2024-08-18T21:53:28.644 INFO:root:teuthology version: 1.2.0 2024-08-18T21:53:28.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-18T21:53:28.757 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859907 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/misc}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7859907' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 78215f5a1cf5eaf321d506a66539942e12851f34 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1664 sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 sleep_before_teardown: 0 subset: 36/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 78215f5a1cf5eaf321d506a66539942e12851f34 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP8saTHOTXw31e5qxskjOj0+5MbtS4/3AnCQ8glNw3g4eLwi8JVC7dyxJHUns8gUeVaqWuGIzjndingQV8R+9Zs= smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJJBulijP4kMBb/Cs0TfqkhN8iqQGO1MdkurWw/Cn+1erc8F9EpjkznWN4/IrjXiZ1X2Oue6YLokXN2IKNMhvsc= smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC7cYgArrexw5wsMfW7mKR0fWU8oUp+X5JkmYyy8KMNiSU7RXw4pq6ivblDM7lPHZX305xqF6XetrA7DKX1tPaw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - fs/misc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-18_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-18T21:53:28.757 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa; will attempt to use it 2024-08-18T21:53:28.758 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks 2024-08-18T21:53:28.758 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-18T21:53:28.759 INFO:teuthology.task.internal:Checking packages... 2024-08-18T21:53:28.781 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'de09dd018de4baddfa6ca4d43bc8fb784cf75833' 2024-08-18T21:53:28.781 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-18T21:53:28.781 INFO:teuthology.packaging:ref: None 2024-08-18T21:53:28.781 INFO:teuthology.packaging:tag: None 2024-08-18T21:53:28.781 INFO:teuthology.packaging:branch: squid 2024-08-18T21:53:28.781 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T21:53:28.781 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-08-18T21:53:28.999 INFO:teuthology.task.internal:Found packages for ceph version 19.1.0-1382.gde09dd01 2024-08-18T21:53:29.000 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-18T21:53:29.006 INFO:teuthology.task.internal:no buildpackages task found 2024-08-18T21:53:29.006 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-18T21:53:29.011 INFO:teuthology.task.internal:Saving configuration 2024-08-18T21:53:29.029 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-18T21:53:29.035 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-18T21:53:29.062 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859907', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-18 21:48:33.941137', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP8saTHOTXw31e5qxskjOj0+5MbtS4/3AnCQ8glNw3g4eLwi8JVC7dyxJHUns8gUeVaqWuGIzjndingQV8R+9Zs='} 2024-08-18T21:53:29.085 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859907', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-18 21:48:33.937953', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJJBulijP4kMBb/Cs0TfqkhN8iqQGO1MdkurWw/Cn+1erc8F9EpjkznWN4/IrjXiZ1X2Oue6YLokXN2IKNMhvsc='} 2024-08-18T21:53:29.107 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859907', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-18 21:48:33.939822', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC7cYgArrexw5wsMfW7mKR0fWU8oUp+X5JkmYyy8KMNiSU7RXw4pq6ivblDM7lPHZX305xqF6XetrA7DKX1tPaw='} 2024-08-18T21:53:29.107 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-18T21:53:29.113 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-08-18T21:53:29.113 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-08-18T21:53:29.113 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-08-18T21:53:29.113 INFO:teuthology.run_tasks:Running task console_log... 2024-08-18T21:53:29.193 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5a67357be0>, signals=[15]) 2024-08-18T21:53:29.193 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-18T21:53:29.198 INFO:teuthology.task.internal:Opening connections... 2024-08-18T21:53:29.198 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2024-08-18T21:53:29.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T21:53:29.277 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2024-08-18T21:53:29.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T21:53:29.354 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2024-08-18T21:53:29.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T21:53:29.427 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-18T21:53:29.433 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-08-18T21:53:29.452 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-08-18T21:53:29.452 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-08-18T21:53:29.510 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2024-08-18T21:53:29.510 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2024-08-18T21:53:29.510 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2024-08-18T21:53:29.510 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2024-08-18T21:53:29.510 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2024-08-18T21:53:29.511 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2024-08-18T21:53:29.511 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-18T21:53:29.511 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2024-08-18T21:53:29.511 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2024-08-18T21:53:29.511 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-18T21:53:29.511 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2024-08-18T21:53:29.511 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-18T21:53:29.511 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-18T21:53:29.511 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-18T21:53:29.512 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-08-18T21:53:29.534 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2024-08-18T21:53:29.553 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2024-08-18T21:53:29.553 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-08-18T21:53:29.611 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2024-08-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2024-08-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2024-08-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2024-08-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2024-08-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2024-08-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2024-08-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2024-08-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2024-08-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-18T21:53:29.613 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-18T21:53:29.613 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-08-18T21:53:29.634 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2024-08-18T21:53:29.653 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2024-08-18T21:53:29.653 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2024-08-18T21:53:29.710 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2024-08-18T21:53:29.710 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2024-08-18T21:53:29.711 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2024-08-18T21:53:29.711 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2024-08-18T21:53:29.711 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2024-08-18T21:53:29.711 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2024-08-18T21:53:29.711 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-18T21:53:29.711 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2024-08-18T21:53:29.711 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2024-08-18T21:53:29.711 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-18T21:53:29.711 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2024-08-18T21:53:29.711 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-18T21:53:29.711 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-18T21:53:29.711 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-18T21:53:29.712 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2024-08-18T21:53:29.734 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-18T21:53:29.743 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-18T21:53:29.748 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-18T21:53:29.749 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2024-08-18T21:53:29.751 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2024-08-18T21:53:29.753 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2024-08-18T21:53:29.769 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-18T21:53:29.775 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-18T21:53:29.775 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2024-08-18T21:53:29.808 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2024-08-18T21:53:29.811 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2024-08-18T21:53:29.837 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-18T21:53:29.915 INFO:teuthology.run_tasks:Running task kernel... 2024-08-18T21:53:29.929 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-18T21:53:29.929 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-08-18T21:53:29.930 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-08-18T21:53:29.930 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-18T21:53:29.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T21:53:29.948 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-08-18T21:53:30.005 INFO:teuthology.orchestra.run.smithi123.stdout:5.14.0-480.el9.x86_64 2024-08-18T21:53:30.005 INFO:teuthology.task.kernel:Running kernel on smithi123: 5.14.0-480.el9.x86_64 2024-08-18T21:53:30.006 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum install -y kernel 2024-08-18T21:53:32.449 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-08-18T21:53:36.741 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 20 MB 00:03 2024-08-18T21:53:40.975 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.6 MB 00:00 2024-08-18T21:53:42.609 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 18 kB 00:00 2024-08-18T21:53:43.771 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 21 MB/s | 22 MB 00:01 2024-08-18T21:53:49.135 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-18T21:53:51.100 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-18T21:53:51.100 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-5.14.0-480.el9.x86_64 is already installed. 2024-08-18T21:53:51.181 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-08-18T21:53:51.182 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-08-18T21:53:51.182 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-08-18T21:53:51.287 DEBUG:teuthology.orchestra.run.smithi123:> echo no | sudo yum reinstall kernel || true 2024-08-18T21:53:51.805 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:02 ago on Sun 18 Aug 2024 09:53:49 PM UTC. 2024-08-18T21:53:51.958 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-08-18T21:53:51.965 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-08-18T21:53:51.965 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-08-18T21:53:51.965 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-08-18T21:53:51.965 INFO:teuthology.orchestra.run.smithi123.stdout:Reinstalling: 2024-08-18T21:53:51.965 INFO:teuthology.orchestra.run.smithi123.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-18T21:53:51.965 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:53:51.965 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-08-18T21:53:51.965 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-08-18T21:53:51.965 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:53:51.965 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 1.5 M 2024-08-18T21:53:51.965 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 0 2024-08-18T21:53:51.966 INFO:teuthology.orchestra.run.smithi123.stderr:Operation aborted. 2024-08-18T21:53:52.019 INFO:teuthology.orchestra.run.smithi123.stdout:Is this ok [y/N]: 2024-08-18T21:53:52.020 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum reinstall -y kernel || true 2024-08-18T21:53:52.534 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:03 ago on Sun 18 Aug 2024 09:53:49 PM UTC. 2024-08-18T21:53:52.656 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-08-18T21:53:52.657 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-08-18T21:53:52.657 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-08-18T21:53:52.657 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-08-18T21:53:52.657 INFO:teuthology.orchestra.run.smithi123.stdout:Reinstalling: 2024-08-18T21:53:52.657 INFO:teuthology.orchestra.run.smithi123.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-18T21:53:52.657 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:53:52.657 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-08-18T21:53:52.657 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-08-18T21:53:52.657 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:53:52.657 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 1.5 M 2024-08-18T21:53:52.657 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 0 2024-08-18T21:53:52.657 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-08-18T21:53:52.996 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-5.14.0-480.el9.x86_64.rpm 5.2 MB/s | 1.5 MB 00:00 2024-08-18T21:53:52.996 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-08-18T21:53:52.996 INFO:teuthology.orchestra.run.smithi123.stdout:Total 4.5 MB/s | 1.5 MB 00:00 2024-08-18T21:53:53.031 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-08-18T21:53:53.275 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-08-18T21:53:53.275 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-08-18T21:53:53.299 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-08-18T21:53:53.300 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-08-18T21:53:53.447 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-08-18T21:53:53.522 INFO:teuthology.orchestra.run.smithi123.stdout: Reinstalling : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-18T21:53:53.523 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T21:53:54.284 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T21:53:54.284 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-18T21:53:55.044 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T21:53:55.044 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:53:55.044 INFO:teuthology.orchestra.run.smithi123.stdout:Reinstalled: 2024-08-18T21:53:55.044 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-5.14.0-480.el9.x86_64 2024-08-18T21:53:55.045 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:53:55.045 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-08-18T21:53:55.209 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q kernel | sort -rV | head -n 1 2024-08-18T21:53:55.265 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-18T21:53:55.266 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-18T21:53:55.266 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-18T21:53:55.266 DEBUG:teuthology.parallel:result is None 2024-08-18T21:53:55.266 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-18T21:53:55.276 INFO:teuthology.task.internal:Creating test directory... 2024-08-18T21:53:55.277 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-18T21:53:55.279 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-18T21:53:55.282 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-18T21:53:55.301 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-18T21:53:55.307 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-18T21:53:55.313 INFO:teuthology.task.internal:Creating archive directory... 2024-08-18T21:53:55.313 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-18T21:53:55.335 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-18T21:53:55.340 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-18T21:53:55.376 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-18T21:53:55.382 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-18T21:53:55.382 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-18T21:53:55.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T21:53:55.425 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-18T21:53:55.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T21:53:55.443 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-18T21:53:55.446 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-18T21:53:55.469 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-18T21:53:55.479 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T21:53:55.497 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T21:53:55.500 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T21:53:55.512 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T21:53:55.520 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T21:53:55.539 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T21:53:55.541 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-18T21:53:55.549 INFO:teuthology.task.internal:Configuring sudo... 2024-08-18T21:53:55.549 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-18T21:53:55.552 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-18T21:53:55.556 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-18T21:53:55.608 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-18T21:53:55.616 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-18T21:53:55.616 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-18T21:53:55.619 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-18T21:53:55.623 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-18T21:53:55.664 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T21:53:55.712 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T21:53:55.766 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T21:53:55.844 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T21:53:55.887 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T21:53:55.887 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-18T21:53:55.952 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T21:53:55.995 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T21:53:56.077 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T21:53:56.115 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T21:53:56.160 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-18T21:53:56.160 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-18T21:53:56.225 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T21:53:56.267 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T21:53:56.332 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T21:53:56.373 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T21:53:56.418 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-08-18T21:53:56.418 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-18T21:53:56.484 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2024-08-18T21:53:56.486 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2024-08-18T21:53:56.489 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2024-08-18T21:53:56.546 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T21:53:56.553 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T21:53:56.561 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T21:53:56.800 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-18T21:53:56.807 INFO:teuthology.task.internal:Starting timer... 2024-08-18T21:53:56.808 INFO:teuthology.run_tasks:Running task pcp... 2024-08-18T21:53:56.817 INFO:teuthology.run_tasks:Running task selinux... 2024-08-18T21:53:56.825 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-08-18T21:53:56.825 DEBUG:teuthology.orchestra.run.smithi123:> sudo service auditd rotate 2024-08-18T21:53:56.902 INFO:teuthology.orchestra.run.smithi123.stdout:Rotating logs: 2024-08-18T21:53:56.904 DEBUG:teuthology.orchestra.run.smithi130:> sudo service auditd rotate 2024-08-18T21:53:56.958 INFO:teuthology.orchestra.run.smithi130.stdout:Rotating logs: 2024-08-18T21:53:56.960 DEBUG:teuthology.orchestra.run.smithi183:> sudo service auditd rotate 2024-08-18T21:53:57.019 INFO:teuthology.orchestra.run.smithi183.stdout:Rotating logs: 2024-08-18T21:53:57.021 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-18T21:53:57.021 DEBUG:teuthology.orchestra.run.smithi123:> /usr/sbin/getenforce 2024-08-18T21:53:57.040 INFO:teuthology.orchestra.run.smithi123.stdout:Permissive 2024-08-18T21:53:57.041 DEBUG:teuthology.orchestra.run.smithi130:> /usr/sbin/getenforce 2024-08-18T21:53:57.074 INFO:teuthology.orchestra.run.smithi130.stdout:Permissive 2024-08-18T21:53:57.074 DEBUG:teuthology.orchestra.run.smithi183:> /usr/sbin/getenforce 2024-08-18T21:53:57.098 INFO:teuthology.orchestra.run.smithi183.stdout:Permissive 2024-08-18T21:53:57.098 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi123.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi130.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi183.front.sepia.ceph.com': 'permissive'} 2024-08-18T21:53:57.099 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T21:53:57.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T21:53:57.124 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T21:53:57.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T21:53:57.151 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T21:53:57.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T21:53:57.176 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-18T21:53:57.177 DEBUG:teuthology.orchestra.run.smithi123:> sudo /usr/sbin/setenforce permissive 2024-08-18T21:53:57.201 DEBUG:teuthology.orchestra.run.smithi130:> sudo /usr/sbin/setenforce permissive 2024-08-18T21:53:57.228 DEBUG:teuthology.orchestra.run.smithi183:> sudo /usr/sbin/setenforce permissive 2024-08-18T21:53:57.276 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-18T21:53:57.285 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-18T21:53:57.288 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-18T21:53:57.401 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-18T21:53:57.412 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-18T21:53:57.413 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi123.front.sepia.ceph.com,smithi130.front.sepia.ceph.com,smithi183.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-18T21:55:58.495 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi123.front.sepia.ceph.com'), Remote(name='ubuntu@smithi130.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com')] 2024-08-18T21:55:58.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-08-18T21:55:58.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T21:55:58.575 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-08-18T21:55:58.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-08-18T21:55:58.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-08-18T21:55:58.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T21:55:58.734 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-08-18T21:55:58.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-08-18T21:55:58.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-08-18T21:55:58.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T21:55:58.889 DEBUG:teuthology.orchestra.run.smithi183:> true 2024-08-18T21:55:58.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-08-18T21:55:58.966 INFO:teuthology.run_tasks:Running task clock... 2024-08-18T21:55:58.976 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-18T21:55:58.976 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-18T21:55:58.977 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T21:55:58.980 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-18T21:55:58.980 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T21:55:58.982 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-18T21:55:58.982 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T21:55:59.008 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-18T21:55:59.011 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-18T21:55:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-18T21:55:59.026 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-18T21:55:59.036 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-18T21:55:59.048 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: ntpd: command not found 2024-08-18T21:55:59.051 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-18T21:55:59.051 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: ntpd: command not found 2024-08-18T21:55:59.059 INFO:teuthology.orchestra.run.smithi123.stdout:506 Cannot talk to daemon 2024-08-18T21:55:59.063 INFO:teuthology.orchestra.run.smithi130.stdout:506 Cannot talk to daemon 2024-08-18T21:55:59.073 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-18T21:55:59.075 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: ntpd: command not found 2024-08-18T21:55:59.077 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-18T21:55:59.086 INFO:teuthology.orchestra.run.smithi183.stdout:506 Cannot talk to daemon 2024-08-18T21:55:59.087 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-18T21:55:59.091 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-18T21:55:59.101 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-18T21:55:59.115 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-18T21:55:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-08-18T21:55:59.145 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-18T21:55:59.145 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-08-18T21:55:59.145 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T21:55:59.146 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T21:55:59.146 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T21:55:59.146 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T21:55:59.149 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-08-18T21:55:59.153 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-18T21:55:59.153 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-08-18T21:55:59.153 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T21:55:59.153 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T21:55:59.153 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T21:55:59.153 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T21:55:59.173 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2024-08-18T21:55:59.176 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-18T21:55:59.176 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-08-18T21:55:59.176 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T21:55:59.176 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T21:55:59.176 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T21:55:59.176 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T21:55:59.177 INFO:teuthology.run_tasks:Running task install... 2024-08-18T21:55:59.185 DEBUG:teuthology.task.install:project ceph 2024-08-18T21:55:59.185 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}} 2024-08-18T21:55:59.185 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'} 2024-08-18T21:55:59.185 INFO:teuthology.task.install:Using flavor: default 2024-08-18T21:55:59.190 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-18T21:55:59.191 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-18T21:55:59.191 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'tag': None, 'wait_for_package': False} 2024-08-18T21:55:59.192 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T21:55:59.194 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'tag': None, 'wait_for_package': False} 2024-08-18T21:55:59.194 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T21:55:59.195 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'tag': None, 'wait_for_package': False} 2024-08-18T21:55:59.196 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T21:55:59.338 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/ 2024-08-18T21:55:59.339 INFO:teuthology.task.install.rpm:Package version is 19.1.0-1382.gde09dd01 2024-08-18T21:55:59.345 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/ 2024-08-18T21:55:59.345 INFO:teuthology.task.install.rpm:Package version is 19.1.0-1382.gde09dd01 2024-08-18T21:55:59.349 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/ 2024-08-18T21:55:59.349 INFO:teuthology.task.install.rpm:Package version is 19.1.0-1382.gde09dd01 2024-08-18T21:55:59.447 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-18T21:55:59.447 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T21:55:59.447 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-18T21:55:59.456 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-18T21:55:59.457 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-08-18T21:55:59.457 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-18T21:55:59.462 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-18T21:55:59.462 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-18T21:55:59.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-18T21:55:59.473 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-18T21:55:59.473 DEBUG:teuthology.orchestra.run.smithi123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/de09dd018de4baddfa6ca4d43bc8fb784cf75833/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-18T21:55:59.482 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-18T21:55:59.483 DEBUG:teuthology.orchestra.run.smithi183:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/de09dd018de4baddfa6ca4d43bc8fb784cf75833/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-18T21:55:59.488 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-18T21:55:59.488 DEBUG:teuthology.orchestra.run.smithi130:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/de09dd018de4baddfa6ca4d43bc8fb784cf75833/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-18T21:55:59.538 DEBUG:teuthology.orchestra.run.smithi123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-18T21:55:59.549 DEBUG:teuthology.orchestra.run.smithi183:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-18T21:55:59.555 DEBUG:teuthology.orchestra.run.smithi130:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-18T21:55:59.613 DEBUG:teuthology.orchestra.run.smithi123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-18T21:55:59.624 DEBUG:teuthology.orchestra.run.smithi183:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-18T21:55:59.631 DEBUG:teuthology.orchestra.run.smithi130:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-18T21:55:59.678 INFO:teuthology.orchestra.run.smithi123.stdout:check_obsoletes = 1 2024-08-18T21:55:59.679 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum clean all 2024-08-18T21:55:59.688 INFO:teuthology.orchestra.run.smithi183.stdout:check_obsoletes = 1 2024-08-18T21:55:59.690 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum clean all 2024-08-18T21:55:59.698 INFO:teuthology.orchestra.run.smithi130.stdout:check_obsoletes = 1 2024-08-18T21:55:59.698 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum clean all 2024-08-18T21:55:59.904 INFO:teuthology.orchestra.run.smithi123.stdout:45 files removed 2024-08-18T21:55:59.914 INFO:teuthology.orchestra.run.smithi183.stdout:45 files removed 2024-08-18T21:55:59.922 INFO:teuthology.orchestra.run.smithi130.stdout:45 files removed 2024-08-18T21:55:59.931 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-18T21:55:59.941 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-18T21:55:59.949 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-18T21:56:00.479 INFO:teuthology.orchestra.run.smithi123.stdout:ceph packages for x86_64 302 kB/s | 84 kB 00:00 2024-08-18T21:56:00.489 INFO:teuthology.orchestra.run.smithi130.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-08-18T21:56:00.490 INFO:teuthology.orchestra.run.smithi183.stdout:ceph packages for x86_64 306 kB/s | 84 kB 00:00 2024-08-18T21:56:00.763 INFO:teuthology.orchestra.run.smithi123.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-08-18T21:56:00.773 INFO:teuthology.orchestra.run.smithi130.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-08-18T21:56:00.773 INFO:teuthology.orchestra.run.smithi183.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-08-18T21:56:01.039 INFO:teuthology.orchestra.run.smithi123.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-08-18T21:56:01.048 INFO:teuthology.orchestra.run.smithi130.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-08-18T21:56:01.049 INFO:teuthology.orchestra.run.smithi183.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-08-18T21:56:01.707 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-08-18T21:56:01.791 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-18T21:56:02.564 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.2 MB 00:01 2024-08-18T21:56:05.058 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 20 MB 00:02 2024-08-18T21:56:05.890 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 20 MB 00:02 2024-08-18T21:56:06.258 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 5.9 MB/s | 20 MB 00:03 2024-08-18T21:56:09.367 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.6 MB 00:00 2024-08-18T21:56:10.107 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.6 MB 00:00 2024-08-18T21:56:11.101 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 18 kB 00:00 2024-08-18T21:56:11.334 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.6 MB 00:01 2024-08-18T21:56:11.966 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 18 kB 00:00 2024-08-18T21:56:11.972 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-18T21:56:12.820 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 31 MB/s | 22 MB 00:00 2024-08-18T21:56:12.893 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 18 kB 00:00 2024-08-18T21:56:13.763 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-18T21:56:17.344 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-18T21:56:18.284 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-18T21:56:19.319 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-18T21:56:19.513 INFO:teuthology.orchestra.run.smithi130.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-18T21:56:19.514 INFO:teuthology.orchestra.run.smithi130.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-18T21:56:19.525 INFO:teuthology.orchestra.run.smithi130.stdout:Package NetworkManager-1:1.48.2-2.el9.x86_64 is already installed. 2024-08-18T21:56:19.526 INFO:teuthology.orchestra.run.smithi130.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-18T21:56:19.527 INFO:teuthology.orchestra.run.smithi130.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-18T21:56:19.528 INFO:teuthology.orchestra.run.smithi130.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-18T21:56:19.529 INFO:teuthology.orchestra.run.smithi130.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-18T21:56:19.532 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-18T21:56:19.533 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsprogs-6.4.0-3.el9.x86_64 is already installed. 2024-08-18T21:56:19.594 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-08-18T21:56:19.622 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================= 2024-08-18T21:56:19.622 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2024-08-18T21:56:19.622 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================= 2024-08-18T21:56:19.623 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2024-08-18T21:56:19.623 INFO:teuthology.orchestra.run.smithi130.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-18T21:56:19.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 6.6 k 2024-08-18T21:56:19.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-18T21:56:19.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 896 k 2024-08-18T21:56:19.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 145 k 2024-08-18T21:56:19.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 1.5 M 2024-08-18T21:56:19.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 146 k 2024-08-18T21:56:19.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 3.6 M 2024-08-18T21:56:19.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 7.4 M 2024-08-18T21:56:19.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 49 k 2024-08-18T21:56:19.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 11 M 2024-08-18T21:56:19.624 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 49 M 2024-08-18T21:56:19.624 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 285 k 2024-08-18T21:56:19.624 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 766 k 2024-08-18T21:56:19.624 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 225 k 2024-08-18T21:56:19.624 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-shell x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 27 k 2024-08-18T21:56:19.624 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 18 k 2024-08-18T21:56:19.624 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-18T21:56:19.624 INFO:teuthology.orchestra.run.smithi130.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-18T21:56:19.624 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-18T21:56:19.624 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 32 k 2024-08-18T21:56:19.624 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 753 k 2024-08-18T21:56:19.625 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 127 k 2024-08-18T21:56:19.625 INFO:teuthology.orchestra.run.smithi130.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-18T21:56:19.625 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-18T21:56:19.625 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-18T21:56:19.625 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-08-18T21:56:19.625 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-08-18T21:56:19.625 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-08-18T21:56:19.625 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 188 k 2024-08-18T21:56:19.625 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 369 k 2024-08-18T21:56:19.625 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 350 k 2024-08-18T21:56:19.625 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 117 k 2024-08-18T21:56:19.625 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 85 k 2024-08-18T21:56:19.625 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.1 M 2024-08-18T21:56:19.625 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 170 k 2024-08-18T21:56:19.626 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-18T21:56:19.626 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrading: 2024-08-18T21:56:19.626 INFO:teuthology.orchestra.run.smithi130.stdout: librados2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.4 M 2024-08-18T21:56:19.626 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.2 M 2024-08-18T21:56:19.626 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2024-08-18T21:56:19.626 INFO:teuthology.orchestra.run.smithi130.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-18T21:56:19.626 INFO:teuthology.orchestra.run.smithi130.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-18T21:56:19.626 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-18T21:56:19.626 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 21 M 2024-08-18T21:56:19.626 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 32 k 2024-08-18T21:56:19.626 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 2.4 M 2024-08-18T21:56:19.626 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 249 k 2024-08-18T21:56:19.627 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 4.7 M 2024-08-18T21:56:19.627 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 17 M 2024-08-18T21:56:19.627 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 16 k 2024-08-18T21:56:19.627 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 25 k 2024-08-18T21:56:19.627 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-18T21:56:19.627 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-18T21:56:19.627 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-18T21:56:19.627 INFO:teuthology.orchestra.run.smithi130.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-18T21:56:19.627 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-18T21:56:19.627 INFO:teuthology.orchestra.run.smithi130.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-18T21:56:19.627 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-18T21:56:19.627 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-18T21:56:19.628 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 163 k 2024-08-18T21:56:19.628 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-18T21:56:19.628 INFO:teuthology.orchestra.run.smithi130.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-18T21:56:19.628 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-18T21:56:19.628 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-18T21:56:19.628 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-18T21:56:19.628 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 507 k 2024-08-18T21:56:19.628 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-18T21:56:19.628 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-18T21:56:19.628 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-18T21:56:19.628 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-18T21:56:19.628 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-18T21:56:19.628 INFO:teuthology.orchestra.run.smithi130.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-18T21:56:19.629 INFO:teuthology.orchestra.run.smithi130.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-18T21:56:19.629 INFO:teuthology.orchestra.run.smithi130.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-18T21:56:19.629 INFO:teuthology.orchestra.run.smithi130.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-18T21:56:19.629 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-18T21:56:19.629 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-18T21:56:19.629 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-08-18T21:56:19.629 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-18T21:56:19.629 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-18T21:56:19.629 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-18T21:56:19.629 INFO:teuthology.orchestra.run.smithi130.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-18T21:56:19.629 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-18T21:56:19.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-18T21:56:19.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-18T21:56:19.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 45 k 2024-08-18T21:56:19.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 136 k 2024-08-18T21:56:19.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-18T21:56:19.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-18T21:56:19.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-18T21:56:19.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-18T21:56:19.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-18T21:56:19.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-18T21:56:19.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-18T21:56:19.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-18T21:56:19.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-18T21:56:19.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-18T21:56:19.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-18T21:56:19.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-18T21:56:19.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-18T21:56:19.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-18T21:56:19.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-18T21:56:19.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-18T21:56:19.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-18T21:56:19.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-18T21:56:19.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-18T21:56:19.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-18T21:56:19.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-18T21:56:19.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-18T21:56:19.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-18T21:56:19.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-18T21:56:19.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-18T21:56:19.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-18T21:56:19.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-18T21:56:19.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-18T21:56:19.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-18T21:56:19.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-18T21:56:19.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-18T21:56:19.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-18T21:56:19.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-18T21:56:19.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-18T21:56:19.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-18T21:56:19.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-18T21:56:19.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-18T21:56:19.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-18T21:56:19.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-18T21:56:19.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-18T21:56:19.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-18T21:56:19.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-18T21:56:19.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-18T21:56:19.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-18T21:56:19.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-18T21:56:19.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-18T21:56:19.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-18T21:56:19.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-18T21:56:19.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-18T21:56:19.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-18T21:56:19.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-18T21:56:19.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-18T21:56:19.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-18T21:56:19.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-18T21:56:19.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-18T21:56:19.634 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-18T21:56:19.634 INFO:teuthology.orchestra.run.smithi130.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-18T21:56:19.634 INFO:teuthology.orchestra.run.smithi130.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-18T21:56:19.634 INFO:teuthology.orchestra.run.smithi130.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-18T21:56:19.635 INFO:teuthology.orchestra.run.smithi130.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-18T21:56:19.635 INFO:teuthology.orchestra.run.smithi130.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-18T21:56:19.635 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-18T21:56:19.635 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-18T21:56:19.635 INFO:teuthology.orchestra.run.smithi130.stdout:Installing weak dependencies: 2024-08-18T21:56:19.635 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-18T21:56:19.635 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T21:56:19.635 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2024-08-18T21:56:19.635 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================= 2024-08-18T21:56:19.635 INFO:teuthology.orchestra.run.smithi130.stdout:Install 148 Packages 2024-08-18T21:56:19.635 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrade 2 Packages 2024-08-18T21:56:19.635 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T21:56:19.636 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 218 M 2024-08-18T21:56:19.636 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2024-08-18T21:56:20.388 INFO:teuthology.orchestra.run.smithi130.stdout:(1/150): ceph-19.1.0-1382.gde09dd01.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-08-18T21:56:20.461 INFO:teuthology.orchestra.run.smithi123.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-18T21:56:20.462 INFO:teuthology.orchestra.run.smithi123.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-18T21:56:20.473 INFO:teuthology.orchestra.run.smithi123.stdout:Package NetworkManager-1:1.48.2-2.el9.x86_64 is already installed. 2024-08-18T21:56:20.474 INFO:teuthology.orchestra.run.smithi123.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-18T21:56:20.475 INFO:teuthology.orchestra.run.smithi123.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-18T21:56:20.476 INFO:teuthology.orchestra.run.smithi123.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-18T21:56:20.477 INFO:teuthology.orchestra.run.smithi123.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-18T21:56:20.480 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-18T21:56:20.481 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsprogs-6.4.0-3.el9.x86_64 is already installed. 2024-08-18T21:56:20.540 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-08-18T21:56:20.549 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-08-18T21:56:20.549 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-08-18T21:56:20.549 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-08-18T21:56:20.549 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-08-18T21:56:20.549 INFO:teuthology.orchestra.run.smithi123.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-18T21:56:20.549 INFO:teuthology.orchestra.run.smithi123.stdout: ceph x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 6.6 k 2024-08-18T21:56:20.549 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-18T21:56:20.549 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 896 k 2024-08-18T21:56:20.550 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 145 k 2024-08-18T21:56:20.550 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 1.5 M 2024-08-18T21:56:20.550 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 146 k 2024-08-18T21:56:20.550 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 3.6 M 2024-08-18T21:56:20.550 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 7.4 M 2024-08-18T21:56:20.550 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 49 k 2024-08-18T21:56:20.550 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 11 M 2024-08-18T21:56:20.550 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 49 M 2024-08-18T21:56:20.550 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 285 k 2024-08-18T21:56:20.550 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 766 k 2024-08-18T21:56:20.550 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 225 k 2024-08-18T21:56:20.550 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-shell x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 27 k 2024-08-18T21:56:20.551 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 18 k 2024-08-18T21:56:20.551 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-18T21:56:20.551 INFO:teuthology.orchestra.run.smithi123.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-18T21:56:20.551 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-18T21:56:20.551 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 32 k 2024-08-18T21:56:20.551 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 753 k 2024-08-18T21:56:20.551 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 127 k 2024-08-18T21:56:20.551 INFO:teuthology.orchestra.run.smithi123.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-18T21:56:20.551 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-18T21:56:20.551 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-18T21:56:20.551 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-08-18T21:56:20.551 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-08-18T21:56:20.551 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-08-18T21:56:20.552 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 188 k 2024-08-18T21:56:20.552 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 369 k 2024-08-18T21:56:20.552 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 350 k 2024-08-18T21:56:20.552 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 117 k 2024-08-18T21:56:20.552 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 85 k 2024-08-18T21:56:20.552 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.1 M 2024-08-18T21:56:20.552 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 170 k 2024-08-18T21:56:20.552 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-18T21:56:20.552 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2024-08-18T21:56:20.552 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.4 M 2024-08-18T21:56:20.552 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.2 M 2024-08-18T21:56:20.552 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-08-18T21:56:20.552 INFO:teuthology.orchestra.run.smithi123.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-18T21:56:20.552 INFO:teuthology.orchestra.run.smithi123.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-18T21:56:20.553 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-18T21:56:20.553 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 21 M 2024-08-18T21:56:20.553 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 32 k 2024-08-18T21:56:20.553 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 2.4 M 2024-08-18T21:56:20.553 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 249 k 2024-08-18T21:56:20.553 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 4.7 M 2024-08-18T21:56:20.553 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 17 M 2024-08-18T21:56:20.553 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 16 k 2024-08-18T21:56:20.553 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 25 k 2024-08-18T21:56:20.553 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-18T21:56:20.554 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-18T21:56:20.554 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-18T21:56:20.554 INFO:teuthology.orchestra.run.smithi123.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-18T21:56:20.554 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-18T21:56:20.554 INFO:teuthology.orchestra.run.smithi123.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-18T21:56:20.554 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-18T21:56:20.554 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-18T21:56:20.554 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 163 k 2024-08-18T21:56:20.554 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-18T21:56:20.554 INFO:teuthology.orchestra.run.smithi123.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-18T21:56:20.554 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-18T21:56:20.554 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-18T21:56:20.555 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-18T21:56:20.555 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 507 k 2024-08-18T21:56:20.555 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-18T21:56:20.555 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-18T21:56:20.555 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-18T21:56:20.555 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-18T21:56:20.555 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-18T21:56:20.555 INFO:teuthology.orchestra.run.smithi123.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-18T21:56:20.555 INFO:teuthology.orchestra.run.smithi123.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-18T21:56:20.555 INFO:teuthology.orchestra.run.smithi123.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-18T21:56:20.555 INFO:teuthology.orchestra.run.smithi123.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-18T21:56:20.555 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-18T21:56:20.555 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-18T21:56:20.555 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-08-18T21:56:20.556 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-18T21:56:20.556 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-18T21:56:20.556 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-18T21:56:20.556 INFO:teuthology.orchestra.run.smithi123.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-18T21:56:20.556 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-18T21:56:20.556 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-18T21:56:20.556 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-18T21:56:20.556 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 45 k 2024-08-18T21:56:20.556 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 136 k 2024-08-18T21:56:20.556 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-18T21:56:20.556 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-18T21:56:20.556 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-18T21:56:20.556 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-18T21:56:20.557 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-18T21:56:20.557 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-18T21:56:20.557 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-18T21:56:20.557 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-18T21:56:20.557 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-18T21:56:20.557 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-18T21:56:20.557 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-18T21:56:20.557 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-18T21:56:20.557 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-18T21:56:20.557 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-18T21:56:20.557 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-18T21:56:20.557 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-18T21:56:20.557 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-18T21:56:20.558 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-18T21:56:20.558 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-18T21:56:20.558 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-18T21:56:20.558 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-18T21:56:20.558 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-18T21:56:20.558 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-18T21:56:20.558 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-18T21:56:20.558 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-18T21:56:20.558 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-18T21:56:20.558 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-18T21:56:20.558 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-18T21:56:20.558 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-18T21:56:20.558 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-18T21:56:20.559 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-18T21:56:20.559 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-18T21:56:20.559 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-18T21:56:20.559 INFO:teuthology.orchestra.run.smithi123.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-18T21:56:20.559 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-18T21:56:20.559 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-18T21:56:20.559 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-18T21:56:20.559 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-18T21:56:20.559 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-18T21:56:20.559 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-18T21:56:20.559 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-18T21:56:20.559 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-18T21:56:20.559 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-18T21:56:20.560 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-18T21:56:20.560 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-18T21:56:20.560 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-18T21:56:20.560 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-18T21:56:20.560 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-18T21:56:20.560 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-18T21:56:20.560 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-18T21:56:20.560 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-18T21:56:20.560 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-18T21:56:20.560 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-18T21:56:20.560 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-18T21:56:20.560 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-18T21:56:20.560 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-18T21:56:20.561 INFO:teuthology.orchestra.run.smithi123.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-18T21:56:20.561 INFO:teuthology.orchestra.run.smithi123.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-18T21:56:20.561 INFO:teuthology.orchestra.run.smithi123.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-18T21:56:20.561 INFO:teuthology.orchestra.run.smithi123.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-18T21:56:20.561 INFO:teuthology.orchestra.run.smithi123.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-18T21:56:20.561 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-18T21:56:20.561 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-18T21:56:20.561 INFO:teuthology.orchestra.run.smithi123.stdout:Installing weak dependencies: 2024-08-18T21:56:20.561 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-18T21:56:20.561 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:56:20.561 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-08-18T21:56:20.561 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-08-18T21:56:20.561 INFO:teuthology.orchestra.run.smithi123.stdout:Install 148 Packages 2024-08-18T21:56:20.561 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 2 Packages 2024-08-18T21:56:20.562 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:56:20.562 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 218 M 2024-08-18T21:56:20.562 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-08-18T21:56:20.563 INFO:teuthology.orchestra.run.smithi130.stdout:(2/150): ceph-fuse-19.1.0-1382.gde09dd01.el9.x8 5.0 MB/s | 896 kB 00:00 2024-08-18T21:56:20.638 INFO:teuthology.orchestra.run.smithi130.stdout:(3/150): ceph-immutable-object-cache-19.1.0-138 1.9 MB/s | 145 kB 00:00 2024-08-18T21:56:20.713 INFO:teuthology.orchestra.run.smithi130.stdout:(4/150): ceph-base-19.1.0-1382.gde09dd01.el9.x8 12 MB/s | 5.4 MB 00:00 2024-08-18T21:56:20.864 INFO:teuthology.orchestra.run.smithi130.stdout:(5/150): ceph-mgr-19.1.0-1382.gde09dd01.el9.x86 10 MB/s | 1.5 MB 00:00 2024-08-18T21:56:20.914 INFO:teuthology.orchestra.run.smithi130.stdout:(6/150): ceph-mds-19.1.0-1382.gde09dd01.el9.x86 8.7 MB/s | 2.4 MB 00:00 2024-08-18T21:56:21.139 INFO:teuthology.orchestra.run.smithi130.stdout:(7/150): ceph-mon-19.1.0-1382.gde09dd01.el9.x86 17 MB/s | 4.7 MB 00:00 2024-08-18T21:56:21.381 INFO:teuthology.orchestra.run.smithi130.stdout:(8/150): ceph-common-19.1.0-1382.gde09dd01.el9. 19 MB/s | 21 MB 00:01 2024-08-18T21:56:21.431 INFO:teuthology.orchestra.run.smithi130.stdout:(9/150): ceph-selinux-19.1.0-1382.gde09dd01.el9 506 kB/s | 25 kB 00:00 2024-08-18T21:56:21.489 INFO:teuthology.orchestra.run.smithi183.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-18T21:56:21.490 INFO:teuthology.orchestra.run.smithi183.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-18T21:56:21.503 INFO:teuthology.orchestra.run.smithi183.stdout:Package NetworkManager-1:1.48.2-2.el9.x86_64 is already installed. 2024-08-18T21:56:21.504 INFO:teuthology.orchestra.run.smithi183.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-18T21:56:21.505 INFO:teuthology.orchestra.run.smithi183.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-18T21:56:21.506 INFO:teuthology.orchestra.run.smithi183.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-18T21:56:21.508 INFO:teuthology.orchestra.run.smithi183.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-18T21:56:21.511 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-18T21:56:21.512 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsprogs-6.4.0-3.el9.x86_64 is already installed. 2024-08-18T21:56:21.574 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-08-18T21:56:21.585 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-08-18T21:56:21.585 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-08-18T21:56:21.585 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-08-18T21:56:21.585 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-08-18T21:56:21.585 INFO:teuthology.orchestra.run.smithi183.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-18T21:56:21.585 INFO:teuthology.orchestra.run.smithi183.stdout: ceph x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 6.6 k 2024-08-18T21:56:21.585 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-18T21:56:21.586 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 896 k 2024-08-18T21:56:21.586 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 145 k 2024-08-18T21:56:21.586 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 1.5 M 2024-08-18T21:56:21.586 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 146 k 2024-08-18T21:56:21.586 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 3.6 M 2024-08-18T21:56:21.586 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 7.4 M 2024-08-18T21:56:21.586 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 49 k 2024-08-18T21:56:21.587 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 11 M 2024-08-18T21:56:21.587 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 49 M 2024-08-18T21:56:21.587 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 285 k 2024-08-18T21:56:21.587 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 766 k 2024-08-18T21:56:21.587 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 225 k 2024-08-18T21:56:21.587 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-shell x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 27 k 2024-08-18T21:56:21.587 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 18 k 2024-08-18T21:56:21.587 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-18T21:56:21.587 INFO:teuthology.orchestra.run.smithi183.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-18T21:56:21.587 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-18T21:56:21.587 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 32 k 2024-08-18T21:56:21.587 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 753 k 2024-08-18T21:56:21.587 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 127 k 2024-08-18T21:56:21.588 INFO:teuthology.orchestra.run.smithi183.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-18T21:56:21.588 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-18T21:56:21.588 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-18T21:56:21.588 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-08-18T21:56:21.588 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-08-18T21:56:21.588 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-08-18T21:56:21.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 188 k 2024-08-18T21:56:21.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 369 k 2024-08-18T21:56:21.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 350 k 2024-08-18T21:56:21.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 117 k 2024-08-18T21:56:21.588 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 85 k 2024-08-18T21:56:21.588 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.1 M 2024-08-18T21:56:21.588 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 170 k 2024-08-18T21:56:21.589 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-18T21:56:21.589 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2024-08-18T21:56:21.589 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.4 M 2024-08-18T21:56:21.589 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.2 M 2024-08-18T21:56:21.589 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-08-18T21:56:21.589 INFO:teuthology.orchestra.run.smithi183.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-18T21:56:21.589 INFO:teuthology.orchestra.run.smithi183.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-18T21:56:21.589 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-18T21:56:21.589 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 21 M 2024-08-18T21:56:21.589 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 32 k 2024-08-18T21:56:21.589 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 2.4 M 2024-08-18T21:56:21.589 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 249 k 2024-08-18T21:56:21.590 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 4.7 M 2024-08-18T21:56:21.590 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 17 M 2024-08-18T21:56:21.590 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 16 k 2024-08-18T21:56:21.590 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 25 k 2024-08-18T21:56:21.590 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-18T21:56:21.590 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-18T21:56:21.590 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-18T21:56:21.590 INFO:teuthology.orchestra.run.smithi183.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-18T21:56:21.590 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-18T21:56:21.590 INFO:teuthology.orchestra.run.smithi183.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-18T21:56:21.590 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-18T21:56:21.590 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-18T21:56:21.591 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 163 k 2024-08-18T21:56:21.591 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-18T21:56:21.591 INFO:teuthology.orchestra.run.smithi183.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-18T21:56:21.591 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-18T21:56:21.591 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-18T21:56:21.591 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-18T21:56:21.591 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 507 k 2024-08-18T21:56:21.591 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-18T21:56:21.591 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-18T21:56:21.591 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-18T21:56:21.591 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-18T21:56:21.591 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-18T21:56:21.591 INFO:teuthology.orchestra.run.smithi183.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-18T21:56:21.591 INFO:teuthology.orchestra.run.smithi183.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-18T21:56:21.592 INFO:teuthology.orchestra.run.smithi183.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-18T21:56:21.592 INFO:teuthology.orchestra.run.smithi183.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-18T21:56:21.592 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-18T21:56:21.592 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-18T21:56:21.592 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-08-18T21:56:21.592 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-18T21:56:21.592 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-18T21:56:21.592 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-18T21:56:21.592 INFO:teuthology.orchestra.run.smithi183.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-18T21:56:21.592 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-18T21:56:21.592 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-18T21:56:21.592 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-18T21:56:21.592 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 45 k 2024-08-18T21:56:21.593 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 136 k 2024-08-18T21:56:21.593 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-18T21:56:21.594 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-18T21:56:21.594 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-18T21:56:21.594 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-18T21:56:21.595 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-18T21:56:21.595 INFO:teuthology.orchestra.run.smithi183.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-18T21:56:21.595 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-18T21:56:21.595 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-18T21:56:21.595 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-18T21:56:21.595 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-18T21:56:21.595 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-18T21:56:21.595 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-18T21:56:21.595 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-18T21:56:21.595 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-18T21:56:21.596 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-18T21:56:21.596 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-18T21:56:21.596 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-18T21:56:21.596 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-18T21:56:21.596 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-18T21:56:21.596 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-18T21:56:21.596 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-18T21:56:21.596 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-18T21:56:21.596 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-18T21:56:21.596 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-18T21:56:21.596 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-18T21:56:21.596 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-18T21:56:21.596 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-18T21:56:21.597 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-18T21:56:21.597 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-18T21:56:21.597 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-18T21:56:21.597 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-18T21:56:21.597 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-18T21:56:21.597 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-18T21:56:21.597 INFO:teuthology.orchestra.run.smithi183.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-18T21:56:21.597 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-18T21:56:21.597 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-18T21:56:21.597 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-18T21:56:21.597 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-18T21:56:21.597 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-18T21:56:21.597 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-18T21:56:21.597 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-18T21:56:21.598 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-18T21:56:21.598 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-18T21:56:21.598 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-18T21:56:21.598 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-18T21:56:21.598 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-18T21:56:21.598 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-18T21:56:21.598 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-18T21:56:21.598 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-18T21:56:21.598 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-18T21:56:21.598 INFO:teuthology.orchestra.run.smithi183.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-18T21:56:21.598 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-18T21:56:21.598 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-18T21:56:21.598 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-18T21:56:21.599 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-18T21:56:21.599 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-18T21:56:21.599 INFO:teuthology.orchestra.run.smithi183.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-18T21:56:21.599 INFO:teuthology.orchestra.run.smithi183.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-18T21:56:21.599 INFO:teuthology.orchestra.run.smithi183.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-18T21:56:21.599 INFO:teuthology.orchestra.run.smithi183.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-18T21:56:21.599 INFO:teuthology.orchestra.run.smithi183.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-18T21:56:21.599 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-18T21:56:21.599 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-18T21:56:21.599 INFO:teuthology.orchestra.run.smithi183.stdout:Installing weak dependencies: 2024-08-18T21:56:21.600 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-18T21:56:21.600 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:56:21.600 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-08-18T21:56:21.600 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-08-18T21:56:21.600 INFO:teuthology.orchestra.run.smithi183.stdout:Install 148 Packages 2024-08-18T21:56:21.600 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 2 Packages 2024-08-18T21:56:21.600 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:56:21.601 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 218 M 2024-08-18T21:56:21.601 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-08-18T21:56:21.798 INFO:teuthology.orchestra.run.smithi130.stdout:(10/150): ceph-radosgw-19.1.0-1382.gde09dd01.el 16 MB/s | 11 MB 00:00 2024-08-18T21:56:21.810 INFO:teuthology.orchestra.run.smithi123.stdout:(1/150): ceph-19.1.0-1382.gde09dd01.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-08-18T21:56:21.848 INFO:teuthology.orchestra.run.smithi130.stdout:(11/150): cephfs-mirror-19.1.0-1382.gde09dd01.e 4.4 MB/s | 225 kB 00:00 2024-08-18T21:56:21.924 INFO:teuthology.orchestra.run.smithi130.stdout:(12/150): cephfs-shell-19.1.0-1382.gde09dd01.el 360 kB/s | 27 kB 00:00 2024-08-18T21:56:22.132 INFO:teuthology.orchestra.run.smithi130.stdout:(13/150): ceph-osd-19.1.0-1382.gde09dd01.el9.x8 14 MB/s | 17 MB 00:01 2024-08-18T21:56:22.157 INFO:teuthology.orchestra.run.smithi130.stdout:(14/150): libcephfs-devel-19.1.0-1382.gde09dd01 136 kB/s | 32 kB 00:00 2024-08-18T21:56:22.169 INFO:teuthology.orchestra.run.smithi123.stdout:(2/150): ceph-fuse-19.1.0-1382.gde09dd01.el9.x8 2.4 MB/s | 896 kB 00:00 2024-08-18T21:56:22.191 INFO:teuthology.orchestra.run.smithi130.stdout:(15/150): libcephfs2-19.1.0-1382.gde09dd01.el9. 13 MB/s | 753 kB 00:00 2024-08-18T21:56:22.216 INFO:teuthology.orchestra.run.smithi130.stdout:(16/150): libcephsqlite-19.1.0-1382.gde09dd01.e 2.7 MB/s | 163 kB 00:00 2024-08-18T21:56:22.244 INFO:teuthology.orchestra.run.smithi123.stdout:(3/150): ceph-immutable-object-cache-19.1.0-138 1.9 MB/s | 145 kB 00:00 2024-08-18T21:56:22.250 INFO:teuthology.orchestra.run.smithi130.stdout:(17/150): librados-devel-19.1.0-1382.gde09dd01. 2.1 MB/s | 127 kB 00:00 2024-08-18T21:56:22.300 INFO:teuthology.orchestra.run.smithi130.stdout:(18/150): libradosstriper1-19.1.0-1382.gde09dd0 5.9 MB/s | 507 kB 00:00 2024-08-18T21:56:22.400 INFO:teuthology.orchestra.run.smithi130.stdout:(19/150): python3-ceph-argparse-19.1.0-1382.gde 452 kB/s | 45 kB 00:00 2024-08-18T21:56:22.501 INFO:teuthology.orchestra.run.smithi130.stdout:(20/150): python3-ceph-common-19.1.0-1382.gde09 1.3 MB/s | 136 kB 00:00 2024-08-18T21:56:22.609 INFO:teuthology.orchestra.run.smithi130.stdout:(21/150): python3-cephfs-19.1.0-1382.gde09dd01. 1.7 MB/s | 188 kB 00:00 2024-08-18T21:56:22.768 INFO:teuthology.orchestra.run.smithi130.stdout:(22/150): python3-rados-19.1.0-1382.gde09dd01.e 2.3 MB/s | 369 kB 00:00 2024-08-18T21:56:22.843 INFO:teuthology.orchestra.run.smithi130.stdout:(23/150): librgw2-19.1.0-1382.gde09dd01.el9.x86 9.0 MB/s | 5.4 MB 00:00 2024-08-18T21:56:22.868 INFO:teuthology.orchestra.run.smithi130.stdout:(24/150): python3-rbd-19.1.0-1382.gde09dd01.el9 3.4 MB/s | 350 kB 00:00 2024-08-18T21:56:22.894 INFO:teuthology.orchestra.run.smithi130.stdout:(25/150): python3-rgw-19.1.0-1382.gde09dd01.el9 2.3 MB/s | 117 kB 00:00 2024-08-18T21:56:22.928 INFO:teuthology.orchestra.run.smithi130.stdout:(26/150): rbd-fuse-19.1.0-1382.gde09dd01.el9.x8 1.4 MB/s | 85 kB 00:00 2024-08-18T21:56:22.970 INFO:teuthology.orchestra.run.smithi183.stdout:(1/150): ceph-19.1.0-1382.gde09dd01.el9.x86_64. 11 kB/s | 6.6 kB 00:00 2024-08-18T21:56:22.978 INFO:teuthology.orchestra.run.smithi130.stdout:(27/150): rbd-nbd-19.1.0-1382.gde09dd01.el9.x86 3.3 MB/s | 170 kB 00:00 2024-08-18T21:56:23.019 INFO:teuthology.orchestra.run.smithi123.stdout:(4/150): ceph-base-19.1.0-1382.gde09dd01.el9.x8 3.5 MB/s | 5.4 MB 00:01 2024-08-18T21:56:23.045 INFO:teuthology.orchestra.run.smithi130.stdout:(28/150): ceph-grafana-dashboards-19.1.0-1382.g 479 kB/s | 32 kB 00:00 2024-08-18T21:56:23.078 INFO:teuthology.orchestra.run.smithi123.stdout:(5/150): ceph-mds-19.1.0-1382.gde09dd01.el9.x86 2.9 MB/s | 2.4 MB 00:00 2024-08-18T21:56:23.154 INFO:teuthology.orchestra.run.smithi130.stdout:(29/150): rbd-mirror-19.1.0-1382.gde09dd01.el9. 12 MB/s | 3.1 MB 00:00 2024-08-18T21:56:23.179 INFO:teuthology.orchestra.run.smithi130.stdout:(30/150): ceph-mgr-cephadm-19.1.0-1382.gde09dd0 1.1 MB/s | 146 kB 00:00 2024-08-18T21:56:23.261 INFO:teuthology.orchestra.run.smithi123.stdout:(6/150): ceph-mgr-19.1.0-1382.gde09dd01.el9.x86 6.3 MB/s | 1.5 MB 00:00 2024-08-18T21:56:23.520 INFO:teuthology.orchestra.run.smithi183.stdout:(2/150): ceph-fuse-19.1.0-1382.gde09dd01.el9.x8 1.6 MB/s | 896 kB 00:00 2024-08-18T21:56:23.604 INFO:teuthology.orchestra.run.smithi183.stdout:(3/150): ceph-immutable-object-cache-19.1.0-138 1.7 MB/s | 145 kB 00:00 2024-08-18T21:56:23.704 INFO:teuthology.orchestra.run.smithi130.stdout:(31/150): ceph-test-19.1.0-1382.gde09dd01.el9.x 21 MB/s | 49 MB 00:02 2024-08-18T21:56:23.779 INFO:teuthology.orchestra.run.smithi130.stdout:(32/150): ceph-mgr-dashboard-19.1.0-1382.gde09d 5.7 MB/s | 3.6 MB 00:00 2024-08-18T21:56:23.804 INFO:teuthology.orchestra.run.smithi130.stdout:(33/150): ceph-mgr-modules-core-19.1.0-1382.gde 2.4 MB/s | 249 kB 00:00 2024-08-18T21:56:23.846 INFO:teuthology.orchestra.run.smithi130.stdout:(34/150): ceph-mgr-rook-19.1.0-1382.gde09dd01.e 739 kB/s | 49 kB 00:00 2024-08-18T21:56:23.872 INFO:teuthology.orchestra.run.smithi130.stdout:(35/150): ceph-prometheus-alerts-19.1.0-1382.gd 245 kB/s | 16 kB 00:00 2024-08-18T21:56:23.922 INFO:teuthology.orchestra.run.smithi130.stdout:(36/150): ceph-volume-19.1.0-1382.gde09dd01.el9 3.7 MB/s | 285 kB 00:00 2024-08-18T21:56:24.014 INFO:teuthology.orchestra.run.smithi130.stdout:(37/150): cephadm-19.1.0-1382.gde09dd01.el9.noa 5.3 MB/s | 766 kB 00:00 2024-08-18T21:56:24.039 INFO:teuthology.orchestra.run.smithi130.stdout:(38/150): cephfs-top-19.1.0-1382.gde09dd01.el9. 156 kB/s | 18 kB 00:00 2024-08-18T21:56:24.237 INFO:teuthology.orchestra.run.smithi183.stdout:(4/150): ceph-mds-19.1.0-1382.gde09dd01.el9.x86 3.8 MB/s | 2.4 MB 00:00 2024-08-18T21:56:24.239 INFO:teuthology.orchestra.run.smithi130.stdout:(39/150): ceph-mgr-diskprediction-local-19.1.0- 7.0 MB/s | 7.4 MB 00:01 2024-08-18T21:56:24.278 INFO:teuthology.orchestra.run.smithi123.stdout:(7/150): ceph-osd-19.1.0-1382.gde09dd01.el9.x86 17 MB/s | 17 MB 00:01 2024-08-18T21:56:24.329 INFO:teuthology.orchestra.run.smithi183.stdout:(5/150): ceph-base-19.1.0-1382.gde09dd01.el9.x8 2.7 MB/s | 5.4 MB 00:01 2024-08-18T21:56:24.362 INFO:teuthology.orchestra.run.smithi123.stdout:(8/150): ceph-mon-19.1.0-1382.gde09dd01.el9.x86 3.7 MB/s | 4.7 MB 00:01 2024-08-18T21:56:24.482 INFO:teuthology.orchestra.run.smithi183.stdout:(6/150): ceph-mgr-19.1.0-1382.gde09dd01.el9.x86 6.3 MB/s | 1.5 MB 00:00 2024-08-18T21:56:24.554 INFO:teuthology.orchestra.run.smithi123.stdout:(9/150): ceph-common-19.1.0-1382.gde09dd01.el9. 6.9 MB/s | 21 MB 00:03 2024-08-18T21:56:24.570 INFO:teuthology.orchestra.run.smithi123.stdout:(10/150): ceph-selinux-19.1.0-1382.gde09dd01.el 121 kB/s | 25 kB 00:00 2024-08-18T21:56:24.688 INFO:teuthology.orchestra.run.smithi123.stdout:(11/150): cephfs-mirror-19.1.0-1382.gde09dd01.e 1.9 MB/s | 225 kB 00:00 2024-08-18T21:56:24.731 INFO:teuthology.orchestra.run.smithi130.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 111 kB/s | 80 kB 00:00 2024-08-18T21:56:24.771 INFO:teuthology.orchestra.run.smithi123.stdout:(12/150): cephfs-shell-19.1.0-1382.gde09dd01.el 326 kB/s | 27 kB 00:00 2024-08-18T21:56:24.821 INFO:teuthology.orchestra.run.smithi183.stdout:(7/150): ceph-mon-19.1.0-1382.gde09dd01.el9.x86 9.6 MB/s | 4.7 MB 00:00 2024-08-18T21:56:24.830 INFO:teuthology.orchestra.run.smithi123.stdout:(13/150): libcephfs-devel-19.1.0-1382.gde09dd01 544 kB/s | 32 kB 00:00 2024-08-18T21:56:24.938 INFO:teuthology.orchestra.run.smithi123.stdout:(14/150): ceph-radosgw-19.1.0-1382.gde09dd01.el 16 MB/s | 11 MB 00:00 2024-08-18T21:56:24.998 INFO:teuthology.orchestra.run.smithi130.stdout:(41/150): libquadmath-11.4.1-3.el9.x86_64.rpm 258 kB/s | 195 kB 00:00 2024-08-18T21:56:25.014 INFO:teuthology.orchestra.run.smithi123.stdout:(15/150): libcephsqlite-19.1.0-1382.gde09dd01.e 2.1 MB/s | 163 kB 00:00 2024-08-18T21:56:25.024 INFO:teuthology.orchestra.run.smithi130.stdout:(42/150): libgfortran-11.4.1-3.el9.x86_64.rpm 816 kB/s | 803 kB 00:00 2024-08-18T21:56:25.089 INFO:teuthology.orchestra.run.smithi123.stdout:(16/150): librados-devel-19.1.0-1382.gde09dd01. 1.7 MB/s | 127 kB 00:00 2024-08-18T21:56:25.122 INFO:teuthology.orchestra.run.smithi123.stdout:(17/150): libcephfs2-19.1.0-1382.gde09dd01.el9. 2.5 MB/s | 753 kB 00:00 2024-08-18T21:56:25.173 INFO:teuthology.orchestra.run.smithi123.stdout:(18/150): libradosstriper1-19.1.0-1382.gde09dd0 5.9 MB/s | 507 kB 00:00 2024-08-18T21:56:25.240 INFO:teuthology.orchestra.run.smithi123.stdout:(19/150): python3-ceph-argparse-19.1.0-1382.gde 675 kB/s | 45 kB 00:00 2024-08-18T21:56:25.290 INFO:teuthology.orchestra.run.smithi123.stdout:(20/150): python3-ceph-common-19.1.0-1382.gde09 2.7 MB/s | 136 kB 00:00 2024-08-18T21:56:25.357 INFO:teuthology.orchestra.run.smithi123.stdout:(21/150): python3-cephfs-19.1.0-1382.gde09dd01. 2.8 MB/s | 188 kB 00:00 2024-08-18T21:56:25.413 INFO:teuthology.orchestra.run.smithi183.stdout:(8/150): ceph-common-19.1.0-1382.gde09dd01.el9. 6.9 MB/s | 21 MB 00:03 2024-08-18T21:56:25.432 INFO:teuthology.orchestra.run.smithi123.stdout:(22/150): python3-rados-19.1.0-1382.gde09dd01.e 4.8 MB/s | 369 kB 00:00 2024-08-18T21:56:25.455 INFO:teuthology.orchestra.run.smithi183.stdout:(9/150): ceph-selinux-19.1.0-1382.gde09dd01.el9 607 kB/s | 25 kB 00:00 2024-08-18T21:56:25.507 INFO:teuthology.orchestra.run.smithi130.stdout:(43/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 327 kB/s | 253 kB 00:00 2024-08-18T21:56:25.508 INFO:teuthology.orchestra.run.smithi123.stdout:(23/150): python3-rbd-19.1.0-1382.gde09dd01.el9 4.5 MB/s | 350 kB 00:00 2024-08-18T21:56:25.558 INFO:teuthology.orchestra.run.smithi123.stdout:(24/150): python3-rgw-19.1.0-1382.gde09dd01.el9 2.3 MB/s | 117 kB 00:00 2024-08-18T21:56:25.588 INFO:teuthology.orchestra.run.smithi183.stdout:(10/150): ceph-radosgw-19.1.0-1382.gde09dd01.el 14 MB/s | 11 MB 00:00 2024-08-18T21:56:25.609 INFO:teuthology.orchestra.run.smithi123.stdout:(25/150): rbd-fuse-19.1.0-1382.gde09dd01.el9.x8 1.7 MB/s | 85 kB 00:00 2024-08-18T21:56:25.664 INFO:teuthology.orchestra.run.smithi183.stdout:(11/150): cephfs-mirror-19.1.0-1382.gde09dd01.e 2.9 MB/s | 225 kB 00:00 2024-08-18T21:56:25.682 INFO:teuthology.orchestra.run.smithi130.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 162 kB/s | 106 kB 00:00 2024-08-18T21:56:25.764 INFO:teuthology.orchestra.run.smithi183.stdout:(12/150): cephfs-shell-19.1.0-1382.gde09dd01.el 271 kB/s | 27 kB 00:00 2024-08-18T21:56:25.817 INFO:teuthology.orchestra.run.smithi123.stdout:(26/150): rbd-mirror-19.1.0-1382.gde09dd01.el9. 15 MB/s | 3.1 MB 00:00 2024-08-18T21:56:25.867 INFO:teuthology.orchestra.run.smithi123.stdout:(27/150): rbd-nbd-19.1.0-1382.gde09dd01.el9.x86 3.4 MB/s | 170 kB 00:00 2024-08-18T21:56:25.918 INFO:teuthology.orchestra.run.smithi123.stdout:(28/150): ceph-grafana-dashboards-19.1.0-1382.g 636 kB/s | 32 kB 00:00 2024-08-18T21:56:25.947 INFO:teuthology.orchestra.run.smithi183.stdout:(13/150): ceph-osd-19.1.0-1382.gde09dd01.el9.x8 11 MB/s | 17 MB 00:01 2024-08-18T21:56:25.949 INFO:teuthology.orchestra.run.smithi130.stdout:(45/150): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-08-18T21:56:25.968 INFO:teuthology.orchestra.run.smithi123.stdout:(29/150): ceph-mgr-cephadm-19.1.0-1382.gde09dd0 2.9 MB/s | 146 kB 00:00 2024-08-18T21:56:25.973 INFO:teuthology.orchestra.run.smithi183.stdout:(14/150): libcephfs-devel-19.1.0-1382.gde09dd01 152 kB/s | 32 kB 00:00 2024-08-18T21:56:26.015 INFO:teuthology.orchestra.run.smithi183.stdout:(15/150): libcephfs2-19.1.0-1382.gde09dd01.el9. 11 MB/s | 753 kB 00:00 2024-08-18T21:56:26.067 INFO:teuthology.orchestra.run.smithi183.stdout:(16/150): libcephsqlite-19.1.0-1382.gde09dd01.e 1.7 MB/s | 163 kB 00:00 2024-08-18T21:56:26.101 INFO:teuthology.orchestra.run.smithi183.stdout:(17/150): librados-devel-19.1.0-1382.gde09dd01. 1.4 MB/s | 127 kB 00:00 2024-08-18T21:56:26.143 INFO:teuthology.orchestra.run.smithi123.stdout:(30/150): ceph-mgr-dashboard-19.1.0-1382.gde09d 20 MB/s | 3.6 MB 00:00 2024-08-18T21:56:26.151 INFO:teuthology.orchestra.run.smithi183.stdout:(18/150): libradosstriper1-19.1.0-1382.gde09dd0 5.9 MB/s | 507 kB 00:00 2024-08-18T21:56:26.224 INFO:teuthology.orchestra.run.smithi130.stdout:(46/150): python3-pycparser-2.20-6.el9.noarch.r 189 kB/s | 135 kB 00:00 2024-08-18T21:56:26.260 INFO:teuthology.orchestra.run.smithi183.stdout:(19/150): python3-ceph-argparse-19.1.0-1382.gde 416 kB/s | 45 kB 00:00 2024-08-18T21:56:26.360 INFO:teuthology.orchestra.run.smithi183.stdout:(20/150): python3-ceph-common-19.1.0-1382.gde09 1.3 MB/s | 136 kB 00:00 2024-08-18T21:56:26.366 INFO:teuthology.orchestra.run.smithi130.stdout:(47/150): python3-requests-2.25.1-8.el9.noarch. 183 kB/s | 125 kB 00:00 2024-08-18T21:56:26.425 INFO:teuthology.orchestra.run.smithi130.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-08-18T21:56:26.443 INFO:teuthology.orchestra.run.smithi183.stdout:(21/150): python3-cephfs-19.1.0-1382.gde09dd01. 2.2 MB/s | 188 kB 00:00 2024-08-18T21:56:26.467 INFO:teuthology.orchestra.run.smithi130.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-08-18T21:56:26.508 INFO:teuthology.orchestra.run.smithi130.stdout:(50/150): elfutils-libelf-devel-0.191-4.el9.x86 522 kB/s | 22 kB 00:00 2024-08-18T21:56:26.527 INFO:teuthology.orchestra.run.smithi183.stdout:(22/150): librgw2-19.1.0-1382.gde09dd01.el9.x86 13 MB/s | 5.4 MB 00:00 2024-08-18T21:56:26.543 INFO:teuthology.orchestra.run.smithi123.stdout:(31/150): ceph-mgr-diskprediction-local-19.1.0- 18 MB/s | 7.4 MB 00:00 2024-08-18T21:56:26.552 INFO:teuthology.orchestra.run.smithi183.stdout:(23/150): python3-rados-19.1.0-1382.gde09dd01.e 3.3 MB/s | 369 kB 00:00 2024-08-18T21:56:26.559 INFO:teuthology.orchestra.run.smithi130.stdout:(51/150): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-08-18T21:56:26.578 INFO:teuthology.orchestra.run.smithi183.stdout:(24/150): python3-rbd-19.1.0-1382.gde09dd01.el9 6.8 MB/s | 350 kB 00:00 2024-08-18T21:56:26.584 INFO:teuthology.orchestra.run.smithi130.stdout:(52/150): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-08-18T21:56:26.594 INFO:teuthology.orchestra.run.smithi123.stdout:(32/150): ceph-mgr-modules-core-19.1.0-1382.gde 4.9 MB/s | 249 kB 00:00 2024-08-18T21:56:26.603 INFO:teuthology.orchestra.run.smithi183.stdout:(25/150): python3-rgw-19.1.0-1382.gde09dd01.el9 2.3 MB/s | 117 kB 00:00 2024-08-18T21:56:26.609 INFO:teuthology.orchestra.run.smithi130.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-08-18T21:56:26.628 INFO:teuthology.orchestra.run.smithi183.stdout:(26/150): rbd-fuse-19.1.0-1382.gde09dd01.el9.x8 1.7 MB/s | 85 kB 00:00 2024-08-18T21:56:26.636 INFO:teuthology.orchestra.run.smithi123.stdout:(33/150): ceph-mgr-rook-19.1.0-1382.gde09dd01.e 1.2 MB/s | 49 kB 00:00 2024-08-18T21:56:26.651 INFO:teuthology.orchestra.run.smithi130.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-08-18T21:56:26.693 INFO:teuthology.orchestra.run.smithi130.stdout:(55/150): python3-urllib3-1.26.5-6.el9.noarch.r 289 kB/s | 215 kB 00:00 2024-08-18T21:56:26.694 INFO:teuthology.orchestra.run.smithi123.stdout:(34/150): ceph-prometheus-alerts-19.1.0-1382.gd 282 kB/s | 16 kB 00:00 2024-08-18T21:56:26.695 INFO:teuthology.orchestra.run.smithi183.stdout:(27/150): rbd-nbd-19.1.0-1382.gde09dd01.el9.x86 2.5 MB/s | 170 kB 00:00 2024-08-18T21:56:26.719 INFO:teuthology.orchestra.run.smithi130.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-08-18T21:56:26.761 INFO:teuthology.orchestra.run.smithi123.stdout:(35/150): ceph-volume-19.1.0-1382.gde09dd01.el9 4.2 MB/s | 285 kB 00:00 2024-08-18T21:56:26.787 INFO:teuthology.orchestra.run.smithi183.stdout:(28/150): rbd-mirror-19.1.0-1382.gde09dd01.el9. 17 MB/s | 3.1 MB 00:00 2024-08-18T21:56:26.794 INFO:teuthology.orchestra.run.smithi130.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-08-18T21:56:26.813 INFO:teuthology.orchestra.run.smithi183.stdout:(29/150): ceph-grafana-dashboards-19.1.0-1382.g 272 kB/s | 32 kB 00:00 2024-08-18T21:56:26.819 INFO:teuthology.orchestra.run.smithi130.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 453 kB/s | 45 kB 00:00 2024-08-18T21:56:26.837 INFO:teuthology.orchestra.run.smithi183.stdout:(30/150): ceph-mgr-cephadm-19.1.0-1382.gde09dd0 2.9 MB/s | 146 kB 00:00 2024-08-18T21:56:26.853 INFO:teuthology.orchestra.run.smithi123.stdout:(36/150): librgw2-19.1.0-1382.gde09dd01.el9.x86 3.1 MB/s | 5.4 MB 00:01 2024-08-18T21:56:26.895 INFO:teuthology.orchestra.run.smithi123.stdout:(37/150): cephadm-19.1.0-1382.gde09dd01.el9.noa 5.6 MB/s | 766 kB 00:00 2024-08-18T21:56:26.929 INFO:teuthology.orchestra.run.smithi123.stdout:(38/150): cephfs-top-19.1.0-1382.gde09dd01.el9. 243 kB/s | 18 kB 00:00 2024-08-18T21:56:26.936 INFO:teuthology.orchestra.run.smithi130.stdout:(59/150): libtool-2.4.6-46.el9.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2024-08-18T21:56:26.978 INFO:teuthology.orchestra.run.smithi130.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 610 kB/s | 25 kB 00:00 2024-08-18T21:56:27.020 INFO:teuthology.orchestra.run.smithi130.stdout:(61/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-08-18T21:56:27.045 INFO:teuthology.orchestra.run.smithi130.stdout:(62/150): librdkafka-1.6.1-102.el9.x86_64.rpm 2.6 MB/s | 662 kB 00:00 2024-08-18T21:56:27.088 INFO:teuthology.orchestra.run.smithi183.stdout:(31/150): ceph-mgr-dashboard-19.1.0-1382.gde09d 13 MB/s | 3.6 MB 00:00 2024-08-18T21:56:27.121 INFO:teuthology.orchestra.run.smithi130.stdout:(63/150): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-08-18T21:56:27.137 INFO:teuthology.orchestra.run.smithi123.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 330 kB/s | 80 kB 00:00 2024-08-18T21:56:27.146 INFO:teuthology.orchestra.run.smithi130.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-08-18T21:56:27.155 INFO:teuthology.orchestra.run.smithi183.stdout:(32/150): ceph-mgr-modules-core-19.1.0-1382.gde 3.7 MB/s | 249 kB 00:00 2024-08-18T21:56:27.171 INFO:teuthology.orchestra.run.smithi130.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 702 kB/s | 35 kB 00:00 2024-08-18T21:56:27.247 INFO:teuthology.orchestra.run.smithi183.stdout:(33/150): ceph-mgr-diskprediction-local-19.1.0- 18 MB/s | 7.4 MB 00:00 2024-08-18T21:56:27.272 INFO:teuthology.orchestra.run.smithi183.stdout:(34/150): ceph-mgr-rook-19.1.0-1382.gde09dd01.e 422 kB/s | 49 kB 00:00 2024-08-18T21:56:27.297 INFO:teuthology.orchestra.run.smithi183.stdout:(35/150): ceph-prometheus-alerts-19.1.0-1382.gd 328 kB/s | 16 kB 00:00 2024-08-18T21:56:27.323 INFO:teuthology.orchestra.run.smithi183.stdout:(36/150): ceph-volume-19.1.0-1382.gde09dd01.el9 5.5 MB/s | 285 kB 00:00 2024-08-18T21:56:27.329 INFO:teuthology.orchestra.run.smithi123.stdout:(40/150): libgfortran-11.4.1-3.el9.x86_64.rpm 2.0 MB/s | 803 kB 00:00 2024-08-18T21:56:27.373 INFO:teuthology.orchestra.run.smithi183.stdout:(37/150): cephadm-19.1.0-1382.gde09dd01.el9.noa 9.9 MB/s | 766 kB 00:00 2024-08-18T21:56:27.398 INFO:teuthology.orchestra.run.smithi183.stdout:(38/150): cephfs-top-19.1.0-1382.gde09dd01.el9. 243 kB/s | 18 kB 00:00 2024-08-18T21:56:27.446 INFO:teuthology.orchestra.run.smithi130.stdout:(66/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.5 MB/s | 3.0 MB 00:00 2024-08-18T21:56:27.532 INFO:teuthology.orchestra.run.smithi183.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 503 kB/s | 80 kB 00:00 2024-08-18T21:56:27.632 INFO:teuthology.orchestra.run.smithi183.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-08-18T21:56:27.654 INFO:teuthology.orchestra.run.smithi123.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 780 kB/s | 253 kB 00:00 2024-08-18T21:56:27.715 INFO:teuthology.orchestra.run.smithi183.stdout:(41/150): libgfortran-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 803 kB 00:00 2024-08-18T21:56:27.821 INFO:teuthology.orchestra.run.smithi123.stdout:(42/150): libquadmath-11.4.1-3.el9.x86_64.rpm 286 kB/s | 195 kB 00:00 2024-08-18T21:56:27.849 INFO:teuthology.orchestra.run.smithi183.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-08-18T21:56:27.880 INFO:teuthology.orchestra.run.smithi130.stdout:(67/150): postgresql-13.14-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-08-18T21:56:27.899 INFO:teuthology.orchestra.run.smithi183.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-08-18T21:56:27.975 INFO:teuthology.orchestra.run.smithi183.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-08-18T21:56:28.039 INFO:teuthology.orchestra.run.smithi130.stdout:(68/150): postgresql-contrib-13.14-1.el9.x86_64 5.6 MB/s | 911 kB 00:00 2024-08-18T21:56:28.072 INFO:teuthology.orchestra.run.smithi123.stdout:(43/150): python3-cryptography-36.0.1-4.el9.x86 2.9 MB/s | 1.2 MB 00:00 2024-08-18T21:56:28.105 INFO:teuthology.orchestra.run.smithi123.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 376 kB/s | 106 kB 00:00 2024-08-18T21:56:28.114 INFO:teuthology.orchestra.run.smithi130.stdout:(69/150): openblas-openmp-0.3.21-2.el9.x86_64.r 4.9 MB/s | 4.7 MB 00:00 2024-08-18T21:56:28.139 INFO:teuthology.orchestra.run.smithi130.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 1.3 MB/s | 133 kB 00:00 2024-08-18T21:56:28.206 INFO:teuthology.orchestra.run.smithi130.stdout:(71/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2024-08-18T21:56:28.248 INFO:teuthology.orchestra.run.smithi130.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-08-18T21:56:28.273 INFO:teuthology.orchestra.run.smithi130.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-08-18T21:56:28.357 INFO:teuthology.orchestra.run.smithi130.stdout:(74/150): postgresql-server-13.14-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-08-18T21:56:28.382 INFO:teuthology.orchestra.run.smithi130.stdout:(75/150): python3-colorama-0.4.6-3.el9.noarch.r 564 kB/s | 61 kB 00:00 2024-08-18T21:56:28.384 INFO:teuthology.orchestra.run.smithi183.stdout:(45/150): ceph-test-19.1.0-1382.gde09dd01.el9.x 17 MB/s | 49 MB 00:02 2024-08-18T21:56:28.407 INFO:teuthology.orchestra.run.smithi130.stdout:(76/150): python3-devel-3.9.19-4.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-08-18T21:56:28.409 INFO:teuthology.orchestra.run.smithi183.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 288 kB/s | 125 kB 00:00 2024-08-18T21:56:28.432 INFO:teuthology.orchestra.run.smithi130.stdout:(77/150): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-08-18T21:56:28.442 INFO:teuthology.orchestra.run.smithi183.stdout:(47/150): python3-cryptography-36.0.1-4.el9.x86 1.7 MB/s | 1.2 MB 00:00 2024-08-18T21:56:28.458 INFO:teuthology.orchestra.run.smithi130.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-08-18T21:56:28.475 INFO:teuthology.orchestra.run.smithi130.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 457 kB/s | 19 kB 00:00 2024-08-18T21:56:28.500 INFO:teuthology.orchestra.run.smithi130.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-08-18T21:56:28.517 INFO:teuthology.orchestra.run.smithi130.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 826 kB/s | 35 kB 00:00 2024-08-18T21:56:28.609 INFO:teuthology.orchestra.run.smithi130.stdout:(82/150): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-08-18T21:56:28.617 INFO:teuthology.orchestra.run.smithi183.stdout:(48/150): python3-urllib3-1.26.5-6.el9.noarch.r 920 kB/s | 215 kB 00:00 2024-08-18T21:56:28.634 INFO:teuthology.orchestra.run.smithi130.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-08-18T21:56:28.651 INFO:teuthology.orchestra.run.smithi183.stdout:(49/150): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-08-18T21:56:28.659 INFO:teuthology.orchestra.run.smithi130.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-08-18T21:56:28.685 INFO:teuthology.orchestra.run.smithi130.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-18T21:56:28.693 INFO:teuthology.orchestra.run.smithi183.stdout:(50/150): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-08-18T21:56:28.710 INFO:teuthology.orchestra.run.smithi130.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 838 kB/s | 42 kB 00:00 2024-08-18T21:56:28.719 INFO:teuthology.orchestra.run.smithi183.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-08-18T21:56:28.743 INFO:teuthology.orchestra.run.smithi183.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-08-18T21:56:28.744 INFO:teuthology.orchestra.run.smithi130.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-08-18T21:56:28.760 INFO:teuthology.orchestra.run.smithi183.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 786 kB/s | 33 kB 00:00 2024-08-18T21:56:28.769 INFO:teuthology.orchestra.run.smithi130.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-08-18T21:56:28.786 INFO:teuthology.orchestra.run.smithi183.stdout:(54/150): boost-program-options-1.75.0-8.el9.x8 637 kB/s | 107 kB 00:00 2024-08-18T21:56:28.794 INFO:teuthology.orchestra.run.smithi130.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-08-18T21:56:28.802 INFO:teuthology.orchestra.run.smithi183.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-08-18T21:56:28.819 INFO:teuthology.orchestra.run.smithi183.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 333 kB/s | 11 kB 00:00 2024-08-18T21:56:28.820 INFO:teuthology.orchestra.run.smithi130.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-18T21:56:28.845 INFO:teuthology.orchestra.run.smithi130.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-18T21:56:28.870 INFO:teuthology.orchestra.run.smithi183.stdout:(57/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-08-18T21:56:28.895 INFO:teuthology.orchestra.run.smithi183.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-08-18T21:56:28.920 INFO:teuthology.orchestra.run.smithi183.stdout:(59/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-08-18T21:56:28.937 INFO:teuthology.orchestra.run.smithi130.stdout:(92/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-08-18T21:56:28.962 INFO:teuthology.orchestra.run.smithi183.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-08-18T21:56:28.963 INFO:teuthology.orchestra.run.smithi130.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 42 kB 00:00 2024-08-18T21:56:28.987 INFO:teuthology.orchestra.run.smithi130.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-08-18T21:56:28.988 INFO:teuthology.orchestra.run.smithi183.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 382 kB/s | 25 kB 00:00 2024-08-18T21:56:29.004 INFO:teuthology.orchestra.run.smithi130.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-08-18T21:56:29.013 INFO:teuthology.orchestra.run.smithi183.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-08-18T21:56:29.030 INFO:teuthology.orchestra.run.smithi130.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 853 kB/s | 36 kB 00:00 2024-08-18T21:56:29.038 INFO:teuthology.orchestra.run.smithi183.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-08-18T21:56:29.055 INFO:teuthology.orchestra.run.smithi130.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-08-18T21:56:29.063 INFO:teuthology.orchestra.run.smithi183.stdout:(64/150): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-08-18T21:56:29.080 INFO:teuthology.orchestra.run.smithi130.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-08-18T21:56:29.088 INFO:teuthology.orchestra.run.smithi183.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 702 kB/s | 35 kB 00:00 2024-08-18T21:56:29.105 INFO:teuthology.orchestra.run.smithi130.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-08-18T21:56:29.114 INFO:teuthology.orchestra.run.smithi183.stdout:(66/150): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-08-18T21:56:29.130 INFO:teuthology.orchestra.run.smithi130.stdout:(100/150): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-08-18T21:56:29.156 INFO:teuthology.orchestra.run.smithi130.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-18T21:56:29.181 INFO:teuthology.orchestra.run.smithi183.stdout:(67/150): postgresql-13.14-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-08-18T21:56:29.181 INFO:teuthology.orchestra.run.smithi130.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 889 kB/s | 45 kB 00:00 2024-08-18T21:56:29.273 INFO:teuthology.orchestra.run.smithi183.stdout:(68/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-08-18T21:56:29.306 INFO:teuthology.orchestra.run.smithi183.stdout:(69/150): postgresql-contrib-13.14-1.el9.x86_64 7.1 MB/s | 911 kB 00:00 2024-08-18T21:56:29.314 INFO:teuthology.orchestra.run.smithi123.stdout:(45/150): ceph-test-19.1.0-1382.gde09dd01.el9.x 10 MB/s | 49 MB 00:04 2024-08-18T21:56:29.350 INFO:teuthology.orchestra.run.smithi123.stdout:(46/150): python3-pycparser-2.20-6.el9.noarch.r 106 kB/s | 135 kB 00:01 2024-08-18T21:56:29.365 INFO:teuthology.orchestra.run.smithi183.stdout:(70/150): openblas-openmp-0.3.21-2.el9.x86_64.r 16 MB/s | 4.7 MB 00:00 2024-08-18T21:56:29.391 INFO:teuthology.orchestra.run.smithi183.stdout:(71/150): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 133 kB 00:00 2024-08-18T21:56:29.432 INFO:teuthology.orchestra.run.smithi183.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-08-18T21:56:29.457 INFO:teuthology.orchestra.run.smithi130.stdout:(103/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-08-18T21:56:29.457 INFO:teuthology.orchestra.run.smithi183.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-08-18T21:56:29.482 INFO:teuthology.orchestra.run.smithi130.stdout:(104/150): lua-devel-5.4.4-4.el9.x86_64.rpm 68 kB/s | 22 kB 00:00 2024-08-18T21:56:29.499 INFO:teuthology.orchestra.run.smithi183.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-08-18T21:56:29.532 INFO:teuthology.orchestra.run.smithi130.stdout:(105/150): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-08-18T21:56:29.557 INFO:teuthology.orchestra.run.smithi130.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-08-18T21:56:29.574 INFO:teuthology.orchestra.run.smithi183.stdout:(75/150): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-08-18T21:56:29.582 INFO:teuthology.orchestra.run.smithi130.stdout:(107/150): gperftools-libs-2.9.1-2.el9.x86_64.r 3.0 MB/s | 309 kB 00:00 2024-08-18T21:56:29.594 INFO:teuthology.orchestra.run.smithi123.stdout:(47/150): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-08-18T21:56:29.599 INFO:teuthology.orchestra.run.smithi183.stdout:(76/150): python3-devel-3.9.19-4.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-08-18T21:56:29.608 INFO:teuthology.orchestra.run.smithi130.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-08-18T21:56:29.633 INFO:teuthology.orchestra.run.smithi183.stdout:(77/150): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-08-18T21:56:29.641 INFO:teuthology.orchestra.run.smithi130.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-08-18T21:56:29.659 INFO:teuthology.orchestra.run.smithi183.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 436 kB/s | 26 kB 00:00 2024-08-18T21:56:29.667 INFO:teuthology.orchestra.run.smithi130.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-08-18T21:56:29.683 INFO:teuthology.orchestra.run.smithi123.stdout:(48/150): bison-3.7.4-5.el9.x86_64.rpm 10 MB/s | 943 kB 00:00 2024-08-18T21:56:29.684 INFO:teuthology.orchestra.run.smithi183.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-08-18T21:56:29.692 INFO:teuthology.orchestra.run.smithi130.stdout:(111/150): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-08-18T21:56:29.709 INFO:teuthology.orchestra.run.smithi183.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-18T21:56:29.717 INFO:teuthology.orchestra.run.smithi130.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-08-18T21:56:29.734 INFO:teuthology.orchestra.run.smithi123.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-08-18T21:56:29.734 INFO:teuthology.orchestra.run.smithi183.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-08-18T21:56:29.759 INFO:teuthology.orchestra.run.smithi130.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 15 MB/s | 548 kB 00:00 2024-08-18T21:56:29.784 INFO:teuthology.orchestra.run.smithi123.stdout:(50/150): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-08-18T21:56:29.785 INFO:teuthology.orchestra.run.smithi130.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-18T21:56:29.810 INFO:teuthology.orchestra.run.smithi130.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-18T21:56:29.818 INFO:teuthology.orchestra.run.smithi183.stdout:(82/150): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-08-18T21:56:29.835 INFO:teuthology.orchestra.run.smithi130.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-08-18T21:56:29.843 INFO:teuthology.orchestra.run.smithi123.stdout:(51/150): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-08-18T21:56:29.843 INFO:teuthology.orchestra.run.smithi183.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-08-18T21:56:29.869 INFO:teuthology.orchestra.run.smithi183.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-08-18T21:56:29.869 INFO:teuthology.orchestra.run.smithi130.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-08-18T21:56:29.893 INFO:teuthology.orchestra.run.smithi123.stdout:(52/150): flexiblas-3.0.4-8.el9.x86_64.rpm 656 kB/s | 33 kB 00:00 2024-08-18T21:56:29.894 INFO:teuthology.orchestra.run.smithi183.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-18T21:56:29.894 INFO:teuthology.orchestra.run.smithi130.stdout:(118/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-08-18T21:56:29.919 INFO:teuthology.orchestra.run.smithi183.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-08-18T21:56:29.928 INFO:teuthology.orchestra.run.smithi130.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-18T21:56:29.944 INFO:teuthology.orchestra.run.smithi183.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-08-18T21:56:29.953 INFO:teuthology.orchestra.run.smithi130.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-18T21:56:29.970 INFO:teuthology.orchestra.run.smithi183.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-08-18T21:56:29.978 INFO:teuthology.orchestra.run.smithi130.stdout:(121/150): python3-google-auth-2.33.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-08-18T21:56:29.995 INFO:teuthology.orchestra.run.smithi183.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-08-18T21:56:30.010 INFO:teuthology.orchestra.run.smithi123.stdout:(53/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-08-18T21:56:30.012 INFO:teuthology.orchestra.run.smithi130.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-08-18T21:56:30.020 INFO:teuthology.orchestra.run.smithi183.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-18T21:56:30.029 INFO:teuthology.orchestra.run.smithi130.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 637 kB/s | 11 kB 00:00 2024-08-18T21:56:30.045 INFO:teuthology.orchestra.run.smithi183.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-18T21:56:30.052 INFO:teuthology.orchestra.run.smithi123.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 440 kB/s | 18 kB 00:00 2024-08-18T21:56:30.088 INFO:teuthology.orchestra.run.smithi130.stdout:(124/150): libarrow-9.0.0-11.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-08-18T21:56:30.094 INFO:teuthology.orchestra.run.smithi123.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-08-18T21:56:30.105 INFO:teuthology.orchestra.run.smithi130.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-08-18T21:56:30.121 INFO:teuthology.orchestra.run.smithi130.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 693 kB/s | 23 kB 00:00 2024-08-18T21:56:30.129 INFO:teuthology.orchestra.run.smithi183.stdout:(92/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-08-18T21:56:30.138 INFO:teuthology.orchestra.run.smithi130.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 580 kB/s | 19 kB 00:00 2024-08-18T21:56:30.152 INFO:teuthology.orchestra.run.smithi123.stdout:(56/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-08-18T21:56:30.154 INFO:teuthology.orchestra.run.smithi183.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-08-18T21:56:30.155 INFO:teuthology.orchestra.run.smithi130.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 583 kB/s | 20 kB 00:00 2024-08-18T21:56:30.171 INFO:teuthology.orchestra.run.smithi183.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-08-18T21:56:30.181 INFO:teuthology.orchestra.run.smithi130.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-18T21:56:30.194 INFO:teuthology.orchestra.run.smithi123.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-08-18T21:56:30.205 INFO:teuthology.orchestra.run.smithi183.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-08-18T21:56:30.206 INFO:teuthology.orchestra.run.smithi130.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-18T21:56:30.222 INFO:teuthology.orchestra.run.smithi183.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-08-18T21:56:30.231 INFO:teuthology.orchestra.run.smithi130.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-08-18T21:56:30.239 INFO:teuthology.orchestra.run.smithi183.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-08-18T21:56:30.261 INFO:teuthology.orchestra.run.smithi123.stdout:(58/150): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-08-18T21:56:30.265 INFO:teuthology.orchestra.run.smithi130.stdout:(132/150): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-08-18T21:56:30.272 INFO:teuthology.orchestra.run.smithi183.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-08-18T21:56:30.289 INFO:teuthology.orchestra.run.smithi183.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-08-18T21:56:30.290 INFO:teuthology.orchestra.run.smithi130.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-08-18T21:56:30.314 INFO:teuthology.orchestra.run.smithi183.stdout:(100/150): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-08-18T21:56:30.320 INFO:teuthology.orchestra.run.smithi123.stdout:(59/150): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-08-18T21:56:30.324 INFO:teuthology.orchestra.run.smithi130.stdout:(134/150): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-08-18T21:56:30.331 INFO:teuthology.orchestra.run.smithi183.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-08-18T21:56:30.349 INFO:teuthology.orchestra.run.smithi183.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-08-18T21:56:30.349 INFO:teuthology.orchestra.run.smithi130.stdout:(135/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-08-18T21:56:30.370 INFO:teuthology.orchestra.run.smithi123.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 507 kB/s | 25 kB 00:00 2024-08-18T21:56:30.374 INFO:teuthology.orchestra.run.smithi130.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-08-18T21:56:30.400 INFO:teuthology.orchestra.run.smithi130.stdout:(137/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 824 kB/s | 90 kB 00:00 2024-08-18T21:56:30.420 INFO:teuthology.orchestra.run.smithi123.stdout:(61/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 952 kB/s | 47 kB 00:00 2024-08-18T21:56:30.425 INFO:teuthology.orchestra.run.smithi130.stdout:(138/150): python3-repoze-lru-0.7-16.el9.noarch 616 kB/s | 31 kB 00:00 2024-08-18T21:56:30.451 INFO:teuthology.orchestra.run.smithi130.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-08-18T21:56:30.475 INFO:teuthology.orchestra.run.smithi130.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-08-18T21:56:30.496 INFO:teuthology.orchestra.run.smithi123.stdout:(62/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 292 kB 00:00 2024-08-18T21:56:30.501 INFO:teuthology.orchestra.run.smithi130.stdout:(141/150): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-08-18T21:56:30.526 INFO:teuthology.orchestra.run.smithi130.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 985 kB/s | 74 kB 00:00 2024-08-18T21:56:30.550 INFO:teuthology.orchestra.run.smithi183.stdout:(103/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-08-18T21:56:30.551 INFO:teuthology.orchestra.run.smithi130.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-18T21:56:30.563 INFO:teuthology.orchestra.run.smithi123.stdout:(63/150): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-08-18T21:56:30.576 INFO:teuthology.orchestra.run.smithi130.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-08-18T21:56:30.599 INFO:teuthology.orchestra.run.smithi183.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-08-18T21:56:30.601 INFO:teuthology.orchestra.run.smithi130.stdout:(145/150): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-08-18T21:56:30.613 INFO:teuthology.orchestra.run.smithi123.stdout:(64/150): openblas-0.3.21-2.el9.x86_64.rpm 707 kB/s | 35 kB 00:00 2024-08-18T21:56:30.624 INFO:teuthology.orchestra.run.smithi183.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-08-18T21:56:30.627 INFO:teuthology.orchestra.run.smithi130.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-08-18T21:56:30.650 INFO:teuthology.orchestra.run.smithi183.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-08-18T21:56:30.652 INFO:teuthology.orchestra.run.smithi130.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-08-18T21:56:30.711 INFO:teuthology.orchestra.run.smithi130.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-08-18T21:56:30.755 INFO:teuthology.orchestra.run.smithi123.stdout:(65/150): openblas-openmp-0.3.21-2.el9.x86_64.r 34 MB/s | 4.7 MB 00:00 2024-08-18T21:56:30.775 INFO:teuthology.orchestra.run.smithi183.stdout:(107/150): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-08-18T21:56:30.780 INFO:teuthology.orchestra.run.smithi123.stdout:(66/150): python3-requests-2.25.1-8.el9.noarch. 47 kB/s | 125 kB 00:02 2024-08-18T21:56:30.800 INFO:teuthology.orchestra.run.smithi183.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-08-18T21:56:30.822 INFO:teuthology.orchestra.run.smithi123.stdout:(67/150): python3-urllib3-1.26.5-6.el9.noarch.r 143 kB/s | 215 kB 00:01 2024-08-18T21:56:30.825 INFO:teuthology.orchestra.run.smithi183.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-18T21:56:30.851 INFO:teuthology.orchestra.run.smithi183.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-18T21:56:30.868 INFO:teuthology.orchestra.run.smithi183.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 9.0 MB/s | 151 kB 00:00 2024-08-18T21:56:30.889 INFO:teuthology.orchestra.run.smithi123.stdout:(68/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-08-18T21:56:30.901 INFO:teuthology.orchestra.run.smithi183.stdout:(112/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-08-18T21:56:30.911 INFO:teuthology.orchestra.run.smithi130.stdout:(149/150): librbd1-19.1.0-1382.gde09dd01.el9.x8 12 MB/s | 3.2 MB 00:00 2024-08-18T21:56:30.935 INFO:teuthology.orchestra.run.smithi183.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-08-18T21:56:30.948 INFO:teuthology.orchestra.run.smithi123.stdout:(69/150): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-08-18T21:56:30.960 INFO:teuthology.orchestra.run.smithi183.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-18T21:56:30.961 INFO:teuthology.orchestra.run.smithi130.stdout:(150/150): librados2-19.1.0-1382.gde09dd01.el9. 10 MB/s | 3.4 MB 00:00 2024-08-18T21:56:30.967 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2024-08-18T21:56:30.967 INFO:teuthology.orchestra.run.smithi130.stdout:Total 19 MB/s | 218 MB 00:11 2024-08-18T21:56:30.985 INFO:teuthology.orchestra.run.smithi183.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-18T21:56:31.011 INFO:teuthology.orchestra.run.smithi183.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-08-18T21:56:31.038 INFO:teuthology.orchestra.run.smithi183.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-08-18T21:56:31.061 INFO:teuthology.orchestra.run.smithi183.stdout:(118/150): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-08-18T21:56:31.095 INFO:teuthology.orchestra.run.smithi183.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.1 MB/s | 358 kB 00:00 2024-08-18T21:56:31.098 INFO:teuthology.orchestra.run.smithi123.stdout:(70/150): postgresql-server-13.14-1.el9.x86_64. 39 MB/s | 5.8 MB 00:00 2024-08-18T21:56:31.129 INFO:teuthology.orchestra.run.smithi183.stdout:(120/150): python3-google-auth-2.33.0-1.el9.noa 6.8 MB/s | 220 kB 00:00 2024-08-18T21:56:31.162 INFO:teuthology.orchestra.run.smithi183.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-08-18T21:56:31.173 INFO:teuthology.orchestra.run.smithi123.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-08-18T21:56:31.212 INFO:teuthology.orchestra.run.smithi183.stdout:(122/150): python3-grpcio-1.46.7-10.el9.x86_64. 24 MB/s | 2.0 MB 00:00 2024-08-18T21:56:31.215 INFO:teuthology.orchestra.run.smithi123.stdout:(72/150): postgresql-13.14-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-08-18T21:56:31.238 INFO:teuthology.orchestra.run.smithi183.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-08-18T21:56:31.240 INFO:teuthology.orchestra.run.smithi123.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-08-18T21:56:31.263 INFO:teuthology.orchestra.run.smithi183.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-08-18T21:56:31.274 INFO:teuthology.orchestra.run.smithi123.stdout:(74/150): postgresql-contrib-13.14-1.el9.x86_64 2.0 MB/s | 911 kB 00:00 2024-08-18T21:56:31.288 INFO:teuthology.orchestra.run.smithi183.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-08-18T21:56:31.300 INFO:teuthology.orchestra.run.smithi123.stdout:(75/150): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-08-18T21:56:31.314 INFO:teuthology.orchestra.run.smithi183.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-08-18T21:56:31.334 INFO:teuthology.orchestra.run.smithi123.stdout:(76/150): python3-devel-3.9.19-4.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-08-18T21:56:31.339 INFO:teuthology.orchestra.run.smithi183.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-08-18T21:56:31.364 INFO:teuthology.orchestra.run.smithi183.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-08-18T21:56:31.367 INFO:teuthology.orchestra.run.smithi123.stdout:(77/150): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-08-18T21:56:31.389 INFO:teuthology.orchestra.run.smithi183.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-18T21:56:31.392 INFO:teuthology.orchestra.run.smithi123.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-08-18T21:56:31.417 INFO:teuthology.orchestra.run.smithi123.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-08-18T21:56:31.431 INFO:teuthology.orchestra.run.smithi183.stdout:(130/150): protobuf-compiler-3.14.0-13.el9.x86_ 798 kB/s | 863 kB 00:01 2024-08-18T21:56:31.451 INFO:teuthology.orchestra.run.smithi123.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-08-18T21:56:31.457 INFO:teuthology.orchestra.run.smithi183.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-08-18T21:56:31.490 INFO:teuthology.orchestra.run.smithi183.stdout:(132/150): python3-pecan-1.4.2-3.el9.noarch.rpm 10 MB/s | 272 kB 00:00 2024-08-18T21:56:31.516 INFO:teuthology.orchestra.run.smithi183.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 715 kB/s | 16 kB 00:00 2024-08-18T21:56:31.526 INFO:teuthology.orchestra.run.smithi123.stdout:(81/150): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-08-18T21:56:31.541 INFO:teuthology.orchestra.run.smithi183.stdout:(134/150): python3-natsort-7.1.1-5.el9.noarch.r 529 kB/s | 58 kB 00:00 2024-08-18T21:56:31.551 INFO:teuthology.orchestra.run.smithi123.stdout:(82/150): python3-markupsafe-1.1.1-12.el9.x86_6 259 kB/s | 35 kB 00:00 2024-08-18T21:56:31.566 INFO:teuthology.orchestra.run.smithi183.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-08-18T21:56:31.585 INFO:teuthology.orchestra.run.smithi123.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-08-18T21:56:31.591 INFO:teuthology.orchestra.run.smithi183.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-08-18T21:56:31.610 INFO:teuthology.orchestra.run.smithi123.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-08-18T21:56:31.616 INFO:teuthology.orchestra.run.smithi183.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-08-18T21:56:31.635 INFO:teuthology.orchestra.run.smithi123.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-18T21:56:31.642 INFO:teuthology.orchestra.run.smithi183.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-18T21:56:31.661 INFO:teuthology.orchestra.run.smithi123.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 838 kB/s | 42 kB 00:00 2024-08-18T21:56:31.676 INFO:teuthology.orchestra.run.smithi183.stdout:(139/150): python3-kubernetes-26.1.0-2.el9.noar 3.0 MB/s | 1.0 MB 00:00 2024-08-18T21:56:31.692 INFO:teuthology.orchestra.run.smithi183.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-08-18T21:56:31.709 INFO:teuthology.orchestra.run.smithi183.stdout:(141/150): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-08-18T21:56:31.728 INFO:teuthology.orchestra.run.smithi123.stdout:(87/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-08-18T21:56:31.735 INFO:teuthology.orchestra.run.smithi183.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-08-18T21:56:31.753 INFO:teuthology.orchestra.run.smithi123.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-08-18T21:56:31.760 INFO:teuthology.orchestra.run.smithi183.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-18T21:56:31.778 INFO:teuthology.orchestra.run.smithi123.stdout:(89/150): python3-protobuf-3.14.0-13.el9.noarch 1.8 MB/s | 269 kB 00:00 2024-08-18T21:56:31.785 INFO:teuthology.orchestra.run.smithi183.stdout:(144/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-08-18T21:56:31.810 INFO:teuthology.orchestra.run.smithi183.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-08-18T21:56:31.812 INFO:teuthology.orchestra.run.smithi123.stdout:(90/150): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-08-18T21:56:31.829 INFO:teuthology.orchestra.run.smithi123.stdout:(91/150): python3-pytz-2021.1-5.el9.noarch.rpm 674 kB/s | 51 kB 00:00 2024-08-18T21:56:31.836 INFO:teuthology.orchestra.run.smithi183.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-08-18T21:56:31.845 INFO:teuthology.orchestra.run.smithi123.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 802 kB/s | 54 kB 00:00 2024-08-18T21:56:31.861 INFO:teuthology.orchestra.run.smithi183.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-08-18T21:56:31.887 INFO:teuthology.orchestra.run.smithi123.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-08-18T21:56:31.903 INFO:teuthology.orchestra.run.smithi183.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-08-18T21:56:31.904 INFO:teuthology.orchestra.run.smithi123.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 757 kB/s | 44 kB 00:00 2024-08-18T21:56:31.946 INFO:teuthology.orchestra.run.smithi123.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-08-18T21:56:31.963 INFO:teuthology.orchestra.run.smithi123.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 611 kB/s | 36 kB 00:00 2024-08-18T21:56:31.989 INFO:teuthology.orchestra.run.smithi123.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-08-18T21:56:32.031 INFO:teuthology.orchestra.run.smithi123.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-08-18T21:56:32.056 INFO:teuthology.orchestra.run.smithi123.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 862 kB/s | 58 kB 00:00 2024-08-18T21:56:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2024-08-18T21:56:32.081 INFO:teuthology.orchestra.run.smithi123.stdout:(100/150): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-08-18T21:56:32.106 INFO:teuthology.orchestra.run.smithi123.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-18T21:56:32.120 INFO:teuthology.orchestra.run.smithi183.stdout:(149/150): librados2-19.1.0-1382.gde09dd01.el9. 12 MB/s | 3.4 MB 00:00 2024-08-18T21:56:32.132 INFO:teuthology.orchestra.run.smithi123.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-08-18T21:56:32.170 INFO:teuthology.orchestra.run.smithi183.stdout:(150/150): librbd1-19.1.0-1382.gde09dd01.el9.x8 10 MB/s | 3.2 MB 00:00 2024-08-18T21:56:32.177 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-08-18T21:56:32.177 INFO:teuthology.orchestra.run.smithi183.stdout:Total 21 MB/s | 218 MB 00:10 2024-08-18T21:56:32.218 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2024-08-18T21:56:32.218 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2024-08-18T21:56:32.291 INFO:teuthology.orchestra.run.smithi123.stdout:(103/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-08-18T21:56:32.316 INFO:teuthology.orchestra.run.smithi123.stdout:(104/150): lua-devel-5.4.4-4.el9.x86_64.rpm 107 kB/s | 22 kB 00:00 2024-08-18T21:56:32.383 INFO:teuthology.orchestra.run.smithi123.stdout:(105/150): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-08-18T21:56:32.408 INFO:teuthology.orchestra.run.smithi123.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 786 kB/s | 19 kB 00:00 2024-08-18T21:56:32.450 INFO:teuthology.orchestra.run.smithi123.stdout:(107/150): gperftools-libs-2.9.1-2.el9.x86_64.r 2.3 MB/s | 309 kB 00:00 2024-08-18T21:56:32.475 INFO:teuthology.orchestra.run.smithi123.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-08-18T21:56:32.526 INFO:teuthology.orchestra.run.smithi123.stdout:(109/150): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-08-18T21:56:32.551 INFO:teuthology.orchestra.run.smithi123.stdout:(110/150): liboath-2.6.7-2.el9.x86_64.rpm 647 kB/s | 49 kB 00:00 2024-08-18T21:56:32.585 INFO:teuthology.orchestra.run.smithi123.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 5.6 MB/s | 151 kB 00:00 2024-08-18T21:56:32.618 INFO:teuthology.orchestra.run.smithi123.stdout:(112/150): libunwind-1.6.2-1.el9.x86_64.rpm 731 kB/s | 67 kB 00:00 2024-08-18T21:56:32.660 INFO:teuthology.orchestra.run.smithi123.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-08-18T21:56:32.685 INFO:teuthology.orchestra.run.smithi123.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-18T21:56:32.710 INFO:teuthology.orchestra.run.smithi123.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-18T21:56:32.736 INFO:teuthology.orchestra.run.smithi123.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 562 kB/s | 14 kB 00:00 2024-08-18T21:56:32.761 INFO:teuthology.orchestra.run.smithi123.stdout:(117/150): python3-asyncssh-2.13.2-5.el9.noarch 3.7 MB/s | 548 kB 00:00 2024-08-18T21:56:32.787 INFO:teuthology.orchestra.run.smithi123.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-08-18T21:56:32.820 INFO:teuthology.orchestra.run.smithi123.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-18T21:56:32.845 INFO:teuthology.orchestra.run.smithi123.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-18T21:56:32.871 INFO:teuthology.orchestra.run.smithi123.stdout:(121/150): python3-google-auth-2.33.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-08-18T21:56:32.896 INFO:teuthology.orchestra.run.smithi123.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-08-18T21:56:32.921 INFO:teuthology.orchestra.run.smithi123.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-08-18T21:56:32.947 INFO:teuthology.orchestra.run.smithi123.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-08-18T21:56:32.972 INFO:teuthology.orchestra.run.smithi123.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 928 kB/s | 23 kB 00:00 2024-08-18T21:56:32.997 INFO:teuthology.orchestra.run.smithi123.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 785 kB/s | 19 kB 00:00 2024-08-18T21:56:33.022 INFO:teuthology.orchestra.run.smithi123.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 790 kB/s | 20 kB 00:00 2024-08-18T21:56:33.081 INFO:teuthology.orchestra.run.smithi123.stdout:(128/150): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-08-18T21:56:33.156 INFO:teuthology.orchestra.run.smithi123.stdout:(129/150): libarrow-9.0.0-11.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-08-18T21:56:33.182 INFO:teuthology.orchestra.run.smithi123.stdout:(130/150): python3-logutils-0.3.5-21.el9.noarch 462 kB/s | 46 kB 00:00 2024-08-18T21:56:33.232 INFO:teuthology.orchestra.run.smithi123.stdout:(131/150): python3-grpcio-1.46.7-10.el9.x86_64. 5.3 MB/s | 2.0 MB 00:00 2024-08-18T21:56:33.257 INFO:teuthology.orchestra.run.smithi123.stdout:(132/150): python3-more-itertools-8.12.0-2.el9. 785 kB/s | 79 kB 00:00 2024-08-18T21:56:33.274 INFO:teuthology.orchestra.run.smithi123.stdout:(133/150): python3-natsort-7.1.1-5.el9.noarch.r 627 kB/s | 58 kB 00:00 2024-08-18T21:56:33.289 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-08-18T21:56:33.291 INFO:teuthology.orchestra.run.smithi123.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 485 kB/s | 16 kB 00:00 2024-08-18T21:56:33.308 INFO:teuthology.orchestra.run.smithi123.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-08-18T21:56:33.342 INFO:teuthology.orchestra.run.smithi123.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-08-18T21:56:33.359 INFO:teuthology.orchestra.run.smithi123.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-08-18T21:56:33.376 INFO:teuthology.orchestra.run.smithi123.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-08-18T21:56:33.401 INFO:teuthology.orchestra.run.smithi123.stdout:(139/150): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-08-18T21:56:33.423 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-08-18T21:56:33.424 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-08-18T21:56:33.426 INFO:teuthology.orchestra.run.smithi123.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-08-18T21:56:33.451 INFO:teuthology.orchestra.run.smithi123.stdout:(141/150): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-08-18T21:56:33.477 INFO:teuthology.orchestra.run.smithi123.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 985 kB/s | 74 kB 00:00 2024-08-18T21:56:33.502 INFO:teuthology.orchestra.run.smithi123.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-18T21:56:33.527 INFO:teuthology.orchestra.run.smithi123.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 803 kB/s | 20 kB 00:00 2024-08-18T21:56:33.561 INFO:teuthology.orchestra.run.smithi123.stdout:(145/150): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-08-18T21:56:33.586 INFO:teuthology.orchestra.run.smithi123.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-08-18T21:56:33.612 INFO:teuthology.orchestra.run.smithi123.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-08-18T21:56:33.662 INFO:teuthology.orchestra.run.smithi123.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-18T21:56:33.837 INFO:teuthology.orchestra.run.smithi123.stdout:(149/150): librbd1-19.1.0-1382.gde09dd01.el9.x8 14 MB/s | 3.2 MB 00:00 2024-08-18T21:56:34.343 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2024-08-18T21:56:34.343 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2024-08-18T21:56:34.379 INFO:teuthology.orchestra.run.smithi123.stdout:(150/150): librados2-19.1.0-1382.gde09dd01.el9. 4.3 MB/s | 3.4 MB 00:00 2024-08-18T21:56:34.385 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-08-18T21:56:34.385 INFO:teuthology.orchestra.run.smithi123.stdout:Total 16 MB/s | 218 MB 00:13 2024-08-18T21:56:35.492 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-08-18T21:56:35.568 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-08-18T21:56:35.569 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-08-18T21:56:35.626 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-08-18T21:56:35.626 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-08-18T21:56:37.742 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-08-18T21:56:37.742 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-08-18T21:56:40.210 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2024-08-18T21:56:40.288 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-18T21:56:40.314 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-18T21:56:40.407 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-18T21:56:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-18T21:56:40.873 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-18T21:56:40.996 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-18T21:56:41.024 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-18T21:56:41.170 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-18T21:56:41.224 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-18T21:56:41.256 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-18T21:56:41.281 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-18T21:56:41.477 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-08-18T21:56:41.483 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-08-18T21:56:41.546 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-08-18T21:56:41.555 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-18T21:56:41.573 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-18T21:56:41.622 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-18T21:56:41.678 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-18T21:56:41.699 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-18T21:56:41.771 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-18T21:56:41.792 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-18T21:56:41.804 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-18T21:56:41.811 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-18T21:56:42.124 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-18T21:56:42.159 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-18T21:56:42.193 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-18T21:56:42.248 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-18T21:56:42.271 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-18T21:56:42.379 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-18T21:56:42.383 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-18T21:56:42.416 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-18T21:56:42.417 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-08-18T21:56:42.452 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-08-18T21:56:42.512 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-18T21:56:42.527 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-08-18T21:56:42.559 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-18T21:56:42.578 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-08-18T21:56:42.587 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-18T21:56:42.613 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-18T21:56:42.618 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-packaging-20.9-5.el9.noarch 22/152 2024-08-18T21:56:42.662 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/152 2024-08-18T21:56:42.695 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/152 2024-08-18T21:56:42.730 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/152 2024-08-18T21:56:42.801 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2024-08-18T21:56:42.835 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-08-18T21:56:42.853 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 27/152 2024-08-18T21:56:42.884 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/152 2024-08-18T21:56:42.885 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-08-18T21:56:42.913 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-18T21:56:42.927 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/152 2024-08-18T21:56:43.000 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-18T21:56:43.005 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/152 2024-08-18T21:56:43.022 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-18T21:56:43.038 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 31/152 2024-08-18T21:56:43.079 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-18T21:56:43.084 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 32/152 2024-08-18T21:56:43.106 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-18T21:56:43.110 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 33/152 2024-08-18T21:56:43.133 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-18T21:56:43.183 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/152 2024-08-18T21:56:43.225 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : luarocks-3.9.2-5.el9.noarch 35/152 2024-08-18T21:56:43.301 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/152 2024-08-18T21:56:43.436 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/152 2024-08-18T21:56:43.455 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-18T21:56:43.486 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/152 2024-08-18T21:56:43.490 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-18T21:56:43.597 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-18T21:56:43.695 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-18T21:56:43.704 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-08-18T21:56:43.730 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-08-18T21:56:43.766 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-08-18T21:56:43.781 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-18T21:56:43.806 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-18T21:56:43.840 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-08-18T21:56:43.876 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-18T21:56:43.892 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-08-18T21:56:43.932 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-packaging-20.9-5.el9.noarch 22/152 2024-08-18T21:56:43.983 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/152 2024-08-18T21:56:44.017 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/152 2024-08-18T21:56:44.024 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/152 2024-08-18T21:56:44.044 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/152 2024-08-18T21:56:44.116 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/152 2024-08-18T21:56:44.131 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2024-08-18T21:56:44.151 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 41/152 2024-08-18T21:56:44.184 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 27/152 2024-08-18T21:56:44.195 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/152 2024-08-18T21:56:44.214 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-18T21:56:44.222 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/152 2024-08-18T21:56:44.233 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 43/152 2024-08-18T21:56:44.266 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/152 2024-08-18T21:56:44.267 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/152 2024-08-18T21:56:44.321 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/152 2024-08-18T21:56:44.343 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/152 2024-08-18T21:56:44.357 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-18T21:56:44.376 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 31/152 2024-08-18T21:56:44.395 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-18T21:56:44.422 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 32/152 2024-08-18T21:56:44.425 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-18T21:56:44.448 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 33/152 2024-08-18T21:56:44.461 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-18T21:56:44.480 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-18T21:56:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-18T21:56:44.517 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-18T21:56:44.520 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/152 2024-08-18T21:56:44.544 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-18T21:56:44.571 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : luarocks-3.9.2-5.el9.noarch 35/152 2024-08-18T21:56:44.596 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-18T21:56:44.612 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-18T21:56:44.647 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/152 2024-08-18T21:56:44.647 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-18T21:56:44.668 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-18T21:56:44.696 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-18T21:56:44.722 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-18T21:56:44.786 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-18T21:56:44.792 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/152 2024-08-18T21:56:44.823 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-18T21:56:44.857 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/152 2024-08-18T21:56:44.865 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-18T21:56:44.925 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-08-18T21:56:44.969 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-18T21:56:44.977 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-08-18T21:56:45.005 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-18T21:56:45.015 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-18T21:56:45.055 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-18T21:56:45.088 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-18T21:56:45.093 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-18T21:56:45.113 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-18T21:56:45.123 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-18T21:56:45.191 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-18T21:56:45.216 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-18T21:56:45.235 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-18T21:56:45.238 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-18T21:56:45.367 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-18T21:56:45.398 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/152 2024-08-18T21:56:45.404 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-18T21:56:45.432 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-18T21:56:45.467 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-18T21:56:45.477 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/152 2024-08-18T21:56:45.506 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 41/152 2024-08-18T21:56:45.512 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-18T21:56:45.550 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/152 2024-08-18T21:56:45.563 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-18T21:56:45.587 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 43/152 2024-08-18T21:56:45.591 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-18T21:56:45.620 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/152 2024-08-18T21:56:45.642 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-18T21:56:45.675 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/152 2024-08-18T21:56:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-18T21:56:45.748 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-18T21:56:45.779 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-18T21:56:45.815 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-18T21:56:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-18T21:56:45.863 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-18T21:56:45.875 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-08-18T21:56:45.898 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-18T21:56:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-08-18T21:56:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-18T21:56:45.949 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-18T21:56:45.969 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-18T21:56:45.992 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-18T21:56:46.004 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-18T21:56:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-08-18T21:56:46.037 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-18T21:56:46.089 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-18T21:56:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-08-18T21:56:46.121 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-18T21:56:46.130 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-18T21:56:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-packaging-20.9-5.el9.noarch 22/152 2024-08-18T21:56:46.168 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-18T21:56:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/152 2024-08-18T21:56:46.210 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-18T21:56:46.215 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-18T21:56:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/152 2024-08-18T21:56:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/152 2024-08-18T21:56:46.269 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-18T21:56:46.307 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-18T21:56:46.314 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-18T21:56:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2024-08-18T21:56:46.352 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-18T21:56:46.385 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-18T21:56:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 27/152 2024-08-18T21:56:46.415 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-18T21:56:46.416 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-18T21:56:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/152 2024-08-18T21:56:46.441 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-18T21:56:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/152 2024-08-18T21:56:46.484 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-18T21:56:46.545 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-18T21:56:46.561 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/152 2024-08-18T21:56:46.594 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 31/152 2024-08-18T21:56:46.640 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 32/152 2024-08-18T21:56:46.666 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 33/152 2024-08-18T21:56:46.677 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-18T21:56:46.716 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-18T21:56:46.737 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/152 2024-08-18T21:56:46.757 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-18T21:56:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : luarocks-3.9.2-5.el9.noarch 35/152 2024-08-18T21:56:46.795 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-18T21:56:46.840 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-18T21:56:46.856 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/152 2024-08-18T21:56:46.876 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-18T21:56:46.924 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-18T21:56:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/152 2024-08-18T21:56:47.021 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-18T21:56:47.050 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/152 2024-08-18T21:56:47.055 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-18T21:56:47.089 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-18T21:56:47.130 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-18T21:56:47.164 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-18T21:56:47.232 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-18T21:56:47.253 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-18T21:56:47.280 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-18T21:56:47.303 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-18T21:56:47.314 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-18T21:56:47.334 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-18T21:56:47.417 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-18T21:56:47.439 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-18T21:56:47.469 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 83/152 2024-08-18T21:56:47.494 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-18T21:56:47.514 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-18T21:56:47.576 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/152 2024-08-18T21:56:47.604 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-18T21:56:47.643 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-18T21:56:47.662 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/152 2024-08-18T21:56:47.690 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 41/152 2024-08-18T21:56:47.734 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/152 2024-08-18T21:56:47.771 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 43/152 2024-08-18T21:56:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/152 2024-08-18T21:56:47.821 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-08-18T21:56:47.849 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-08-18T21:56:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/152 2024-08-18T21:56:47.928 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-18T21:56:47.932 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-18T21:56:47.972 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-18T21:56:48.008 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-18T21:56:48.055 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-18T21:56:48.099 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-18T21:56:48.142 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-18T21:56:48.184 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-18T21:56:48.233 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-18T21:56:48.282 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-18T21:56:48.316 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-18T21:56:48.320 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-18T21:56:48.361 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-18T21:56:48.403 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-18T21:56:48.416 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-18T21:56:48.471 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 83/152 2024-08-18T21:56:48.505 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-18T21:56:48.515 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-18T21:56:48.553 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-18T21:56:48.594 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-18T21:56:48.604 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-18T21:56:48.605 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-18T21:56:48.627 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-18T21:56:48.644 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-18T21:56:48.651 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-18T21:56:48.716 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-18T21:56:48.746 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-18T21:56:48.820 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-08-18T21:56:48.842 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-08-18T21:56:48.869 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-18T21:56:48.900 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-18T21:56:48.920 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-18T21:56:48.928 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-18T21:56:48.963 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-18T21:56:49.030 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-18T21:56:49.079 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-18T21:56:49.218 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-18T21:56:49.465 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-18T21:56:49.499 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-18T21:56:49.533 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-18T21:56:49.575 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-18T21:56:49.583 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-18T21:56:49.608 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-18T21:56:49.700 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-18T21:56:49.708 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-18T21:56:49.756 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-18T21:56:49.787 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-18T21:56:49.891 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-18T21:56:49.946 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-18T21:56:50.022 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-18T21:56:50.104 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-18T21:56:50.133 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-18T21:56:50.165 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-18T21:56:50.484 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-18T21:56:50.527 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-18T21:56:50.606 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-18T21:56:50.633 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 98/152 2024-08-18T21:56:50.669 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-18T21:56:50.671 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-18T21:56:50.718 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-18T21:56:50.752 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-18T21:56:50.853 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-18T21:56:50.915 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 83/152 2024-08-18T21:56:50.960 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-18T21:56:50.983 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-18T21:56:51.048 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-18T21:56:51.070 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-18T21:56:51.088 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-18T21:56:51.096 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-18T21:56:51.123 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-18T21:56:51.144 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-18T21:56:51.247 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-18T21:56:51.280 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-08-18T21:56:51.310 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-08-18T21:56:51.345 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-18T21:56:51.374 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 102/152 2024-08-18T21:56:51.388 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-18T21:56:51.439 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-18T21:56:51.486 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-18T21:56:51.606 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-18T21:56:51.632 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 98/152 2024-08-18T21:56:51.669 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-18T21:56:52.055 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-18T21:56:52.143 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-18T21:56:52.168 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-18T21:56:52.247 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-18T21:56:52.320 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-18T21:56:52.348 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 102/152 2024-08-18T21:56:53.437 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-18T21:56:53.514 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-18T21:56:53.545 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-18T21:56:53.575 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-18T21:56:53.878 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-18T21:56:53.884 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-18T21:56:53.913 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-18T21:56:53.929 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-18T21:56:54.024 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-18T21:56:54.051 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 98/152 2024-08-18T21:56:54.116 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-18T21:56:54.479 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-18T21:56:54.517 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-18T21:56:54.587 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-18T21:56:54.612 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-18T21:56:54.612 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-18T21:56:54.612 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-18T21:56:54.613 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T21:56:54.615 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-18T21:56:54.651 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-18T21:56:54.654 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-18T21:56:54.671 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-18T21:56:54.695 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-18T21:56:54.700 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 102/152 2024-08-18T21:56:55.279 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-18T21:56:55.315 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-18T21:56:55.413 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-18T21:56:55.413 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-18T21:56:55.413 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-18T21:56:55.413 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:56:55.459 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-18T21:56:56.981 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-18T21:56:57.022 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-18T21:56:57.600 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-18T21:56:57.634 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-18T21:56:57.726 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-18T21:56:57.726 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-18T21:56:57.727 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-18T21:56:57.727 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:56:57.768 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-18T21:57:05.991 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-18T21:57:05.991 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /sys 2024-08-18T21:57:05.992 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /proc 2024-08-18T21:57:05.992 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /mnt 2024-08-18T21:57:05.992 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /var/tmp 2024-08-18T21:57:05.992 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /home 2024-08-18T21:57:05.992 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /root 2024-08-18T21:57:05.992 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /tmp 2024-08-18T21:57:05.992 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T21:57:06.165 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-18T21:57:06.181 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-18T21:57:06.181 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:06.181 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-18T21:57:06.181 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T21:57:06.796 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-18T21:57:06.796 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /sys 2024-08-18T21:57:06.796 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /proc 2024-08-18T21:57:06.796 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /mnt 2024-08-18T21:57:06.797 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /var/tmp 2024-08-18T21:57:06.797 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /home 2024-08-18T21:57:06.797 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /root 2024-08-18T21:57:06.797 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /tmp 2024-08-18T21:57:06.797 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:57:06.977 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-18T21:57:06.994 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-18T21:57:06.994 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:06.994 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-18T21:57:06.994 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:57:07.643 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-18T21:57:07.669 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-18T21:57:07.670 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:07.670 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-18T21:57:07.670 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-18T21:57:07.670 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-18T21:57:07.670 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T21:57:07.893 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-18T21:57:07.917 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-18T21:57:07.917 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:07.917 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-18T21:57:07.917 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-18T21:57:07.917 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-18T21:57:07.917 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T21:57:08.361 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-18T21:57:08.385 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-18T21:57:08.385 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:08.385 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-18T21:57:08.385 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-18T21:57:08.385 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-18T21:57:08.385 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T21:57:08.455 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-18T21:57:08.482 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-18T21:57:08.482 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:08.482 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-18T21:57:08.482 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-18T21:57:08.482 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-18T21:57:08.482 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:57:08.491 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-18T21:57:08.540 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-18T21:57:08.605 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-18T21:57:08.706 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-18T21:57:08.729 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-18T21:57:08.729 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:08.729 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-18T21:57:08.729 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-18T21:57:08.730 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-18T21:57:08.730 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:57:08.791 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-18T21:57:08.854 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-18T21:57:08.924 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-18T21:57:09.013 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-18T21:57:09.101 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-18T21:57:09.101 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /sys 2024-08-18T21:57:09.101 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /proc 2024-08-18T21:57:09.101 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /mnt 2024-08-18T21:57:09.101 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /var/tmp 2024-08-18T21:57:09.101 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /home 2024-08-18T21:57:09.101 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /root 2024-08-18T21:57:09.101 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /tmp 2024-08-18T21:57:09.101 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:57:09.152 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-18T21:57:09.173 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-18T21:57:09.196 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-18T21:57:09.197 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-18T21:57:09.197 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:09.197 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-18T21:57:09.198 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-18T21:57:09.198 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-18T21:57:09.198 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:57:09.236 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-18T21:57:09.255 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-18T21:57:09.288 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-18T21:57:09.304 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-18T21:57:09.304 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:09.304 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-18T21:57:09.304 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:57:09.311 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-18T21:57:09.369 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-18T21:57:09.429 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-18T21:57:09.618 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-18T21:57:09.666 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-18T21:57:09.744 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-18T21:57:09.759 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-18T21:57:09.787 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-18T21:57:09.819 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 122/152 2024-08-18T21:57:09.832 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-18T21:57:09.890 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 123/152 2024-08-18T21:57:09.927 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-18T21:57:09.980 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-18T21:57:10.029 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-18T21:57:10.064 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-18T21:57:10.092 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-18T21:57:10.487 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-18T21:57:10.515 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-18T21:57:10.547 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 122/152 2024-08-18T21:57:10.626 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 123/152 2024-08-18T21:57:10.663 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-18T21:57:10.791 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-18T21:57:10.817 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-18T21:57:10.817 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:10.817 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-18T21:57:10.818 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-18T21:57:10.818 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-18T21:57:10.818 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:57:10.976 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-18T21:57:11.013 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-18T21:57:11.041 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-18T21:57:11.065 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-18T21:57:11.065 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:11.065 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-18T21:57:11.065 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-18T21:57:11.065 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-18T21:57:11.065 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:57:11.500 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-18T21:57:11.524 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-18T21:57:11.524 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:11.524 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-18T21:57:11.524 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-18T21:57:11.524 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-18T21:57:11.524 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:57:11.630 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-18T21:57:11.678 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-18T21:57:11.706 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-18T21:57:11.740 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-18T21:57:11.749 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-18T21:57:11.934 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-18T21:57:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-18T21:57:11.983 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-18T21:57:12.005 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-18T21:57:12.053 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-18T21:57:12.109 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-18T21:57:12.141 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-18T21:57:12.276 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 127/152 2024-08-18T21:57:12.279 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-18T21:57:12.315 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-18T21:57:12.318 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-18T21:57:12.340 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-18T21:57:12.340 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:12.340 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-18T21:57:12.340 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-18T21:57:12.340 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-18T21:57:12.340 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T21:57:12.358 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-18T21:57:12.386 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-18T21:57:12.391 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-18T21:57:12.403 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-18T21:57:12.502 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 130/152 2024-08-18T21:57:12.561 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 131/152 2024-08-18T21:57:12.703 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-18T21:57:12.724 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-18T21:57:12.827 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-18T21:57:12.865 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-18T21:57:12.892 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-18T21:57:12.923 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 122/152 2024-08-18T21:57:12.985 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 123/152 2024-08-18T21:57:12.994 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 127/152 2024-08-18T21:57:13.015 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-18T21:57:13.026 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-18T21:57:13.050 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-18T21:57:13.050 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:13.051 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-18T21:57:13.051 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-18T21:57:13.051 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-18T21:57:13.051 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:57:13.118 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-18T21:57:13.131 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-18T21:57:13.235 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 130/152 2024-08-18T21:57:13.290 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 131/152 2024-08-18T21:57:13.476 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-18T21:57:13.510 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-18T21:57:13.535 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-18T21:57:13.535 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:13.535 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-18T21:57:13.535 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-18T21:57:13.535 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-18T21:57:13.535 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T21:57:13.578 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-18T21:57:13.601 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-18T21:57:13.601 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:13.601 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-18T21:57:13.601 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T21:57:13.653 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-18T21:57:13.678 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-18T21:57:13.678 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:13.678 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-18T21:57:13.678 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-18T21:57:13.678 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-18T21:57:13.678 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T21:57:13.996 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-18T21:57:14.020 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-18T21:57:14.020 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:14.020 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-18T21:57:14.020 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-18T21:57:14.020 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-18T21:57:14.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T21:57:14.049 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-18T21:57:14.084 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-18T21:57:14.207 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-18T21:57:14.237 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-18T21:57:14.261 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-18T21:57:14.261 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:14.262 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-18T21:57:14.262 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-18T21:57:14.262 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-18T21:57:14.262 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:57:14.304 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-18T21:57:14.327 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-18T21:57:14.327 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:14.328 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-18T21:57:14.328 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:57:14.380 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-18T21:57:14.403 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-18T21:57:14.403 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:14.403 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-18T21:57:14.403 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-18T21:57:14.404 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-18T21:57:14.404 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:57:14.705 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-18T21:57:14.729 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-18T21:57:14.729 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:14.729 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-18T21:57:14.729 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-18T21:57:14.729 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-18T21:57:14.729 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:57:15.039 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-18T21:57:15.067 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-18T21:57:15.168 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-18T21:57:15.339 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 127/152 2024-08-18T21:57:15.369 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-18T21:57:15.393 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-18T21:57:15.394 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:15.394 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-18T21:57:15.394 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-18T21:57:15.394 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-18T21:57:15.394 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:57:15.445 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-18T21:57:15.457 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-18T21:57:15.564 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 130/152 2024-08-18T21:57:15.628 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 131/152 2024-08-18T21:57:16.533 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-18T21:57:16.564 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-18T21:57:16.588 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-18T21:57:16.588 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:16.588 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-18T21:57:16.588 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-18T21:57:16.588 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-18T21:57:16.588 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:57:16.632 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-18T21:57:16.655 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-18T21:57:16.655 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:16.655 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-18T21:57:16.655 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:57:16.699 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-18T21:57:16.722 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-18T21:57:16.722 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:16.723 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-18T21:57:16.723 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-18T21:57:16.723 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-18T21:57:16.723 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:57:17.033 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-18T21:57:17.056 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-18T21:57:17.057 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T21:57:17.057 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-18T21:57:17.057 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-18T21:57:17.057 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-18T21:57:17.057 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:57:18.583 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 137/152 2024-08-18T21:57:18.624 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 138/152 2024-08-18T21:57:18.688 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 139/152 2024-08-18T21:57:18.723 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 140/152 2024-08-18T21:57:18.757 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-18T21:57:18.968 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 142/152 2024-08-18T21:57:19.012 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-08-18T21:57:19.042 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 144/152 2024-08-18T21:57:19.300 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 137/152 2024-08-18T21:57:19.342 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 138/152 2024-08-18T21:57:19.386 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 139/152 2024-08-18T21:57:19.415 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 140/152 2024-08-18T21:57:19.442 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-18T21:57:19.630 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 142/152 2024-08-18T21:57:19.670 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-18T21:57:19.679 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-08-18T21:57:19.707 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-18T21:57:19.709 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 144/152 2024-08-18T21:57:19.728 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-18T21:57:20.292 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-18T21:57:20.334 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-18T21:57:20.353 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-18T21:57:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 146/152 2024-08-18T21:57:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-18T21:57:20.715 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-18T21:57:20.824 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-18T21:57:20.858 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-18T21:57:20.858 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-18T21:57:20.934 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-18T21:57:20.934 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-18T21:57:21.190 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 146/152 2024-08-18T21:57:21.270 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-18T21:57:21.320 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-18T21:57:21.427 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-18T21:57:21.457 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-18T21:57:21.457 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-18T21:57:21.549 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-18T21:57:21.550 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-18T21:57:21.595 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 137/152 2024-08-18T21:57:21.636 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 138/152 2024-08-18T21:57:21.696 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 139/152 2024-08-18T21:57:21.726 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 140/152 2024-08-18T21:57:21.752 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-18T21:57:21.949 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 142/152 2024-08-18T21:57:21.990 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-08-18T21:57:22.020 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 144/152 2024-08-18T21:57:22.643 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-18T21:57:22.684 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-18T21:57:22.705 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-18T21:57:23.534 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 146/152 2024-08-18T21:57:23.681 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-18T21:57:23.729 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-18T21:57:23.840 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-18T21:57:23.876 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-18T21:57:23.876 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-18T21:57:23.969 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-18T21:57:23.969 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-18T21:57:26.754 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-18T21:57:26.754 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 1/152 2024-08-18T21:57:26.754 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2/152 2024-08-18T21:57:26.754 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 3/152 2024-08-18T21:57:26.754 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 4/152 2024-08-18T21:57:26.755 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 5/152 2024-08-18T21:57:26.755 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-18T21:57:26.755 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-18T21:57:26.755 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 8/152 2024-08-18T21:57:26.755 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 9/152 2024-08-18T21:57:26.755 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 10/152 2024-08-18T21:57:26.755 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 11/152 2024-08-18T21:57:26.755 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-18T21:57:26.755 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 13/152 2024-08-18T21:57:26.755 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 14/152 2024-08-18T21:57:26.755 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 15/152 2024-08-18T21:57:26.755 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 16/152 2024-08-18T21:57:26.756 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 17/152 2024-08-18T21:57:26.756 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 18/152 2024-08-18T21:57:26.756 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 19/152 2024-08-18T21:57:26.756 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 20/152 2024-08-18T21:57:26.756 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 21/152 2024-08-18T21:57:26.756 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 22/152 2024-08-18T21:57:26.756 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 23/152 2024-08-18T21:57:26.756 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 24/152 2024-08-18T21:57:26.756 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 25/152 2024-08-18T21:57:26.756 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 26/152 2024-08-18T21:57:26.756 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 27/152 2024-08-18T21:57:26.756 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 28/152 2024-08-18T21:57:26.757 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 29/152 2024-08-18T21:57:26.768 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 30/152 2024-08-18T21:57:26.768 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 31/152 2024-08-18T21:57:26.768 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 32/152 2024-08-18T21:57:26.768 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 33/152 2024-08-18T21:57:26.768 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 34/152 2024-08-18T21:57:26.768 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 35/152 2024-08-18T21:57:26.768 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 36/152 2024-08-18T21:57:26.768 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 37/152 2024-08-18T21:57:26.768 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 38/152 2024-08-18T21:57:26.768 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 39/152 2024-08-18T21:57:26.769 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-18T21:57:26.769 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-08-18T21:57:26.769 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-08-18T21:57:26.769 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-18T21:57:26.769 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-18T21:57:26.769 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-18T21:57:26.769 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-18T21:57:26.769 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-18T21:57:26.769 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-18T21:57:26.769 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-18T21:57:26.769 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-18T21:57:26.769 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-18T21:57:26.769 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-18T21:57:26.770 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-18T21:57:26.770 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-18T21:57:26.770 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-18T21:57:26.770 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-18T21:57:26.770 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-18T21:57:26.770 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-18T21:57:26.770 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-18T21:57:26.770 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-18T21:57:26.770 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-18T21:57:26.770 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-18T21:57:26.770 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-18T21:57:26.770 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-18T21:57:26.771 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-18T21:57:26.771 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-08-18T21:57:26.771 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-08-18T21:57:26.771 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-18T21:57:26.771 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-08-18T21:57:26.771 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-08-18T21:57:26.771 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-08-18T21:57:26.771 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-08-18T21:57:26.771 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-18T21:57:26.771 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-18T21:57:26.771 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-18T21:57:26.771 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-18T21:57:26.772 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 77/152 2024-08-18T21:57:26.772 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-18T21:57:26.772 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-18T21:57:26.772 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-18T21:57:26.772 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-18T21:57:26.772 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-18T21:57:26.772 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-18T21:57:26.772 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-18T21:57:26.772 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-18T21:57:26.772 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-18T21:57:26.772 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-18T21:57:26.772 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-18T21:57:26.772 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-18T21:57:26.772 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-18T21:57:26.773 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-18T21:57:26.773 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-18T21:57:26.773 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-18T21:57:26.773 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-18T21:57:26.773 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-18T21:57:26.773 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-18T21:57:26.773 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-18T21:57:26.773 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-18T21:57:26.773 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-18T21:57:26.773 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-18T21:57:26.773 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/152 2024-08-18T21:57:26.773 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-18T21:57:26.773 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-18T21:57:26.774 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-18T21:57:26.774 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-18T21:57:26.774 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-18T21:57:26.774 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-18T21:57:26.774 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-18T21:57:26.774 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-18T21:57:26.774 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-18T21:57:26.774 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-18T21:57:26.774 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-18T21:57:26.774 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-18T21:57:26.774 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-18T21:57:26.774 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-18T21:57:26.775 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-18T21:57:26.775 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-18T21:57:26.775 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-18T21:57:26.775 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-18T21:57:26.775 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-18T21:57:26.775 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-18T21:57:26.775 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-18T21:57:26.775 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-18T21:57:26.775 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-18T21:57:26.775 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-18T21:57:26.775 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-18T21:57:26.775 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-18T21:57:26.775 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-18T21:57:26.776 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-18T21:57:26.776 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-18T21:57:26.776 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-18T21:57:26.776 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-18T21:57:26.776 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-18T21:57:26.776 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-18T21:57:26.776 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-18T21:57:26.776 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-18T21:57:26.776 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-18T21:57:26.776 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-18T21:57:26.776 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-18T21:57:26.776 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-18T21:57:26.776 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-18T21:57:26.777 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-18T21:57:26.777 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-18T21:57:26.777 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-18T21:57:26.777 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-18T21:57:26.777 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-18T21:57:26.777 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-18T21:57:26.777 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-18T21:57:26.777 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 149/152 2024-08-18T21:57:26.777 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-18T21:57:26.777 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 151/152 2024-08-18T21:57:27.345 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-18T21:57:27.345 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 1/152 2024-08-18T21:57:27.346 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2/152 2024-08-18T21:57:27.346 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 3/152 2024-08-18T21:57:27.346 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 4/152 2024-08-18T21:57:27.346 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 5/152 2024-08-18T21:57:27.346 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-18T21:57:27.346 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-18T21:57:27.347 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 8/152 2024-08-18T21:57:27.347 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 9/152 2024-08-18T21:57:27.347 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 10/152 2024-08-18T21:57:27.347 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 11/152 2024-08-18T21:57:27.347 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-18T21:57:27.347 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 13/152 2024-08-18T21:57:27.347 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 14/152 2024-08-18T21:57:27.347 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 15/152 2024-08-18T21:57:27.347 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 16/152 2024-08-18T21:57:27.348 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 17/152 2024-08-18T21:57:27.348 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 18/152 2024-08-18T21:57:27.348 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 19/152 2024-08-18T21:57:27.348 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 20/152 2024-08-18T21:57:27.348 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 21/152 2024-08-18T21:57:27.348 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 22/152 2024-08-18T21:57:27.349 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 23/152 2024-08-18T21:57:27.349 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 24/152 2024-08-18T21:57:27.349 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 25/152 2024-08-18T21:57:27.349 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 26/152 2024-08-18T21:57:27.349 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 27/152 2024-08-18T21:57:27.349 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 28/152 2024-08-18T21:57:27.349 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 29/152 2024-08-18T21:57:27.349 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 30/152 2024-08-18T21:57:27.350 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 31/152 2024-08-18T21:57:27.350 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 32/152 2024-08-18T21:57:27.350 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 33/152 2024-08-18T21:57:27.350 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 34/152 2024-08-18T21:57:27.350 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 35/152 2024-08-18T21:57:27.350 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 36/152 2024-08-18T21:57:27.350 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 37/152 2024-08-18T21:57:27.350 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 38/152 2024-08-18T21:57:27.350 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 39/152 2024-08-18T21:57:27.351 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-18T21:57:27.351 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-08-18T21:57:27.351 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-08-18T21:57:27.351 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-18T21:57:27.351 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-18T21:57:27.351 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-18T21:57:27.351 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-18T21:57:27.351 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-18T21:57:27.351 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-18T21:57:27.351 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-18T21:57:27.351 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-18T21:57:27.352 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-18T21:57:27.352 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-18T21:57:27.352 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-18T21:57:27.352 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-18T21:57:27.352 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-18T21:57:27.352 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-18T21:57:27.352 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-18T21:57:27.352 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-18T21:57:27.352 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-18T21:57:27.352 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-18T21:57:27.352 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-18T21:57:27.352 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-18T21:57:27.353 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-18T21:57:27.353 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-18T21:57:27.353 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-18T21:57:27.353 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-08-18T21:57:27.353 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-08-18T21:57:27.353 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-18T21:57:27.353 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-08-18T21:57:27.353 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-08-18T21:57:27.353 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-08-18T21:57:27.353 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-08-18T21:57:27.353 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-18T21:57:27.354 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-18T21:57:27.354 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-18T21:57:27.354 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-18T21:57:27.354 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 77/152 2024-08-18T21:57:27.354 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-18T21:57:27.354 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-18T21:57:27.354 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-18T21:57:27.354 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-18T21:57:27.354 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-18T21:57:27.354 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-18T21:57:27.354 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-18T21:57:27.355 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-18T21:57:27.355 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-18T21:57:27.355 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-18T21:57:27.355 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-18T21:57:27.355 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-18T21:57:27.355 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-18T21:57:27.355 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-18T21:57:27.355 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-18T21:57:27.355 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-18T21:57:27.355 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-18T21:57:27.355 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-18T21:57:27.355 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-18T21:57:27.356 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-18T21:57:27.356 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-18T21:57:27.356 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-18T21:57:27.356 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-18T21:57:27.356 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/152 2024-08-18T21:57:27.356 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-18T21:57:27.356 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-18T21:57:27.356 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-18T21:57:27.357 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-18T21:57:27.357 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-18T21:57:27.357 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-18T21:57:27.357 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-18T21:57:27.357 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-18T21:57:27.357 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-18T21:57:27.357 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-18T21:57:27.357 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-18T21:57:27.357 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-18T21:57:27.357 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-18T21:57:27.357 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-18T21:57:27.358 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-18T21:57:27.358 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-18T21:57:27.358 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-18T21:57:27.358 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-18T21:57:27.358 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-18T21:57:27.358 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-18T21:57:27.358 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-18T21:57:27.358 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-18T21:57:27.358 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-18T21:57:27.358 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-18T21:57:27.358 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-18T21:57:27.359 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-18T21:57:27.359 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-18T21:57:27.359 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-18T21:57:27.359 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-18T21:57:27.359 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-18T21:57:27.359 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-18T21:57:27.359 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-18T21:57:27.359 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-18T21:57:27.359 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-18T21:57:27.359 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-18T21:57:27.359 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-18T21:57:27.359 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-18T21:57:27.360 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-18T21:57:27.360 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-18T21:57:27.360 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-18T21:57:27.360 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-18T21:57:27.360 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-18T21:57:27.360 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-18T21:57:27.360 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-18T21:57:27.360 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-18T21:57:27.360 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-18T21:57:27.361 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-18T21:57:27.361 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 149/152 2024-08-18T21:57:27.361 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-18T21:57:27.361 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 151/152 2024-08-18T21:57:28.989 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-18T21:57:28.989 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T21:57:28.990 INFO:teuthology.orchestra.run.smithi130.stdout:Upgraded: 2024-08-18T21:57:28.990 INFO:teuthology.orchestra.run.smithi130.stdout: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.990 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.990 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2024-08-18T21:57:28.990 INFO:teuthology.orchestra.run.smithi130.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-18T21:57:28.990 INFO:teuthology.orchestra.run.smithi130.stdout: automake-1.16.2-8.el9.noarch 2024-08-18T21:57:28.990 INFO:teuthology.orchestra.run.smithi130.stdout: bison-3.7.4-5.el9.x86_64 2024-08-18T21:57:28.990 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-18T21:57:28.990 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.991 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.991 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.991 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.991 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:28.991 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.991 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.991 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.991 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:28.991 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:28.991 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:28.991 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:28.992 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:28.992 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.992 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.992 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:28.992 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.992 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.992 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.992 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:28.992 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:28.993 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.993 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.993 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:28.993 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-18T21:57:28.993 INFO:teuthology.orchestra.run.smithi130.stdout: flex-2.6.4-9.el9.x86_64 2024-08-18T21:57:28.993 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-18T21:57:28.993 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-18T21:57:28.993 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-18T21:57:28.993 INFO:teuthology.orchestra.run.smithi130.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-18T21:57:28.993 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-18T21:57:28.993 INFO:teuthology.orchestra.run.smithi130.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-18T21:57:28.994 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-18T21:57:28.994 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-18T21:57:28.994 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-18T21:57:28.994 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.994 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.994 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.994 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-18T21:57:28.994 INFO:teuthology.orchestra.run.smithi130.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-18T21:57:28.994 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-18T21:57:28.994 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-18T21:57:28.994 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-18T21:57:28.995 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.995 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.995 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-18T21:57:28.995 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.995 INFO:teuthology.orchestra.run.smithi130.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-18T21:57:28.995 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-18T21:57:28.995 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-18T21:57:28.995 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-18T21:57:28.995 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-18T21:57:28.995 INFO:teuthology.orchestra.run.smithi130.stdout: lua-5.4.4-4.el9.x86_64 2024-08-18T21:57:28.995 INFO:teuthology.orchestra.run.smithi130.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-18T21:57:28.995 INFO:teuthology.orchestra.run.smithi130.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-18T21:57:28.995 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-18T21:57:28.995 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-18T21:57:28.996 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-18T21:57:28.996 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-18T21:57:28.996 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-13.14-1.el9.x86_64 2024-08-18T21:57:28.996 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-08-18T21:57:28.996 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-08-18T21:57:28.996 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server-13.14-1.el9.x86_64 2024-08-18T21:57:28.996 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-18T21:57:28.996 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-18T21:57:28.996 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-18T21:57:28.996 INFO:teuthology.orchestra.run.smithi130.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-18T21:57:28.996 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-18T21:57:28.996 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-18T21:57:28.996 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-18T21:57:28.996 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.997 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.997 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:28.997 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-18T21:57:28.997 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-18T21:57:28.997 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-18T21:57:28.997 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-18T21:57:28.997 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-18T21:57:28.997 INFO:teuthology.orchestra.run.smithi130.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-18T21:57:28.997 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-18T21:57:28.997 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-18T21:57:28.997 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-18T21:57:28.997 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-18T21:57:28.997 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-18T21:57:28.998 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-18T21:57:28.998 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-18T21:57:28.998 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-18T21:57:28.998 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-18T21:57:28.998 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-18T21:57:28.998 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-18T21:57:28.998 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-18T21:57:28.998 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-18T21:57:28.998 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-18T21:57:28.998 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-18T21:57:28.998 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-18T21:57:28.998 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-18T21:57:28.999 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-18T21:57:28.999 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-18T21:57:28.999 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-18T21:57:28.999 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-18T21:57:28.999 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-18T21:57:28.999 INFO:teuthology.orchestra.run.smithi130.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-18T21:57:28.999 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-18T21:57:28.999 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply-3.11-14.el9.noarch 2024-08-18T21:57:28.999 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-18T21:57:28.999 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-18T21:57:28.999 INFO:teuthology.orchestra.run.smithi130.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-18T21:57:28.999 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-18T21:57:29.000 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-18T21:57:29.000 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-18T21:57:29.000 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-18T21:57:29.000 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-18T21:57:29.000 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-18T21:57:29.000 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.000 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.000 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-18T21:57:29.000 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-18T21:57:29.000 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-18T21:57:29.000 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.000 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-18T21:57:29.000 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-18T21:57:29.001 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-18T21:57:29.001 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-18T21:57:29.001 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-18T21:57:29.001 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-18T21:57:29.001 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-18T21:57:29.001 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-18T21:57:29.001 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-18T21:57:29.001 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-18T21:57:29.001 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-18T21:57:29.001 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-18T21:57:29.001 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-18T21:57:29.001 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-18T21:57:29.002 INFO:teuthology.orchestra.run.smithi130.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-18T21:57:29.002 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.002 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.002 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.002 INFO:teuthology.orchestra.run.smithi130.stdout: re2-1:20211101-3.el9.x86_64 2024-08-18T21:57:29.002 INFO:teuthology.orchestra.run.smithi130.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-18T21:57:29.002 INFO:teuthology.orchestra.run.smithi130.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-18T21:57:29.002 INFO:teuthology.orchestra.run.smithi130.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-18T21:57:29.002 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-18T21:57:29.002 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-18T21:57:29.003 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-18T21:57:29.003 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T21:57:29.003 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2024-08-18T21:57:29.329 DEBUG:teuthology.parallel:result is None 2024-08-18T21:57:29.579 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-18T21:57:29.580 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:57:29.580 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2024-08-18T21:57:29.580 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.580 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.580 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-08-18T21:57:29.580 INFO:teuthology.orchestra.run.smithi183.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-18T21:57:29.580 INFO:teuthology.orchestra.run.smithi183.stdout: automake-1.16.2-8.el9.noarch 2024-08-18T21:57:29.580 INFO:teuthology.orchestra.run.smithi183.stdout: bison-3.7.4-5.el9.x86_64 2024-08-18T21:57:29.580 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-18T21:57:29.580 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.580 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.580 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.581 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.581 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:29.581 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.581 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.581 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.581 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:29.581 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:29.581 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:29.581 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:29.581 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:29.581 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.581 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.581 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:29.582 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.582 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.582 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.582 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:29.582 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:29.582 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.582 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.582 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:29.582 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-18T21:57:29.582 INFO:teuthology.orchestra.run.smithi183.stdout: flex-2.6.4-9.el9.x86_64 2024-08-18T21:57:29.582 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-18T21:57:29.582 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-18T21:57:29.582 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-18T21:57:29.583 INFO:teuthology.orchestra.run.smithi183.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-18T21:57:29.583 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-18T21:57:29.583 INFO:teuthology.orchestra.run.smithi183.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-18T21:57:29.583 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-18T21:57:29.583 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-18T21:57:29.583 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-18T21:57:29.583 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.583 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.584 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.584 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-18T21:57:29.584 INFO:teuthology.orchestra.run.smithi183.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-18T21:57:29.584 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-18T21:57:29.584 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-18T21:57:29.584 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-18T21:57:29.584 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.584 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.584 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-18T21:57:29.584 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.584 INFO:teuthology.orchestra.run.smithi183.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-18T21:57:29.584 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-18T21:57:29.584 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-18T21:57:29.584 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-18T21:57:29.585 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-18T21:57:29.585 INFO:teuthology.orchestra.run.smithi183.stdout: lua-5.4.4-4.el9.x86_64 2024-08-18T21:57:29.585 INFO:teuthology.orchestra.run.smithi183.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-18T21:57:29.585 INFO:teuthology.orchestra.run.smithi183.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-18T21:57:29.585 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-18T21:57:29.585 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-18T21:57:29.585 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-18T21:57:29.585 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-18T21:57:29.585 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-13.14-1.el9.x86_64 2024-08-18T21:57:29.585 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-08-18T21:57:29.585 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-08-18T21:57:29.585 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server-13.14-1.el9.x86_64 2024-08-18T21:57:29.585 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-18T21:57:29.586 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-18T21:57:29.586 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-18T21:57:29.586 INFO:teuthology.orchestra.run.smithi183.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-18T21:57:29.586 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-18T21:57:29.586 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-18T21:57:29.586 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-18T21:57:29.586 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.586 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.586 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.586 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-18T21:57:29.586 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-18T21:57:29.586 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-18T21:57:29.587 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-18T21:57:29.587 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-18T21:57:29.587 INFO:teuthology.orchestra.run.smithi183.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-18T21:57:29.587 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-18T21:57:29.587 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-18T21:57:29.587 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-18T21:57:29.587 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-18T21:57:29.587 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-18T21:57:29.587 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-18T21:57:29.587 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-18T21:57:29.587 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-18T21:57:29.587 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-18T21:57:29.587 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-18T21:57:29.587 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-18T21:57:29.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-18T21:57:29.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-18T21:57:29.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-18T21:57:29.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-18T21:57:29.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-18T21:57:29.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-18T21:57:29.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-18T21:57:29.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-18T21:57:29.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-18T21:57:29.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-18T21:57:29.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-18T21:57:29.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-18T21:57:29.588 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-18T21:57:29.589 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply-3.11-14.el9.noarch 2024-08-18T21:57:29.589 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-18T21:57:29.589 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-18T21:57:29.589 INFO:teuthology.orchestra.run.smithi183.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-18T21:57:29.589 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-18T21:57:29.589 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-18T21:57:29.589 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-18T21:57:29.589 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-18T21:57:29.590 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-18T21:57:29.590 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-18T21:57:29.590 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.590 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.590 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-18T21:57:29.590 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-18T21:57:29.590 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-18T21:57:29.590 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.590 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-18T21:57:29.591 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-18T21:57:29.591 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-18T21:57:29.591 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-18T21:57:29.591 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-18T21:57:29.591 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-18T21:57:29.591 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-18T21:57:29.591 INFO:teuthology.orchestra.run.smithi183.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-18T21:57:29.591 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-18T21:57:29.591 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-18T21:57:29.592 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-18T21:57:29.592 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-18T21:57:29.592 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-18T21:57:29.592 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-18T21:57:29.592 INFO:teuthology.orchestra.run.smithi183.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-18T21:57:29.592 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.592 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.592 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:29.592 INFO:teuthology.orchestra.run.smithi183.stdout: re2-1:20211101-3.el9.x86_64 2024-08-18T21:57:29.592 INFO:teuthology.orchestra.run.smithi183.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-18T21:57:29.592 INFO:teuthology.orchestra.run.smithi183.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-18T21:57:29.592 INFO:teuthology.orchestra.run.smithi183.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-18T21:57:29.592 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-18T21:57:29.593 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-18T21:57:29.593 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-18T21:57:29.593 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:57:29.593 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-08-18T21:57:29.864 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-18T21:57:29.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 1/152 2024-08-18T21:57:29.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2/152 2024-08-18T21:57:29.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 3/152 2024-08-18T21:57:29.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 4/152 2024-08-18T21:57:29.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 5/152 2024-08-18T21:57:29.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-18T21:57:29.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-18T21:57:29.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 8/152 2024-08-18T21:57:29.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 9/152 2024-08-18T21:57:29.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 10/152 2024-08-18T21:57:29.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 11/152 2024-08-18T21:57:29.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-18T21:57:29.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 13/152 2024-08-18T21:57:29.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 14/152 2024-08-18T21:57:29.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 15/152 2024-08-18T21:57:29.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 16/152 2024-08-18T21:57:29.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 17/152 2024-08-18T21:57:29.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 18/152 2024-08-18T21:57:29.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 19/152 2024-08-18T21:57:29.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 20/152 2024-08-18T21:57:29.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 21/152 2024-08-18T21:57:29.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 22/152 2024-08-18T21:57:29.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 23/152 2024-08-18T21:57:29.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 24/152 2024-08-18T21:57:29.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 25/152 2024-08-18T21:57:29.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 26/152 2024-08-18T21:57:29.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 27/152 2024-08-18T21:57:29.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 28/152 2024-08-18T21:57:29.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 29/152 2024-08-18T21:57:29.876 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 30/152 2024-08-18T21:57:29.876 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 31/152 2024-08-18T21:57:29.876 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 32/152 2024-08-18T21:57:29.876 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 33/152 2024-08-18T21:57:29.876 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 34/152 2024-08-18T21:57:29.877 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 35/152 2024-08-18T21:57:29.877 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 36/152 2024-08-18T21:57:29.877 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 37/152 2024-08-18T21:57:29.877 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 38/152 2024-08-18T21:57:29.877 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 39/152 2024-08-18T21:57:29.877 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-18T21:57:29.877 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-08-18T21:57:29.877 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-08-18T21:57:29.877 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-18T21:57:29.877 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-18T21:57:29.877 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-18T21:57:29.877 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-18T21:57:29.877 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-18T21:57:29.877 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-18T21:57:29.878 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-18T21:57:29.878 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-18T21:57:29.878 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-18T21:57:29.878 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-18T21:57:29.878 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-18T21:57:29.878 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-18T21:57:29.878 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-18T21:57:29.878 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-18T21:57:29.878 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-18T21:57:29.878 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-18T21:57:29.878 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-18T21:57:29.878 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-18T21:57:29.879 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-18T21:57:29.879 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-18T21:57:29.879 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-18T21:57:29.879 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-18T21:57:29.879 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-18T21:57:29.879 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-08-18T21:57:29.879 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-08-18T21:57:29.879 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-18T21:57:29.879 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-08-18T21:57:29.879 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-08-18T21:57:29.879 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-08-18T21:57:29.879 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-08-18T21:57:29.879 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-18T21:57:29.880 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-18T21:57:29.880 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-18T21:57:29.880 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-18T21:57:29.880 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 77/152 2024-08-18T21:57:29.880 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-18T21:57:29.880 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-18T21:57:29.880 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-18T21:57:29.880 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-18T21:57:29.880 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-18T21:57:29.880 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-18T21:57:29.880 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-18T21:57:29.880 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-18T21:57:29.880 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-18T21:57:29.880 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-18T21:57:29.881 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-18T21:57:29.881 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-18T21:57:29.881 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-18T21:57:29.881 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-18T21:57:29.881 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-18T21:57:29.881 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-18T21:57:29.881 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-18T21:57:29.881 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-18T21:57:29.881 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-18T21:57:29.881 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-18T21:57:29.881 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-18T21:57:29.881 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-18T21:57:29.881 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-18T21:57:29.881 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/152 2024-08-18T21:57:29.882 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-18T21:57:29.882 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-18T21:57:29.882 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-18T21:57:29.882 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-18T21:57:29.882 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-18T21:57:29.882 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-18T21:57:29.882 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-18T21:57:29.882 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-18T21:57:29.882 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-18T21:57:29.882 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-18T21:57:29.882 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-18T21:57:29.882 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-18T21:57:29.883 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-18T21:57:29.883 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-18T21:57:29.883 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-18T21:57:29.883 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-18T21:57:29.883 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-18T21:57:29.883 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-18T21:57:29.883 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-18T21:57:29.883 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-18T21:57:29.883 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-18T21:57:29.883 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-18T21:57:29.883 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-18T21:57:29.883 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-18T21:57:29.883 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-18T21:57:29.883 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-18T21:57:29.884 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-18T21:57:29.884 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-18T21:57:29.884 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-18T21:57:29.884 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-18T21:57:29.884 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-18T21:57:29.884 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-18T21:57:29.884 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-18T21:57:29.884 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-18T21:57:29.884 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-18T21:57:29.884 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-18T21:57:29.884 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-18T21:57:29.884 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-18T21:57:29.884 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-18T21:57:29.885 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-18T21:57:29.885 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-18T21:57:29.885 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-18T21:57:29.885 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-18T21:57:29.885 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-18T21:57:29.885 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-18T21:57:29.885 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-18T21:57:29.885 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-18T21:57:29.885 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 149/152 2024-08-18T21:57:29.885 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-18T21:57:29.885 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 151/152 2024-08-18T21:57:29.888 DEBUG:teuthology.parallel:result is None 2024-08-18T21:57:32.109 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-18T21:57:32.109 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:57:32.109 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2024-08-18T21:57:32.109 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.109 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.109 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-08-18T21:57:32.109 INFO:teuthology.orchestra.run.smithi123.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-18T21:57:32.109 INFO:teuthology.orchestra.run.smithi123.stdout: automake-1.16.2-8.el9.noarch 2024-08-18T21:57:32.110 INFO:teuthology.orchestra.run.smithi123.stdout: bison-3.7.4-5.el9.x86_64 2024-08-18T21:57:32.110 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-18T21:57:32.110 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.110 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.110 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.110 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.110 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:32.110 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.110 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.110 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.110 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:32.110 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:32.111 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:32.111 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:32.111 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:32.111 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.111 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.111 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:32.111 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.111 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.111 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.111 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:32.112 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:32.112 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.112 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.112 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T21:57:32.112 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-18T21:57:32.112 INFO:teuthology.orchestra.run.smithi123.stdout: flex-2.6.4-9.el9.x86_64 2024-08-18T21:57:32.112 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-18T21:57:32.112 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-18T21:57:32.112 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-18T21:57:32.113 INFO:teuthology.orchestra.run.smithi123.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-18T21:57:32.113 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-18T21:57:32.113 INFO:teuthology.orchestra.run.smithi123.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-18T21:57:32.113 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-18T21:57:32.113 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-18T21:57:32.113 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-18T21:57:32.113 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.113 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.113 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.113 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-18T21:57:32.114 INFO:teuthology.orchestra.run.smithi123.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-18T21:57:32.114 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-18T21:57:32.114 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-18T21:57:32.114 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-18T21:57:32.114 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.114 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.114 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-18T21:57:32.114 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.114 INFO:teuthology.orchestra.run.smithi123.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-18T21:57:32.114 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-18T21:57:32.114 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-18T21:57:32.114 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-18T21:57:32.115 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-18T21:57:32.115 INFO:teuthology.orchestra.run.smithi123.stdout: lua-5.4.4-4.el9.x86_64 2024-08-18T21:57:32.115 INFO:teuthology.orchestra.run.smithi123.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-18T21:57:32.115 INFO:teuthology.orchestra.run.smithi123.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-18T21:57:32.115 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-18T21:57:32.115 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-18T21:57:32.115 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-18T21:57:32.115 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-18T21:57:32.115 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-13.14-1.el9.x86_64 2024-08-18T21:57:32.115 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-08-18T21:57:32.115 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-08-18T21:57:32.115 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server-13.14-1.el9.x86_64 2024-08-18T21:57:32.115 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-18T21:57:32.116 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-18T21:57:32.116 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-18T21:57:32.116 INFO:teuthology.orchestra.run.smithi123.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-18T21:57:32.116 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-18T21:57:32.116 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-18T21:57:32.116 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-18T21:57:32.116 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.116 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.116 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.116 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-18T21:57:32.116 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-18T21:57:32.116 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-18T21:57:32.116 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-18T21:57:32.117 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-18T21:57:32.117 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-18T21:57:32.117 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-18T21:57:32.117 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-18T21:57:32.117 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-18T21:57:32.117 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-18T21:57:32.117 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-18T21:57:32.117 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-18T21:57:32.117 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-18T21:57:32.117 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-18T21:57:32.117 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-18T21:57:32.117 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-18T21:57:32.117 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-18T21:57:32.118 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-18T21:57:32.118 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-18T21:57:32.118 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-18T21:57:32.118 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-18T21:57:32.118 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-18T21:57:32.118 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-18T21:57:32.118 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-18T21:57:32.118 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-18T21:57:32.118 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-18T21:57:32.118 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-18T21:57:32.118 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-18T21:57:32.118 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-18T21:57:32.119 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-18T21:57:32.119 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply-3.11-14.el9.noarch 2024-08-18T21:57:32.119 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-18T21:57:32.119 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-18T21:57:32.119 INFO:teuthology.orchestra.run.smithi123.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-18T21:57:32.119 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-18T21:57:32.119 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-18T21:57:32.119 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-18T21:57:32.119 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-18T21:57:32.119 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-18T21:57:32.119 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-18T21:57:32.119 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.120 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.120 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-18T21:57:32.120 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-18T21:57:32.120 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-18T21:57:32.120 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.120 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-18T21:57:32.120 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-18T21:57:32.120 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-18T21:57:32.120 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-18T21:57:32.120 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-18T21:57:32.120 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-18T21:57:32.120 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-18T21:57:32.120 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-18T21:57:32.120 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-18T21:57:32.121 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-18T21:57:32.121 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-18T21:57:32.121 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-18T21:57:32.121 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-18T21:57:32.121 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-18T21:57:32.121 INFO:teuthology.orchestra.run.smithi123.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-18T21:57:32.121 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.121 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.121 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T21:57:32.121 INFO:teuthology.orchestra.run.smithi123.stdout: re2-1:20211101-3.el9.x86_64 2024-08-18T21:57:32.121 INFO:teuthology.orchestra.run.smithi123.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-18T21:57:32.121 INFO:teuthology.orchestra.run.smithi123.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-18T21:57:32.121 INFO:teuthology.orchestra.run.smithi123.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-18T21:57:32.121 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-18T21:57:32.121 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-18T21:57:32.122 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-18T21:57:32.122 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:57:32.122 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-08-18T21:57:32.409 DEBUG:teuthology.parallel:result is None 2024-08-18T21:57:32.409 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T21:57:32.553 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-18T21:57:32.575 INFO:teuthology.orchestra.run.smithi123.stdout:19.1.0-1382.gde09dd01.el9 2024-08-18T21:57:32.576 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1382.gde09dd01.el9 2024-08-18T21:57:32.576 INFO:teuthology.task.install:The correct ceph version 19.1.0-1382.gde09dd01 is installed. 2024-08-18T21:57:32.578 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T21:57:32.710 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-18T21:57:32.737 INFO:teuthology.orchestra.run.smithi130.stdout:19.1.0-1382.gde09dd01.el9 2024-08-18T21:57:32.737 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1382.gde09dd01.el9 2024-08-18T21:57:32.738 INFO:teuthology.task.install:The correct ceph version 19.1.0-1382.gde09dd01 is installed. 2024-08-18T21:57:32.740 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T21:57:32.872 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-18T21:57:32.896 INFO:teuthology.orchestra.run.smithi183.stdout:19.1.0-1382.gde09dd01.el9 2024-08-18T21:57:32.896 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1382.gde09dd01.el9 2024-08-18T21:57:32.896 INFO:teuthology.task.install:The correct ceph version 19.1.0-1382.gde09dd01 is installed. 2024-08-18T21:57:32.898 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-18T21:57:32.898 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T21:57:32.899 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-18T21:57:32.926 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-18T21:57:32.926 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-18T21:57:32.959 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-08-18T21:57:32.959 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-18T21:57:32.987 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-18T21:57:32.987 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T21:57:32.988 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2024-08-18T21:57:33.012 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-18T21:57:33.078 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-18T21:57:33.078 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2024-08-18T21:57:33.112 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-18T21:57:33.182 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-08-18T21:57:33.182 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2024-08-18T21:57:33.211 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-18T21:57:33.276 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-18T21:57:33.276 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T21:57:33.276 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-18T21:57:33.300 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-18T21:57:33.366 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-18T21:57:33.367 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-18T21:57:33.394 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-18T21:57:33.463 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-08-18T21:57:33.463 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-18T21:57:33.487 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-18T21:57:33.553 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-18T21:57:33.553 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T21:57:33.553 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2024-08-18T21:57:33.578 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-18T21:57:33.647 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-18T21:57:33.647 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2024-08-18T21:57:33.675 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-18T21:57:33.743 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-08-18T21:57:33.743 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2024-08-18T21:57:33.768 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-18T21:57:33.834 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-18T21:57:33.945 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-08-18T21:57:33.945 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T21:57:33.946 INFO:tasks.cephadm:Cluster fsid is dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:57:33.946 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-18T21:57:33.946 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.123', 'mon.b': '172.21.15.130', 'mon.c': '172.21.15.183'} 2024-08-18T21:57:33.946 INFO:tasks.cephadm:First mon is mon.a on smithi123 2024-08-18T21:57:33.946 INFO:tasks.cephadm:First mgr is x 2024-08-18T21:57:33.946 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-18T21:57:33.947 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname $(hostname -s) 2024-08-18T21:57:33.972 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname $(hostname -s) 2024-08-18T21:57:34.001 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname $(hostname -s) 2024-08-18T21:57:34.026 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-18T21:57:34.026 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T21:57:34.166 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/55869/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.0-1382-gde09dd01', 'node_name': '172.21.5.40+adami10', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.0-1382.gde09dd01'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-18 16:22:46.893995', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-08-18T21:57:34.307 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 de09dd018de4baddfa6ca4d43bc8fb784cf75833 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T21:57:34.309 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/x86_64/flavors/default/cephadm 2024-08-18T21:57:34.309 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/x86_64/flavors/default/cephadm 2024-08-18T21:57:34.309 DEBUG:teuthology.orchestra.run.smithi123:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-18T21:57:34.675 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r--. 1 ubuntu ubuntu 784608 Aug 18 21:57 /home/ubuntu/cephtest/cephadm 2024-08-18T21:57:34.675 DEBUG:teuthology.orchestra.run.smithi130:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-18T21:57:35.046 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r--. 1 ubuntu ubuntu 784608 Aug 18 21:57 /home/ubuntu/cephtest/cephadm 2024-08-18T21:57:35.047 DEBUG:teuthology.orchestra.run.smithi183:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-18T21:57:35.384 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r--. 1 ubuntu ubuntu 784608 Aug 18 21:57 /home/ubuntu/cephtest/cephadm 2024-08-18T21:57:35.384 DEBUG:teuthology.orchestra.run.smithi123:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-18T21:57:35.400 DEBUG:teuthology.orchestra.run.smithi130:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-18T21:57:35.420 DEBUG:teuthology.orchestra.run.smithi183:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-18T21:57:35.456 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 on all hosts... 2024-08-18T21:57:35.456 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 pull 2024-08-18T21:57:35.458 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 pull 2024-08-18T21:57:35.464 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 pull 2024-08-18T21:57:37.120 INFO:teuthology.orchestra.run.smithi183.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833... 2024-08-18T21:57:37.158 INFO:teuthology.orchestra.run.smithi130.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833... 2024-08-18T21:57:38.237 INFO:teuthology.orchestra.run.smithi123.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833... 2024-08-18T21:58:05.887 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-08-18T21:58:05.887 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_version": "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)", 2024-08-18T21:58:05.887 INFO:teuthology.orchestra.run.smithi183.stdout: "image_id": "ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba", 2024-08-18T21:58:05.887 INFO:teuthology.orchestra.run.smithi183.stdout: "repo_digests": [ 2024-08-18T21:58:05.887 INFO:teuthology.orchestra.run.smithi183.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9" 2024-08-18T21:58:05.888 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-08-18T21:58:05.888 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-08-18T21:58:06.246 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-08-18T21:58:06.246 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_version": "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)", 2024-08-18T21:58:06.246 INFO:teuthology.orchestra.run.smithi130.stdout: "image_id": "ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba", 2024-08-18T21:58:06.246 INFO:teuthology.orchestra.run.smithi130.stdout: "repo_digests": [ 2024-08-18T21:58:06.246 INFO:teuthology.orchestra.run.smithi130.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9" 2024-08-18T21:58:06.246 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-08-18T21:58:06.247 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-08-18T21:58:06.470 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T21:58:06.470 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)", 2024-08-18T21:58:06.470 INFO:teuthology.orchestra.run.smithi123.stdout: "image_id": "ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba", 2024-08-18T21:58:06.470 INFO:teuthology.orchestra.run.smithi123.stdout: "repo_digests": [ 2024-08-18T21:58:06.470 INFO:teuthology.orchestra.run.smithi123.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9" 2024-08-18T21:58:06.470 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-08-18T21:58:06.470 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T21:58:06.495 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph 2024-08-18T21:58:06.547 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph 2024-08-18T21:58:06.574 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph 2024-08-18T21:58:06.608 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /etc/ceph 2024-08-18T21:58:06.632 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /etc/ceph 2024-08-18T21:58:06.656 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /etc/ceph 2024-08-18T21:58:06.686 INFO:tasks.cephadm:Writing seed config... 2024-08-18T21:58:06.687 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-08-18T21:58:06.687 INFO:tasks.cephadm: override: [client] debug client = 20 2024-08-18T21:58:06.687 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-08-18T21:58:06.687 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-08-18T21:58:06.687 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-08-18T21:58:06.687 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-08-18T21:58:06.688 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-08-18T21:58:06.688 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-08-18T21:58:06.688 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-08-18T21:58:06.688 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-08-18T21:58:06.688 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-08-18T21:58:06.688 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-08-18T21:58:06.688 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-08-18T21:58:06.688 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-08-18T21:58:06.688 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-08-18T21:58:06.688 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-08-18T21:58:06.688 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-08-18T21:58:06.688 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-08-18T21:58:06.688 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-08-18T21:58:06.688 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-08-18T21:58:06.689 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-18T21:58:06.690 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-18T21:58:06.690 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-08-18T21:58:06.690 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-18T21:58:06.690 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-18T21:58:06.690 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-18T21:58:06.690 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-18T21:58:06.690 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-18T21:58:06.690 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-08-18T21:58:06.690 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-08-18T21:58:06.690 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-08-18T21:58:06.691 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T21:58:06.691 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-18T21:58:06.706 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = dfa1db70-5dac-11ef-bccf-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-08-18T21:58:06.707 DEBUG:teuthology.orchestra.run.smithi123:mon.a> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mon.a.service 2024-08-18T21:58:06.749 DEBUG:teuthology.orchestra.run.smithi123:mgr.x> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mgr.x.service 2024-08-18T21:58:06.792 INFO:tasks.cephadm:Bootstrapping... 2024-08-18T21:58:06.792 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 -v bootstrap --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.123 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-18T21:58:06.994 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-08-18T21:58:06.994 INFO:teuthology.orchestra.run.smithi123.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833', '-v', 'bootstrap', '--fsid', 'dfa1db70-5dac-11ef-bccf-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.123', '--skip-admin-label'] 2024-08-18T21:58:06.994 INFO:teuthology.orchestra.run.smithi123.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-18T21:58:06.995 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying podman|docker is present... 2024-08-18T21:58:07.020 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stdout 5.1.2 2024-08-18T21:58:07.020 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying lvm2 is present... 2024-08-18T21:58:07.020 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying time synchronization is in place... 2024-08-18T21:58:07.028 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-18T21:58:07.028 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-18T21:58:07.034 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-18T21:58:07.034 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-08-18T21:58:07.040 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout enabled 2024-08-18T21:58:07.047 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout active 2024-08-18T21:58:07.047 INFO:teuthology.orchestra.run.smithi123.stdout:Unit chronyd.service is enabled and running 2024-08-18T21:58:07.047 INFO:teuthology.orchestra.run.smithi123.stdout:Repeating the final host check... 2024-08-18T21:58:07.070 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stdout 5.1.2 2024-08-18T21:58:07.070 INFO:teuthology.orchestra.run.smithi123.stdout:podman (/bin/podman) version 5.1.2 is present 2024-08-18T21:58:07.071 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl is present 2024-08-18T21:58:07.071 INFO:teuthology.orchestra.run.smithi123.stdout:lvcreate is present 2024-08-18T21:58:07.077 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-18T21:58:07.077 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-18T21:58:07.083 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-18T21:58:07.083 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-08-18T21:58:07.090 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout enabled 2024-08-18T21:58:07.096 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout active 2024-08-18T21:58:07.097 INFO:teuthology.orchestra.run.smithi123.stdout:Unit chronyd.service is enabled and running 2024-08-18T21:58:07.097 INFO:teuthology.orchestra.run.smithi123.stdout:Host looks OK 2024-08-18T21:58:07.097 INFO:teuthology.orchestra.run.smithi123.stdout:Cluster fsid: dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:58:07.097 INFO:teuthology.orchestra.run.smithi123.stdout:Acquiring lock 140490876865024 on /run/cephadm/dfa1db70-5dac-11ef-bccf-c7b262605968.lock 2024-08-18T21:58:07.097 INFO:teuthology.orchestra.run.smithi123.stdout:Lock 140490876865024 acquired on /run/cephadm/dfa1db70-5dac-11ef-bccf-c7b262605968.lock 2024-08-18T21:58:07.097 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying IP 172.21.15.123 port 3300 ... 2024-08-18T21:58:07.097 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying IP 172.21.15.123 port 6789 ... 2024-08-18T21:58:07.098 INFO:teuthology.orchestra.run.smithi123.stdout:Base mon IP(s) is [172.21.15.123:3300, 172.21.15.123:6789], mon addrv is [v2:172.21.15.123:3300,v1:172.21.15.123:6789] 2024-08-18T21:58:07.100 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.123 metric 100 2024-08-18T21:58:07.100 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.123 metric 100 2024-08-18T21:58:07.103 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-18T21:58:07.103 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-08-18T21:58:07.103 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-08-18T21:58:07.105 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-18T21:58:07.105 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-18T21:58:07.106 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-18T21:58:07.106 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-08-18T21:58:07.106 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-08-18T21:58:07.106 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-18T21:58:07.106 INFO:teuthology.orchestra.run.smithi123.stdout:Mon IP `172.21.15.123` is in CIDR network `172.21.0.0/20` 2024-08-18T21:58:07.106 INFO:teuthology.orchestra.run.smithi123.stdout:Mon IP `172.21.15.123` is in CIDR network `172.21.0.0/20` 2024-08-18T21:58:07.106 INFO:teuthology.orchestra.run.smithi123.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-18T21:58:07.107 INFO:teuthology.orchestra.run.smithi123.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-18T21:58:07.108 INFO:teuthology.orchestra.run.smithi123.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833... 2024-08-18T21:58:07.590 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stdout ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba 2024-08-18T21:58:07.591 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833... 2024-08-18T21:58:07.591 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Getting image source signatures 2024-08-18T21:58:07.591 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Copying blob sha256:7556061847b3cc957dc118ff2516cc1cd809c4272dcb16074c5c7fe28afc4774 2024-08-18T21:58:07.591 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-18T21:58:07.591 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Copying config sha256:ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba 2024-08-18T21:58:07.591 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-18T21:58:08.552 INFO:teuthology.orchestra.run.smithi123.stdout:ceph: stdout ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-18T21:58:08.552 INFO:teuthology.orchestra.run.smithi123.stdout:Ceph version: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-18T21:58:08.552 INFO:teuthology.orchestra.run.smithi123.stdout:Extracting ceph user uid/gid from container image... 2024-08-18T21:58:09.716 INFO:teuthology.orchestra.run.smithi123.stdout:stat: stdout 167 167 2024-08-18T21:58:09.716 INFO:teuthology.orchestra.run.smithi123.stdout:Creating initial keys... 2024-08-18T21:58:10.713 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph-authtool: stdout AQBybsJmATP1BRAAeY8o1acDyjF1kREuhFwO7Q== 2024-08-18T21:58:11.560 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph-authtool: stdout AQBzbsJmOLkxARAAUXZdK+y0nj63wUyX/O9IqQ== 2024-08-18T21:58:12.465 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph-authtool: stdout AQBzbsJm9m+vMxAAhXAWKIYiUAgXRlcmkdmTJQ== 2024-08-18T21:58:12.466 INFO:teuthology.orchestra.run.smithi123.stdout:Creating initial monmap... 2024-08-18T21:58:13.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-18T21:58:13.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-18T21:58:13.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:58:13.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-18T21:58:13.355 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool for a [v2:172.21.15.123:3300,v1:172.21.15.123:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-18T21:58:13.355 INFO:teuthology.orchestra.run.smithi123.stdout:setting min_mon_release = quincy 2024-08-18T21:58:13.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: set fsid to dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:58:13.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-18T21:58:13.356 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:58:13.356 INFO:teuthology.orchestra.run.smithi123.stdout:Creating mon... 2024-08-18T21:58:21.379 INFO:teuthology.orchestra.run.smithi123.stdout:create mon.a on 2024-08-18T21:58:21.852 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-18T21:58:22.259 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-18T21:58:22.434 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-dfa1db70-5dac-11ef-bccf-c7b262605968.target → /etc/systemd/system/ceph-dfa1db70-5dac-11ef-bccf-c7b262605968.target. 2024-08-18T21:58:22.434 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-dfa1db70-5dac-11ef-bccf-c7b262605968.target → /etc/systemd/system/ceph-dfa1db70-5dac-11ef-bccf-c7b262605968.target. 2024-08-18T21:58:22.667 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mon.a 2024-08-18T21:58:22.667 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to reset failed state of unit ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mon.a.service: Unit ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mon.a.service not loaded. 2024-08-18T21:58:22.826 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-dfa1db70-5dac-11ef-bccf-c7b262605968.target.wants/ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mon.a.service → /etc/systemd/system/ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@.service. 2024-08-18T21:58:23.338 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:23 smithi123 ceph-mon[18081]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-18T21:58:23.338 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:23 smithi123 bash[18063]: a3ffe1787bcac5dd185fbf31f74a431de35baff0966d4bee16a0a9a9100cd39b 2024-08-18T21:58:23.350 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-18T21:58:23.350 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-08-18T21:58:23.357 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-18T21:58:23.357 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-08-18T21:58:23.358 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-08-18T21:58:23.358 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to enable service . firewalld.service is not available 2024-08-18T21:58:23.358 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mon to start... 2024-08-18T21:58:23.358 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mon... 2024-08-18T21:58:23.600 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:23 smithi123 systemd[1]: Started Ceph mon.a for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T21:58:24.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:24 smithi123 ceph-mon[18081]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-18T21:58:24.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:24 smithi123 ceph-mon[18081]: monmap epoch 1 2024-08-18T21:58:24.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:24 smithi123 ceph-mon[18081]: fsid dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:58:24.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:24 smithi123 ceph-mon[18081]: last_changed 2024-08-18T21:58:12.803696+0000 2024-08-18T21:58:24.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:24 smithi123 ceph-mon[18081]: created 2024-08-18T21:58:12.803696+0000 2024-08-18T21:58:24.423 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:24 smithi123 ceph-mon[18081]: min_mon_release 19 (squid) 2024-08-18T21:58:24.423 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:24 smithi123 ceph-mon[18081]: election_strategy: 1 2024-08-18T21:58:24.423 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:24 smithi123 ceph-mon[18081]: 0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2024-08-18T21:58:24.423 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:24 smithi123 ceph-mon[18081]: fsmap 2024-08-18T21:58:24.423 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:24 smithi123 ceph-mon[18081]: osdmap e1: 0 total, 0 up, 0 in 2024-08-18T21:58:24.423 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:24 smithi123 ceph-mon[18081]: mgrmap e1: no daemons active 2024-08-18T21:58:24.423 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:24 smithi123 ceph-mon[18081]: from='client.? 172.21.15.123:0/100957377' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-08-18T21:58:24.429 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout cluster: 2024-08-18T21:58:24.429 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout id: dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:58:24.429 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-18T21:58:24.429 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-08-18T21:58:24.429 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout services: 2024-08-18T21:58:24.429 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.566327s) 2024-08-18T21:58:24.429 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-18T21:58:24.430 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-18T21:58:24.430 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-08-18T21:58:24.430 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout data: 2024-08-18T21:58:24.430 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-18T21:58:24.430 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-18T21:58:24.430 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-18T21:58:24.430 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout pgs: 2024-08-18T21:58:24.430 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-08-18T21:58:24.430 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.798+0000 7f92459a4640 1 Processor -- start 2024-08-18T21:58:24.430 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.799+0000 7f92459a4640 1 -- start start 2024-08-18T21:58:24.430 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.799+0000 7f92459a4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92401072e0 0x7f92401076e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:24.430 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.799+0000 7f92459a4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9240107c20 con 0x7f92401072e0 2024-08-18T21:58:24.431 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.799+0000 7f923effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92401072e0 0x7f92401076e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:24.431 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.799+0000 7f923effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92401072e0 0x7f92401076e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57732/0 (socket says 172.21.15.123:57732) 2024-08-18T21:58:24.431 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.799+0000 7f923effd640 1 -- 172.21.15.123:0/223985006 learned_addr learned my addr 172.21.15.123:0/223985006 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:24.431 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.800+0000 7f923effd640 1 -- 172.21.15.123:0/223985006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9240107da0 con 0x7f92401072e0 2024-08-18T21:58:24.431 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.801+0000 7f923effd640 1 --2- 172.21.15.123:0/223985006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92401072e0 0x7f92401076e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9230009820 tx=0x7f923002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d884d38e0eaa3fa1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:24.431 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.802+0000 7f923e7fc640 1 -- 172.21.15.123:0/223985006 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9230037070 con 0x7f92401072e0 2024-08-18T21:58:24.431 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.802+0000 7f923e7fc640 1 -- 172.21.15.123:0/223985006 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9230032440 con 0x7f92401072e0 2024-08-18T21:58:24.431 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.802+0000 7f923e7fc640 1 -- 172.21.15.123:0/223985006 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9230032740 con 0x7f92401072e0 2024-08-18T21:58:24.431 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.802+0000 7f92459a4640 1 -- 172.21.15.123:0/223985006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92401072e0 msgr2=0x7f92401076e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:24.431 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.802+0000 7f92459a4640 1 --2- 172.21.15.123:0/223985006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92401072e0 0x7f92401076e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9230009820 tx=0x7f923002a270 comp rx=0 tx=0).stop 2024-08-18T21:58:24.431 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.802+0000 7f92459a4640 1 -- 172.21.15.123:0/223985006 shutdown_connections 2024-08-18T21:58:24.431 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.802+0000 7f92459a4640 1 --2- 172.21.15.123:0/223985006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92401072e0 0x7f92401076e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:24.431 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.802+0000 7f92459a4640 1 -- 172.21.15.123:0/223985006 >> 172.21.15.123:0/223985006 conn(0x7f9240102b30 msgr2=0x7f9240104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:24.432 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.802+0000 7f92459a4640 1 -- 172.21.15.123:0/223985006 shutdown_connections 2024-08-18T21:58:24.432 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.802+0000 7f92459a4640 1 -- 172.21.15.123:0/223985006 wait complete. 2024-08-18T21:58:24.432 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.803+0000 7f92459a4640 1 Processor -- start 2024-08-18T21:58:24.432 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.803+0000 7f92459a4640 1 -- start start 2024-08-18T21:58:24.432 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.803+0000 7f92459a4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92401072e0 0x7f924019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:24.432 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.803+0000 7f92459a4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9240108800 con 0x7f92401072e0 2024-08-18T21:58:24.432 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.803+0000 7f923effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92401072e0 0x7f924019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:24.432 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.803+0000 7f923effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92401072e0 0x7f924019aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57748/0 (socket says 172.21.15.123:57748) 2024-08-18T21:58:24.432 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.803+0000 7f923effd640 1 -- 172.21.15.123:0/100957377 learned_addr learned my addr 172.21.15.123:0/100957377 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:24.432 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.803+0000 7f923effd640 1 -- 172.21.15.123:0/100957377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924019af90 con 0x7f92401072e0 2024-08-18T21:58:24.432 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.804+0000 7f923effd640 1 --2- 172.21.15.123:0/100957377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92401072e0 0x7f924019aa50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f92300090b0 tx=0x7f92300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:24.432 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.804+0000 7f92449a2640 1 -- 172.21.15.123:0/100957377 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9230041070 con 0x7f92401072e0 2024-08-18T21:58:24.432 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.804+0000 7f92449a2640 1 -- 172.21.15.123:0/100957377 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923003c7a0 con 0x7f92401072e0 2024-08-18T21:58:24.432 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.804+0000 7f92449a2640 1 -- 172.21.15.123:0/100957377 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9230037040 con 0x7f92401072e0 2024-08-18T21:58:24.433 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.804+0000 7f92459a4640 1 -- 172.21.15.123:0/100957377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f924019b220 con 0x7f92401072e0 2024-08-18T21:58:24.433 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.804+0000 7f92459a4640 1 -- 172.21.15.123:0/100957377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f924019df10 con 0x7f92401072e0 2024-08-18T21:58:24.433 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.804+0000 7f92449a2640 1 -- 172.21.15.123:0/100957377 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9230044070 con 0x7f92401072e0 2024-08-18T21:58:24.433 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.804+0000 7f92449a2640 1 -- 172.21.15.123:0/100957377 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f923003d3f0 con 0x7f92401072e0 2024-08-18T21:58:24.433 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.805+0000 7f92459a4640 1 -- 172.21.15.123:0/100957377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9240107760 con 0x7f92401072e0 2024-08-18T21:58:24.433 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.807+0000 7f92449a2640 1 -- 172.21.15.123:0/100957377 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f9230046450 con 0x7f92401072e0 2024-08-18T21:58:24.433 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.865+0000 7f92459a4640 1 -- 172.21.15.123:0/100957377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f924002d720 con 0x7f92401072e0 2024-08-18T21:58:24.433 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.866+0000 7f92449a2640 1 -- 172.21.15.123:0/100957377 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f9230046630 con 0x7f92401072e0 2024-08-18T21:58:24.433 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.866+0000 7f92459a4640 1 -- 172.21.15.123:0/100957377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92401072e0 msgr2=0x7f924019aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:24.433 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.866+0000 7f92459a4640 1 --2- 172.21.15.123:0/100957377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92401072e0 0x7f924019aa50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f92300090b0 tx=0x7f92300046c0 comp rx=0 tx=0).stop 2024-08-18T21:58:24.434 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.867+0000 7f92459a4640 1 -- 172.21.15.123:0/100957377 shutdown_connections 2024-08-18T21:58:24.434 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.867+0000 7f92459a4640 1 --2- 172.21.15.123:0/100957377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92401072e0 0x7f924019aa50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:24.434 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.867+0000 7f92459a4640 1 -- 172.21.15.123:0/100957377 >> 172.21.15.123:0/100957377 conn(0x7f9240102b30 msgr2=0x7f9240191670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:24.434 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.867+0000 7f92459a4640 1 -- 172.21.15.123:0/100957377 shutdown_connections 2024-08-18T21:58:24.434 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:23.867+0000 7f92459a4640 1 -- 172.21.15.123:0/100957377 wait complete. 2024-08-18T21:58:24.434 INFO:teuthology.orchestra.run.smithi123.stdout:mon is available 2024-08-18T21:58:24.434 INFO:teuthology.orchestra.run.smithi123.stdout:Assimilating anything we can from ceph.conf... 2024-08-18T21:58:25.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-08-18T21:58:25.396 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [global] 2024-08-18T21:58:25.396 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout fsid = dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:58:25.396 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.123:3300,v1:172.21.15.123:6789] 2024-08-18T21:58:25.396 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-18T21:58:25.396 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-18T21:58:25.396 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-18T21:58:25.396 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-18T21:58:25.396 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-08-18T21:58:25.396 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-18T21:58:25.396 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-18T21:58:25.396 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-08-18T21:58:25.396 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [osd] 2024-08-18T21:58:25.397 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-18T21:58:25.397 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-18T21:58:25.397 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-18T21:58:25.397 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-18T21:58:25.397 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-18T21:58:25.397 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.815+0000 7f5bc6a64640 1 Processor -- start 2024-08-18T21:58:25.397 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.815+0000 7f5bc6a64640 1 -- start start 2024-08-18T21:58:25.397 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.816+0000 7f5bc6a64640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bc01072e0 0x7f5bc01076e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:25.397 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.816+0000 7f5bc6a64640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc0107c20 con 0x7f5bc01072e0 2024-08-18T21:58:25.397 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.816+0000 7f5bc4800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bc01072e0 0x7f5bc01076e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:25.397 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.816+0000 7f5bc4800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bc01072e0 0x7f5bc01076e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57762/0 (socket says 172.21.15.123:57762) 2024-08-18T21:58:25.397 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.816+0000 7f5bc4800640 1 -- 172.21.15.123:0/3002257576 learned_addr learned my addr 172.21.15.123:0/3002257576 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:25.397 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.816+0000 7f5bc4800640 1 -- 172.21.15.123:0/3002257576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc0107da0 con 0x7f5bc01072e0 2024-08-18T21:58:25.397 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.817+0000 7f5bc4800640 1 --2- 172.21.15.123:0/3002257576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bc01072e0 0x7f5bc01076e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8009e80 tx=0x7f5bb802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc5146e606edec4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:25.398 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.817+0000 7f5bbf7fe640 1 -- 172.21.15.123:0/3002257576 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bb8036070 con 0x7f5bc01072e0 2024-08-18T21:58:25.398 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.817+0000 7f5bbf7fe640 1 -- 172.21.15.123:0/3002257576 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb8031400 con 0x7f5bc01072e0 2024-08-18T21:58:25.398 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.817+0000 7f5bbf7fe640 1 -- 172.21.15.123:0/3002257576 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bb8031700 con 0x7f5bc01072e0 2024-08-18T21:58:25.398 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.818+0000 7f5bc6a64640 1 -- 172.21.15.123:0/3002257576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bc01072e0 msgr2=0x7f5bc01076e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:25.398 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.818+0000 7f5bc6a64640 1 --2- 172.21.15.123:0/3002257576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bc01072e0 0x7f5bc01076e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8009e80 tx=0x7f5bb802a7a0 comp rx=0 tx=0).stop 2024-08-18T21:58:25.398 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.818+0000 7f5bc6a64640 1 -- 172.21.15.123:0/3002257576 shutdown_connections 2024-08-18T21:58:25.398 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.818+0000 7f5bc6a64640 1 --2- 172.21.15.123:0/3002257576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bc01072e0 0x7f5bc01076e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:25.398 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.818+0000 7f5bc6a64640 1 -- 172.21.15.123:0/3002257576 >> 172.21.15.123:0/3002257576 conn(0x7f5bc0102b30 msgr2=0x7f5bc0104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:25.398 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.818+0000 7f5bc6a64640 1 -- 172.21.15.123:0/3002257576 shutdown_connections 2024-08-18T21:58:25.398 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.818+0000 7f5bc6a64640 1 -- 172.21.15.123:0/3002257576 wait complete. 2024-08-18T21:58:25.398 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.818+0000 7f5bc6a64640 1 Processor -- start 2024-08-18T21:58:25.398 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.818+0000 7f5bc6a64640 1 -- start start 2024-08-18T21:58:25.398 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.818+0000 7f5bc6a64640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bc01072e0 0x7f5bc019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:25.399 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.818+0000 7f5bc6a64640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc0108800 con 0x7f5bc01072e0 2024-08-18T21:58:25.399 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.819+0000 7f5bc4800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bc01072e0 0x7f5bc019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:25.399 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.819+0000 7f5bc4800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bc01072e0 0x7f5bc019aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57776/0 (socket says 172.21.15.123:57776) 2024-08-18T21:58:25.399 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.819+0000 7f5bc4800640 1 -- 172.21.15.123:0/3777731879 learned_addr learned my addr 172.21.15.123:0/3777731879 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:25.399 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.819+0000 7f5bc4800640 1 -- 172.21.15.123:0/3777731879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc019af80 con 0x7f5bc01072e0 2024-08-18T21:58:25.399 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.819+0000 7f5bc4800640 1 --2- 172.21.15.123:0/3777731879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bc01072e0 0x7f5bc019aa40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8034040 tx=0x7f5bb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:25.399 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.819+0000 7f5bbdffb640 1 -- 172.21.15.123:0/3777731879 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bb8041070 con 0x7f5bc01072e0 2024-08-18T21:58:25.399 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.819+0000 7f5bbdffb640 1 -- 172.21.15.123:0/3777731879 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb803c650 con 0x7f5bc01072e0 2024-08-18T21:58:25.399 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.819+0000 7f5bbdffb640 1 -- 172.21.15.123:0/3777731879 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bb8036040 con 0x7f5bc01072e0 2024-08-18T21:58:25.399 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.819+0000 7f5bc6a64640 1 -- 172.21.15.123:0/3777731879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc019b210 con 0x7f5bc01072e0 2024-08-18T21:58:25.399 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.819+0000 7f5bc6a64640 1 -- 172.21.15.123:0/3777731879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc019df00 con 0x7f5bc01072e0 2024-08-18T21:58:25.399 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.820+0000 7f5bbdffb640 1 -- 172.21.15.123:0/3777731879 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5bb8044070 con 0x7f5bc01072e0 2024-08-18T21:58:25.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.820+0000 7f5bbdffb640 1 -- 172.21.15.123:0/3777731879 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5bb8046c60 con 0x7f5bc01072e0 2024-08-18T21:58:25.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.820+0000 7f5bc6a64640 1 -- 172.21.15.123:0/3777731879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bc0107760 con 0x7f5bc01072e0 2024-08-18T21:58:25.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.822+0000 7f5bbdffb640 1 -- 172.21.15.123:0/3777731879 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f5bb803c9a0 con 0x7f5bc01072e0 2024-08-18T21:58:25.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.881+0000 7f5bc6a64640 1 -- 172.21.15.123:0/3777731879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f5bc002d730 con 0x7f5bc01072e0 2024-08-18T21:58:25.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.884+0000 7f5bbdffb640 1 -- 172.21.15.123:0/3777731879 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+431 (secure 0 0 0) 0x7f5bb803cb80 con 0x7f5bc01072e0 2024-08-18T21:58:25.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.885+0000 7f5bbdffb640 1 -- 172.21.15.123:0/3777731879 <== mon.0 v2:172.21.15.123:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5bb8056070 con 0x7f5bc01072e0 2024-08-18T21:58:25.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.885+0000 7f5bc6a64640 1 -- 172.21.15.123:0/3777731879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bc01072e0 msgr2=0x7f5bc019aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:25.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.885+0000 7f5bc6a64640 1 --2- 172.21.15.123:0/3777731879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bc01072e0 0x7f5bc019aa40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8034040 tx=0x7f5bb8004a40 comp rx=0 tx=0).stop 2024-08-18T21:58:25.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.885+0000 7f5bc6a64640 1 -- 172.21.15.123:0/3777731879 shutdown_connections 2024-08-18T21:58:25.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.885+0000 7f5bc6a64640 1 --2- 172.21.15.123:0/3777731879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bc01072e0 0x7f5bc019aa40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:25.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.885+0000 7f5bc6a64640 1 -- 172.21.15.123:0/3777731879 >> 172.21.15.123:0/3777731879 conn(0x7f5bc0102b30 msgr2=0x7f5bc018ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:25.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.885+0000 7f5bc6a64640 1 -- 172.21.15.123:0/3777731879 shutdown_connections 2024-08-18T21:58:25.400 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:24.885+0000 7f5bc6a64640 1 -- 172.21.15.123:0/3777731879 wait complete. 2024-08-18T21:58:25.401 INFO:teuthology.orchestra.run.smithi123.stdout:Generating new minimal ceph.conf... 2024-08-18T21:58:25.502 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:25 smithi123 ceph-mon[18081]: from='client.? 172.21.15.123:0/3777731879' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-18T21:58:25.502 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:25 smithi123 ceph-mon[18081]: from='client.? 172.21.15.123:0/3777731879' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-18T21:58:26.491 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:26 smithi123 ceph-mon[18081]: from='client.? 172.21.15.123:0/2785334611' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:58:26.498 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.808+0000 7efe607bb640 1 Processor -- start 2024-08-18T21:58:26.498 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.808+0000 7efe607bb640 1 -- start start 2024-08-18T21:58:26.498 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.808+0000 7efe607bb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe581072e0 0x7efe581076e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:26.498 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.808+0000 7efe607bb640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efe58107cb0 con 0x7efe581072e0 2024-08-18T21:58:26.498 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.809+0000 7efe5e557640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe581072e0 0x7efe581076e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:26.499 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.809+0000 7efe5e557640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe581072e0 0x7efe581076e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57788/0 (socket says 172.21.15.123:57788) 2024-08-18T21:58:26.499 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.809+0000 7efe5e557640 1 -- 172.21.15.123:0/1655849697 learned_addr learned my addr 172.21.15.123:0/1655849697 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:26.499 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.809+0000 7efe5e557640 1 -- 172.21.15.123:0/1655849697 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe58108490 con 0x7efe581072e0 2024-08-18T21:58:26.499 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.809+0000 7efe5e557640 1 --2- 172.21.15.123:0/1655849697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe581072e0 0x7efe581076e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efe54009820 tx=0x7efe5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42ff0e2de2334c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:26.499 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.810+0000 7efe5d555640 1 -- 172.21.15.123:0/1655849697 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe54037070 con 0x7efe581072e0 2024-08-18T21:58:26.499 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.810+0000 7efe5d555640 1 -- 172.21.15.123:0/1655849697 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe54032900 con 0x7efe581072e0 2024-08-18T21:58:26.499 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.810+0000 7efe5d555640 1 -- 172.21.15.123:0/1655849697 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe54030850 con 0x7efe581072e0 2024-08-18T21:58:26.499 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.810+0000 7efe607bb640 1 -- 172.21.15.123:0/1655849697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe581072e0 msgr2=0x7efe581076e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:26.499 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.810+0000 7efe607bb640 1 --2- 172.21.15.123:0/1655849697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe581072e0 0x7efe581076e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efe54009820 tx=0x7efe5402a270 comp rx=0 tx=0).stop 2024-08-18T21:58:26.499 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.810+0000 7efe607bb640 1 -- 172.21.15.123:0/1655849697 shutdown_connections 2024-08-18T21:58:26.499 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.810+0000 7efe607bb640 1 --2- 172.21.15.123:0/1655849697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe581072e0 0x7efe581076e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:26.499 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.810+0000 7efe607bb640 1 -- 172.21.15.123:0/1655849697 >> 172.21.15.123:0/1655849697 conn(0x7efe58102ab0 msgr2=0x7efe58104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:26.500 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.810+0000 7efe607bb640 1 -- 172.21.15.123:0/1655849697 shutdown_connections 2024-08-18T21:58:26.500 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.810+0000 7efe607bb640 1 -- 172.21.15.123:0/1655849697 wait complete. 2024-08-18T21:58:26.500 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.811+0000 7efe607bb640 1 Processor -- start 2024-08-18T21:58:26.500 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.811+0000 7efe607bb640 1 -- start start 2024-08-18T21:58:26.500 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.811+0000 7efe607bb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe581072e0 0x7efe5807ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:26.500 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.811+0000 7efe607bb640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efe5810b840 con 0x7efe581072e0 2024-08-18T21:58:26.500 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.811+0000 7efe5e557640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe581072e0 0x7efe5807ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:26.500 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.811+0000 7efe5e557640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe581072e0 0x7efe5807ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57796/0 (socket says 172.21.15.123:57796) 2024-08-18T21:58:26.500 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.811+0000 7efe5e557640 1 -- 172.21.15.123:0/2785334611 learned_addr learned my addr 172.21.15.123:0/2785334611 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:26.500 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.812+0000 7efe5e557640 1 -- 172.21.15.123:0/2785334611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5807cf40 con 0x7efe581072e0 2024-08-18T21:58:26.500 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.812+0000 7efe5e557640 1 --2- 172.21.15.123:0/2785334611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe581072e0 0x7efe5807ca00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efe540097f0 tx=0x7efe54030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:26.500 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.812+0000 7efe4b7fe640 1 -- 172.21.15.123:0/2785334611 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe54037040 con 0x7efe581072e0 2024-08-18T21:58:26.500 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.812+0000 7efe4b7fe640 1 -- 172.21.15.123:0/2785334611 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe54040070 con 0x7efe581072e0 2024-08-18T21:58:26.500 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.812+0000 7efe607bb640 1 -- 172.21.15.123:0/2785334611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe5807b130 con 0x7efe581072e0 2024-08-18T21:58:26.501 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.812+0000 7efe4b7fe640 1 -- 172.21.15.123:0/2785334611 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe5403a390 con 0x7efe581072e0 2024-08-18T21:58:26.501 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.812+0000 7efe607bb640 1 -- 172.21.15.123:0/2785334611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe5807b610 con 0x7efe581072e0 2024-08-18T21:58:26.501 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.812+0000 7efe4b7fe640 1 -- 172.21.15.123:0/2785334611 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efe5403a650 con 0x7efe581072e0 2024-08-18T21:58:26.501 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.812+0000 7efe4b7fe640 1 -- 172.21.15.123:0/2785334611 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efe540459b0 con 0x7efe581072e0 2024-08-18T21:58:26.501 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.813+0000 7efe607bb640 1 -- 172.21.15.123:0/2785334611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe58107760 con 0x7efe581072e0 2024-08-18T21:58:26.501 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.815+0000 7efe4b7fe640 1 -- 172.21.15.123:0/2785334611 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7efe54045460 con 0x7efe581072e0 2024-08-18T21:58:26.501 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.874+0000 7efe607bb640 1 -- 172.21.15.123:0/2785334611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7efe5807bb40 con 0x7efe581072e0 2024-08-18T21:58:26.501 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.874+0000 7efe4b7fe640 1 -- 172.21.15.123:0/2785334611 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7efe5403b430 con 0x7efe581072e0 2024-08-18T21:58:26.501 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.875+0000 7efe607bb640 1 -- 172.21.15.123:0/2785334611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe581072e0 msgr2=0x7efe5807ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:26.501 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.875+0000 7efe607bb640 1 --2- 172.21.15.123:0/2785334611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe581072e0 0x7efe5807ca00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efe540097f0 tx=0x7efe54030d80 comp rx=0 tx=0).stop 2024-08-18T21:58:26.501 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.875+0000 7efe607bb640 1 -- 172.21.15.123:0/2785334611 shutdown_connections 2024-08-18T21:58:26.501 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.875+0000 7efe607bb640 1 --2- 172.21.15.123:0/2785334611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe581072e0 0x7efe5807ca00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:26.501 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.875+0000 7efe607bb640 1 -- 172.21.15.123:0/2785334611 >> 172.21.15.123:0/2785334611 conn(0x7efe58102ab0 msgr2=0x7efe581035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:26.501 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.876+0000 7efe607bb640 1 -- 172.21.15.123:0/2785334611 shutdown_connections 2024-08-18T21:58:26.502 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:25.876+0000 7efe607bb640 1 -- 172.21.15.123:0/2785334611 wait complete. 2024-08-18T21:58:26.502 INFO:teuthology.orchestra.run.smithi123.stdout:Restarting the monitor... 2024-08-18T21:58:26.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:26 smithi123 systemd[1]: Stopping Ceph mon.a for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T21:58:27.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:26 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a[18077]: 2024-08-18T21:58:26.769+0000 7f7bbdc92640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T21:58:27.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:26 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a[18077]: 2024-08-18T21:58:26.769+0000 7f7bbdc92640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-18T21:58:27.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:26 smithi123 podman[18335]: 2024-08-18 21:58:26.820786218 +0000 UTC m=+0.142776662 container died a3ffe1787bcac5dd185fbf31f74a431de35baff0966d4bee16a0a9a9100cd39b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T21:58:27.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:27 smithi123 podman[18335]: 2024-08-18 21:58:27.369328898 +0000 UTC m=+0.691319351 container cleanup a3ffe1787bcac5dd185fbf31f74a431de35baff0966d4bee16a0a9a9100cd39b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-18T21:58:27.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:27 smithi123 bash[18335]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a 2024-08-18T21:58:29.653 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 podman[18348]: 2024-08-18 21:58:29.299154984 +0000 UTC m=+2.474623600 container remove a3ffe1787bcac5dd185fbf31f74a431de35baff0966d4bee16a0a9a9100cd39b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-08-18T21:58:29.653 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 systemd[1]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-18T21:58:29.653 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 systemd[1]: Stopped Ceph mon.a for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T21:58:29.653 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 systemd[1]: Starting Ceph mon.a for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T21:58:29.953 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 podman[18444]: 2024-08-18 21:58:29.555088748 +0000 UTC m=+0.016988737 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T21:58:29.954 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 podman[18444]: 2024-08-18 21:58:29.660749791 +0000 UTC m=+0.122649765 container create 391aeb56646b7797c49322c0ecd73b752b78887609c3af722de733686031835e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0) 2024-08-18T21:58:29.954 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 podman[18444]: 2024-08-18 21:58:29.86313241 +0000 UTC m=+0.325032386 container init 391aeb56646b7797c49322c0ecd73b752b78887609c3af722de733686031835e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-18T21:58:29.954 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 podman[18444]: 2024-08-18 21:58:29.866138702 +0000 UTC m=+0.328038678 container start 391aeb56646b7797c49322c0ecd73b752b78887609c3af722de733686031835e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T21:58:29.954 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: set uid:gid to 167:167 (ceph:ceph) 2024-08-18T21:58:29.955 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc), process ceph-mon, pid 2 2024-08-18T21:58:29.955 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: pidfile_write: ignore empty --pid-file 2024-08-18T21:58:29.955 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: load: jerasure load: lrc 2024-08-18T21:58:29.955 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: RocksDB version: 7.9.2 2024-08-18T21:58:29.955 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Git sha 0 2024-08-18T21:58:29.955 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Compile date 2024-08-18 15:19:56 2024-08-18T21:58:29.956 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: DB SUMMARY 2024-08-18T21:58:29.956 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: DB Session ID: 5P6MR62KV21NU8DVMN9V 2024-08-18T21:58:29.956 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: CURRENT file: CURRENT 2024-08-18T21:58:29.956 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: IDENTITY file: IDENTITY 2024-08-18T21:58:29.956 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-18T21:58:29.956 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-18T21:58:29.957 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104838 ; 2024-08-18T21:58:29.957 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.error_if_exists: 0 2024-08-18T21:58:29.957 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.create_if_missing: 0 2024-08-18T21:58:29.957 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.paranoid_checks: 1 2024-08-18T21:58:29.957 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-18T21:58:29.958 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-18T21:58:29.958 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-18T21:58:29.958 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.env: 0x56052b1707a0 2024-08-18T21:58:29.958 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.fs: PosixFileSystem 2024-08-18T21:58:29.958 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.info_log: 0x56052d635500 2024-08-18T21:58:29.958 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_file_opening_threads: 16 2024-08-18T21:58:29.958 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.statistics: (nil) 2024-08-18T21:58:29.958 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.use_fsync: 0 2024-08-18T21:58:29.959 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_log_file_size: 0 2024-08-18T21:58:29.959 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-18T21:58:29.959 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-18T21:58:29.959 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.keep_log_file_num: 1000 2024-08-18T21:58:29.959 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.recycle_log_file_num: 0 2024-08-18T21:58:29.959 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.allow_fallocate: 1 2024-08-18T21:58:29.959 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.allow_mmap_reads: 0 2024-08-18T21:58:29.959 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.allow_mmap_writes: 0 2024-08-18T21:58:29.959 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.use_direct_reads: 0 2024-08-18T21:58:29.959 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-18T21:58:29.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.create_missing_column_families: 0 2024-08-18T21:58:29.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.db_log_dir: 2024-08-18T21:58:29.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.wal_dir: 2024-08-18T21:58:29.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-18T21:58:29.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-18T21:58:29.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-18T21:58:29.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-18T21:58:29.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-18T21:58:29.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-18T21:58:29.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.advise_random_on_open: 1 2024-08-18T21:58:29.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.db_write_buffer_size: 0 2024-08-18T21:58:29.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.write_buffer_manager: 0x56052d644dc0 2024-08-18T21:58:29.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-18T21:58:29.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-18T21:58:29.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-18T21:58:29.961 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.rate_limiter: (nil) 2024-08-18T21:58:29.961 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-18T21:58:29.961 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.wal_recovery_mode: 2 2024-08-18T21:58:29.962 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.enable_thread_tracking: 0 2024-08-18T21:58:29.962 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.enable_pipelined_write: 0 2024-08-18T21:58:29.962 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.unordered_write: 0 2024-08-18T21:58:29.962 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-18T21:58:29.962 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-18T21:58:29.963 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-18T21:58:29.963 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-18T21:58:29.963 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.row_cache: None 2024-08-18T21:58:29.963 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.wal_filter: None 2024-08-18T21:58:29.963 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-18T21:58:29.963 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.allow_ingest_behind: 0 2024-08-18T21:58:29.963 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.two_write_queues: 0 2024-08-18T21:58:29.963 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.manual_wal_flush: 0 2024-08-18T21:58:29.963 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.wal_compression: 0 2024-08-18T21:58:29.963 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.atomic_flush: 0 2024-08-18T21:58:29.963 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-18T21:58:29.963 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-18T21:58:29.963 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-18T21:58:29.963 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.log_readahead_size: 0 2024-08-18T21:58:29.964 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-18T21:58:29.964 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.best_efforts_recovery: 0 2024-08-18T21:58:29.964 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-18T21:58:29.964 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-18T21:58:29.964 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.allow_data_in_errors: 0 2024-08-18T21:58:29.964 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.db_host_id: __hostname__ 2024-08-18T21:58:29.964 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-18T21:58:29.964 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_background_jobs: 2 2024-08-18T21:58:29.964 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_background_compactions: -1 2024-08-18T21:58:29.964 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_subcompactions: 1 2024-08-18T21:58:29.964 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-18T21:58:29.964 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-18T21:58:29.964 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-18T21:58:29.964 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_total_wal_size: 0 2024-08-18T21:58:29.965 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-18T21:58:29.965 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-18T21:58:29.965 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-18T21:58:29.965 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-18T21:58:29.965 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_open_files: -1 2024-08-18T21:58:29.965 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.bytes_per_sync: 0 2024-08-18T21:58:29.965 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-18T21:58:29.965 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-18T21:58:29.965 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compaction_readahead_size: 0 2024-08-18T21:58:29.965 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_background_flushes: -1 2024-08-18T21:58:29.965 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Compression algorithms supported: 2024-08-18T21:58:29.965 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: kZSTD supported: 0 2024-08-18T21:58:29.965 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: kXpressCompression supported: 0 2024-08-18T21:58:29.965 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: kBZip2Compression supported: 0 2024-08-18T21:58:29.966 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-18T21:58:29.966 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: kLZ4Compression supported: 1 2024-08-18T21:58:29.966 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: kZlibCompression supported: 1 2024-08-18T21:58:29.966 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: kLZ4HCCompression supported: 1 2024-08-18T21:58:29.966 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: kSnappyCompression supported: 1 2024-08-18T21:58:29.966 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-18T21:58:29.966 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-18T21:58:29.966 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-18T21:58:29.966 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-18T21:58:29.966 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-18T21:58:29.966 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.merge_operator: 2024-08-18T21:58:29.967 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compaction_filter: None 2024-08-18T21:58:29.967 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compaction_filter_factory: None 2024-08-18T21:58:29.967 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.sst_partitioner_factory: None 2024-08-18T21:58:29.967 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-18T21:58:29.967 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-18T21:58:29.967 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56052d635120) 2024-08-18T21:58:29.967 INFO:journalctl@ceph.mon.a.smithi123.stdout: cache_index_and_filter_blocks: 1 2024-08-18T21:58:29.967 INFO:journalctl@ceph.mon.a.smithi123.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-18T21:58:29.967 INFO:journalctl@ceph.mon.a.smithi123.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-18T21:58:29.967 INFO:journalctl@ceph.mon.a.smithi123.stdout: pin_top_level_index_and_filter: 1 2024-08-18T21:58:29.968 INFO:journalctl@ceph.mon.a.smithi123.stdout: index_type: 0 2024-08-18T21:58:29.968 INFO:journalctl@ceph.mon.a.smithi123.stdout: data_block_index_type: 0 2024-08-18T21:58:29.968 INFO:journalctl@ceph.mon.a.smithi123.stdout: index_shortening: 1 2024-08-18T21:58:29.968 INFO:journalctl@ceph.mon.a.smithi123.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-18T21:58:29.968 INFO:journalctl@ceph.mon.a.smithi123.stdout: checksum: 4 2024-08-18T21:58:29.968 INFO:journalctl@ceph.mon.a.smithi123.stdout: no_block_cache: 0 2024-08-18T21:58:29.968 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_cache: 0x56052d629090 2024-08-18T21:58:29.968 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_cache_name: BinnedLRUCache 2024-08-18T21:58:29.968 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_cache_options: 2024-08-18T21:58:29.968 INFO:journalctl@ceph.mon.a.smithi123.stdout: capacity : 536870912 2024-08-18T21:58:29.968 INFO:journalctl@ceph.mon.a.smithi123.stdout: num_shard_bits : 4 2024-08-18T21:58:29.968 INFO:journalctl@ceph.mon.a.smithi123.stdout: strict_capacity_limit : 0 2024-08-18T21:58:29.968 INFO:journalctl@ceph.mon.a.smithi123.stdout: high_pri_pool_ratio: 0.000 2024-08-18T21:58:29.968 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_cache_compressed: (nil) 2024-08-18T21:58:29.969 INFO:journalctl@ceph.mon.a.smithi123.stdout: persistent_cache: (nil) 2024-08-18T21:58:29.969 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_size: 4096 2024-08-18T21:58:29.969 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_size_deviation: 10 2024-08-18T21:58:29.969 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_restart_interval: 16 2024-08-18T21:58:29.969 INFO:journalctl@ceph.mon.a.smithi123.stdout: index_block_restart_interval: 1 2024-08-18T21:58:29.969 INFO:journalctl@ceph.mon.a.smithi123.stdout: metadata_block_size: 4096 2024-08-18T21:58:29.969 INFO:journalctl@ceph.mon.a.smithi123.stdout: partition_filters: 0 2024-08-18T21:58:29.969 INFO:journalctl@ceph.mon.a.smithi123.stdout: use_delta_encoding: 1 2024-08-18T21:58:29.969 INFO:journalctl@ceph.mon.a.smithi123.stdout: filter_policy: bloomfilter 2024-08-18T21:58:29.969 INFO:journalctl@ceph.mon.a.smithi123.stdout: whole_key_filtering: 1 2024-08-18T21:58:29.969 INFO:journalctl@ceph.mon.a.smithi123.stdout: verify_compression: 0 2024-08-18T21:58:29.969 INFO:journalctl@ceph.mon.a.smithi123.stdout: read_amp_bytes_per_bit: 0 2024-08-18T21:58:29.969 INFO:journalctl@ceph.mon.a.smithi123.stdout: format_version: 5 2024-08-18T21:58:29.969 INFO:journalctl@ceph.mon.a.smithi123.stdout: enable_index_compression: 1 2024-08-18T21:58:29.970 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_align: 0 2024-08-18T21:58:29.970 INFO:journalctl@ceph.mon.a.smithi123.stdout: max_auto_readahead_size: 262144 2024-08-18T21:58:29.970 INFO:journalctl@ceph.mon.a.smithi123.stdout: prepopulate_block_cache: 0 2024-08-18T21:58:29.970 INFO:journalctl@ceph.mon.a.smithi123.stdout: initial_auto_readahead_size: 8192 2024-08-18T21:58:29.970 INFO:journalctl@ceph.mon.a.smithi123.stdout: num_file_reads_for_auto_readahead: 2 2024-08-18T21:58:29.970 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.write_buffer_size: 33554432 2024-08-18T21:58:29.970 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_write_buffer_number: 2 2024-08-18T21:58:29.970 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compression: NoCompression 2024-08-18T21:58:29.970 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.bottommost_compression: Disabled 2024-08-18T21:58:29.970 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.prefix_extractor: nullptr 2024-08-18T21:58:29.970 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-18T21:58:29.970 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.num_levels: 7 2024-08-18T21:58:29.970 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-18T21:58:29.971 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-18T21:58:29.971 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-18T21:58:29.971 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-18T21:58:29.971 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-18T21:58:29.971 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-18T21:58:29.971 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-18T21:58:29.971 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-18T21:58:29.971 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-18T21:58:29.971 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-18T21:58:29.971 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-18T21:58:29.971 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-18T21:58:29.971 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-18T21:58:29.971 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compression_opts.level: 32767 2024-08-18T21:58:29.971 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compression_opts.strategy: 0 2024-08-18T21:58:29.972 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-18T21:58:29.972 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-18T21:58:29.972 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-18T21:58:29.972 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-18T21:58:29.972 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compression_opts.enabled: false 2024-08-18T21:58:29.972 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-18T21:58:29.972 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-18T21:58:29.972 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-18T21:58:29.972 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-18T21:58:29.972 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.target_file_size_base: 67108864 2024-08-18T21:58:29.972 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-18T21:58:29.972 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-18T21:58:29.972 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-18T21:58:29.972 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-18T21:58:29.973 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-18T21:58:29.973 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-18T21:58:29.973 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-18T21:58:29.973 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-18T21:58:29.973 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-18T21:58:29.973 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-18T21:58:29.973 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-18T21:58:29.973 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-18T21:58:29.973 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-18T21:58:29.973 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-18T21:58:29.973 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.arena_block_size: 1048576 2024-08-18T21:58:29.973 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-18T21:58:29.973 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-18T21:58:29.973 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.disable_auto_compactions: 0 2024-08-18T21:58:29.974 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-18T21:58:29.974 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-18T21:58:29.974 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-18T21:58:29.974 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-18T21:58:29.974 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-18T21:58:29.974 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-18T21:58:29.974 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-18T21:58:29.974 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-18T21:58:29.974 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-18T21:58:29.974 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-18T21:58:29.974 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-18T21:58:29.974 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.inplace_update_support: 0 2024-08-18T21:58:29.974 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-18T21:58:29.974 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.bloom_locality: 0 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.max_successive_merges: 0 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.paranoid_file_checks: 0 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.force_consistency_checks: 1 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.report_bg_io_stats: 0 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.ttl: 2592000 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.enable_blob_files: false 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.min_blob_size: 0 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.blob_file_size: 268435456 2024-08-18T21:58:29.975 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-18T21:58:29.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-18T21:58:29.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-18T21:58:29.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-18T21:58:29.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-18T21:58:29.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.blob_file_starting_level: 0 2024-08-18T21:58:29.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-18T21:58:29.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-18T21:58:29.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-18T21:58:29.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 74e01c48-6984-41ce-b111-cb3879479fc2 2024-08-18T21:58:29.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724018309893262, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-18T21:58:29.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-18T21:58:29.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724018309894257, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99954, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 97842, "index_size": 304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14181, "raw_average_key_size": 49, "raw_value_size": 90162, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724018309, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "74e01c48-6984-41ce-b111-cb3879479fc2", "db_session_id": "5P6MR62KV21NU8DVMN9V", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-18T21:58:29.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724018309894353, "job": 1, "event": "recovery_finished"} 2024-08-18T21:58:29.977 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-18T21:58:29.977 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-18T21:58:29.977 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56052d656e00 2024-08-18T21:58:29.977 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: DB pointer 0x56052d750000 2024-08-18T21:58:29.977 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-18T21:58:29.977 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-18T21:58:29.977 INFO:journalctl@ceph.mon.a.smithi123.stdout: ** DB Stats ** 2024-08-18T21:58:29.977 INFO:journalctl@ceph.mon.a.smithi123.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-18T21:58:29.977 INFO:journalctl@ceph.mon.a.smithi123.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-18T21:58:29.977 INFO:journalctl@ceph.mon.a.smithi123.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-18T21:58:29.977 INFO:journalctl@ceph.mon.a.smithi123.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-18T21:58:29.977 INFO:journalctl@ceph.mon.a.smithi123.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-18T21:58:29.977 INFO:journalctl@ceph.mon.a.smithi123.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-18T21:58:29.977 INFO:journalctl@ceph.mon.a.smithi123.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-18T21:58:29.978 INFO:journalctl@ceph.mon.a.smithi123.stdout: 2024-08-18T21:58:29.978 INFO:journalctl@ceph.mon.a.smithi123.stdout: ** Compaction Stats [default] ** 2024-08-18T21:58:29.978 INFO:journalctl@ceph.mon.a.smithi123.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-18T21:58:29.979 INFO:journalctl@ceph.mon.a.smithi123.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-18T21:58:29.979 INFO:journalctl@ceph.mon.a.smithi123.stdout: L0 2/0 99.47 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-18T21:58:29.979 INFO:journalctl@ceph.mon.a.smithi123.stdout: Sum 2/0 99.47 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-18T21:58:29.979 INFO:journalctl@ceph.mon.a.smithi123.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-18T21:58:29.979 INFO:journalctl@ceph.mon.a.smithi123.stdout: 2024-08-18T21:58:29.979 INFO:journalctl@ceph.mon.a.smithi123.stdout: ** Compaction Stats [default] ** 2024-08-18T21:58:29.980 INFO:journalctl@ceph.mon.a.smithi123.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-18T21:58:29.980 INFO:journalctl@ceph.mon.a.smithi123.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-18T21:58:29.980 INFO:journalctl@ceph.mon.a.smithi123.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 150.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-18T21:58:29.980 INFO:journalctl@ceph.mon.a.smithi123.stdout: 2024-08-18T21:58:29.980 INFO:journalctl@ceph.mon.a.smithi123.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-18T21:58:29.980 INFO:journalctl@ceph.mon.a.smithi123.stdout: 2024-08-18T21:58:29.981 INFO:journalctl@ceph.mon.a.smithi123.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-18T21:58:29.981 INFO:journalctl@ceph.mon.a.smithi123.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-18T21:58:29.981 INFO:journalctl@ceph.mon.a.smithi123.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-18T21:58:29.981 INFO:journalctl@ceph.mon.a.smithi123.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-18T21:58:29.981 INFO:journalctl@ceph.mon.a.smithi123.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-18T21:58:29.981 INFO:journalctl@ceph.mon.a.smithi123.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-18T21:58:29.981 INFO:journalctl@ceph.mon.a.smithi123.stdout: Cumulative compaction: 0.00 GB write, 30.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-18T21:58:29.981 INFO:journalctl@ceph.mon.a.smithi123.stdout: Interval compaction: 0.00 GB write, 30.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-18T21:58:29.981 INFO:journalctl@ceph.mon.a.smithi123.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-18T21:58:29.982 INFO:journalctl@ceph.mon.a.smithi123.stdout: Block cache BinnedLRUCache@0x56052d629090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-18T21:58:29.982 INFO:journalctl@ceph.mon.a.smithi123.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-08-18T21:58:29.982 INFO:journalctl@ceph.mon.a.smithi123.stdout: 2024-08-18T21:58:29.982 INFO:journalctl@ceph.mon.a.smithi123.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-18T21:58:29.982 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: starting mon.a rank 0 at public addrs [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] at bind addrs [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:58:29.982 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: mon.a@-1(???) e1 preinit fsid dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:58:29.983 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: mon.a@-1(???).mds e1 new map 2024-08-18T21:58:29.983 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: mon.a@-1(???).mds e1 print_map 2024-08-18T21:58:29.983 INFO:journalctl@ceph.mon.a.smithi123.stdout: e1 2024-08-18T21:58:29.983 INFO:journalctl@ceph.mon.a.smithi123.stdout: btime 2024-08-18T21:58:23:301079+0000 2024-08-18T21:58:29.983 INFO:journalctl@ceph.mon.a.smithi123.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T21:58:29.983 INFO:journalctl@ceph.mon.a.smithi123.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-18T21:58:29.984 INFO:journalctl@ceph.mon.a.smithi123.stdout: legacy client fscid: -1 2024-08-18T21:58:29.984 INFO:journalctl@ceph.mon.a.smithi123.stdout: 2024-08-18T21:58:29.984 INFO:journalctl@ceph.mon.a.smithi123.stdout: No filesystems configured 2024-08-18T21:58:29.984 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-18T21:58:29.984 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-18T21:58:29.984 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-18T21:58:29.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-18T21:58:29.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-18T21:58:29.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-18T21:58:29.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: monmap epoch 1 2024-08-18T21:58:29.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: fsid dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:58:29.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: last_changed 2024-08-18T21:58:12.803696+0000 2024-08-18T21:58:29.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: created 2024-08-18T21:58:12.803696+0000 2024-08-18T21:58:29.986 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: min_mon_release 19 (squid) 2024-08-18T21:58:29.986 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: election_strategy: 1 2024-08-18T21:58:29.986 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: 0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2024-08-18T21:58:29.986 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: fsmap 2024-08-18T21:58:29.986 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: osdmap e1: 0 total, 0 up, 0 in 2024-08-18T21:58:29.986 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 ceph-mon[18462]: mgrmap e1: no daemons active 2024-08-18T21:58:29.991 INFO:teuthology.orchestra.run.smithi123.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-18T21:58:30.255 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 bash[18444]: 391aeb56646b7797c49322c0ecd73b752b78887609c3af722de733686031835e 2024-08-18T21:58:30.256 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:29 smithi123 systemd[1]: Started Ceph mon.a for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T21:58:31.143 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.520+0000 7fc0e3ecb640 1 Processor -- start 2024-08-18T21:58:31.143 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.520+0000 7fc0e3ecb640 1 -- start start 2024-08-18T21:58:31.143 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.521+0000 7fc0e3ecb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0dc107da0 0x7fc0dc10a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:31.143 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.521+0000 7fc0e3ecb640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc075550 con 0x7fc0dc107da0 2024-08-18T21:58:31.143 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.521+0000 7fc0e1c67640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0dc107da0 0x7fc0dc10a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:31.144 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.521+0000 7fc0e1c67640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0dc107da0 0x7fc0dc10a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57808/0 (socket says 172.21.15.123:57808) 2024-08-18T21:58:31.144 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.521+0000 7fc0e1c67640 1 -- 172.21.15.123:0/3367162352 learned_addr learned my addr 172.21.15.123:0/3367162352 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:31.144 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.521+0000 7fc0e1c67640 1 -- 172.21.15.123:0/3367162352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0dc10a6d0 con 0x7fc0dc107da0 2024-08-18T21:58:31.144 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.523+0000 7fc0e1c67640 1 --2- 172.21.15.123:0/3367162352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0dc107da0 0x7fc0dc10a190 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009820 tx=0x7fc0d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fb36135f4a00a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:31.144 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.523+0000 7fc0e0c65640 1 -- 172.21.15.123:0/3367162352 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0d4037070 con 0x7fc0dc107da0 2024-08-18T21:58:31.144 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.523+0000 7fc0e0c65640 1 -- 172.21.15.123:0/3367162352 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc0d4032900 con 0x7fc0dc107da0 2024-08-18T21:58:31.144 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.523+0000 7fc0e0c65640 1 -- 172.21.15.123:0/3367162352 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0d4030850 con 0x7fc0dc107da0 2024-08-18T21:58:31.144 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.524+0000 7fc0e3ecb640 1 -- 172.21.15.123:0/3367162352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0dc107da0 msgr2=0x7fc0dc10a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:31.144 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.524+0000 7fc0e3ecb640 1 --2- 172.21.15.123:0/3367162352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0dc107da0 0x7fc0dc10a190 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009820 tx=0x7fc0d402a270 comp rx=0 tx=0).stop 2024-08-18T21:58:31.144 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.524+0000 7fc0e3ecb640 1 -- 172.21.15.123:0/3367162352 shutdown_connections 2024-08-18T21:58:31.144 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.524+0000 7fc0e3ecb640 1 --2- 172.21.15.123:0/3367162352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0dc107da0 0x7fc0dc10a190 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:31.144 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.524+0000 7fc0e3ecb640 1 -- 172.21.15.123:0/3367162352 >> 172.21.15.123:0/3367162352 conn(0x7fc0dc101980 msgr2=0x7fc0dc103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:31.144 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.524+0000 7fc0e3ecb640 1 -- 172.21.15.123:0/3367162352 shutdown_connections 2024-08-18T21:58:31.145 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.524+0000 7fc0e3ecb640 1 -- 172.21.15.123:0/3367162352 wait complete. 2024-08-18T21:58:31.145 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.524+0000 7fc0e3ecb640 1 Processor -- start 2024-08-18T21:58:31.145 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.525+0000 7fc0e3ecb640 1 -- start start 2024-08-18T21:58:31.145 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.525+0000 7fc0e3ecb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0dc107da0 0x7fc0dc107620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:31.145 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.525+0000 7fc0e3ecb640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc10b710 con 0x7fc0dc107da0 2024-08-18T21:58:31.145 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.525+0000 7fc0e1c67640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0dc107da0 0x7fc0dc107620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:31.145 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.525+0000 7fc0e1c67640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0dc107da0 0x7fc0dc107620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57822/0 (socket says 172.21.15.123:57822) 2024-08-18T21:58:31.145 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.525+0000 7fc0e1c67640 1 -- 172.21.15.123:0/4006409349 learned_addr learned my addr 172.21.15.123:0/4006409349 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:31.145 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.525+0000 7fc0e1c67640 1 -- 172.21.15.123:0/4006409349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0dc107b60 con 0x7fc0dc107da0 2024-08-18T21:58:31.145 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.525+0000 7fc0e1c67640 1 --2- 172.21.15.123:0/4006409349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0dc107da0 0x7fc0dc107620 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4032ce0 tx=0x7fc0d4032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:31.145 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.525+0000 7fc0daffd640 1 -- 172.21.15.123:0/4006409349 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0d4042070 con 0x7fc0dc107da0 2024-08-18T21:58:31.145 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.525+0000 7fc0daffd640 1 -- 172.21.15.123:0/4006409349 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc0d40308c0 con 0x7fc0dc107da0 2024-08-18T21:58:31.145 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.525+0000 7fc0e3ecb640 1 -- 172.21.15.123:0/4006409349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0dc105d50 con 0x7fc0dc107da0 2024-08-18T21:58:31.145 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.525+0000 7fc0daffd640 1 -- 172.21.15.123:0/4006409349 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0d4037040 con 0x7fc0dc107da0 2024-08-18T21:58:31.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.525+0000 7fc0e3ecb640 1 -- 172.21.15.123:0/4006409349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0dc106290 con 0x7fc0dc107da0 2024-08-18T21:58:31.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.526+0000 7fc0daffd640 1 -- 172.21.15.123:0/4006409349 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc0d4045070 con 0x7fc0dc107da0 2024-08-18T21:58:31.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.526+0000 7fc0daffd640 1 -- 172.21.15.123:0/4006409349 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc0d4047b70 con 0x7fc0dc107da0 2024-08-18T21:58:31.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.526+0000 7fc0e3ecb640 1 -- 172.21.15.123:0/4006409349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0dc108200 con 0x7fc0dc107da0 2024-08-18T21:58:31.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.529+0000 7fc0daffd640 1 -- 172.21.15.123:0/4006409349 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fc0d403c720 con 0x7fc0dc107da0 2024-08-18T21:58:31.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.585+0000 7fc0e3ecb640 1 -- 172.21.15.123:0/4006409349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fc0dc1065d0 con 0x7fc0dc107da0 2024-08-18T21:58:31.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.587+0000 7fc0daffd640 1 -- 172.21.15.123:0/4006409349 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fc0d403c900 con 0x7fc0dc107da0 2024-08-18T21:58:31.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.587+0000 7fc0e3ecb640 1 -- 172.21.15.123:0/4006409349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0dc107da0 msgr2=0x7fc0dc107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:31.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.587+0000 7fc0e3ecb640 1 --2- 172.21.15.123:0/4006409349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0dc107da0 0x7fc0dc107620 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4032ce0 tx=0x7fc0d4032d10 comp rx=0 tx=0).stop 2024-08-18T21:58:31.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.587+0000 7fc0e3ecb640 1 -- 172.21.15.123:0/4006409349 shutdown_connections 2024-08-18T21:58:31.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.587+0000 7fc0e3ecb640 1 --2- 172.21.15.123:0/4006409349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0dc107da0 0x7fc0dc107620 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:31.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.587+0000 7fc0e3ecb640 1 -- 172.21.15.123:0/4006409349 >> 172.21.15.123:0/4006409349 conn(0x7fc0dc101980 msgr2=0x7fc0dc1024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:31.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.587+0000 7fc0e3ecb640 1 -- 172.21.15.123:0/4006409349 shutdown_connections 2024-08-18T21:58:31.147 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:30.587+0000 7fc0e3ecb640 1 -- 172.21.15.123:0/4006409349 wait complete. 2024-08-18T21:58:31.147 INFO:teuthology.orchestra.run.smithi123.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-18T21:58:31.160 INFO:teuthology.orchestra.run.smithi123.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-18T21:58:31.160 INFO:teuthology.orchestra.run.smithi123.stdout:Creating mgr... 2024-08-18T21:58:31.161 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-18T21:58:31.161 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-18T21:58:31.407 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mgr.x 2024-08-18T21:58:31.407 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to reset failed state of unit ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mgr.x.service: Unit ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mgr.x.service not loaded. 2024-08-18T21:58:31.554 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-dfa1db70-5dac-11ef-bccf-c7b262605968.target.wants/ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@.service. 2024-08-18T21:58:31.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:31 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/4006409349' entity='client.admin' 2024-08-18T21:58:32.179 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-18T21:58:32.179 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-08-18T21:58:32.187 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-18T21:58:32.187 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-08-18T21:58:32.187 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-08-18T21:58:32.187 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to enable service . firewalld.service is not available 2024-08-18T21:58:32.195 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-18T21:58:32.196 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-08-18T21:58:32.203 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-18T21:58:32.203 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-08-18T21:58:32.203 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-08-18T21:58:32.203 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-18T21:58:32.203 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr to start... 2024-08-18T21:58:32.204 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr... 2024-08-18T21:58:32.330 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:32 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:32.271+0000 7f9f4d710040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-18T21:58:32.646 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:32 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:32.336+0000 7f9f4d710040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-18T21:58:32.646 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:32 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:32.483+0000 7f9f4d710040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-18T21:58:32.646 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:32 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:32.645+0000 7f9f4d710040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-18T21:58:32.921 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:32 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/973118121' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-18T21:58:32.921 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:32 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:32.797+0000 7f9f4d710040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-18T21:58:32.922 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:32 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:32.920+0000 7f9f4d710040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-18T21:58:33.260 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:33.049+0000 7f9f4d710040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-18T21:58:33.260 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:33.106+0000 7f9f4d710040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-18T21:58:33.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-08-18T21:58:33.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-08-18T21:58:33.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsid": "dfa1db70-5dac-11ef-bccf-c7b262605968", 2024-08-18T21:58:33.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "health": { 2024-08-18T21:58:33.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-18T21:58:33.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-18T21:58:33.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-18T21:58:33.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:33.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-18T21:58:33.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-18T21:58:33.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 0 2024-08-18T21:58:33.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-08-18T21:58:33.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-18T21:58:33.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "a" 2024-08-18T21:58:33.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-08-18T21:58:33.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-08-18T21:58:33.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-18T21:58:33.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T21:58:33.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-18T21:58:33.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-18T21:58:33.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:33.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-18T21:58:33.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T21:58:33.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-18T21:58:33.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-18T21:58:33.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-18T21:58:33.318 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-18T21:58:33.318 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-18T21:58:33.319 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-18T21:58:33.319 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:33.319 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-18T21:58:33.319 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-18T21:58:33.319 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-18T21:58:33.319 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-18T21:58:33.319 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-18T21:58:33.319 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-18T21:58:33.319 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-18T21:58:33.319 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-18T21:58:33.319 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-18T21:58:33.319 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:33.319 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-18T21:58:33.320 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T21:58:33.320 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "btime": "2024-08-18T21:58:23:301079+0000", 2024-08-18T21:58:33.320 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-18T21:58:33.320 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-18T21:58:33.320 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:33.320 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-18T21:58:33.320 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-18T21:58:33.320 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-18T21:58:33.320 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-18T21:58:33.320 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-18T21:58:33.320 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-18T21:58:33.320 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "restful" 2024-08-18T21:58:33.320 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-08-18T21:58:33.320 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-18T21:58:33.321 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:33.321 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-18T21:58:33.321 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T21:58:33.321 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modified": "2024-08-18T21:58:23.301728+0000", 2024-08-18T21:58:33.321 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-18T21:58:33.321 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:33.321 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-18T21:58:33.321 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-08-18T21:58:33.321 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.645+0000 7febad1d1640 1 Processor -- start 2024-08-18T21:58:33.321 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.645+0000 7febad1d1640 1 -- start start 2024-08-18T21:58:33.321 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.645+0000 7febad1d1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba8107d40 0x7feba810a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:33.321 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.645+0000 7febad1d1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feba80755b0 con 0x7feba8107d40 2024-08-18T21:58:33.321 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.646+0000 7feba6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba8107d40 0x7feba810a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:33.321 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.646+0000 7feba6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba8107d40 0x7feba810a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57852/0 (socket says 172.21.15.123:57852) 2024-08-18T21:58:33.321 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.646+0000 7feba6d9d640 1 -- 172.21.15.123:0/1078357547 learned_addr learned my addr 172.21.15.123:0/1078357547 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:33.322 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.646+0000 7feba6d9d640 1 -- 172.21.15.123:0/1078357547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba810a670 con 0x7feba8107d40 2024-08-18T21:58:33.322 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.647+0000 7feba6d9d640 1 --2- 172.21.15.123:0/1078357547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba8107d40 0x7feba810a130 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7feb98009820 tx=0x7feb9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4a89a0d1f98a36 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:33.322 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.647+0000 7feba5d9b640 1 -- 172.21.15.123:0/1078357547 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb98037070 con 0x7feba8107d40 2024-08-18T21:58:33.322 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.647+0000 7feba5d9b640 1 -- 172.21.15.123:0/1078357547 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feb98032900 con 0x7feba8107d40 2024-08-18T21:58:33.322 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.647+0000 7feba5d9b640 1 -- 172.21.15.123:0/1078357547 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb98030850 con 0x7feba8107d40 2024-08-18T21:58:33.322 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.648+0000 7febad1d1640 1 -- 172.21.15.123:0/1078357547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba8107d40 msgr2=0x7feba810a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:33.322 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.648+0000 7febad1d1640 1 --2- 172.21.15.123:0/1078357547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba8107d40 0x7feba810a130 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7feb98009820 tx=0x7feb9802a270 comp rx=0 tx=0).stop 2024-08-18T21:58:33.322 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.648+0000 7febad1d1640 1 -- 172.21.15.123:0/1078357547 shutdown_connections 2024-08-18T21:58:33.322 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.648+0000 7febad1d1640 1 --2- 172.21.15.123:0/1078357547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba8107d40 0x7feba810a130 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:33.322 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.648+0000 7febad1d1640 1 -- 172.21.15.123:0/1078357547 >> 172.21.15.123:0/1078357547 conn(0x7feba8101980 msgr2=0x7feba8103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:33.322 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.648+0000 7febad1d1640 1 -- 172.21.15.123:0/1078357547 shutdown_connections 2024-08-18T21:58:33.322 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.648+0000 7febad1d1640 1 -- 172.21.15.123:0/1078357547 wait complete. 2024-08-18T21:58:33.322 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.649+0000 7febad1d1640 1 Processor -- start 2024-08-18T21:58:33.323 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.649+0000 7febad1d1640 1 -- start start 2024-08-18T21:58:33.323 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.649+0000 7febad1d1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba8107d40 0x7feba819b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:33.323 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.649+0000 7febad1d1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feba810b710 con 0x7feba8107d40 2024-08-18T21:58:33.323 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.649+0000 7feba6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba8107d40 0x7feba819b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:33.323 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.649+0000 7feba6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba8107d40 0x7feba819b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57862/0 (socket says 172.21.15.123:57862) 2024-08-18T21:58:33.323 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.649+0000 7feba6d9d640 1 -- 172.21.15.123:0/973118121 learned_addr learned my addr 172.21.15.123:0/973118121 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:33.323 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.649+0000 7feba6d9d640 1 -- 172.21.15.123:0/973118121 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba819b810 con 0x7feba8107d40 2024-08-18T21:58:33.323 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.650+0000 7feba6d9d640 1 --2- 172.21.15.123:0/973118121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba8107d40 0x7feba819b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7feb980097f0 tx=0x7feb98030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:33.323 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.650+0000 7feb9ffff640 1 -- 172.21.15.123:0/973118121 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb98037040 con 0x7feba8107d40 2024-08-18T21:58:33.323 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.650+0000 7febad1d1640 1 -- 172.21.15.123:0/973118121 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba819baa0 con 0x7feba8107d40 2024-08-18T21:58:33.323 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.650+0000 7feb9ffff640 1 -- 172.21.15.123:0/973118121 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feb98040070 con 0x7feba8107d40 2024-08-18T21:58:33.323 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.650+0000 7feb9ffff640 1 -- 172.21.15.123:0/973118121 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb9803a390 con 0x7feba8107d40 2024-08-18T21:58:33.323 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.650+0000 7febad1d1640 1 -- 172.21.15.123:0/973118121 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba819e790 con 0x7feba8107d40 2024-08-18T21:58:33.323 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.650+0000 7feb9ffff640 1 -- 172.21.15.123:0/973118121 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feb9803a630 con 0x7feba8107d40 2024-08-18T21:58:33.324 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.650+0000 7feb9ffff640 1 -- 172.21.15.123:0/973118121 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7feb980459a0 con 0x7feba8107d40 2024-08-18T21:58:33.324 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.651+0000 7febad1d1640 1 -- 172.21.15.123:0/973118121 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba81081a0 con 0x7feba8107d40 2024-08-18T21:58:33.324 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.653+0000 7feb9ffff640 1 -- 172.21.15.123:0/973118121 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7feb98045460 con 0x7feba8107d40 2024-08-18T21:58:33.324 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.714+0000 7febad1d1640 1 -- 172.21.15.123:0/973118121 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7feba819e960 con 0x7feba8107d40 2024-08-18T21:58:33.324 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.714+0000 7feb9ffff640 1 -- 172.21.15.123:0/973118121 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7feb9803b430 con 0x7feba8107d40 2024-08-18T21:58:33.324 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.715+0000 7febad1d1640 1 -- 172.21.15.123:0/973118121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba8107d40 msgr2=0x7feba819b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:33.324 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.715+0000 7febad1d1640 1 --2- 172.21.15.123:0/973118121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba8107d40 0x7feba819b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7feb980097f0 tx=0x7feb98030d80 comp rx=0 tx=0).stop 2024-08-18T21:58:33.324 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.715+0000 7febad1d1640 1 -- 172.21.15.123:0/973118121 shutdown_connections 2024-08-18T21:58:33.324 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.715+0000 7febad1d1640 1 --2- 172.21.15.123:0/973118121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba8107d40 0x7feba819b2d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:33.324 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.715+0000 7febad1d1640 1 -- 172.21.15.123:0/973118121 >> 172.21.15.123:0/973118121 conn(0x7feba8101980 msgr2=0x7feba81024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:33.324 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.715+0000 7febad1d1640 1 -- 172.21.15.123:0/973118121 shutdown_connections 2024-08-18T21:58:33.324 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:32.715+0000 7febad1d1640 1 -- 172.21.15.123:0/973118121 wait complete. 2024-08-18T21:58:33.324 INFO:teuthology.orchestra.run.smithi123.stdout:mgr not available, waiting (1/15)... 2024-08-18T21:58:33.684 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:33.411+0000 7f9f4d710040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-18T21:58:33.685 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:33.471+0000 7f9f4d710040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-18T21:58:33.685 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:33.538+0000 7f9f4d710040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-18T21:58:33.685 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:33.683+0000 7f9f4d710040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-18T21:58:33.991 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:33.743+0000 7f9f4d710040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-18T21:58:33.991 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:33.808+0000 7f9f4d710040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-18T21:58:33.991 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:33.990+0000 7f9f4d710040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-18T21:58:34.260 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:34 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:34.050+0000 7f9f4d710040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-18T21:58:34.260 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:34 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:34.109+0000 7f9f4d710040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-18T21:58:34.260 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:34 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:34.175+0000 7f9f4d710040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-18T21:58:34.760 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:34 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:34.382+0000 7f9f4d710040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-18T21:58:34.760 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:34 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:34.439+0000 7f9f4d710040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-18T21:58:35.260 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:34 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:34.962+0000 7f9f4d710040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-18T21:58:35.527 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:35 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:35.268+0000 7f9f4d710040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-18T21:58:35.777 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:35 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:35.698+0000 7f9f4d710040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-18T21:58:35.777 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:35 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:35.758+0000 7f9f4d710040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-18T21:58:36.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:35 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1548334378' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-18T21:58:36.260 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:35 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:35.823+0000 7f9f4d710040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-18T21:58:36.373 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-08-18T21:58:36.373 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-08-18T21:58:36.373 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsid": "dfa1db70-5dac-11ef-bccf-c7b262605968", 2024-08-18T21:58:36.373 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "health": { 2024-08-18T21:58:36.373 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-18T21:58:36.373 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-18T21:58:36.373 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-18T21:58:36.374 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:36.374 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-18T21:58:36.374 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-18T21:58:36.374 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 0 2024-08-18T21:58:36.374 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-08-18T21:58:36.374 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-18T21:58:36.374 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "a" 2024-08-18T21:58:36.374 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-08-18T21:58:36.374 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-08-18T21:58:36.374 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-18T21:58:36.374 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T21:58:36.374 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-18T21:58:36.374 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-18T21:58:36.374 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:36.375 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-18T21:58:36.375 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T21:58:36.375 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-18T21:58:36.375 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-18T21:58:36.375 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-18T21:58:36.375 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-18T21:58:36.375 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-18T21:58:36.375 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-18T21:58:36.375 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:36.375 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-18T21:58:36.375 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-18T21:58:36.375 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-18T21:58:36.375 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-18T21:58:36.375 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-18T21:58:36.376 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-18T21:58:36.376 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-18T21:58:36.376 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-18T21:58:36.376 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-18T21:58:36.376 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:36.376 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-18T21:58:36.376 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T21:58:36.376 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "btime": "2024-08-18T21:58:23:301079+0000", 2024-08-18T21:58:36.376 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-18T21:58:36.376 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-18T21:58:36.376 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:36.376 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-18T21:58:36.376 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-18T21:58:36.376 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-18T21:58:36.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-18T21:58:36.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-18T21:58:36.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-18T21:58:36.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "restful" 2024-08-18T21:58:36.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-08-18T21:58:36.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-18T21:58:36.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:36.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-18T21:58:36.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T21:58:36.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modified": "2024-08-18T21:58:23.301728+0000", 2024-08-18T21:58:36.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-18T21:58:36.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:36.377 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-18T21:58:36.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-08-18T21:58:36.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.708+0000 7fb811381640 1 Processor -- start 2024-08-18T21:58:36.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.708+0000 7fb811381640 1 -- start start 2024-08-18T21:58:36.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.708+0000 7fb811381640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb80c105bb0 0x7fb80c105fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:36.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.708+0000 7fb811381640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb80c075530 con 0x7fb80c105bb0 2024-08-18T21:58:36.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.708+0000 7fb80affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb80c105bb0 0x7fb80c105fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:36.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.708+0000 7fb80affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb80c105bb0 0x7fb80c105fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39850/0 (socket says 172.21.15.123:39850) 2024-08-18T21:58:36.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.708+0000 7fb80affd640 1 -- 172.21.15.123:0/3866008339 learned_addr learned my addr 172.21.15.123:0/3866008339 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:36.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.709+0000 7fb80affd640 1 -- 172.21.15.123:0/3866008339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80c1064f0 con 0x7fb80c105bb0 2024-08-18T21:58:36.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.709+0000 7fb80affd640 1 --2- 172.21.15.123:0/3866008339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb80c105bb0 0x7fb80c105fb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009820 tx=0x7fb7fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963bf2359a47c99c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:36.378 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.710+0000 7fb809ffb640 1 -- 172.21.15.123:0/3866008339 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc037070 con 0x7fb80c105bb0 2024-08-18T21:58:36.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.710+0000 7fb809ffb640 1 -- 172.21.15.123:0/3866008339 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7fc032900 con 0x7fb80c105bb0 2024-08-18T21:58:36.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.710+0000 7fb809ffb640 1 -- 172.21.15.123:0/3866008339 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc030850 con 0x7fb80c105bb0 2024-08-18T21:58:36.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.710+0000 7fb811381640 1 -- 172.21.15.123:0/3866008339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb80c105bb0 msgr2=0x7fb80c105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:36.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.710+0000 7fb811381640 1 --2- 172.21.15.123:0/3866008339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb80c105bb0 0x7fb80c105fb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009820 tx=0x7fb7fc02a270 comp rx=0 tx=0).stop 2024-08-18T21:58:36.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.710+0000 7fb811381640 1 -- 172.21.15.123:0/3866008339 shutdown_connections 2024-08-18T21:58:36.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.710+0000 7fb811381640 1 --2- 172.21.15.123:0/3866008339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb80c105bb0 0x7fb80c105fb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:36.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.710+0000 7fb811381640 1 -- 172.21.15.123:0/3866008339 >> 172.21.15.123:0/3866008339 conn(0x7fb80c101980 msgr2=0x7fb80c103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:36.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.710+0000 7fb811381640 1 -- 172.21.15.123:0/3866008339 shutdown_connections 2024-08-18T21:58:36.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.710+0000 7fb811381640 1 -- 172.21.15.123:0/3866008339 wait complete. 2024-08-18T21:58:36.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.711+0000 7fb811381640 1 Processor -- start 2024-08-18T21:58:36.379 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.711+0000 7fb811381640 1 -- start start 2024-08-18T21:58:36.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.711+0000 7fb811381640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb80c105bb0 0x7fb80c19d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:36.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.711+0000 7fb811381640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb80c1075f0 con 0x7fb80c105bb0 2024-08-18T21:58:36.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.711+0000 7fb80affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb80c105bb0 0x7fb80c19d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:36.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.711+0000 7fb80affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb80c105bb0 0x7fb80c19d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39856/0 (socket says 172.21.15.123:39856) 2024-08-18T21:58:36.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.711+0000 7fb80affd640 1 -- 172.21.15.123:0/1548334378 learned_addr learned my addr 172.21.15.123:0/1548334378 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:36.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.712+0000 7fb80affd640 1 -- 172.21.15.123:0/1548334378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80c19d9f0 con 0x7fb80c105bb0 2024-08-18T21:58:36.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.712+0000 7fb80affd640 1 --2- 172.21.15.123:0/1548334378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb80c105bb0 0x7fb80c19d4b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc032ce0 tx=0x7fb7fc032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:36.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.712+0000 7fb7f3fff640 1 -- 172.21.15.123:0/1548334378 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc042070 con 0x7fb80c105bb0 2024-08-18T21:58:36.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.712+0000 7fb7f3fff640 1 -- 172.21.15.123:0/1548334378 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7fc0308c0 con 0x7fb80c105bb0 2024-08-18T21:58:36.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.712+0000 7fb811381640 1 -- 172.21.15.123:0/1548334378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80c19dc80 con 0x7fb80c105bb0 2024-08-18T21:58:36.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.712+0000 7fb811381640 1 -- 172.21.15.123:0/1548334378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb80c1a0970 con 0x7fb80c105bb0 2024-08-18T21:58:36.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.712+0000 7fb7f3fff640 1 -- 172.21.15.123:0/1548334378 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc037040 con 0x7fb80c105bb0 2024-08-18T21:58:36.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.712+0000 7fb7f3fff640 1 -- 172.21.15.123:0/1548334378 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb7fc045070 con 0x7fb80c105bb0 2024-08-18T21:58:36.380 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.712+0000 7fb7f3fff640 1 -- 172.21.15.123:0/1548334378 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb7fc047be0 con 0x7fb80c105bb0 2024-08-18T21:58:36.381 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.713+0000 7fb811381640 1 -- 172.21.15.123:0/1548334378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7f80052c0 con 0x7fb80c105bb0 2024-08-18T21:58:36.381 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.715+0000 7fb7f3fff640 1 -- 172.21.15.123:0/1548334378 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fb7fc047440 con 0x7fb80c105bb0 2024-08-18T21:58:36.381 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.775+0000 7fb811381640 1 -- 172.21.15.123:0/1548334378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb7f8005880 con 0x7fb80c105bb0 2024-08-18T21:58:36.381 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.776+0000 7fb7f3fff640 1 -- 172.21.15.123:0/1548334378 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fb7fc03c720 con 0x7fb80c105bb0 2024-08-18T21:58:36.381 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.777+0000 7fb811381640 1 -- 172.21.15.123:0/1548334378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb80c105bb0 msgr2=0x7fb80c19d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:36.381 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.777+0000 7fb811381640 1 --2- 172.21.15.123:0/1548334378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb80c105bb0 0x7fb80c19d4b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc032ce0 tx=0x7fb7fc032d10 comp rx=0 tx=0).stop 2024-08-18T21:58:36.381 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.777+0000 7fb811381640 1 -- 172.21.15.123:0/1548334378 shutdown_connections 2024-08-18T21:58:36.381 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.777+0000 7fb811381640 1 --2- 172.21.15.123:0/1548334378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb80c105bb0 0x7fb80c19d4b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:36.381 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.777+0000 7fb811381640 1 -- 172.21.15.123:0/1548334378 >> 172.21.15.123:0/1548334378 conn(0x7fb80c101980 msgr2=0x7fb80c1917d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:36.381 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.777+0000 7fb811381640 1 -- 172.21.15.123:0/1548334378 shutdown_connections 2024-08-18T21:58:36.381 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:35.777+0000 7fb811381640 1 -- 172.21.15.123:0/1548334378 wait complete. 2024-08-18T21:58:36.381 INFO:teuthology.orchestra.run.smithi123.stdout:mgr not available, waiting (2/15)... 2024-08-18T21:58:37.262 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:36 smithi123 ceph-mon[18462]: Activating manager daemon x 2024-08-18T21:58:37.263 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:36 smithi123 ceph-mon[18462]: mgrmap e2: x(active, starting, since 0.00308581s) 2024-08-18T21:58:37.263 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:36 smithi123 ceph-mon[18462]: from='mgr.14100 172.21.15.123:0/1526466889' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-18T21:58:37.263 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:36 smithi123 ceph-mon[18462]: from='mgr.14100 172.21.15.123:0/1526466889' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-18T21:58:37.263 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:36 smithi123 ceph-mon[18462]: from='mgr.14100 172.21.15.123:0/1526466889' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-18T21:58:37.263 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:36 smithi123 ceph-mon[18462]: from='mgr.14100 172.21.15.123:0/1526466889' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T21:58:37.263 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:36 smithi123 ceph-mon[18462]: from='mgr.14100 172.21.15.123:0/1526466889' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-18T21:58:37.263 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:36 smithi123 ceph-mon[18462]: Manager daemon x is now available 2024-08-18T21:58:37.263 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:36 smithi123 ceph-mon[18462]: from='mgr.14100 172.21.15.123:0/1526466889' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-18T21:58:37.263 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:36 smithi123 ceph-mon[18462]: from='mgr.14100 172.21.15.123:0/1526466889' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-18T21:58:37.263 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:36 smithi123 ceph-mon[18462]: from='mgr.14100 172.21.15.123:0/1526466889' entity='mgr.x' 2024-08-18T21:58:37.263 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:36 smithi123 ceph-mon[18462]: from='mgr.14100 172.21.15.123:0/1526466889' entity='mgr.x' 2024-08-18T21:58:37.263 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:36 smithi123 ceph-mon[18462]: from='mgr.14100 172.21.15.123:0/1526466889' entity='mgr.x' 2024-08-18T21:58:39.009 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:38 smithi123 ceph-mon[18462]: mgrmap e3: x(active, since 1.00728s) 2024-08-18T21:58:39.621 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-08-18T21:58:39.622 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-08-18T21:58:39.622 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsid": "dfa1db70-5dac-11ef-bccf-c7b262605968", 2024-08-18T21:58:39.622 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "health": { 2024-08-18T21:58:39.622 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-18T21:58:39.622 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-18T21:58:39.622 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-18T21:58:39.622 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:39.622 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-18T21:58:39.622 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-18T21:58:39.622 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 0 2024-08-18T21:58:39.623 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-08-18T21:58:39.623 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-18T21:58:39.623 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "a" 2024-08-18T21:58:39.623 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-08-18T21:58:39.623 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-08-18T21:58:39.623 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-18T21:58:39.623 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T21:58:39.623 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-18T21:58:39.623 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-18T21:58:39.623 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:39.623 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-18T21:58:39.623 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T21:58:39.623 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-18T21:58:39.624 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-18T21:58:39.624 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-18T21:58:39.624 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-18T21:58:39.624 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-18T21:58:39.624 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-18T21:58:39.624 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:39.624 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-18T21:58:39.624 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-18T21:58:39.624 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-18T21:58:39.624 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-18T21:58:39.624 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-18T21:58:39.624 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-18T21:58:39.624 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-18T21:58:39.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-18T21:58:39.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-18T21:58:39.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:39.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-18T21:58:39.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T21:58:39.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "btime": "2024-08-18T21:58:23:301079+0000", 2024-08-18T21:58:39.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-18T21:58:39.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-18T21:58:39.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:39.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-18T21:58:39.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-18T21:58:39.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-18T21:58:39.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-18T21:58:39.625 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-18T21:58:39.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-18T21:58:39.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "restful" 2024-08-18T21:58:39.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-08-18T21:58:39.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-18T21:58:39.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:39.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-18T21:58:39.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T21:58:39.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modified": "2024-08-18T21:58:23.301728+0000", 2024-08-18T21:58:39.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-18T21:58:39.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-08-18T21:58:39.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-18T21:58:39.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-08-18T21:58:39.626 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.760+0000 7fa92c53e640 1 Processor -- start 2024-08-18T21:58:39.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.760+0000 7fa92c53e640 1 -- start start 2024-08-18T21:58:39.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.760+0000 7fa92c53e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924105960 0x7fa924105d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:39.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.760+0000 7fa92c53e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa924106330 con 0x7fa924105960 2024-08-18T21:58:39.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.760+0000 7fa92a2da640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924105960 0x7fa924105d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:39.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.760+0000 7fa92a2da640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924105960 0x7fa924105d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39922/0 (socket says 172.21.15.123:39922) 2024-08-18T21:58:39.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.760+0000 7fa92a2da640 1 -- 172.21.15.123:0/4065253760 learned_addr learned my addr 172.21.15.123:0/4065253760 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:39.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.761+0000 7fa92a2da640 1 -- 172.21.15.123:0/4065253760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa924106b60 con 0x7fa924105960 2024-08-18T21:58:39.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.761+0000 7fa92a2da640 1 --2- 172.21.15.123:0/4065253760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924105960 0x7fa924105d60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa920009820 tx=0x7fa92002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57a6fb53c91445f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:39.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.761+0000 7fa9292d8640 1 -- 172.21.15.123:0/4065253760 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa920037070 con 0x7fa924105960 2024-08-18T21:58:39.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.761+0000 7fa9292d8640 1 -- 172.21.15.123:0/4065253760 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa920032900 con 0x7fa924105960 2024-08-18T21:58:39.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.761+0000 7fa9292d8640 1 -- 172.21.15.123:0/4065253760 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa920030850 con 0x7fa924105960 2024-08-18T21:58:39.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.762+0000 7fa92c53e640 1 -- 172.21.15.123:0/4065253760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924105960 msgr2=0x7fa924105d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:39.627 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.762+0000 7fa92c53e640 1 --2- 172.21.15.123:0/4065253760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924105960 0x7fa924105d60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa920009820 tx=0x7fa92002a270 comp rx=0 tx=0).stop 2024-08-18T21:58:39.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.762+0000 7fa92c53e640 1 -- 172.21.15.123:0/4065253760 shutdown_connections 2024-08-18T21:58:39.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.762+0000 7fa92c53e640 1 --2- 172.21.15.123:0/4065253760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924105960 0x7fa924105d60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:39.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.762+0000 7fa92c53e640 1 -- 172.21.15.123:0/4065253760 >> 172.21.15.123:0/4065253760 conn(0x7fa9241010f0 msgr2=0x7fa924103530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:39.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.762+0000 7fa92c53e640 1 -- 172.21.15.123:0/4065253760 shutdown_connections 2024-08-18T21:58:39.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.762+0000 7fa92c53e640 1 -- 172.21.15.123:0/4065253760 wait complete. 2024-08-18T21:58:39.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.763+0000 7fa92c53e640 1 Processor -- start 2024-08-18T21:58:39.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.763+0000 7fa92c53e640 1 -- start start 2024-08-18T21:58:39.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.763+0000 7fa92c53e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924105960 0x7fa92419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:39.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.763+0000 7fa92c53e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa924109f10 con 0x7fa924105960 2024-08-18T21:58:39.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.763+0000 7fa92a2da640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924105960 0x7fa92419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:39.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.763+0000 7fa92a2da640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924105960 0x7fa92419a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39936/0 (socket says 172.21.15.123:39936) 2024-08-18T21:58:39.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.763+0000 7fa92a2da640 1 -- 172.21.15.123:0/3488338887 learned_addr learned my addr 172.21.15.123:0/3488338887 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:39.628 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.763+0000 7fa92a2da640 1 -- 172.21.15.123:0/3488338887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa92419a740 con 0x7fa924105960 2024-08-18T21:58:39.629 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.764+0000 7fa92a2da640 1 --2- 172.21.15.123:0/3488338887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924105960 0x7fa92419a200 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa920009940 tx=0x7fa920032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:39.629 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.764+0000 7fa91b7fe640 1 -- 172.21.15.123:0/3488338887 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa920042070 con 0x7fa924105960 2024-08-18T21:58:39.629 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.764+0000 7fa91b7fe640 1 -- 172.21.15.123:0/3488338887 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa9200308c0 con 0x7fa924105960 2024-08-18T21:58:39.629 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.764+0000 7fa92c53e640 1 -- 172.21.15.123:0/3488338887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa92419a9d0 con 0x7fa924105960 2024-08-18T21:58:39.629 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.764+0000 7fa91b7fe640 1 -- 172.21.15.123:0/3488338887 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa920037040 con 0x7fa924105960 2024-08-18T21:58:39.629 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.764+0000 7fa92c53e640 1 -- 172.21.15.123:0/3488338887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa92419d6c0 con 0x7fa924105960 2024-08-18T21:58:39.629 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.765+0000 7fa91b7fe640 1 -- 172.21.15.123:0/3488338887 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7fa920045070 con 0x7fa924105960 2024-08-18T21:58:39.629 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.765+0000 7fa91b7fe640 1 --2- 172.21.15.123:0/3488338887 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7fa910038e10 0x7fa91003b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:39.629 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.765+0000 7fa91b7fe640 1 -- 172.21.15.123:0/3488338887 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa92006be00 con 0x7fa924105960 2024-08-18T21:58:39.629 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.765+0000 7fa92c53e640 1 -- 172.21.15.123:0/3488338887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa92410a090 con 0x7fa924105960 2024-08-18T21:58:39.629 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.765+0000 7fa929ad9640 1 --2- 172.21.15.123:0/3488338887 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7fa910038e10 0x7fa91003b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:39.629 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.765+0000 7fa929ad9640 1 --2- 172.21.15.123:0/3488338887 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7fa910038e10 0x7fa91003b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa9140098c0 tx=0x7fa914006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:39.629 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.770+0000 7fa91b7fe640 1 -- 172.21.15.123:0/3488338887 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa92004b170 con 0x7fa924105960 2024-08-18T21:58:39.630 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.926+0000 7fa91b7fe640 1 -- 172.21.15.123:0/3488338887 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fa920042d00 con 0x7fa924105960 2024-08-18T21:58:39.630 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.998+0000 7fa92c53e640 1 -- 172.21.15.123:0/3488338887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa92402d830 con 0x7fa924105960 2024-08-18T21:58:39.630 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:38.999+0000 7fa91b7fe640 1 -- 172.21.15.123:0/3488338887 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7fa92003b330 con 0x7fa924105960 2024-08-18T21:58:39.630 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:39.001+0000 7fa92c53e640 1 -- 172.21.15.123:0/3488338887 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7fa910038e10 msgr2=0x7fa91003b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:39.630 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:39.001+0000 7fa92c53e640 1 --2- 172.21.15.123:0/3488338887 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7fa910038e10 0x7fa91003b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa9140098c0 tx=0x7fa914006db0 comp rx=0 tx=0).stop 2024-08-18T21:58:39.630 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:39.001+0000 7fa92c53e640 1 -- 172.21.15.123:0/3488338887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924105960 msgr2=0x7fa92419a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:39.630 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:39.001+0000 7fa92c53e640 1 --2- 172.21.15.123:0/3488338887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924105960 0x7fa92419a200 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa920009940 tx=0x7fa920032ce0 comp rx=0 tx=0).stop 2024-08-18T21:58:39.630 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:39.001+0000 7fa92c53e640 1 -- 172.21.15.123:0/3488338887 shutdown_connections 2024-08-18T21:58:39.630 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:39.001+0000 7fa92c53e640 1 --2- 172.21.15.123:0/3488338887 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7fa910038e10 0x7fa91003b2d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:39.630 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:39.001+0000 7fa92c53e640 1 --2- 172.21.15.123:0/3488338887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924105960 0x7fa92419a200 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:39.630 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:39.001+0000 7fa92c53e640 1 -- 172.21.15.123:0/3488338887 >> 172.21.15.123:0/3488338887 conn(0x7fa9241010f0 msgr2=0x7fa924103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:39.630 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:39.001+0000 7fa92c53e640 1 -- 172.21.15.123:0/3488338887 shutdown_connections 2024-08-18T21:58:39.630 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:39.001+0000 7fa92c53e640 1 -- 172.21.15.123:0/3488338887 wait complete. 2024-08-18T21:58:39.631 INFO:teuthology.orchestra.run.smithi123.stdout:mgr is available 2024-08-18T21:58:40.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:39 smithi123 ceph-mon[18462]: mgrmap e4: x(active, since 2s) 2024-08-18T21:58:40.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:39 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3488338887' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-18T21:58:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-08-18T21:58:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [global] 2024-08-18T21:58:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout fsid = dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:58:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.123:3300,v1:172.21.15.123:6789] 2024-08-18T21:58:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-18T21:58:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-18T21:58:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-18T21:58:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-18T21:58:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-08-18T21:58:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-18T21:58:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-18T21:58:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-08-18T21:58:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [osd] 2024-08-18T21:58:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-18T21:58:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-18T21:58:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-18T21:58:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-18T21:58:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-18T21:58:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.032+0000 7f119ce1c640 1 Processor -- start 2024-08-18T21:58:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.032+0000 7f119ce1c640 1 -- start start 2024-08-18T21:58:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.033+0000 7f119ce1c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1198105bb0 0x7f1198105fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.033+0000 7f119ce1c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1198075530 con 0x7f1198105bb0 2024-08-18T21:58:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.033+0000 7f119659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1198105bb0 0x7f1198105fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.033+0000 7f119659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1198105bb0 0x7f1198105fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39938/0 (socket says 172.21.15.123:39938) 2024-08-18T21:58:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.033+0000 7f119659c640 1 -- 172.21.15.123:0/4059347146 learned_addr learned my addr 172.21.15.123:0/4059347146 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.033+0000 7f119659c640 1 -- 172.21.15.123:0/4059347146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11981064f0 con 0x7f1198105bb0 2024-08-18T21:58:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.034+0000 7f119659c640 1 --2- 172.21.15.123:0/4059347146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1198105bb0 0x7f1198105fb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1188009820 tx=0x7f118802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36853eb17199af08 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.034+0000 7f119559a640 1 -- 172.21.15.123:0/4059347146 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1188037070 con 0x7f1198105bb0 2024-08-18T21:58:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.034+0000 7f119559a640 1 -- 172.21.15.123:0/4059347146 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1188032900 con 0x7f1198105bb0 2024-08-18T21:58:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.034+0000 7f119559a640 1 -- 172.21.15.123:0/4059347146 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1188030850 con 0x7f1198105bb0 2024-08-18T21:58:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.034+0000 7f119ce1c640 1 -- 172.21.15.123:0/4059347146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1198105bb0 msgr2=0x7f1198105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.034+0000 7f119ce1c640 1 --2- 172.21.15.123:0/4059347146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1198105bb0 0x7f1198105fb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1188009820 tx=0x7f118802a270 comp rx=0 tx=0).stop 2024-08-18T21:58:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.035+0000 7f119ce1c640 1 -- 172.21.15.123:0/4059347146 shutdown_connections 2024-08-18T21:58:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.035+0000 7f119ce1c640 1 --2- 172.21.15.123:0/4059347146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1198105bb0 0x7f1198105fb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.035+0000 7f119ce1c640 1 -- 172.21.15.123:0/4059347146 >> 172.21.15.123:0/4059347146 conn(0x7f1198101980 msgr2=0x7f1198103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.035+0000 7f119ce1c640 1 -- 172.21.15.123:0/4059347146 shutdown_connections 2024-08-18T21:58:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.035+0000 7f119ce1c640 1 -- 172.21.15.123:0/4059347146 wait complete. 2024-08-18T21:58:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.035+0000 7f119ce1c640 1 Processor -- start 2024-08-18T21:58:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.035+0000 7f119ce1c640 1 -- start start 2024-08-18T21:58:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.036+0000 7f119ce1c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1198105bb0 0x7f119819d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.036+0000 7f119ce1c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f11981075f0 con 0x7f1198105bb0 2024-08-18T21:58:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.036+0000 7f119659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1198105bb0 0x7f119819d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.036+0000 7f119659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1198105bb0 0x7f119819d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39940/0 (socket says 172.21.15.123:39940) 2024-08-18T21:58:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.036+0000 7f119659c640 1 -- 172.21.15.123:0/3958156056 learned_addr learned my addr 172.21.15.123:0/3958156056 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.036+0000 7f119659c640 1 -- 172.21.15.123:0/3958156056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119819d9f0 con 0x7f1198105bb0 2024-08-18T21:58:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.036+0000 7f119659c640 1 --2- 172.21.15.123:0/3958156056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1198105bb0 0x7f119819d4b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f11880097f0 tx=0x7f1188030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.036+0000 7f118f7fe640 1 -- 172.21.15.123:0/3958156056 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1188037040 con 0x7f1198105bb0 2024-08-18T21:58:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.036+0000 7f118f7fe640 1 -- 172.21.15.123:0/3958156056 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1188040070 con 0x7f1198105bb0 2024-08-18T21:58:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.036+0000 7f119ce1c640 1 -- 172.21.15.123:0/3958156056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119819dc80 con 0x7f1198105bb0 2024-08-18T21:58:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.036+0000 7f118f7fe640 1 -- 172.21.15.123:0/3958156056 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f118803a390 con 0x7f1198105bb0 2024-08-18T21:58:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.036+0000 7f119ce1c640 1 -- 172.21.15.123:0/3958156056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11981a0970 con 0x7f1198105bb0 2024-08-18T21:58:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.037+0000 7f118f7fe640 1 -- 172.21.15.123:0/3958156056 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f118803a5e0 con 0x7f1198105bb0 2024-08-18T21:58:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.037+0000 7f118f7fe640 1 --2- 172.21.15.123:0/3958156056 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f1184038f70 0x7f118403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.037+0000 7f118f7fe640 1 -- 172.21.15.123:0/3958156056 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1188032ab0 con 0x7f1198105bb0 2024-08-18T21:58:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.037+0000 7f1195d9b640 1 --2- 172.21.15.123:0/3958156056 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f1184038f70 0x7f118403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.038+0000 7f119ce1c640 1 -- 172.21.15.123:0/3958156056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1198105fb0 con 0x7f1198105bb0 2024-08-18T21:58:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.038+0000 7f1195d9b640 1 --2- 172.21.15.123:0/3958156056 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f1184038f70 0x7f118403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f11800098c0 tx=0x7f1180006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.042+0000 7f118f7fe640 1 -- 172.21.15.123:0/3958156056 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f118803a8d0 con 0x7f1198105bb0 2024-08-18T21:58:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.209+0000 7f119ce1c640 1 -- 172.21.15.123:0/3958156056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f11981a1fe0 con 0x7f1198105bb0 2024-08-18T21:58:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.210+0000 7f118f7fe640 1 -- 172.21.15.123:0/3958156056 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+431 (secure 0 0 0) 0x7f118802fd60 con 0x7f1198105bb0 2024-08-18T21:58:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.212+0000 7f119ce1c640 1 -- 172.21.15.123:0/3958156056 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f1184038f70 msgr2=0x7f118403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.212+0000 7f119ce1c640 1 --2- 172.21.15.123:0/3958156056 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f1184038f70 0x7f118403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f11800098c0 tx=0x7f1180006db0 comp rx=0 tx=0).stop 2024-08-18T21:58:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.212+0000 7f119ce1c640 1 -- 172.21.15.123:0/3958156056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1198105bb0 msgr2=0x7f119819d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.212+0000 7f119ce1c640 1 --2- 172.21.15.123:0/3958156056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1198105bb0 0x7f119819d4b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f11880097f0 tx=0x7f1188030d80 comp rx=0 tx=0).stop 2024-08-18T21:58:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.212+0000 7f119ce1c640 1 -- 172.21.15.123:0/3958156056 shutdown_connections 2024-08-18T21:58:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.212+0000 7f119ce1c640 1 --2- 172.21.15.123:0/3958156056 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f1184038f70 0x7f118403b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.212+0000 7f119ce1c640 1 --2- 172.21.15.123:0/3958156056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1198105bb0 0x7f119819d4b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.212+0000 7f119ce1c640 1 -- 172.21.15.123:0/3958156056 >> 172.21.15.123:0/3958156056 conn(0x7f1198101980 msgr2=0x7f11981917d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.212+0000 7f119ce1c640 1 -- 172.21.15.123:0/3958156056 shutdown_connections 2024-08-18T21:58:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:40.212+0000 7f119ce1c640 1 -- 172.21.15.123:0/3958156056 wait complete. 2024-08-18T21:58:40.893 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling cephadm module... 2024-08-18T21:58:41.183 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:40 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3958156056' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-18T21:58:42.224 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:41 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2414883227' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-08-18T21:58:42.224 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:41 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: ignoring --setuser ceph since I am not root 2024-08-18T21:58:42.224 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:41 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: ignoring --setgroup ceph since I am not root 2024-08-18T21:58:42.224 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:42 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:42.157+0000 7fe4f7439040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-18T21:58:42.224 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:42 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:42.223+0000 7fe4f7439040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-18T21:58:42.510 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:42 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:42.367+0000 7fe4f7439040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-18T21:58:42.544 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.259+0000 7f4142d11640 1 Processor -- start 2024-08-18T21:58:42.544 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.259+0000 7f4142d11640 1 -- start start 2024-08-18T21:58:42.545 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.259+0000 7f4142d11640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f413c1072e0 0x7f413c1076e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:42.545 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.259+0000 7f4142d11640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f413c107c20 con 0x7f413c1072e0 2024-08-18T21:58:42.545 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.259+0000 7f4140aad640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f413c1072e0 0x7f413c1076e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:42.545 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.259+0000 7f4140aad640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f413c1072e0 0x7f413c1076e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39952/0 (socket says 172.21.15.123:39952) 2024-08-18T21:58:42.545 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.259+0000 7f4140aad640 1 -- 172.21.15.123:0/1653185823 learned_addr learned my addr 172.21.15.123:0/1653185823 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:42.545 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.259+0000 7f4140aad640 1 -- 172.21.15.123:0/1653185823 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413c107da0 con 0x7f413c1072e0 2024-08-18T21:58:42.545 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.260+0000 7f4140aad640 1 --2- 172.21.15.123:0/1653185823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f413c1072e0 0x7f413c1076e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4130009820 tx=0x7f413002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=affd5cf985d34e55 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:42.545 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.260+0000 7f413b7fe640 1 -- 172.21.15.123:0/1653185823 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4130037070 con 0x7f413c1072e0 2024-08-18T21:58:42.545 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.260+0000 7f413b7fe640 1 -- 172.21.15.123:0/1653185823 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4130032900 con 0x7f413c1072e0 2024-08-18T21:58:42.545 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.260+0000 7f413b7fe640 1 -- 172.21.15.123:0/1653185823 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4130030850 con 0x7f413c1072e0 2024-08-18T21:58:42.545 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.261+0000 7f4142d11640 1 -- 172.21.15.123:0/1653185823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f413c1072e0 msgr2=0x7f413c1076e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:42.545 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.261+0000 7f4142d11640 1 --2- 172.21.15.123:0/1653185823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f413c1072e0 0x7f413c1076e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4130009820 tx=0x7f413002a270 comp rx=0 tx=0).stop 2024-08-18T21:58:42.545 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.261+0000 7f4142d11640 1 -- 172.21.15.123:0/1653185823 shutdown_connections 2024-08-18T21:58:42.546 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.261+0000 7f4142d11640 1 --2- 172.21.15.123:0/1653185823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f413c1072e0 0x7f413c1076e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:42.546 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.261+0000 7f4142d11640 1 -- 172.21.15.123:0/1653185823 >> 172.21.15.123:0/1653185823 conn(0x7f413c102b30 msgr2=0x7f413c104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:42.546 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.261+0000 7f4142d11640 1 -- 172.21.15.123:0/1653185823 shutdown_connections 2024-08-18T21:58:42.546 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.261+0000 7f4142d11640 1 -- 172.21.15.123:0/1653185823 wait complete. 2024-08-18T21:58:42.546 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.261+0000 7f4142d11640 1 Processor -- start 2024-08-18T21:58:42.546 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.261+0000 7f4142d11640 1 -- start start 2024-08-18T21:58:42.546 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.262+0000 7f4142d11640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f413c1072e0 0x7f413c19b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:42.546 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.262+0000 7f4142d11640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f413c10b750 con 0x7f413c1072e0 2024-08-18T21:58:42.546 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.262+0000 7f4140aad640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f413c1072e0 0x7f413c19b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:42.546 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.262+0000 7f4140aad640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f413c1072e0 0x7f413c19b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39968/0 (socket says 172.21.15.123:39968) 2024-08-18T21:58:42.546 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.262+0000 7f4140aad640 1 -- 172.21.15.123:0/2414883227 learned_addr learned my addr 172.21.15.123:0/2414883227 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:42.546 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.262+0000 7f4140aad640 1 -- 172.21.15.123:0/2414883227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413c19b7d0 con 0x7f413c1072e0 2024-08-18T21:58:42.547 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.262+0000 7f4140aad640 1 --2- 172.21.15.123:0/2414883227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f413c1072e0 0x7f413c19b290 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4130032ce0 tx=0x7f4130032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:42.547 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.262+0000 7f4139ffb640 1 -- 172.21.15.123:0/2414883227 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4130042070 con 0x7f413c1072e0 2024-08-18T21:58:42.547 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.262+0000 7f4139ffb640 1 -- 172.21.15.123:0/2414883227 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f41300308c0 con 0x7f413c1072e0 2024-08-18T21:58:42.547 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.262+0000 7f4142d11640 1 -- 172.21.15.123:0/2414883227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413c19ba60 con 0x7f413c1072e0 2024-08-18T21:58:42.547 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.262+0000 7f4139ffb640 1 -- 172.21.15.123:0/2414883227 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4130037040 con 0x7f413c1072e0 2024-08-18T21:58:42.547 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.263+0000 7f4142d11640 1 -- 172.21.15.123:0/2414883227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f413c19e750 con 0x7f413c1072e0 2024-08-18T21:58:42.547 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.263+0000 7f4139ffb640 1 -- 172.21.15.123:0/2414883227 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f4130045070 con 0x7f413c1072e0 2024-08-18T21:58:42.547 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.263+0000 7f4142d11640 1 -- 172.21.15.123:0/2414883227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f413c107760 con 0x7f413c1072e0 2024-08-18T21:58:42.547 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.264+0000 7f4139ffb640 1 --2- 172.21.15.123:0/2414883227 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f412c038f20 0x7f412c03b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:42.547 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.264+0000 7f4139ffb640 1 -- 172.21.15.123:0/2414883227 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f413006bfe0 con 0x7f413c1072e0 2024-08-18T21:58:42.547 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.264+0000 7f413bfff640 1 --2- 172.21.15.123:0/2414883227 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f412c038f20 0x7f412c03b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:42.547 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.264+0000 7f413bfff640 1 --2- 172.21.15.123:0/2414883227 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f412c038f20 0x7f412c03b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f41280098c0 tx=0x7f4128006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:42.547 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.268+0000 7f4139ffb640 1 -- 172.21.15.123:0/2414883227 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f413006ba00 con 0x7f413c1072e0 2024-08-18T21:58:42.547 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.480+0000 7f4142d11640 1 -- 172.21.15.123:0/2414883227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f413c19edd0 con 0x7f413c1072e0 2024-08-18T21:58:42.548 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.929+0000 7f4139ffb640 1 -- 172.21.15.123:0/2414883227 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f413003cd50 con 0x7f413c1072e0 2024-08-18T21:58:42.548 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.931+0000 7f4139ffb640 1 -- 172.21.15.123:0/2414883227 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f413003c830 con 0x7f413c1072e0 2024-08-18T21:58:42.548 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.932+0000 7f4142d11640 1 -- 172.21.15.123:0/2414883227 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f412c038f20 msgr2=0x7f412c03b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:42.548 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.932+0000 7f4142d11640 1 --2- 172.21.15.123:0/2414883227 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f412c038f20 0x7f412c03b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f41280098c0 tx=0x7f4128006db0 comp rx=0 tx=0).stop 2024-08-18T21:58:42.548 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.932+0000 7f4142d11640 1 -- 172.21.15.123:0/2414883227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f413c1072e0 msgr2=0x7f413c19b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:42.548 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.932+0000 7f4142d11640 1 --2- 172.21.15.123:0/2414883227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f413c1072e0 0x7f413c19b290 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4130032ce0 tx=0x7f4130032d10 comp rx=0 tx=0).stop 2024-08-18T21:58:42.548 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.933+0000 7f4142d11640 1 -- 172.21.15.123:0/2414883227 shutdown_connections 2024-08-18T21:58:42.548 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.933+0000 7f4142d11640 1 --2- 172.21.15.123:0/2414883227 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f412c038f20 0x7f412c03b3e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:42.548 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.933+0000 7f4142d11640 1 --2- 172.21.15.123:0/2414883227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f413c1072e0 0x7f413c19b290 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:42.548 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.933+0000 7f4142d11640 1 -- 172.21.15.123:0/2414883227 >> 172.21.15.123:0/2414883227 conn(0x7f413c102b30 msgr2=0x7f413c103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:42.548 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.933+0000 7f4142d11640 1 -- 172.21.15.123:0/2414883227 shutdown_connections 2024-08-18T21:58:42.548 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:41.933+0000 7f4142d11640 1 -- 172.21.15.123:0/2414883227 wait complete. 2024-08-18T21:58:42.795 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:42 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:42.525+0000 7fe4f7439040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-18T21:58:42.795 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:42 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:42.674+0000 7fe4f7439040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-18T21:58:43.208 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:42 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2414883227' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-18T21:58:43.208 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:42 smithi123 ceph-mon[18462]: mgrmap e5: x(active, since 5s) 2024-08-18T21:58:43.208 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:42 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:42.800+0000 7fe4f7439040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-18T21:58:43.208 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:42 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:42.925+0000 7fe4f7439040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-18T21:58:43.208 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:42 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:42.984+0000 7fe4f7439040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-18T21:58:43.510 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:43 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:43.301+0000 7fe4f7439040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-18T21:58:43.510 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:43 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:43.363+0000 7fe4f7439040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-18T21:58:43.510 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:43 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:43.434+0000 7fe4f7439040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-18T21:58:43.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-08-18T21:58:43.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-18T21:58:43.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-18T21:58:43.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-18T21:58:43.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-18T21:58:43.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-08-18T21:58:43.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.001+0000 7fbbac867640 1 Processor -- start 2024-08-18T21:58:43.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.001+0000 7fbbac867640 1 -- start start 2024-08-18T21:58:43.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.001+0000 7fbbac867640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8107d40 0x7fbba810a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:43.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.001+0000 7fbbac867640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbba80755b0 con 0x7fbba8107d40 2024-08-18T21:58:43.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.001+0000 7fbba659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8107d40 0x7fbba810a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:43.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.001+0000 7fbba659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8107d40 0x7fbba810a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45642/0 (socket says 172.21.15.123:45642) 2024-08-18T21:58:43.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.001+0000 7fbba659c640 1 -- 172.21.15.123:0/2757207181 learned_addr learned my addr 172.21.15.123:0/2757207181 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:43.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.001+0000 7fbba659c640 1 -- 172.21.15.123:0/2757207181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba810a670 con 0x7fbba8107d40 2024-08-18T21:58:43.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.002+0000 7fbba659c640 1 --2- 172.21.15.123:0/2757207181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8107d40 0x7fbba810a130 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009820 tx=0x7fbb9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47268012c4abcc6d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:43.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.002+0000 7fbba559a640 1 -- 172.21.15.123:0/2757207181 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb98037070 con 0x7fbba8107d40 2024-08-18T21:58:43.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.002+0000 7fbba559a640 1 -- 172.21.15.123:0/2757207181 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb98032900 con 0x7fbba8107d40 2024-08-18T21:58:43.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.002+0000 7fbba559a640 1 -- 172.21.15.123:0/2757207181 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb98030850 con 0x7fbba8107d40 2024-08-18T21:58:43.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.003+0000 7fbbac867640 1 -- 172.21.15.123:0/2757207181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8107d40 msgr2=0x7fbba810a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:43.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.003+0000 7fbbac867640 1 --2- 172.21.15.123:0/2757207181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8107d40 0x7fbba810a130 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009820 tx=0x7fbb9802a270 comp rx=0 tx=0).stop 2024-08-18T21:58:43.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.003+0000 7fbbac867640 1 -- 172.21.15.123:0/2757207181 shutdown_connections 2024-08-18T21:58:43.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.003+0000 7fbbac867640 1 --2- 172.21.15.123:0/2757207181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8107d40 0x7fbba810a130 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:43.815 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.003+0000 7fbbac867640 1 -- 172.21.15.123:0/2757207181 >> 172.21.15.123:0/2757207181 conn(0x7fbba8101980 msgr2=0x7fbba8103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:43.815 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.003+0000 7fbbac867640 1 -- 172.21.15.123:0/2757207181 shutdown_connections 2024-08-18T21:58:43.815 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.003+0000 7fbbac867640 1 -- 172.21.15.123:0/2757207181 wait complete. 2024-08-18T21:58:43.815 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.004+0000 7fbbac867640 1 Processor -- start 2024-08-18T21:58:43.815 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.004+0000 7fbbac867640 1 -- start start 2024-08-18T21:58:43.815 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.004+0000 7fbbac867640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8107d40 0x7fbba819b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:43.815 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.004+0000 7fbbac867640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbba810b710 con 0x7fbba8107d40 2024-08-18T21:58:43.815 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.004+0000 7fbba659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8107d40 0x7fbba819b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:43.815 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.004+0000 7fbba659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8107d40 0x7fbba819b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45644/0 (socket says 172.21.15.123:45644) 2024-08-18T21:58:43.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.004+0000 7fbba659c640 1 -- 172.21.15.123:0/2198775144 learned_addr learned my addr 172.21.15.123:0/2198775144 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:43.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.004+0000 7fbba659c640 1 -- 172.21.15.123:0/2198775144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba819b810 con 0x7fbba8107d40 2024-08-18T21:58:43.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.005+0000 7fbba659c640 1 --2- 172.21.15.123:0/2198775144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8107d40 0x7fbba819b2d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb98032ce0 tx=0x7fbb98032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:43.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.005+0000 7fbb977fe640 1 -- 172.21.15.123:0/2198775144 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb98042070 con 0x7fbba8107d40 2024-08-18T21:58:43.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.005+0000 7fbbac867640 1 -- 172.21.15.123:0/2198775144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba819baa0 con 0x7fbba8107d40 2024-08-18T21:58:43.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.005+0000 7fbb977fe640 1 -- 172.21.15.123:0/2198775144 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb980308c0 con 0x7fbba8107d40 2024-08-18T21:58:43.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.005+0000 7fbbac867640 1 -- 172.21.15.123:0/2198775144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba819e790 con 0x7fbba8107d40 2024-08-18T21:58:43.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.005+0000 7fbb977fe640 1 -- 172.21.15.123:0/2198775144 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb98037040 con 0x7fbba8107d40 2024-08-18T21:58:43.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.006+0000 7fbbac867640 1 -- 172.21.15.123:0/2198775144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba81081a0 con 0x7fbba8107d40 2024-08-18T21:58:43.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.006+0000 7fbb977fe640 1 -- 172.21.15.123:0/2198775144 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fbb98045070 con 0x7fbba8107d40 2024-08-18T21:58:43.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.006+0000 7fbb977fe640 1 --2- 172.21.15.123:0/2198775144 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7fbb90039150 0x7fbb9003b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:43.816 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.006+0000 7fbb977fe640 1 -- 172.21.15.123:0/2198775144 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbb9806bee0 con 0x7fbba8107d40 2024-08-18T21:58:43.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.006+0000 7fbba5d9b640 1 -- 172.21.15.123:0/2198775144 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7fbb90039150 msgr2=0x7fbb9003b610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/1909168969 2024-08-18T21:58:43.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.006+0000 7fbba5d9b640 1 --2- 172.21.15.123:0/2198775144 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7fbb90039150 0x7fbb9003b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:58:43.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.011+0000 7fbb977fe640 1 -- 172.21.15.123:0/2198775144 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbb9806b900 con 0x7fbba8107d40 2024-08-18T21:58:43.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.207+0000 7fbba5d9b640 1 -- 172.21.15.123:0/2198775144 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7fbb90039150 msgr2=0x7fbb9003b610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/1909168969 2024-08-18T21:58:43.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.207+0000 7fbba5d9b640 1 --2- 172.21.15.123:0/2198775144 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7fbb90039150 0x7fbb9003b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:58:43.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.230+0000 7fbbac867640 1 -- 172.21.15.123:0/2198775144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fbba819e960 con 0x7fbba8107d40 2024-08-18T21:58:43.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.230+0000 7fbb977fe640 1 -- 172.21.15.123:0/2198775144 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fbba819e960 con 0x7fbba8107d40 2024-08-18T21:58:43.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.232+0000 7fbbac867640 1 -- 172.21.15.123:0/2198775144 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7fbb90039150 msgr2=0x7fbb9003b610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:58:43.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.232+0000 7fbbac867640 1 --2- 172.21.15.123:0/2198775144 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7fbb90039150 0x7fbb9003b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:43.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.232+0000 7fbbac867640 1 -- 172.21.15.123:0/2198775144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8107d40 msgr2=0x7fbba819b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:43.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.232+0000 7fbbac867640 1 --2- 172.21.15.123:0/2198775144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8107d40 0x7fbba819b2d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb98032ce0 tx=0x7fbb98032d10 comp rx=0 tx=0).stop 2024-08-18T21:58:43.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.232+0000 7fbbac867640 1 -- 172.21.15.123:0/2198775144 shutdown_connections 2024-08-18T21:58:43.817 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.232+0000 7fbbac867640 1 --2- 172.21.15.123:0/2198775144 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7fbb90039150 0x7fbb9003b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:43.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.232+0000 7fbbac867640 1 --2- 172.21.15.123:0/2198775144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbba8107d40 0x7fbba819b2d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:43.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.232+0000 7fbbac867640 1 -- 172.21.15.123:0/2198775144 >> 172.21.15.123:0/2198775144 conn(0x7fbba8101980 msgr2=0x7fbba81024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:43.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.232+0000 7fbbac867640 1 -- 172.21.15.123:0/2198775144 shutdown_connections 2024-08-18T21:58:43.818 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:43.232+0000 7fbbac867640 1 -- 172.21.15.123:0/2198775144 wait complete. 2024-08-18T21:58:43.818 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for the mgr to restart... 2024-08-18T21:58:43.818 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr epoch 5... 2024-08-18T21:58:43.901 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:43 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:43.582+0000 7fe4f7439040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-18T21:58:43.901 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:43 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:43.640+0000 7fe4f7439040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-18T21:58:43.901 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:43 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:43.707+0000 7fe4f7439040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-18T21:58:43.901 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:43 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:43.900+0000 7fe4f7439040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-18T21:58:44.179 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:43 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2198775144' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-18T21:58:44.179 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:43 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:43.962+0000 7fe4f7439040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-18T21:58:44.179 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:44 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:44.021+0000 7fe4f7439040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-18T21:58:44.179 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:44 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:44.091+0000 7fe4f7439040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-18T21:58:44.464 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:44 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:44.308+0000 7fe4f7439040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-18T21:58:44.464 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:44 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:44.366+0000 7fe4f7439040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-18T21:58:45.177 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:44 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:44.873+0000 7fe4f7439040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-18T21:58:45.510 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:45 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:45.176+0000 7fe4f7439040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-18T21:58:46.010 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:45 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:45.586+0000 7fe4f7439040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-18T21:58:46.010 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:45 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:45.642+0000 7fe4f7439040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-18T21:58:46.010 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:45 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:45.700+0000 7fe4f7439040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-18T21:58:47.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: Active manager daemon x restarted 2024-08-18T21:58:47.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: Activating manager daemon x 2024-08-18T21:58:47.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: osdmap e2: 0 total, 0 up, 0 in 2024-08-18T21:58:47.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: mgrmap e6: x(active, starting, since 0.00391582s) 2024-08-18T21:58:47.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T21:58:47.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-18T21:58:47.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-18T21:58:47.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-18T21:58:47.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-18T21:58:47.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: Manager daemon x is now available 2024-08-18T21:58:47.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' 2024-08-18T21:58:47.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' 2024-08-18T21:58:47.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T21:58:47.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T21:58:47.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-18T21:58:47.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:46 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-18T21:58:48.056 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:47 smithi123 ceph-mon[18462]: Found migration_current of "None". Setting to last migration. 2024-08-18T21:58:48.056 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:47 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' 2024-08-18T21:58:48.056 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:47 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' 2024-08-18T21:58:48.057 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:47 smithi123 ceph-mon[18462]: mgrmap e7: x(active, since 1.00515s) 2024-08-18T21:58:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-08-18T21:58:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-18T21:58:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-18T21:58:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-08-18T21:58:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.257+0000 7f58c9047640 1 Processor -- start 2024-08-18T21:58:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.257+0000 7f58c9047640 1 -- start start 2024-08-18T21:58:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.257+0000 7f58c9047640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4107d50 0x7f58c410a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.257+0000 7f58c9047640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f58c40755b0 con 0x7f58c4107d50 2024-08-18T21:58:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.257+0000 7f58c2d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4107d50 0x7f58c410a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.257+0000 7f58c2d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4107d50 0x7f58c410a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45652/0 (socket says 172.21.15.123:45652) 2024-08-18T21:58:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.257+0000 7f58c2d9d640 1 -- 172.21.15.123:0/1605268423 learned_addr learned my addr 172.21.15.123:0/1605268423 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.257+0000 7f58c2d9d640 1 -- 172.21.15.123:0/1605268423 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c410a680 con 0x7f58c4107d50 2024-08-18T21:58:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.258+0000 7f58c2d9d640 1 --2- 172.21.15.123:0/1605268423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4107d50 0x7f58c410a140 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009820 tx=0x7f58b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6a37339af7671c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.258+0000 7f58c1d9b640 1 -- 172.21.15.123:0/1605268423 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58b4037070 con 0x7f58c4107d50 2024-08-18T21:58:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.258+0000 7f58c1d9b640 1 -- 172.21.15.123:0/1605268423 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f58b4032900 con 0x7f58c4107d50 2024-08-18T21:58:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.258+0000 7f58c1d9b640 1 -- 172.21.15.123:0/1605268423 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58b4030850 con 0x7f58c4107d50 2024-08-18T21:58:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.259+0000 7f58c9047640 1 -- 172.21.15.123:0/1605268423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4107d50 msgr2=0x7f58c410a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.259+0000 7f58c9047640 1 --2- 172.21.15.123:0/1605268423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4107d50 0x7f58c410a140 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009820 tx=0x7f58b402a270 comp rx=0 tx=0).stop 2024-08-18T21:58:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.259+0000 7f58c9047640 1 -- 172.21.15.123:0/1605268423 shutdown_connections 2024-08-18T21:58:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.259+0000 7f58c9047640 1 --2- 172.21.15.123:0/1605268423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4107d50 0x7f58c410a140 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.259+0000 7f58c9047640 1 -- 172.21.15.123:0/1605268423 >> 172.21.15.123:0/1605268423 conn(0x7f58c41019d0 msgr2=0x7f58c4103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.259+0000 7f58c9047640 1 -- 172.21.15.123:0/1605268423 shutdown_connections 2024-08-18T21:58:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.259+0000 7f58c9047640 1 -- 172.21.15.123:0/1605268423 wait complete. 2024-08-18T21:58:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.260+0000 7f58c9047640 1 Processor -- start 2024-08-18T21:58:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.260+0000 7f58c9047640 1 -- start start 2024-08-18T21:58:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.260+0000 7f58c9047640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4107d50 0x7f58c419b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.260+0000 7f58c9047640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f58c410b720 con 0x7f58c4107d50 2024-08-18T21:58:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.260+0000 7f58c2d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4107d50 0x7f58c419b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.260+0000 7f58c2d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4107d50 0x7f58c419b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45662/0 (socket says 172.21.15.123:45662) 2024-08-18T21:58:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.260+0000 7f58c2d9d640 1 -- 172.21.15.123:0/1462845743 learned_addr learned my addr 172.21.15.123:0/1462845743 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.261+0000 7f58c2d9d640 1 -- 172.21.15.123:0/1462845743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c419b850 con 0x7f58c4107d50 2024-08-18T21:58:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.261+0000 7f58c2d9d640 1 --2- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4107d50 0x7f58c419b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f58b4031000 tx=0x7f58b40326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.261+0000 7f58abfff640 1 -- 172.21.15.123:0/1462845743 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58b4042070 con 0x7f58c4107d50 2024-08-18T21:58:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.261+0000 7f58c9047640 1 -- 172.21.15.123:0/1462845743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c419bae0 con 0x7f58c4107d50 2024-08-18T21:58:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.261+0000 7f58abfff640 1 -- 172.21.15.123:0/1462845743 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f58b4032be0 con 0x7f58c4107d50 2024-08-18T21:58:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.261+0000 7f58abfff640 1 -- 172.21.15.123:0/1462845743 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58b4037040 con 0x7f58c4107d50 2024-08-18T21:58:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.261+0000 7f58c9047640 1 -- 172.21.15.123:0/1462845743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c419e7d0 con 0x7f58c4107d50 2024-08-18T21:58:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.262+0000 7f58abfff640 1 -- 172.21.15.123:0/1462845743 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f58b4045070 con 0x7f58c4107d50 2024-08-18T21:58:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.262+0000 7f58abfff640 1 --2- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f58ac038f70 0x7f58ac03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.262+0000 7f58abfff640 1 -- 172.21.15.123:0/1462845743 --> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f58ac03bb40 con 0x7f58ac038f70 2024-08-18T21:58:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.262+0000 7f58abfff640 1 -- 172.21.15.123:0/1462845743 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f58b406bfa0 con 0x7f58c4107d50 2024-08-18T21:58:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.262+0000 7f58c259c640 1 -- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f58ac038f70 msgr2=0x7f58ac03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/1909168969 2024-08-18T21:58:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.262+0000 7f58c259c640 1 --2- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f58ac038f70 0x7f58ac03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:58:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.463+0000 7f58c259c640 1 -- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f58ac038f70 msgr2=0x7f58ac03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/1909168969 2024-08-18T21:58:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.463+0000 7f58c259c640 1 --2- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f58ac038f70 0x7f58ac03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:58:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.864+0000 7f58c259c640 1 -- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f58ac038f70 msgr2=0x7f58ac03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/1909168969 2024-08-18T21:58:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:44.864+0000 7f58c259c640 1 --2- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f58ac038f70 0x7f58ac03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:58:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:45.665+0000 7f58c259c640 1 -- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f58ac038f70 msgr2=0x7f58ac03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/1909168969 2024-08-18T21:58:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:45.665+0000 7f58c259c640 1 --2- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f58ac038f70 0x7f58ac03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:58:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:46.764+0000 7f58abfff640 1 -- 172.21.15.123:0/1462845743 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f58b406aa60 con 0x7f58c4107d50 2024-08-18T21:58:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:46.764+0000 7f58abfff640 1 -- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f58ac038f70 msgr2=0x7f58ac03b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:58:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:46.764+0000 7f58abfff640 1 --2- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f58ac038f70 0x7f58ac03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.764+0000 7f58abfff640 1 -- 172.21.15.123:0/1462845743 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f58b403cb30 con 0x7f58c4107d50 2024-08-18T21:58:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.764+0000 7f58abfff640 1 --2- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f58ac03c8a0 0x7f58ac03ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.765+0000 7f58abfff640 1 -- 172.21.15.123:0/1462845743 --> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f58ac03bb40 con 0x7f58ac03c8a0 2024-08-18T21:58:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.765+0000 7f58c259c640 1 --2- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f58ac03c8a0 0x7f58ac03ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.765+0000 7f58c259c640 1 --2- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f58ac03c8a0 0x7f58ac03ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f58b8003980 tx=0x7f58b8006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.766+0000 7f58abfff640 1 -- 172.21.15.123:0/1462845743 <== mgr.14118 v2:172.21.15.123:6800/4048905381 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f58ac03bb40 con 0x7f58ac03c8a0 2024-08-18T21:58:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.773+0000 7f58c9047640 1 -- 172.21.15.123:0/1462845743 --> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f58c41081b0 con 0x7f58ac03c8a0 2024-08-18T21:58:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.773+0000 7f58abfff640 1 -- 172.21.15.123:0/1462845743 <== mgr.14118 v2:172.21.15.123:6800/4048905381 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f58c41081b0 con 0x7f58ac03c8a0 2024-08-18T21:58:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.773+0000 7f58c9047640 1 -- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f58ac03c8a0 msgr2=0x7f58ac03ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.773+0000 7f58c9047640 1 --2- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f58ac03c8a0 0x7f58ac03ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f58b8003980 tx=0x7f58b8006e10 comp rx=0 tx=0).stop 2024-08-18T21:58:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.773+0000 7f58c9047640 1 -- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4107d50 msgr2=0x7f58c419b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.773+0000 7f58c9047640 1 --2- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4107d50 0x7f58c419b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f58b4031000 tx=0x7f58b40326e0 comp rx=0 tx=0).stop 2024-08-18T21:58:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.773+0000 7f58c9047640 1 -- 172.21.15.123:0/1462845743 shutdown_connections 2024-08-18T21:58:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.773+0000 7f58c9047640 1 --2- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f58ac03c8a0 0x7f58ac03ec90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.773+0000 7f58c9047640 1 --2- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:6800/1909168969,v1:172.21.15.123:6801/1909168969] conn(0x7f58ac038f70 0x7f58ac03b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.773+0000 7f58c9047640 1 --2- 172.21.15.123:0/1462845743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4107d50 0x7f58c419b310 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.773+0000 7f58c9047640 1 -- 172.21.15.123:0/1462845743 >> 172.21.15.123:0/1462845743 conn(0x7f58c41019d0 msgr2=0x7f58c41025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.774+0000 7f58c9047640 1 -- 172.21.15.123:0/1462845743 shutdown_connections 2024-08-18T21:58:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:47.774+0000 7f58c9047640 1 -- 172.21.15.123:0/1462845743 wait complete. 2024-08-18T21:58:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:mgr epoch 5 is available 2024-08-18T21:58:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:Setting orchestrator backend to cephadm... 2024-08-18T21:58:48.826 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-mon[18462]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-18T21:58:48.826 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-mon[18462]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-18T21:58:48.826 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T21:58:48.826 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:48.679+0000 7fe45e947640 -1 log_channel(cephadm) log [ERR] : [18/Aug/2024:21:58:48] ENGINE Error in HTTPServer.serve 2024-08-18T21:58:48.827 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: Traceback (most recent call last): 2024-08-18T21:58:48.827 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-18T21:58:48.827 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: self._connections.run(self.expiration_interval) 2024-08-18T21:58:48.827 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-18T21:58:48.827 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: self._run(expiration_interval) 2024-08-18T21:58:48.827 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-18T21:58:48.827 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: new_conn = self._from_server_socket(self.server.socket) 2024-08-18T21:58:48.827 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-18T21:58:48.827 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-18T21:58:48.827 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-18T21:58:48.827 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: s = self.context.wrap_socket( 2024-08-18T21:58:48.827 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-18T21:58:48.827 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: return self.sslsocket_class._create( 2024-08-18T21:58:48.827 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-18T21:58:48.828 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: self.do_handshake() 2024-08-18T21:58:48.828 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-18T21:58:48.828 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: self._sslobj.do_handshake() 2024-08-18T21:58:48.828 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-18T21:58:48.828 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:58:49.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.736+0000 7fa4b2d45640 1 Processor -- start 2024-08-18T21:58:49.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.736+0000 7fa4b2d45640 1 -- start start 2024-08-18T21:58:49.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.736+0000 7fa4b2d45640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ac1061d0 0x7fa4ac1065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:49.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.736+0000 7fa4b2d45640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac106ba0 con 0x7fa4ac1061d0 2024-08-18T21:58:49.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.737+0000 7fa4b0ae1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ac1061d0 0x7fa4ac1065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:49.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.737+0000 7fa4b0ae1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ac1061d0 0x7fa4ac1065d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45714/0 (socket says 172.21.15.123:45714) 2024-08-18T21:58:49.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.737+0000 7fa4b0ae1640 1 -- 172.21.15.123:0/1646733954 learned_addr learned my addr 172.21.15.123:0/1646733954 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:49.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.737+0000 7fa4b0ae1640 1 -- 172.21.15.123:0/1646733954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ac107380 con 0x7fa4ac1061d0 2024-08-18T21:58:49.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.737+0000 7fa4b0ae1640 1 --2- 172.21.15.123:0/1646733954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ac1061d0 0x7fa4ac1065d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009820 tx=0x7fa49c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1b909c44f9ab50 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:49.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.738+0000 7fa4ab7fe640 1 -- 172.21.15.123:0/1646733954 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa49c037070 con 0x7fa4ac1061d0 2024-08-18T21:58:49.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.738+0000 7fa4ab7fe640 1 -- 172.21.15.123:0/1646733954 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa49c032900 con 0x7fa4ac1061d0 2024-08-18T21:58:49.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.738+0000 7fa4ab7fe640 1 -- 172.21.15.123:0/1646733954 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa49c030850 con 0x7fa4ac1061d0 2024-08-18T21:58:49.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.738+0000 7fa4b2d45640 1 -- 172.21.15.123:0/1646733954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ac1061d0 msgr2=0x7fa4ac1065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:49.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.738+0000 7fa4b2d45640 1 --2- 172.21.15.123:0/1646733954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ac1061d0 0x7fa4ac1065d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009820 tx=0x7fa49c02a270 comp rx=0 tx=0).stop 2024-08-18T21:58:49.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.738+0000 7fa4b2d45640 1 -- 172.21.15.123:0/1646733954 shutdown_connections 2024-08-18T21:58:49.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.738+0000 7fa4b2d45640 1 --2- 172.21.15.123:0/1646733954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ac1061d0 0x7fa4ac1065d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:49.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.738+0000 7fa4b2d45640 1 -- 172.21.15.123:0/1646733954 >> 172.21.15.123:0/1646733954 conn(0x7fa4ac1019e0 msgr2=0x7fa4ac103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:49.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.738+0000 7fa4b2d45640 1 -- 172.21.15.123:0/1646733954 shutdown_connections 2024-08-18T21:58:49.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.738+0000 7fa4b2d45640 1 -- 172.21.15.123:0/1646733954 wait complete. 2024-08-18T21:58:49.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.739+0000 7fa4b2d45640 1 Processor -- start 2024-08-18T21:58:49.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.739+0000 7fa4b2d45640 1 -- start start 2024-08-18T21:58:49.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.739+0000 7fa4b2d45640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ac1061d0 0x7fa4ac19b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:49.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.739+0000 7fa4b2d45640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac10a730 con 0x7fa4ac1061d0 2024-08-18T21:58:49.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.739+0000 7fa4b0ae1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ac1061d0 0x7fa4ac19b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:49.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.739+0000 7fa4b0ae1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ac1061d0 0x7fa4ac19b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45718/0 (socket says 172.21.15.123:45718) 2024-08-18T21:58:49.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.739+0000 7fa4b0ae1640 1 -- 172.21.15.123:0/2894891913 learned_addr learned my addr 172.21.15.123:0/2894891913 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:49.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.739+0000 7fa4b0ae1640 1 -- 172.21.15.123:0/2894891913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ac19b850 con 0x7fa4ac1061d0 2024-08-18T21:58:49.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.739+0000 7fa4b0ae1640 1 --2- 172.21.15.123:0/2894891913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ac1061d0 0x7fa4ac19b310 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009940 tx=0x7fa49c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:49.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.740+0000 7fa4a9ffb640 1 -- 172.21.15.123:0/2894891913 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa49c042070 con 0x7fa4ac1061d0 2024-08-18T21:58:49.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.740+0000 7fa4a9ffb640 1 -- 172.21.15.123:0/2894891913 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa49c0308c0 con 0x7fa4ac1061d0 2024-08-18T21:58:49.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.740+0000 7fa4b2d45640 1 -- 172.21.15.123:0/2894891913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4ac19bae0 con 0x7fa4ac1061d0 2024-08-18T21:58:49.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.740+0000 7fa4a9ffb640 1 -- 172.21.15.123:0/2894891913 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa49c037040 con 0x7fa4ac1061d0 2024-08-18T21:58:49.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.740+0000 7fa4b2d45640 1 -- 172.21.15.123:0/2894891913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4ac19e7d0 con 0x7fa4ac1061d0 2024-08-18T21:58:49.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.741+0000 7fa4a9ffb640 1 -- 172.21.15.123:0/2894891913 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fa49c045070 con 0x7fa4ac1061d0 2024-08-18T21:58:49.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.741+0000 7fa4b2d45640 1 -- 172.21.15.123:0/2894891913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4ac10a8b0 con 0x7fa4ac1061d0 2024-08-18T21:58:49.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.741+0000 7fa4a9ffb640 1 --2- 172.21.15.123:0/2894891913 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fa494038e60 0x7fa49403b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:49.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.741+0000 7fa4a9ffb640 1 -- 172.21.15.123:0/2894891913 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa49c06be70 con 0x7fa4ac1061d0 2024-08-18T21:58:49.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.741+0000 7fa4abfff640 1 --2- 172.21.15.123:0/2894891913 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fa494038e60 0x7fa49403b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:49.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.741+0000 7fa4abfff640 1 --2- 172.21.15.123:0/2894891913 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fa494038e60 0x7fa49403b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00098c0 tx=0x7fa4a0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:49.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.746+0000 7fa4a9ffb640 1 -- 172.21.15.123:0/2894891913 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa49c03cd90 con 0x7fa4ac1061d0 2024-08-18T21:58:49.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.825+0000 7fa4a9ffb640 1 -- 172.21.15.123:0/2894891913 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa49c0327b0 con 0x7fa4ac1061d0 2024-08-18T21:58:49.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.930+0000 7fa4b2d45640 1 -- 172.21.15.123:0/2894891913 --> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fa4ac02d850 con 0x7fa494038e60 2024-08-18T21:58:49.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.938+0000 7fa4a9ffb640 1 -- 172.21.15.123:0/2894891913 <== mgr.14118 v2:172.21.15.123:6800/4048905381 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa4ac02d850 con 0x7fa494038e60 2024-08-18T21:58:49.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.940+0000 7fa4b2d45640 1 -- 172.21.15.123:0/2894891913 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fa494038e60 msgr2=0x7fa49403b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:49.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.940+0000 7fa4b2d45640 1 --2- 172.21.15.123:0/2894891913 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fa494038e60 0x7fa49403b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00098c0 tx=0x7fa4a0006db0 comp rx=0 tx=0).stop 2024-08-18T21:58:49.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.940+0000 7fa4b2d45640 1 -- 172.21.15.123:0/2894891913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ac1061d0 msgr2=0x7fa4ac19b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:49.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.940+0000 7fa4b2d45640 1 --2- 172.21.15.123:0/2894891913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ac1061d0 0x7fa4ac19b310 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009940 tx=0x7fa49c032ce0 comp rx=0 tx=0).stop 2024-08-18T21:58:49.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.940+0000 7fa4b2d45640 1 -- 172.21.15.123:0/2894891913 shutdown_connections 2024-08-18T21:58:49.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.940+0000 7fa4b2d45640 1 --2- 172.21.15.123:0/2894891913 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fa494038e60 0x7fa49403b320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:49.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.940+0000 7fa4b2d45640 1 --2- 172.21.15.123:0/2894891913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ac1061d0 0x7fa4ac19b310 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:49.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.940+0000 7fa4b2d45640 1 -- 172.21.15.123:0/2894891913 >> 172.21.15.123:0/2894891913 conn(0x7fa4ac1019e0 msgr2=0x7fa4ac1028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:49.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.940+0000 7fa4b2d45640 1 -- 172.21.15.123:0/2894891913 shutdown_connections 2024-08-18T21:58:49.527 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:48.940+0000 7fa4b2d45640 1 -- 172.21.15.123:0/2894891913 wait complete. 2024-08-18T21:58:50.136 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:49 smithi123 ceph-mon[18462]: [18/Aug/2024:21:58:48] ENGINE Bus STARTING 2024-08-18T21:58:50.136 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:49 smithi123 ceph-mon[18462]: [18/Aug/2024:21:58:48] ENGINE Serving on http://172.21.15.123:8765 2024-08-18T21:58:50.136 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:49 smithi123 ceph-mon[18462]: [18/Aug/2024:21:58:48] ENGINE Serving on https://172.21.15.123:7150 2024-08-18T21:58:50.136 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:49 smithi123 ceph-mon[18462]: [18/Aug/2024:21:58:48] ENGINE Bus STARTED 2024-08-18T21:58:50.136 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:49 smithi123 ceph-mon[18462]: [18/Aug/2024:21:58:48] ENGINE Error in HTTPServer.serve 2024-08-18T21:58:50.136 INFO:journalctl@ceph.mon.a.smithi123.stdout: Traceback (most recent call last): 2024-08-18T21:58:50.137 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-18T21:58:50.137 INFO:journalctl@ceph.mon.a.smithi123.stdout: self._connections.run(self.expiration_interval) 2024-08-18T21:58:50.137 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-18T21:58:50.137 INFO:journalctl@ceph.mon.a.smithi123.stdout: self._run(expiration_interval) 2024-08-18T21:58:50.137 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-18T21:58:50.137 INFO:journalctl@ceph.mon.a.smithi123.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-18T21:58:50.137 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-18T21:58:50.137 INFO:journalctl@ceph.mon.a.smithi123.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-18T21:58:50.137 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-18T21:58:50.137 INFO:journalctl@ceph.mon.a.smithi123.stdout: s = self.context.wrap_socket( 2024-08-18T21:58:50.137 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-18T21:58:50.137 INFO:journalctl@ceph.mon.a.smithi123.stdout: return self.sslsocket_class._create( 2024-08-18T21:58:50.137 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-18T21:58:50.138 INFO:journalctl@ceph.mon.a.smithi123.stdout: self.do_handshake() 2024-08-18T21:58:50.138 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-18T21:58:50.138 INFO:journalctl@ceph.mon.a.smithi123.stdout: self._sslobj.do_handshake() 2024-08-18T21:58:50.138 INFO:journalctl@ceph.mon.a.smithi123.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-18T21:58:50.138 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:49 smithi123 ceph-mon[18462]: mgrmap e8: x(active, since 2s) 2024-08-18T21:58:50.138 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:49 smithi123 ceph-mon[18462]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T21:58:50.138 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:49 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' 2024-08-18T21:58:50.138 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:49 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T21:58:50.711 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-18T21:58:50.711 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.954+0000 7f7dcce47640 1 Processor -- start 2024-08-18T21:58:50.711 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.954+0000 7f7dcce47640 1 -- start start 2024-08-18T21:58:50.711 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.955+0000 7f7dcce47640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc8107d80 0x7f7dc810a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:50.711 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.955+0000 7f7dcce47640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc807bdf0 con 0x7f7dc8107d80 2024-08-18T21:58:50.711 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.955+0000 7f7dc659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc8107d80 0x7f7dc810a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:50.711 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.955+0000 7f7dc659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc8107d80 0x7f7dc810a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45728/0 (socket says 172.21.15.123:45728) 2024-08-18T21:58:50.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.955+0000 7f7dc659c640 1 -- 172.21.15.123:0/4165418879 learned_addr learned my addr 172.21.15.123:0/4165418879 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:50.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.955+0000 7f7dc659c640 1 -- 172.21.15.123:0/4165418879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc810a6b0 con 0x7f7dc8107d80 2024-08-18T21:58:50.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.956+0000 7f7dc659c640 1 --2- 172.21.15.123:0/4165418879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc8107d80 0x7f7dc810a170 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7db0009820 tx=0x7f7db002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9026926ee817807e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:50.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.956+0000 7f7dc559a640 1 -- 172.21.15.123:0/4165418879 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db0037070 con 0x7f7dc8107d80 2024-08-18T21:58:50.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.956+0000 7f7dc559a640 1 -- 172.21.15.123:0/4165418879 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7db0032900 con 0x7f7dc8107d80 2024-08-18T21:58:50.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.956+0000 7f7dc559a640 1 -- 172.21.15.123:0/4165418879 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db0030850 con 0x7f7dc8107d80 2024-08-18T21:58:50.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.957+0000 7f7dcce47640 1 -- 172.21.15.123:0/4165418879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc8107d80 msgr2=0x7f7dc810a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:50.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.957+0000 7f7dcce47640 1 --2- 172.21.15.123:0/4165418879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc8107d80 0x7f7dc810a170 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7db0009820 tx=0x7f7db002a270 comp rx=0 tx=0).stop 2024-08-18T21:58:50.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.957+0000 7f7dcce47640 1 -- 172.21.15.123:0/4165418879 shutdown_connections 2024-08-18T21:58:50.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.957+0000 7f7dcce47640 1 --2- 172.21.15.123:0/4165418879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc8107d80 0x7f7dc810a170 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:50.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.957+0000 7f7dcce47640 1 -- 172.21.15.123:0/4165418879 >> 172.21.15.123:0/4165418879 conn(0x7f7dc8101980 msgr2=0x7f7dc8103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:50.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.957+0000 7f7dcce47640 1 -- 172.21.15.123:0/4165418879 shutdown_connections 2024-08-18T21:58:50.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.957+0000 7f7dcce47640 1 -- 172.21.15.123:0/4165418879 wait complete. 2024-08-18T21:58:50.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.957+0000 7f7dcce47640 1 Processor -- start 2024-08-18T21:58:50.713 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.957+0000 7f7dcce47640 1 -- start start 2024-08-18T21:58:50.713 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.958+0000 7f7dcce47640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc8107d80 0x7f7dc819b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:50.713 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.958+0000 7f7dcce47640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc810b6f0 con 0x7f7dc8107d80 2024-08-18T21:58:50.713 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.958+0000 7f7dc659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc8107d80 0x7f7dc819b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:50.713 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.958+0000 7f7dc659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc8107d80 0x7f7dc819b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45744/0 (socket says 172.21.15.123:45744) 2024-08-18T21:58:50.713 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.958+0000 7f7dc659c640 1 -- 172.21.15.123:0/261236743 learned_addr learned my addr 172.21.15.123:0/261236743 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:50.713 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.958+0000 7f7dc659c640 1 -- 172.21.15.123:0/261236743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc819b810 con 0x7f7dc8107d80 2024-08-18T21:58:50.713 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.958+0000 7f7dc659c640 1 --2- 172.21.15.123:0/261236743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc8107d80 0x7f7dc819b2d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7db0031000 tx=0x7f7db00326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:50.713 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.958+0000 7f7dbf7fe640 1 -- 172.21.15.123:0/261236743 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db0042070 con 0x7f7dc8107d80 2024-08-18T21:58:50.713 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.958+0000 7f7dbf7fe640 1 -- 172.21.15.123:0/261236743 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7db0032be0 con 0x7f7dc8107d80 2024-08-18T21:58:50.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.958+0000 7f7dcce47640 1 -- 172.21.15.123:0/261236743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc819baa0 con 0x7f7dc8107d80 2024-08-18T21:58:50.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.958+0000 7f7dbf7fe640 1 -- 172.21.15.123:0/261236743 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db0037040 con 0x7f7dc8107d80 2024-08-18T21:58:50.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.958+0000 7f7dcce47640 1 -- 172.21.15.123:0/261236743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc819e790 con 0x7f7dc8107d80 2024-08-18T21:58:50.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.959+0000 7f7dbf7fe640 1 -- 172.21.15.123:0/261236743 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7db0045070 con 0x7f7dc8107d80 2024-08-18T21:58:50.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.959+0000 7f7dbf7fe640 1 --2- 172.21.15.123:0/261236743 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f7db4038f70 0x7f7db403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:50.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.959+0000 7f7dbf7fe640 1 -- 172.21.15.123:0/261236743 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7db006c230 con 0x7f7dc8107d80 2024-08-18T21:58:50.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.959+0000 7f7dcce47640 1 -- 172.21.15.123:0/261236743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc81081e0 con 0x7f7dc8107d80 2024-08-18T21:58:50.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.959+0000 7f7dc5d9b640 1 --2- 172.21.15.123:0/261236743 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f7db4038f70 0x7f7db403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:50.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.960+0000 7f7dc5d9b640 1 --2- 172.21.15.123:0/261236743 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f7db4038f70 0x7f7db403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7db80098c0 tx=0x7f7db8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:50.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:49.964+0000 7f7dbf7fe640 1 -- 172.21.15.123:0/261236743 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7db004c030 con 0x7f7dc8107d80 2024-08-18T21:58:50.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:50.135+0000 7f7dcce47640 1 -- 172.21.15.123:0/261236743 --> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f7dc8102c40 con 0x7f7db4038f70 2024-08-18T21:58:50.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:50.135+0000 7f7dbf7fe640 1 -- 172.21.15.123:0/261236743 <== mgr.14118 v2:172.21.15.123:6800/4048905381 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f7dc8102c40 con 0x7f7db4038f70 2024-08-18T21:58:50.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:50.138+0000 7f7dcce47640 1 -- 172.21.15.123:0/261236743 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f7db4038f70 msgr2=0x7f7db403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:50.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:50.138+0000 7f7dcce47640 1 --2- 172.21.15.123:0/261236743 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f7db4038f70 0x7f7db403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7db80098c0 tx=0x7f7db8006db0 comp rx=0 tx=0).stop 2024-08-18T21:58:50.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:50.138+0000 7f7dcce47640 1 -- 172.21.15.123:0/261236743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc8107d80 msgr2=0x7f7dc819b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:50.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:50.138+0000 7f7dcce47640 1 --2- 172.21.15.123:0/261236743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc8107d80 0x7f7dc819b2d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7db0031000 tx=0x7f7db00326e0 comp rx=0 tx=0).stop 2024-08-18T21:58:50.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:50.138+0000 7f7dcce47640 1 -- 172.21.15.123:0/261236743 shutdown_connections 2024-08-18T21:58:50.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:50.138+0000 7f7dcce47640 1 --2- 172.21.15.123:0/261236743 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f7db4038f70 0x7f7db403b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:50.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:50.138+0000 7f7dcce47640 1 --2- 172.21.15.123:0/261236743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc8107d80 0x7f7dc819b2d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:50.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:50.138+0000 7f7dcce47640 1 -- 172.21.15.123:0/261236743 >> 172.21.15.123:0/261236743 conn(0x7f7dc8101980 msgr2=0x7f7dc8102530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:50.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:50.138+0000 7f7dcce47640 1 -- 172.21.15.123:0/261236743 shutdown_connections 2024-08-18T21:58:50.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:50.139+0000 7f7dcce47640 1 -- 172.21.15.123:0/261236743 wait complete. 2024-08-18T21:58:50.716 INFO:teuthology.orchestra.run.smithi123.stdout:Generating ssh key... 2024-08-18T21:58:51.315 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-mon[18462]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T21:58:51.892 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: Generating public/private rsa key pair. 2024-08-18T21:58:51.892 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: Your identification has been saved in /tmp/tmpgganm65v/key 2024-08-18T21:58:51.892 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: Your public key has been saved in /tmp/tmpgganm65v/key.pub 2024-08-18T21:58:51.892 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: The key fingerprint is: 2024-08-18T21:58:51.892 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: SHA256:ANwV9X17UPPxMldAy0RXI7KSVoQU1ZK4+fiH3F7gtd8 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:58:51.892 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: The key's randomart image is: 2024-08-18T21:58:51.892 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: +---[RSA 3072]----+ 2024-08-18T21:58:51.893 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: | ... .+=B=o+==*| 2024-08-18T21:58:51.893 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: | ... oo+o=.+B| 2024-08-18T21:58:51.893 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: | . +o.o B =| 2024-08-18T21:58:51.893 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: | ..o. *.| 2024-08-18T21:58:51.893 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: | S o . o.| 2024-08-18T21:58:51.893 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: | . .. o o| 2024-08-18T21:58:51.893 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: | o o. o | 2024-08-18T21:58:51.893 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: | + o. o| 2024-08-18T21:58:51.893 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: | o. E| 2024-08-18T21:58:51.893 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:58:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: +----[SHA256]-----+ 2024-08-18T21:58:52.166 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.139+0000 7fca9940c640 1 Processor -- start 2024-08-18T21:58:52.166 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.139+0000 7fca9940c640 1 -- start start 2024-08-18T21:58:52.167 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.139+0000 7fca9940c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca94107d90 0x7fca9410a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:52.167 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.139+0000 7fca9940c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fca9407bda0 con 0x7fca94107d90 2024-08-18T21:58:52.167 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.139+0000 7fca92ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca94107d90 0x7fca9410a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:52.167 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.139+0000 7fca92ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca94107d90 0x7fca9410a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45746/0 (socket says 172.21.15.123:45746) 2024-08-18T21:58:52.167 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.139+0000 7fca92ffd640 1 -- 172.21.15.123:0/4247077652 learned_addr learned my addr 172.21.15.123:0/4247077652 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:52.167 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.139+0000 7fca92ffd640 1 -- 172.21.15.123:0/4247077652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9410a6c0 con 0x7fca94107d90 2024-08-18T21:58:52.167 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.140+0000 7fca92ffd640 1 --2- 172.21.15.123:0/4247077652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca94107d90 0x7fca9410a180 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fca84009820 tx=0x7fca8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4dc318ef540423 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:52.167 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.140+0000 7fca91ffb640 1 -- 172.21.15.123:0/4247077652 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca84037070 con 0x7fca94107d90 2024-08-18T21:58:52.167 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.140+0000 7fca91ffb640 1 -- 172.21.15.123:0/4247077652 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca84032900 con 0x7fca94107d90 2024-08-18T21:58:52.167 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.140+0000 7fca91ffb640 1 -- 172.21.15.123:0/4247077652 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca84030850 con 0x7fca94107d90 2024-08-18T21:58:52.167 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.141+0000 7fca9940c640 1 -- 172.21.15.123:0/4247077652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca94107d90 msgr2=0x7fca9410a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:52.168 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.141+0000 7fca9940c640 1 --2- 172.21.15.123:0/4247077652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca94107d90 0x7fca9410a180 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fca84009820 tx=0x7fca8402a270 comp rx=0 tx=0).stop 2024-08-18T21:58:52.168 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.141+0000 7fca9940c640 1 -- 172.21.15.123:0/4247077652 shutdown_connections 2024-08-18T21:58:52.168 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.141+0000 7fca9940c640 1 --2- 172.21.15.123:0/4247077652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca94107d90 0x7fca9410a180 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:52.168 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.141+0000 7fca9940c640 1 -- 172.21.15.123:0/4247077652 >> 172.21.15.123:0/4247077652 conn(0x7fca941019b0 msgr2=0x7fca94103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:52.168 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.141+0000 7fca9940c640 1 -- 172.21.15.123:0/4247077652 shutdown_connections 2024-08-18T21:58:52.168 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.141+0000 7fca9940c640 1 -- 172.21.15.123:0/4247077652 wait complete. 2024-08-18T21:58:52.168 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.141+0000 7fca9940c640 1 Processor -- start 2024-08-18T21:58:52.168 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.141+0000 7fca9940c640 1 -- start start 2024-08-18T21:58:52.168 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.142+0000 7fca9940c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca94107d90 0x7fca9419b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:52.168 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.142+0000 7fca9940c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fca9410b6a0 con 0x7fca94107d90 2024-08-18T21:58:52.168 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.142+0000 7fca92ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca94107d90 0x7fca9419b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:52.168 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.142+0000 7fca92ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca94107d90 0x7fca9419b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45758/0 (socket says 172.21.15.123:45758) 2024-08-18T21:58:52.168 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.142+0000 7fca92ffd640 1 -- 172.21.15.123:0/2111582875 learned_addr learned my addr 172.21.15.123:0/2111582875 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:52.168 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.142+0000 7fca92ffd640 1 -- 172.21.15.123:0/2111582875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9419b7a0 con 0x7fca94107d90 2024-08-18T21:58:52.169 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.142+0000 7fca92ffd640 1 --2- 172.21.15.123:0/2111582875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca94107d90 0x7fca9419b260 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fca840097f0 tx=0x7fca84030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:52.169 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.142+0000 7fca7bfff640 1 -- 172.21.15.123:0/2111582875 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca84037040 con 0x7fca94107d90 2024-08-18T21:58:52.169 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.142+0000 7fca9940c640 1 -- 172.21.15.123:0/2111582875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca9419ba30 con 0x7fca94107d90 2024-08-18T21:58:52.169 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.142+0000 7fca7bfff640 1 -- 172.21.15.123:0/2111582875 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca84040070 con 0x7fca94107d90 2024-08-18T21:58:52.169 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.142+0000 7fca7bfff640 1 -- 172.21.15.123:0/2111582875 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca8403a390 con 0x7fca94107d90 2024-08-18T21:58:52.169 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.142+0000 7fca9940c640 1 -- 172.21.15.123:0/2111582875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca9419e720 con 0x7fca94107d90 2024-08-18T21:58:52.169 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.143+0000 7fca7bfff640 1 -- 172.21.15.123:0/2111582875 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fca8403b430 con 0x7fca94107d90 2024-08-18T21:58:52.169 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.144+0000 7fca9940c640 1 -- 172.21.15.123:0/2111582875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca941081f0 con 0x7fca94107d90 2024-08-18T21:58:52.169 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.144+0000 7fca7bfff640 1 --2- 172.21.15.123:0/2111582875 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fca7c038f70 0x7fca7c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:52.169 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.144+0000 7fca7bfff640 1 -- 172.21.15.123:0/2111582875 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fca8406c490 con 0x7fca94107d90 2024-08-18T21:58:52.169 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.144+0000 7fca927fc640 1 --2- 172.21.15.123:0/2111582875 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fca7c038f70 0x7fca7c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:52.169 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.144+0000 7fca927fc640 1 --2- 172.21.15.123:0/2111582875 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fca7c038f70 0x7fca7c03b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca880098c0 tx=0x7fca88006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:52.169 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.148+0000 7fca7bfff640 1 -- 172.21.15.123:0/2111582875 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fca84032900 con 0x7fca94107d90 2024-08-18T21:58:52.170 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.314+0000 7fca9940c640 1 -- 172.21.15.123:0/2111582875 --> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fca94102c40 con 0x7fca7c038f70 2024-08-18T21:58:52.170 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.597+0000 7fca7bfff640 1 -- 172.21.15.123:0/2111582875 <== mgr.14118 v2:172.21.15.123:6800/4048905381 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fca94102c40 con 0x7fca7c038f70 2024-08-18T21:58:52.170 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.599+0000 7fca9940c640 1 -- 172.21.15.123:0/2111582875 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fca7c038f70 msgr2=0x7fca7c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:52.170 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.599+0000 7fca9940c640 1 --2- 172.21.15.123:0/2111582875 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fca7c038f70 0x7fca7c03b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca880098c0 tx=0x7fca88006db0 comp rx=0 tx=0).stop 2024-08-18T21:58:52.170 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.599+0000 7fca9940c640 1 -- 172.21.15.123:0/2111582875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca94107d90 msgr2=0x7fca9419b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:52.170 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.599+0000 7fca9940c640 1 --2- 172.21.15.123:0/2111582875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca94107d90 0x7fca9419b260 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fca840097f0 tx=0x7fca84030d80 comp rx=0 tx=0).stop 2024-08-18T21:58:52.170 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.599+0000 7fca9940c640 1 -- 172.21.15.123:0/2111582875 shutdown_connections 2024-08-18T21:58:52.170 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.599+0000 7fca9940c640 1 --2- 172.21.15.123:0/2111582875 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fca7c038f70 0x7fca7c03b430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:52.170 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.599+0000 7fca9940c640 1 --2- 172.21.15.123:0/2111582875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca94107d90 0x7fca9419b260 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:52.170 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.599+0000 7fca9940c640 1 -- 172.21.15.123:0/2111582875 >> 172.21.15.123:0/2111582875 conn(0x7fca941019b0 msgr2=0x7fca94102530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:52.170 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.599+0000 7fca9940c640 1 -- 172.21.15.123:0/2111582875 shutdown_connections 2024-08-18T21:58:52.170 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:51.599+0000 7fca9940c640 1 -- 172.21.15.123:0/2111582875 wait complete. 2024-08-18T21:58:52.715 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:52 smithi123 ceph-mon[18462]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T21:58:52.716 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:52 smithi123 ceph-mon[18462]: Generating ssh key... 2024-08-18T21:58:52.716 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:52 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' 2024-08-18T21:58:52.716 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:52 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' 2024-08-18T21:58:53.272 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzgsMJTbP8dMdSaAchB9+jlgCA1FJEYQz0RTIVf3DVZ1DN2+Un24QJntyYJ41m6C9+lSsQQztV5BUul8Ybmv0H63VqUAw8r+5ejFaaf+SfK4AlCgPjqYgR0aEwQL4rRUcLuXNYeUxEUSod3bScIJFtvfMMIuvqXVTVb+mmmLk7QvorrQAIAy1FH2M5sJf7JxNc/zArovneGquwsKNdeePKilLN2OL91FD20nniFxan6ltWgyjRfq8QdgShB2okyN69h4D70se2LRYvHDTo86UcKgM099TKWB13t+OrgMs54xZF3vDssmaauXgSpxs9R3RwgizvK2ebDgeB6Wj+C589UtpkeqE/qSzOs0Pf9llbMXkZIhAlUY7NkjeKJLNDBl4JBNGzylwkAI2lnQ2CD5KFTalTR8bFZdjZZCF/nD9Zfl4hktbroLYD//zY9vhuGiGCnXfOhreB5R7SSD+XTawlyF1L8TAwH5GeH7Tlk30Nj4/Y7bDn25Qoczlt4WXCurk= ceph-dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:58:53.272 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.536+0000 7f768a955640 1 Processor -- start 2024-08-18T21:58:53.273 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.536+0000 7f768a955640 1 -- start start 2024-08-18T21:58:53.273 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.537+0000 7f768a955640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7684107d80 0x7f768410a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:53.273 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.537+0000 7f768a955640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f768407bdc0 con 0x7f7684107d80 2024-08-18T21:58:53.273 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.537+0000 7f7683fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7684107d80 0x7f768410a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:53.273 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.537+0000 7f7683fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7684107d80 0x7f768410a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45764/0 (socket says 172.21.15.123:45764) 2024-08-18T21:58:53.273 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.537+0000 7f7683fff640 1 -- 172.21.15.123:0/1406640600 learned_addr learned my addr 172.21.15.123:0/1406640600 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:53.273 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.537+0000 7f7683fff640 1 -- 172.21.15.123:0/1406640600 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768410a6b0 con 0x7f7684107d80 2024-08-18T21:58:53.273 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.538+0000 7f7683fff640 1 --2- 172.21.15.123:0/1406640600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7684107d80 0x7f768410a170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7674009820 tx=0x7f767402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cab8b8f32023c0c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:53.273 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.538+0000 7f76837fe640 1 -- 172.21.15.123:0/1406640600 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7674037070 con 0x7f7684107d80 2024-08-18T21:58:53.273 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.538+0000 7f76837fe640 1 -- 172.21.15.123:0/1406640600 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7674032900 con 0x7f7684107d80 2024-08-18T21:58:53.273 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.538+0000 7f76837fe640 1 -- 172.21.15.123:0/1406640600 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7674030850 con 0x7f7684107d80 2024-08-18T21:58:53.273 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.538+0000 7f768a955640 1 -- 172.21.15.123:0/1406640600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7684107d80 msgr2=0x7f768410a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:53.273 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.538+0000 7f768a955640 1 --2- 172.21.15.123:0/1406640600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7684107d80 0x7f768410a170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7674009820 tx=0x7f767402a270 comp rx=0 tx=0).stop 2024-08-18T21:58:53.273 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.539+0000 7f768a955640 1 -- 172.21.15.123:0/1406640600 shutdown_connections 2024-08-18T21:58:53.274 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.539+0000 7f768a955640 1 --2- 172.21.15.123:0/1406640600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7684107d80 0x7f768410a170 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:53.274 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.539+0000 7f768a955640 1 -- 172.21.15.123:0/1406640600 >> 172.21.15.123:0/1406640600 conn(0x7f76841019e0 msgr2=0x7f7684103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:53.274 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.539+0000 7f768a955640 1 -- 172.21.15.123:0/1406640600 shutdown_connections 2024-08-18T21:58:53.274 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.539+0000 7f768a955640 1 -- 172.21.15.123:0/1406640600 wait complete. 2024-08-18T21:58:53.274 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.539+0000 7f768a955640 1 Processor -- start 2024-08-18T21:58:53.274 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.539+0000 7f768a955640 1 -- start start 2024-08-18T21:58:53.274 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.539+0000 7f768a955640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7684107d80 0x7f768419b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:53.274 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.539+0000 7f768a955640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f768410b690 con 0x7f7684107d80 2024-08-18T21:58:53.274 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.540+0000 7f7683fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7684107d80 0x7f768419b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:53.274 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.540+0000 7f7683fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7684107d80 0x7f768419b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45768/0 (socket says 172.21.15.123:45768) 2024-08-18T21:58:53.274 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.540+0000 7f7683fff640 1 -- 172.21.15.123:0/519654371 learned_addr learned my addr 172.21.15.123:0/519654371 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:53.274 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.540+0000 7f7683fff640 1 -- 172.21.15.123:0/519654371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768419b7b0 con 0x7f7684107d80 2024-08-18T21:58:53.275 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.540+0000 7f7683fff640 1 --2- 172.21.15.123:0/519654371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7684107d80 0x7f768419b270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7674032ce0 tx=0x7f7674032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:53.275 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.540+0000 7f7681ffb640 1 -- 172.21.15.123:0/519654371 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7674042070 con 0x7f7684107d80 2024-08-18T21:58:53.275 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.540+0000 7f7681ffb640 1 -- 172.21.15.123:0/519654371 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76740308c0 con 0x7f7684107d80 2024-08-18T21:58:53.275 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.540+0000 7f768a955640 1 -- 172.21.15.123:0/519654371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f768419ba40 con 0x7f7684107d80 2024-08-18T21:58:53.275 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.540+0000 7f7681ffb640 1 -- 172.21.15.123:0/519654371 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7674037040 con 0x7f7684107d80 2024-08-18T21:58:53.275 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.540+0000 7f768a955640 1 -- 172.21.15.123:0/519654371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f768419e730 con 0x7f7684107d80 2024-08-18T21:58:53.275 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.541+0000 7f7681ffb640 1 -- 172.21.15.123:0/519654371 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7674045070 con 0x7f7684107d80 2024-08-18T21:58:53.275 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.541+0000 7f768a955640 1 -- 172.21.15.123:0/519654371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76841081e0 con 0x7f7684107d80 2024-08-18T21:58:53.275 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.541+0000 7f7681ffb640 1 --2- 172.21.15.123:0/519654371 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f7670038fc0 0x7f767003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:53.275 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.541+0000 7f7681ffb640 1 -- 172.21.15.123:0/519654371 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f767406c220 con 0x7f7684107d80 2024-08-18T21:58:53.275 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.541+0000 7f767bfff640 1 --2- 172.21.15.123:0/519654371 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f7670038fc0 0x7f767003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:53.275 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.542+0000 7f767bfff640 1 --2- 172.21.15.123:0/519654371 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f7670038fc0 0x7f767003b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f766c0098c0 tx=0x7f766c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:53.275 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.546+0000 7f7681ffb640 1 -- 172.21.15.123:0/519654371 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7674045360 con 0x7f7684107d80 2024-08-18T21:58:53.276 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.714+0000 7f768a955640 1 -- 172.21.15.123:0/519654371 --> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f7684102cb0 con 0x7f7670038fc0 2024-08-18T21:58:53.276 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.715+0000 7f7681ffb640 1 -- 172.21.15.123:0/519654371 <== mgr.14118 v2:172.21.15.123:6800/4048905381 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f7684102cb0 con 0x7f7670038fc0 2024-08-18T21:58:53.276 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.717+0000 7f768a955640 1 -- 172.21.15.123:0/519654371 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f7670038fc0 msgr2=0x7f767003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:53.276 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.717+0000 7f768a955640 1 --2- 172.21.15.123:0/519654371 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f7670038fc0 0x7f767003b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f766c0098c0 tx=0x7f766c006db0 comp rx=0 tx=0).stop 2024-08-18T21:58:53.276 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.717+0000 7f768a955640 1 -- 172.21.15.123:0/519654371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7684107d80 msgr2=0x7f768419b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:53.276 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.717+0000 7f768a955640 1 --2- 172.21.15.123:0/519654371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7684107d80 0x7f768419b270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7674032ce0 tx=0x7f7674032d10 comp rx=0 tx=0).stop 2024-08-18T21:58:53.276 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.717+0000 7f768a955640 1 -- 172.21.15.123:0/519654371 shutdown_connections 2024-08-18T21:58:53.276 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.717+0000 7f768a955640 1 --2- 172.21.15.123:0/519654371 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f7670038fc0 0x7f767003b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:53.276 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.717+0000 7f768a955640 1 --2- 172.21.15.123:0/519654371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7684107d80 0x7f768419b270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:53.276 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.717+0000 7f768a955640 1 -- 172.21.15.123:0/519654371 >> 172.21.15.123:0/519654371 conn(0x7f76841019e0 msgr2=0x7f76841025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:53.277 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.717+0000 7f768a955640 1 -- 172.21.15.123:0/519654371 shutdown_connections 2024-08-18T21:58:53.277 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:52.717+0000 7f768a955640 1 -- 172.21.15.123:0/519654371 wait complete. 2024-08-18T21:58:53.277 INFO:teuthology.orchestra.run.smithi123.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-18T21:58:53.277 INFO:teuthology.orchestra.run.smithi123.stdout:Adding key to root@localhost authorized_keys... 2024-08-18T21:58:53.280 INFO:teuthology.orchestra.run.smithi123.stdout:Adding host smithi123... 2024-08-18T21:58:53.817 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:53 smithi123 ceph-mon[18462]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T21:58:54.622 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:54 smithi123 ceph-mon[18462]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi123", "addr": "172.21.15.123", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T21:58:56.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:55 smithi123 ceph-mon[18462]: Deploying cephadm binary to smithi123 2024-08-18T21:58:57.540 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Added host 'smithi123' with addr '172.21.15.123' 2024-08-18T21:58:57.540 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.637+0000 7f8c6acb6640 1 Processor -- start 2024-08-18T21:58:57.540 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.637+0000 7f8c6acb6640 1 -- start start 2024-08-18T21:58:57.541 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.637+0000 7f8c6acb6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c64107da0 0x7f8c6410a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:57.541 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.637+0000 7f8c6acb6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8c64075550 con 0x7f8c64107da0 2024-08-18T21:58:57.541 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.638+0000 7f8c68a52640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c64107da0 0x7f8c6410a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:57.541 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.638+0000 7f8c68a52640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c64107da0 0x7f8c6410a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50798/0 (socket says 172.21.15.123:50798) 2024-08-18T21:58:57.541 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.638+0000 7f8c68a52640 1 -- 172.21.15.123:0/2933929181 learned_addr learned my addr 172.21.15.123:0/2933929181 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:57.541 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.638+0000 7f8c68a52640 1 -- 172.21.15.123:0/2933929181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6410a6d0 con 0x7f8c64107da0 2024-08-18T21:58:57.541 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.638+0000 7f8c68a52640 1 --2- 172.21.15.123:0/2933929181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c64107da0 0x7f8c6410a190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009e80 tx=0x7f8c5402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c04bf1f8758544 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:57.541 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.639+0000 7f8c637fe640 1 -- 172.21.15.123:0/2933929181 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c54036070 con 0x7f8c64107da0 2024-08-18T21:58:57.541 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.639+0000 7f8c637fe640 1 -- 172.21.15.123:0/2933929181 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c540318c0 con 0x7f8c64107da0 2024-08-18T21:58:57.541 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.639+0000 7f8c637fe640 1 -- 172.21.15.123:0/2933929181 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c54007ab0 con 0x7f8c64107da0 2024-08-18T21:58:57.541 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.639+0000 7f8c6acb6640 1 -- 172.21.15.123:0/2933929181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c64107da0 msgr2=0x7f8c6410a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:57.541 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.639+0000 7f8c6acb6640 1 --2- 172.21.15.123:0/2933929181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c64107da0 0x7f8c6410a190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009e80 tx=0x7f8c5402a7a0 comp rx=0 tx=0).stop 2024-08-18T21:58:57.541 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.639+0000 7f8c6acb6640 1 -- 172.21.15.123:0/2933929181 shutdown_connections 2024-08-18T21:58:57.542 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.639+0000 7f8c6acb6640 1 --2- 172.21.15.123:0/2933929181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c64107da0 0x7f8c6410a190 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:57.542 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.639+0000 7f8c6acb6640 1 -- 172.21.15.123:0/2933929181 >> 172.21.15.123:0/2933929181 conn(0x7f8c64101980 msgr2=0x7f8c64103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:57.542 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.639+0000 7f8c6acb6640 1 -- 172.21.15.123:0/2933929181 shutdown_connections 2024-08-18T21:58:57.542 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.639+0000 7f8c6acb6640 1 -- 172.21.15.123:0/2933929181 wait complete. 2024-08-18T21:58:57.542 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.640+0000 7f8c6acb6640 1 Processor -- start 2024-08-18T21:58:57.542 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.640+0000 7f8c6acb6640 1 -- start start 2024-08-18T21:58:57.542 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.640+0000 7f8c6acb6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c64107da0 0x7f8c6419b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:57.542 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.640+0000 7f8c6acb6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6410b710 con 0x7f8c64107da0 2024-08-18T21:58:57.542 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.640+0000 7f8c68a52640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c64107da0 0x7f8c6419b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:57.542 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.640+0000 7f8c68a52640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c64107da0 0x7f8c6419b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50802/0 (socket says 172.21.15.123:50802) 2024-08-18T21:58:57.542 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.640+0000 7f8c68a52640 1 -- 172.21.15.123:0/1231115936 learned_addr learned my addr 172.21.15.123:0/1231115936 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:57.542 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.640+0000 7f8c68a52640 1 -- 172.21.15.123:0/1231115936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6419b810 con 0x7f8c64107da0 2024-08-18T21:58:57.543 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.640+0000 7f8c68a52640 1 --2- 172.21.15.123:0/1231115936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c64107da0 0x7f8c6419b2d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8c5402acc0 tx=0x7f8c54031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:57.543 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.641+0000 7f8c61ffb640 1 -- 172.21.15.123:0/1231115936 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c54036050 con 0x7f8c64107da0 2024-08-18T21:58:57.543 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.641+0000 7f8c61ffb640 1 -- 172.21.15.123:0/1231115936 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c54037040 con 0x7f8c64107da0 2024-08-18T21:58:57.543 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.641+0000 7f8c61ffb640 1 -- 172.21.15.123:0/1231115936 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c5403d850 con 0x7f8c64107da0 2024-08-18T21:58:57.543 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.641+0000 7f8c6acb6640 1 -- 172.21.15.123:0/1231115936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c6419baa0 con 0x7f8c64107da0 2024-08-18T21:58:57.543 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.641+0000 7f8c6acb6640 1 -- 172.21.15.123:0/1231115936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c6419e790 con 0x7f8c64107da0 2024-08-18T21:58:57.543 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.642+0000 7f8c61ffb640 1 -- 172.21.15.123:0/1231115936 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f8c54044020 con 0x7f8c64107da0 2024-08-18T21:58:57.543 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.642+0000 7f8c6acb6640 1 -- 172.21.15.123:0/1231115936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c64108200 con 0x7f8c64107da0 2024-08-18T21:58:57.543 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.642+0000 7f8c61ffb640 1 --2- 172.21.15.123:0/1231115936 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f8c50038fc0 0x7f8c5003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:57.543 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.642+0000 7f8c61ffb640 1 -- 172.21.15.123:0/1231115936 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8c54042020 con 0x7f8c64107da0 2024-08-18T21:58:57.543 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.642+0000 7f8c63fff640 1 --2- 172.21.15.123:0/1231115936 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f8c50038fc0 0x7f8c5003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:57.543 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.642+0000 7f8c63fff640 1 --2- 172.21.15.123:0/1231115936 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f8c50038fc0 0x7f8c5003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0098c0 tx=0x7f8c4c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:57.543 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.646+0000 7f8c61ffb640 1 -- 172.21.15.123:0/1231115936 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f8c5404b020 con 0x7f8c64107da0 2024-08-18T21:58:57.544 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:53.816+0000 7f8c6acb6640 1 -- 172.21.15.123:0/1231115936 --> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi123", "addr": "172.21.15.123", "target": ["mon-mgr", ""]}) -- 0x7f8c64102bd0 con 0x7f8c50038fc0 2024-08-18T21:58:57.544 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.017+0000 7f8c61ffb640 1 -- 172.21.15.123:0/1231115936 <== mgr.14118 v2:172.21.15.123:6800/4048905381 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f8c64102bd0 con 0x7f8c50038fc0 2024-08-18T21:58:57.544 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.021+0000 7f8c6acb6640 1 -- 172.21.15.123:0/1231115936 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f8c50038fc0 msgr2=0x7f8c5003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:57.544 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.021+0000 7f8c6acb6640 1 --2- 172.21.15.123:0/1231115936 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f8c50038fc0 0x7f8c5003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0098c0 tx=0x7f8c4c006db0 comp rx=0 tx=0).stop 2024-08-18T21:58:57.544 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.021+0000 7f8c6acb6640 1 -- 172.21.15.123:0/1231115936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c64107da0 msgr2=0x7f8c6419b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:57.544 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.021+0000 7f8c6acb6640 1 --2- 172.21.15.123:0/1231115936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c64107da0 0x7f8c6419b2d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8c5402acc0 tx=0x7f8c54031ca0 comp rx=0 tx=0).stop 2024-08-18T21:58:57.544 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.021+0000 7f8c6acb6640 1 -- 172.21.15.123:0/1231115936 shutdown_connections 2024-08-18T21:58:57.544 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.021+0000 7f8c6acb6640 1 --2- 172.21.15.123:0/1231115936 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f8c50038fc0 0x7f8c5003b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:57.544 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.021+0000 7f8c6acb6640 1 --2- 172.21.15.123:0/1231115936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c64107da0 0x7f8c6419b2d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:57.544 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.021+0000 7f8c6acb6640 1 -- 172.21.15.123:0/1231115936 >> 172.21.15.123:0/1231115936 conn(0x7f8c64101980 msgr2=0x7f8c641024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:57.544 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.021+0000 7f8c6acb6640 1 -- 172.21.15.123:0/1231115936 shutdown_connections 2024-08-18T21:58:57.544 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.022+0000 7f8c6acb6640 1 -- 172.21.15.123:0/1231115936 wait complete. 2024-08-18T21:58:57.544 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying unmanaged mon service... 2024-08-18T21:58:58.259 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:58 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' 2024-08-18T21:58:58.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:58 smithi123 ceph-mon[18462]: Added host smithi123 2024-08-18T21:58:58.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:58 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T21:58:58.907 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-18T21:58:58.908 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.937+0000 7f82d99cd640 1 Processor -- start 2024-08-18T21:58:58.908 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.937+0000 7f82d99cd640 1 -- start start 2024-08-18T21:58:58.908 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.937+0000 7f82d99cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d4105bd0 0x7f82d4105fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:58.908 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.937+0000 7f82d99cd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f82d407bd60 con 0x7f82d4105bd0 2024-08-18T21:58:58.908 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.937+0000 7f82d2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d4105bd0 0x7f82d4105fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:58.908 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.937+0000 7f82d2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d4105bd0 0x7f82d4105fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50810/0 (socket says 172.21.15.123:50810) 2024-08-18T21:58:58.908 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.937+0000 7f82d2ffd640 1 -- 172.21.15.123:0/455717627 learned_addr learned my addr 172.21.15.123:0/455717627 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:58.908 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.937+0000 7f82d2ffd640 1 -- 172.21.15.123:0/455717627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d4106510 con 0x7f82d4105bd0 2024-08-18T21:58:58.908 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.938+0000 7f82d2ffd640 1 --2- 172.21.15.123:0/455717627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d4105bd0 0x7f82d4105fd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009820 tx=0x7f82c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a65e66e6670817 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:58.908 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.938+0000 7f82d27fc640 1 -- 172.21.15.123:0/455717627 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82c4037070 con 0x7f82d4105bd0 2024-08-18T21:58:58.908 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.938+0000 7f82d27fc640 1 -- 172.21.15.123:0/455717627 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f82c4032900 con 0x7f82d4105bd0 2024-08-18T21:58:58.908 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.938+0000 7f82d27fc640 1 -- 172.21.15.123:0/455717627 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82c4030850 con 0x7f82d4105bd0 2024-08-18T21:58:58.908 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.939+0000 7f82d99cd640 1 -- 172.21.15.123:0/455717627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d4105bd0 msgr2=0x7f82d4105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:58.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.939+0000 7f82d99cd640 1 --2- 172.21.15.123:0/455717627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d4105bd0 0x7f82d4105fd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009820 tx=0x7f82c402a270 comp rx=0 tx=0).stop 2024-08-18T21:58:58.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.939+0000 7f82d99cd640 1 -- 172.21.15.123:0/455717627 shutdown_connections 2024-08-18T21:58:58.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.939+0000 7f82d99cd640 1 --2- 172.21.15.123:0/455717627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d4105bd0 0x7f82d4105fd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:58.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.939+0000 7f82d99cd640 1 -- 172.21.15.123:0/455717627 >> 172.21.15.123:0/455717627 conn(0x7f82d41019e0 msgr2=0x7f82d4103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:58.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.939+0000 7f82d99cd640 1 -- 172.21.15.123:0/455717627 shutdown_connections 2024-08-18T21:58:58.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.939+0000 7f82d99cd640 1 -- 172.21.15.123:0/455717627 wait complete. 2024-08-18T21:58:58.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.940+0000 7f82d99cd640 1 Processor -- start 2024-08-18T21:58:58.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.940+0000 7f82d99cd640 1 -- start start 2024-08-18T21:58:58.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.940+0000 7f82d99cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d4105bd0 0x7f82d419d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:58.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.940+0000 7f82d99cd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f82d4107610 con 0x7f82d4105bd0 2024-08-18T21:58:58.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.940+0000 7f82d2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d4105bd0 0x7f82d419d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:58.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.940+0000 7f82d2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d4105bd0 0x7f82d419d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50820/0 (socket says 172.21.15.123:50820) 2024-08-18T21:58:58.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.940+0000 7f82d2ffd640 1 -- 172.21.15.123:0/340853118 learned_addr learned my addr 172.21.15.123:0/340853118 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:58:58.909 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.940+0000 7f82d2ffd640 1 -- 172.21.15.123:0/340853118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d419d980 con 0x7f82d4105bd0 2024-08-18T21:58:58.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.940+0000 7f82d2ffd640 1 --2- 172.21.15.123:0/340853118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d4105bd0 0x7f82d419d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f82c4032ce0 tx=0x7f82c4032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:58.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.940+0000 7f82d89cb640 1 -- 172.21.15.123:0/340853118 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82c4042070 con 0x7f82d4105bd0 2024-08-18T21:58:58.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.940+0000 7f82d89cb640 1 -- 172.21.15.123:0/340853118 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f82c40308c0 con 0x7f82d4105bd0 2024-08-18T21:58:58.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.940+0000 7f82d89cb640 1 -- 172.21.15.123:0/340853118 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82c4037040 con 0x7f82d4105bd0 2024-08-18T21:58:58.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.940+0000 7f82d99cd640 1 -- 172.21.15.123:0/340853118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d419dc10 con 0x7f82d4105bd0 2024-08-18T21:58:58.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.941+0000 7f82d99cd640 1 -- 172.21.15.123:0/340853118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d41a0900 con 0x7f82d4105bd0 2024-08-18T21:58:58.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.941+0000 7f82d89cb640 1 -- 172.21.15.123:0/340853118 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f82c4045070 con 0x7f82d4105bd0 2024-08-18T21:58:58.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.941+0000 7f82d99cd640 1 -- 172.21.15.123:0/340853118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d4105fd0 con 0x7f82d4105bd0 2024-08-18T21:58:58.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.942+0000 7f82d89cb640 1 --2- 172.21.15.123:0/340853118 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f82c0038f70 0x7f82c003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:58:58.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.942+0000 7f82d89cb640 1 -- 172.21.15.123:0/340853118 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f82c406c050 con 0x7f82d4105bd0 2024-08-18T21:58:58.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.942+0000 7f82cbfff640 1 --2- 172.21.15.123:0/340853118 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f82c0038f70 0x7f82c003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:58:58.910 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.942+0000 7f82cbfff640 1 --2- 172.21.15.123:0/340853118 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f82c0038f70 0x7f82c003b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0098c0 tx=0x7f82bc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:58:58.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:57.946+0000 7f82d89cb640 1 -- 172.21.15.123:0/340853118 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f82c404b170 con 0x7f82d4105bd0 2024-08-18T21:58:58.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:58.135+0000 7f82d99cd640 1 -- 172.21.15.123:0/340853118 --> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f82d402d8d0 con 0x7f82c0038f70 2024-08-18T21:58:58.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:58.140+0000 7f82d89cb640 1 -- 172.21.15.123:0/340853118 <== mgr.14118 v2:172.21.15.123:6800/4048905381 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f82d402d8d0 con 0x7f82c0038f70 2024-08-18T21:58:58.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:58.142+0000 7f82d99cd640 1 -- 172.21.15.123:0/340853118 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f82c0038f70 msgr2=0x7f82c003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:58.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:58.142+0000 7f82d99cd640 1 --2- 172.21.15.123:0/340853118 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f82c0038f70 0x7f82c003b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0098c0 tx=0x7f82bc006db0 comp rx=0 tx=0).stop 2024-08-18T21:58:58.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:58.142+0000 7f82d99cd640 1 -- 172.21.15.123:0/340853118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d4105bd0 msgr2=0x7f82d419d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:58:58.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:58.142+0000 7f82d99cd640 1 --2- 172.21.15.123:0/340853118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d4105bd0 0x7f82d419d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f82c4032ce0 tx=0x7f82c4032d10 comp rx=0 tx=0).stop 2024-08-18T21:58:58.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:58.142+0000 7f82d99cd640 1 -- 172.21.15.123:0/340853118 shutdown_connections 2024-08-18T21:58:58.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:58.142+0000 7f82d99cd640 1 --2- 172.21.15.123:0/340853118 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f82c0038f70 0x7f82c003b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:58.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:58.142+0000 7f82d99cd640 1 --2- 172.21.15.123:0/340853118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d4105bd0 0x7f82d419d440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:58:58.911 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:58.142+0000 7f82d99cd640 1 -- 172.21.15.123:0/340853118 >> 172.21.15.123:0/340853118 conn(0x7f82d41019e0 msgr2=0x7f82d4194120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:58:58.912 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:58.142+0000 7f82d99cd640 1 -- 172.21.15.123:0/340853118 shutdown_connections 2024-08-18T21:58:58.912 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:58.142+0000 7f82d99cd640 1 -- 172.21.15.123:0/340853118 wait complete. 2024-08-18T21:58:58.912 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying unmanaged mgr service... 2024-08-18T21:58:59.177 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:59 smithi123 ceph-mon[18462]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T21:58:59.177 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:59 smithi123 ceph-mon[18462]: Saving service mon spec with placement count:5 2024-08-18T21:58:59.177 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:58:59 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' 2024-08-18T21:59:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-18T21:59:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.253+0000 7f1a80f8c640 1 Processor -- start 2024-08-18T21:59:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.253+0000 7f1a80f8c640 1 -- start start 2024-08-18T21:59:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.253+0000 7f1a80f8c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a7c1055a0 0x7f1a7c1059a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.253+0000 7f1a80f8c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c105f70 con 0x7f1a7c1055a0 2024-08-18T21:59:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.253+0000 7f1a7a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a7c1055a0 0x7f1a7c1059a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.253+0000 7f1a7a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a7c1055a0 0x7f1a7c1059a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50824/0 (socket says 172.21.15.123:50824) 2024-08-18T21:59:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.253+0000 7f1a7a59c640 1 -- 172.21.15.123:0/1119478197 learned_addr learned my addr 172.21.15.123:0/1119478197 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.253+0000 7f1a7a59c640 1 -- 172.21.15.123:0/1119478197 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7c108580 con 0x7f1a7c1055a0 2024-08-18T21:59:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.254+0000 7f1a7a59c640 1 --2- 172.21.15.123:0/1119478197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a7c1055a0 0x7f1a7c1059a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c009820 tx=0x7f1a6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc3737f549b071b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.254+0000 7f1a79d9b640 1 -- 172.21.15.123:0/1119478197 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a6c037070 con 0x7f1a7c1055a0 2024-08-18T21:59:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.254+0000 7f1a79d9b640 1 -- 172.21.15.123:0/1119478197 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1a6c032900 con 0x7f1a7c1055a0 2024-08-18T21:59:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.254+0000 7f1a79d9b640 1 -- 172.21.15.123:0/1119478197 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a6c030850 con 0x7f1a7c1055a0 2024-08-18T21:59:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.255+0000 7f1a80f8c640 1 -- 172.21.15.123:0/1119478197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a7c1055a0 msgr2=0x7f1a7c1059a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.255+0000 7f1a80f8c640 1 --2- 172.21.15.123:0/1119478197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a7c1055a0 0x7f1a7c1059a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c009820 tx=0x7f1a6c02a270 comp rx=0 tx=0).stop 2024-08-18T21:59:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.255+0000 7f1a80f8c640 1 -- 172.21.15.123:0/1119478197 shutdown_connections 2024-08-18T21:59:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.255+0000 7f1a80f8c640 1 --2- 172.21.15.123:0/1119478197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a7c1055a0 0x7f1a7c1059a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.255+0000 7f1a80f8c640 1 -- 172.21.15.123:0/1119478197 >> 172.21.15.123:0/1119478197 conn(0x7f1a7c1010f0 msgr2=0x7f1a7c103530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.255+0000 7f1a80f8c640 1 -- 172.21.15.123:0/1119478197 shutdown_connections 2024-08-18T21:59:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.255+0000 7f1a80f8c640 1 -- 172.21.15.123:0/1119478197 wait complete. 2024-08-18T21:59:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.255+0000 7f1a80f8c640 1 Processor -- start 2024-08-18T21:59:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.256+0000 7f1a80f8c640 1 -- start start 2024-08-18T21:59:00.350 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.256+0000 7f1a80f8c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a7c1055a0 0x7f1a7c19b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.256+0000 7f1a80f8c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c10b7b0 con 0x7f1a7c1055a0 2024-08-18T21:59:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.256+0000 7f1a7a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a7c1055a0 0x7f1a7c19b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.256+0000 7f1a7a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a7c1055a0 0x7f1a7c19b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50840/0 (socket says 172.21.15.123:50840) 2024-08-18T21:59:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.256+0000 7f1a7a59c640 1 -- 172.21.15.123:0/2495897238 learned_addr learned my addr 172.21.15.123:0/2495897238 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.256+0000 7f1a7a59c640 1 -- 172.21.15.123:0/2495897238 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7c19b820 con 0x7f1a7c1055a0 2024-08-18T21:59:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.256+0000 7f1a7a59c640 1 --2- 172.21.15.123:0/2495897238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a7c1055a0 0x7f1a7c19b2e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0097f0 tx=0x7f1a6c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.256+0000 7f1a737fe640 1 -- 172.21.15.123:0/2495897238 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a6c037040 con 0x7f1a7c1055a0 2024-08-18T21:59:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.256+0000 7f1a737fe640 1 -- 172.21.15.123:0/2495897238 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1a6c040070 con 0x7f1a7c1055a0 2024-08-18T21:59:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.256+0000 7f1a80f8c640 1 -- 172.21.15.123:0/2495897238 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a7c19bab0 con 0x7f1a7c1055a0 2024-08-18T21:59:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.256+0000 7f1a737fe640 1 -- 172.21.15.123:0/2495897238 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a6c03a390 con 0x7f1a7c1055a0 2024-08-18T21:59:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.256+0000 7f1a80f8c640 1 -- 172.21.15.123:0/2495897238 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a7c19e7a0 con 0x7f1a7c1055a0 2024-08-18T21:59:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.257+0000 7f1a737fe640 1 -- 172.21.15.123:0/2495897238 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f1a6c03a630 con 0x7f1a7c1055a0 2024-08-18T21:59:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.257+0000 7f1a80f8c640 1 -- 172.21.15.123:0/2495897238 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a7c105a20 con 0x7f1a7c1055a0 2024-08-18T21:59:00.351 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.257+0000 7f1a737fe640 1 --2- 172.21.15.123:0/2495897238 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f1a68038f70 0x7f1a6803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.257+0000 7f1a737fe640 1 -- 172.21.15.123:0/2495897238 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1a6c06c5f0 con 0x7f1a7c1055a0 2024-08-18T21:59:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.257+0000 7f1a73fff640 1 --2- 172.21.15.123:0/2495897238 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f1a68038f70 0x7f1a6803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.258+0000 7f1a73fff640 1 --2- 172.21.15.123:0/2495897238 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f1a68038f70 0x7f1a6803b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1a640098c0 tx=0x7f1a64006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.262+0000 7f1a737fe640 1 -- 172.21.15.123:0/2495897238 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1a6c03b5a0 con 0x7f1a7c1055a0 2024-08-18T21:59:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.444+0000 7f1a80f8c640 1 -- 172.21.15.123:0/2495897238 --> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f1a7c102360 con 0x7f1a68038f70 2024-08-18T21:59:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.449+0000 7f1a737fe640 1 -- 172.21.15.123:0/2495897238 <== mgr.14118 v2:172.21.15.123:6800/4048905381 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1a7c102360 con 0x7f1a68038f70 2024-08-18T21:59:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.451+0000 7f1a80f8c640 1 -- 172.21.15.123:0/2495897238 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f1a68038f70 msgr2=0x7f1a6803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.451+0000 7f1a80f8c640 1 --2- 172.21.15.123:0/2495897238 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f1a68038f70 0x7f1a6803b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1a640098c0 tx=0x7f1a64006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.451+0000 7f1a80f8c640 1 -- 172.21.15.123:0/2495897238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a7c1055a0 msgr2=0x7f1a7c19b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.451+0000 7f1a80f8c640 1 --2- 172.21.15.123:0/2495897238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a7c1055a0 0x7f1a7c19b2e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0097f0 tx=0x7f1a6c030d80 comp rx=0 tx=0).stop 2024-08-18T21:59:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.451+0000 7f1a80f8c640 1 -- 172.21.15.123:0/2495897238 shutdown_connections 2024-08-18T21:59:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.451+0000 7f1a80f8c640 1 --2- 172.21.15.123:0/2495897238 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f1a68038f70 0x7f1a6803b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:00.352 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.451+0000 7f1a80f8c640 1 --2- 172.21.15.123:0/2495897238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a7c1055a0 0x7f1a7c19b2e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:00.353 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.451+0000 7f1a80f8c640 1 -- 172.21.15.123:0/2495897238 >> 172.21.15.123:0/2495897238 conn(0x7f1a7c1010f0 msgr2=0x7f1a7c101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:00.353 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.451+0000 7f1a80f8c640 1 -- 172.21.15.123:0/2495897238 shutdown_connections 2024-08-18T21:59:00.353 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:58:59.451+0000 7f1a80f8c640 1 -- 172.21.15.123:0/2495897238 wait complete. 2024-08-18T21:59:00.741 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:00 smithi123 ceph-mon[18462]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T21:59:00.742 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:00 smithi123 ceph-mon[18462]: Saving service mgr spec with placement count:2 2024-08-18T21:59:00.742 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:00 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' 2024-08-18T21:59:01.733 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.740+0000 7fc4f0198640 1 Processor -- start 2024-08-18T21:59:01.733 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.740+0000 7fc4f0198640 1 -- start start 2024-08-18T21:59:01.733 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.740+0000 7fc4f0198640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4e8105bb0 0x7fc4e8105fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:01.733 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.740+0000 7fc4f0198640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e807bd80 con 0x7fc4e8105bb0 2024-08-18T21:59:01.733 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.740+0000 7fc4edf34640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4e8105bb0 0x7fc4e8105fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:01.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.740+0000 7fc4edf34640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4e8105bb0 0x7fc4e8105fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50854/0 (socket says 172.21.15.123:50854) 2024-08-18T21:59:01.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.740+0000 7fc4edf34640 1 -- 172.21.15.123:0/323093600 learned_addr learned my addr 172.21.15.123:0/323093600 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:01.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.740+0000 7fc4edf34640 1 -- 172.21.15.123:0/323093600 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e81064f0 con 0x7fc4e8105bb0 2024-08-18T21:59:01.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.741+0000 7fc4edf34640 1 --2- 172.21.15.123:0/323093600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4e8105bb0 0x7fc4e8105fb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009820 tx=0x7fc4e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3325f4dd3546d84b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:01.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.741+0000 7fc4ecf32640 1 -- 172.21.15.123:0/323093600 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e4037070 con 0x7fc4e8105bb0 2024-08-18T21:59:01.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.741+0000 7fc4ecf32640 1 -- 172.21.15.123:0/323093600 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc4e4032900 con 0x7fc4e8105bb0 2024-08-18T21:59:01.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.741+0000 7fc4ecf32640 1 -- 172.21.15.123:0/323093600 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e4030850 con 0x7fc4e8105bb0 2024-08-18T21:59:01.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.742+0000 7fc4f0198640 1 -- 172.21.15.123:0/323093600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4e8105bb0 msgr2=0x7fc4e8105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:01.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.742+0000 7fc4f0198640 1 --2- 172.21.15.123:0/323093600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4e8105bb0 0x7fc4e8105fb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009820 tx=0x7fc4e402a270 comp rx=0 tx=0).stop 2024-08-18T21:59:01.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.742+0000 7fc4f0198640 1 -- 172.21.15.123:0/323093600 shutdown_connections 2024-08-18T21:59:01.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.742+0000 7fc4f0198640 1 --2- 172.21.15.123:0/323093600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4e8105bb0 0x7fc4e8105fb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:01.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.742+0000 7fc4f0198640 1 -- 172.21.15.123:0/323093600 >> 172.21.15.123:0/323093600 conn(0x7fc4e81019e0 msgr2=0x7fc4e8103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:01.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.742+0000 7fc4f0198640 1 -- 172.21.15.123:0/323093600 shutdown_connections 2024-08-18T21:59:01.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.742+0000 7fc4f0198640 1 -- 172.21.15.123:0/323093600 wait complete. 2024-08-18T21:59:01.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.743+0000 7fc4f0198640 1 Processor -- start 2024-08-18T21:59:01.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.743+0000 7fc4f0198640 1 -- start start 2024-08-18T21:59:01.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.743+0000 7fc4f0198640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4e8105bb0 0x7fc4e819d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:01.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.743+0000 7fc4f0198640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e8107470 con 0x7fc4e8105bb0 2024-08-18T21:59:01.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.743+0000 7fc4edf34640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4e8105bb0 0x7fc4e819d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:01.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.743+0000 7fc4edf34640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4e8105bb0 0x7fc4e819d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50862/0 (socket says 172.21.15.123:50862) 2024-08-18T21:59:01.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.743+0000 7fc4edf34640 1 -- 172.21.15.123:0/3223263463 learned_addr learned my addr 172.21.15.123:0/3223263463 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:01.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.743+0000 7fc4edf34640 1 -- 172.21.15.123:0/3223263463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e819d990 con 0x7fc4e8105bb0 2024-08-18T21:59:01.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.743+0000 7fc4edf34640 1 --2- 172.21.15.123:0/3223263463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4e8105bb0 0x7fc4e819d450 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4032ce0 tx=0x7fc4e4032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:01.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.743+0000 7fc4deffd640 1 -- 172.21.15.123:0/3223263463 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e4042070 con 0x7fc4e8105bb0 2024-08-18T21:59:01.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.743+0000 7fc4deffd640 1 -- 172.21.15.123:0/3223263463 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc4e40308c0 con 0x7fc4e8105bb0 2024-08-18T21:59:01.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.743+0000 7fc4f0198640 1 -- 172.21.15.123:0/3223263463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e819dc20 con 0x7fc4e8105bb0 2024-08-18T21:59:01.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.743+0000 7fc4deffd640 1 -- 172.21.15.123:0/3223263463 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e4037040 con 0x7fc4e8105bb0 2024-08-18T21:59:01.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.744+0000 7fc4f0198640 1 -- 172.21.15.123:0/3223263463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e81a0910 con 0x7fc4e8105bb0 2024-08-18T21:59:01.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.744+0000 7fc4deffd640 1 -- 172.21.15.123:0/3223263463 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fc4e4045070 con 0x7fc4e8105bb0 2024-08-18T21:59:01.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.744+0000 7fc4f0198640 1 -- 172.21.15.123:0/3223263463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e8107b40 con 0x7fc4e8105bb0 2024-08-18T21:59:01.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.745+0000 7fc4deffd640 1 --2- 172.21.15.123:0/3223263463 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fc4d4038f70 0x7fc4d403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:01.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.745+0000 7fc4deffd640 1 -- 172.21.15.123:0/3223263463 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc4e406c050 con 0x7fc4e8105bb0 2024-08-18T21:59:01.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.745+0000 7fc4ed733640 1 --2- 172.21.15.123:0/3223263463 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fc4d4038f70 0x7fc4d403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:01.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.745+0000 7fc4ed733640 1 --2- 172.21.15.123:0/3223263463 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fc4d4038f70 0x7fc4d403b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80098c0 tx=0x7fc4d8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:01.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.749+0000 7fc4deffd640 1 -- 172.21.15.123:0/3223263463 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fc4e404b170 con 0x7fc4e8105bb0 2024-08-18T21:59:01.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.919+0000 7fc4f0198640 1 -- 172.21.15.123:0/3223263463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fc4e802d860 con 0x7fc4e8105bb0 2024-08-18T21:59:01.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.921+0000 7fc4deffd640 1 -- 172.21.15.123:0/3223263463 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7fc4e403cd50 con 0x7fc4e8105bb0 2024-08-18T21:59:01.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.924+0000 7fc4f0198640 1 -- 172.21.15.123:0/3223263463 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fc4d4038f70 msgr2=0x7fc4d403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:01.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.924+0000 7fc4f0198640 1 --2- 172.21.15.123:0/3223263463 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fc4d4038f70 0x7fc4d403b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80098c0 tx=0x7fc4d8006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:01.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.924+0000 7fc4f0198640 1 -- 172.21.15.123:0/3223263463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4e8105bb0 msgr2=0x7fc4e819d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:01.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.924+0000 7fc4f0198640 1 --2- 172.21.15.123:0/3223263463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4e8105bb0 0x7fc4e819d450 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4032ce0 tx=0x7fc4e4032d10 comp rx=0 tx=0).stop 2024-08-18T21:59:01.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.924+0000 7fc4f0198640 1 -- 172.21.15.123:0/3223263463 shutdown_connections 2024-08-18T21:59:01.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.924+0000 7fc4f0198640 1 --2- 172.21.15.123:0/3223263463 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fc4d4038f70 0x7fc4d403b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:01.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.924+0000 7fc4f0198640 1 --2- 172.21.15.123:0/3223263463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4e8105bb0 0x7fc4e819d450 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:01.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.924+0000 7fc4f0198640 1 -- 172.21.15.123:0/3223263463 >> 172.21.15.123:0/3223263463 conn(0x7fc4e81019e0 msgr2=0x7fc4e8194110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:01.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.924+0000 7fc4f0198640 1 -- 172.21.15.123:0/3223263463 shutdown_connections 2024-08-18T21:59:01.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:00.924+0000 7fc4f0198640 1 -- 172.21.15.123:0/3223263463 wait complete. 2024-08-18T21:59:02.104 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:01 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3223263463' entity='client.admin' 2024-08-18T21:59:02.104 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:01 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' 2024-08-18T21:59:02.104 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:01 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' 2024-08-18T21:59:03.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.182+0000 7f323937b640 1 Processor -- start 2024-08-18T21:59:03.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.182+0000 7f323937b640 1 -- start start 2024-08-18T21:59:03.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.182+0000 7f323937b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3234107d80 0x7f323410a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:03.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.182+0000 7f323937b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f323407bdc0 con 0x7f3234107d80 2024-08-18T21:59:03.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.182+0000 7f3232ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3234107d80 0x7f323410a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:03.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.182+0000 7f3232ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3234107d80 0x7f323410a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50872/0 (socket says 172.21.15.123:50872) 2024-08-18T21:59:03.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.182+0000 7f3232ffd640 1 -- 172.21.15.123:0/3877375394 learned_addr learned my addr 172.21.15.123:0/3877375394 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:03.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.183+0000 7f3232ffd640 1 -- 172.21.15.123:0/3877375394 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323410a6b0 con 0x7f3234107d80 2024-08-18T21:59:03.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.183+0000 7f3232ffd640 1 --2- 172.21.15.123:0/3877375394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3234107d80 0x7f323410a170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3224009820 tx=0x7f322402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8d456ecb60adaf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:03.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.184+0000 7f32327fc640 1 -- 172.21.15.123:0/3877375394 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3224037070 con 0x7f3234107d80 2024-08-18T21:59:03.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.184+0000 7f32327fc640 1 -- 172.21.15.123:0/3877375394 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3224032920 con 0x7f3234107d80 2024-08-18T21:59:03.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.184+0000 7f32327fc640 1 -- 172.21.15.123:0/3877375394 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3224030810 con 0x7f3234107d80 2024-08-18T21:59:03.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.184+0000 7f323937b640 1 -- 172.21.15.123:0/3877375394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3234107d80 msgr2=0x7f323410a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:03.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.184+0000 7f323937b640 1 --2- 172.21.15.123:0/3877375394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3234107d80 0x7f323410a170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3224009820 tx=0x7f322402a270 comp rx=0 tx=0).stop 2024-08-18T21:59:03.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.184+0000 7f323937b640 1 -- 172.21.15.123:0/3877375394 shutdown_connections 2024-08-18T21:59:03.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.184+0000 7f323937b640 1 --2- 172.21.15.123:0/3877375394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3234107d80 0x7f323410a170 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:03.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.184+0000 7f323937b640 1 -- 172.21.15.123:0/3877375394 >> 172.21.15.123:0/3877375394 conn(0x7f32341019e0 msgr2=0x7f3234103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:03.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.185+0000 7f323937b640 1 -- 172.21.15.123:0/3877375394 shutdown_connections 2024-08-18T21:59:03.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.185+0000 7f323937b640 1 -- 172.21.15.123:0/3877375394 wait complete. 2024-08-18T21:59:03.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.185+0000 7f323937b640 1 Processor -- start 2024-08-18T21:59:03.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.185+0000 7f323937b640 1 -- start start 2024-08-18T21:59:03.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.185+0000 7f323937b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3234107d80 0x7f323419b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:03.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.185+0000 7f323937b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f323410b6d0 con 0x7f3234107d80 2024-08-18T21:59:03.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.185+0000 7f3232ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3234107d80 0x7f323419b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:03.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.185+0000 7f3232ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3234107d80 0x7f323419b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50878/0 (socket says 172.21.15.123:50878) 2024-08-18T21:59:03.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.185+0000 7f3232ffd640 1 -- 172.21.15.123:0/3264999938 learned_addr learned my addr 172.21.15.123:0/3264999938 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:03.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.186+0000 7f3232ffd640 1 -- 172.21.15.123:0/3264999938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323419b7d0 con 0x7f3234107d80 2024-08-18T21:59:03.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.186+0000 7f3232ffd640 1 --2- 172.21.15.123:0/3264999938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3234107d80 0x7f323419b290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3224030380 tx=0x7f3224032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:03.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.186+0000 7f3230ff9640 1 -- 172.21.15.123:0/3264999938 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3224037040 con 0x7f3234107d80 2024-08-18T21:59:03.537 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.186+0000 7f3230ff9640 1 -- 172.21.15.123:0/3264999938 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3224040070 con 0x7f3234107d80 2024-08-18T21:59:03.537 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.186+0000 7f323937b640 1 -- 172.21.15.123:0/3264999938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f323419ba60 con 0x7f3234107d80 2024-08-18T21:59:03.537 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.186+0000 7f3230ff9640 1 -- 172.21.15.123:0/3264999938 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f322403a7b0 con 0x7f3234107d80 2024-08-18T21:59:03.537 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.186+0000 7f323937b640 1 -- 172.21.15.123:0/3264999938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f323419e750 con 0x7f3234107d80 2024-08-18T21:59:03.537 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.187+0000 7f3230ff9640 1 -- 172.21.15.123:0/3264999938 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f322403aa30 con 0x7f3234107d80 2024-08-18T21:59:03.537 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.187+0000 7f323937b640 1 -- 172.21.15.123:0/3264999938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32341081e0 con 0x7f3234107d80 2024-08-18T21:59:03.537 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.187+0000 7f3230ff9640 1 --2- 172.21.15.123:0/3264999938 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f3220038f70 0x7f322003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:03.537 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.187+0000 7f3230ff9640 1 -- 172.21.15.123:0/3264999938 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f322406c640 con 0x7f3234107d80 2024-08-18T21:59:03.537 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.187+0000 7f322bfff640 1 --2- 172.21.15.123:0/3264999938 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f3220038f70 0x7f322003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:03.537 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.188+0000 7f322bfff640 1 --2- 172.21.15.123:0/3264999938 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f3220038f70 0x7f322003b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f321c0098c0 tx=0x7f321c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:03.537 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.192+0000 7f3230ff9640 1 -- 172.21.15.123:0/3264999938 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3224044c70 con 0x7f3234107d80 2024-08-18T21:59:03.538 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.376+0000 7f323937b640 1 -- 172.21.15.123:0/3264999938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f323419edb0 con 0x7f3234107d80 2024-08-18T21:59:03.538 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.381+0000 7f3230ff9640 1 -- 172.21.15.123:0/3264999938 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f3224041270 con 0x7f3234107d80 2024-08-18T21:59:03.538 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.383+0000 7f323937b640 1 -- 172.21.15.123:0/3264999938 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f3220038f70 msgr2=0x7f322003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:03.538 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.383+0000 7f323937b640 1 --2- 172.21.15.123:0/3264999938 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f3220038f70 0x7f322003b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f321c0098c0 tx=0x7f321c006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:03.538 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.383+0000 7f323937b640 1 -- 172.21.15.123:0/3264999938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3234107d80 msgr2=0x7f323419b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:03.538 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.383+0000 7f323937b640 1 --2- 172.21.15.123:0/3264999938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3234107d80 0x7f323419b290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3224030380 tx=0x7f3224032670 comp rx=0 tx=0).stop 2024-08-18T21:59:03.538 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.383+0000 7f323937b640 1 -- 172.21.15.123:0/3264999938 shutdown_connections 2024-08-18T21:59:03.538 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.383+0000 7f323937b640 1 --2- 172.21.15.123:0/3264999938 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f3220038f70 0x7f322003b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:03.538 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.383+0000 7f323937b640 1 --2- 172.21.15.123:0/3264999938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3234107d80 0x7f323419b290 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:03.538 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.383+0000 7f323937b640 1 -- 172.21.15.123:0/3264999938 >> 172.21.15.123:0/3264999938 conn(0x7f32341019e0 msgr2=0x7f32341025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:03.538 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.383+0000 7f323937b640 1 -- 172.21.15.123:0/3264999938 shutdown_connections 2024-08-18T21:59:03.538 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:02.383+0000 7f323937b640 1 -- 172.21.15.123:0/3264999938 wait complete. 2024-08-18T21:59:03.539 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling the dashboard module... 2024-08-18T21:59:03.644 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:03 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3264999938' entity='client.admin' 2024-08-18T21:59:03.644 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:03 smithi123 ceph-mon[18462]: from='mgr.14118 172.21.15.123:0/2281440429' entity='mgr.x' 2024-08-18T21:59:04.692 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:04 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1224955258' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-08-18T21:59:04.692 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:04 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: ignoring --setuser ceph since I am not root 2024-08-18T21:59:04.693 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:04 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: ignoring --setgroup ceph since I am not root 2024-08-18T21:59:04.693 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:04 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:04.625+0000 7f3f39f27040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-18T21:59:04.693 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:04 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:04.691+0000 7f3f39f27040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-18T21:59:04.994 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:04 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:04.841+0000 7f3f39f27040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-18T21:59:05.001 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.934+0000 7fd8cd865640 1 Processor -- start 2024-08-18T21:59:05.001 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.934+0000 7fd8cd865640 1 -- start start 2024-08-18T21:59:05.002 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.934+0000 7fd8cd865640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8c8105bd0 0x7fd8c8105fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:05.002 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.934+0000 7fd8cd865640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c8075510 con 0x7fd8c8105bd0 2024-08-18T21:59:05.002 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.934+0000 7fd8c6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8c8105bd0 0x7fd8c8105fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:05.002 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.935+0000 7fd8c6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8c8105bd0 0x7fd8c8105fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45990/0 (socket says 172.21.15.123:45990) 2024-08-18T21:59:05.002 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.935+0000 7fd8c6ffd640 1 -- 172.21.15.123:0/3320526867 learned_addr learned my addr 172.21.15.123:0/3320526867 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:05.002 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.935+0000 7fd8c6ffd640 1 -- 172.21.15.123:0/3320526867 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c8106510 con 0x7fd8c8105bd0 2024-08-18T21:59:05.002 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.935+0000 7fd8c6ffd640 1 --2- 172.21.15.123:0/3320526867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8c8105bd0 0x7fd8c8105fd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009e80 tx=0x7fd8b802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae491559470fb856 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:05.002 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.936+0000 7fd8c5ffb640 1 -- 172.21.15.123:0/3320526867 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b8036070 con 0x7fd8c8105bd0 2024-08-18T21:59:05.002 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.936+0000 7fd8c5ffb640 1 -- 172.21.15.123:0/3320526867 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8b80318e0 con 0x7fd8c8105bd0 2024-08-18T21:59:05.002 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.936+0000 7fd8c5ffb640 1 -- 172.21.15.123:0/3320526867 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b8007a00 con 0x7fd8c8105bd0 2024-08-18T21:59:05.002 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.936+0000 7fd8cd865640 1 -- 172.21.15.123:0/3320526867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8c8105bd0 msgr2=0x7fd8c8105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:05.002 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.936+0000 7fd8cd865640 1 --2- 172.21.15.123:0/3320526867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8c8105bd0 0x7fd8c8105fd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009e80 tx=0x7fd8b802a7a0 comp rx=0 tx=0).stop 2024-08-18T21:59:05.003 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.936+0000 7fd8cd865640 1 -- 172.21.15.123:0/3320526867 shutdown_connections 2024-08-18T21:59:05.003 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.936+0000 7fd8cd865640 1 --2- 172.21.15.123:0/3320526867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8c8105bd0 0x7fd8c8105fd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:05.003 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.936+0000 7fd8cd865640 1 -- 172.21.15.123:0/3320526867 >> 172.21.15.123:0/3320526867 conn(0x7fd8c8101980 msgr2=0x7fd8c8103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:05.003 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.936+0000 7fd8cd865640 1 -- 172.21.15.123:0/3320526867 shutdown_connections 2024-08-18T21:59:05.003 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.937+0000 7fd8cd865640 1 -- 172.21.15.123:0/3320526867 wait complete. 2024-08-18T21:59:05.003 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.937+0000 7fd8cd865640 1 Processor -- start 2024-08-18T21:59:05.003 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.937+0000 7fd8cd865640 1 -- start start 2024-08-18T21:59:05.003 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.937+0000 7fd8cd865640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8c8105bd0 0x7fd8c819d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:05.003 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.937+0000 7fd8cd865640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c8107650 con 0x7fd8c8105bd0 2024-08-18T21:59:05.003 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.937+0000 7fd8c6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8c8105bd0 0x7fd8c819d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:05.003 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.938+0000 7fd8c6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8c8105bd0 0x7fd8c819d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45994/0 (socket says 172.21.15.123:45994) 2024-08-18T21:59:05.003 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.938+0000 7fd8c6ffd640 1 -- 172.21.15.123:0/1224955258 learned_addr learned my addr 172.21.15.123:0/1224955258 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:05.004 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.938+0000 7fd8c6ffd640 1 -- 172.21.15.123:0/1224955258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c819da10 con 0x7fd8c8105bd0 2024-08-18T21:59:05.004 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.938+0000 7fd8c6ffd640 1 --2- 172.21.15.123:0/1224955258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8c8105bd0 0x7fd8c819d4d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8b802acc0 tx=0x7fd8b8031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:05.004 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.938+0000 7fd8cc863640 1 -- 172.21.15.123:0/1224955258 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b8036050 con 0x7fd8c8105bd0 2024-08-18T21:59:05.004 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.938+0000 7fd8cc863640 1 -- 172.21.15.123:0/1224955258 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8b8037040 con 0x7fd8c8105bd0 2024-08-18T21:59:05.004 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.938+0000 7fd8cd865640 1 -- 172.21.15.123:0/1224955258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c819dca0 con 0x7fd8c8105bd0 2024-08-18T21:59:05.004 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.938+0000 7fd8cc863640 1 -- 172.21.15.123:0/1224955258 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b803d8e0 con 0x7fd8c8105bd0 2024-08-18T21:59:05.004 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.938+0000 7fd8cd865640 1 -- 172.21.15.123:0/1224955258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c81a0990 con 0x7fd8c8105bd0 2024-08-18T21:59:05.004 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.939+0000 7fd8cc863640 1 -- 172.21.15.123:0/1224955258 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd8b8044020 con 0x7fd8c8105bd0 2024-08-18T21:59:05.004 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.939+0000 7fd8cc863640 1 --2- 172.21.15.123:0/1224955258 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fd8b4038fc0 0x7fd8b403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:05.005 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.939+0000 7fd8cc863640 1 -- 172.21.15.123:0/1224955258 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd8b8042020 con 0x7fd8c8105bd0 2024-08-18T21:59:05.005 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.939+0000 7fd8cd865640 1 -- 172.21.15.123:0/1224955258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c8105fd0 con 0x7fd8c8105bd0 2024-08-18T21:59:05.005 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.939+0000 7fd8c67fc640 1 --2- 172.21.15.123:0/1224955258 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fd8b4038fc0 0x7fd8b403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:05.005 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.940+0000 7fd8c67fc640 1 --2- 172.21.15.123:0/1224955258 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fd8b4038fc0 0x7fd8b403b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00098c0 tx=0x7fd8b0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:05.005 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:03.944+0000 7fd8cc863640 1 -- 172.21.15.123:0/1224955258 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd8b804b020 con 0x7fd8c8105bd0 2024-08-18T21:59:05.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:04.177+0000 7fd8cd865640 1 -- 172.21.15.123:0/1224955258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fd8c8196910 con 0x7fd8c8105bd0 2024-08-18T21:59:05.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:04.386+0000 7fd8cc863640 1 -- 172.21.15.123:0/1224955258 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fd8b8031e00 con 0x7fd8c8105bd0 2024-08-18T21:59:05.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:04.388+0000 7fd8cc863640 1 -- 172.21.15.123:0/1224955258 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fd8b8046930 con 0x7fd8c8105bd0 2024-08-18T21:59:05.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:04.389+0000 7fd8cd865640 1 -- 172.21.15.123:0/1224955258 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fd8b4038fc0 msgr2=0x7fd8b403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:05.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:04.389+0000 7fd8cd865640 1 --2- 172.21.15.123:0/1224955258 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fd8b4038fc0 0x7fd8b403b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00098c0 tx=0x7fd8b0006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:05.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:04.389+0000 7fd8cd865640 1 -- 172.21.15.123:0/1224955258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8c8105bd0 msgr2=0x7fd8c819d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:05.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:04.389+0000 7fd8cd865640 1 --2- 172.21.15.123:0/1224955258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8c8105bd0 0x7fd8c819d4d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8b802acc0 tx=0x7fd8b8031cc0 comp rx=0 tx=0).stop 2024-08-18T21:59:05.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:04.389+0000 7fd8cd865640 1 -- 172.21.15.123:0/1224955258 shutdown_connections 2024-08-18T21:59:05.006 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:04.389+0000 7fd8cd865640 1 --2- 172.21.15.123:0/1224955258 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fd8b4038fc0 0x7fd8b403b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:05.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:04.389+0000 7fd8cd865640 1 --2- 172.21.15.123:0/1224955258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8c8105bd0 0x7fd8c819d4d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:05.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:04.389+0000 7fd8cd865640 1 -- 172.21.15.123:0/1224955258 >> 172.21.15.123:0/1224955258 conn(0x7fd8c8101980 msgr2=0x7fd8c81917f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:05.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:04.390+0000 7fd8cd865640 1 -- 172.21.15.123:0/1224955258 shutdown_connections 2024-08-18T21:59:05.007 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:04.390+0000 7fd8cd865640 1 -- 172.21.15.123:0/1224955258 wait complete. 2024-08-18T21:59:05.260 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:05 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:05.001+0000 7f3f39f27040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-18T21:59:05.260 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:05 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:05.155+0000 7f3f39f27040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-18T21:59:05.690 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:05 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1224955258' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-18T21:59:05.691 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:05 smithi123 ceph-mon[18462]: mgrmap e9: x(active, since 17s) 2024-08-18T21:59:05.691 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:05 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:05.284+0000 7f3f39f27040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-18T21:59:05.691 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:05 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:05.415+0000 7f3f39f27040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-18T21:59:05.691 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:05 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:05.475+0000 7f3f39f27040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-18T21:59:06.010 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:05 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:05.790+0000 7f3f39f27040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-18T21:59:06.010 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:05 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:05.851+0000 7f3f39f27040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-18T21:59:06.010 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:05 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:05.919+0000 7f3f39f27040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-18T21:59:06.375 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:06 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:06.066+0000 7f3f39f27040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-18T21:59:06.376 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:06 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:06.125+0000 7f3f39f27040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-18T21:59:06.376 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:06 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:06.190+0000 7f3f39f27040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-18T21:59:06.376 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:06 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:06.374+0000 7f3f39f27040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-18T21:59:06.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-08-18T21:59:06.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-18T21:59:06.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-18T21:59:06.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-18T21:59:06.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-18T21:59:06.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-08-18T21:59:06.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.484+0000 7f2ad5638640 1 Processor -- start 2024-08-18T21:59:06.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.484+0000 7f2ad5638640 1 -- start start 2024-08-18T21:59:06.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.484+0000 7f2ad5638640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad0107d80 0x7f2ad010a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:06.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.484+0000 7f2ad5638640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad007bdc0 con 0x7f2ad0107d80 2024-08-18T21:59:06.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.484+0000 7f2aceffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad0107d80 0x7f2ad010a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:06.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.484+0000 7f2aceffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad0107d80 0x7f2ad010a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46032/0 (socket says 172.21.15.123:46032) 2024-08-18T21:59:06.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.484+0000 7f2aceffd640 1 -- 172.21.15.123:0/1244342588 learned_addr learned my addr 172.21.15.123:0/1244342588 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:06.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.485+0000 7f2aceffd640 1 -- 172.21.15.123:0/1244342588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad010a6b0 con 0x7f2ad0107d80 2024-08-18T21:59:06.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.485+0000 7f2aceffd640 1 --2- 172.21.15.123:0/1244342588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad0107d80 0x7f2ad010a170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009820 tx=0x7f2ac002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4784109240a8d028 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:06.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.485+0000 7f2ace7fc640 1 -- 172.21.15.123:0/1244342588 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac0037070 con 0x7f2ad0107d80 2024-08-18T21:59:06.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.485+0000 7f2ace7fc640 1 -- 172.21.15.123:0/1244342588 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ac0032920 con 0x7f2ad0107d80 2024-08-18T21:59:06.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.485+0000 7f2ace7fc640 1 -- 172.21.15.123:0/1244342588 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac0030810 con 0x7f2ad0107d80 2024-08-18T21:59:06.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.486+0000 7f2ad5638640 1 -- 172.21.15.123:0/1244342588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad0107d80 msgr2=0x7f2ad010a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:06.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.486+0000 7f2ad5638640 1 --2- 172.21.15.123:0/1244342588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad0107d80 0x7f2ad010a170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009820 tx=0x7f2ac002a270 comp rx=0 tx=0).stop 2024-08-18T21:59:06.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.486+0000 7f2ad5638640 1 -- 172.21.15.123:0/1244342588 shutdown_connections 2024-08-18T21:59:06.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.486+0000 7f2ad5638640 1 --2- 172.21.15.123:0/1244342588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad0107d80 0x7f2ad010a170 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:06.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.486+0000 7f2ad5638640 1 -- 172.21.15.123:0/1244342588 >> 172.21.15.123:0/1244342588 conn(0x7f2ad01019e0 msgr2=0x7f2ad0103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:06.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.486+0000 7f2ad5638640 1 -- 172.21.15.123:0/1244342588 shutdown_connections 2024-08-18T21:59:06.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.486+0000 7f2ad5638640 1 -- 172.21.15.123:0/1244342588 wait complete. 2024-08-18T21:59:06.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.487+0000 7f2ad5638640 1 Processor -- start 2024-08-18T21:59:06.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.487+0000 7f2ad5638640 1 -- start start 2024-08-18T21:59:06.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.487+0000 7f2ad5638640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad0107d80 0x7f2ad019b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:06.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.487+0000 7f2ad5638640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad010b6d0 con 0x7f2ad0107d80 2024-08-18T21:59:06.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.487+0000 7f2aceffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad0107d80 0x7f2ad019b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:06.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.487+0000 7f2aceffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad0107d80 0x7f2ad019b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46044/0 (socket says 172.21.15.123:46044) 2024-08-18T21:59:06.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.487+0000 7f2aceffd640 1 -- 172.21.15.123:0/3373027378 learned_addr learned my addr 172.21.15.123:0/3373027378 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:06.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.487+0000 7f2aceffd640 1 -- 172.21.15.123:0/3373027378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad019b7d0 con 0x7f2ad0107d80 2024-08-18T21:59:06.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.487+0000 7f2aceffd640 1 --2- 172.21.15.123:0/3373027378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad0107d80 0x7f2ad019b290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0030380 tx=0x7f2ac0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:06.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.487+0000 7f2accff9640 1 -- 172.21.15.123:0/3373027378 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac0037040 con 0x7f2ad0107d80 2024-08-18T21:59:06.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.488+0000 7f2accff9640 1 -- 172.21.15.123:0/3373027378 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ac0040070 con 0x7f2ad0107d80 2024-08-18T21:59:06.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.488+0000 7f2ad5638640 1 -- 172.21.15.123:0/3373027378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad019ba60 con 0x7f2ad0107d80 2024-08-18T21:59:06.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.488+0000 7f2accff9640 1 -- 172.21.15.123:0/3373027378 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac003a7b0 con 0x7f2ad0107d80 2024-08-18T21:59:06.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.488+0000 7f2ad5638640 1 -- 172.21.15.123:0/3373027378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad019e750 con 0x7f2ad0107d80 2024-08-18T21:59:06.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.488+0000 7f2accff9640 1 -- 172.21.15.123:0/3373027378 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f2ac003aa30 con 0x7f2ad0107d80 2024-08-18T21:59:06.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.488+0000 7f2ad5638640 1 -- 172.21.15.123:0/3373027378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad01081e0 con 0x7f2ad0107d80 2024-08-18T21:59:06.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.489+0000 7f2accff9640 1 --2- 172.21.15.123:0/3373027378 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f2abc038fc0 0x7f2abc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:06.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.489+0000 7f2accff9640 1 -- 172.21.15.123:0/3373027378 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2ac006c750 con 0x7f2ad0107d80 2024-08-18T21:59:06.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.489+0000 7f2ac7fff640 1 -- 172.21.15.123:0/3373027378 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f2abc038fc0 msgr2=0x7f2abc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/4048905381 2024-08-18T21:59:06.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.489+0000 7f2ac7fff640 1 --2- 172.21.15.123:0/3373027378 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f2abc038fc0 0x7f2abc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:59:06.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.493+0000 7f2accff9640 1 -- 172.21.15.123:0/3373027378 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2ac0044c70 con 0x7f2ad0107d80 2024-08-18T21:59:06.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.690+0000 7f2ac7fff640 1 -- 172.21.15.123:0/3373027378 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f2abc038fc0 msgr2=0x7f2abc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/4048905381 2024-08-18T21:59:06.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.690+0000 7f2ac7fff640 1 --2- 172.21.15.123:0/3373027378 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f2abc038fc0 0x7f2abc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:59:06.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.714+0000 7f2ad5638640 1 -- 172.21.15.123:0/3373027378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f2ad019ed40 con 0x7f2ad0107d80 2024-08-18T21:59:06.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.714+0000 7f2accff9640 1 -- 172.21.15.123:0/3373027378 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f2ac0041270 con 0x7f2ad0107d80 2024-08-18T21:59:06.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.717+0000 7f2ad5638640 1 -- 172.21.15.123:0/3373027378 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f2abc038fc0 msgr2=0x7f2abc03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:59:06.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.717+0000 7f2ad5638640 1 --2- 172.21.15.123:0/3373027378 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f2abc038fc0 0x7f2abc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:06.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.717+0000 7f2ad5638640 1 -- 172.21.15.123:0/3373027378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad0107d80 msgr2=0x7f2ad019b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:06.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.717+0000 7f2ad5638640 1 --2- 172.21.15.123:0/3373027378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad0107d80 0x7f2ad019b290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0030380 tx=0x7f2ac0032670 comp rx=0 tx=0).stop 2024-08-18T21:59:06.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.717+0000 7f2ad5638640 1 -- 172.21.15.123:0/3373027378 shutdown_connections 2024-08-18T21:59:06.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.717+0000 7f2ad5638640 1 --2- 172.21.15.123:0/3373027378 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7f2abc038fc0 0x7f2abc03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:06.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.717+0000 7f2ad5638640 1 --2- 172.21.15.123:0/3373027378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad0107d80 0x7f2ad019b290 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:06.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.717+0000 7f2ad5638640 1 -- 172.21.15.123:0/3373027378 >> 172.21.15.123:0/3373027378 conn(0x7f2ad01019e0 msgr2=0x7f2ad01025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:06.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.717+0000 7f2ad5638640 1 -- 172.21.15.123:0/3373027378 shutdown_connections 2024-08-18T21:59:06.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:05.717+0000 7f2ad5638640 1 -- 172.21.15.123:0/3373027378 wait complete. 2024-08-18T21:59:06.395 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for the mgr to restart... 2024-08-18T21:59:06.395 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr epoch 9... 2024-08-18T21:59:06.702 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:06 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3373027378' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-18T21:59:06.703 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:06 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:06.447+0000 7f3f39f27040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-18T21:59:06.703 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:06 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:06.506+0000 7f3f39f27040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-18T21:59:06.703 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:06 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:06.575+0000 7f3f39f27040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-18T21:59:06.987 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:06 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:06.797+0000 7f3f39f27040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-18T21:59:06.987 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:06 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:06.855+0000 7f3f39f27040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-18T21:59:07.660 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:07 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:07.358+0000 7f3f39f27040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-18T21:59:08.010 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:07 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:07.659+0000 7f3f39f27040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-18T21:59:08.510 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:08 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:08.064+0000 7f3f39f27040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-18T21:59:08.510 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:08 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:08.119+0000 7f3f39f27040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-18T21:59:08.510 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:08 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:08.177+0000 7f3f39f27040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-18T21:59:09.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:09 smithi123 ceph-mon[18462]: Active manager daemon x restarted 2024-08-18T21:59:09.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:09 smithi123 ceph-mon[18462]: Activating manager daemon x 2024-08-18T21:59:09.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:09 smithi123 ceph-mon[18462]: osdmap e3: 0 total, 0 up, 0 in 2024-08-18T21:59:09.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:09 smithi123 ceph-mon[18462]: mgrmap e10: x(active, starting, since 0.00333143s) 2024-08-18T21:59:09.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T21:59:09.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-18T21:59:09.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-18T21:59:09.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-18T21:59:09.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-18T21:59:09.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:09 smithi123 ceph-mon[18462]: Manager daemon x is now available 2024-08-18T21:59:09.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T21:59:09.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-18T21:59:09.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-18T21:59:10.726 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:10.447+0000 7f3e9fba4640 -1 log_channel(cephadm) log [ERR] : [18/Aug/2024:21:59:10] ENGINE Error in HTTPServer.serve 2024-08-18T21:59:10.727 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: Traceback (most recent call last): 2024-08-18T21:59:10.727 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-18T21:59:10.727 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: self._connections.run(self.expiration_interval) 2024-08-18T21:59:10.727 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-18T21:59:10.727 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: self._run(expiration_interval) 2024-08-18T21:59:10.727 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-18T21:59:10.727 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: new_conn = self._from_server_socket(self.server.socket) 2024-08-18T21:59:10.727 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-18T21:59:10.727 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-18T21:59:10.727 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-18T21:59:10.727 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: s = self.context.wrap_socket( 2024-08-18T21:59:10.727 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-18T21:59:10.727 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: return self.sslsocket_class._create( 2024-08-18T21:59:10.728 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-18T21:59:10.728 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: self.do_handshake() 2024-08-18T21:59:10.728 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-18T21:59:10.728 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: self._sslobj.do_handshake() 2024-08-18T21:59:10.728 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-18T21:59:10.728 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 21:59:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T21:59:11.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-08-18T21:59:11.113 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-18T21:59:11.113 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-18T21:59:11.113 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-08-18T21:59:11.113 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.780+0000 7fbcf9f73640 1 Processor -- start 2024-08-18T21:59:11.113 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.780+0000 7fbcf9f73640 1 -- start start 2024-08-18T21:59:11.113 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.780+0000 7fbcf9f73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4107de0 0x7fbcf410a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:11.114 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.780+0000 7fbcf9f73640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf407bda0 con 0x7fbcf4107de0 2024-08-18T21:59:11.114 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.780+0000 7fbcf37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4107de0 0x7fbcf410a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:11.114 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.781+0000 7fbcf37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4107de0 0x7fbcf410a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46046/0 (socket says 172.21.15.123:46046) 2024-08-18T21:59:11.114 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.781+0000 7fbcf37fe640 1 -- 172.21.15.123:0/1681460032 learned_addr learned my addr 172.21.15.123:0/1681460032 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:11.114 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.781+0000 7fbcf37fe640 1 -- 172.21.15.123:0/1681460032 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf410a710 con 0x7fbcf4107de0 2024-08-18T21:59:11.114 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.781+0000 7fbcf37fe640 1 --2- 172.21.15.123:0/1681460032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4107de0 0x7fbcf410a1d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009820 tx=0x7fbce402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa4704beb000e23 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:11.114 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.782+0000 7fbcf27fc640 1 -- 172.21.15.123:0/1681460032 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce4037070 con 0x7fbcf4107de0 2024-08-18T21:59:11.114 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.782+0000 7fbcf27fc640 1 -- 172.21.15.123:0/1681460032 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbce4032920 con 0x7fbcf4107de0 2024-08-18T21:59:11.114 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.782+0000 7fbcf27fc640 1 -- 172.21.15.123:0/1681460032 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce4030810 con 0x7fbcf4107de0 2024-08-18T21:59:11.114 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.782+0000 7fbcf9f73640 1 -- 172.21.15.123:0/1681460032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4107de0 msgr2=0x7fbcf410a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:11.114 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.782+0000 7fbcf9f73640 1 --2- 172.21.15.123:0/1681460032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4107de0 0x7fbcf410a1d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009820 tx=0x7fbce402a270 comp rx=0 tx=0).stop 2024-08-18T21:59:11.114 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.782+0000 7fbcf9f73640 1 -- 172.21.15.123:0/1681460032 shutdown_connections 2024-08-18T21:59:11.115 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.782+0000 7fbcf9f73640 1 --2- 172.21.15.123:0/1681460032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4107de0 0x7fbcf410a1d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:11.115 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.782+0000 7fbcf9f73640 1 -- 172.21.15.123:0/1681460032 >> 172.21.15.123:0/1681460032 conn(0x7fbcf41019e0 msgr2=0x7fbcf4103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:11.115 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.782+0000 7fbcf9f73640 1 -- 172.21.15.123:0/1681460032 shutdown_connections 2024-08-18T21:59:11.115 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.782+0000 7fbcf9f73640 1 -- 172.21.15.123:0/1681460032 wait complete. 2024-08-18T21:59:11.115 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.783+0000 7fbcf9f73640 1 Processor -- start 2024-08-18T21:59:11.115 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.783+0000 7fbcf9f73640 1 -- start start 2024-08-18T21:59:11.115 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.783+0000 7fbcf9f73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4107de0 0x7fbcf4107660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:11.115 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.783+0000 7fbcf9f73640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf410b730 con 0x7fbcf4107de0 2024-08-18T21:59:11.115 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.783+0000 7fbcf37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4107de0 0x7fbcf4107660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:11.115 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.783+0000 7fbcf37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4107de0 0x7fbcf4107660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46054/0 (socket says 172.21.15.123:46054) 2024-08-18T21:59:11.115 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.783+0000 7fbcf37fe640 1 -- 172.21.15.123:0/1559546088 learned_addr learned my addr 172.21.15.123:0/1559546088 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:11.115 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.784+0000 7fbcf37fe640 1 -- 172.21.15.123:0/1559546088 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf4107ba0 con 0x7fbcf4107de0 2024-08-18T21:59:11.115 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.784+0000 7fbcf37fe640 1 --2- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4107de0 0x7fbcf4107660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbce40097f0 tx=0x7fbce40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:11.116 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.784+0000 7fbcf0ff9640 1 -- 172.21.15.123:0/1559546088 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce4037040 con 0x7fbcf4107de0 2024-08-18T21:59:11.116 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.784+0000 7fbcf9f73640 1 -- 172.21.15.123:0/1559546088 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf4105d90 con 0x7fbcf4107de0 2024-08-18T21:59:11.116 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.784+0000 7fbcf0ff9640 1 -- 172.21.15.123:0/1559546088 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbce4030c40 con 0x7fbcf4107de0 2024-08-18T21:59:11.116 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.784+0000 7fbcf0ff9640 1 -- 172.21.15.123:0/1559546088 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce403a5d0 con 0x7fbcf4107de0 2024-08-18T21:59:11.116 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.784+0000 7fbcf9f73640 1 -- 172.21.15.123:0/1559546088 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf41062d0 con 0x7fbcf4107de0 2024-08-18T21:59:11.116 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.785+0000 7fbcf0ff9640 1 -- 172.21.15.123:0/1559546088 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fbce403a810 con 0x7fbcf4107de0 2024-08-18T21:59:11.116 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.785+0000 7fbcf0ff9640 1 --2- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fbcdc038fc0 0x7fbcdc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:11.116 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.785+0000 7fbcf0ff9640 1 -- 172.21.15.123:0/1559546088 --> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbcdc03bb90 con 0x7fbcdc038fc0 2024-08-18T21:59:11.116 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.785+0000 7fbcf0ff9640 1 -- 172.21.15.123:0/1559546088 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbce406d4d0 con 0x7fbcf4107de0 2024-08-18T21:59:11.116 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.785+0000 7fbcf2ffd640 1 -- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fbcdc038fc0 msgr2=0x7fbcdc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/4048905381 2024-08-18T21:59:11.116 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.785+0000 7fbcf2ffd640 1 --2- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fbcdc038fc0 0x7fbcdc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:59:11.116 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.986+0000 7fbcf2ffd640 1 -- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fbcdc038fc0 msgr2=0x7fbcdc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/4048905381 2024-08-18T21:59:11.116 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:06.986+0000 7fbcf2ffd640 1 --2- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fbcdc038fc0 0x7fbcdc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T21:59:11.117 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:07.387+0000 7fbcf2ffd640 1 -- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fbcdc038fc0 msgr2=0x7fbcdc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/4048905381 2024-08-18T21:59:11.117 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:07.387+0000 7fbcf2ffd640 1 --2- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fbcdc038fc0 0x7fbcdc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T21:59:11.117 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:08.188+0000 7fbcf2ffd640 1 -- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fbcdc038fc0 msgr2=0x7fbcdc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/4048905381 2024-08-18T21:59:11.117 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:08.188+0000 7fbcf2ffd640 1 --2- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fbcdc038fc0 0x7fbcdc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T21:59:11.117 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:09.244+0000 7fbcf0ff9640 1 -- 172.21.15.123:0/1559546088 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7fbce406bf80 con 0x7fbcf4107de0 2024-08-18T21:59:11.117 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:09.244+0000 7fbcf0ff9640 1 -- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fbcdc038fc0 msgr2=0x7fbcdc03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:59:11.117 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:09.244+0000 7fbcf0ff9640 1 --2- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fbcdc038fc0 0x7fbcdc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:11.117 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.245+0000 7fbcf0ff9640 1 -- 172.21.15.123:0/1559546088 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7fbce4044920 con 0x7fbcf4107de0 2024-08-18T21:59:11.117 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.246+0000 7fbcf0ff9640 1 --2- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbcdc03ca80 0x7fbcdc03ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:11.117 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.246+0000 7fbcf0ff9640 1 -- 172.21.15.123:0/1559546088 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbce40665f0 con 0x7fbcdc03ca80 2024-08-18T21:59:11.117 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.246+0000 7fbcf2ffd640 1 --2- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbcdc03ca80 0x7fbcdc03ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:11.117 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.248+0000 7fbcf2ffd640 1 --2- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbcdc03ca80 0x7fbcdc03ee70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbce8003980 tx=0x7fbce8006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:11.117 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.249+0000 7fbcf0ff9640 1 -- 172.21.15.123:0/1559546088 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fbce40665f0 con 0x7fbcdc03ca80 2024-08-18T21:59:11.117 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.255+0000 7fbcf9f73640 1 -- 172.21.15.123:0/1559546088 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fbcf4108240 con 0x7fbcdc03ca80 2024-08-18T21:59:11.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.256+0000 7fbcf0ff9640 1 -- 172.21.15.123:0/1559546088 <== mgr.14150 v2:172.21.15.123:6800/22123895 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fbcf4108240 con 0x7fbcdc03ca80 2024-08-18T21:59:11.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.256+0000 7fbcf9f73640 1 -- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbcdc03ca80 msgr2=0x7fbcdc03ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:11.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.256+0000 7fbcf9f73640 1 --2- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbcdc03ca80 0x7fbcdc03ee70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbce8003980 tx=0x7fbce8006e10 comp rx=0 tx=0).stop 2024-08-18T21:59:11.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.256+0000 7fbcf9f73640 1 -- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4107de0 msgr2=0x7fbcf4107660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:11.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.256+0000 7fbcf9f73640 1 --2- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4107de0 0x7fbcf4107660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbce40097f0 tx=0x7fbce40327b0 comp rx=0 tx=0).stop 2024-08-18T21:59:11.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.256+0000 7fbcf9f73640 1 -- 172.21.15.123:0/1559546088 shutdown_connections 2024-08-18T21:59:11.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.256+0000 7fbcf9f73640 1 --2- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbcdc03ca80 0x7fbcdc03ee70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:11.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.256+0000 7fbcf9f73640 1 --2- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:6800/4048905381,v1:172.21.15.123:6801/4048905381] conn(0x7fbcdc038fc0 0x7fbcdc03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:11.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.256+0000 7fbcf9f73640 1 --2- 172.21.15.123:0/1559546088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4107de0 0x7fbcf4107660 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:11.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.256+0000 7fbcf9f73640 1 -- 172.21.15.123:0/1559546088 >> 172.21.15.123:0/1559546088 conn(0x7fbcf41019e0 msgr2=0x7fbcf4102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:11.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.256+0000 7fbcf9f73640 1 -- 172.21.15.123:0/1559546088 shutdown_connections 2024-08-18T21:59:11.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:10.256+0000 7fbcf9f73640 1 -- 172.21.15.123:0/1559546088 wait complete. 2024-08-18T21:59:11.118 INFO:teuthology.orchestra.run.smithi123.stdout:mgr epoch 9 is available 2024-08-18T21:59:11.119 INFO:teuthology.orchestra.run.smithi123.stdout:Generating a dashboard self-signed certificate... 2024-08-18T21:59:11.395 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:11 smithi123 ceph-mon[18462]: [18/Aug/2024:21:59:10] ENGINE Bus STARTING 2024-08-18T21:59:11.395 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:11 smithi123 ceph-mon[18462]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-18T21:59:11.395 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:11 smithi123 ceph-mon[18462]: mgrmap e11: x(active, since 1.00624s) 2024-08-18T21:59:11.395 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:11 smithi123 ceph-mon[18462]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-18T21:59:11.395 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:11 smithi123 ceph-mon[18462]: [18/Aug/2024:21:59:10] ENGINE Serving on http://172.21.15.123:8765 2024-08-18T21:59:11.395 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:11 smithi123 ceph-mon[18462]: [18/Aug/2024:21:59:10] ENGINE Serving on https://172.21.15.123:7150 2024-08-18T21:59:11.396 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:11 smithi123 ceph-mon[18462]: [18/Aug/2024:21:59:10] ENGINE Bus STARTED 2024-08-18T21:59:11.396 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:11 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:12.305 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-08-18T21:59:12.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.470+0000 7ff3acbd6640 1 Processor -- start 2024-08-18T21:59:12.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.471+0000 7ff3acbd6640 1 -- start start 2024-08-18T21:59:12.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.471+0000 7ff3acbd6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a81072e0 0x7ff3a81076e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:12.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.471+0000 7ff3acbd6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a8107c20 con 0x7ff3a81072e0 2024-08-18T21:59:12.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.471+0000 7ff3a659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a81072e0 0x7ff3a81076e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:12.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.471+0000 7ff3a659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a81072e0 0x7ff3a81076e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46146/0 (socket says 172.21.15.123:46146) 2024-08-18T21:59:12.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.471+0000 7ff3a659c640 1 -- 172.21.15.123:0/1226512833 learned_addr learned my addr 172.21.15.123:0/1226512833 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:12.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.471+0000 7ff3a659c640 1 -- 172.21.15.123:0/1226512833 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a8107da0 con 0x7ff3a81072e0 2024-08-18T21:59:12.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.472+0000 7ff3a659c640 1 --2- 172.21.15.123:0/1226512833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a81072e0 0x7ff3a81076e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff390009820 tx=0x7ff39002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103ac6d444bc893a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:12.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.472+0000 7ff3a559a640 1 -- 172.21.15.123:0/1226512833 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff390037070 con 0x7ff3a81072e0 2024-08-18T21:59:12.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.472+0000 7ff3a559a640 1 -- 172.21.15.123:0/1226512833 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff390032920 con 0x7ff3a81072e0 2024-08-18T21:59:12.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.472+0000 7ff3a559a640 1 -- 172.21.15.123:0/1226512833 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff390030810 con 0x7ff3a81072e0 2024-08-18T21:59:12.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.473+0000 7ff3acbd6640 1 -- 172.21.15.123:0/1226512833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a81072e0 msgr2=0x7ff3a81076e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:12.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.473+0000 7ff3acbd6640 1 --2- 172.21.15.123:0/1226512833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a81072e0 0x7ff3a81076e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff390009820 tx=0x7ff39002a270 comp rx=0 tx=0).stop 2024-08-18T21:59:12.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.473+0000 7ff3acbd6640 1 -- 172.21.15.123:0/1226512833 shutdown_connections 2024-08-18T21:59:12.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.473+0000 7ff3acbd6640 1 --2- 172.21.15.123:0/1226512833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a81072e0 0x7ff3a81076e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:12.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.473+0000 7ff3acbd6640 1 -- 172.21.15.123:0/1226512833 >> 172.21.15.123:0/1226512833 conn(0x7ff3a8102b30 msgr2=0x7ff3a8104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:12.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.473+0000 7ff3acbd6640 1 -- 172.21.15.123:0/1226512833 shutdown_connections 2024-08-18T21:59:12.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.473+0000 7ff3acbd6640 1 -- 172.21.15.123:0/1226512833 wait complete. 2024-08-18T21:59:12.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.474+0000 7ff3acbd6640 1 Processor -- start 2024-08-18T21:59:12.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.474+0000 7ff3acbd6640 1 -- start start 2024-08-18T21:59:12.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.474+0000 7ff3acbd6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a81072e0 0x7ff3a819b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:12.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.474+0000 7ff3acbd6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a810b750 con 0x7ff3a81072e0 2024-08-18T21:59:12.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.474+0000 7ff3a659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a81072e0 0x7ff3a819b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:12.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.474+0000 7ff3a659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a81072e0 0x7ff3a819b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46160/0 (socket says 172.21.15.123:46160) 2024-08-18T21:59:12.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.474+0000 7ff3a659c640 1 -- 172.21.15.123:0/3960168884 learned_addr learned my addr 172.21.15.123:0/3960168884 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:12.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.474+0000 7ff3a659c640 1 -- 172.21.15.123:0/3960168884 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a819b7d0 con 0x7ff3a81072e0 2024-08-18T21:59:12.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.474+0000 7ff3a659c640 1 --2- 172.21.15.123:0/3960168884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a81072e0 0x7ff3a819b290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff390030380 tx=0x7ff390032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:12.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.474+0000 7ff39f7fe640 1 -- 172.21.15.123:0/3960168884 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff390037040 con 0x7ff3a81072e0 2024-08-18T21:59:12.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.474+0000 7ff3acbd6640 1 -- 172.21.15.123:0/3960168884 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a819ba60 con 0x7ff3a81072e0 2024-08-18T21:59:12.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.474+0000 7ff39f7fe640 1 -- 172.21.15.123:0/3960168884 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff390040070 con 0x7ff3a81072e0 2024-08-18T21:59:12.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.474+0000 7ff39f7fe640 1 -- 172.21.15.123:0/3960168884 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff39003a7b0 con 0x7ff3a81072e0 2024-08-18T21:59:12.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.475+0000 7ff3acbd6640 1 -- 172.21.15.123:0/3960168884 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a819e750 con 0x7ff3a81072e0 2024-08-18T21:59:12.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.476+0000 7ff39f7fe640 1 -- 172.21.15.123:0/3960168884 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7ff39003b420 con 0x7ff3a81072e0 2024-08-18T21:59:12.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.476+0000 7ff3acbd6640 1 -- 172.21.15.123:0/3960168884 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a8107760 con 0x7ff3a81072e0 2024-08-18T21:59:12.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.476+0000 7ff39f7fe640 1 --2- 172.21.15.123:0/3960168884 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff394038eb0 0x7ff39403b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:12.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.476+0000 7ff39f7fe640 1 -- 172.21.15.123:0/3960168884 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff39006c550 con 0x7ff3a81072e0 2024-08-18T21:59:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.476+0000 7ff3a5d9b640 1 --2- 172.21.15.123:0/3960168884 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff394038eb0 0x7ff39403b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.476+0000 7ff3a5d9b640 1 --2- 172.21.15.123:0/3960168884 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff394038eb0 0x7ff39403b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff3980098c0 tx=0x7ff398006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.480+0000 7ff39f7fe640 1 -- 172.21.15.123:0/3960168884 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff390043360 con 0x7ff3a81072e0 2024-08-18T21:59:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.522+0000 7ff39f7fe640 1 -- 172.21.15.123:0/3960168884 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7ff39003aa30 con 0x7ff3a81072e0 2024-08-18T21:59:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.655+0000 7ff3acbd6640 1 -- 172.21.15.123:0/3960168884 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7ff3a8103d50 con 0x7ff394038eb0 2024-08-18T21:59:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.750+0000 7ff39f7fe640 1 -- 172.21.15.123:0/3960168884 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7ff3a8103d50 con 0x7ff394038eb0 2024-08-18T21:59:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.752+0000 7ff3acbd6640 1 -- 172.21.15.123:0/3960168884 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff394038eb0 msgr2=0x7ff39403b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.752+0000 7ff3acbd6640 1 --2- 172.21.15.123:0/3960168884 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff394038eb0 0x7ff39403b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff3980098c0 tx=0x7ff398006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.752+0000 7ff3acbd6640 1 -- 172.21.15.123:0/3960168884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a81072e0 msgr2=0x7ff3a819b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.752+0000 7ff3acbd6640 1 --2- 172.21.15.123:0/3960168884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a81072e0 0x7ff3a819b290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff390030380 tx=0x7ff390032670 comp rx=0 tx=0).stop 2024-08-18T21:59:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.752+0000 7ff3acbd6640 1 -- 172.21.15.123:0/3960168884 shutdown_connections 2024-08-18T21:59:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.752+0000 7ff3acbd6640 1 --2- 172.21.15.123:0/3960168884 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff394038eb0 0x7ff39403b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:12.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.752+0000 7ff3acbd6640 1 --2- 172.21.15.123:0/3960168884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3a81072e0 0x7ff3a819b290 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:12.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.752+0000 7ff3acbd6640 1 -- 172.21.15.123:0/3960168884 >> 172.21.15.123:0/3960168884 conn(0x7ff3a8102b30 msgr2=0x7ff3a8103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:12.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.752+0000 7ff3acbd6640 1 -- 172.21.15.123:0/3960168884 shutdown_connections 2024-08-18T21:59:12.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:11.752+0000 7ff3acbd6640 1 -- 172.21.15.123:0/3960168884 wait complete. 2024-08-18T21:59:12.310 INFO:teuthology.orchestra.run.smithi123.stdout:Creating initial admin user... 2024-08-18T21:59:12.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:12 smithi123 ceph-mon[18462]: [18/Aug/2024:21:59:10] ENGINE Error in HTTPServer.serve 2024-08-18T21:59:12.510 INFO:journalctl@ceph.mon.a.smithi123.stdout: Traceback (most recent call last): 2024-08-18T21:59:12.510 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-18T21:59:12.510 INFO:journalctl@ceph.mon.a.smithi123.stdout: self._connections.run(self.expiration_interval) 2024-08-18T21:59:12.510 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-18T21:59:12.510 INFO:journalctl@ceph.mon.a.smithi123.stdout: self._run(expiration_interval) 2024-08-18T21:59:12.510 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-18T21:59:12.510 INFO:journalctl@ceph.mon.a.smithi123.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-18T21:59:12.510 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-18T21:59:12.510 INFO:journalctl@ceph.mon.a.smithi123.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-18T21:59:12.510 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-18T21:59:12.511 INFO:journalctl@ceph.mon.a.smithi123.stdout: s = self.context.wrap_socket( 2024-08-18T21:59:12.511 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-18T21:59:12.511 INFO:journalctl@ceph.mon.a.smithi123.stdout: return self.sslsocket_class._create( 2024-08-18T21:59:12.511 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-18T21:59:12.511 INFO:journalctl@ceph.mon.a.smithi123.stdout: self.do_handshake() 2024-08-18T21:59:12.511 INFO:journalctl@ceph.mon.a.smithi123.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-18T21:59:12.511 INFO:journalctl@ceph.mon.a.smithi123.stdout: self._sslobj.do_handshake() 2024-08-18T21:59:12.511 INFO:journalctl@ceph.mon.a.smithi123.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-18T21:59:12.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:12 smithi123 ceph-mon[18462]: mgrmap e12: x(active, since 2s) 2024-08-18T21:59:12.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:12 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:12.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:12 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:13.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:13 smithi123 ceph-mon[18462]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T21:59:13.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:13 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:13.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:13 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:14.443 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$5b7ZsX/tg5BgxTTgjbFDN.jcVRZ3WBffqII5TVWWFnAO6dYr7WB8C", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1724018353, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-18T21:59:14.443 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.784+0000 7ff6b148e640 1 Processor -- start 2024-08-18T21:59:14.443 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.784+0000 7ff6b148e640 1 -- start start 2024-08-18T21:59:14.443 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.784+0000 7ff6b148e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ac1077a0 0x7ff6ac107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:14.443 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.784+0000 7ff6b148e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac108170 con 0x7ff6ac1077a0 2024-08-18T21:59:14.443 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.785+0000 7ff6aaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ac1077a0 0x7ff6ac107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:14.443 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.785+0000 7ff6aaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ac1077a0 0x7ff6ac107ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33124/0 (socket says 172.21.15.123:33124) 2024-08-18T21:59:14.443 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.785+0000 7ff6aaffd640 1 -- 172.21.15.123:0/4149977043 learned_addr learned my addr 172.21.15.123:0/4149977043 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:14.443 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.785+0000 7ff6aaffd640 1 -- 172.21.15.123:0/4149977043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac106400 con 0x7ff6ac1077a0 2024-08-18T21:59:14.443 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.786+0000 7ff6aaffd640 1 --2- 172.21.15.123:0/4149977043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ac1077a0 0x7ff6ac107ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff694009820 tx=0x7ff69402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafd1754b01c5ca1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:14.443 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.786+0000 7ff6a9ffb640 1 -- 172.21.15.123:0/4149977043 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff694037070 con 0x7ff6ac1077a0 2024-08-18T21:59:14.443 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.786+0000 7ff6a9ffb640 1 -- 172.21.15.123:0/4149977043 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff694032920 con 0x7ff6ac1077a0 2024-08-18T21:59:14.443 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.786+0000 7ff6a9ffb640 1 -- 172.21.15.123:0/4149977043 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff694030810 con 0x7ff6ac1077a0 2024-08-18T21:59:14.444 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.787+0000 7ff6b148e640 1 -- 172.21.15.123:0/4149977043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ac1077a0 msgr2=0x7ff6ac107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:14.444 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.787+0000 7ff6b148e640 1 --2- 172.21.15.123:0/4149977043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ac1077a0 0x7ff6ac107ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff694009820 tx=0x7ff69402a270 comp rx=0 tx=0).stop 2024-08-18T21:59:14.444 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.787+0000 7ff6b148e640 1 -- 172.21.15.123:0/4149977043 shutdown_connections 2024-08-18T21:59:14.444 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.787+0000 7ff6b148e640 1 --2- 172.21.15.123:0/4149977043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ac1077a0 0x7ff6ac107ba0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:14.444 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.787+0000 7ff6b148e640 1 -- 172.21.15.123:0/4149977043 >> 172.21.15.123:0/4149977043 conn(0x7ff6ac101100 msgr2=0x7ff6ac103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:14.444 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.787+0000 7ff6b148e640 1 -- 172.21.15.123:0/4149977043 shutdown_connections 2024-08-18T21:59:14.444 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.787+0000 7ff6b148e640 1 -- 172.21.15.123:0/4149977043 wait complete. 2024-08-18T21:59:14.444 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.787+0000 7ff6b148e640 1 Processor -- start 2024-08-18T21:59:14.444 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.788+0000 7ff6b148e640 1 -- start start 2024-08-18T21:59:14.444 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.788+0000 7ff6b148e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ac1077a0 0x7ff6ac191410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:14.444 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.788+0000 7ff6b148e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac10a7c0 con 0x7ff6ac1077a0 2024-08-18T21:59:14.444 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.788+0000 7ff6aaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ac1077a0 0x7ff6ac191410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:14.445 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.788+0000 7ff6aaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ac1077a0 0x7ff6ac191410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33138/0 (socket says 172.21.15.123:33138) 2024-08-18T21:59:14.445 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.788+0000 7ff6aaffd640 1 -- 172.21.15.123:0/834875092 learned_addr learned my addr 172.21.15.123:0/834875092 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:14.445 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.788+0000 7ff6aaffd640 1 -- 172.21.15.123:0/834875092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac191950 con 0x7ff6ac1077a0 2024-08-18T21:59:14.445 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.788+0000 7ff6aaffd640 1 --2- 172.21.15.123:0/834875092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ac1077a0 0x7ff6ac191410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff694030380 tx=0x7ff694032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:14.445 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.789+0000 7ff6a3fff640 1 -- 172.21.15.123:0/834875092 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff694037040 con 0x7ff6ac1077a0 2024-08-18T21:59:14.445 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.789+0000 7ff6b148e640 1 -- 172.21.15.123:0/834875092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ac18fb40 con 0x7ff6ac1077a0 2024-08-18T21:59:14.445 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.789+0000 7ff6a3fff640 1 -- 172.21.15.123:0/834875092 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff694040070 con 0x7ff6ac1077a0 2024-08-18T21:59:14.445 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.789+0000 7ff6a3fff640 1 -- 172.21.15.123:0/834875092 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff69403a7b0 con 0x7ff6ac1077a0 2024-08-18T21:59:14.445 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.789+0000 7ff6b148e640 1 -- 172.21.15.123:0/834875092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ac190080 con 0x7ff6ac1077a0 2024-08-18T21:59:14.445 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.789+0000 7ff6a3fff640 1 -- 172.21.15.123:0/834875092 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7ff69403a9e0 con 0x7ff6ac1077a0 2024-08-18T21:59:14.445 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.790+0000 7ff6a3fff640 1 --2- 172.21.15.123:0/834875092 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff698039020 0x7ff69803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:14.445 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.790+0000 7ff6a3fff640 1 -- 172.21.15.123:0/834875092 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff69406db20 con 0x7ff6ac1077a0 2024-08-18T21:59:14.445 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.790+0000 7ff6aa7fc640 1 --2- 172.21.15.123:0/834875092 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff698039020 0x7ff69803b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:14.445 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.790+0000 7ff6b148e640 1 -- 172.21.15.123:0/834875092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ac107c20 con 0x7ff6ac1077a0 2024-08-18T21:59:14.446 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.790+0000 7ff6aa7fc640 1 --2- 172.21.15.123:0/834875092 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff698039020 0x7ff69803b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0098c0 tx=0x7ff69c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:14.446 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.795+0000 7ff6a3fff640 1 -- 172.21.15.123:0/834875092 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff694031560 con 0x7ff6ac1077a0 2024-08-18T21:59:14.446 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:12.983+0000 7ff6b148e640 1 -- 172.21.15.123:0/834875092 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7ff6ac195000 con 0x7ff698039020 2024-08-18T21:59:14.446 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:13.208+0000 7ff6a3fff640 1 -- 172.21.15.123:0/834875092 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7ff6ac195000 con 0x7ff698039020 2024-08-18T21:59:14.446 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:13.210+0000 7ff6b148e640 1 -- 172.21.15.123:0/834875092 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff698039020 msgr2=0x7ff69803b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:14.446 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:13.210+0000 7ff6b148e640 1 --2- 172.21.15.123:0/834875092 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff698039020 0x7ff69803b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0098c0 tx=0x7ff69c006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:14.446 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:13.210+0000 7ff6b148e640 1 -- 172.21.15.123:0/834875092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ac1077a0 msgr2=0x7ff6ac191410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:14.446 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:13.210+0000 7ff6b148e640 1 --2- 172.21.15.123:0/834875092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ac1077a0 0x7ff6ac191410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff694030380 tx=0x7ff694032670 comp rx=0 tx=0).stop 2024-08-18T21:59:14.446 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:13.210+0000 7ff6b148e640 1 -- 172.21.15.123:0/834875092 shutdown_connections 2024-08-18T21:59:14.446 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:13.210+0000 7ff6b148e640 1 --2- 172.21.15.123:0/834875092 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff698039020 0x7ff69803b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:14.446 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:13.210+0000 7ff6b148e640 1 --2- 172.21.15.123:0/834875092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ac1077a0 0x7ff6ac191410 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:14.446 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:13.211+0000 7ff6b148e640 1 -- 172.21.15.123:0/834875092 >> 172.21.15.123:0/834875092 conn(0x7ff6ac101100 msgr2=0x7ff6ac102020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:14.446 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:13.211+0000 7ff6b148e640 1 -- 172.21.15.123:0/834875092 shutdown_connections 2024-08-18T21:59:14.447 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:13.211+0000 7ff6b148e640 1 -- 172.21.15.123:0/834875092 wait complete. 2024-08-18T21:59:14.447 INFO:teuthology.orchestra.run.smithi123.stdout:Fetching dashboard port number... 2024-08-18T21:59:14.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:14 smithi123 ceph-mon[18462]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T21:59:15.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:15 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1352723268' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-08-18T21:59:15.598 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 8443 2024-08-18T21:59:15.599 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.865+0000 7f7dbad74640 1 Processor -- start 2024-08-18T21:59:15.599 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.865+0000 7f7dbad74640 1 -- start start 2024-08-18T21:59:15.599 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.865+0000 7f7dbad74640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db41072e0 0x7f7db41076e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:15.599 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.865+0000 7f7dbad74640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7db4107c20 con 0x7f7db41072e0 2024-08-18T21:59:15.599 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.865+0000 7f7db8b10640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db41072e0 0x7f7db41076e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:15.599 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.865+0000 7f7db8b10640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db41072e0 0x7f7db41076e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33140/0 (socket says 172.21.15.123:33140) 2024-08-18T21:59:15.599 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.865+0000 7f7db8b10640 1 -- 172.21.15.123:0/2927874050 learned_addr learned my addr 172.21.15.123:0/2927874050 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:15.599 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.865+0000 7f7db8b10640 1 -- 172.21.15.123:0/2927874050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db4107da0 con 0x7f7db41072e0 2024-08-18T21:59:15.599 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.866+0000 7f7db8b10640 1 --2- 172.21.15.123:0/2927874050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db41072e0 0x7f7db41076e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009820 tx=0x7f7da802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1989855340faa07c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:15.599 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.866+0000 7f7db37fe640 1 -- 172.21.15.123:0/2927874050 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da8037070 con 0x7f7db41072e0 2024-08-18T21:59:15.599 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.866+0000 7f7db37fe640 1 -- 172.21.15.123:0/2927874050 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7da8032920 con 0x7f7db41072e0 2024-08-18T21:59:15.600 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.866+0000 7f7db37fe640 1 -- 172.21.15.123:0/2927874050 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da8030810 con 0x7f7db41072e0 2024-08-18T21:59:15.600 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.867+0000 7f7dbad74640 1 -- 172.21.15.123:0/2927874050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db41072e0 msgr2=0x7f7db41076e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:15.600 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.867+0000 7f7dbad74640 1 --2- 172.21.15.123:0/2927874050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db41072e0 0x7f7db41076e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009820 tx=0x7f7da802a270 comp rx=0 tx=0).stop 2024-08-18T21:59:15.600 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.867+0000 7f7dbad74640 1 -- 172.21.15.123:0/2927874050 shutdown_connections 2024-08-18T21:59:15.600 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.867+0000 7f7dbad74640 1 --2- 172.21.15.123:0/2927874050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db41072e0 0x7f7db41076e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:15.600 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.867+0000 7f7dbad74640 1 -- 172.21.15.123:0/2927874050 >> 172.21.15.123:0/2927874050 conn(0x7f7db4102b30 msgr2=0x7f7db4104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:15.600 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.867+0000 7f7dbad74640 1 -- 172.21.15.123:0/2927874050 shutdown_connections 2024-08-18T21:59:15.600 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.867+0000 7f7dbad74640 1 -- 172.21.15.123:0/2927874050 wait complete. 2024-08-18T21:59:15.600 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.867+0000 7f7dbad74640 1 Processor -- start 2024-08-18T21:59:15.600 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.868+0000 7f7dbad74640 1 -- start start 2024-08-18T21:59:15.600 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.868+0000 7f7dbad74640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db41072e0 0x7f7db419b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:15.600 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.868+0000 7f7dbad74640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7db410b750 con 0x7f7db41072e0 2024-08-18T21:59:15.600 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.868+0000 7f7db8b10640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db41072e0 0x7f7db419b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:15.601 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.868+0000 7f7db8b10640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db41072e0 0x7f7db419b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33148/0 (socket says 172.21.15.123:33148) 2024-08-18T21:59:15.601 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.868+0000 7f7db8b10640 1 -- 172.21.15.123:0/1352723268 learned_addr learned my addr 172.21.15.123:0/1352723268 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:15.601 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.868+0000 7f7db8b10640 1 -- 172.21.15.123:0/1352723268 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db419b7d0 con 0x7f7db41072e0 2024-08-18T21:59:15.601 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.868+0000 7f7db8b10640 1 --2- 172.21.15.123:0/1352723268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db41072e0 0x7f7db419b290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7da8030380 tx=0x7f7da8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:15.601 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.868+0000 7f7db1ffb640 1 -- 172.21.15.123:0/1352723268 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da8037040 con 0x7f7db41072e0 2024-08-18T21:59:15.601 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.868+0000 7f7db1ffb640 1 -- 172.21.15.123:0/1352723268 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7da8040070 con 0x7f7db41072e0 2024-08-18T21:59:15.601 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.868+0000 7f7dbad74640 1 -- 172.21.15.123:0/1352723268 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db419ba60 con 0x7f7db41072e0 2024-08-18T21:59:15.601 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.868+0000 7f7db1ffb640 1 -- 172.21.15.123:0/1352723268 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da803a7b0 con 0x7f7db41072e0 2024-08-18T21:59:15.601 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.868+0000 7f7dbad74640 1 -- 172.21.15.123:0/1352723268 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db419e750 con 0x7f7db41072e0 2024-08-18T21:59:15.601 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.869+0000 7f7db1ffb640 1 -- 172.21.15.123:0/1352723268 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f7da803a9e0 con 0x7f7db41072e0 2024-08-18T21:59:15.601 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.869+0000 7f7dbad74640 1 -- 172.21.15.123:0/1352723268 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db4107760 con 0x7f7db41072e0 2024-08-18T21:59:15.601 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.870+0000 7f7db1ffb640 1 --2- 172.21.15.123:0/1352723268 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7da4039020 0x7f7da403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:15.601 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.870+0000 7f7db1ffb640 1 -- 172.21.15.123:0/1352723268 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7da806c700 con 0x7f7db41072e0 2024-08-18T21:59:15.601 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.870+0000 7f7db3fff640 1 --2- 172.21.15.123:0/1352723268 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7da4039020 0x7f7da403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:15.602 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.870+0000 7f7db3fff640 1 --2- 172.21.15.123:0/1352723268 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7da4039020 0x7f7da403b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7da00098c0 tx=0x7f7da0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:15.602 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:14.874+0000 7f7db1ffb640 1 -- 172.21.15.123:0/1352723268 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7da8044c70 con 0x7f7db41072e0 2024-08-18T21:59:15.602 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.042+0000 7f7dbad74640 1 -- 172.21.15.123:0/1352723268 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f7db419e920 con 0x7f7db41072e0 2024-08-18T21:59:15.602 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.043+0000 7f7db1ffb640 1 -- 172.21.15.123:0/1352723268 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f7da8041270 con 0x7f7db41072e0 2024-08-18T21:59:15.602 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.045+0000 7f7dbad74640 1 -- 172.21.15.123:0/1352723268 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7da4039020 msgr2=0x7f7da403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:15.602 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.045+0000 7f7dbad74640 1 --2- 172.21.15.123:0/1352723268 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7da4039020 0x7f7da403b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7da00098c0 tx=0x7f7da0006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:15.602 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.045+0000 7f7dbad74640 1 -- 172.21.15.123:0/1352723268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db41072e0 msgr2=0x7f7db419b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:15.602 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.045+0000 7f7dbad74640 1 --2- 172.21.15.123:0/1352723268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db41072e0 0x7f7db419b290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7da8030380 tx=0x7f7da8032670 comp rx=0 tx=0).stop 2024-08-18T21:59:15.602 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.045+0000 7f7dbad74640 1 -- 172.21.15.123:0/1352723268 shutdown_connections 2024-08-18T21:59:15.602 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.045+0000 7f7dbad74640 1 --2- 172.21.15.123:0/1352723268 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7da4039020 0x7f7da403b4e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:15.602 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.045+0000 7f7dbad74640 1 --2- 172.21.15.123:0/1352723268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db41072e0 0x7f7db419b290 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:15.603 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.045+0000 7f7dbad74640 1 -- 172.21.15.123:0/1352723268 >> 172.21.15.123:0/1352723268 conn(0x7f7db4102b30 msgr2=0x7f7db4103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:15.603 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.045+0000 7f7dbad74640 1 -- 172.21.15.123:0/1352723268 shutdown_connections 2024-08-18T21:59:15.603 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.045+0000 7f7dbad74640 1 -- 172.21.15.123:0/1352723268 wait complete. 2024-08-18T21:59:15.605 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-18T21:59:15.605 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-08-18T21:59:15.612 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-18T21:59:15.612 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-08-18T21:59:15.612 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-08-18T21:59:15.612 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-18T21:59:15.614 INFO:teuthology.orchestra.run.smithi123.stdout:Ceph Dashboard is now available at: 2024-08-18T21:59:15.614 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:59:15.614 INFO:teuthology.orchestra.run.smithi123.stdout: URL: https://smithi123:8443/ 2024-08-18T21:59:15.614 INFO:teuthology.orchestra.run.smithi123.stdout: User: admin 2024-08-18T21:59:15.614 INFO:teuthology.orchestra.run.smithi123.stdout: Password: os02wfu1gd 2024-08-18T21:59:15.614 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:59:15.614 INFO:teuthology.orchestra.run.smithi123.stdout:Saving cluster configuration to /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config directory 2024-08-18T21:59:16.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:16 smithi123 ceph-mon[18462]: mgrmap e13: x(active, since 6s) 2024-08-18T21:59:16.858 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.987+0000 7fa124302640 1 Processor -- start 2024-08-18T21:59:16.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.987+0000 7fa124302640 1 -- start start 2024-08-18T21:59:16.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.987+0000 7fa124302640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa11c1072e0 0x7fa11c1076e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:16.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.987+0000 7fa124302640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c107c20 con 0x7fa11c1072e0 2024-08-18T21:59:16.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.987+0000 7fa12209e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa11c1072e0 0x7fa11c1076e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:16.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.987+0000 7fa12209e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa11c1072e0 0x7fa11c1076e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33154/0 (socket says 172.21.15.123:33154) 2024-08-18T21:59:16.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.987+0000 7fa12209e640 1 -- 172.21.15.123:0/3028718076 learned_addr learned my addr 172.21.15.123:0/3028718076 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:16.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.988+0000 7fa12209e640 1 -- 172.21.15.123:0/3028718076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11c107da0 con 0x7fa11c1072e0 2024-08-18T21:59:16.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.988+0000 7fa12209e640 1 --2- 172.21.15.123:0/3028718076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa11c1072e0 0x7fa11c1076e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa118009820 tx=0x7fa11802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16789ae0361dff19 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:16.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.988+0000 7fa12109c640 1 -- 172.21.15.123:0/3028718076 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa118037070 con 0x7fa11c1072e0 2024-08-18T21:59:16.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.989+0000 7fa12109c640 1 -- 172.21.15.123:0/3028718076 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa118032920 con 0x7fa11c1072e0 2024-08-18T21:59:16.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.989+0000 7fa12109c640 1 -- 172.21.15.123:0/3028718076 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa118030810 con 0x7fa11c1072e0 2024-08-18T21:59:16.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.989+0000 7fa124302640 1 -- 172.21.15.123:0/3028718076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa11c1072e0 msgr2=0x7fa11c1076e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:16.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.989+0000 7fa124302640 1 --2- 172.21.15.123:0/3028718076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa11c1072e0 0x7fa11c1076e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa118009820 tx=0x7fa11802a270 comp rx=0 tx=0).stop 2024-08-18T21:59:16.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.989+0000 7fa124302640 1 -- 172.21.15.123:0/3028718076 shutdown_connections 2024-08-18T21:59:16.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.989+0000 7fa124302640 1 --2- 172.21.15.123:0/3028718076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa11c1072e0 0x7fa11c1076e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:16.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.989+0000 7fa124302640 1 -- 172.21.15.123:0/3028718076 >> 172.21.15.123:0/3028718076 conn(0x7fa11c102b30 msgr2=0x7fa11c104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:16.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.989+0000 7fa124302640 1 -- 172.21.15.123:0/3028718076 shutdown_connections 2024-08-18T21:59:16.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.989+0000 7fa124302640 1 -- 172.21.15.123:0/3028718076 wait complete. 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.990+0000 7fa124302640 1 Processor -- start 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.990+0000 7fa124302640 1 -- start start 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.990+0000 7fa124302640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa11c1072e0 0x7fa11c19d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.990+0000 7fa124302640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c10b750 con 0x7fa11c1072e0 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.990+0000 7fa12209e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa11c1072e0 0x7fa11c19d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.990+0000 7fa12209e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa11c1072e0 0x7fa11c19d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33160/0 (socket says 172.21.15.123:33160) 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.990+0000 7fa12209e640 1 -- 172.21.15.123:0/831259078 learned_addr learned my addr 172.21.15.123:0/831259078 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.990+0000 7fa12209e640 1 -- 172.21.15.123:0/831259078 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11c19d9d0 con 0x7fa11c1072e0 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.990+0000 7fa12209e640 1 --2- 172.21.15.123:0/831259078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa11c1072e0 0x7fa11c19d490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa118030380 tx=0x7fa118032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.991+0000 7fa1137fe640 1 -- 172.21.15.123:0/831259078 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa118037040 con 0x7fa11c1072e0 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.991+0000 7fa1137fe640 1 -- 172.21.15.123:0/831259078 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa118040070 con 0x7fa11c1072e0 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.991+0000 7fa124302640 1 -- 172.21.15.123:0/831259078 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa11c19dc60 con 0x7fa11c1072e0 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.991+0000 7fa1137fe640 1 -- 172.21.15.123:0/831259078 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa11803a7b0 con 0x7fa11c1072e0 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.991+0000 7fa124302640 1 -- 172.21.15.123:0/831259078 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa11c1a0950 con 0x7fa11c1072e0 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.991+0000 7fa1137fe640 1 -- 172.21.15.123:0/831259078 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fa11803b420 con 0x7fa11c1072e0 2024-08-18T21:59:16.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.992+0000 7fa124302640 1 -- 172.21.15.123:0/831259078 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa11c107760 con 0x7fa11c1072e0 2024-08-18T21:59:16.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.992+0000 7fa1137fe640 1 --2- 172.21.15.123:0/831259078 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa108039060 0x7fa10803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:16.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.992+0000 7fa1137fe640 1 -- 172.21.15.123:0/831259078 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa11806c810 con 0x7fa11c1072e0 2024-08-18T21:59:16.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.992+0000 7fa12189d640 1 --2- 172.21.15.123:0/831259078 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa108039060 0x7fa10803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:16.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.992+0000 7fa12189d640 1 --2- 172.21.15.123:0/831259078 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa108039060 0x7fa10803b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0098c0 tx=0x7fa10c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:16.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:15.997+0000 7fa1137fe640 1 -- 172.21.15.123:0/831259078 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa118038280 con 0x7fa11c1072e0 2024-08-18T21:59:16.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:16.248+0000 7fa124302640 1 -- 172.21.15.123:0/831259078 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fa11c1a0b20 con 0x7fa11c1072e0 2024-08-18T21:59:16.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:16.251+0000 7fa1137fe640 1 -- 172.21.15.123:0/831259078 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7fa11803bc00 con 0x7fa11c1072e0 2024-08-18T21:59:16.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-18T21:59:16.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:16.253+0000 7fa124302640 1 -- 172.21.15.123:0/831259078 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa108039060 msgr2=0x7fa10803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:16.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:16.253+0000 7fa124302640 1 --2- 172.21.15.123:0/831259078 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa108039060 0x7fa10803b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0098c0 tx=0x7fa10c006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:16.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:16.253+0000 7fa124302640 1 -- 172.21.15.123:0/831259078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa11c1072e0 msgr2=0x7fa11c19d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:16.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:16.253+0000 7fa124302640 1 --2- 172.21.15.123:0/831259078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa11c1072e0 0x7fa11c19d490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa118030380 tx=0x7fa118032670 comp rx=0 tx=0).stop 2024-08-18T21:59:16.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:16.253+0000 7fa124302640 1 -- 172.21.15.123:0/831259078 shutdown_connections 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:16.253+0000 7fa124302640 1 --2- 172.21.15.123:0/831259078 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa108039060 0x7fa10803b520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:16.253+0000 7fa124302640 1 --2- 172.21.15.123:0/831259078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa11c1072e0 0x7fa11c19d490 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:16.253+0000 7fa124302640 1 -- 172.21.15.123:0/831259078 >> 172.21.15.123:0/831259078 conn(0x7fa11c102b30 msgr2=0x7fa11c103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:16.254+0000 7fa124302640 1 -- 172.21.15.123:0/831259078 shutdown_connections 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-08-18T21:59:16.254+0000 7fa124302640 1 -- 172.21.15.123:0/831259078 wait complete. 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout:Or, if you are only running a single cluster on this host: 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:59:16.867 INFO:teuthology.orchestra.run.smithi123.stdout: ceph telemetry on 2024-08-18T21:59:16.868 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:59:16.868 INFO:teuthology.orchestra.run.smithi123.stdout:For more information see: 2024-08-18T21:59:16.868 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:59:16.868 INFO:teuthology.orchestra.run.smithi123.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-18T21:59:16.868 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:59:16.868 INFO:teuthology.orchestra.run.smithi123.stdout:Bootstrap complete. 2024-08-18T21:59:16.901 INFO:tasks.cephadm:Fetching config... 2024-08-18T21:59:16.902 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T21:59:16.902 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-18T21:59:16.918 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-18T21:59:16.918 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T21:59:16.918 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-18T21:59:16.974 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-18T21:59:16.974 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T21:59:16.974 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-18T21:59:17.039 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-18T21:59:17.039 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T21:59:17.039 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-18T21:59:17.095 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-18T21:59:17.095 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzgsMJTbP8dMdSaAchB9+jlgCA1FJEYQz0RTIVf3DVZ1DN2+Un24QJntyYJ41m6C9+lSsQQztV5BUul8Ybmv0H63VqUAw8r+5ejFaaf+SfK4AlCgPjqYgR0aEwQL4rRUcLuXNYeUxEUSod3bScIJFtvfMMIuvqXVTVb+mmmLk7QvorrQAIAy1FH2M5sJf7JxNc/zArovneGquwsKNdeePKilLN2OL91FD20nniFxan6ltWgyjRfq8QdgShB2okyN69h4D70se2LRYvHDTo86UcKgM099TKWB13t+OrgMs54xZF3vDssmaauXgSpxs9R3RwgizvK2ebDgeB6Wj+C589UtpkeqE/qSzOs0Pf9llbMXkZIhAlUY7NkjeKJLNDBl4JBNGzylwkAI2lnQ2CD5KFTalTR8bFZdjZZCF/nD9Zfl4hktbroLYD//zY9vhuGiGCnXfOhreB5R7SSD+XTawlyF1L8TAwH5GeH7Tlk30Nj4/Y7bDn25Qoczlt4WXCurk= ceph-dfa1db70-5dac-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-18T21:59:17.180 INFO:teuthology.orchestra.run.smithi123.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzgsMJTbP8dMdSaAchB9+jlgCA1FJEYQz0RTIVf3DVZ1DN2+Un24QJntyYJ41m6C9+lSsQQztV5BUul8Ybmv0H63VqUAw8r+5ejFaaf+SfK4AlCgPjqYgR0aEwQL4rRUcLuXNYeUxEUSod3bScIJFtvfMMIuvqXVTVb+mmmLk7QvorrQAIAy1FH2M5sJf7JxNc/zArovneGquwsKNdeePKilLN2OL91FD20nniFxan6ltWgyjRfq8QdgShB2okyN69h4D70se2LRYvHDTo86UcKgM099TKWB13t+OrgMs54xZF3vDssmaauXgSpxs9R3RwgizvK2ebDgeB6Wj+C589UtpkeqE/qSzOs0Pf9llbMXkZIhAlUY7NkjeKJLNDBl4JBNGzylwkAI2lnQ2CD5KFTalTR8bFZdjZZCF/nD9Zfl4hktbroLYD//zY9vhuGiGCnXfOhreB5R7SSD+XTawlyF1L8TAwH5GeH7Tlk30Nj4/Y7bDn25Qoczlt4WXCurk= ceph-dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:59:17.196 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzgsMJTbP8dMdSaAchB9+jlgCA1FJEYQz0RTIVf3DVZ1DN2+Un24QJntyYJ41m6C9+lSsQQztV5BUul8Ybmv0H63VqUAw8r+5ejFaaf+SfK4AlCgPjqYgR0aEwQL4rRUcLuXNYeUxEUSod3bScIJFtvfMMIuvqXVTVb+mmmLk7QvorrQAIAy1FH2M5sJf7JxNc/zArovneGquwsKNdeePKilLN2OL91FD20nniFxan6ltWgyjRfq8QdgShB2okyN69h4D70se2LRYvHDTo86UcKgM099TKWB13t+OrgMs54xZF3vDssmaauXgSpxs9R3RwgizvK2ebDgeB6Wj+C589UtpkeqE/qSzOs0Pf9llbMXkZIhAlUY7NkjeKJLNDBl4JBNGzylwkAI2lnQ2CD5KFTalTR8bFZdjZZCF/nD9Zfl4hktbroLYD//zY9vhuGiGCnXfOhreB5R7SSD+XTawlyF1L8TAwH5GeH7Tlk30Nj4/Y7bDn25Qoczlt4WXCurk= ceph-dfa1db70-5dac-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-18T21:59:17.252 INFO:teuthology.orchestra.run.smithi130.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzgsMJTbP8dMdSaAchB9+jlgCA1FJEYQz0RTIVf3DVZ1DN2+Un24QJntyYJ41m6C9+lSsQQztV5BUul8Ybmv0H63VqUAw8r+5ejFaaf+SfK4AlCgPjqYgR0aEwQL4rRUcLuXNYeUxEUSod3bScIJFtvfMMIuvqXVTVb+mmmLk7QvorrQAIAy1FH2M5sJf7JxNc/zArovneGquwsKNdeePKilLN2OL91FD20nniFxan6ltWgyjRfq8QdgShB2okyN69h4D70se2LRYvHDTo86UcKgM099TKWB13t+OrgMs54xZF3vDssmaauXgSpxs9R3RwgizvK2ebDgeB6Wj+C589UtpkeqE/qSzOs0Pf9llbMXkZIhAlUY7NkjeKJLNDBl4JBNGzylwkAI2lnQ2CD5KFTalTR8bFZdjZZCF/nD9Zfl4hktbroLYD//zY9vhuGiGCnXfOhreB5R7SSD+XTawlyF1L8TAwH5GeH7Tlk30Nj4/Y7bDn25Qoczlt4WXCurk= ceph-dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:59:17.264 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzgsMJTbP8dMdSaAchB9+jlgCA1FJEYQz0RTIVf3DVZ1DN2+Un24QJntyYJ41m6C9+lSsQQztV5BUul8Ybmv0H63VqUAw8r+5ejFaaf+SfK4AlCgPjqYgR0aEwQL4rRUcLuXNYeUxEUSod3bScIJFtvfMMIuvqXVTVb+mmmLk7QvorrQAIAy1FH2M5sJf7JxNc/zArovneGquwsKNdeePKilLN2OL91FD20nniFxan6ltWgyjRfq8QdgShB2okyN69h4D70se2LRYvHDTo86UcKgM099TKWB13t+OrgMs54xZF3vDssmaauXgSpxs9R3RwgizvK2ebDgeB6Wj+C589UtpkeqE/qSzOs0Pf9llbMXkZIhAlUY7NkjeKJLNDBl4JBNGzylwkAI2lnQ2CD5KFTalTR8bFZdjZZCF/nD9Zfl4hktbroLYD//zY9vhuGiGCnXfOhreB5R7SSD+XTawlyF1L8TAwH5GeH7Tlk30Nj4/Y7bDn25Qoczlt4WXCurk= ceph-dfa1db70-5dac-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-18T21:59:17.321 INFO:teuthology.orchestra.run.smithi183.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzgsMJTbP8dMdSaAchB9+jlgCA1FJEYQz0RTIVf3DVZ1DN2+Un24QJntyYJ41m6C9+lSsQQztV5BUul8Ybmv0H63VqUAw8r+5ejFaaf+SfK4AlCgPjqYgR0aEwQL4rRUcLuXNYeUxEUSod3bScIJFtvfMMIuvqXVTVb+mmmLk7QvorrQAIAy1FH2M5sJf7JxNc/zArovneGquwsKNdeePKilLN2OL91FD20nniFxan6ltWgyjRfq8QdgShB2okyN69h4D70se2LRYvHDTo86UcKgM099TKWB13t+OrgMs54xZF3vDssmaauXgSpxs9R3RwgizvK2ebDgeB6Wj+C589UtpkeqE/qSzOs0Pf9llbMXkZIhAlUY7NkjeKJLNDBl4JBNGzylwkAI2lnQ2CD5KFTalTR8bFZdjZZCF/nD9Zfl4hktbroLYD//zY9vhuGiGCnXfOhreB5R7SSD+XTawlyF1L8TAwH5GeH7Tlk30Nj4/Y7bDn25Qoczlt4WXCurk= ceph-dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:59:17.334 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-18T21:59:17.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:17 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/831259078' entity='client.admin' 2024-08-18T21:59:17.590 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T21:59:18.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.012+0000 7fd126c6e640 1 -- 172.21.15.123:0/1601617694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd120100260 msgr2=0x7fd120100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:18.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.012+0000 7fd126c6e640 1 --2- 172.21.15.123:0/1601617694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd120100260 0x7fd120100660 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd114009880 tx=0x7fd11402a5d0 comp rx=0 tx=0).stop 2024-08-18T21:59:18.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.013+0000 7fd126c6e640 1 -- 172.21.15.123:0/1601617694 shutdown_connections 2024-08-18T21:59:18.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.013+0000 7fd126c6e640 1 --2- 172.21.15.123:0/1601617694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd120100260 0x7fd120100660 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:18.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.013+0000 7fd126c6e640 1 -- 172.21.15.123:0/1601617694 >> 172.21.15.123:0/1601617694 conn(0x7fd1200fb9d0 msgr2=0x7fd1200fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:18.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.013+0000 7fd126c6e640 1 -- 172.21.15.123:0/1601617694 shutdown_connections 2024-08-18T21:59:18.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.013+0000 7fd126c6e640 1 -- 172.21.15.123:0/1601617694 wait complete. 2024-08-18T21:59:18.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.013+0000 7fd126c6e640 1 Processor -- start 2024-08-18T21:59:18.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.013+0000 7fd126c6e640 1 -- start start 2024-08-18T21:59:18.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.013+0000 7fd126c6e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd120100260 0x7fd1201959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:18.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.013+0000 7fd126c6e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd120106370 con 0x7fd120100260 2024-08-18T21:59:18.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.013+0000 7fd124a0a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd120100260 0x7fd1201959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:18.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.013+0000 7fd124a0a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd120100260 0x7fd1201959f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33180/0 (socket says 172.21.15.123:33180) 2024-08-18T21:59:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.013+0000 7fd124a0a640 1 -- 172.21.15.123:0/2474079233 learned_addr learned my addr 172.21.15.123:0/2474079233 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.014+0000 7fd124a0a640 1 -- 172.21.15.123:0/2474079233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd120195f30 con 0x7fd120100260 2024-08-18T21:59:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.014+0000 7fd124a0a640 1 --2- 172.21.15.123:0/2474079233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd120100260 0x7fd1201959f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd114004f60 tx=0x7fd1140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.014+0000 7fd11dffb640 1 -- 172.21.15.123:0/2474079233 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd11403f070 con 0x7fd120100260 2024-08-18T21:59:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.014+0000 7fd11dffb640 1 -- 172.21.15.123:0/2474079233 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd114004d40 con 0x7fd120100260 2024-08-18T21:59:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.014+0000 7fd126c6e640 1 -- 172.21.15.123:0/2474079233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1201961c0 con 0x7fd120100260 2024-08-18T21:59:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.014+0000 7fd11dffb640 1 -- 172.21.15.123:0/2474079233 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd114035030 con 0x7fd120100260 2024-08-18T21:59:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.014+0000 7fd126c6e640 1 -- 172.21.15.123:0/2474079233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd120198eb0 con 0x7fd120100260 2024-08-18T21:59:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.015+0000 7fd11dffb640 1 -- 172.21.15.123:0/2474079233 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fd114042070 con 0x7fd120100260 2024-08-18T21:59:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.015+0000 7fd126c6e640 1 -- 172.21.15.123:0/2474079233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd120106af0 con 0x7fd120100260 2024-08-18T21:59:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.015+0000 7fd11dffb640 1 --2- 172.21.15.123:0/2474079233 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd110039060 0x7fd11003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.016+0000 7fd11dffb640 1 -- 172.21.15.123:0/2474079233 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd11406ce30 con 0x7fd120100260 2024-08-18T21:59:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.016+0000 7fd11ffff640 1 --2- 172.21.15.123:0/2474079233 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd110039060 0x7fd11003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:18.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.016+0000 7fd11ffff640 1 --2- 172.21.15.123:0/2474079233 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd110039060 0x7fd11003b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0098c0 tx=0x7fd10c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:18.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.020+0000 7fd11dffb640 1 -- 172.21.15.123:0/2474079233 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd11404ce10 con 0x7fd120100260 2024-08-18T21:59:18.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.189+0000 7fd126c6e640 1 -- 172.21.15.123:0/2474079233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fd12002d650 con 0x7fd120100260 2024-08-18T21:59:18.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.191+0000 7fd11dffb640 1 -- 172.21.15.123:0/2474079233 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fd1140307a0 con 0x7fd120100260 2024-08-18T21:59:18.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.193+0000 7fd126c6e640 1 -- 172.21.15.123:0/2474079233 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd110039060 msgr2=0x7fd11003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:18.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.193+0000 7fd126c6e640 1 --2- 172.21.15.123:0/2474079233 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd110039060 0x7fd11003b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0098c0 tx=0x7fd10c006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:18.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.193+0000 7fd126c6e640 1 -- 172.21.15.123:0/2474079233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd120100260 msgr2=0x7fd1201959f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:18.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.193+0000 7fd126c6e640 1 --2- 172.21.15.123:0/2474079233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd120100260 0x7fd1201959f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd114004f60 tx=0x7fd1140048f0 comp rx=0 tx=0).stop 2024-08-18T21:59:18.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.193+0000 7fd126c6e640 1 -- 172.21.15.123:0/2474079233 shutdown_connections 2024-08-18T21:59:18.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.193+0000 7fd126c6e640 1 --2- 172.21.15.123:0/2474079233 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd110039060 0x7fd11003b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:18.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.193+0000 7fd126c6e640 1 --2- 172.21.15.123:0/2474079233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd120100260 0x7fd1201959f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:18.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.193+0000 7fd126c6e640 1 -- 172.21.15.123:0/2474079233 >> 172.21.15.123:0/2474079233 conn(0x7fd1200fb9d0 msgr2=0x7fd1200fc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:18.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.193+0000 7fd126c6e640 1 -- 172.21.15.123:0/2474079233 shutdown_connections 2024-08-18T21:59:18.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:18.194+0000 7fd126c6e640 1 -- 172.21.15.123:0/2474079233 wait complete. 2024-08-18T21:59:18.794 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-18T21:59:18.794 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-18T21:59:19.215 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T21:59:19.410 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:19 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2474079233' entity='client.admin' 2024-08-18T21:59:19.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.671+0000 7f606bf7b640 1 -- 172.21.15.123:0/3903825785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6064100250 msgr2=0x7f6064100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:19.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.671+0000 7f606bf7b640 1 --2- 172.21.15.123:0/3903825785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6064100250 0x7f6064100650 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6060009880 tx=0x7f606002a5d0 comp rx=0 tx=0).stop 2024-08-18T21:59:19.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.671+0000 7f606bf7b640 1 -- 172.21.15.123:0/3903825785 shutdown_connections 2024-08-18T21:59:19.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.671+0000 7f606bf7b640 1 --2- 172.21.15.123:0/3903825785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6064100250 0x7f6064100650 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:19.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.671+0000 7f606bf7b640 1 -- 172.21.15.123:0/3903825785 >> 172.21.15.123:0/3903825785 conn(0x7f60640fb9e0 msgr2=0x7f60640fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:19.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.672+0000 7f606bf7b640 1 -- 172.21.15.123:0/3903825785 shutdown_connections 2024-08-18T21:59:19.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.672+0000 7f606bf7b640 1 -- 172.21.15.123:0/3903825785 wait complete. 2024-08-18T21:59:19.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.672+0000 7f606bf7b640 1 Processor -- start 2024-08-18T21:59:19.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.672+0000 7f606bf7b640 1 -- start start 2024-08-18T21:59:19.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.672+0000 7f606bf7b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6064100250 0x7f60640fd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:19.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.672+0000 7f606bf7b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6064106360 con 0x7f6064100250 2024-08-18T21:59:19.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.672+0000 7f6069d17640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6064100250 0x7f60640fd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:19.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.672+0000 7f6069d17640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6064100250 0x7f60640fd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33190/0 (socket says 172.21.15.123:33190) 2024-08-18T21:59:19.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.672+0000 7f6069d17640 1 -- 172.21.15.123:0/98316584 learned_addr learned my addr 172.21.15.123:0/98316584 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:19.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.673+0000 7f6069d17640 1 -- 172.21.15.123:0/98316584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60640fdde0 con 0x7f6064100250 2024-08-18T21:59:19.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.673+0000 7f6069d17640 1 --2- 172.21.15.123:0/98316584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6064100250 0x7f60640fd8a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6060004f60 tx=0x7f60600048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:19.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.673+0000 7f6056ffd640 1 -- 172.21.15.123:0/98316584 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606003f070 con 0x7f6064100250 2024-08-18T21:59:19.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.673+0000 7f6056ffd640 1 -- 172.21.15.123:0/98316584 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6060004d40 con 0x7f6064100250 2024-08-18T21:59:19.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.673+0000 7f606bf7b640 1 -- 172.21.15.123:0/98316584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60640fbfd0 con 0x7f6064100250 2024-08-18T21:59:19.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.673+0000 7f6056ffd640 1 -- 172.21.15.123:0/98316584 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6060035030 con 0x7f6064100250 2024-08-18T21:59:19.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.673+0000 7f606bf7b640 1 -- 172.21.15.123:0/98316584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60640fc510 con 0x7f6064100250 2024-08-18T21:59:19.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.674+0000 7f6056ffd640 1 -- 172.21.15.123:0/98316584 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f6060042070 con 0x7f6064100250 2024-08-18T21:59:19.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.674+0000 7f606bf7b640 1 -- 172.21.15.123:0/98316584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6064106ae0 con 0x7f6064100250 2024-08-18T21:59:19.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.674+0000 7f6056ffd640 1 --2- 172.21.15.123:0/98316584 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6050039060 0x7f605003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:19.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.674+0000 7f6056ffd640 1 -- 172.21.15.123:0/98316584 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f606006cdd0 con 0x7f6064100250 2024-08-18T21:59:19.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.674+0000 7f6069516640 1 --2- 172.21.15.123:0/98316584 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6050039060 0x7f605003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:19.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.675+0000 7f6069516640 1 --2- 172.21.15.123:0/98316584 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6050039060 0x7f605003b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f60580098c0 tx=0x7f6058006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:19.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.680+0000 7f6056ffd640 1 -- 172.21.15.123:0/98316584 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f60600035f0 con 0x7f6064100250 2024-08-18T21:59:19.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.849+0000 7f606bf7b640 1 -- 172.21.15.123:0/98316584 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f6064190040 con 0x7f6050039060 2024-08-18T21:59:19.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.852+0000 7f6056ffd640 1 -- 172.21.15.123:0/98316584 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6064190040 con 0x7f6050039060 2024-08-18T21:59:19.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.855+0000 7f606bf7b640 1 -- 172.21.15.123:0/98316584 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6050039060 msgr2=0x7f605003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:19.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.855+0000 7f606bf7b640 1 --2- 172.21.15.123:0/98316584 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6050039060 0x7f605003b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f60580098c0 tx=0x7f6058006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:19.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.855+0000 7f606bf7b640 1 -- 172.21.15.123:0/98316584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6064100250 msgr2=0x7f60640fd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:19.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.855+0000 7f606bf7b640 1 --2- 172.21.15.123:0/98316584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6064100250 0x7f60640fd8a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6060004f60 tx=0x7f60600048f0 comp rx=0 tx=0).stop 2024-08-18T21:59:19.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.855+0000 7f606bf7b640 1 -- 172.21.15.123:0/98316584 shutdown_connections 2024-08-18T21:59:19.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.855+0000 7f606bf7b640 1 --2- 172.21.15.123:0/98316584 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6050039060 0x7f605003b520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:19.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.855+0000 7f606bf7b640 1 --2- 172.21.15.123:0/98316584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6064100250 0x7f60640fd8a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:19.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.855+0000 7f606bf7b640 1 -- 172.21.15.123:0/98316584 >> 172.21.15.123:0/98316584 conn(0x7f60640fb9e0 msgr2=0x7f606406a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:19.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.855+0000 7f606bf7b640 1 -- 172.21.15.123:0/98316584 shutdown_connections 2024-08-18T21:59:19.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:19.855+0000 7f606bf7b640 1 -- 172.21.15.123:0/98316584 wait complete. 2024-08-18T21:59:20.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:20.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:20.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi123", "name": "osd_memory_target"}]: dispatch 2024-08-18T21:59:20.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:20.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T21:59:20.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:20.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:20.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T21:59:20.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:20.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T21:59:20.582 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi130 2024-08-18T21:59:20.583 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-18T21:59:20.583 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/etc/ceph/ceph.conf 2024-08-18T21:59:20.603 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-18T21:59:20.603 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-18T21:59:20.661 INFO:tasks.cephadm:Adding host smithi130 to orchestrator... 2024-08-18T21:59:20.662 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch host add smithi130 2024-08-18T21:59:20.908 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T21:59:21.312 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:21 smithi123 ceph-mon[18462]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T21:59:21.313 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:21 smithi123 ceph-mon[18462]: Updating smithi123:/etc/ceph/ceph.conf 2024-08-18T21:59:21.313 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:21 smithi123 ceph-mon[18462]: Updating smithi123:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T21:59:21.313 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:21 smithi123 ceph-mon[18462]: Updating smithi123:/etc/ceph/ceph.client.admin.keyring 2024-08-18T21:59:21.313 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:21 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:21.313 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:21 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:21.313 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:21 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:21.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.336+0000 7fbfcc48d640 1 -- 172.21.15.123:0/2136420323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc4106300 msgr2=0x7fbfc41066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:21.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.336+0000 7fbfcc48d640 1 --2- 172.21.15.123:0/2136420323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc4106300 0x7fbfc41066e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009c20 tx=0x7fbfb402aa90 comp rx=0 tx=0).stop 2024-08-18T21:59:21.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.336+0000 7fbfcc48d640 1 -- 172.21.15.123:0/2136420323 shutdown_connections 2024-08-18T21:59:21.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.336+0000 7fbfcc48d640 1 --2- 172.21.15.123:0/2136420323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc4106300 0x7fbfc41066e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.336+0000 7fbfcc48d640 1 -- 172.21.15.123:0/2136420323 >> 172.21.15.123:0/2136420323 conn(0x7fbfc4075f80 msgr2=0x7fbfc4076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.337+0000 7fbfcc48d640 1 -- 172.21.15.123:0/2136420323 shutdown_connections 2024-08-18T21:59:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.337+0000 7fbfcc48d640 1 -- 172.21.15.123:0/2136420323 wait complete. 2024-08-18T21:59:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.337+0000 7fbfcc48d640 1 Processor -- start 2024-08-18T21:59:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.337+0000 7fbfcc48d640 1 -- start start 2024-08-18T21:59:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.337+0000 7fbfcc48d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc4106300 0x7fbfc4196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.337+0000 7fbfcc48d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc410ba10 con 0x7fbfc4106300 2024-08-18T21:59:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.337+0000 7fbfca229640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc4106300 0x7fbfc4196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.337+0000 7fbfca229640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc4106300 0x7fbfc4196e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33216/0 (socket says 172.21.15.123:33216) 2024-08-18T21:59:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.337+0000 7fbfca229640 1 -- 172.21.15.123:0/510276465 learned_addr learned my addr 172.21.15.123:0/510276465 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.338+0000 7fbfca229640 1 -- 172.21.15.123:0/510276465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc41973c0 con 0x7fbfc4106300 2024-08-18T21:59:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.338+0000 7fbfca229640 1 --2- 172.21.15.123:0/510276465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc4106300 0x7fbfc4196e80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4005e30 tx=0x7fbfb402fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:21.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.338+0000 7fbfc37fe640 1 -- 172.21.15.123:0/510276465 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb4047070 con 0x7fbfc4106300 2024-08-18T21:59:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.338+0000 7fbfcc48d640 1 -- 172.21.15.123:0/510276465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc4197650 con 0x7fbfc4106300 2024-08-18T21:59:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.338+0000 7fbfc37fe640 1 -- 172.21.15.123:0/510276465 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfb4003df0 con 0x7fbfc4106300 2024-08-18T21:59:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.338+0000 7fbfc37fe640 1 -- 172.21.15.123:0/510276465 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb4033050 con 0x7fbfc4106300 2024-08-18T21:59:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.338+0000 7fbfcc48d640 1 -- 172.21.15.123:0/510276465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc419b750 con 0x7fbfc4106300 2024-08-18T21:59:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.339+0000 7fbfc37fe640 1 -- 172.21.15.123:0/510276465 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fbfb404a070 con 0x7fbfc4106300 2024-08-18T21:59:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.339+0000 7fbfcc48d640 1 -- 172.21.15.123:0/510276465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc4102a60 con 0x7fbfc4106300 2024-08-18T21:59:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.339+0000 7fbfc37fe640 1 --2- 172.21.15.123:0/510276465 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbfac039060 0x7fbfac03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.339+0000 7fbfc37fe640 1 -- 172.21.15.123:0/510276465 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbfb403e030 con 0x7fbfc4106300 2024-08-18T21:59:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.339+0000 7fbfc9a28640 1 --2- 172.21.15.123:0/510276465 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbfac039060 0x7fbfac03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.340+0000 7fbfc9a28640 1 --2- 172.21.15.123:0/510276465 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbfac039060 0x7fbfac03b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80098c0 tx=0x7fbfb8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:21.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.344+0000 7fbfc37fe640 1 -- 172.21.15.123:0/510276465 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbfb404a360 con 0x7fbfc4106300 2024-08-18T21:59:21.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:21.512+0000 7fbfcc48d640 1 -- 172.21.15.123:0/510276465 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi130", "target": ["mon-mgr", ""]}) -- 0x7fbfc4106760 con 0x7fbfac039060 2024-08-18T21:59:22.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:22 smithi123 ceph-mon[18462]: Updating smithi123:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T21:59:23.509 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:23 smithi123 ceph-mon[18462]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi130", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T21:59:23.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:23 smithi123 ceph-mon[18462]: Deploying cephadm binary to smithi130 2024-08-18T21:59:24.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:24.629+0000 7fbfc37fe640 1 -- 172.21.15.123:0/510276465 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fbfc4106760 con 0x7fbfac039060 2024-08-18T21:59:24.630 INFO:teuthology.orchestra.run.smithi123.stdout:Added host 'smithi130' with addr '172.21.15.130' 2024-08-18T21:59:24.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:24.631+0000 7fbfcc48d640 1 -- 172.21.15.123:0/510276465 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbfac039060 msgr2=0x7fbfac03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:24.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:24.631+0000 7fbfcc48d640 1 --2- 172.21.15.123:0/510276465 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbfac039060 0x7fbfac03b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80098c0 tx=0x7fbfb8006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:24.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:24.631+0000 7fbfcc48d640 1 -- 172.21.15.123:0/510276465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc4106300 msgr2=0x7fbfc4196e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:24.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:24.631+0000 7fbfcc48d640 1 --2- 172.21.15.123:0/510276465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc4106300 0x7fbfc4196e80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4005e30 tx=0x7fbfb402fc10 comp rx=0 tx=0).stop 2024-08-18T21:59:24.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:24.631+0000 7fbfcc48d640 1 -- 172.21.15.123:0/510276465 shutdown_connections 2024-08-18T21:59:24.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:24.631+0000 7fbfcc48d640 1 --2- 172.21.15.123:0/510276465 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbfac039060 0x7fbfac03b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:24.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:24.631+0000 7fbfcc48d640 1 --2- 172.21.15.123:0/510276465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc4106300 0x7fbfc4196e80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:24.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:24.631+0000 7fbfcc48d640 1 -- 172.21.15.123:0/510276465 >> 172.21.15.123:0/510276465 conn(0x7fbfc4075f80 msgr2=0x7fbfc4102f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:24.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:24.631+0000 7fbfcc48d640 1 -- 172.21.15.123:0/510276465 shutdown_connections 2024-08-18T21:59:24.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:24.631+0000 7fbfcc48d640 1 -- 172.21.15.123:0/510276465 wait complete. 2024-08-18T21:59:25.209 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch host ls --format=json 2024-08-18T21:59:25.451 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T21:59:25.835 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:25 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:25.836 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:25 smithi123 ceph-mon[18462]: Added host smithi130 2024-08-18T21:59:25.836 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:25 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T21:59:25.836 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:25 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:25.836 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:25 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:25.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.913+0000 7fed2f2e6640 1 -- 172.21.15.123:0/206410641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed280ffa60 msgr2=0x7fed280ffe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:25.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.913+0000 7fed2f2e6640 1 --2- 172.21.15.123:0/206410641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed280ffa60 0x7fed280ffe40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed24009880 tx=0x7fed2402a5d0 comp rx=0 tx=0).stop 2024-08-18T21:59:25.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.913+0000 7fed2f2e6640 1 -- 172.21.15.123:0/206410641 shutdown_connections 2024-08-18T21:59:25.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.913+0000 7fed2f2e6640 1 --2- 172.21.15.123:0/206410641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed280ffa60 0x7fed280ffe40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:25.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.913+0000 7fed2f2e6640 1 -- 172.21.15.123:0/206410641 >> 172.21.15.123:0/206410641 conn(0x7fed280fb650 msgr2=0x7fed280fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:25.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.913+0000 7fed2f2e6640 1 -- 172.21.15.123:0/206410641 shutdown_connections 2024-08-18T21:59:25.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.913+0000 7fed2f2e6640 1 -- 172.21.15.123:0/206410641 wait complete. 2024-08-18T21:59:25.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.914+0000 7fed2f2e6640 1 Processor -- start 2024-08-18T21:59:25.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.914+0000 7fed2f2e6640 1 -- start start 2024-08-18T21:59:25.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.914+0000 7fed2f2e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed280ffa60 0x7fed28196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:25.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.914+0000 7fed2f2e6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fed2810b9a0 con 0x7fed280ffa60 2024-08-18T21:59:25.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.914+0000 7fed2d082640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed280ffa60 0x7fed28196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:25.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.914+0000 7fed2d082640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed280ffa60 0x7fed28196ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55874/0 (socket says 172.21.15.123:55874) 2024-08-18T21:59:25.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.914+0000 7fed2d082640 1 -- 172.21.15.123:0/2832131133 learned_addr learned my addr 172.21.15.123:0/2832131133 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:25.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.914+0000 7fed2d082640 1 -- 172.21.15.123:0/2832131133 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed28197410 con 0x7fed280ffa60 2024-08-18T21:59:25.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.914+0000 7fed2d082640 1 --2- 172.21.15.123:0/2832131133 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed280ffa60 0x7fed28196ed0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed24009230 tx=0x7fed24003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:25.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.915+0000 7fed1e7fc640 1 -- 172.21.15.123:0/2832131133 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed2403f070 con 0x7fed280ffa60 2024-08-18T21:59:25.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.915+0000 7fed2f2e6640 1 -- 172.21.15.123:0/2832131133 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed28197700 con 0x7fed280ffa60 2024-08-18T21:59:25.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.915+0000 7fed1e7fc640 1 -- 172.21.15.123:0/2832131133 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed2403bc80 con 0x7fed280ffa60 2024-08-18T21:59:25.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.915+0000 7fed1e7fc640 1 -- 172.21.15.123:0/2832131133 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed24035030 con 0x7fed280ffa60 2024-08-18T21:59:25.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.915+0000 7fed2f2e6640 1 -- 172.21.15.123:0/2832131133 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed2819b7a0 con 0x7fed280ffa60 2024-08-18T21:59:25.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.916+0000 7fed2f2e6640 1 -- 172.21.15.123:0/2832131133 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed28102b20 con 0x7fed280ffa60 2024-08-18T21:59:25.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.916+0000 7fed1e7fc640 1 -- 172.21.15.123:0/2832131133 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fed24042070 con 0x7fed280ffa60 2024-08-18T21:59:25.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.916+0000 7fed1e7fc640 1 --2- 172.21.15.123:0/2832131133 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fed14039060 0x7fed1403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:25.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.916+0000 7fed1e7fc640 1 -- 172.21.15.123:0/2832131133 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fed2406cc90 con 0x7fed280ffa60 2024-08-18T21:59:25.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.916+0000 7fed2c881640 1 --2- 172.21.15.123:0/2832131133 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fed14039060 0x7fed1403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:25.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.916+0000 7fed2c881640 1 --2- 172.21.15.123:0/2832131133 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fed14039060 0x7fed1403b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fed180098c0 tx=0x7fed18006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:25.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:25.921+0000 7fed1e7fc640 1 -- 172.21.15.123:0/2832131133 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fed24031e20 con 0x7fed280ffa60 2024-08-18T21:59:26.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:26.093+0000 7fed2f2e6640 1 -- 172.21.15.123:0/2832131133 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed280fff20 con 0x7fed14039060 2024-08-18T21:59:26.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:26.094+0000 7fed1e7fc640 1 -- 172.21.15.123:0/2832131133 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7fed280fff20 con 0x7fed14039060 2024-08-18T21:59:26.095 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:59:26.096 INFO:teuthology.orchestra.run.smithi123.stdout:[{"addr": "172.21.15.123", "hostname": "smithi123", "labels": [], "status": ""}, {"addr": "172.21.15.130", "hostname": "smithi130", "labels": [], "status": ""}] 2024-08-18T21:59:26.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:26.096+0000 7fed2f2e6640 1 -- 172.21.15.123:0/2832131133 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fed14039060 msgr2=0x7fed1403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:26.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:26.096+0000 7fed2f2e6640 1 --2- 172.21.15.123:0/2832131133 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fed14039060 0x7fed1403b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fed180098c0 tx=0x7fed18006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:26.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:26.096+0000 7fed2f2e6640 1 -- 172.21.15.123:0/2832131133 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed280ffa60 msgr2=0x7fed28196ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:26.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:26.096+0000 7fed2f2e6640 1 --2- 172.21.15.123:0/2832131133 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed280ffa60 0x7fed28196ed0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed24009230 tx=0x7fed24003d40 comp rx=0 tx=0).stop 2024-08-18T21:59:26.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:26.096+0000 7fed2f2e6640 1 -- 172.21.15.123:0/2832131133 shutdown_connections 2024-08-18T21:59:26.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:26.096+0000 7fed2f2e6640 1 --2- 172.21.15.123:0/2832131133 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fed14039060 0x7fed1403b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:26.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:26.096+0000 7fed2f2e6640 1 --2- 172.21.15.123:0/2832131133 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed280ffa60 0x7fed28196ed0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:26.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:26.096+0000 7fed2f2e6640 1 -- 172.21.15.123:0/2832131133 >> 172.21.15.123:0/2832131133 conn(0x7fed280fb650 msgr2=0x7fed28108e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:26.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:26.097+0000 7fed2f2e6640 1 -- 172.21.15.123:0/2832131133 shutdown_connections 2024-08-18T21:59:26.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:26.097+0000 7fed2f2e6640 1 -- 172.21.15.123:0/2832131133 wait complete. 2024-08-18T21:59:26.785 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi183 2024-08-18T21:59:26.785 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-08-18T21:59:26.785 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/etc/ceph/ceph.conf 2024-08-18T21:59:26.804 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-08-18T21:59:26.804 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-18T21:59:26.862 INFO:tasks.cephadm:Adding host smithi183 to orchestrator... 2024-08-18T21:59:26.862 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch host add smithi183 2024-08-18T21:59:27.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:26 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:27.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:26 smithi123 ceph-mon[18462]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T21:59:27.109 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T21:59:27.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.557+0000 7fe0d38ca640 1 -- 172.21.15.123:0/2307223138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc106300 msgr2=0x7fe0cc1066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:27.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.557+0000 7fe0d38ca640 1 --2- 172.21.15.123:0/2307223138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc106300 0x7fe0cc1066e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009c20 tx=0x7fe0c002aa90 comp rx=0 tx=0).stop 2024-08-18T21:59:27.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.557+0000 7fe0d38ca640 1 -- 172.21.15.123:0/2307223138 shutdown_connections 2024-08-18T21:59:27.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.557+0000 7fe0d38ca640 1 --2- 172.21.15.123:0/2307223138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc106300 0x7fe0cc1066e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:27.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.557+0000 7fe0d38ca640 1 -- 172.21.15.123:0/2307223138 >> 172.21.15.123:0/2307223138 conn(0x7fe0cc075f80 msgr2=0x7fe0cc076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:27.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.557+0000 7fe0d38ca640 1 -- 172.21.15.123:0/2307223138 shutdown_connections 2024-08-18T21:59:27.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.557+0000 7fe0d38ca640 1 -- 172.21.15.123:0/2307223138 wait complete. 2024-08-18T21:59:27.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.557+0000 7fe0d38ca640 1 Processor -- start 2024-08-18T21:59:27.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.557+0000 7fe0d38ca640 1 -- start start 2024-08-18T21:59:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.558+0000 7fe0d38ca640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc106300 0x7fe0cc1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.558+0000 7fe0d38ca640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc10ba10 con 0x7fe0cc106300 2024-08-18T21:59:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.558+0000 7fe0d1666640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc106300 0x7fe0cc1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.558+0000 7fe0d1666640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc106300 0x7fe0cc1991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55892/0 (socket says 172.21.15.123:55892) 2024-08-18T21:59:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.558+0000 7fe0d1666640 1 -- 172.21.15.123:0/638897096 learned_addr learned my addr 172.21.15.123:0/638897096 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.558+0000 7fe0d1666640 1 -- 172.21.15.123:0/638897096 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0cc1996e0 con 0x7fe0cc106300 2024-08-18T21:59:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.558+0000 7fe0d1666640 1 --2- 172.21.15.123:0/638897096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc106300 0x7fe0cc1991a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0005e30 tx=0x7fe0c002fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.558+0000 7fe0ca7fc640 1 -- 172.21.15.123:0/638897096 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0c0047070 con 0x7fe0cc106300 2024-08-18T21:59:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.558+0000 7fe0ca7fc640 1 -- 172.21.15.123:0/638897096 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0c0003df0 con 0x7fe0cc106300 2024-08-18T21:59:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.558+0000 7fe0d38ca640 1 -- 172.21.15.123:0/638897096 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0cc199970 con 0x7fe0cc106300 2024-08-18T21:59:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.558+0000 7fe0ca7fc640 1 -- 172.21.15.123:0/638897096 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0c0033050 con 0x7fe0cc106300 2024-08-18T21:59:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.558+0000 7fe0d38ca640 1 -- 172.21.15.123:0/638897096 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0cc199dd0 con 0x7fe0cc106300 2024-08-18T21:59:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.559+0000 7fe0ca7fc640 1 -- 172.21.15.123:0/638897096 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fe0c004a070 con 0x7fe0cc106300 2024-08-18T21:59:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.559+0000 7fe0d38ca640 1 -- 172.21.15.123:0/638897096 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0cc102a60 con 0x7fe0cc106300 2024-08-18T21:59:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.560+0000 7fe0ca7fc640 1 --2- 172.21.15.123:0/638897096 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe0b4039060 0x7fe0b403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.560+0000 7fe0ca7fc640 1 -- 172.21.15.123:0/638897096 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe0c003e030 con 0x7fe0cc106300 2024-08-18T21:59:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.560+0000 7fe0d0e65640 1 --2- 172.21.15.123:0/638897096 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe0b4039060 0x7fe0b403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.560+0000 7fe0d0e65640 1 --2- 172.21.15.123:0/638897096 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe0b4039060 0x7fe0b403b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0098c0 tx=0x7fe0bc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:27.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.564+0000 7fe0ca7fc640 1 -- 172.21.15.123:0/638897096 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe0c004a360 con 0x7fe0cc106300 2024-08-18T21:59:27.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:27.733+0000 7fe0d38ca640 1 -- 172.21.15.123:0/638897096 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi183", "target": ["mon-mgr", ""]}) -- 0x7fe0cc19a500 con 0x7fe0b4039060 2024-08-18T21:59:28.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:28 smithi123 ceph-mon[18462]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi183", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T21:59:30.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:29 smithi123 ceph-mon[18462]: Deploying cephadm binary to smithi183 2024-08-18T21:59:30.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:29 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:30.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:29 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:30.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:29 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:30.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:29 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:30.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:29 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-08-18T21:59:30.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:29 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:30.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:29 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T21:59:30.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:29 smithi123 ceph-mon[18462]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-18T21:59:30.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:29 smithi123 ceph-mon[18462]: Updating smithi130:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T21:59:30.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:29 smithi123 ceph-mon[18462]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:30.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:29 smithi123 ceph-mon[18462]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-08-18T21:59:30.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:30.930+0000 7fe0ca7fc640 1 -- 172.21.15.123:0/638897096 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fe0cc19a500 con 0x7fe0b4039060 2024-08-18T21:59:30.932 INFO:teuthology.orchestra.run.smithi123.stdout:Added host 'smithi183' with addr '172.21.15.183' 2024-08-18T21:59:30.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:30.932+0000 7fe0d38ca640 1 -- 172.21.15.123:0/638897096 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe0b4039060 msgr2=0x7fe0b403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:30.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:30.932+0000 7fe0d38ca640 1 --2- 172.21.15.123:0/638897096 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe0b4039060 0x7fe0b403b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0098c0 tx=0x7fe0bc006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:30.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:30.932+0000 7fe0d38ca640 1 -- 172.21.15.123:0/638897096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc106300 msgr2=0x7fe0cc1991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:30.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:30.932+0000 7fe0d38ca640 1 --2- 172.21.15.123:0/638897096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc106300 0x7fe0cc1991a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0005e30 tx=0x7fe0c002fc10 comp rx=0 tx=0).stop 2024-08-18T21:59:30.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:30.932+0000 7fe0d38ca640 1 -- 172.21.15.123:0/638897096 shutdown_connections 2024-08-18T21:59:30.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:30.932+0000 7fe0d38ca640 1 --2- 172.21.15.123:0/638897096 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe0b4039060 0x7fe0b403b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:30.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:30.932+0000 7fe0d38ca640 1 --2- 172.21.15.123:0/638897096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc106300 0x7fe0cc1991a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:30.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:30.932+0000 7fe0d38ca640 1 -- 172.21.15.123:0/638897096 >> 172.21.15.123:0/638897096 conn(0x7fe0cc075f80 msgr2=0x7fe0cc0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:30.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:30.932+0000 7fe0d38ca640 1 -- 172.21.15.123:0/638897096 shutdown_connections 2024-08-18T21:59:30.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:30.932+0000 7fe0d38ca640 1 -- 172.21.15.123:0/638897096 wait complete. 2024-08-18T21:59:31.514 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:31 smithi123 ceph-mon[18462]: Updating smithi130:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T21:59:31.514 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:31.514 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:31.514 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:31.514 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:31.514 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T21:59:31.514 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:31.515 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch host ls --format=json 2024-08-18T21:59:31.756 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T21:59:32.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.227+0000 7ff086968640 1 -- 172.21.15.123:0/932676323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff080100450 msgr2=0x7ff080100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:32.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.227+0000 7ff086968640 1 --2- 172.21.15.123:0/932676323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff080100450 0x7ff080100830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff070009880 tx=0x7ff07002a5d0 comp rx=0 tx=0).stop 2024-08-18T21:59:32.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.227+0000 7ff086968640 1 -- 172.21.15.123:0/932676323 shutdown_connections 2024-08-18T21:59:32.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.227+0000 7ff086968640 1 --2- 172.21.15.123:0/932676323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff080100450 0x7ff080100830 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:32.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.227+0000 7ff086968640 1 -- 172.21.15.123:0/932676323 >> 172.21.15.123:0/932676323 conn(0x7ff0800fbed0 msgr2=0x7ff0800fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:32.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.227+0000 7ff086968640 1 -- 172.21.15.123:0/932676323 shutdown_connections 2024-08-18T21:59:32.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.227+0000 7ff086968640 1 -- 172.21.15.123:0/932676323 wait complete. 2024-08-18T21:59:32.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.227+0000 7ff086968640 1 Processor -- start 2024-08-18T21:59:32.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.227+0000 7ff086968640 1 -- start start 2024-08-18T21:59:32.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.228+0000 7ff086968640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff080100450 0x7ff080197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:32.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.228+0000 7ff086968640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff08010a8a0 con 0x7ff080100450 2024-08-18T21:59:32.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.228+0000 7ff07ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff080100450 0x7ff080197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:32.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.228+0000 7ff07ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff080100450 0x7ff080197cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55910/0 (socket says 172.21.15.123:55910) 2024-08-18T21:59:32.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.228+0000 7ff07ffff640 1 -- 172.21.15.123:0/2694784095 learned_addr learned my addr 172.21.15.123:0/2694784095 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:32.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.228+0000 7ff07ffff640 1 -- 172.21.15.123:0/2694784095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff080198200 con 0x7ff080100450 2024-08-18T21:59:32.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.228+0000 7ff07ffff640 1 --2- 172.21.15.123:0/2694784095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff080100450 0x7ff080197cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff070009230 tx=0x7ff070003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:32.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.228+0000 7ff07d7fa640 1 -- 172.21.15.123:0/2694784095 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff07003f070 con 0x7ff080100450 2024-08-18T21:59:32.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.228+0000 7ff07d7fa640 1 -- 172.21.15.123:0/2694784095 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff07003bd40 con 0x7ff080100450 2024-08-18T21:59:32.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.228+0000 7ff086968640 1 -- 172.21.15.123:0/2694784095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0801984f0 con 0x7ff080100450 2024-08-18T21:59:32.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.228+0000 7ff07d7fa640 1 -- 172.21.15.123:0/2694784095 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff070035030 con 0x7ff080100450 2024-08-18T21:59:32.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.228+0000 7ff086968640 1 -- 172.21.15.123:0/2694784095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0801989b0 con 0x7ff080100450 2024-08-18T21:59:32.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.229+0000 7ff07d7fa640 1 -- 172.21.15.123:0/2694784095 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7ff070042070 con 0x7ff080100450 2024-08-18T21:59:32.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.229+0000 7ff086968640 1 -- 172.21.15.123:0/2694784095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff080101930 con 0x7ff080100450 2024-08-18T21:59:32.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.229+0000 7ff07d7fa640 1 --2- 172.21.15.123:0/2694784095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff06c039060 0x7ff06c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:32.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.229+0000 7ff07d7fa640 1 -- 172.21.15.123:0/2694784095 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff07006cc70 con 0x7ff080100450 2024-08-18T21:59:32.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.230+0000 7ff07f7fe640 1 --2- 172.21.15.123:0/2694784095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff06c039060 0x7ff06c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:32.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.230+0000 7ff07f7fe640 1 --2- 172.21.15.123:0/2694784095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff06c039060 0x7ff06c03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff0680098c0 tx=0x7ff068006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:32.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.234+0000 7ff07d7fa640 1 -- 172.21.15.123:0/2694784095 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff070036df0 con 0x7ff080100450 2024-08-18T21:59:32.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.406+0000 7ff086968640 1 -- 172.21.15.123:0/2694784095 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff0801008b0 con 0x7ff06c039060 2024-08-18T21:59:32.408 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:32 smithi123 ceph-mon[18462]: Added host smithi183 2024-08-18T21:59:32.408 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:32 smithi123 ceph-mon[18462]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:32.408 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:32 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:32.408 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:32 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:32.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.407+0000 7ff07d7fa640 1 -- 172.21.15.123:0/2694784095 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7ff0801008b0 con 0x7ff06c039060 2024-08-18T21:59:32.409 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T21:59:32.409 INFO:teuthology.orchestra.run.smithi123.stdout:[{"addr": "172.21.15.123", "hostname": "smithi123", "labels": [], "status": ""}, {"addr": "172.21.15.130", "hostname": "smithi130", "labels": [], "status": ""}, {"addr": "172.21.15.183", "hostname": "smithi183", "labels": [], "status": ""}] 2024-08-18T21:59:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.409+0000 7ff086968640 1 -- 172.21.15.123:0/2694784095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff06c039060 msgr2=0x7ff06c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.409+0000 7ff086968640 1 --2- 172.21.15.123:0/2694784095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff06c039060 0x7ff06c03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff0680098c0 tx=0x7ff068006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:32.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.409+0000 7ff086968640 1 -- 172.21.15.123:0/2694784095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff080100450 msgr2=0x7ff080197cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:32.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.409+0000 7ff086968640 1 --2- 172.21.15.123:0/2694784095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff080100450 0x7ff080197cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff070009230 tx=0x7ff070003d80 comp rx=0 tx=0).stop 2024-08-18T21:59:32.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.410+0000 7ff086968640 1 -- 172.21.15.123:0/2694784095 shutdown_connections 2024-08-18T21:59:32.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.410+0000 7ff086968640 1 --2- 172.21.15.123:0/2694784095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff06c039060 0x7ff06c03b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:32.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.410+0000 7ff086968640 1 --2- 172.21.15.123:0/2694784095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff080100450 0x7ff080197cc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:32.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.410+0000 7ff086968640 1 -- 172.21.15.123:0/2694784095 >> 172.21.15.123:0/2694784095 conn(0x7ff0800fbed0 msgr2=0x7ff080107e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:32.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.410+0000 7ff086968640 1 -- 172.21.15.123:0/2694784095 shutdown_connections 2024-08-18T21:59:32.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:32.410+0000 7ff086968640 1 -- 172.21.15.123:0/2694784095 wait complete. 2024-08-18T21:59:32.979 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-18T21:59:32.980 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd crush tunables default 2024-08-18T21:59:33.220 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T21:59:33.637 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:33 smithi123 ceph-mon[18462]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T21:59:33.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.716+0000 7fd62da2a640 1 -- 172.21.15.123:0/4269514508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6281006c0 msgr2=0x7fd628100aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:33.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.716+0000 7fd62da2a640 1 --2- 172.21.15.123:0/4269514508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6281006c0 0x7fd628100aa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd610009880 tx=0x7fd61002a5d0 comp rx=0 tx=0).stop 2024-08-18T21:59:33.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.716+0000 7fd62da2a640 1 -- 172.21.15.123:0/4269514508 shutdown_connections 2024-08-18T21:59:33.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.716+0000 7fd62da2a640 1 --2- 172.21.15.123:0/4269514508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6281006c0 0x7fd628100aa0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:33.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.716+0000 7fd62da2a640 1 -- 172.21.15.123:0/4269514508 >> 172.21.15.123:0/4269514508 conn(0x7fd628075f80 msgr2=0x7fd628076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:33.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.716+0000 7fd62da2a640 1 -- 172.21.15.123:0/4269514508 shutdown_connections 2024-08-18T21:59:33.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.716+0000 7fd62da2a640 1 -- 172.21.15.123:0/4269514508 wait complete. 2024-08-18T21:59:33.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.716+0000 7fd62da2a640 1 Processor -- start 2024-08-18T21:59:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.717+0000 7fd62da2a640 1 -- start start 2024-08-18T21:59:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.717+0000 7fd62da2a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6281006c0 0x7fd628197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.717+0000 7fd62da2a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd62810a8d0 con 0x7fd6281006c0 2024-08-18T21:59:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.717+0000 7fd626ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6281006c0 0x7fd628197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.717+0000 7fd626ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6281006c0 0x7fd628197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37768/0 (socket says 172.21.15.123:37768) 2024-08-18T21:59:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.717+0000 7fd626ffd640 1 -- 172.21.15.123:0/835083793 learned_addr learned my addr 172.21.15.123:0/835083793 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.717+0000 7fd626ffd640 1 -- 172.21.15.123:0/835083793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd628198350 con 0x7fd6281006c0 2024-08-18T21:59:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.717+0000 7fd626ffd640 1 --2- 172.21.15.123:0/835083793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6281006c0 0x7fd628197e10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd610009230 tx=0x7fd610003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.718+0000 7fd62ca28640 1 -- 172.21.15.123:0/835083793 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd61003f070 con 0x7fd6281006c0 2024-08-18T21:59:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.718+0000 7fd62ca28640 1 -- 172.21.15.123:0/835083793 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd61003bc80 con 0x7fd6281006c0 2024-08-18T21:59:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.718+0000 7fd62da2a640 1 -- 172.21.15.123:0/835083793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd628198640 con 0x7fd6281006c0 2024-08-18T21:59:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.718+0000 7fd62ca28640 1 -- 172.21.15.123:0/835083793 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd610035030 con 0x7fd6281006c0 2024-08-18T21:59:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.718+0000 7fd62da2a640 1 -- 172.21.15.123:0/835083793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd628198b00 con 0x7fd6281006c0 2024-08-18T21:59:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.718+0000 7fd62ca28640 1 -- 172.21.15.123:0/835083793 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fd610042070 con 0x7fd6281006c0 2024-08-18T21:59:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.719+0000 7fd62da2a640 1 -- 172.21.15.123:0/835083793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd628101970 con 0x7fd6281006c0 2024-08-18T21:59:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.719+0000 7fd62ca28640 1 --2- 172.21.15.123:0/835083793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd614039060 0x7fd61403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.719+0000 7fd62ca28640 1 -- 172.21.15.123:0/835083793 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd61006c9f0 con 0x7fd6281006c0 2024-08-18T21:59:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.719+0000 7fd6267fc640 1 --2- 172.21.15.123:0/835083793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd614039060 0x7fd61403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.719+0000 7fd6267fc640 1 --2- 172.21.15.123:0/835083793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd614039060 0x7fd61403b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd6180098c0 tx=0x7fd618006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:33.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.724+0000 7fd62ca28640 1 -- 172.21.15.123:0/835083793 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd6100050d0 con 0x7fd6281006c0 2024-08-18T21:59:33.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:33.893+0000 7fd62da2a640 1 -- 172.21.15.123:0/835083793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fd628100b20 con 0x7fd6281006c0 2024-08-18T21:59:34.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:34.380+0000 7fd62ca28640 1 -- 172.21.15.123:0/835083793 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fd6100046c0 con 0x7fd6281006c0 2024-08-18T21:59:34.381 INFO:teuthology.orchestra.run.smithi123.stderr:adjusted tunables profile to default 2024-08-18T21:59:34.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:34.383+0000 7fd62da2a640 1 -- 172.21.15.123:0/835083793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd614039060 msgr2=0x7fd61403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:34.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:34.383+0000 7fd62da2a640 1 --2- 172.21.15.123:0/835083793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd614039060 0x7fd61403b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd6180098c0 tx=0x7fd618006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:34.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:34.383+0000 7fd62da2a640 1 -- 172.21.15.123:0/835083793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6281006c0 msgr2=0x7fd628197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:34.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:34.383+0000 7fd62da2a640 1 --2- 172.21.15.123:0/835083793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6281006c0 0x7fd628197e10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd610009230 tx=0x7fd610003d40 comp rx=0 tx=0).stop 2024-08-18T21:59:34.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:34.383+0000 7fd62da2a640 1 -- 172.21.15.123:0/835083793 shutdown_connections 2024-08-18T21:59:34.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:34.383+0000 7fd62da2a640 1 --2- 172.21.15.123:0/835083793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd614039060 0x7fd61403b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:34.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:34.383+0000 7fd62da2a640 1 --2- 172.21.15.123:0/835083793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6281006c0 0x7fd628197e10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:34.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:34.383+0000 7fd62da2a640 1 -- 172.21.15.123:0/835083793 >> 172.21.15.123:0/835083793 conn(0x7fd628075f80 msgr2=0x7fd628101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:34.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:34.383+0000 7fd62da2a640 1 -- 172.21.15.123:0/835083793 shutdown_connections 2024-08-18T21:59:34.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:34.383+0000 7fd62da2a640 1 -- 172.21.15.123:0/835083793 wait complete. 2024-08-18T21:59:34.673 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:34 smithi123 ceph-mon[18462]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:34.673 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:34 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/835083793' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-18T21:59:34.983 INFO:tasks.cephadm:Adding mon.a on smithi123 2024-08-18T21:59:34.983 INFO:tasks.cephadm:Adding mon.b on smithi130 2024-08-18T21:59:34.983 INFO:tasks.cephadm:Adding mon.c on smithi183 2024-08-18T21:59:34.983 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch apply mon '3;smithi123:172.21.15.123=a;smithi130:172.21.15.130=b;smithi183:172.21.15.183=c' 2024-08-18T21:59:35.235 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T21:59:35.283 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T21:59:35.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:35 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/835083793' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-18T21:59:35.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:35 smithi123 ceph-mon[18462]: osdmap e4: 0 total, 0 up, 0 in 2024-08-18T21:59:35.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:35 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:35.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:35 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:35.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:35 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:35.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:35 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:35.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:35 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi183", "name": "osd_memory_target"}]: dispatch 2024-08-18T21:59:35.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:35 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:35.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:35 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T21:59:35.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.765+0000 7f2f85593640 1 -- 172.21.15.183:0/1885167152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f80100250 msgr2=0x7f2f80100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:35.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.765+0000 7f2f85593640 1 --2- 172.21.15.183:0/1885167152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f80100250 0x7f2f80100650 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009880 tx=0x7f2f7002a5d0 comp rx=0 tx=0).stop 2024-08-18T21:59:35.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.765+0000 7f2f85593640 1 -- 172.21.15.183:0/1885167152 shutdown_connections 2024-08-18T21:59:35.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.765+0000 7f2f85593640 1 --2- 172.21.15.183:0/1885167152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f80100250 0x7f2f80100650 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:35.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.765+0000 7f2f85593640 1 -- 172.21.15.183:0/1885167152 >> 172.21.15.183:0/1885167152 conn(0x7f2f800fb9e0 msgr2=0x7f2f800fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:35.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.765+0000 7f2f85593640 1 -- 172.21.15.183:0/1885167152 shutdown_connections 2024-08-18T21:59:35.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.765+0000 7f2f85593640 1 -- 172.21.15.183:0/1885167152 wait complete. 2024-08-18T21:59:35.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.766+0000 7f2f85593640 1 Processor -- start 2024-08-18T21:59:35.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.766+0000 7f2f85593640 1 -- start start 2024-08-18T21:59:35.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.766+0000 7f2f85593640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f80100250 0x7f2f8006a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:35.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.766+0000 7f2f85593640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2f80106360 con 0x7f2f80100250 2024-08-18T21:59:35.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.767+0000 7f2f7effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f80100250 0x7f2f8006a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:35.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.767+0000 7f2f7effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f80100250 0x7f2f8006a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.183:41082/0 (socket says 172.21.15.183:41082) 2024-08-18T21:59:35.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.767+0000 7f2f7effd640 1 -- 172.21.15.183:0/3698825746 learned_addr learned my addr 172.21.15.183:0/3698825746 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-08-18T21:59:35.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.767+0000 7f2f7effd640 1 -- 172.21.15.183:0/3698825746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f801975c0 con 0x7f2f80100250 2024-08-18T21:59:35.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.767+0000 7f2f7effd640 1 --2- 172.21.15.183:0/3698825746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f80100250 0x7f2f8006a690 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2f70004f60 tx=0x7f2f700048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:35.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.767+0000 7f2f67fff640 1 -- 172.21.15.183:0/3698825746 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f7003f070 con 0x7f2f80100250 2024-08-18T21:59:35.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.767+0000 7f2f67fff640 1 -- 172.21.15.183:0/3698825746 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f70004d40 con 0x7f2f80100250 2024-08-18T21:59:35.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.767+0000 7f2f67fff640 1 -- 172.21.15.183:0/3698825746 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f70035030 con 0x7f2f80100250 2024-08-18T21:59:35.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.767+0000 7f2f85593640 1 -- 172.21.15.183:0/3698825746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8019bbd0 con 0x7f2f80100250 2024-08-18T21:59:35.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.767+0000 7f2f85593640 1 -- 172.21.15.183:0/3698825746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f8019bf70 con 0x7f2f80100250 2024-08-18T21:59:35.801 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.769+0000 7f2f67fff640 1 -- 172.21.15.183:0/3698825746 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f2f70042070 con 0x7f2f80100250 2024-08-18T21:59:35.801 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.769+0000 7f2f67fff640 1 --2- 172.21.15.183:0/3698825746 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2f680390c0 0x7f2f6803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:35.801 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.769+0000 7f2f85593640 1 -- 172.21.15.183:0/3698825746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f80106ae0 con 0x7f2f80100250 2024-08-18T21:59:35.801 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.769+0000 7f2f67fff640 1 -- 172.21.15.183:0/3698825746 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2f7006cea0 con 0x7f2f80100250 2024-08-18T21:59:35.801 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.769+0000 7f2f7e7fc640 1 --2- 172.21.15.183:0/3698825746 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2f680390c0 0x7f2f6803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:35.801 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.769+0000 7f2f7e7fc640 1 --2- 172.21.15.183:0/3698825746 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2f680390c0 0x7f2f6803b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2f740098c0 tx=0x7f2f74006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:35.801 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.774+0000 7f2f67fff640 1 -- 172.21.15.183:0/3698825746 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2f70042360 con 0x7f2f80100250 2024-08-18T21:59:35.964 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.962+0000 7f2f85593640 1 -- 172.21.15.183:0/3698825746 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi123:172.21.15.123=a;smithi130:172.21.15.130=b;smithi183:172.21.15.183=c", "target": ["mon-mgr", ""]}) -- 0x7f2f8002d950 con 0x7f2f680390c0 2024-08-18T21:59:35.970 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.969+0000 7f2f67fff640 1 -- 172.21.15.183:0/3698825746 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2f8002d950 con 0x7f2f680390c0 2024-08-18T21:59:35.970 INFO:teuthology.orchestra.run.smithi183.stdout:Scheduled mon update... 2024-08-18T21:59:35.972 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.971+0000 7f2f85593640 1 -- 172.21.15.183:0/3698825746 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2f680390c0 msgr2=0x7f2f6803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:35.973 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.971+0000 7f2f85593640 1 --2- 172.21.15.183:0/3698825746 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2f680390c0 0x7f2f6803b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2f740098c0 tx=0x7f2f74006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:35.973 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.971+0000 7f2f85593640 1 -- 172.21.15.183:0/3698825746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f80100250 msgr2=0x7f2f8006a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:35.973 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.971+0000 7f2f85593640 1 --2- 172.21.15.183:0/3698825746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f80100250 0x7f2f8006a690 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2f70004f60 tx=0x7f2f700048f0 comp rx=0 tx=0).stop 2024-08-18T21:59:35.973 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.971+0000 7f2f85593640 1 -- 172.21.15.183:0/3698825746 shutdown_connections 2024-08-18T21:59:35.973 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.971+0000 7f2f85593640 1 --2- 172.21.15.183:0/3698825746 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2f680390c0 0x7f2f6803b580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:35.973 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.971+0000 7f2f85593640 1 --2- 172.21.15.183:0/3698825746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f80100250 0x7f2f8006a690 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:35.973 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.971+0000 7f2f85593640 1 -- 172.21.15.183:0/3698825746 >> 172.21.15.183:0/3698825746 conn(0x7f2f800fb9e0 msgr2=0x7f2f800fc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:35.973 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.971+0000 7f2f85593640 1 -- 172.21.15.183:0/3698825746 shutdown_connections 2024-08-18T21:59:35.973 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:35.971+0000 7f2f85593640 1 -- 172.21.15.183:0/3698825746 wait complete. 2024-08-18T21:59:36.458 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:36 smithi123 ceph-mon[18462]: Updating smithi183:/etc/ceph/ceph.conf 2024-08-18T21:59:36.458 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:36 smithi123 ceph-mon[18462]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:36.458 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:36 smithi123 ceph-mon[18462]: Updating smithi183:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T21:59:36.458 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:36 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:36.458 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:36 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:36.458 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:36 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:36.458 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:36 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:36.458 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:36 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:36.458 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:36 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:36.459 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:36 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:36.459 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:36 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:36.459 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:36 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T21:59:36.459 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:36 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T21:59:36.459 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:36 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:36.508 DEBUG:teuthology.orchestra.run.smithi130:mon.b> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mon.b.service 2024-08-18T21:59:36.511 DEBUG:teuthology.orchestra.run.smithi183:mon.c> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mon.c.service 2024-08-18T21:59:36.513 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-18T21:59:36.513 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T21:59:36.788 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T21:59:37.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.175+0000 7fac67799640 1 -- 172.21.15.183:0/3504685366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac601051e0 msgr2=0x7fac601055c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:37.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.175+0000 7fac67799640 1 --2- 172.21.15.183:0/3504685366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac601051e0 0x7fac601055c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fac5c009880 tx=0x7fac5c02a5d0 comp rx=0 tx=0).stop 2024-08-18T21:59:37.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.175+0000 7fac67799640 1 -- 172.21.15.183:0/3504685366 shutdown_connections 2024-08-18T21:59:37.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.175+0000 7fac67799640 1 --2- 172.21.15.183:0/3504685366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac601051e0 0x7fac601055c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:37.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.175+0000 7fac67799640 1 -- 172.21.15.183:0/3504685366 >> 172.21.15.183:0/3504685366 conn(0x7fac600fb650 msgr2=0x7fac600fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:37.178 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.175+0000 7fac67799640 1 -- 172.21.15.183:0/3504685366 shutdown_connections 2024-08-18T21:59:37.178 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.175+0000 7fac67799640 1 -- 172.21.15.183:0/3504685366 wait complete. 2024-08-18T21:59:37.178 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.176+0000 7fac67799640 1 Processor -- start 2024-08-18T21:59:37.178 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.176+0000 7fac67799640 1 -- start start 2024-08-18T21:59:37.178 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.176+0000 7fac67799640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac601051e0 0x7fac600fbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:37.178 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.176+0000 7fac67799640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fac6010a9f0 con 0x7fac601051e0 2024-08-18T21:59:37.179 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.176+0000 7fac65535640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac601051e0 0x7fac600fbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:37.180 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.176+0000 7fac65535640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac601051e0 0x7fac600fbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.183:34472/0 (socket says 172.21.15.183:34472) 2024-08-18T21:59:37.180 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.176+0000 7fac65535640 1 -- 172.21.15.183:0/2365204313 learned_addr learned my addr 172.21.15.183:0/2365204313 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-08-18T21:59:37.180 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.177+0000 7fac65535640 1 -- 172.21.15.183:0/2365204313 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac600fd9f0 con 0x7fac601051e0 2024-08-18T21:59:37.180 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.177+0000 7fac65535640 1 --2- 172.21.15.183:0/2365204313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac601051e0 0x7fac600fbb00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fac5c009230 tx=0x7fac5c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:37.180 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.177+0000 7fac527fc640 1 -- 172.21.15.183:0/2365204313 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac5c03f070 con 0x7fac601051e0 2024-08-18T21:59:37.180 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.177+0000 7fac67799640 1 -- 172.21.15.183:0/2365204313 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac600fc040 con 0x7fac601051e0 2024-08-18T21:59:37.180 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.177+0000 7fac527fc640 1 -- 172.21.15.183:0/2365204313 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac5c03bc80 con 0x7fac601051e0 2024-08-18T21:59:37.180 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.177+0000 7fac527fc640 1 -- 172.21.15.183:0/2365204313 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac5c035030 con 0x7fac601051e0 2024-08-18T21:59:37.180 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.177+0000 7fac67799640 1 -- 172.21.15.183:0/2365204313 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac600fc500 con 0x7fac601051e0 2024-08-18T21:59:37.180 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.178+0000 7fac527fc640 1 -- 172.21.15.183:0/2365204313 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fac5c042070 con 0x7fac601051e0 2024-08-18T21:59:37.180 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.178+0000 7fac527fc640 1 --2- 172.21.15.183:0/2365204313 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac4c039060 0x7fac4c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:37.180 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.178+0000 7fac527fc640 1 -- 172.21.15.183:0/2365204313 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fac5c06cd90 con 0x7fac601051e0 2024-08-18T21:59:37.181 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.178+0000 7fac67799640 1 -- 172.21.15.183:0/2365204313 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac601019a0 con 0x7fac601051e0 2024-08-18T21:59:37.181 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.178+0000 7fac64d34640 1 --2- 172.21.15.183:0/2365204313 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac4c039060 0x7fac4c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:37.181 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.179+0000 7fac64d34640 1 --2- 172.21.15.183:0/2365204313 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac4c039060 0x7fac4c03b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fac540098c0 tx=0x7fac54006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:37.184 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.183+0000 7fac527fc640 1 -- 172.21.15.183:0/2365204313 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fac5c04c350 con 0x7fac601051e0 2024-08-18T21:59:37.416 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.413+0000 7fac67799640 1 -- 172.21.15.183:0/2365204313 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fac600fd030 con 0x7fac601051e0 2024-08-18T21:59:37.416 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.414+0000 7fac527fc640 1 -- 172.21.15.183:0/2365204313 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7fac5c04ad50 con 0x7fac601051e0 2024-08-18T21:59:37.417 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:59:37.417 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":1,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","modified":"2024-08-18T21:58:12.803696Z","created":"2024-08-18T21:58:12.803696Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-18T21:59:37.417 INFO:teuthology.orchestra.run.smithi183.stderr:dumped monmap epoch 1 2024-08-18T21:59:37.419 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.417+0000 7fac67799640 1 -- 172.21.15.183:0/2365204313 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac4c039060 msgr2=0x7fac4c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:37.419 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.417+0000 7fac67799640 1 --2- 172.21.15.183:0/2365204313 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac4c039060 0x7fac4c03b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fac540098c0 tx=0x7fac54006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:37.419 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.417+0000 7fac67799640 1 -- 172.21.15.183:0/2365204313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac601051e0 msgr2=0x7fac600fbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:37.419 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.417+0000 7fac67799640 1 --2- 172.21.15.183:0/2365204313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac601051e0 0x7fac600fbb00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fac5c009230 tx=0x7fac5c003d40 comp rx=0 tx=0).stop 2024-08-18T21:59:37.419 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.417+0000 7fac67799640 1 -- 172.21.15.183:0/2365204313 shutdown_connections 2024-08-18T21:59:37.419 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.417+0000 7fac67799640 1 --2- 172.21.15.183:0/2365204313 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac4c039060 0x7fac4c03b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:37.419 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.417+0000 7fac67799640 1 --2- 172.21.15.183:0/2365204313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac601051e0 0x7fac600fbb00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:37.420 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.417+0000 7fac67799640 1 -- 172.21.15.183:0/2365204313 >> 172.21.15.183:0/2365204313 conn(0x7fac600fb650 msgr2=0x7fac6018fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:37.420 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.417+0000 7fac67799640 1 -- 172.21.15.183:0/2365204313 shutdown_connections 2024-08-18T21:59:37.420 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:37.417+0000 7fac67799640 1 -- 172.21.15.183:0/2365204313 wait complete. 2024-08-18T21:59:37.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:37 smithi123 ceph-mon[18462]: Updating smithi183:/etc/ceph/ceph.client.admin.keyring 2024-08-18T21:59:37.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:37 smithi123 ceph-mon[18462]: Updating smithi183:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T21:59:37.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:37 smithi123 ceph-mon[18462]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi123:172.21.15.123=a;smithi130:172.21.15.130=b;smithi183:172.21.15.183=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T21:59:37.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:37 smithi123 ceph-mon[18462]: Saving service mon spec with placement smithi123:172.21.15.123=a;smithi130:172.21.15.130=b;smithi183:172.21.15.183=c;count:3 2024-08-18T21:59:37.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:37 smithi123 ceph-mon[18462]: Reconfiguring mon.a (unknown last config time)... 2024-08-18T21:59:37.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:37 smithi123 ceph-mon[18462]: Reconfiguring daemon mon.a on smithi123 2024-08-18T21:59:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:38 smithi123 ceph-mon[18462]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:38 smithi123 ceph-mon[18462]: from='client.? 172.21.15.183:0/2365204313' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T21:59:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T21:59:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T21:59:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T21:59:38.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:39.196 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-18T21:59:39.196 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T21:59:39.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:39 smithi123 ceph-mon[18462]: Deploying daemon mon.c on smithi183 2024-08-18T21:59:40.416 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T21:59:40.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:40 smithi123 ceph-mon[18462]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:40.950 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.889+0000 7fc971085640 1 -- 172.21.15.183:0/695628895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc96c074240 msgr2=0x7fc96c074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:40.950 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.889+0000 7fc971085640 1 --2- 172.21.15.183:0/695628895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc96c074240 0x7fc96c074620 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009880 tx=0x7fc95c02a670 comp rx=0 tx=0).stop 2024-08-18T21:59:40.951 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.890+0000 7fc971085640 1 -- 172.21.15.183:0/695628895 shutdown_connections 2024-08-18T21:59:40.951 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.890+0000 7fc971085640 1 --2- 172.21.15.183:0/695628895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc96c074240 0x7fc96c074620 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:40.951 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.890+0000 7fc971085640 1 -- 172.21.15.183:0/695628895 >> 172.21.15.183:0/695628895 conn(0x7fc96c0fd050 msgr2=0x7fc96c0ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:40.951 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.890+0000 7fc971085640 1 -- 172.21.15.183:0/695628895 shutdown_connections 2024-08-18T21:59:40.951 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.890+0000 7fc971085640 1 -- 172.21.15.183:0/695628895 wait complete. 2024-08-18T21:59:40.951 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.890+0000 7fc971085640 1 Processor -- start 2024-08-18T21:59:40.951 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.891+0000 7fc971085640 1 -- start start 2024-08-18T21:59:40.951 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.891+0000 7fc971085640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc96c074240 0x7fc96c199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:40.951 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.891+0000 7fc971085640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc96c10dca0 con 0x7fc96c074240 2024-08-18T21:59:40.951 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.891+0000 7fc96ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc96c074240 0x7fc96c199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:40.951 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.891+0000 7fc96ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc96c074240 0x7fc96c199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.183:34496/0 (socket says 172.21.15.183:34496) 2024-08-18T21:59:40.951 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.891+0000 7fc96ad9d640 1 -- 172.21.15.183:0/2565144770 learned_addr learned my addr 172.21.15.183:0/2565144770 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-08-18T21:59:40.952 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.891+0000 7fc96ad9d640 1 -- 172.21.15.183:0/2565144770 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc96c199750 con 0x7fc96c074240 2024-08-18T21:59:40.952 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.892+0000 7fc96ad9d640 1 --2- 172.21.15.183:0/2565144770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc96c074240 0x7fc96c199210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009230 tx=0x7fc95c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:40.952 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.892+0000 7fc953fff640 1 -- 172.21.15.183:0/2565144770 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc95c03f070 con 0x7fc96c074240 2024-08-18T21:59:40.952 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.892+0000 7fc971085640 1 -- 172.21.15.183:0/2565144770 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc96c1999e0 con 0x7fc96c074240 2024-08-18T21:59:40.952 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.892+0000 7fc953fff640 1 -- 172.21.15.183:0/2565144770 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc95c03bc80 con 0x7fc96c074240 2024-08-18T21:59:40.952 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.892+0000 7fc953fff640 1 -- 172.21.15.183:0/2565144770 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc95c035030 con 0x7fc96c074240 2024-08-18T21:59:40.952 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.892+0000 7fc971085640 1 -- 172.21.15.183:0/2565144770 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc96c199e40 con 0x7fc96c074240 2024-08-18T21:59:40.952 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.893+0000 7fc971085640 1 -- 172.21.15.183:0/2565144770 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc96c075980 con 0x7fc96c074240 2024-08-18T21:59:40.952 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.893+0000 7fc953fff640 1 -- 172.21.15.183:0/2565144770 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fc95c042070 con 0x7fc96c074240 2024-08-18T21:59:40.952 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.893+0000 7fc953fff640 1 --2- 172.21.15.183:0/2565144770 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc954039060 0x7fc95403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:40.952 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.893+0000 7fc953fff640 1 -- 172.21.15.183:0/2565144770 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc95c06cd80 con 0x7fc96c074240 2024-08-18T21:59:40.952 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.893+0000 7fc96a59c640 1 --2- 172.21.15.183:0/2565144770 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc954039060 0x7fc95403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:40.952 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.894+0000 7fc96a59c640 1 --2- 172.21.15.183:0/2565144770 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc954039060 0x7fc95403b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc9600098c0 tx=0x7fc960006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:40.953 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:40.898+0000 7fc953fff640 1 -- 172.21.15.183:0/2565144770 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fc95c031e20 con 0x7fc96c074240 2024-08-18T21:59:41.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:41.150+0000 7fc971085640 1 -- 172.21.15.183:0/2565144770 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc96c19a5d0 con 0x7fc96c074240 2024-08-18T21:59:41.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:41.151+0000 7fc953fff640 1 -- 172.21.15.183:0/2565144770 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7fc95c031570 con 0x7fc96c074240 2024-08-18T21:59:41.153 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:59:41.153 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":1,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","modified":"2024-08-18T21:58:12.803696Z","created":"2024-08-18T21:58:12.803696Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-18T21:59:41.153 INFO:teuthology.orchestra.run.smithi183.stderr:dumped monmap epoch 1 2024-08-18T21:59:41.155 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:41.153+0000 7fc971085640 1 -- 172.21.15.183:0/2565144770 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc954039060 msgr2=0x7fc95403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:41.155 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:41.153+0000 7fc971085640 1 --2- 172.21.15.183:0/2565144770 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc954039060 0x7fc95403b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc9600098c0 tx=0x7fc960006db0 comp rx=0 tx=0).stop 2024-08-18T21:59:41.155 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:41.153+0000 7fc971085640 1 -- 172.21.15.183:0/2565144770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc96c074240 msgr2=0x7fc96c199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:41.155 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:41.153+0000 7fc971085640 1 --2- 172.21.15.183:0/2565144770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc96c074240 0x7fc96c199210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009230 tx=0x7fc95c003d40 comp rx=0 tx=0).stop 2024-08-18T21:59:41.155 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:41.153+0000 7fc971085640 1 -- 172.21.15.183:0/2565144770 shutdown_connections 2024-08-18T21:59:41.155 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:41.153+0000 7fc971085640 1 --2- 172.21.15.183:0/2565144770 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc954039060 0x7fc95403b520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:41.155 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:41.153+0000 7fc971085640 1 --2- 172.21.15.183:0/2565144770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc96c074240 0x7fc96c199210 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:41.155 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:41.153+0000 7fc971085640 1 -- 172.21.15.183:0/2565144770 >> 172.21.15.183:0/2565144770 conn(0x7fc96c0fd050 msgr2=0x7fc96c1076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:41.155 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:41.153+0000 7fc971085640 1 -- 172.21.15.183:0/2565144770 shutdown_connections 2024-08-18T21:59:41.156 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:41.153+0000 7fc971085640 1 -- 172.21.15.183:0/2565144770 wait complete. 2024-08-18T21:59:41.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:41 smithi183 systemd[1]: Starting Ceph mon.c for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T21:59:41.759 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:41 smithi123 ceph-mon[18462]: from='client.? 172.21.15.183:0/2565144770' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T21:59:42.263 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 podman[22078]: 2024-08-18 21:59:41.914771689 +0000 UTC m=+0.016912601 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T21:59:42.263 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 podman[22078]: 2024-08-18 21:59:42.022860572 +0000 UTC m=+0.125001469 container create 9943b5f35ebf0c296355587a8a9b3ccafb3964ec890317a23dcf5e09e940b11f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-08-18T21:59:42.263 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 podman[22078]: 2024-08-18 21:59:42.233399713 +0000 UTC m=+0.335540612 container init 9943b5f35ebf0c296355587a8a9b3ccafb3964ec890317a23dcf5e09e940b11f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-c, ceph=True, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-18T21:59:42.263 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 podman[22078]: 2024-08-18 21:59:42.236547143 +0000 UTC m=+0.338688052 container start 9943b5f35ebf0c296355587a8a9b3ccafb3964ec890317a23dcf5e09e940b11f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T21:59:42.264 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: set uid:gid to 167:167 (ceph:ceph) 2024-08-18T21:59:42.264 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc), process ceph-mon, pid 2 2024-08-18T21:59:42.264 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: pidfile_write: ignore empty --pid-file 2024-08-18T21:59:42.264 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: load: jerasure load: lrc 2024-08-18T21:59:42.264 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: RocksDB version: 7.9.2 2024-08-18T21:59:42.264 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Git sha 0 2024-08-18T21:59:42.264 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Compile date 2024-08-18 15:19:56 2024-08-18T21:59:42.264 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: DB SUMMARY 2024-08-18T21:59:42.264 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: DB Session ID: C0AK8887I1DYURW3VRYH 2024-08-18T21:59:42.264 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: CURRENT file: CURRENT 2024-08-18T21:59:42.264 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: IDENTITY file: IDENTITY 2024-08-18T21:59:42.264 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-18T21:59:42.264 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-08-18T21:59:42.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-08-18T21:59:42.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.error_if_exists: 0 2024-08-18T21:59:42.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.create_if_missing: 0 2024-08-18T21:59:42.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.paranoid_checks: 1 2024-08-18T21:59:42.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-18T21:59:42.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-18T21:59:42.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-18T21:59:42.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.env: 0x562e176387a0 2024-08-18T21:59:42.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.fs: PosixFileSystem 2024-08-18T21:59:42.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.info_log: 0x562e18a71500 2024-08-18T21:59:42.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_file_opening_threads: 16 2024-08-18T21:59:42.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.statistics: (nil) 2024-08-18T21:59:42.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.use_fsync: 0 2024-08-18T21:59:42.266 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_log_file_size: 0 2024-08-18T21:59:42.266 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-18T21:59:42.266 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-18T21:59:42.266 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.keep_log_file_num: 1000 2024-08-18T21:59:42.266 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.recycle_log_file_num: 0 2024-08-18T21:59:42.266 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.allow_fallocate: 1 2024-08-18T21:59:42.266 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.allow_mmap_reads: 0 2024-08-18T21:59:42.266 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.allow_mmap_writes: 0 2024-08-18T21:59:42.266 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.use_direct_reads: 0 2024-08-18T21:59:42.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-18T21:59:42.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.create_missing_column_families: 0 2024-08-18T21:59:42.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.db_log_dir: 2024-08-18T21:59:42.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.wal_dir: 2024-08-18T21:59:42.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-18T21:59:42.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-18T21:59:42.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-18T21:59:42.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-18T21:59:42.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-18T21:59:42.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-18T21:59:42.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.advise_random_on_open: 1 2024-08-18T21:59:42.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.db_write_buffer_size: 0 2024-08-18T21:59:42.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.write_buffer_manager: 0x562e18a80dc0 2024-08-18T21:59:42.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-18T21:59:42.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-18T21:59:42.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-18T21:59:42.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.rate_limiter: (nil) 2024-08-18T21:59:42.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-18T21:59:42.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.wal_recovery_mode: 2 2024-08-18T21:59:42.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.enable_thread_tracking: 0 2024-08-18T21:59:42.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.enable_pipelined_write: 0 2024-08-18T21:59:42.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.unordered_write: 0 2024-08-18T21:59:42.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-18T21:59:42.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-18T21:59:42.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-18T21:59:42.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-18T21:59:42.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.row_cache: None 2024-08-18T21:59:42.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.wal_filter: None 2024-08-18T21:59:42.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-18T21:59:42.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.allow_ingest_behind: 0 2024-08-18T21:59:42.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.two_write_queues: 0 2024-08-18T21:59:42.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.manual_wal_flush: 0 2024-08-18T21:59:42.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.wal_compression: 0 2024-08-18T21:59:42.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.atomic_flush: 0 2024-08-18T21:59:42.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-18T21:59:42.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-18T21:59:42.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-18T21:59:42.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.log_readahead_size: 0 2024-08-18T21:59:42.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-18T21:59:42.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.best_efforts_recovery: 0 2024-08-18T21:59:42.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-18T21:59:42.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-18T21:59:42.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.allow_data_in_errors: 0 2024-08-18T21:59:42.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.db_host_id: __hostname__ 2024-08-18T21:59:42.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-18T21:59:42.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_background_jobs: 2 2024-08-18T21:59:42.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_background_compactions: -1 2024-08-18T21:59:42.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_subcompactions: 1 2024-08-18T21:59:42.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-18T21:59:42.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-18T21:59:42.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-18T21:59:42.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_total_wal_size: 0 2024-08-18T21:59:42.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-18T21:59:42.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-18T21:59:42.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-18T21:59:42.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-18T21:59:42.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_open_files: -1 2024-08-18T21:59:42.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.bytes_per_sync: 0 2024-08-18T21:59:42.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-18T21:59:42.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-18T21:59:42.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compaction_readahead_size: 0 2024-08-18T21:59:42.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_background_flushes: -1 2024-08-18T21:59:42.665 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Compression algorithms supported: 2024-08-18T21:59:42.665 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: kZSTD supported: 0 2024-08-18T21:59:42.665 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: kXpressCompression supported: 0 2024-08-18T21:59:42.665 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: kBZip2Compression supported: 0 2024-08-18T21:59:42.665 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-18T21:59:42.665 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: kLZ4Compression supported: 1 2024-08-18T21:59:42.665 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: kZlibCompression supported: 1 2024-08-18T21:59:42.665 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: kLZ4HCCompression supported: 1 2024-08-18T21:59:42.665 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: kSnappyCompression supported: 1 2024-08-18T21:59:42.665 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-18T21:59:42.665 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-18T21:59:42.665 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-08-18T21:59:42.665 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-18T21:59:42.665 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-18T21:59:42.666 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.merge_operator: 2024-08-18T21:59:42.666 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compaction_filter: None 2024-08-18T21:59:42.666 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compaction_filter_factory: None 2024-08-18T21:59:42.666 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.sst_partitioner_factory: None 2024-08-18T21:59:42.666 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-18T21:59:42.666 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-18T21:59:42.666 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562e18a71120) 2024-08-18T21:59:42.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: cache_index_and_filter_blocks: 1 2024-08-18T21:59:42.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-18T21:59:42.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-18T21:59:42.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: pin_top_level_index_and_filter: 1 2024-08-18T21:59:42.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: index_type: 0 2024-08-18T21:59:42.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: data_block_index_type: 0 2024-08-18T21:59:42.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: index_shortening: 1 2024-08-18T21:59:42.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-18T21:59:42.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: checksum: 4 2024-08-18T21:59:42.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: no_block_cache: 0 2024-08-18T21:59:42.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_cache: 0x562e18a65090 2024-08-18T21:59:42.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_cache_name: BinnedLRUCache 2024-08-18T21:59:42.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_cache_options: 2024-08-18T21:59:42.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: capacity : 536870912 2024-08-18T21:59:42.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: num_shard_bits : 4 2024-08-18T21:59:42.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: strict_capacity_limit : 0 2024-08-18T21:59:42.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: high_pri_pool_ratio: 0.000 2024-08-18T21:59:42.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_cache_compressed: (nil) 2024-08-18T21:59:42.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: persistent_cache: (nil) 2024-08-18T21:59:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_size: 4096 2024-08-18T21:59:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_size_deviation: 10 2024-08-18T21:59:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_restart_interval: 16 2024-08-18T21:59:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: index_block_restart_interval: 1 2024-08-18T21:59:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: metadata_block_size: 4096 2024-08-18T21:59:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: partition_filters: 0 2024-08-18T21:59:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: use_delta_encoding: 1 2024-08-18T21:59:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: filter_policy: bloomfilter 2024-08-18T21:59:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: whole_key_filtering: 1 2024-08-18T21:59:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: verify_compression: 0 2024-08-18T21:59:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: read_amp_bytes_per_bit: 0 2024-08-18T21:59:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: format_version: 5 2024-08-18T21:59:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: enable_index_compression: 1 2024-08-18T21:59:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_align: 0 2024-08-18T21:59:42.669 INFO:journalctl@ceph.mon.c.smithi183.stdout: max_auto_readahead_size: 262144 2024-08-18T21:59:42.669 INFO:journalctl@ceph.mon.c.smithi183.stdout: prepopulate_block_cache: 0 2024-08-18T21:59:42.669 INFO:journalctl@ceph.mon.c.smithi183.stdout: initial_auto_readahead_size: 8192 2024-08-18T21:59:42.669 INFO:journalctl@ceph.mon.c.smithi183.stdout: num_file_reads_for_auto_readahead: 2 2024-08-18T21:59:42.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.write_buffer_size: 33554432 2024-08-18T21:59:42.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_write_buffer_number: 2 2024-08-18T21:59:42.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compression: NoCompression 2024-08-18T21:59:42.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.bottommost_compression: Disabled 2024-08-18T21:59:42.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.prefix_extractor: nullptr 2024-08-18T21:59:42.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-18T21:59:42.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.num_levels: 7 2024-08-18T21:59:42.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-18T21:59:42.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-18T21:59:42.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-18T21:59:42.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-18T21:59:42.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-18T21:59:42.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-18T21:59:42.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-18T21:59:42.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-18T21:59:42.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-18T21:59:42.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-18T21:59:42.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-18T21:59:42.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-18T21:59:42.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-18T21:59:42.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compression_opts.level: 32767 2024-08-18T21:59:42.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compression_opts.strategy: 0 2024-08-18T21:59:42.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-18T21:59:42.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-18T21:59:42.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-18T21:59:42.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-18T21:59:42.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compression_opts.enabled: false 2024-08-18T21:59:42.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-18T21:59:42.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-18T21:59:42.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-18T21:59:42.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-18T21:59:42.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.target_file_size_base: 67108864 2024-08-18T21:59:42.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-18T21:59:42.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-18T21:59:42.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-18T21:59:42.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-18T21:59:42.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-18T21:59:42.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-18T21:59:42.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-18T21:59:42.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-18T21:59:42.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-18T21:59:42.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-18T21:59:42.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-18T21:59:42.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-18T21:59:42.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-18T21:59:42.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-18T21:59:42.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.arena_block_size: 1048576 2024-08-18T21:59:42.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-18T21:59:42.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-18T21:59:42.674 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.disable_auto_compactions: 0 2024-08-18T21:59:42.674 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-18T21:59:42.674 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-18T21:59:42.674 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-18T21:59:42.674 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-18T21:59:42.674 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-18T21:59:42.674 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-18T21:59:42.674 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-18T21:59:42.674 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-18T21:59:42.674 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-18T21:59:42.674 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-18T21:59:42.674 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-18T21:59:42.674 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.inplace_update_support: 0 2024-08-18T21:59:42.675 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-18T21:59:42.675 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-18T21:59:42.675 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-18T21:59:42.675 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-18T21:59:42.675 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.bloom_locality: 0 2024-08-18T21:59:42.675 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.max_successive_merges: 0 2024-08-18T21:59:42.675 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-18T21:59:42.675 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.paranoid_file_checks: 0 2024-08-18T21:59:42.675 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.force_consistency_checks: 1 2024-08-18T21:59:42.675 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.report_bg_io_stats: 0 2024-08-18T21:59:42.675 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.ttl: 2592000 2024-08-18T21:59:42.675 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-18T21:59:42.675 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-18T21:59:42.675 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-18T21:59:42.676 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.enable_blob_files: false 2024-08-18T21:59:42.676 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.min_blob_size: 0 2024-08-18T21:59:42.676 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.blob_file_size: 268435456 2024-08-18T21:59:42.676 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-18T21:59:42.676 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-18T21:59:42.676 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-18T21:59:42.676 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-18T21:59:42.676 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-18T21:59:42.676 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.blob_file_starting_level: 0 2024-08-18T21:59:42.676 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-18T21:59:42.676 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-18T21:59:42.676 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-18T21:59:42.676 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1e1a4933-f337-42e4-961e-23b3869fee74 2024-08-18T21:59:42.676 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724018382264017, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-18T21:59:42.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-18T21:59:42.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724018382264464, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724018382, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1e1a4933-f337-42e4-961e-23b3869fee74", "db_session_id": "C0AK8887I1DYURW3VRYH", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-18T21:59:42.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724018382264565, "job": 1, "event": "recovery_finished"} 2024-08-18T21:59:42.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-18T21:59:42.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-18T21:59:42.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562e18a92e00 2024-08-18T21:59:42.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: DB pointer 0x562e18b8c000 2024-08-18T21:59:42.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-18T21:59:42.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-18T21:59:42.677 INFO:journalctl@ceph.mon.c.smithi183.stdout: ** DB Stats ** 2024-08-18T21:59:42.677 INFO:journalctl@ceph.mon.c.smithi183.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-18T21:59:42.677 INFO:journalctl@ceph.mon.c.smithi183.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-18T21:59:42.677 INFO:journalctl@ceph.mon.c.smithi183.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-18T21:59:42.677 INFO:journalctl@ceph.mon.c.smithi183.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-18T21:59:42.678 INFO:journalctl@ceph.mon.c.smithi183.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-18T21:59:42.678 INFO:journalctl@ceph.mon.c.smithi183.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-18T21:59:42.678 INFO:journalctl@ceph.mon.c.smithi183.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-18T21:59:42.678 INFO:journalctl@ceph.mon.c.smithi183.stdout: 2024-08-18T21:59:42.678 INFO:journalctl@ceph.mon.c.smithi183.stdout: ** Compaction Stats [default] ** 2024-08-18T21:59:42.678 INFO:journalctl@ceph.mon.c.smithi183.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-18T21:59:42.678 INFO:journalctl@ceph.mon.c.smithi183.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-18T21:59:42.678 INFO:journalctl@ceph.mon.c.smithi183.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-18T21:59:42.678 INFO:journalctl@ceph.mon.c.smithi183.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-18T21:59:42.678 INFO:journalctl@ceph.mon.c.smithi183.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-18T21:59:42.678 INFO:journalctl@ceph.mon.c.smithi183.stdout: 2024-08-18T21:59:42.678 INFO:journalctl@ceph.mon.c.smithi183.stdout: ** Compaction Stats [default] ** 2024-08-18T21:59:42.679 INFO:journalctl@ceph.mon.c.smithi183.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-18T21:59:42.679 INFO:journalctl@ceph.mon.c.smithi183.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-18T21:59:42.679 INFO:journalctl@ceph.mon.c.smithi183.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-18T21:59:42.679 INFO:journalctl@ceph.mon.c.smithi183.stdout: 2024-08-18T21:59:42.679 INFO:journalctl@ceph.mon.c.smithi183.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-18T21:59:42.679 INFO:journalctl@ceph.mon.c.smithi183.stdout: 2024-08-18T21:59:42.679 INFO:journalctl@ceph.mon.c.smithi183.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-18T21:59:42.679 INFO:journalctl@ceph.mon.c.smithi183.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-18T21:59:42.679 INFO:journalctl@ceph.mon.c.smithi183.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-18T21:59:42.679 INFO:journalctl@ceph.mon.c.smithi183.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-18T21:59:42.679 INFO:journalctl@ceph.mon.c.smithi183.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-18T21:59:42.679 INFO:journalctl@ceph.mon.c.smithi183.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-18T21:59:42.679 INFO:journalctl@ceph.mon.c.smithi183.stdout: Cumulative compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-18T21:59:42.679 INFO:journalctl@ceph.mon.c.smithi183.stdout: Interval compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-18T21:59:42.680 INFO:journalctl@ceph.mon.c.smithi183.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-18T21:59:42.680 INFO:journalctl@ceph.mon.c.smithi183.stdout: Block cache BinnedLRUCache@0x562e18a65090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-18T21:59:42.680 INFO:journalctl@ceph.mon.c.smithi183.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-18T21:59:42.680 INFO:journalctl@ceph.mon.c.smithi183.stdout: 2024-08-18T21:59:42.680 INFO:journalctl@ceph.mon.c.smithi183.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-18T21:59:42.680 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-08-18T21:59:42.680 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: using public_addr v2:172.21.15.183:0/0 -> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] 2024-08-18T21:59:42.680 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: starting mon.c rank -1 at public addrs [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] at bind addrs [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:59:42.680 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: mon.c@-1(???) e0 preinit fsid dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:59:42.680 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: mon.c@-1(synchronizing).mds e1 new map 2024-08-18T21:59:42.680 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: mon.c@-1(synchronizing).mds e1 print_map 2024-08-18T21:59:42.680 INFO:journalctl@ceph.mon.c.smithi183.stdout: e1 2024-08-18T21:59:42.680 INFO:journalctl@ceph.mon.c.smithi183.stdout: btime 2024-08-18T21:58:23:301079+0000 2024-08-18T21:59:42.680 INFO:journalctl@ceph.mon.c.smithi183.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T21:59:42.681 INFO:journalctl@ceph.mon.c.smithi183.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-18T21:59:42.681 INFO:journalctl@ceph.mon.c.smithi183.stdout: legacy client fscid: -1 2024-08-18T21:59:42.681 INFO:journalctl@ceph.mon.c.smithi183.stdout: 2024-08-18T21:59:42.681 INFO:journalctl@ceph.mon.c.smithi183.stdout: No filesystems configured 2024-08-18T21:59:42.681 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-18T21:59:42.681 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-18T21:59:42.681 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-18T21:59:42.681 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-18T21:59:42.681 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-18T21:59:42.681 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-18T21:59:42.681 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-18T21:59:42.681 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-18T21:59:42.681 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-18T21:59:42.681 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-18T21:59:42.682 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: Added host smithi183 2024-08-18T21:59:42.682 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:42.682 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.682 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.682 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T21:59:42.682 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:42.682 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/835083793' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-18T21:59:42.682 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/835083793' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-18T21:59:42.682 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: osdmap e4: 0 total, 0 up, 0 in 2024-08-18T21:59:42.682 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.682 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.682 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.682 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi183", "name": "osd_memory_target"}]: dispatch 2024-08-18T21:59:42.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:42.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T21:59:42.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: Updating smithi183:/etc/ceph/ceph.conf 2024-08-18T21:59:42.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:42.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: Updating smithi183:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T21:59:42.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.684 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T21:59:42.684 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T21:59:42.684 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:42.684 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: Updating smithi183:/etc/ceph/ceph.client.admin.keyring 2024-08-18T21:59:42.684 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: Updating smithi183:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T21:59:42.684 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi123:172.21.15.123=a;smithi130:172.21.15.130=b;smithi183:172.21.15.183=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T21:59:42.684 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: Saving service mon spec with placement smithi123:172.21.15.123=a;smithi130:172.21.15.130=b;smithi183:172.21.15.183=c;count:3 2024-08-18T21:59:42.684 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: Reconfiguring mon.a (unknown last config time)... 2024-08-18T21:59:42.684 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: Reconfiguring daemon mon.a on smithi123 2024-08-18T21:59:42.684 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:42.684 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='client.? 172.21.15.183:0/2365204313' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T21:59:42.684 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.684 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.684 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T21:59:42.685 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:42.685 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T21:59:42.685 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:42.685 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T21:59:42.685 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:42.685 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: Deploying daemon mon.c on smithi183 2024-08-18T21:59:42.685 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:42.685 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: from='client.? 172.21.15.183:0/2565144770' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T21:59:42.685 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 ceph-mon[22097]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-18T21:59:42.685 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 bash[22078]: 9943b5f35ebf0c296355587a8a9b3ccafb3964ec890317a23dcf5e09e940b11f 2024-08-18T21:59:42.685 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:42 smithi183 systemd[1]: Started Ceph mon.c for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T21:59:42.761 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-18T21:59:42.762 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T21:59:43.021 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T21:59:47.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T21:59:47.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: mon.a calling monitor election 2024-08-18T21:59:47.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:47.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:47.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:47.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:47.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: mon.c calling monitor election 2024-08-18T21:59:47.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:47.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:47.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:47.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:47.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-18T21:59:47.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: monmap epoch 2 2024-08-18T21:59:47.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: fsid dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:59:47.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: last_changed 2024-08-18T21:59:42.289939+0000 2024-08-18T21:59:47.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: created 2024-08-18T21:58:12.803696+0000 2024-08-18T21:59:47.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: min_mon_release 19 (squid) 2024-08-18T21:59:47.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: election_strategy: 1 2024-08-18T21:59:47.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: 0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2024-08-18T21:59:47.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-08-18T21:59:47.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: fsmap 2024-08-18T21:59:47.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: osdmap e4: 0 total, 0 up, 0 in 2024-08-18T21:59:47.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: mgrmap e13: x(active, since 38s) 2024-08-18T21:59:47.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: overall HEALTH_OK 2024-08-18T21:59:47.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:47.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:47.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:47.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T21:59:47.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:47.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T21:59:47.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: mon.a calling monitor election 2024-08-18T21:59:47.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:47.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:47.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:47.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:47.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: mon.c calling monitor election 2024-08-18T21:59:47.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:47.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:47.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:47.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:47.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-18T21:59:47.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: monmap epoch 2 2024-08-18T21:59:47.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: fsid dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:59:47.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: last_changed 2024-08-18T21:59:42.289939+0000 2024-08-18T21:59:47.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: created 2024-08-18T21:58:12.803696+0000 2024-08-18T21:59:47.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: min_mon_release 19 (squid) 2024-08-18T21:59:47.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: election_strategy: 1 2024-08-18T21:59:47.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: 0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2024-08-18T21:59:47.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-08-18T21:59:47.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: fsmap 2024-08-18T21:59:47.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: osdmap e4: 0 total, 0 up, 0 in 2024-08-18T21:59:47.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: mgrmap e13: x(active, since 38s) 2024-08-18T21:59:47.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: overall HEALTH_OK 2024-08-18T21:59:47.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:47.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:47.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:47.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T21:59:47.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:47.981 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.979+0000 7f47d5131640 1 -- 172.21.15.183:0/1344357818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8003530 msgr2=0x7f47b80059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:47.981 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.979+0000 7f47d5131640 1 --2- 172.21.15.183:0/1344357818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8003530 0x7f47b80059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f47d0101740 tx=0x7f47c402c490 comp rx=0 tx=0).stop 2024-08-18T21:59:47.981 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.979+0000 7f47d5131640 1 -- 172.21.15.183:0/1344357818 shutdown_connections 2024-08-18T21:59:47.981 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.979+0000 7f47d5131640 1 --2- 172.21.15.183:0/1344357818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8003530 0x7f47b80059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:47.981 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.979+0000 7f47d5131640 1 -- 172.21.15.183:0/1344357818 >> 172.21.15.183:0/1344357818 conn(0x7f47d00fbfb0 msgr2=0x7f47d00fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:47.981 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.979+0000 7f47d5131640 1 -- 172.21.15.183:0/1344357818 shutdown_connections 2024-08-18T21:59:47.981 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.979+0000 7f47d5131640 1 -- 172.21.15.183:0/1344357818 wait complete. 2024-08-18T21:59:47.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.980+0000 7f47d5131640 1 Processor -- start 2024-08-18T21:59:47.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.980+0000 7f47d5131640 1 -- start start 2024-08-18T21:59:47.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.981+0000 7f47d5131640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8003530 0x7f47d0197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:47.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.981+0000 7f47d5131640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47d0197550 0x7f47d019b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:47.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.981+0000 7f47d5131640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f47d01083c0 con 0x7f47b8003530 2024-08-18T21:59:47.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.981+0000 7f47d5131640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f47d0108240 con 0x7f47d0197550 2024-08-18T21:59:47.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.981+0000 7f47ce59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47d0197550 0x7f47d019b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:47.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.981+0000 7f47ce59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47d0197550 0x7f47d019b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:33790/0 (socket says 172.21.15.183:33790) 2024-08-18T21:59:47.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.981+0000 7f47ce59c640 1 -- 172.21.15.183:0/2036857917 learned_addr learned my addr 172.21.15.183:0/2036857917 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-08-18T21:59:47.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.981+0000 7f47ced9d640 1 --2- 172.21.15.183:0/2036857917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8003530 0x7f47d0197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:47.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.981+0000 7f47ce59c640 1 -- 172.21.15.183:0/2036857917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47d0197550 msgr2=0x7f47d019b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-08-18T21:59:47.984 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.981+0000 7f47ce59c640 1 -- 172.21.15.183:0/2036857917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47d0197550 msgr2=0x7f47d019b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:59:47.984 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.981+0000 7f47ce59c640 1 --2- 172.21.15.183:0/2036857917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47d0197550 0x7f47d019b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:59:47.984 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.981+0000 7f47ce59c640 1 --2- 172.21.15.183:0/2036857917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47d0197550 0x7f47d019b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:59:47.984 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.981+0000 7f47ced9d640 1 -- 172.21.15.183:0/2036857917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47d0197550 msgr2=0x7f47d019b890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:59:47.984 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.981+0000 7f47ced9d640 1 --2- 172.21.15.183:0/2036857917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47d0197550 0x7f47d019b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:47.984 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.982+0000 7f47ced9d640 1 -- 172.21.15.183:0/2036857917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d0197b70 con 0x7f47b8003530 2024-08-18T21:59:47.985 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.982+0000 7f47ced9d640 1 --2- 172.21.15.183:0/2036857917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8003530 0x7f47d0197010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f47c4005f30 tx=0x7f47c4033680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:47.985 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.982+0000 7f47b7fff640 1 -- 172.21.15.183:0/2036857917 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f47c4038040 con 0x7f47b8003530 2024-08-18T21:59:47.985 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.982+0000 7f47b7fff640 1 -- 172.21.15.183:0/2036857917 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47c4032e00 con 0x7f47b8003530 2024-08-18T21:59:47.985 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.982+0000 7f47b7fff640 1 -- 172.21.15.183:0/2036857917 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f47c4004a00 con 0x7f47b8003530 2024-08-18T21:59:47.985 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.982+0000 7f47d5131640 1 -- 172.21.15.183:0/2036857917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d019bdd0 con 0x7f47b8003530 2024-08-18T21:59:47.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.982+0000 7f47d5131640 1 -- 172.21.15.183:0/2036857917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d019c310 con 0x7f47b8003530 2024-08-18T21:59:47.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.983+0000 7f47b7fff640 1 -- 172.21.15.183:0/2036857917 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f47c4043020 con 0x7f47b8003530 2024-08-18T21:59:47.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.984+0000 7f47d5131640 1 -- 172.21.15.183:0/2036857917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d01019f0 con 0x7f47b8003530 2024-08-18T21:59:47.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.984+0000 7f47b7fff640 1 --2- 172.21.15.183:0/2036857917 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f47bc038e50 0x7f47bc03b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:47.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.984+0000 7f47b7fff640 1 -- 172.21.15.183:0/2036857917 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f47c406e670 con 0x7f47b8003530 2024-08-18T21:59:47.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.984+0000 7f47ce59c640 1 --2- 172.21.15.183:0/2036857917 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f47bc038e50 0x7f47bc03b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:47.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.985+0000 7f47ce59c640 1 --2- 172.21.15.183:0/2036857917 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f47bc038e50 0x7f47bc03b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009100 tx=0x7f47c0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:47.990 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:47.989+0000 7f47b7fff640 1 -- 172.21.15.183:0/2036857917 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f47c404a020 con 0x7f47b8003530 2024-08-18T21:59:48.223 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:48.222+0000 7f47d5131640 1 -- 172.21.15.183:0/2036857917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f47d0190bb0 con 0x7f47b8003530 2024-08-18T21:59:48.224 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:48.223+0000 7f47b7fff640 1 -- 172.21.15.183:0/2036857917 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f47c404cbc0 con 0x7f47b8003530 2024-08-18T21:59:48.224 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:59:48.224 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":2,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","modified":"2024-08-18T21:59:42.289939Z","created":"2024-08-18T21:58:12.803696Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:3300","nonce":0},{"type":"v1","addr":"172.21.15.183:6789","nonce":0}]},"addr":"172.21.15.183:6789/0","public_addr":"172.21.15.183:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-18T21:59:48.224 INFO:teuthology.orchestra.run.smithi183.stderr:dumped monmap epoch 2 2024-08-18T21:59:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:48.225+0000 7f47d5131640 1 -- 172.21.15.183:0/2036857917 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f47bc038e50 msgr2=0x7f47bc03b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:48.225+0000 7f47d5131640 1 --2- 172.21.15.183:0/2036857917 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f47bc038e50 0x7f47bc03b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009100 tx=0x7f47c0008040 comp rx=0 tx=0).stop 2024-08-18T21:59:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:48.225+0000 7f47d5131640 1 -- 172.21.15.183:0/2036857917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8003530 msgr2=0x7f47d0197010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:48.225+0000 7f47d5131640 1 --2- 172.21.15.183:0/2036857917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8003530 0x7f47d0197010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f47c4005f30 tx=0x7f47c4033680 comp rx=0 tx=0).stop 2024-08-18T21:59:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:48.225+0000 7f47d5131640 1 -- 172.21.15.183:0/2036857917 shutdown_connections 2024-08-18T21:59:48.227 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:48.225+0000 7f47d5131640 1 --2- 172.21.15.183:0/2036857917 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f47bc038e50 0x7f47bc03b310 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:48.227 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:48.225+0000 7f47d5131640 1 --2- 172.21.15.183:0/2036857917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47d0197550 0x7f47d019b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:48.227 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:48.225+0000 7f47d5131640 1 --2- 172.21.15.183:0/2036857917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8003530 0x7f47d0197010 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:48.227 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:48.225+0000 7f47d5131640 1 -- 172.21.15.183:0/2036857917 >> 172.21.15.183:0/2036857917 conn(0x7f47d00fbfb0 msgr2=0x7f47d006a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:48.227 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:48.225+0000 7f47d5131640 1 -- 172.21.15.183:0/2036857917 shutdown_connections 2024-08-18T21:59:48.227 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:48.225+0000 7f47d5131640 1 -- 172.21.15.183:0/2036857917 wait complete. 2024-08-18T21:59:48.581 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:48 smithi183 ceph-mon[22097]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:48.581 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:48 smithi183 ceph-mon[22097]: Deploying daemon mon.b on smithi130 2024-08-18T21:59:48.581 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:48 smithi183 ceph-mon[22097]: from='client.? 172.21.15.183:0/2036857917' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T21:59:48.581 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:48.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:48 smithi123 ceph-mon[18462]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:48.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:48 smithi123 ceph-mon[18462]: Deploying daemon mon.b on smithi130 2024-08-18T21:59:48.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:48 smithi123 ceph-mon[18462]: from='client.? 172.21.15.183:0/2036857917' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T21:59:48.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:49.867 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-18T21:59:49.868 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T21:59:50.122 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T21:59:50.536 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:50 smithi183 ceph-mon[22097]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:50.542 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.536+0000 7f3ff862e640 1 -- 172.21.15.183:0/3479757309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ff01015f0 msgr2=0x7f3ff01019d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:50.542 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.536+0000 7f3ff862e640 1 --2- 172.21.15.183:0/3479757309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ff01015f0 0x7f3ff01019d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009880 tx=0x7f3fec02a5d0 comp rx=0 tx=0).stop 2024-08-18T21:59:50.542 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.536+0000 7f3ff862e640 1 -- 172.21.15.183:0/3479757309 shutdown_connections 2024-08-18T21:59:50.542 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.536+0000 7f3ff862e640 1 --2- 172.21.15.183:0/3479757309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ff01015f0 0x7f3ff01019d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:50.542 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.536+0000 7f3ff862e640 1 -- 172.21.15.183:0/3479757309 >> 172.21.15.183:0/3479757309 conn(0x7f3ff00fd050 msgr2=0x7f3ff00ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:50.542 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.536+0000 7f3ff862e640 1 -- 172.21.15.183:0/3479757309 shutdown_connections 2024-08-18T21:59:50.542 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.536+0000 7f3ff862e640 1 -- 172.21.15.183:0/3479757309 wait complete. 2024-08-18T21:59:50.542 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.537+0000 7f3ff862e640 1 Processor -- start 2024-08-18T21:59:50.542 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.537+0000 7f3ff862e640 1 -- start start 2024-08-18T21:59:50.543 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.537+0000 7f3ff862e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff01015f0 0x7f3ff0197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:50.543 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.537+0000 7f3ff862e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ff0197680 0x7f3ff019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:50.543 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.537+0000 7f3ff862e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff010ba40 con 0x7f3ff0197680 2024-08-18T21:59:50.543 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.537+0000 7f3ff862e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff010b8c0 con 0x7f3ff01015f0 2024-08-18T21:59:50.543 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.537+0000 7f3ff63ca640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff01015f0 0x7f3ff0197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:50.543 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.537+0000 7f3ff63ca640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff01015f0 0x7f3ff0197140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:33796/0 (socket says 172.21.15.183:33796) 2024-08-18T21:59:50.543 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.537+0000 7f3ff63ca640 1 -- 172.21.15.183:0/2921975408 learned_addr learned my addr 172.21.15.183:0/2921975408 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-08-18T21:59:50.543 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.537+0000 7f3ff63ca640 1 -- 172.21.15.183:0/2921975408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff01015f0 msgr2=0x7f3ff0197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-08-18T21:59:50.543 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.537+0000 7f3ff63ca640 1 -- 172.21.15.183:0/2921975408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff01015f0 msgr2=0x7f3ff0197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:59:50.543 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.537+0000 7f3ff63ca640 1 --2- 172.21.15.183:0/2921975408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff01015f0 0x7f3ff0197140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:59:50.543 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.537+0000 7f3ff5bc9640 1 --2- 172.21.15.183:0/2921975408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ff0197680 0x7f3ff019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:50.543 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.537+0000 7f3ff63ca640 1 --2- 172.21.15.183:0/2921975408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff01015f0 0x7f3ff0197140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:59:50.544 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.538+0000 7f3ff5bc9640 1 -- 172.21.15.183:0/2921975408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff01015f0 msgr2=0x7f3ff0197140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:59:50.544 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.538+0000 7f3ff5bc9640 1 --2- 172.21.15.183:0/2921975408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff01015f0 0x7f3ff0197140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:50.544 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.538+0000 7f3ff5bc9640 1 -- 172.21.15.183:0/2921975408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff0197ca0 con 0x7f3ff0197680 2024-08-18T21:59:50.544 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.538+0000 7f3ff5bc9640 1 --2- 172.21.15.183:0/2921975408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ff0197680 0x7f3ff019b9c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000b3d0 tx=0x7f3fe000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:50.544 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.538+0000 7f3fe77fe640 1 -- 172.21.15.183:0/2921975408 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3fe0011630 con 0x7f3ff0197680 2024-08-18T21:59:50.544 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.538+0000 7f3fe77fe640 1 -- 172.21.15.183:0/2921975408 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fe0011cb0 con 0x7f3ff0197680 2024-08-18T21:59:50.544 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.538+0000 7f3ff862e640 1 -- 172.21.15.183:0/2921975408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff019bf00 con 0x7f3ff0197680 2024-08-18T21:59:50.544 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.538+0000 7f3fe77fe640 1 -- 172.21.15.183:0/2921975408 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3fe0010df0 con 0x7f3ff0197680 2024-08-18T21:59:50.544 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.538+0000 7f3ff862e640 1 -- 172.21.15.183:0/2921975408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff019c440 con 0x7f3ff0197680 2024-08-18T21:59:50.544 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.539+0000 7f3fe77fe640 1 -- 172.21.15.183:0/2921975408 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f3fe0018020 con 0x7f3ff0197680 2024-08-18T21:59:50.544 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.539+0000 7f3ff862e640 1 -- 172.21.15.183:0/2921975408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff0102ad0 con 0x7f3ff0197680 2024-08-18T21:59:50.544 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.539+0000 7f3fe77fe640 1 --2- 172.21.15.183:0/2921975408 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3fdc038e50 0x7f3fdc03b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:50.544 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.539+0000 7f3fe77fe640 1 -- 172.21.15.183:0/2921975408 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3fe004bb90 con 0x7f3ff0197680 2024-08-18T21:59:50.545 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.539+0000 7f3ff63ca640 1 --2- 172.21.15.183:0/2921975408 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3fdc038e50 0x7f3fdc03b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:50.545 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.540+0000 7f3ff63ca640 1 --2- 172.21.15.183:0/2921975408 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3fdc038e50 0x7f3fdc03b310 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0096c0 tx=0x7f3fec005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:50.545 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.544+0000 7f3fe77fe640 1 -- 172.21.15.183:0/2921975408 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3fe001f020 con 0x7f3ff0197680 2024-08-18T21:59:50.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:50 smithi123 ceph-mon[18462]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:50.773 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.773+0000 7f3ff862e640 1 -- 172.21.15.183:0/2921975408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3ff019c750 con 0x7f3ff0197680 2024-08-18T21:59:50.774 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.774+0000 7f3fe77fe640 1 -- 172.21.15.183:0/2921975408 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f3fe0017500 con 0x7f3ff0197680 2024-08-18T21:59:50.774 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:59:50.774 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":2,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","modified":"2024-08-18T21:59:42.289939Z","created":"2024-08-18T21:58:12.803696Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:3300","nonce":0},{"type":"v1","addr":"172.21.15.183:6789","nonce":0}]},"addr":"172.21.15.183:6789/0","public_addr":"172.21.15.183:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-18T21:59:50.775 INFO:teuthology.orchestra.run.smithi183.stderr:dumped monmap epoch 2 2024-08-18T21:59:50.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.776+0000 7f3ff862e640 1 -- 172.21.15.183:0/2921975408 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3fdc038e50 msgr2=0x7f3fdc03b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:50.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.776+0000 7f3ff862e640 1 --2- 172.21.15.183:0/2921975408 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3fdc038e50 0x7f3fdc03b310 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0096c0 tx=0x7f3fec005a40 comp rx=0 tx=0).stop 2024-08-18T21:59:50.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.776+0000 7f3ff862e640 1 -- 172.21.15.183:0/2921975408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ff0197680 msgr2=0x7f3ff019b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:50.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.776+0000 7f3ff862e640 1 --2- 172.21.15.183:0/2921975408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ff0197680 0x7f3ff019b9c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000b3d0 tx=0x7f3fe000b890 comp rx=0 tx=0).stop 2024-08-18T21:59:50.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.776+0000 7f3ff862e640 1 -- 172.21.15.183:0/2921975408 shutdown_connections 2024-08-18T21:59:50.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.776+0000 7f3ff862e640 1 --2- 172.21.15.183:0/2921975408 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3fdc038e50 0x7f3fdc03b310 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:50.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.776+0000 7f3ff862e640 1 --2- 172.21.15.183:0/2921975408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ff0197680 0x7f3ff019b9c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:50.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.776+0000 7f3ff862e640 1 --2- 172.21.15.183:0/2921975408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff01015f0 0x7f3ff0197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:50.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.776+0000 7f3ff862e640 1 -- 172.21.15.183:0/2921975408 >> 172.21.15.183:0/2921975408 conn(0x7f3ff00fd050 msgr2=0x7f3ff0109090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:50.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.776+0000 7f3ff862e640 1 -- 172.21.15.183:0/2921975408 shutdown_connections 2024-08-18T21:59:50.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:50.776+0000 7f3ff862e640 1 -- 172.21.15.183:0/2921975408 wait complete. 2024-08-18T21:59:51.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:51 smithi130 systemd[1]: Started Ceph mon.b for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T21:59:52.417 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-18T21:59:52.418 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T21:59:52.676 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T21:59:56.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.127+0000 7f2c0efe6640 1 -- 172.21.15.183:0/145887916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bf0003530 msgr2=0x7f2bf00059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:56.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.127+0000 7f2c0efe6640 1 --2- 172.21.15.183:0/145887916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bf0003530 0x7f2bf00059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2c08101720 tx=0x7f2c0402bce0 comp rx=0 tx=0).stop 2024-08-18T21:59:56.134 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.128+0000 7f2c0efe6640 1 -- 172.21.15.183:0/145887916 shutdown_connections 2024-08-18T21:59:56.134 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.128+0000 7f2c0efe6640 1 --2- 172.21.15.183:0/145887916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bf0003530 0x7f2bf00059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:56.134 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.128+0000 7f2c0efe6640 1 -- 172.21.15.183:0/145887916 >> 172.21.15.183:0/145887916 conn(0x7f2c080fbf50 msgr2=0x7f2c080fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:56.134 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.128+0000 7f2c0efe6640 1 -- 172.21.15.183:0/145887916 shutdown_connections 2024-08-18T21:59:56.134 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.128+0000 7f2c0efe6640 1 -- 172.21.15.183:0/145887916 wait complete. 2024-08-18T21:59:56.134 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.128+0000 7f2c0efe6640 1 Processor -- start 2024-08-18T21:59:56.135 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0efe6640 1 -- start start 2024-08-18T21:59:56.135 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0efe6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bf0003530 0x7f2c08197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:56.135 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0efe6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c08198490 0x7f2c081988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:56.135 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0efe6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c081a0fc0 0x7f2c081a33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:56.135 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0efe6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2c08108350 con 0x7f2c081a0fc0 2024-08-18T21:59:56.135 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0efe6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2c081081d0 con 0x7f2bf0003530 2024-08-18T21:59:56.135 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0efe6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2c081084d0 con 0x7f2c08198490 2024-08-18T21:59:56.136 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2bfffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c08198490 0x7f2c081988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:56.136 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2bfffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c08198490 0x7f2c081988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:33802/0 (socket says 172.21.15.183:33802) 2024-08-18T21:59:56.136 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2bfffff640 1 -- 172.21.15.183:0/418904131 learned_addr learned my addr 172.21.15.183:0/418904131 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-08-18T21:59:56.136 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0d583640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c081a0fc0 0x7f2c081a33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:56.136 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0cd82640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bf0003530 0x7f2c08197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:56.136 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2bfffff640 1 -- 172.21.15.183:0/418904131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c08198490 msgr2=0x7f2c081988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-08-18T21:59:56.136 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2bfffff640 1 -- 172.21.15.183:0/418904131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c08198490 msgr2=0x7f2c081988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:59:56.136 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2bfffff640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c08198490 0x7f2c081988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:59:56.136 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2bfffff640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c08198490 0x7f2c081988f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:59:56.136 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0cd82640 1 -- 172.21.15.183:0/418904131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bf0003530 msgr2=0x7f2c08197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-08-18T21:59:56.136 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0cd82640 1 -- 172.21.15.183:0/418904131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bf0003530 msgr2=0x7f2c08197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T21:59:56.136 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0cd82640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bf0003530 0x7f2c08197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T21:59:56.137 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0cd82640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bf0003530 0x7f2c08197f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T21:59:56.137 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0d583640 1 -- 172.21.15.183:0/418904131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c08198490 msgr2=0x7f2c081988f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:59:56.137 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0d583640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c08198490 0x7f2c081988f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:56.137 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0d583640 1 -- 172.21.15.183:0/418904131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bf0003530 msgr2=0x7f2c08197f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T21:59:56.137 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0d583640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bf0003530 0x7f2c08197f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:56.137 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.129+0000 7f2c0d583640 1 -- 172.21.15.183:0/418904131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c081a3b50 con 0x7f2c081a0fc0 2024-08-18T21:59:56.137 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.130+0000 7f2c0d583640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c081a0fc0 0x7f2c081a33b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000bd50 tx=0x7f2c0000be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:56.137 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.130+0000 7f2bfdffb640 1 -- 172.21.15.183:0/418904131 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00019070 con 0x7f2c081a0fc0 2024-08-18T21:59:56.137 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.130+0000 7f2bfdffb640 1 -- 172.21.15.183:0/418904131 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c00014920 con 0x7f2c081a0fc0 2024-08-18T21:59:56.137 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.130+0000 7f2c0efe6640 1 -- 172.21.15.183:0/418904131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c081a3e40 con 0x7f2c081a0fc0 2024-08-18T21:59:56.137 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.130+0000 7f2bfdffb640 1 -- 172.21.15.183:0/418904131 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00012990 con 0x7f2c081a0fc0 2024-08-18T21:59:56.137 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.130+0000 7f2c0efe6640 1 -- 172.21.15.183:0/418904131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c081a4320 con 0x7f2c081a0fc0 2024-08-18T21:59:56.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.131+0000 7f2bfdffb640 1 -- 172.21.15.183:0/418904131 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f2c0001c070 con 0x7f2c081a0fc0 2024-08-18T21:59:56.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.131+0000 7f2bfdffb640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2bf40394f0 0x7f2bf403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:56.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.131+0000 7f2bfdffb640 1 -- 172.21.15.183:0/418904131 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2c0004ccb0 con 0x7f2c081a0fc0 2024-08-18T21:59:56.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.131+0000 7f2c0cd82640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2bf40394f0 0x7f2bf403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:56.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.132+0000 7f2c0efe6640 1 -- 172.21.15.183:0/418904131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c08109500 con 0x7f2c081a0fc0 2024-08-18T21:59:56.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.132+0000 7f2c0cd82640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2bf40394f0 0x7f2bf403b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2c0402c250 tx=0x7f2c0402c1e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:56.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.137+0000 7f2bfdffb640 1 -- 172.21.15.183:0/418904131 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2c00013c30 con 0x7f2c081a0fc0 2024-08-18T21:59:56.382 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.381+0000 7f2c0efe6640 1 -- 172.21.15.183:0/418904131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f2c0802d5e0 con 0x7f2c081a0fc0 2024-08-18T21:59:56.382 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T21:59:56.382 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: mon.c calling monitor election 2024-08-18T21:59:56.383 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: mon.a calling monitor election 2024-08-18T21:59:56.383 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:56.383 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:56.383 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:56.383 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:56.383 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:56.383 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:56.383 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:56.383 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:56.383 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:56.383 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:56.383 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-18T21:59:56.384 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: monmap epoch 3 2024-08-18T21:59:56.384 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: fsid dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:59:56.384 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: last_changed 2024-08-18T21:59:51.019393+0000 2024-08-18T21:59:56.384 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: created 2024-08-18T21:58:12.803696+0000 2024-08-18T21:59:56.384 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: min_mon_release 19 (squid) 2024-08-18T21:59:56.384 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: election_strategy: 1 2024-08-18T21:59:56.384 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: 0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2024-08-18T21:59:56.384 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-08-18T21:59:56.384 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-08-18T21:59:56.384 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: fsmap 2024-08-18T21:59:56.384 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: osdmap e4: 0 total, 0 up, 0 in 2024-08-18T21:59:56.384 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: mgrmap e13: x(active, since 46s) 2024-08-18T21:59:56.384 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: overall HEALTH_OK 2024-08-18T21:59:56.384 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:56.385 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:56.385 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:56.385 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:56 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:56.385 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.382+0000 7f2bfdffb640 1 -- 172.21.15.183:0/418904131 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1287 (secure 0 0 0) 0x7f2c0001d8d0 con 0x7f2c081a0fc0 2024-08-18T21:59:56.385 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T21:59:56.386 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":3,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","modified":"2024-08-18T21:59:51.019393Z","created":"2024-08-18T21:58:12.803696Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:3300","nonce":0},{"type":"v1","addr":"172.21.15.183:6789","nonce":0}]},"addr":"172.21.15.183:6789/0","public_addr":"172.21.15.183:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:3300","nonce":0},{"type":"v1","addr":"172.21.15.130:6789","nonce":0}]},"addr":"172.21.15.130:6789/0","public_addr":"172.21.15.130:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-18T21:59:56.386 INFO:teuthology.orchestra.run.smithi183.stderr:dumped monmap epoch 3 2024-08-18T21:59:56.386 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.385+0000 7f2c0efe6640 1 -- 172.21.15.183:0/418904131 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2bf40394f0 msgr2=0x7f2bf403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:56.387 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.385+0000 7f2c0efe6640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2bf40394f0 0x7f2bf403b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2c0402c250 tx=0x7f2c0402c1e0 comp rx=0 tx=0).stop 2024-08-18T21:59:56.387 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.385+0000 7f2c0efe6640 1 -- 172.21.15.183:0/418904131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c081a0fc0 msgr2=0x7f2c081a33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:56.387 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.385+0000 7f2c0efe6640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c081a0fc0 0x7f2c081a33b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000bd50 tx=0x7f2c0000be40 comp rx=0 tx=0).stop 2024-08-18T21:59:56.387 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.385+0000 7f2c0efe6640 1 -- 172.21.15.183:0/418904131 shutdown_connections 2024-08-18T21:59:56.387 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.385+0000 7f2c0efe6640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c081a0fc0 0x7f2c081a33b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:56.387 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.385+0000 7f2c0efe6640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c08198490 0x7f2c081988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:56.387 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.385+0000 7f2c0efe6640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2bf40394f0 0x7f2bf403b9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:56.387 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.385+0000 7f2c0efe6640 1 --2- 172.21.15.183:0/418904131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bf0003530 0x7f2c08197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:56.387 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.385+0000 7f2c0efe6640 1 -- 172.21.15.183:0/418904131 >> 172.21.15.183:0/418904131 conn(0x7f2c080fbf50 msgr2=0x7f2c080fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:56.387 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.385+0000 7f2c0efe6640 1 -- 172.21.15.183:0/418904131 shutdown_connections 2024-08-18T21:59:56.387 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:56.385+0000 7f2c0efe6640 1 -- 172.21.15.183:0/418904131 wait complete. 2024-08-18T21:59:56.432 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T21:59:56.432 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: mon.c calling monitor election 2024-08-18T21:59:56.432 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: mon.a calling monitor election 2024-08-18T21:59:56.432 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:56.432 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:56.433 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:56.433 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:56.433 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:56.433 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:56.433 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:56.433 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:56.433 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:56.433 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:56.433 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-18T21:59:56.434 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: monmap epoch 3 2024-08-18T21:59:56.434 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: fsid dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:59:56.434 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: last_changed 2024-08-18T21:59:51.019393+0000 2024-08-18T21:59:56.434 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: created 2024-08-18T21:58:12.803696+0000 2024-08-18T21:59:56.434 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: min_mon_release 19 (squid) 2024-08-18T21:59:56.434 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: election_strategy: 1 2024-08-18T21:59:56.434 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: 0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2024-08-18T21:59:56.434 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-08-18T21:59:56.434 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-08-18T21:59:56.435 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: fsmap 2024-08-18T21:59:56.435 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: osdmap e4: 0 total, 0 up, 0 in 2024-08-18T21:59:56.435 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: mgrmap e13: x(active, since 46s) 2024-08-18T21:59:56.435 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: overall HEALTH_OK 2024-08-18T21:59:56.435 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:56.435 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:56.435 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:56.435 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:56 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:56.950 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-18T21:59:56.951 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph config generate-minimal-conf 2024-08-18T21:59:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T21:59:57.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:57 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T21:59:57.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:57 smithi123 ceph-mon[18462]: from='client.? 172.21.15.183:0/418904131' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T21:59:57.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:57 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:57.270 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:57 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T21:59:57.270 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:57 smithi183 ceph-mon[22097]: from='client.? 172.21.15.183:0/418904131' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T21:59:57.270 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:57 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.651+0000 7fab47261640 1 -- 172.21.15.123:0/3077314703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab401015f0 msgr2=0x7fab401019d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.651+0000 7fab47261640 1 --2- 172.21.15.123:0/3077314703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab401015f0 0x7fab401019d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab34009880 tx=0x7fab3402a5d0 comp rx=0 tx=0).stop 2024-08-18T21:59:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.651+0000 7fab47261640 1 -- 172.21.15.123:0/3077314703 shutdown_connections 2024-08-18T21:59:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.651+0000 7fab47261640 1 --2- 172.21.15.123:0/3077314703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab401015f0 0x7fab401019d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.651+0000 7fab47261640 1 -- 172.21.15.123:0/3077314703 >> 172.21.15.123:0/3077314703 conn(0x7fab400fd050 msgr2=0x7fab400ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.651+0000 7fab47261640 1 -- 172.21.15.123:0/3077314703 shutdown_connections 2024-08-18T21:59:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.651+0000 7fab47261640 1 -- 172.21.15.123:0/3077314703 wait complete. 2024-08-18T21:59:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.652+0000 7fab47261640 1 Processor -- start 2024-08-18T21:59:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.652+0000 7fab47261640 1 -- start start 2024-08-18T21:59:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.652+0000 7fab47261640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab401015f0 0x7fab40074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.652+0000 7fab47261640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab40074760 0x7fab40074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.652+0000 7fab47261640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab401a3390 0x7fab401a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.652+0000 7fab47261640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fab4010ba40 con 0x7fab40074760 2024-08-18T21:59:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.652+0000 7fab47261640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fab4010b8c0 con 0x7fab401a3390 2024-08-18T21:59:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.652+0000 7fab47261640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fab4010bbc0 con 0x7fab401015f0 2024-08-18T21:59:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.652+0000 7fab3ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab40074760 0x7fab40074bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.653+0000 7fab3ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab40074760 0x7fab40074bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46710/0 (socket says 172.21.15.123:46710) 2024-08-18T21:59:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.653+0000 7fab3ffff640 1 -- 172.21.15.123:0/2409897669 learned_addr learned my addr 172.21.15.123:0/2409897669 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T21:59:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.653+0000 7fab44ffd640 1 --2- 172.21.15.123:0/2409897669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab401015f0 0x7fab40074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.653+0000 7fab3ffff640 1 -- 172.21.15.123:0/2409897669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab401015f0 msgr2=0x7fab40074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.653+0000 7fab3ffff640 1 --2- 172.21.15.123:0/2409897669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab401015f0 0x7fab40074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.653+0000 7fab3ffff640 1 -- 172.21.15.123:0/2409897669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab401a3390 msgr2=0x7fab401a5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.653+0000 7fab3ffff640 1 --2- 172.21.15.123:0/2409897669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab401a3390 0x7fab401a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.653+0000 7fab3ffff640 1 -- 172.21.15.123:0/2409897669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab401a5e50 con 0x7fab40074760 2024-08-18T21:59:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.653+0000 7fab44ffd640 1 --2- 172.21.15.123:0/2409897669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab401015f0 0x7fab40074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T21:59:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.653+0000 7fab3ffff640 1 --2- 172.21.15.123:0/2409897669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab40074760 0x7fab40074bc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00b520 tx=0x7fab2c00b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.653+0000 7fab3dffb640 1 -- 172.21.15.123:0/2409897669 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c004230 con 0x7fab40074760 2024-08-18T21:59:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.653+0000 7fab3dffb640 1 -- 172.21.15.123:0/2409897669 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab2c0043d0 con 0x7fab40074760 2024-08-18T21:59:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.653+0000 7fab3dffb640 1 -- 172.21.15.123:0/2409897669 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c003d60 con 0x7fab40074760 2024-08-18T21:59:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.653+0000 7fab47261640 1 -- 172.21.15.123:0/2409897669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab401a6140 con 0x7fab40074760 2024-08-18T21:59:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.654+0000 7fab47261640 1 -- 172.21.15.123:0/2409897669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab401a6630 con 0x7fab40074760 2024-08-18T21:59:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.654+0000 7fab3dffb640 1 -- 172.21.15.123:0/2409897669 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fab2c00e070 con 0x7fab40074760 2024-08-18T21:59:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.654+0000 7fab3dffb640 1 --2- 172.21.15.123:0/2409897669 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fab300394f0 0x7fab3003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.654+0000 7fab3dffb640 1 -- 172.21.15.123:0/2409897669 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fab2c04b930 con 0x7fab40074760 2024-08-18T21:59:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.655+0000 7fab44ffd640 1 --2- 172.21.15.123:0/2409897669 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fab300394f0 0x7fab3003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.655+0000 7fab47261640 1 -- 172.21.15.123:0/2409897669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab40101a50 con 0x7fab40074760 2024-08-18T21:59:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.655+0000 7fab44ffd640 1 --2- 172.21.15.123:0/2409897669 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fab300394f0 0x7fab3003b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab34005ab0 tx=0x7fab34005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.660+0000 7fab3dffb640 1 -- 172.21.15.123:0/2409897669 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fab2c014020 con 0x7fab40074760 2024-08-18T21:59:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.865+0000 7fab47261640 1 -- 172.21.15.123:0/2409897669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fab401a68f0 con 0x7fab40074760 2024-08-18T21:59:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.866+0000 7fab3dffb640 1 -- 172.21.15.123:0/2409897669 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7fab2c020350 con 0x7fab40074760 2024-08-18T21:59:57.867 INFO:teuthology.orchestra.run.smithi123.stdout:# minimal ceph.conf for dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:59:57.867 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2024-08-18T21:59:57.867 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:59:57.867 INFO:teuthology.orchestra.run.smithi123.stdout: mon_host = [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] 2024-08-18T21:59:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.868+0000 7fab47261640 1 -- 172.21.15.123:0/2409897669 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fab300394f0 msgr2=0x7fab3003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.868+0000 7fab47261640 1 --2- 172.21.15.123:0/2409897669 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fab300394f0 0x7fab3003b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab34005ab0 tx=0x7fab34005a20 comp rx=0 tx=0).stop 2024-08-18T21:59:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.868+0000 7fab47261640 1 -- 172.21.15.123:0/2409897669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab40074760 msgr2=0x7fab40074bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.868+0000 7fab47261640 1 --2- 172.21.15.123:0/2409897669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab40074760 0x7fab40074bc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00b520 tx=0x7fab2c00b9e0 comp rx=0 tx=0).stop 2024-08-18T21:59:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.868+0000 7fab47261640 1 -- 172.21.15.123:0/2409897669 shutdown_connections 2024-08-18T21:59:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.868+0000 7fab47261640 1 --2- 172.21.15.123:0/2409897669 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fab300394f0 0x7fab3003b9b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.868+0000 7fab47261640 1 --2- 172.21.15.123:0/2409897669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab401a3390 0x7fab401a5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.868+0000 7fab47261640 1 --2- 172.21.15.123:0/2409897669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab40074760 0x7fab40074bc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.868+0000 7fab47261640 1 --2- 172.21.15.123:0/2409897669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab401015f0 0x7fab40074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.868+0000 7fab47261640 1 -- 172.21.15.123:0/2409897669 >> 172.21.15.123:0/2409897669 conn(0x7fab400fd050 msgr2=0x7fab40109090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.868+0000 7fab47261640 1 -- 172.21.15.123:0/2409897669 shutdown_connections 2024-08-18T21:59:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T21:59:57.868+0000 7fab47261640 1 -- 172.21.15.123:0/2409897669 wait complete. 2024-08-18T21:59:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T21:59:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: mon.c calling monitor election 2024-08-18T21:59:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: mon.a calling monitor election 2024-08-18T21:59:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T21:59:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-18T21:59:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: monmap epoch 3 2024-08-18T21:59:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: fsid dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:59:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: last_changed 2024-08-18T21:59:51.019393+0000 2024-08-18T21:59:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: created 2024-08-18T21:58:12.803696+0000 2024-08-18T21:59:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: min_mon_release 19 (squid) 2024-08-18T21:59:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: election_strategy: 1 2024-08-18T21:59:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: 0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2024-08-18T21:59:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-08-18T21:59:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-08-18T21:59:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: fsmap 2024-08-18T21:59:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: osdmap e4: 0 total, 0 up, 0 in 2024-08-18T21:59:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: mgrmap e13: x(active, since 46s) 2024-08-18T21:59:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: overall HEALTH_OK 2024-08-18T21:59:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T21:59:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='client.? 172.21.15.183:0/418904131' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T21:59:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:58.527 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-18T21:59:58.527 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T21:59:58.528 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.conf 2024-08-18T21:59:58.555 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T21:59:58.556 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-18T21:59:58.623 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-18T21:59:58.623 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.conf 2024-08-18T21:59:58.651 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-18T21:59:58.651 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-18T21:59:58.717 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-08-18T21:59:58.717 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.conf 2024-08-18T21:59:58.744 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-08-18T21:59:58.744 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-18T21:59:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: mon.b calling monitor election 2024-08-18T21:59:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: Updating smithi123:/etc/ceph/ceph.conf 2024-08-18T21:59:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-18T21:59:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: Updating smithi183:/etc/ceph/ceph.conf 2024-08-18T21:59:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: Updating smithi123:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T21:59:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: Updating smithi183:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T21:59:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: Updating smithi130:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T21:59:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: mon.b calling monitor election 2024-08-18T21:59:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: mon.c calling monitor election 2024-08-18T21:59:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: mon.a calling monitor election 2024-08-18T21:59:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-18T21:59:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: monmap epoch 3 2024-08-18T21:59:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: fsid dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:59:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: last_changed 2024-08-18T21:59:51.019393+0000 2024-08-18T21:59:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: created 2024-08-18T21:58:12.803696+0000 2024-08-18T21:59:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: min_mon_release 19 (squid) 2024-08-18T21:59:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: election_strategy: 1 2024-08-18T21:59:58.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: 0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2024-08-18T21:59:58.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-08-18T21:59:58.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-08-18T21:59:58.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: fsmap 2024-08-18T21:59:58.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: osdmap e4: 0 total, 0 up, 0 in 2024-08-18T21:59:58.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: mgrmap e13: x(active, since 48s) 2024-08-18T21:59:58.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: overall HEALTH_OK 2024-08-18T21:59:58.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:58.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:58.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:58.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:58.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:58.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:58.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:58.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: Reconfiguring mon.a (monmap changed)... 2024-08-18T21:59:58.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T21:59:58.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T21:59:58.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:58.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:58 smithi123 ceph-mon[18462]: Reconfiguring daemon mon.a on smithi123 2024-08-18T21:59:58.809 INFO:tasks.cephadm:Adding mgr.x on smithi123 2024-08-18T21:59:58.810 INFO:tasks.cephadm:Adding mgr.y on smithi130 2024-08-18T21:59:58.810 INFO:tasks.cephadm:Adding mgr.z on smithi183 2024-08-18T21:59:58.810 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch apply mgr '3;smithi123=x;smithi130=y;smithi183=z' 2024-08-18T21:59:59.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: mon.b calling monitor election 2024-08-18T21:59:59.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: Updating smithi123:/etc/ceph/ceph.conf 2024-08-18T21:59:59.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-18T21:59:59.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: Updating smithi183:/etc/ceph/ceph.conf 2024-08-18T21:59:59.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: Updating smithi123:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T21:59:59.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: Updating smithi183:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T21:59:59.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: Updating smithi130:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T21:59:59.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: mon.b calling monitor election 2024-08-18T21:59:59.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: mon.c calling monitor election 2024-08-18T21:59:59.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: mon.a calling monitor election 2024-08-18T21:59:59.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: monmap epoch 3 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: fsid dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: last_changed 2024-08-18T21:59:51.019393+0000 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: created 2024-08-18T21:58:12.803696+0000 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: min_mon_release 19 (squid) 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: election_strategy: 1 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: 0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: fsmap 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: osdmap e4: 0 total, 0 up, 0 in 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: mgrmap e13: x(active, since 48s) 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: overall HEALTH_OK 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: Reconfiguring mon.a (monmap changed)... 2024-08-18T21:59:59.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T21:59:59.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T21:59:59.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:59.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:58 smithi130 ceph-mon[21698]: Reconfiguring daemon mon.a on smithi123 2024-08-18T21:59:59.091 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T21:59:59.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: mon.b calling monitor election 2024-08-18T21:59:59.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: Updating smithi123:/etc/ceph/ceph.conf 2024-08-18T21:59:59.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-18T21:59:59.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: Updating smithi183:/etc/ceph/ceph.conf 2024-08-18T21:59:59.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: Updating smithi123:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T21:59:59.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: Updating smithi183:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T21:59:59.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: Updating smithi130:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T21:59:59.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: mon.b calling monitor election 2024-08-18T21:59:59.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: mon.c calling monitor election 2024-08-18T21:59:59.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: mon.a calling monitor election 2024-08-18T21:59:59.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-18T21:59:59.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: monmap epoch 3 2024-08-18T21:59:59.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: fsid dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T21:59:59.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: last_changed 2024-08-18T21:59:51.019393+0000 2024-08-18T21:59:59.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: created 2024-08-18T21:58:12.803696+0000 2024-08-18T21:59:59.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: min_mon_release 19 (squid) 2024-08-18T21:59:59.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: election_strategy: 1 2024-08-18T21:59:59.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: 0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2024-08-18T21:59:59.161 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-08-18T21:59:59.161 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-08-18T21:59:59.161 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: fsmap 2024-08-18T21:59:59.161 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: osdmap e4: 0 total, 0 up, 0 in 2024-08-18T21:59:59.161 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: mgrmap e13: x(active, since 48s) 2024-08-18T21:59:59.161 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: overall HEALTH_OK 2024-08-18T21:59:59.161 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.161 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.161 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.161 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.161 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.161 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.161 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.162 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: Reconfiguring mon.a (monmap changed)... 2024-08-18T21:59:59.162 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T21:59:59.162 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T21:59:59.162 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:59.162 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:58 smithi183 ceph-mon[22097]: Reconfiguring daemon mon.a on smithi123 2024-08-18T21:59:59.466 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.463+0000 7f99e39cb640 1 -- 172.21.15.183:0/1778161644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99dc100320 msgr2=0x7f99dc100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:59.466 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.463+0000 7f99e39cb640 1 --2- 172.21.15.183:0/1778161644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99dc100320 0x7f99dc100720 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009c20 tx=0x7f99cc02aa90 comp rx=0 tx=0).stop 2024-08-18T21:59:59.466 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.463+0000 7f99e39cb640 1 -- 172.21.15.183:0/1778161644 shutdown_connections 2024-08-18T21:59:59.466 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.463+0000 7f99e39cb640 1 --2- 172.21.15.183:0/1778161644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99dc100320 0x7f99dc100720 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:59.466 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.464+0000 7f99e39cb640 1 -- 172.21.15.183:0/1778161644 >> 172.21.15.183:0/1778161644 conn(0x7f99dc0fbad0 msgr2=0x7f99dc0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:59.466 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.464+0000 7f99e39cb640 1 -- 172.21.15.183:0/1778161644 shutdown_connections 2024-08-18T21:59:59.466 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.464+0000 7f99e39cb640 1 -- 172.21.15.183:0/1778161644 wait complete. 2024-08-18T21:59:59.467 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.464+0000 7f99e39cb640 1 Processor -- start 2024-08-18T21:59:59.467 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.464+0000 7f99e39cb640 1 -- start start 2024-08-18T21:59:59.467 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.464+0000 7f99e39cb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99dc100320 0x7f99dc198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:59.467 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.464+0000 7f99e39cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99dc199480 0x7f99dc19e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:59.467 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.464+0000 7f99e39cb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99dc199900 0x7f99dc1a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:59.467 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.464+0000 7f99e39cb640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc106410 con 0x7f99dc199900 2024-08-18T21:59:59.467 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.464+0000 7f99e39cb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc106290 con 0x7f99dc100320 2024-08-18T21:59:59.467 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.464+0000 7f99e39cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc106590 con 0x7f99dc199480 2024-08-18T21:59:59.467 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99e0f66640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99dc199480 0x7f99dc19e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:59.467 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99e0f66640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99dc199480 0x7f99dc19e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44280/0 (socket says 172.21.15.183:44280) 2024-08-18T21:59:59.467 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99e0f66640 1 -- 172.21.15.183:0/2376407097 learned_addr learned my addr 172.21.15.183:0/2376407097 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-08-18T21:59:59.467 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99e1f68640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99dc199900 0x7f99dc1a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:59.468 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99e1767640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99dc100320 0x7f99dc198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:59.468 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99e1f68640 1 -- 172.21.15.183:0/2376407097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99dc199480 msgr2=0x7f99dc19e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:59.468 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99e1f68640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99dc199480 0x7f99dc19e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:59.468 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99e1f68640 1 -- 172.21.15.183:0/2376407097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99dc100320 msgr2=0x7f99dc198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:59.468 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99e1f68640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99dc100320 0x7f99dc198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:59.468 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99e1f68640 1 -- 172.21.15.183:0/2376407097 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc1a1340 con 0x7f99dc199900 2024-08-18T21:59:59.468 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99e0f66640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99dc199480 0x7f99dc19e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T21:59:59.468 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99e1767640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99dc100320 0x7f99dc198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T21:59:59.468 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99e1f68640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99dc199900 0x7f99dc1a0a80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009fd0 tx=0x7f99d400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:59.468 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99da7fc640 1 -- 172.21.15.183:0/2376407097 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d4015020 con 0x7f99dc199900 2024-08-18T21:59:59.468 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99e39cb640 1 -- 172.21.15.183:0/2376407097 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99dc1a1630 con 0x7f99dc199900 2024-08-18T21:59:59.468 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99da7fc640 1 -- 172.21.15.183:0/2376407097 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99d4011d10 con 0x7f99dc199900 2024-08-18T21:59:59.468 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.465+0000 7f99da7fc640 1 -- 172.21.15.183:0/2376407097 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d400f2e0 con 0x7f99dc199900 2024-08-18T21:59:59.468 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.466+0000 7f99e39cb640 1 -- 172.21.15.183:0/2376407097 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99dc1a1ba0 con 0x7f99dc199900 2024-08-18T21:59:59.469 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.466+0000 7f99da7fc640 1 -- 172.21.15.183:0/2376407097 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f99d4018020 con 0x7f99dc199900 2024-08-18T21:59:59.470 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.467+0000 7f99e39cb640 1 -- 172.21.15.183:0/2376407097 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99dc192cf0 con 0x7f99dc199900 2024-08-18T21:59:59.470 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.467+0000 7f99da7fc640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f99c40394f0 0x7f99c403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T21:59:59.470 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.467+0000 7f99da7fc640 1 -- 172.21.15.183:0/2376407097 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f99d404bd20 con 0x7f99dc199900 2024-08-18T21:59:59.470 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.467+0000 7f99e1767640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f99c40394f0 0x7f99c403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T21:59:59.470 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.467+0000 7f99e1767640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f99c40394f0 0x7f99c403b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009430 tx=0x7f99cc03a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T21:59:59.472 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.472+0000 7f99da7fc640 1 -- 172.21.15.183:0/2376407097 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f99d401f020 con 0x7f99dc199900 2024-08-18T21:59:59.649 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.649+0000 7f99e39cb640 1 -- 172.21.15.183:0/2376407097 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi123=x;smithi130=y;smithi183=z", "target": ["mon-mgr", ""]}) -- 0x7f99dc0623f0 con 0x7f99c40394f0 2024-08-18T21:59:59.654 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.653+0000 7f99da7fc640 1 -- 172.21.15.183:0/2376407097 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f99dc0623f0 con 0x7f99c40394f0 2024-08-18T21:59:59.654 INFO:teuthology.orchestra.run.smithi183.stdout:Scheduled mgr update... 2024-08-18T21:59:59.656 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.655+0000 7f99e39cb640 1 -- 172.21.15.183:0/2376407097 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f99c40394f0 msgr2=0x7f99c403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:59.656 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.655+0000 7f99e39cb640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f99c40394f0 0x7f99c403b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009430 tx=0x7f99cc03a040 comp rx=0 tx=0).stop 2024-08-18T21:59:59.656 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.655+0000 7f99e39cb640 1 -- 172.21.15.183:0/2376407097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99dc199900 msgr2=0x7f99dc1a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T21:59:59.656 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.655+0000 7f99e39cb640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99dc199900 0x7f99dc1a0a80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009fd0 tx=0x7f99d400b870 comp rx=0 tx=0).stop 2024-08-18T21:59:59.656 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.655+0000 7f99e39cb640 1 -- 172.21.15.183:0/2376407097 shutdown_connections 2024-08-18T21:59:59.656 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.655+0000 7f99e39cb640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99dc199900 0x7f99dc1a0a80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:59.656 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.655+0000 7f99e39cb640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99dc199480 0x7f99dc19e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:59.656 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.655+0000 7f99e39cb640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f99c40394f0 0x7f99c403b9b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:59.656 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.655+0000 7f99e39cb640 1 --2- 172.21.15.183:0/2376407097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99dc100320 0x7f99dc198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T21:59:59.657 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.655+0000 7f99e39cb640 1 -- 172.21.15.183:0/2376407097 >> 172.21.15.183:0/2376407097 conn(0x7f99dc0fbad0 msgr2=0x7f99dc18fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T21:59:59.657 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.655+0000 7f99e39cb640 1 -- 172.21.15.183:0/2376407097 shutdown_connections 2024-08-18T21:59:59.657 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T21:59:59.655+0000 7f99e39cb640 1 -- 172.21.15.183:0/2376407097 wait complete. 2024-08-18T21:59:59.992 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:59 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T21:59:59.992 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:59 smithi130 ceph-mon[21698]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T21:59:59.992 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:59 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.992 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:59 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.992 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:59 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T21:59:59.992 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:59 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T21:59:59.992 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:59 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T21:59:59.992 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:59 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T21:59:59.992 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 21:59:59 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:00.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:59 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T22:00:00.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:59 smithi123 ceph-mon[18462]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:00.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:59 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:00.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:59 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:00.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:59 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:00.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:59 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:00:00.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:59 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:00:00.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:59 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:00.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 21:59:59 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:00.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:59 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T22:00:00.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:59 smithi183 ceph-mon[22097]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:00.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:59 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:00.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:59 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:00.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:59 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:00.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:59 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:00:00.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:59 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:00:00.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:59 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:00.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 21:59:59 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:00.235 DEBUG:teuthology.orchestra.run.smithi130:mgr.y> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mgr.y.service 2024-08-18T22:00:00.237 DEBUG:teuthology.orchestra.run.smithi183:mgr.z> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mgr.z.service 2024-08-18T22:00:00.240 INFO:tasks.cephadm:Deploying OSDs... 2024-08-18T22:00:00.240 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T22:00:00.240 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2024-08-18T22:00:00.259 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-18T22:00:00.259 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2024-08-18T22:00:00.315 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-18T22:00:00.315 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:00:00.315 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-08-18T22:00:00.316 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:00:00.316 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:00:00.316 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-08-18 21:59:17.740573698 +0000 2024-08-18T22:00:00.316 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-08-18 21:55:19.505925317 +0000 2024-08-18T22:00:00.316 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-08-18 21:55:19.505925317 +0000 2024-08-18T22:00:00.316 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-08-18 21:55:19.505925317 +0000 2024-08-18T22:00:00.316 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-18T22:00:00.382 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-08-18T22:00:00.382 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-08-18T22:00:00.382 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000221618 s, 2.3 MB/s 2024-08-18T22:00:00.384 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-18T22:00:00.442 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2024-08-18T22:00:00.499 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-18T22:00:00.499 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:00:00.499 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-08-18T22:00:00.499 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:00:00.499 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:00:00.499 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-08-18 21:59:17.773572945 +0000 2024-08-18T22:00:00.499 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-08-18 21:55:19.830918696 +0000 2024-08-18T22:00:00.499 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-08-18 21:55:19.830918696 +0000 2024-08-18T22:00:00.499 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-08-18 21:55:19.830918696 +0000 2024-08-18T22:00:00.500 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-18T22:00:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-08-18T22:00:00.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-08-18T22:00:00.566 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000194534 s, 2.6 MB/s 2024-08-18T22:00:00.567 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-18T22:00:00.624 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2024-08-18T22:00:00.682 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-18T22:00:00.682 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:00:00.682 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-08-18T22:00:00.682 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:00:00.683 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:00:00.683 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-08-18 21:59:17.809572123 +0000 2024-08-18T22:00:00.683 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-08-18 21:55:20.154912094 +0000 2024-08-18T22:00:00.683 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-08-18 21:55:20.154912094 +0000 2024-08-18T22:00:00.683 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-08-18 21:55:20.154912094 +0000 2024-08-18T22:00:00.684 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-18T22:00:00.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-08-18T22:00:00.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-08-18T22:00:00.748 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000255148 s, 2.0 MB/s 2024-08-18T22:00:00.749 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-18T22:00:00.806 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2024-08-18T22:00:00.862 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-18T22:00:00.863 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:00:00.863 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-08-18T22:00:00.863 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:00:00.863 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:00:00.863 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-08-18 21:59:17.841571393 +0000 2024-08-18T22:00:00.863 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-08-18 21:55:20.507904901 +0000 2024-08-18T22:00:00.863 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-08-18 21:55:20.507904901 +0000 2024-08-18T22:00:00.863 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-08-18 21:55:20.507904901 +0000 2024-08-18T22:00:00.863 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-18T22:00:00.925 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-08-18T22:00:00.926 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-08-18T22:00:00.926 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.0002369 s, 2.2 MB/s 2024-08-18T22:00:00.927 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-18T22:00:00.984 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-18T22:00:00.984 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2024-08-18T22:00:01.000 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-18T22:00:01.000 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2024-08-18T22:00:01.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:00 smithi123 ceph-mon[18462]: Reconfiguring mon.b (monmap changed)... 2024-08-18T22:00:01.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:00 smithi123 ceph-mon[18462]: Reconfiguring daemon mon.b on smithi130 2024-08-18T22:00:01.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:00 smithi123 ceph-mon[18462]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi123=x;smithi130=y;smithi183=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:00:01.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:00 smithi123 ceph-mon[18462]: Saving service mgr spec with placement smithi123=x;smithi130=y;smithi183=z;count:3 2024-08-18T22:00:01.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:00 smithi123 ceph-mon[18462]: overall HEALTH_OK 2024-08-18T22:00:01.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:00 smithi130 ceph-mon[21698]: Reconfiguring mon.b (monmap changed)... 2024-08-18T22:00:01.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:00 smithi130 ceph-mon[21698]: Reconfiguring daemon mon.b on smithi130 2024-08-18T22:00:01.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:00 smithi130 ceph-mon[21698]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi123=x;smithi130=y;smithi183=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:00:01.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:00 smithi130 ceph-mon[21698]: Saving service mgr spec with placement smithi123=x;smithi130=y;smithi183=z;count:3 2024-08-18T22:00:01.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:00 smithi130 ceph-mon[21698]: overall HEALTH_OK 2024-08-18T22:00:01.029 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-18T22:00:01.029 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:00:01.029 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-08-18T22:00:01.029 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:00:01.029 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:00:01.029 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-08-18 21:59:50.432536157 +0000 2024-08-18T22:00:01.029 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-08-18 21:55:38.955236945 +0000 2024-08-18T22:00:01.029 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-08-18 21:55:38.955236945 +0000 2024-08-18T22:00:01.030 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-08-18 21:55:38.955236945 +0000 2024-08-18T22:00:01.030 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-18T22:00:01.093 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-08-18T22:00:01.094 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-08-18T22:00:01.094 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000248541 s, 2.1 MB/s 2024-08-18T22:00:01.095 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-18T22:00:01.151 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2024-08-18T22:00:01.158 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:00 smithi183 ceph-mon[22097]: Reconfiguring mon.b (monmap changed)... 2024-08-18T22:00:01.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:00 smithi183 ceph-mon[22097]: Reconfiguring daemon mon.b on smithi130 2024-08-18T22:00:01.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:00 smithi183 ceph-mon[22097]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi123=x;smithi130=y;smithi183=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:00:01.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:00 smithi183 ceph-mon[22097]: Saving service mgr spec with placement smithi123=x;smithi130=y;smithi183=z;count:3 2024-08-18T22:00:01.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:00 smithi183 ceph-mon[22097]: overall HEALTH_OK 2024-08-18T22:00:01.207 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-18T22:00:01.207 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:00:01.207 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 690 Links: 1 2024-08-18T22:00:01.207 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:00:01.207 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:00:01.207 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-08-18 21:59:50.432536157 +0000 2024-08-18T22:00:01.207 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-08-18 21:55:39.280234189 +0000 2024-08-18T22:00:01.208 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-08-18 21:55:39.280234189 +0000 2024-08-18T22:00:01.208 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-08-18 21:55:39.280234189 +0000 2024-08-18T22:00:01.208 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-18T22:00:01.271 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-08-18T22:00:01.271 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-08-18T22:00:01.272 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000208458 s, 2.5 MB/s 2024-08-18T22:00:01.272 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-18T22:00:01.329 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2024-08-18T22:00:01.386 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-18T22:00:01.386 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:00:01.386 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 710 Links: 1 2024-08-18T22:00:01.386 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:00:01.386 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:00:01.386 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-08-18 21:59:50.433536139 +0000 2024-08-18T22:00:01.386 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-08-18 21:55:39.601231467 +0000 2024-08-18T22:00:01.386 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-08-18 21:55:39.601231467 +0000 2024-08-18T22:00:01.387 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-08-18 21:55:39.601231467 +0000 2024-08-18T22:00:01.387 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-18T22:00:01.449 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-08-18T22:00:01.449 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-08-18T22:00:01.449 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000221366 s, 2.3 MB/s 2024-08-18T22:00:01.450 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-18T22:00:01.507 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2024-08-18T22:00:01.562 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-18T22:00:01.562 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:00:01.562 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 728 Links: 1 2024-08-18T22:00:01.562 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:00:01.562 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:00:01.562 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-08-18 21:59:50.433536139 +0000 2024-08-18T22:00:01.563 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-08-18 21:55:39.922228744 +0000 2024-08-18T22:00:01.563 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-08-18 21:55:39.922228744 +0000 2024-08-18T22:00:01.563 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-08-18 21:55:39.922228744 +0000 2024-08-18T22:00:01.563 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-18T22:00:01.626 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-08-18T22:00:01.626 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-08-18T22:00:01.626 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000242844 s, 2.1 MB/s 2024-08-18T22:00:01.627 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-18T22:00:01.684 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-08-18T22:00:01.684 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2024-08-18T22:00:01.701 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-18T22:00:01.701 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 2024-08-18T22:00:01.757 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-18T22:00:01.757 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:00:01.757 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-08-18T22:00:01.757 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:00:01.757 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:00:01.757 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-08-18 21:59:41.278695293 +0000 2024-08-18T22:00:01.758 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-08-18 21:55:39.240940602 +0000 2024-08-18T22:00:01.758 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-08-18 21:55:39.240940602 +0000 2024-08-18T22:00:01.758 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-08-18 21:55:39.240940602 +0000 2024-08-18T22:00:01.758 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-18T22:00:01.821 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-08-18T22:00:01.822 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-08-18T22:00:01.822 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000281844 s, 1.8 MB/s 2024-08-18T22:00:01.823 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-18T22:00:01.880 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 2024-08-18T22:00:01.935 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-18T22:00:01.936 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:00:01.936 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 691 Links: 1 2024-08-18T22:00:01.936 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:00:01.936 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:00:01.936 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-08-18 21:59:41.278695293 +0000 2024-08-18T22:00:01.936 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-08-18 21:55:39.561931802 +0000 2024-08-18T22:00:01.936 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-08-18 21:55:39.561931802 +0000 2024-08-18T22:00:01.936 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-08-18 21:55:39.561931802 +0000 2024-08-18T22:00:01.936 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-18T22:00:01.999 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-08-18T22:00:02.000 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-08-18T22:00:02.000 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000191805 s, 2.7 MB/s 2024-08-18T22:00:02.001 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-18T22:00:02.058 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 2024-08-18T22:00:02.115 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-18T22:00:02.115 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:00:02.115 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 710 Links: 1 2024-08-18T22:00:02.115 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:00:02.116 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:00:02.116 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-08-18 21:59:41.279695266 +0000 2024-08-18T22:00:02.116 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-08-18 21:55:39.907922316 +0000 2024-08-18T22:00:02.116 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-08-18 21:55:39.907922316 +0000 2024-08-18T22:00:02.116 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-08-18 21:55:39.907922316 +0000 2024-08-18T22:00:02.116 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-18T22:00:02.178 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-08-18T22:00:02.178 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-08-18T22:00:02.179 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000212698 s, 2.4 MB/s 2024-08-18T22:00:02.180 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-18T22:00:02.237 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 2024-08-18T22:00:02.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:01 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:02.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:01 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:02.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:01 smithi123 ceph-mon[18462]: Reconfiguring mon.c (monmap changed)... 2024-08-18T22:00:02.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:01 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:00:02.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:01 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:00:02.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:01 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:02.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:01 smithi123 ceph-mon[18462]: Reconfiguring daemon mon.c on smithi183 2024-08-18T22:00:02.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:01 smithi123 ceph-mon[18462]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:02.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:01 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:02.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:01 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:02.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:01 smithi130 ceph-mon[21698]: Reconfiguring mon.c (monmap changed)... 2024-08-18T22:00:02.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:01 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:00:02.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:01 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:00:02.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:01 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:02.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:01 smithi130 ceph-mon[21698]: Reconfiguring daemon mon.c on smithi183 2024-08-18T22:00:02.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:01 smithi130 ceph-mon[21698]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:02.274 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:01 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:02.274 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:01 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:02.274 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:01 smithi183 ceph-mon[22097]: Reconfiguring mon.c (monmap changed)... 2024-08-18T22:00:02.274 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:01 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:00:02.274 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:01 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:00:02.274 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:01 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:02.274 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:01 smithi183 ceph-mon[22097]: Reconfiguring daemon mon.c on smithi183 2024-08-18T22:00:02.274 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:01 smithi183 ceph-mon[22097]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:02.289 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-18T22:00:02.289 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:00:02.290 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 731 Links: 1 2024-08-18T22:00:02.290 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:00:02.290 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:00:02.290 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-08-18 21:59:41.279695266 +0000 2024-08-18T22:00:02.290 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-08-18 21:55:40.220913735 +0000 2024-08-18T22:00:02.290 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-08-18 21:55:40.220913735 +0000 2024-08-18T22:00:02.290 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-08-18 21:55:40.220913735 +0000 2024-08-18T22:00:02.290 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-18T22:00:02.354 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-08-18T22:00:02.354 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-08-18T22:00:02.354 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000204782 s, 2.5 MB/s 2024-08-18T22:00:02.355 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-18T22:00:02.412 INFO:tasks.cephadm:Deploying osd.0 on smithi123 with /dev/vg_nvme/lv_4... 2024-08-18T22:00:02.412 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-18T22:00:02.665 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:00:03.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:03.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:03.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:03.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:03.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:03.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:03.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:00:03.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-18T22:00:03.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:00:03.411 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:03.411 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:03 smithi183 ceph-mon[22097]: Deploying daemon mgr.z on smithi183 2024-08-18T22:00:03.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:03.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:03.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:03.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:03.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:03.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:03.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:00:03.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-18T22:00:03.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:00:03.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:03.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:03 smithi123 ceph-mon[18462]: Deploying daemon mgr.z on smithi183 2024-08-18T22:00:03.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:03.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:03.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:03.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:03.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:03.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:03.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:00:03.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-18T22:00:03.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:00:03.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:03.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:03 smithi130 ceph-mon[21698]: Deploying daemon mgr.z on smithi183 2024-08-18T22:00:04.326 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:04 smithi183 systemd[1]: Starting Ceph mgr.z for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:00:04.589 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:04 smithi183 ceph-mon[22097]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:04.589 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:04 smithi183 podman[23887]: 2024-08-18 22:00:04.325142657 +0000 UTC m=+0.110410663 container create d5afc1953c8e7591accd2bfa1e057d8e3ba9f462e3d44808b38c3a928dd5c84b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-08-18T22:00:04.589 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:04 smithi183 podman[23887]: 2024-08-18 22:00:04.23170355 +0000 UTC m=+0.016971516 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:00:04.589 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:04 smithi183 podman[23887]: 2024-08-18 22:00:04.560876569 +0000 UTC m=+0.346144548 container init d5afc1953c8e7591accd2bfa1e057d8e3ba9f462e3d44808b38c3a928dd5c84b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0) 2024-08-18T22:00:04.589 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:04 smithi183 podman[23887]: 2024-08-18 22:00:04.56435536 +0000 UTC m=+0.349623331 container start d5afc1953c8e7591accd2bfa1e057d8e3ba9f462e3d44808b38c3a928dd5c84b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-18T22:00:04.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:04 smithi123 ceph-mon[18462]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:04.763 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:04 smithi130 ceph-mon[21698]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:04.847 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:04 smithi183 ceph-mgr[23906]: -- 172.21.15.183:0/4294539311 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561a106bb0e0 con 0x561a10698800 2024-08-18T22:00:04.847 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:04 smithi183 bash[23887]: d5afc1953c8e7591accd2bfa1e057d8e3ba9f462e3d44808b38c3a928dd5c84b 2024-08-18T22:00:04.847 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:04 smithi183 systemd[1]: Started Ceph mgr.z for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T22:00:04.847 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:04 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:04.781+0000 7fcba56af040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-18T22:00:04.847 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:04 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:04.846+0000 7fcba56af040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-18T22:00:04.940 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:00:04.965 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi123:vg_nvme/lv_4 2024-08-18T22:00:05.144 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:04 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:04.986+0000 7fcba56af040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-18T22:00:05.144 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:05.143+0000 7fcba56af040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-18T22:00:05.208 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:00:05.409 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:05.285+0000 7fcba56af040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-18T22:00:05.713 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:05.409+0000 7fcba56af040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-18T22:00:05.714 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:05.535+0000 7fcba56af040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-18T22:00:05.714 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:05.591+0000 7fcba56af040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-18T22:00:05.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.687+0000 7f70bffba640 1 -- 172.21.15.123:0/3302582343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70b81014a0 msgr2=0x7f70b8101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:00:05.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.687+0000 7f70bffba640 1 --2- 172.21.15.123:0/3302582343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70b81014a0 0x7f70b8101950 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009ca0 tx=0x7f70b002a8c0 comp rx=0 tx=0).stop 2024-08-18T22:00:05.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.687+0000 7f70bffba640 1 -- 172.21.15.123:0/3302582343 shutdown_connections 2024-08-18T22:00:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.687+0000 7f70bffba640 1 --2- 172.21.15.123:0/3302582343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70b81014a0 0x7f70b8101950 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.687+0000 7f70bffba640 1 --2- 172.21.15.123:0/3302582343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70b8100b00 0x7f70b8100f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.687+0000 7f70bffba640 1 --2- 172.21.15.123:0/3302582343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70b81001c0 0x7f70b81005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.687+0000 7f70bffba640 1 -- 172.21.15.123:0/3302582343 >> 172.21.15.123:0/3302582343 conn(0x7f70b80fbfd0 msgr2=0x7f70b80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:00:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.687+0000 7f70bffba640 1 -- 172.21.15.123:0/3302582343 shutdown_connections 2024-08-18T22:00:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.687+0000 7f70bffba640 1 -- 172.21.15.123:0/3302582343 wait complete. 2024-08-18T22:00:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.688+0000 7f70bffba640 1 Processor -- start 2024-08-18T22:00:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.688+0000 7f70bffba640 1 -- start start 2024-08-18T22:00:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.688+0000 7f70bffba640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70b81001c0 0x7f70b8199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:00:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.688+0000 7f70bffba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70b8100b00 0x7f70b819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:00:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.688+0000 7f70bffba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70b81014a0 0x7f70b81a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:00:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.688+0000 7f70bffba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f70b810f860 con 0x7f70b81014a0 2024-08-18T22:00:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.688+0000 7f70bffba640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70b810f6e0 con 0x7f70b81001c0 2024-08-18T22:00:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.688+0000 7f70bffba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f70b810f9e0 con 0x7f70b8100b00 2024-08-18T22:00:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.688+0000 7f70be557640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70b81014a0 0x7f70b81a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:00:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.688+0000 7f70be557640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70b81014a0 0x7f70b81a1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39024/0 (socket says 172.21.15.123:39024) 2024-08-18T22:00:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.688+0000 7f70bd555640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70b8100b00 0x7f70b819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:00:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.688+0000 7f70be557640 1 -- 172.21.15.123:0/2772141280 learned_addr learned my addr 172.21.15.123:0/2772141280 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:00:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.688+0000 7f70bdd56640 1 --2- 172.21.15.123:0/2772141280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70b81001c0 0x7f70b8199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:00:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.689+0000 7f70be557640 1 -- 172.21.15.123:0/2772141280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70b8100b00 msgr2=0x7f70b819a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:00:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.689+0000 7f70be557640 1 --2- 172.21.15.123:0/2772141280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70b8100b00 0x7f70b819a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.689+0000 7f70be557640 1 -- 172.21.15.123:0/2772141280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70b81001c0 msgr2=0x7f70b8199e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:00:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.689+0000 7f70be557640 1 --2- 172.21.15.123:0/2772141280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70b81001c0 0x7f70b8199e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.689+0000 7f70be557640 1 -- 172.21.15.123:0/2772141280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b81a1a80 con 0x7f70b81014a0 2024-08-18T22:00:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.689+0000 7f70be557640 1 --2- 172.21.15.123:0/2772141280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70b81014a0 0x7f70b81a1410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f70b00319f0 tx=0x7f70b002f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:00:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.689+0000 7f70aeffd640 1 -- 172.21.15.123:0/2772141280 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b0003c70 con 0x7f70b81014a0 2024-08-18T22:00:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.689+0000 7f70aeffd640 1 -- 172.21.15.123:0/2772141280 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70b0003e10 con 0x7f70b81014a0 2024-08-18T22:00:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.689+0000 7f70bffba640 1 -- 172.21.15.123:0/2772141280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b81a1d10 con 0x7f70b81014a0 2024-08-18T22:00:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.689+0000 7f70aeffd640 1 -- 172.21.15.123:0/2772141280 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b002fcc0 con 0x7f70b81014a0 2024-08-18T22:00:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.689+0000 7f70bffba640 1 -- 172.21.15.123:0/2772141280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b81a2270 con 0x7f70b81014a0 2024-08-18T22:00:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.690+0000 7f70aeffd640 1 -- 172.21.15.123:0/2772141280 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f70b0004040 con 0x7f70b81014a0 2024-08-18T22:00:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.690+0000 7f70bffba640 1 -- 172.21.15.123:0/2772141280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70b810af10 con 0x7f70b81014a0 2024-08-18T22:00:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.690+0000 7f70aeffd640 1 --2- 172.21.15.123:0/2772141280 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f70a40392c0 0x7f70a403b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:00:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.690+0000 7f70aeffd640 1 -- 172.21.15.123:0/2772141280 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f70b006d7c0 con 0x7f70b81014a0 2024-08-18T22:00:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.690+0000 7f70bdd56640 1 --2- 172.21.15.123:0/2772141280 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f70a40392c0 0x7f70a403b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:00:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.690+0000 7f70bdd56640 1 --2- 172.21.15.123:0/2772141280 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f70a40392c0 0x7f70a403b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f70b400bbe0 tx=0x7f70b400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:00:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.695+0000 7f70aeffd640 1 -- 172.21.15.123:0/2772141280 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f70b003bcc0 con 0x7f70b81014a0 2024-08-18T22:00:05.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:05.872+0000 7f70bffba640 1 -- 172.21.15.123:0/2772141280 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f70b8062360 con 0x7f70a40392c0 2024-08-18T22:00:05.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:05 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:05.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:05 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:05.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:05 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:05.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:05 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:00:05.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:05 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-18T22:00:05.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:05 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:00:05.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:05 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:05.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:05 smithi123 ceph-mon[18462]: Deploying daemon mgr.y on smithi130 2024-08-18T22:00:05.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:05 smithi123 ceph-mon[18462]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:06.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:05 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:06.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:05 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:06.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:05 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:06.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:05 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:00:06.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:05 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-18T22:00:06.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:05 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:00:06.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:05 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:06.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:05 smithi130 ceph-mon[21698]: Deploying daemon mgr.y on smithi130 2024-08-18T22:00:06.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:05 smithi130 ceph-mon[21698]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:06.020 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:05.894+0000 7fcba56af040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-18T22:00:06.020 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:05.953+0000 7fcba56af040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-18T22:00:06.020 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:06.020+0000 7fcba56af040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-18T22:00:06.020 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:06.021 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:06.021 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:06.021 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:00:06.021 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-18T22:00:06.021 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:00:06.021 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:06.021 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-mon[22097]: Deploying daemon mgr.y on smithi130 2024-08-18T22:00:06.021 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:05 smithi183 ceph-mon[22097]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:06.292 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:06.166+0000 7fcba56af040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-18T22:00:06.292 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:06.225+0000 7fcba56af040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-18T22:00:06.292 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:06.292+0000 7fcba56af040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-18T22:00:06.593 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:06.474+0000 7fcba56af040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-18T22:00:06.593 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:06.533+0000 7fcba56af040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-18T22:00:06.593 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:06.592+0000 7fcba56af040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-18T22:00:06.871 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:06.660+0000 7fcba56af040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-18T22:00:06.872 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:06.871+0000 7fcba56af040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-18T22:00:06.872 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:06 smithi183 ceph-mon[22097]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:00:06.872 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:06 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:00:06.872 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:06 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:00:06.872 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:06 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:07.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:06 smithi123 ceph-mon[18462]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:00:07.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:06 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:00:07.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:06 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:00:07.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:06 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:07.014 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:06 smithi130 systemd[1]: Started Ceph mgr.y for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T22:00:07.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:06 smithi130 ceph-mon[21698]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:00:07.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:06 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:00:07.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:06 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:00:07.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:06 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:07.159 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:06.930+0000 7fcba56af040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-18T22:00:07.430 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:07 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:07.031+0000 7f6311b7e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-18T22:00:07.430 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:07 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:07.099+0000 7f6311b7e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-18T22:00:07.430 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:07 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:07.248+0000 7f6311b7e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-18T22:00:07.430 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:07 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:07.429+0000 7f6311b7e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-18T22:00:07.701 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:07 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:07.584+0000 7f6311b7e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-18T22:00:07.826 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:07 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:07.503+0000 7fcba56af040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-18T22:00:07.826 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:07 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:07.824+0000 7fcba56af040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-18T22:00:07.959 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:07 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:07.711+0000 7f6311b7e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-18T22:00:07.959 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:07 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:07.843+0000 7f6311b7e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-18T22:00:07.959 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:07 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:07.901+0000 7f6311b7e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-18T22:00:08.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:07 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:08.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:07 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:08.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:07 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:08.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:07 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:08.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:07 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:08.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:07 smithi123 ceph-mon[18462]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:08.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:07 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:08.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:07 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:08.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:07 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:08.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:07 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:08.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:07 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:08.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:07 smithi183 ceph-mon[22097]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:08.216 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:07 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:08.217 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:07 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:08.217 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:07 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:08.217 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:07 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:08.217 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:07 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:08.217 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:07 smithi130 ceph-mon[21698]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:08.495 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:08.215+0000 7f6311b7e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-18T22:00:08.495 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:08.279+0000 7f6311b7e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-18T22:00:08.495 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:08.348+0000 7f6311b7e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-18T22:00:08.495 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:08.494+0000 7f6311b7e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-18T22:00:08.659 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:08.254+0000 7fcba56af040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-18T22:00:08.659 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:08.312+0000 7fcba56af040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-18T22:00:08.659 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z[23902]: 2024-08-18T22:00:08.373+0000 7fcba56af040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-18T22:00:08.764 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:08.553+0000 7f6311b7e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-18T22:00:08.764 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:08.619+0000 7f6311b7e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-18T22:00:09.197 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:08.802+0000 7f6311b7e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-18T22:00:09.197 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:08.861+0000 7f6311b7e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-18T22:00:09.197 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:08.921+0000 7f6311b7e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-18T22:00:09.197 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:08.988+0000 7f6311b7e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-18T22:00:09.197 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:09 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:09.195+0000 7f6311b7e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-18T22:00:09.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3103825110' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c488e31f-717b-4e62-9a65-2716c0c0b138"}]: dispatch 2024-08-18T22:00:09.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3103825110' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c488e31f-717b-4e62-9a65-2716c0c0b138"}]': finished 2024-08-18T22:00:09.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: osdmap e5: 1 total, 0 up, 1 in 2024-08-18T22:00:09.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:09.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:09.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:09.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:09.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:09.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:09.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:09.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:09.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: Reconfiguring mgr.x (unknown last config time)... 2024-08-18T22:00:09.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:00:09.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:00:09.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:09.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: Reconfiguring daemon mgr.x on smithi123 2024-08-18T22:00:09.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:08 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2117523742' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:00:09.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3103825110' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c488e31f-717b-4e62-9a65-2716c0c0b138"}]: dispatch 2024-08-18T22:00:09.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3103825110' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c488e31f-717b-4e62-9a65-2716c0c0b138"}]': finished 2024-08-18T22:00:09.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: osdmap e5: 1 total, 0 up, 1 in 2024-08-18T22:00:09.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:09.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:09.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:09.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:09.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:09.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:09.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:09.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:09.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: Reconfiguring mgr.x (unknown last config time)... 2024-08-18T22:00:09.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:00:09.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:00:09.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:09.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: Reconfiguring daemon mgr.x on smithi123 2024-08-18T22:00:09.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:08 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2117523742' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:00:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3103825110' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c488e31f-717b-4e62-9a65-2716c0c0b138"}]: dispatch 2024-08-18T22:00:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3103825110' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c488e31f-717b-4e62-9a65-2716c0c0b138"}]': finished 2024-08-18T22:00:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: osdmap e5: 1 total, 0 up, 1 in 2024-08-18T22:00:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:09.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:09.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:09.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: Reconfiguring mgr.x (unknown last config time)... 2024-08-18T22:00:09.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:00:09.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:00:09.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:09.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: Reconfiguring daemon mgr.x on smithi123 2024-08-18T22:00:09.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:08 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2117523742' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:00:09.514 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:09 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:09.254+0000 7f6311b7e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-18T22:00:10.081 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:09 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:09.771+0000 7f6311b7e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-18T22:00:10.081 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:10 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:10.080+0000 7f6311b7e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-18T22:00:10.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:10.293+0000 7f70aeffd640 1 -- 172.21.15.123:0/2772141280 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 14) ==== 92061+0+0 (secure 0 0 0) 0x7f70b00305c0 con 0x7f70b81014a0 2024-08-18T22:00:10.496 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:10 smithi130 ceph-mon[21698]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:10.497 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:10.497 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:10 smithi130 ceph-mon[21698]: Standby manager daemon z started 2024-08-18T22:00:10.497 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:10 smithi130 ceph-mon[21698]: from='mgr.? 172.21.15.183:0/1026827368' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-18T22:00:10.497 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:10 smithi130 ceph-mon[21698]: from='mgr.? 172.21.15.183:0/1026827368' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:00:10.497 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:10 smithi130 ceph-mon[21698]: from='mgr.? 172.21.15.183:0/1026827368' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-18T22:00:10.498 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:10 smithi130 ceph-mon[21698]: from='mgr.? 172.21.15.183:0/1026827368' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:00:10.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:10 smithi183 ceph-mon[22097]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:10.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:10.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:10 smithi183 ceph-mon[22097]: Standby manager daemon z started 2024-08-18T22:00:10.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:10 smithi183 ceph-mon[22097]: from='mgr.? 172.21.15.183:0/1026827368' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-18T22:00:10.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:10 smithi183 ceph-mon[22097]: from='mgr.? 172.21.15.183:0/1026827368' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:00:10.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:10 smithi183 ceph-mon[22097]: from='mgr.? 172.21.15.183:0/1026827368' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-18T22:00:10.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:10 smithi183 ceph-mon[22097]: from='mgr.? 172.21.15.183:0/1026827368' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:00:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:10 smithi123 ceph-mon[18462]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:10 smithi123 ceph-mon[18462]: Standby manager daemon z started 2024-08-18T22:00:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:10 smithi123 ceph-mon[18462]: from='mgr.? 172.21.15.183:0/1026827368' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-18T22:00:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:10 smithi123 ceph-mon[18462]: from='mgr.? 172.21.15.183:0/1026827368' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:00:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:10 smithi123 ceph-mon[18462]: from='mgr.? 172.21.15.183:0/1026827368' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-18T22:00:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:10 smithi123 ceph-mon[18462]: from='mgr.? 172.21.15.183:0/1026827368' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:00:10.764 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:10 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:10.495+0000 7f6311b7e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-18T22:00:10.764 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:10 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:10.550+0000 7f6311b7e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-18T22:00:10.764 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:00:10 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y[23071]: 2024-08-18T22:00:10.609+0000 7f6311b7e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-18T22:00:11.624 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:11 smithi123 ceph-mon[18462]: mgrmap e14: x(active, since 61s), standbys: z 2024-08-18T22:00:11.624 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:11 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-18T22:00:11.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:11 smithi183 ceph-mon[22097]: mgrmap e14: x(active, since 61s), standbys: z 2024-08-18T22:00:11.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:11 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-18T22:00:11.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:11 smithi130 ceph-mon[21698]: mgrmap e14: x(active, since 61s), standbys: z 2024-08-18T22:00:11.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:11 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-18T22:00:12.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:12.309+0000 7f70aeffd640 1 -- 172.21.15.123:0/2772141280 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f70b002ec70 con 0x7f70b81014a0 2024-08-18T22:00:12.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:12 smithi123 ceph-mon[18462]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:12.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:12 smithi123 ceph-mon[18462]: Standby manager daemon y started 2024-08-18T22:00:12.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:12 smithi123 ceph-mon[18462]: from='mgr.? 172.21.15.130:0/149180055' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-18T22:00:12.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:12 smithi123 ceph-mon[18462]: from='mgr.? 172.21.15.130:0/149180055' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:00:12.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:12 smithi123 ceph-mon[18462]: from='mgr.? 172.21.15.130:0/149180055' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-18T22:00:12.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:12 smithi123 ceph-mon[18462]: from='mgr.? 172.21.15.130:0/149180055' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:00:12.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:12 smithi183 ceph-mon[22097]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:12.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:12 smithi183 ceph-mon[22097]: Standby manager daemon y started 2024-08-18T22:00:12.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:12 smithi183 ceph-mon[22097]: from='mgr.? 172.21.15.130:0/149180055' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-18T22:00:12.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:12 smithi183 ceph-mon[22097]: from='mgr.? 172.21.15.130:0/149180055' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:00:12.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:12 smithi183 ceph-mon[22097]: from='mgr.? 172.21.15.130:0/149180055' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-18T22:00:12.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:12 smithi183 ceph-mon[22097]: from='mgr.? 172.21.15.130:0/149180055' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:00:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:12 smithi130 ceph-mon[21698]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:12 smithi130 ceph-mon[21698]: Standby manager daemon y started 2024-08-18T22:00:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:12 smithi130 ceph-mon[21698]: from='mgr.? 172.21.15.130:0/149180055' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-18T22:00:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:12 smithi130 ceph-mon[21698]: from='mgr.? 172.21.15.130:0/149180055' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:00:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:12 smithi130 ceph-mon[21698]: from='mgr.? 172.21.15.130:0/149180055' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-18T22:00:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:12 smithi130 ceph-mon[21698]: from='mgr.? 172.21.15.130:0/149180055' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:00:13.386 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:13 smithi123 ceph-mon[18462]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-08-18T22:00:13.386 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:13 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-18T22:00:13.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:13 smithi183 ceph-mon[22097]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-08-18T22:00:13.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:13 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-18T22:00:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:13 smithi130 ceph-mon[21698]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-08-18T22:00:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:13 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-18T22:00:14.492 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:14 smithi123 ceph-mon[18462]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:14.492 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:14 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:14.492 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:14 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:14.492 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:14 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:14.493 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:14 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:14.493 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:14 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:14.493 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:14 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:14 smithi130 ceph-mon[21698]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:14 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:14 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:14 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:14 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:14 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:14 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:14.908 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:14 smithi183 ceph-mon[22097]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:14.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:14 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:14.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:14 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:14.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:14 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:14.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:14 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:14.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:14 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:14.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:14 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:16.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:16 smithi123 ceph-mon[18462]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:16.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-18T22:00:16.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:16.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:16 smithi130 ceph-mon[21698]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:16.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-18T22:00:16.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:16.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:16 smithi183 ceph-mon[22097]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:16.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-18T22:00:16.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:17.498 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:17 smithi123 ceph-mon[18462]: Deploying daemon osd.0 on smithi123 2024-08-18T22:00:17.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:17 smithi130 ceph-mon[21698]: Deploying daemon osd.0 on smithi123 2024-08-18T22:00:17.810 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:17 smithi183 ceph-mon[22097]: Deploying daemon osd.0 on smithi123 2024-08-18T22:00:18.696 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:18 smithi123 ceph-mon[18462]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:18.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:18 smithi130 ceph-mon[21698]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:18.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:18 smithi183 ceph-mon[22097]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:19.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:19 smithi123 ceph-mon[18462]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:19.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:19 smithi130 ceph-mon[21698]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:19.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:19 smithi183 ceph-mon[22097]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:20 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:20 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:20 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:20.778 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:20.778 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:20.778 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:20.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:20 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:20.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:20 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:20.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:20 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:21.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:21 smithi183 ceph-mon[22097]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:22.003 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:21 smithi123 ceph-mon[18462]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:22.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:21 smithi130 ceph-mon[21698]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:23.552 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:23.552 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:23.552 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:23.552 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:23.552 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:23.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:23.599+0000 7f70aeffd640 1 -- 172.21.15.123:0/2772141280 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f70b8062360 con 0x7f70a40392c0 2024-08-18T22:00:23.600 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 0 on host 'smithi123' 2024-08-18T22:00:23.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:23.602+0000 7f70bffba640 1 -- 172.21.15.123:0/2772141280 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f70a40392c0 msgr2=0x7f70a403b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:00:23.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:23.602+0000 7f70bffba640 1 --2- 172.21.15.123:0/2772141280 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f70a40392c0 0x7f70a403b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f70b400bbe0 tx=0x7f70b400b390 comp rx=0 tx=0).stop 2024-08-18T22:00:23.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:23.602+0000 7f70bffba640 1 -- 172.21.15.123:0/2772141280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70b81014a0 msgr2=0x7f70b81a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:00:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:23.602+0000 7f70bffba640 1 --2- 172.21.15.123:0/2772141280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70b81014a0 0x7f70b81a1410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f70b00319f0 tx=0x7f70b002f450 comp rx=0 tx=0).stop 2024-08-18T22:00:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:23.603+0000 7f70bffba640 1 -- 172.21.15.123:0/2772141280 shutdown_connections 2024-08-18T22:00:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:23.603+0000 7f70bffba640 1 --2- 172.21.15.123:0/2772141280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70b81014a0 0x7f70b81a1410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:23.603+0000 7f70bffba640 1 --2- 172.21.15.123:0/2772141280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70b8100b00 0x7f70b819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:23.603+0000 7f70bffba640 1 --2- 172.21.15.123:0/2772141280 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f70a40392c0 0x7f70a403b780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:23.603+0000 7f70bffba640 1 --2- 172.21.15.123:0/2772141280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70b81001c0 0x7f70b8199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:23.603+0000 7f70bffba640 1 -- 172.21.15.123:0/2772141280 >> 172.21.15.123:0/2772141280 conn(0x7f70b80fbfd0 msgr2=0x7f70b80fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:00:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:23.603+0000 7f70bffba640 1 -- 172.21.15.123:0/2772141280 shutdown_connections 2024-08-18T22:00:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:00:23.603+0000 7f70bffba640 1 -- 172.21.15.123:0/2772141280 wait complete. 2024-08-18T22:00:23.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:23.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:23.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:23.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:23.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:23.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:23.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:23.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:23.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:23.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:24.257 DEBUG:teuthology.orchestra.run.smithi123:osd.0> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.0.service 2024-08-18T22:00:24.260 INFO:tasks.cephadm:Deploying osd.1 on smithi130 with /dev/vg_nvme/lv_4... 2024-08-18T22:00:24.260 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-18T22:00:24.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:24 smithi123 ceph-mon[18462]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:24.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:24 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:24.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:24 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:24.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:24 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:24.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:24 smithi123 ceph-mon[18462]: from='osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-18T22:00:24.510 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:00:24 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-0[30331]: 2024-08-18T22:00:24.326+0000 7ff624597640 -1 osd.0 0 log_to_monitors true 2024-08-18T22:00:24.535 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.b/config 2024-08-18T22:00:24.651 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:24 smithi130 ceph-mon[21698]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:24.651 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:24 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:24.651 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:24 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:24.651 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:24 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:24.651 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:24 smithi130 ceph-mon[21698]: from='osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-18T22:00:24.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:24 smithi183 ceph-mon[22097]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:24.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:24 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:24 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:24 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:24 smithi183 ceph-mon[22097]: from='osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-18T22:00:25.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:25 smithi130 ceph-mon[21698]: from='osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-18T22:00:25.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:25 smithi130 ceph-mon[21698]: osdmap e6: 1 total, 0 up, 1 in 2024-08-18T22:00:25.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:25 smithi130 ceph-mon[21698]: from='osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-08-18T22:00:25.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:25 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:25.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:25 smithi130 ceph-mon[21698]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:25.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:25 smithi183 ceph-mon[22097]: from='osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-18T22:00:25.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:25 smithi183 ceph-mon[22097]: osdmap e6: 1 total, 0 up, 1 in 2024-08-18T22:00:25.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:25 smithi183 ceph-mon[22097]: from='osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-08-18T22:00:25.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:25 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:25.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:25 smithi183 ceph-mon[22097]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:26.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:25 smithi123 ceph-mon[18462]: from='osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-18T22:00:26.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:25 smithi123 ceph-mon[18462]: osdmap e6: 1 total, 0 up, 1 in 2024-08-18T22:00:26.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:25 smithi123 ceph-mon[18462]: from='osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-08-18T22:00:26.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:25 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:26.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:25 smithi123 ceph-mon[18462]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:26.620 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:00:26 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-0[30331]: 2024-08-18T22:00:26.316+0000 7ff62051a640 -1 osd.0 0 waiting for initial osdmap 2024-08-18T22:00:26.620 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:00:26 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-0[30331]: 2024-08-18T22:00:26.320+0000 7ff61833a640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:00:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:26 smithi183 ceph-mon[22097]: from='osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-08-18T22:00:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:26 smithi183 ceph-mon[22097]: osdmap e7: 1 total, 0 up, 1 in 2024-08-18T22:00:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:26 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:26 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:26 smithi183 ceph-mon[22097]: from='osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725]' entity='osd.0' 2024-08-18T22:00:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:26 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:26.929 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:26 smithi130 ceph-mon[21698]: from='osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-08-18T22:00:26.929 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:26 smithi130 ceph-mon[21698]: osdmap e7: 1 total, 0 up, 1 in 2024-08-18T22:00:26.930 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:26 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:26.930 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:26 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:26.930 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:26 smithi130 ceph-mon[21698]: from='osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725]' entity='osd.0' 2024-08-18T22:00:26.930 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:26 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:26.932 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T22:00:26.959 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_4 2024-08-18T22:00:27.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:26 smithi123 ceph-mon[18462]: from='osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-08-18T22:00:27.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:26 smithi123 ceph-mon[18462]: osdmap e7: 1 total, 0 up, 1 in 2024-08-18T22:00:27.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:26 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:27.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:26 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:27.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:26 smithi123 ceph-mon[18462]: from='osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725]' entity='osd.0' 2024-08-18T22:00:27.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:26 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:27.208 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.b/config 2024-08-18T22:00:27.658 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.654+0000 7fac5a177640 1 -- 172.21.15.130:0/3239164552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac541034f0 msgr2=0x7fac54109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:00:27.658 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.654+0000 7fac5a177640 1 --2- 172.21.15.130:0/3239164552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac541034f0 0x7fac54109d80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009ca0 tx=0x7fac4c02a8c0 comp rx=0 tx=0).stop 2024-08-18T22:00:27.658 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.654+0000 7fac5a177640 1 -- 172.21.15.130:0/3239164552 shutdown_connections 2024-08-18T22:00:27.658 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.654+0000 7fac5a177640 1 --2- 172.21.15.130:0/3239164552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac541034f0 0x7fac54109d80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:27.658 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.654+0000 7fac5a177640 1 --2- 172.21.15.130:0/3239164552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac54102b30 0x7fac54102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:27.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.654+0000 7fac5a177640 1 --2- 172.21.15.130:0/3239164552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac54101930 0x7fac54101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:27.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.654+0000 7fac5a177640 1 -- 172.21.15.130:0/3239164552 >> 172.21.15.130:0/3239164552 conn(0x7fac540fd0c0 msgr2=0x7fac540ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:00:27.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.655+0000 7fac5a177640 1 -- 172.21.15.130:0/3239164552 shutdown_connections 2024-08-18T22:00:27.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.655+0000 7fac5a177640 1 -- 172.21.15.130:0/3239164552 wait complete. 2024-08-18T22:00:27.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.655+0000 7fac5a177640 1 Processor -- start 2024-08-18T22:00:27.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.655+0000 7fac5a177640 1 -- start start 2024-08-18T22:00:27.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac5a177640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac54101930 0x7fac54075cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:00:27.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac5a177640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac54102b30 0x7fac54074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:00:27.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac5a177640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac541034f0 0x7fac54074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:00:27.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac5a177640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fac5410d610 con 0x7fac541034f0 2024-08-18T22:00:27.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac5a177640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac5410d490 con 0x7fac54101930 2024-08-18T22:00:27.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac5a177640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fac5410d790 con 0x7fac54102b30 2024-08-18T22:00:27.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac537fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac54101930 0x7fac54075cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:00:27.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac537fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac54101930 0x7fac54075cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:39982/0 (socket says 172.21.15.130:39982) 2024-08-18T22:00:27.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac537fe640 1 -- 172.21.15.130:0/1861879725 learned_addr learned my addr 172.21.15.130:0/1861879725 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-08-18T22:00:27.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac52ffd640 1 --2- 172.21.15.130:0/1861879725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac54102b30 0x7fac54074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:00:27.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac537fe640 1 -- 172.21.15.130:0/1861879725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac54102b30 msgr2=0x7fac54074310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:00:27.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac537fe640 1 --2- 172.21.15.130:0/1861879725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac54102b30 0x7fac54074310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:27.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac537fe640 1 -- 172.21.15.130:0/1861879725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac541034f0 msgr2=0x7fac54074850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:00:27.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac537fe640 1 --2- 172.21.15.130:0/1861879725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac541034f0 0x7fac54074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:27.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac537fe640 1 -- 172.21.15.130:0/1861879725 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac54075110 con 0x7fac54101930 2024-08-18T22:00:27.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac537fe640 1 --2- 172.21.15.130:0/1861879725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac54101930 0x7fac54075cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fac4400d950 tx=0x7fac4400dd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:00:27.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.656+0000 7fac50ff9640 1 -- 172.21.15.130:0/1861879725 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44017020 con 0x7fac54101930 2024-08-18T22:00:27.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.657+0000 7fac5a177640 1 -- 172.21.15.130:0/1861879725 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac541a1df0 con 0x7fac54101930 2024-08-18T22:00:27.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.657+0000 7fac50ff9640 1 -- 172.21.15.130:0/1861879725 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac44009c30 con 0x7fac54101930 2024-08-18T22:00:27.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.657+0000 7fac50ff9640 1 -- 172.21.15.130:0/1861879725 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4400f6b0 con 0x7fac54101930 2024-08-18T22:00:27.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.657+0000 7fac5a177640 1 -- 172.21.15.130:0/1861879725 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac541a2250 con 0x7fac54101930 2024-08-18T22:00:27.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.658+0000 7fac5a177640 1 -- 172.21.15.130:0/1861879725 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac54108d30 con 0x7fac54101930 2024-08-18T22:00:27.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.659+0000 7fac50ff9640 1 -- 172.21.15.130:0/1861879725 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7fac4401a020 con 0x7fac54101930 2024-08-18T22:00:27.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.659+0000 7fac50ff9640 1 --2- 172.21.15.130:0/1861879725 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac400a2af0 0x7fac400a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:00:27.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.660+0000 7fac50ff9640 1 -- 172.21.15.130:0/1861879725 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7fac440cd230 con 0x7fac54101930 2024-08-18T22:00:27.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.660+0000 7fac52ffd640 1 --2- 172.21.15.130:0/1861879725 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac400a2af0 0x7fac400a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:00:27.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.660+0000 7fac52ffd640 1 --2- 172.21.15.130:0/1861879725 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac400a2af0 0x7fac400a4fb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fac54075a40 tx=0x7fac3c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:00:27.665 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.664+0000 7fac50ff9640 1 -- 172.21.15.130:0/1861879725 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fac44009de0 con 0x7fac54101930 2024-08-18T22:00:27.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:27.839+0000 7fac5a177640 1 -- 172.21.15.130:0/1861879725 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fac54062360 con 0x7fac400a2af0 2024-08-18T22:00:28.438 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: purged_snaps scrub starts 2024-08-18T22:00:28.439 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: purged_snaps scrub ok 2024-08-18T22:00:28.439 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: Detected new or changed devices on smithi123 2024-08-18T22:00:28.439 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:28.439 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:28.439 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:00:28.440 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: Adjusting osd_memory_target on smithi123 to 17088M 2024-08-18T22:00:28.440 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:28.440 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:28.440 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:28.440 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:28.441 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:28.441 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725] boot 2024-08-18T22:00:28.441 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: osdmap e8: 1 total, 1 up, 1 in 2024-08-18T22:00:28.441 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:28.441 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:00:28.442 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:00:28.442 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:28.501 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: purged_snaps scrub starts 2024-08-18T22:00:28.502 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: purged_snaps scrub ok 2024-08-18T22:00:28.502 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: Detected new or changed devices on smithi123 2024-08-18T22:00:28.502 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:28.502 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:28.502 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:00:28.502 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: Adjusting osd_memory_target on smithi123 to 17088M 2024-08-18T22:00:28.502 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:28.502 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:28.502 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:28.502 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:28.503 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:28.503 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725] boot 2024-08-18T22:00:28.503 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: osdmap e8: 1 total, 1 up, 1 in 2024-08-18T22:00:28.503 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:28.503 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:00:28.503 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:00:28.503 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:28.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: purged_snaps scrub starts 2024-08-18T22:00:28.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: purged_snaps scrub ok 2024-08-18T22:00:28.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: Detected new or changed devices on smithi123 2024-08-18T22:00:28.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:28.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:28.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:00:28.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: Adjusting osd_memory_target on smithi123 to 17088M 2024-08-18T22:00:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:00:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: osd.0 [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725] boot 2024-08-18T22:00:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: osdmap e8: 1 total, 1 up, 1 in 2024-08-18T22:00:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:00:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:00:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:00:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:29.282 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:29 smithi130 ceph-mon[21698]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:00:29.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:29 smithi183 ceph-mon[22097]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:00:29.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:29 smithi123 ceph-mon[18462]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:00:30.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:30 smithi130 ceph-mon[21698]: osdmap e9: 1 total, 1 up, 1 in 2024-08-18T22:00:30.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:30 smithi130 ceph-mon[21698]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:30.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:30 smithi130 ceph-mon[21698]: from='client.? 172.21.15.130:0/3423914964' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc6d894a-bf9f-45f3-9902-8fabe7a564ee"}]: dispatch 2024-08-18T22:00:30.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:30 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc6d894a-bf9f-45f3-9902-8fabe7a564ee"}]: dispatch 2024-08-18T22:00:30.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:30 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc6d894a-bf9f-45f3-9902-8fabe7a564ee"}]': finished 2024-08-18T22:00:30.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:30 smithi130 ceph-mon[21698]: osdmap e10: 2 total, 1 up, 2 in 2024-08-18T22:00:30.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:30 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:00:30.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:30 smithi123 ceph-mon[18462]: osdmap e9: 1 total, 1 up, 1 in 2024-08-18T22:00:30.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:30 smithi123 ceph-mon[18462]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:30.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:30 smithi123 ceph-mon[18462]: from='client.? 172.21.15.130:0/3423914964' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc6d894a-bf9f-45f3-9902-8fabe7a564ee"}]: dispatch 2024-08-18T22:00:30.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:30 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc6d894a-bf9f-45f3-9902-8fabe7a564ee"}]: dispatch 2024-08-18T22:00:30.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:30 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc6d894a-bf9f-45f3-9902-8fabe7a564ee"}]': finished 2024-08-18T22:00:30.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:30 smithi123 ceph-mon[18462]: osdmap e10: 2 total, 1 up, 2 in 2024-08-18T22:00:30.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:30 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:00:30.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:30 smithi183 ceph-mon[22097]: osdmap e9: 1 total, 1 up, 1 in 2024-08-18T22:00:30.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:30 smithi183 ceph-mon[22097]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:30.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:30 smithi183 ceph-mon[22097]: from='client.? 172.21.15.130:0/3423914964' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc6d894a-bf9f-45f3-9902-8fabe7a564ee"}]: dispatch 2024-08-18T22:00:30.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:30 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc6d894a-bf9f-45f3-9902-8fabe7a564ee"}]: dispatch 2024-08-18T22:00:30.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:30 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc6d894a-bf9f-45f3-9902-8fabe7a564ee"}]': finished 2024-08-18T22:00:30.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:30 smithi183 ceph-mon[22097]: osdmap e10: 2 total, 1 up, 2 in 2024-08-18T22:00:30.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:30 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:00:31.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:31 smithi123 ceph-mon[18462]: from='client.? 172.21.15.130:0/4257939298' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:00:31.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:31 smithi130 ceph-mon[21698]: from='client.? 172.21.15.130:0/4257939298' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:00:31.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:31 smithi183 ceph-mon[22097]: from='client.? 172.21.15.130:0/4257939298' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:00:32.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:32 smithi123 ceph-mon[18462]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:32.513 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:32 smithi130 ceph-mon[21698]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:32.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:32 smithi183 ceph-mon[22097]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:34.600 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:34 smithi130 ceph-mon[21698]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:34.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:34 smithi183 ceph-mon[22097]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:34.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:34 smithi123 ceph-mon[18462]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:36.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:36 smithi130 ceph-mon[21698]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:36.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:36 smithi183 ceph-mon[22097]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:36.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:36 smithi123 ceph-mon[18462]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:37.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:37 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-18T22:00:37.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:37 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:37.723 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:37 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-18T22:00:37.723 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:37 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:37.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:37 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-18T22:00:37.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:37 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:38.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:38 smithi183 ceph-mon[22097]: Deploying daemon osd.1 on smithi130 2024-08-18T22:00:38.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:38 smithi183 ceph-mon[22097]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:38 smithi123 ceph-mon[18462]: Deploying daemon osd.1 on smithi130 2024-08-18T22:00:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:38 smithi123 ceph-mon[18462]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:38.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:38 smithi130 ceph-mon[21698]: Deploying daemon osd.1 on smithi130 2024-08-18T22:00:38.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:38 smithi130 ceph-mon[21698]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:40.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:40 smithi183 ceph-mon[22097]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:40.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:40 smithi123 ceph-mon[18462]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:40.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:40 smithi130 ceph-mon[21698]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:41.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:41 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:41.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:41 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:41.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:41 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:41.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:41 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:41.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:41 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:41.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:41 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:41.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:41 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:41.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:41 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:41.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:41 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:42.574 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:42 smithi130 ceph-mon[21698]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:42.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:42 smithi183 ceph-mon[22097]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:42.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:42 smithi123 ceph-mon[18462]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:43.917 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:43.916+0000 7fac50ff9640 1 -- 172.21.15.130:0/1861879725 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fac54062360 con 0x7fac400a2af0 2024-08-18T22:00:43.917 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 1 on host 'smithi130' 2024-08-18T22:00:43.919 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:43.918+0000 7fac5a177640 1 -- 172.21.15.130:0/1861879725 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac400a2af0 msgr2=0x7fac400a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:00:43.919 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:43.918+0000 7fac5a177640 1 --2- 172.21.15.130:0/1861879725 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac400a2af0 0x7fac400a4fb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fac54075a40 tx=0x7fac3c009110 comp rx=0 tx=0).stop 2024-08-18T22:00:43.919 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:43.918+0000 7fac5a177640 1 -- 172.21.15.130:0/1861879725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac54101930 msgr2=0x7fac54075cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:00:43.919 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:43.918+0000 7fac5a177640 1 --2- 172.21.15.130:0/1861879725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac54101930 0x7fac54075cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fac4400d950 tx=0x7fac4400dd50 comp rx=0 tx=0).stop 2024-08-18T22:00:43.919 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:43.918+0000 7fac5a177640 1 -- 172.21.15.130:0/1861879725 shutdown_connections 2024-08-18T22:00:43.920 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:43.918+0000 7fac5a177640 1 --2- 172.21.15.130:0/1861879725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac541034f0 0x7fac54074850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:43.920 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:43.918+0000 7fac5a177640 1 --2- 172.21.15.130:0/1861879725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac54102b30 0x7fac54074310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:43.920 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:43.918+0000 7fac5a177640 1 --2- 172.21.15.130:0/1861879725 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac400a2af0 0x7fac400a4fb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:43.920 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:43.918+0000 7fac5a177640 1 --2- 172.21.15.130:0/1861879725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac54101930 0x7fac54075cc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:43.920 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:43.918+0000 7fac5a177640 1 -- 172.21.15.130:0/1861879725 >> 172.21.15.130:0/1861879725 conn(0x7fac540fd0c0 msgr2=0x7fac54105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:00:43.920 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:43.918+0000 7fac5a177640 1 -- 172.21.15.130:0/1861879725 shutdown_connections 2024-08-18T22:00:43.920 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:00:43.918+0000 7fac5a177640 1 -- 172.21.15.130:0/1861879725 wait complete. 2024-08-18T22:00:44.484 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:44 smithi130 ceph-mon[21698]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:44.484 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:44 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:44.484 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:44 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:44.511 DEBUG:teuthology.orchestra.run.smithi130:osd.1> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.1.service 2024-08-18T22:00:44.513 INFO:tasks.cephadm:Deploying osd.2 on smithi183 with /dev/vg_nvme/lv_4... 2024-08-18T22:00:44.514 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-18T22:00:44.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:44 smithi183 ceph-mon[22097]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:44.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:44 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:44.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:44 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:44.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:44 smithi123 ceph-mon[18462]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:44.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:44 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:44.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:44 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:44.773 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T22:00:45.344 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:00:45 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-1[26022]: 2024-08-18T22:00:45.031+0000 7f335782e640 -1 osd.1 0 log_to_monitors true 2024-08-18T22:00:45.897 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:45 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:45.897 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:45 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:45.897 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:45 smithi183 ceph-mon[22097]: from='osd.1 [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-18T22:00:45.897 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:45 smithi183 ceph-mon[22097]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-18T22:00:45.897 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:45 smithi183 ceph-mon[22097]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:46.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:45 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:46.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:45 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:46.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:45 smithi123 ceph-mon[18462]: from='osd.1 [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-18T22:00:46.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:45 smithi123 ceph-mon[18462]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-18T22:00:46.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:45 smithi123 ceph-mon[18462]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:46.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:45 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:46.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:45 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:46.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:45 smithi130 ceph-mon[21698]: from='osd.1 [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-18T22:00:46.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:45 smithi130 ceph-mon[21698]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-18T22:00:46.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:45 smithi130 ceph-mon[21698]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:46.896 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:46 smithi183 ceph-mon[22097]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-18T22:00:46.896 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:46 smithi183 ceph-mon[22097]: from='osd.1 [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:00:46.897 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:46 smithi183 ceph-mon[22097]: osdmap e11: 2 total, 1 up, 2 in 2024-08-18T22:00:46.897 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:00:46.897 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:46 smithi183 ceph-mon[22097]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:00:47.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:46 smithi123 ceph-mon[18462]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-18T22:00:47.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:46 smithi123 ceph-mon[18462]: from='osd.1 [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:00:47.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:46 smithi123 ceph-mon[18462]: osdmap e11: 2 total, 1 up, 2 in 2024-08-18T22:00:47.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:00:47.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:46 smithi123 ceph-mon[18462]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:00:47.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:46 smithi130 ceph-mon[21698]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-18T22:00:47.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:46 smithi130 ceph-mon[21698]: from='osd.1 [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:00:47.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:46 smithi130 ceph-mon[21698]: osdmap e11: 2 total, 1 up, 2 in 2024-08-18T22:00:47.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:00:47.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:46 smithi130 ceph-mon[21698]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:00:47.015 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:00:46 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-1[26022]: 2024-08-18T22:00:46.608+0000 7f33537b1640 -1 osd.1 0 waiting for initial osdmap 2024-08-18T22:00:47.015 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:00:46 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-1[26022]: 2024-08-18T22:00:46.613+0000 7f334f5d9640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:00:47.132 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T22:00:47.159 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_4 2024-08-18T22:00:47.412 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T22:00:47.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:47 smithi183 ceph-mon[22097]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-18T22:00:47.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:47 smithi183 ceph-mon[22097]: osdmap e12: 2 total, 1 up, 2 in 2024-08-18T22:00:47.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:00:47.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:00:47.683 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:47 smithi183 ceph-mon[22097]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:47.879 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.876+0000 7f5b1a2e1640 1 -- 172.21.15.183:0/34199589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b14101a80 msgr2=0x7f5b14101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:00:47.879 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.876+0000 7f5b1a2e1640 1 --2- 172.21.15.183:0/34199589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b14101a80 0x7f5b14101f00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009900 tx=0x7f5afc02a410 comp rx=0 tx=0).stop 2024-08-18T22:00:47.880 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.876+0000 7f5b1a2e1640 1 -- 172.21.15.183:0/34199589 shutdown_connections 2024-08-18T22:00:47.880 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.876+0000 7f5b1a2e1640 1 --2- 172.21.15.183:0/34199589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b14102440 0x7f5b14108cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:47.880 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.876+0000 7f5b1a2e1640 1 --2- 172.21.15.183:0/34199589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b14101a80 0x7f5b14101f00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:47.880 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.876+0000 7f5b1a2e1640 1 --2- 172.21.15.183:0/34199589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b14100d60 0x7f5b14101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:47.880 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.876+0000 7f5b1a2e1640 1 -- 172.21.15.183:0/34199589 >> 172.21.15.183:0/34199589 conn(0x7f5b140fb770 msgr2=0x7f5b140fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:00:47.880 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.876+0000 7f5b1a2e1640 1 -- 172.21.15.183:0/34199589 shutdown_connections 2024-08-18T22:00:47.880 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.876+0000 7f5b1a2e1640 1 -- 172.21.15.183:0/34199589 wait complete. 2024-08-18T22:00:47.880 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1a2e1640 1 Processor -- start 2024-08-18T22:00:47.880 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1a2e1640 1 -- start start 2024-08-18T22:00:47.880 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1a2e1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b14100d60 0x7f5b14104a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:00:47.880 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1a2e1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b14101a80 0x7f5b14103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:00:47.880 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1a2e1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b14102440 0x7f5b141035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:00:47.880 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1a2e1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1410c4d0 con 0x7f5b14100d60 2024-08-18T22:00:47.881 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1a2e1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1410c350 con 0x7f5b14101a80 2024-08-18T22:00:47.881 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1a2e1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1410c650 con 0x7f5b14102440 2024-08-18T22:00:47.881 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1887e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b14102440 0x7f5b141035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:00:47.881 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1887e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b14102440 0x7f5b141035b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:33884/0 (socket says 172.21.15.183:33884) 2024-08-18T22:00:47.881 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1887e640 1 -- 172.21.15.183:0/1475871249 learned_addr learned my addr 172.21.15.183:0/1475871249 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-08-18T22:00:47.881 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b0bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b14101a80 0x7f5b14103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:00:47.881 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b13fff640 1 --2- 172.21.15.183:0/1475871249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b14100d60 0x7f5b14104a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:00:47.881 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1887e640 1 -- 172.21.15.183:0/1475871249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b14101a80 msgr2=0x7f5b14103070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:00:47.881 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1887e640 1 --2- 172.21.15.183:0/1475871249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b14101a80 0x7f5b14103070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:47.881 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1887e640 1 -- 172.21.15.183:0/1475871249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b14100d60 msgr2=0x7f5b14104a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:00:47.881 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1887e640 1 --2- 172.21.15.183:0/1475871249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b14100d60 0x7f5b14104a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:00:47.881 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1887e640 1 -- 172.21.15.183:0/1475871249 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b14103e70 con 0x7f5b14102440 2024-08-18T22:00:47.881 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b0bfff640 1 --2- 172.21.15.183:0/1475871249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b14101a80 0x7f5b14103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:00:47.881 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.877+0000 7f5b1887e640 1 --2- 172.21.15.183:0/1475871249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b14102440 0x7f5b141035b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00cad0 tx=0x7f5b0c00cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:00:47.882 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.878+0000 7f5b11ffb640 1 -- 172.21.15.183:0/1475871249 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00ae20 con 0x7f5b14102440 2024-08-18T22:00:47.882 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.878+0000 7f5b11ffb640 1 -- 172.21.15.183:0/1475871249 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b0c005020 con 0x7f5b14102440 2024-08-18T22:00:47.882 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.878+0000 7f5b1a2e1640 1 -- 172.21.15.183:0/1475871249 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b141a1e20 con 0x7f5b14102440 2024-08-18T22:00:47.882 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.878+0000 7f5b11ffb640 1 -- 172.21.15.183:0/1475871249 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00f6f0 con 0x7f5b14102440 2024-08-18T22:00:47.882 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.878+0000 7f5b1a2e1640 1 -- 172.21.15.183:0/1475871249 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b141a22d0 con 0x7f5b14102440 2024-08-18T22:00:47.883 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.879+0000 7f5b1a2e1640 1 -- 172.21.15.183:0/1475871249 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b141a2560 con 0x7f5b14102440 2024-08-18T22:00:47.883 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.880+0000 7f5b11ffb640 1 -- 172.21.15.183:0/1475871249 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f5b0c0051d0 con 0x7f5b14102440 2024-08-18T22:00:47.883 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.881+0000 7f5b11ffb640 1 --2- 172.21.15.183:0/1475871249 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5b000a2b70 0x7f5b000a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:00:47.883 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.881+0000 7f5b11ffb640 1 -- 172.21.15.183:0/1475871249 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2309+0+0 (secure 0 0 0) 0x7f5b0c0cdac0 con 0x7f5b14102440 2024-08-18T22:00:47.883 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.881+0000 7f5b13fff640 1 --2- 172.21.15.183:0/1475871249 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5b000a2b70 0x7f5b000a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:00:47.884 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.881+0000 7f5b13fff640 1 --2- 172.21.15.183:0/1475871249 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5b000a2b70 0x7f5b000a5030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5b1406a030 tx=0x7f5b04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:00:47.885 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:47.884+0000 7f5b11ffb640 1 -- 172.21.15.183:0/1475871249 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5b0c014030 con 0x7f5b14102440 2024-08-18T22:00:47.948 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:47 smithi130 ceph-mon[21698]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-18T22:00:47.948 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:47 smithi130 ceph-mon[21698]: osdmap e12: 2 total, 1 up, 2 in 2024-08-18T22:00:47.948 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:47 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:00:47.948 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:47 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:00:47.948 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:47 smithi130 ceph-mon[21698]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:48.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:47 smithi123 ceph-mon[18462]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-18T22:00:48.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:47 smithi123 ceph-mon[18462]: osdmap e12: 2 total, 1 up, 2 in 2024-08-18T22:00:48.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:00:48.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:00:48.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:47 smithi123 ceph-mon[18462]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:00:48.066 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:00:48.065+0000 7f5b1a2e1640 1 -- 172.21.15.183:0/1475871249 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5b14062360 con 0x7f5b000a2b70 2024-08-18T22:00:48.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: purged_snaps scrub starts 2024-08-18T22:00:48.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: purged_snaps scrub ok 2024-08-18T22:00:48.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: osd.1 [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210] boot 2024-08-18T22:00:48.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: osdmap e13: 2 total, 2 up, 2 in 2024-08-18T22:00:48.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:00:48.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: Detected new or changed devices on smithi130 2024-08-18T22:00:48.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:48.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:48.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:00:48.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: Adjusting osd_memory_target on smithi130 to 17088M 2024-08-18T22:00:48.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:48.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:48.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:48.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:48.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:00:48.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:00:48.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:00:48.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:48.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:48.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:48.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:48.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:49.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: purged_snaps scrub starts 2024-08-18T22:00:49.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: purged_snaps scrub ok 2024-08-18T22:00:49.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: osd.1 [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210] boot 2024-08-18T22:00:49.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: osdmap e13: 2 total, 2 up, 2 in 2024-08-18T22:00:49.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:00:49.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: Detected new or changed devices on smithi130 2024-08-18T22:00:49.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:49.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:49.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:00:49.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: Adjusting osd_memory_target on smithi130 to 17088M 2024-08-18T22:00:49.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:49.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:49.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:49.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:49.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:00:49.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:00:49.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:00:49.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:49.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:49.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:49.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:49.012 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:49.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: purged_snaps scrub starts 2024-08-18T22:00:49.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: purged_snaps scrub ok 2024-08-18T22:00:49.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: osd.1 [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210] boot 2024-08-18T22:00:49.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: osdmap e13: 2 total, 2 up, 2 in 2024-08-18T22:00:49.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:00:49.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: Detected new or changed devices on smithi130 2024-08-18T22:00:49.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:49.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:49.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:00:49.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: Adjusting osd_memory_target on smithi130 to 17088M 2024-08-18T22:00:49.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:49.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:49.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:49.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:49.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:00:49.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:00:49.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:00:49.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:49.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:00:49.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:49.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:00:49.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:00:50.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:49 smithi123 ceph-mon[18462]: osdmap e14: 2 total, 2 up, 2 in 2024-08-18T22:00:50.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:49 smithi123 ceph-mon[18462]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:00:50.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:49 smithi130 ceph-mon[21698]: osdmap e14: 2 total, 2 up, 2 in 2024-08-18T22:00:50.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:49 smithi130 ceph-mon[21698]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:00:50.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:49 smithi183 ceph-mon[22097]: osdmap e14: 2 total, 2 up, 2 in 2024-08-18T22:00:50.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:49 smithi183 ceph-mon[22097]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:00:51.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:50 smithi183 ceph-mon[22097]: from='client.? 172.21.15.183:0/2808781236' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d53b95f-7d21-4c8b-bdfb-de99b494ca99"}]: dispatch 2024-08-18T22:00:51.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:50 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d53b95f-7d21-4c8b-bdfb-de99b494ca99"}]: dispatch 2024-08-18T22:00:51.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:50 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d53b95f-7d21-4c8b-bdfb-de99b494ca99"}]': finished 2024-08-18T22:00:51.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:50 smithi183 ceph-mon[22097]: osdmap e15: 3 total, 2 up, 3 in 2024-08-18T22:00:51.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:51 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:00:51.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:51 smithi183 ceph-mon[22097]: from='client.? 172.21.15.183:0/2331780186' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:00:51.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:50 smithi123 ceph-mon[18462]: from='client.? 172.21.15.183:0/2808781236' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d53b95f-7d21-4c8b-bdfb-de99b494ca99"}]: dispatch 2024-08-18T22:00:51.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:50 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d53b95f-7d21-4c8b-bdfb-de99b494ca99"}]: dispatch 2024-08-18T22:00:51.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:50 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d53b95f-7d21-4c8b-bdfb-de99b494ca99"}]': finished 2024-08-18T22:00:51.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:50 smithi123 ceph-mon[18462]: osdmap e15: 3 total, 2 up, 3 in 2024-08-18T22:00:51.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:50 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:00:51.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:50 smithi123 ceph-mon[18462]: from='client.? 172.21.15.183:0/2331780186' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:00:51.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:51 smithi130 ceph-mon[21698]: from='client.? 172.21.15.183:0/2808781236' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d53b95f-7d21-4c8b-bdfb-de99b494ca99"}]: dispatch 2024-08-18T22:00:51.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:51 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d53b95f-7d21-4c8b-bdfb-de99b494ca99"}]: dispatch 2024-08-18T22:00:51.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:51 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d53b95f-7d21-4c8b-bdfb-de99b494ca99"}]': finished 2024-08-18T22:00:51.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:51 smithi130 ceph-mon[21698]: osdmap e15: 3 total, 2 up, 3 in 2024-08-18T22:00:51.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:51 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:00:51.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:51 smithi130 ceph-mon[21698]: from='client.? 172.21.15.183:0/2331780186' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:00:52.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:52 smithi123 ceph-mon[18462]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:00:52.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:52 smithi130 ceph-mon[21698]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:00:52.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:52 smithi183 ceph-mon[22097]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:00:54.521 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:54 smithi183 ceph-mon[22097]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:00:54.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:54 smithi123 ceph-mon[18462]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:00:54.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:54 smithi130 ceph-mon[21698]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:00:56.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:56 smithi183 ceph-mon[22097]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:00:56.587 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:56 smithi123 ceph-mon[18462]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:00:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:56 smithi130 ceph-mon[21698]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:00:57.591 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:57 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-18T22:00:57.591 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:57 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:57.740 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:57 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-18T22:00:57.740 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:57 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:57.759 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:57 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-18T22:00:57.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:57 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:00:58.573 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:58 smithi183 ceph-mon[22097]: Deploying daemon osd.2 on smithi183 2024-08-18T22:00:58.573 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:00:58 smithi183 ceph-mon[22097]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:00:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:58 smithi123 ceph-mon[18462]: Deploying daemon osd.2 on smithi183 2024-08-18T22:00:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:00:58 smithi123 ceph-mon[18462]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:00:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:58 smithi130 ceph-mon[21698]: Deploying daemon osd.2 on smithi183 2024-08-18T22:00:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:00:58 smithi130 ceph-mon[21698]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:00.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:00 smithi183 ceph-mon[22097]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:00.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:00 smithi123 ceph-mon[18462]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:00.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:00 smithi130 ceph-mon[21698]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:02.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:02 smithi183 ceph-mon[22097]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:02.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:02 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:02.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:02 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:02.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:02 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:02.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:02 smithi123 ceph-mon[18462]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:02.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:02 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:02.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:02 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:02.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:02 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:02.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:02 smithi130 ceph-mon[21698]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:02.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:02 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:02.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:02 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:02.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:02 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:04.401 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:04 smithi183 ceph-mon[22097]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:04.401 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:04 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:04.401 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:04 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:04.402 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:04 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:04.402 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:04 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:04.402 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:04 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:04.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:04 smithi123 ceph-mon[18462]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:04.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:04 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:04.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:04 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:04.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:04 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:04.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:04 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:04.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:04 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:04.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:04 smithi130 ceph-mon[21698]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:04.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:04 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:04.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:04 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:04.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:04 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:04.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:04 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:04.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:04 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:05.011 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:05.010+0000 7f5b11ffb640 1 -- 172.21.15.183:0/1475871249 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5b14062360 con 0x7f5b000a2b70 2024-08-18T22:01:05.012 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 2 on host 'smithi183' 2024-08-18T22:01:05.013 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:05.013+0000 7f5b1a2e1640 1 -- 172.21.15.183:0/1475871249 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5b000a2b70 msgr2=0x7f5b000a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:01:05.013 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:05.013+0000 7f5b1a2e1640 1 --2- 172.21.15.183:0/1475871249 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5b000a2b70 0x7f5b000a5030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5b1406a030 tx=0x7f5b04005f90 comp rx=0 tx=0).stop 2024-08-18T22:01:05.013 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:05.013+0000 7f5b1a2e1640 1 -- 172.21.15.183:0/1475871249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b14102440 msgr2=0x7f5b141035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:01:05.014 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:05.013+0000 7f5b1a2e1640 1 --2- 172.21.15.183:0/1475871249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b14102440 0x7f5b141035b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00cad0 tx=0x7f5b0c00cf90 comp rx=0 tx=0).stop 2024-08-18T22:01:05.014 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:05.013+0000 7f5b1a2e1640 1 -- 172.21.15.183:0/1475871249 shutdown_connections 2024-08-18T22:01:05.014 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:05.013+0000 7f5b1a2e1640 1 --2- 172.21.15.183:0/1475871249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b14102440 0x7f5b141035b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:05.014 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:05.013+0000 7f5b1a2e1640 1 --2- 172.21.15.183:0/1475871249 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5b000a2b70 0x7f5b000a5030 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:05.014 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:05.013+0000 7f5b1a2e1640 1 --2- 172.21.15.183:0/1475871249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b14101a80 0x7f5b14103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:05.014 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:05.013+0000 7f5b1a2e1640 1 --2- 172.21.15.183:0/1475871249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b14100d60 0x7f5b14104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:05.014 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:05.013+0000 7f5b1a2e1640 1 -- 172.21.15.183:0/1475871249 >> 172.21.15.183:0/1475871249 conn(0x7f5b140fb770 msgr2=0x7f5b140fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:01:05.014 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:05.013+0000 7f5b1a2e1640 1 -- 172.21.15.183:0/1475871249 shutdown_connections 2024-08-18T22:01:05.014 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:05.013+0000 7f5b1a2e1640 1 -- 172.21.15.183:0/1475871249 wait complete. 2024-08-18T22:01:05.572 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:05 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:05.572 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:05 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:05.572 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:05 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:05.598 DEBUG:teuthology.orchestra.run.smithi183:osd.2> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.2.service 2024-08-18T22:01:05.601 INFO:tasks.cephadm:Deploying osd.3 on smithi123 with /dev/vg_nvme/lv_3... 2024-08-18T22:01:05.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-18T22:01:05.629 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:05 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:05.629 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:05 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:05.629 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:05 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:05.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:05 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:05.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:05 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:05.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:05 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:05.853 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:01:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-2[27023]: 2024-08-18T22:01:05.629+0000 7f0e85d60640 -1 osd.2 0 log_to_monitors true 2024-08-18T22:01:05.860 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:01:06.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:06 smithi183 ceph-mon[22097]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:06.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:06 smithi183 ceph-mon[22097]: from='osd.2 [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-18T22:01:06.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:06 smithi183 ceph-mon[22097]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-18T22:01:06.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:06 smithi123 ceph-mon[18462]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:06.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:06 smithi123 ceph-mon[18462]: from='osd.2 [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-18T22:01:06.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:06 smithi123 ceph-mon[18462]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-18T22:01:06.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:06 smithi130 ceph-mon[21698]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:06.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:06 smithi130 ceph-mon[21698]: from='osd.2 [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-18T22:01:06.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:06 smithi130 ceph-mon[21698]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-18T22:01:07.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:07 smithi123 ceph-mon[18462]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-18T22:01:07.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:07 smithi123 ceph-mon[18462]: osdmap e16: 3 total, 2 up, 3 in 2024-08-18T22:01:07.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:07 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:01:07.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:07 smithi123 ceph-mon[18462]: from='osd.2 [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:01:07.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:07 smithi123 ceph-mon[18462]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:01:07.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:07 smithi183 ceph-mon[22097]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-18T22:01:07.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:07 smithi183 ceph-mon[22097]: osdmap e16: 3 total, 2 up, 3 in 2024-08-18T22:01:07.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:07 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:01:07.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:07 smithi183 ceph-mon[22097]: from='osd.2 [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:01:07.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:07 smithi183 ceph-mon[22097]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:01:07.659 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:01:07 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-2[27023]: 2024-08-18T22:01:07.353+0000 7f0e81ce3640 -1 osd.2 0 waiting for initial osdmap 2024-08-18T22:01:07.660 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:01:07 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-2[27023]: 2024-08-18T22:01:07.356+0000 7f0e7db0b640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:01:07.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:07 smithi130 ceph-mon[21698]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-18T22:01:07.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:07 smithi130 ceph-mon[21698]: osdmap e16: 3 total, 2 up, 3 in 2024-08-18T22:01:07.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:07 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:01:07.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:07 smithi130 ceph-mon[21698]: from='osd.2 [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:01:07.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:07 smithi130 ceph-mon[21698]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:01:08.496 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:08 smithi183 ceph-mon[22097]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:08.496 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:08 smithi183 ceph-mon[22097]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-08-18T22:01:08.496 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:08 smithi183 ceph-mon[22097]: osdmap e17: 3 total, 2 up, 3 in 2024-08-18T22:01:08.496 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:08 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:01:08.496 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:08 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:01:08.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:08 smithi123 ceph-mon[18462]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:08.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:08 smithi123 ceph-mon[18462]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-08-18T22:01:08.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:08 smithi123 ceph-mon[18462]: osdmap e17: 3 total, 2 up, 3 in 2024-08-18T22:01:08.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:08 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:01:08.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:08 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:01:08.560 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:01:08.593 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi123:vg_nvme/lv_3 2024-08-18T22:01:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:08 smithi130 ceph-mon[21698]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-18T22:01:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:08 smithi130 ceph-mon[21698]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-08-18T22:01:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:08 smithi130 ceph-mon[21698]: osdmap e17: 3 total, 2 up, 3 in 2024-08-18T22:01:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:08 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:01:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:08 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:01:08.888 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:01:09.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.551+0000 7faa63ff3640 1 -- 172.21.15.123:0/3721636596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa5c104cc0 msgr2=0x7faa5c1070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:01:09.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.551+0000 7faa63ff3640 1 --2- 172.21.15.123:0/3721636596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa5c104cc0 0x7faa5c1070b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009900 tx=0x7faa4c02a410 comp rx=0 tx=0).stop 2024-08-18T22:01:09.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.551+0000 7faa63ff3640 1 -- 172.21.15.123:0/3721636596 shutdown_connections 2024-08-18T22:01:09.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.551+0000 7faa63ff3640 1 --2- 172.21.15.123:0/3721636596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa5c1075f0 0x7faa5c109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:09.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.551+0000 7faa63ff3640 1 --2- 172.21.15.123:0/3721636596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa5c104cc0 0x7faa5c1070b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:09.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.551+0000 7faa63ff3640 1 --2- 172.21.15.123:0/3721636596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa5c102390 0x7faa5c104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:09.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.551+0000 7faa63ff3640 1 -- 172.21.15.123:0/3721636596 >> 172.21.15.123:0/3721636596 conn(0x7faa5c0fbfb0 msgr2=0x7faa5c0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:01:09.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.552+0000 7faa63ff3640 1 -- 172.21.15.123:0/3721636596 shutdown_connections 2024-08-18T22:01:09.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.552+0000 7faa63ff3640 1 -- 172.21.15.123:0/3721636596 wait complete. 2024-08-18T22:01:09.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.552+0000 7faa63ff3640 1 Processor -- start 2024-08-18T22:01:09.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.552+0000 7faa63ff3640 1 -- start start 2024-08-18T22:01:09.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.552+0000 7faa63ff3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa5c102390 0x7faa5c101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:01:09.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.552+0000 7faa63ff3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa5c104cc0 0x7faa5c100340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:01:09.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa63ff3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa5c1075f0 0x7faa5c100880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:01:09.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa63ff3640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c10d590 con 0x7faa5c102390 2024-08-18T22:01:09.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa63ff3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c10d410 con 0x7faa5c104cc0 2024-08-18T22:01:09.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa63ff3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c10d710 con 0x7faa5c1075f0 2024-08-18T22:01:09.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa61d8f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa5c102390 0x7faa5c101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:01:09.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa61d8f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa5c102390 0x7faa5c101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58510/0 (socket says 172.21.15.123:58510) 2024-08-18T22:01:09.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa61d8f640 1 -- 172.21.15.123:0/2032788151 learned_addr learned my addr 172.21.15.123:0/2032788151 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:01:09.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa6158e640 1 --2- 172.21.15.123:0/2032788151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa5c104cc0 0x7faa5c100340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:01:09.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa62590640 1 --2- 172.21.15.123:0/2032788151 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa5c1075f0 0x7faa5c100880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:01:09.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa61d8f640 1 -- 172.21.15.123:0/2032788151 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa5c1075f0 msgr2=0x7faa5c100880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:01:09.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa61d8f640 1 --2- 172.21.15.123:0/2032788151 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa5c1075f0 0x7faa5c100880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:09.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa61d8f640 1 -- 172.21.15.123:0/2032788151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa5c104cc0 msgr2=0x7faa5c100340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:01:09.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa61d8f640 1 --2- 172.21.15.123:0/2032788151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa5c104cc0 0x7faa5c100340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:09.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa61d8f640 1 -- 172.21.15.123:0/2032788151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5c101140 con 0x7faa5c102390 2024-08-18T22:01:09.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa6158e640 1 --2- 172.21.15.123:0/2032788151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa5c104cc0 0x7faa5c100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:01:09.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.553+0000 7faa61d8f640 1 --2- 172.21.15.123:0/2032788151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa5c102390 0x7faa5c101cf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faa5800e9f0 tx=0x7faa5800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:01:09.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.555+0000 7faa52ffd640 1 -- 172.21.15.123:0/2032788151 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5800cd80 con 0x7faa5c102390 2024-08-18T22:01:09.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.555+0000 7faa52ffd640 1 -- 172.21.15.123:0/2032788151 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa58005500 con 0x7faa5c102390 2024-08-18T22:01:09.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.555+0000 7faa63ff3640 1 -- 172.21.15.123:0/2032788151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa5c1a1de0 con 0x7faa5c102390 2024-08-18T22:01:09.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.555+0000 7faa52ffd640 1 -- 172.21.15.123:0/2032788151 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa58010690 con 0x7faa5c102390 2024-08-18T22:01:09.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.555+0000 7faa63ff3640 1 -- 172.21.15.123:0/2032788151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa5c1a21d0 con 0x7faa5c102390 2024-08-18T22:01:09.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.557+0000 7faa63ff3640 1 -- 172.21.15.123:0/2032788151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa5c0fdaa0 con 0x7faa5c102390 2024-08-18T22:01:09.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.558+0000 7faa52ffd640 1 -- 172.21.15.123:0/2032788151 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7faa580046c0 con 0x7faa5c102390 2024-08-18T22:01:09.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.558+0000 7faa52ffd640 1 --2- 172.21.15.123:0/2032788151 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faa480a2b70 0x7faa480a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:01:09.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.559+0000 7faa6158e640 1 --2- 172.21.15.123:0/2032788151 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faa480a2b70 0x7faa480a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:01:09.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.559+0000 7faa52ffd640 1 -- 172.21.15.123:0/2032788151 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3226+0+0 (secure 0 0 0) 0x7faa58099c90 con 0x7faa5c102390 2024-08-18T22:01:09.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.559+0000 7faa6158e640 1 --2- 172.21.15.123:0/2032788151 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faa480a2b70 0x7faa480a5030 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faa4c005ab0 tx=0x7faa4c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:01:09.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.564+0000 7faa52ffd640 1 -- 172.21.15.123:0/2032788151 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7faa5809c2f0 con 0x7faa5c102390 2024-08-18T22:01:09.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:09.746+0000 7faa63ff3640 1 -- 172.21.15.123:0/2032788151 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7faa5c062360 con 0x7faa480a2b70 2024-08-18T22:01:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:09 smithi183 ceph-mon[22097]: purged_snaps scrub starts 2024-08-18T22:01:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:09 smithi183 ceph-mon[22097]: purged_snaps scrub ok 2024-08-18T22:01:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:09 smithi183 ceph-mon[22097]: osd.2 [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173] boot 2024-08-18T22:01:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:09 smithi183 ceph-mon[22097]: osdmap e18: 3 total, 3 up, 3 in 2024-08-18T22:01:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:01:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:01:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:09.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:09.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:10.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:09 smithi123 ceph-mon[18462]: purged_snaps scrub starts 2024-08-18T22:01:10.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:09 smithi123 ceph-mon[18462]: purged_snaps scrub ok 2024-08-18T22:01:10.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:09 smithi123 ceph-mon[18462]: osd.2 [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173] boot 2024-08-18T22:01:10.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:09 smithi123 ceph-mon[18462]: osdmap e18: 3 total, 3 up, 3 in 2024-08-18T22:01:10.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:01:10.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:10.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:10.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:01:10.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:10.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:10.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:10.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:10.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:09 smithi130 ceph-mon[21698]: purged_snaps scrub starts 2024-08-18T22:01:10.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:09 smithi130 ceph-mon[21698]: purged_snaps scrub ok 2024-08-18T22:01:10.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:09 smithi130 ceph-mon[21698]: osd.2 [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173] boot 2024-08-18T22:01:10.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:09 smithi130 ceph-mon[21698]: osdmap e18: 3 total, 3 up, 3 in 2024-08-18T22:01:10.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:01:10.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:10.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:10.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:01:10.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:10.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:10.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:10.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:10 smithi123 ceph-mon[18462]: Detected new or changed devices on smithi183 2024-08-18T22:01:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:10 smithi123 ceph-mon[18462]: Adjusting osd_memory_target on smithi183 to 17088M 2024-08-18T22:01:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:10 smithi123 ceph-mon[18462]: pgmap v68: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-18T22:01:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-18T22:01:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:10 smithi123 ceph-mon[18462]: osdmap e19: 3 total, 3 up, 3 in 2024-08-18T22:01:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-18T22:01:10.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:10 smithi123 ceph-mon[18462]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:01:10.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:01:10.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:01:10.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:10 smithi183 ceph-mon[22097]: Detected new or changed devices on smithi183 2024-08-18T22:01:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:10 smithi183 ceph-mon[22097]: Adjusting osd_memory_target on smithi183 to 17088M 2024-08-18T22:01:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:10 smithi183 ceph-mon[22097]: pgmap v68: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-18T22:01:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-18T22:01:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:10 smithi183 ceph-mon[22097]: osdmap e19: 3 total, 3 up, 3 in 2024-08-18T22:01:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-18T22:01:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:10 smithi183 ceph-mon[22097]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:01:10.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:01:10.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:01:10.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:11.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:10 smithi130 ceph-mon[21698]: Detected new or changed devices on smithi183 2024-08-18T22:01:11.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:10 smithi130 ceph-mon[21698]: Adjusting osd_memory_target on smithi183 to 17088M 2024-08-18T22:01:11.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:10 smithi130 ceph-mon[21698]: pgmap v68: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:11.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-18T22:01:11.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-18T22:01:11.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:10 smithi130 ceph-mon[21698]: osdmap e19: 3 total, 3 up, 3 in 2024-08-18T22:01:11.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-18T22:01:11.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:10 smithi130 ceph-mon[21698]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:01:11.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:01:11.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:01:11.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:11.158 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:01:10 smithi123 sudo[34882]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-18T22:01:11.158 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:01:10 smithi123 sudo[34882]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:01:11.158 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:01:10 smithi123 sudo[34882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:01:11.158 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:01:10 smithi123 sudo[34882]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:01:11.410 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:01:11 smithi123 sudo[34899]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-18T22:01:11.410 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:01:11 smithi123 sudo[34899]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:01:11.410 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:01:11 smithi123 sudo[34899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:01:11.410 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:01:11 smithi123 sudo[34899]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:01:11.685 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:11 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-18T22:01:11.685 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:11 smithi130 ceph-mon[21698]: osdmap e20: 3 total, 3 up, 3 in 2024-08-18T22:01:11.685 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:11 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:11.685 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:11 smithi130 ceph-mon[21698]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:11.685 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:01:11 smithi130 sudo[30223]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-18T22:01:11.686 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:01:11 smithi130 sudo[30223]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:01:11.686 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:01:11 smithi130 sudo[30223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:01:11.686 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:01:11 smithi130 sudo[30223]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:01:11.686 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:01:11 smithi130 sudo[30226]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-18T22:01:11.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:11 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-18T22:01:11.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:11 smithi123 ceph-mon[18462]: osdmap e20: 3 total, 3 up, 3 in 2024-08-18T22:01:11.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:11 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:11.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:11 smithi123 ceph-mon[18462]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:11 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-18T22:01:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:11 smithi183 ceph-mon[22097]: osdmap e20: 3 total, 3 up, 3 in 2024-08-18T22:01:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:11 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:11 smithi183 ceph-mon[22097]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:12.014 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:01:11 smithi130 sudo[30226]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:01:12.014 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:01:11 smithi130 sudo[30226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:01:12.014 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:01:11 smithi130 sudo[30226]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:01:12.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:12.193+0000 7faa52ffd640 1 -- 172.21.15.123:0/2032788151 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7faa58098260 con 0x7faa5c102390 2024-08-18T22:01:12.214 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:01:11 smithi183 sudo[31057]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-18T22:01:12.214 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:01:11 smithi183 sudo[31057]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:01:12.214 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:01:11 smithi183 sudo[31057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:01:12.214 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:01:11 smithi183 sudo[31057]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:01:12.659 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:01:12 smithi183 sudo[31060]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-18T22:01:12.659 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:01:12 smithi183 sudo[31060]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:01:12.659 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:01:12 smithi183 sudo[31060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:01:12.660 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:01:12 smithi183 sudo[31060]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:01:12.746 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 sudo[34988]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-18T22:01:12.746 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 sudo[34988]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:01:12.746 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 sudo[34988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:01:12.746 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 sudo[34988]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:01:13.002 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 sudo[34991]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-18T22:01:13.002 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 sudo[34991]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:01:13.003 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 sudo[34991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:01:13.003 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 sudo[34991]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:01:13.003 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 ceph-mon[18462]: osdmap e21: 3 total, 3 up, 3 in 2024-08-18T22:01:13.003 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:13.003 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3186180292' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80751174-10e5-4717-9f1b-2216aae9402c"}]: dispatch 2024-08-18T22:01:13.003 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3186180292' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80751174-10e5-4717-9f1b-2216aae9402c"}]': finished 2024-08-18T22:01:13.003 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 ceph-mon[18462]: osdmap e22: 4 total, 3 up, 4 in 2024-08-18T22:01:13.003 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:01:13.003 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 ceph-mon[18462]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-18T22:01:13.003 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:13.003 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:12 smithi123 ceph-mon[18462]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-18T22:01:13.008 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:12 smithi183 ceph-mon[22097]: osdmap e21: 3 total, 3 up, 3 in 2024-08-18T22:01:13.008 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:12 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:13.008 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:12 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3186180292' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80751174-10e5-4717-9f1b-2216aae9402c"}]: dispatch 2024-08-18T22:01:13.008 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:12 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3186180292' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80751174-10e5-4717-9f1b-2216aae9402c"}]': finished 2024-08-18T22:01:13.008 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:12 smithi183 ceph-mon[22097]: osdmap e22: 4 total, 3 up, 4 in 2024-08-18T22:01:13.008 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:12 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:01:13.008 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:12 smithi183 ceph-mon[22097]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-18T22:01:13.008 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:12 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:13.008 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:12 smithi183 ceph-mon[22097]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-18T22:01:13.008 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:12 smithi183 sudo[31063]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-18T22:01:13.008 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:12 smithi183 sudo[31063]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:01:13.008 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:12 smithi183 sudo[31063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:01:13.008 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 sudo[31063]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:01:13.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:12 smithi130 ceph-mon[21698]: osdmap e21: 3 total, 3 up, 3 in 2024-08-18T22:01:13.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:12 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:13.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:12 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3186180292' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80751174-10e5-4717-9f1b-2216aae9402c"}]: dispatch 2024-08-18T22:01:13.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:12 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3186180292' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80751174-10e5-4717-9f1b-2216aae9402c"}]': finished 2024-08-18T22:01:13.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:12 smithi130 ceph-mon[21698]: osdmap e22: 4 total, 3 up, 4 in 2024-08-18T22:01:13.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:12 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:01:13.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:12 smithi130 ceph-mon[21698]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-18T22:01:13.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:12 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:13.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:12 smithi130 ceph-mon[21698]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-18T22:01:13.408 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 sudo[31066]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-18T22:01:13.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 sudo[31066]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:01:13.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 sudo[31066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:01:13.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 sudo[31066]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:01:13.752 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 sudo[30229]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-18T22:01:13.753 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 sudo[30229]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:01:13.753 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 sudo[30229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:01:13.753 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 sudo[30229]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:01:14.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 sudo[30232]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-18T22:01:14.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 sudo[30232]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:01:14.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 sudo[30232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:01:14.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 sudo[30232]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:01:14.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 ceph-mon[21698]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-18T22:01:14.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T22:01:14.016 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T22:01:14.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T22:01:14.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 ceph-mon[21698]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-18T22:01:14.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T22:01:14.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T22:01:14.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T22:01:14.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/462640634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:01:14.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 ceph-mon[21698]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-18T22:01:14.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T22:01:14.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T22:01:14.017 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T22:01:14.018 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:13 smithi130 ceph-mon[21698]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:14.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 ceph-mon[22097]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-18T22:01:14.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T22:01:14.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T22:01:14.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T22:01:14.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 ceph-mon[22097]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-18T22:01:14.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T22:01:14.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T22:01:14.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T22:01:14.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/462640634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:01:14.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 ceph-mon[22097]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-18T22:01:14.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T22:01:14.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T22:01:14.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T22:01:14.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:13 smithi183 ceph-mon[22097]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:14.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:13 smithi123 ceph-mon[18462]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-18T22:01:14.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:13 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T22:01:14.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:13 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T22:01:14.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:13 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T22:01:14.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:13 smithi123 ceph-mon[18462]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-18T22:01:14.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:13 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T22:01:14.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:13 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T22:01:14.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:13 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T22:01:14.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:13 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/462640634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:01:14.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:13 smithi123 ceph-mon[18462]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-18T22:01:14.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:13 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-18T22:01:14.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:13 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-18T22:01:14.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:13 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-18T22:01:14.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:13 smithi123 ceph-mon[18462]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:15.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:14 smithi183 ceph-mon[22097]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-18T22:01:15.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:14 smithi183 ceph-mon[22097]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-18T22:01:15.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:14 smithi123 ceph-mon[18462]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-18T22:01:15.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:14 smithi123 ceph-mon[18462]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-18T22:01:15.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:14 smithi130 ceph-mon[21698]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-18T22:01:15.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:14 smithi130 ceph-mon[21698]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-18T22:01:16.041 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:15 smithi123 ceph-mon[18462]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:16.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:15 smithi183 ceph-mon[22097]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:16.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:15 smithi130 ceph-mon[21698]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:18.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:18 smithi123 ceph-mon[18462]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:18.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:18 smithi183 ceph-mon[22097]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:18.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:18 smithi130 ceph-mon[21698]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:19.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:19 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-18T22:01:19.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:19 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:19.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:19 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-18T22:01:19.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:19 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:19.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:19 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-18T22:01:19.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:19 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:20.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:20 smithi183 ceph-mon[22097]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-08-18T22:01:20.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:20 smithi183 ceph-mon[22097]: Deploying daemon osd.3 on smithi123 2024-08-18T22:01:20.726 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:20 smithi123 ceph-mon[18462]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-08-18T22:01:20.726 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:20 smithi123 ceph-mon[18462]: Deploying daemon osd.3 on smithi123 2024-08-18T22:01:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:20 smithi130 ceph-mon[21698]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-08-18T22:01:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:20 smithi130 ceph-mon[21698]: Deploying daemon osd.3 on smithi123 2024-08-18T22:01:22.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:22 smithi123 ceph-mon[18462]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-08-18T22:01:22.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:22 smithi130 ceph-mon[21698]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-08-18T22:01:22.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:22 smithi183 ceph-mon[22097]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-08-18T22:01:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:24 smithi183 ceph-mon[22097]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-08-18T22:01:24.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:24 smithi123 ceph-mon[18462]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-08-18T22:01:24.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:24 smithi130 ceph-mon[21698]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-08-18T22:01:25.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:25 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:25.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:25 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:25.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:25 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:25.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:25 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:25.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:25 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:25.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:25 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:25.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:25 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:25.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:25 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:25.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:25 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:26.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:26 smithi183 ceph-mon[22097]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-08-18T22:01:26.680 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:26 smithi123 ceph-mon[18462]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-08-18T22:01:26.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:26 smithi130 ceph-mon[21698]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-08-18T22:01:27.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:27.917+0000 7faa52ffd640 1 -- 172.21.15.123:0/2032788151 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faa5c062360 con 0x7faa480a2b70 2024-08-18T22:01:27.918 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 3 on host 'smithi123' 2024-08-18T22:01:27.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:27.920+0000 7faa63ff3640 1 -- 172.21.15.123:0/2032788151 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faa480a2b70 msgr2=0x7faa480a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:01:27.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:27.920+0000 7faa63ff3640 1 --2- 172.21.15.123:0/2032788151 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faa480a2b70 0x7faa480a5030 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faa4c005ab0 tx=0x7faa4c000bc0 comp rx=0 tx=0).stop 2024-08-18T22:01:27.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:27.920+0000 7faa63ff3640 1 -- 172.21.15.123:0/2032788151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa5c102390 msgr2=0x7faa5c101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:01:27.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:27.920+0000 7faa63ff3640 1 --2- 172.21.15.123:0/2032788151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa5c102390 0x7faa5c101cf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faa5800e9f0 tx=0x7faa5800edf0 comp rx=0 tx=0).stop 2024-08-18T22:01:27.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:27.920+0000 7faa63ff3640 1 -- 172.21.15.123:0/2032788151 shutdown_connections 2024-08-18T22:01:27.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:27.920+0000 7faa63ff3640 1 --2- 172.21.15.123:0/2032788151 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa5c1075f0 0x7faa5c100880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:27.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:27.920+0000 7faa63ff3640 1 --2- 172.21.15.123:0/2032788151 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faa480a2b70 0x7faa480a5030 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:27.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:27.920+0000 7faa63ff3640 1 --2- 172.21.15.123:0/2032788151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa5c104cc0 0x7faa5c100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:27.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:27.920+0000 7faa63ff3640 1 --2- 172.21.15.123:0/2032788151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa5c102390 0x7faa5c101cf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:27.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:27.920+0000 7faa63ff3640 1 -- 172.21.15.123:0/2032788151 >> 172.21.15.123:0/2032788151 conn(0x7faa5c0fbfb0 msgr2=0x7faa5c102d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:01:27.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:27.920+0000 7faa63ff3640 1 -- 172.21.15.123:0/2032788151 shutdown_connections 2024-08-18T22:01:27.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:01:27.921+0000 7faa63ff3640 1 -- 172.21.15.123:0/2032788151 wait complete. 2024-08-18T22:01:28.222 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:28.222 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:28.222 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:28 smithi123 ceph-mon[18462]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-08-18T22:01:28.223 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:28.223 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:28.223 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:28.223 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:28.223 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:28.223 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:28.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:28.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:28.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:28 smithi183 ceph-mon[22097]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-08-18T22:01:28.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:28.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:28.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:28.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:28.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:28.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:28.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:28.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:28.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:28 smithi130 ceph-mon[21698]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-08-18T22:01:28.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:28.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:28.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:28.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:28.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:28.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:28.575 DEBUG:teuthology.orchestra.run.smithi123:osd.3> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.3.service 2024-08-18T22:01:28.578 INFO:tasks.cephadm:Deploying osd.4 on smithi130 with /dev/vg_nvme/lv_3... 2024-08-18T22:01:28.578 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-18T22:01:28.838 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.b/config 2024-08-18T22:01:29.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:29 smithi130 ceph-mon[21698]: from='osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-18T22:01:29.408 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:29 smithi183 ceph-mon[22097]: from='osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-18T22:01:29.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:29 smithi123 ceph-mon[18462]: from='osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-18T22:01:30.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:30 smithi183 ceph-mon[22097]: from='osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-18T22:01:30.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:30 smithi183 ceph-mon[22097]: osdmap e23: 4 total, 3 up, 4 in 2024-08-18T22:01:30.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:30 smithi183 ceph-mon[22097]: from='osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-08-18T22:01:30.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:30 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:01:30.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:30 smithi183 ceph-mon[22097]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:30.253 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:30 smithi130 ceph-mon[21698]: from='osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-18T22:01:30.253 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:30 smithi130 ceph-mon[21698]: osdmap e23: 4 total, 3 up, 4 in 2024-08-18T22:01:30.253 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:30 smithi130 ceph-mon[21698]: from='osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-08-18T22:01:30.253 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:30 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:01:30.253 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:30 smithi130 ceph-mon[21698]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:30.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:30 smithi123 ceph-mon[18462]: from='osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-18T22:01:30.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:30 smithi123 ceph-mon[18462]: osdmap e23: 4 total, 3 up, 4 in 2024-08-18T22:01:30.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:30 smithi123 ceph-mon[18462]: from='osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-08-18T22:01:30.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:30 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:01:30.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:30 smithi123 ceph-mon[18462]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-08-18T22:01:31.146 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:01:30 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3[36964]: 2024-08-18T22:01:30.799+0000 7ffa97533640 -1 osd.3 0 waiting for initial osdmap 2024-08-18T22:01:31.146 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:01:30 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3[36964]: 2024-08-18T22:01:30.805+0000 7ffa8f353640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:01:31.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:31 smithi130 ceph-mon[21698]: from='osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-08-18T22:01:31.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:31 smithi130 ceph-mon[21698]: osdmap e24: 4 total, 3 up, 4 in 2024-08-18T22:01:31.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:01:31.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:01:31.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:31 smithi130 ceph-mon[21698]: from='osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577]' entity='osd.3' 2024-08-18T22:01:31.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:31 smithi130 ceph-mon[21698]: osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577] boot 2024-08-18T22:01:31.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:31 smithi130 ceph-mon[21698]: osdmap e25: 4 total, 4 up, 4 in 2024-08-18T22:01:31.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:01:31.299 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T22:01:31.326 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_3 2024-08-18T22:01:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:31 smithi183 ceph-mon[22097]: from='osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-08-18T22:01:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:31 smithi183 ceph-mon[22097]: osdmap e24: 4 total, 3 up, 4 in 2024-08-18T22:01:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:01:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:01:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:31 smithi183 ceph-mon[22097]: from='osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577]' entity='osd.3' 2024-08-18T22:01:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:31 smithi183 ceph-mon[22097]: osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577] boot 2024-08-18T22:01:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:31 smithi183 ceph-mon[22097]: osdmap e25: 4 total, 4 up, 4 in 2024-08-18T22:01:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:01:31.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:31 smithi123 ceph-mon[18462]: from='osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-08-18T22:01:31.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:31 smithi123 ceph-mon[18462]: osdmap e24: 4 total, 3 up, 4 in 2024-08-18T22:01:31.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:01:31.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:01:31.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:31 smithi123 ceph-mon[18462]: from='osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577]' entity='osd.3' 2024-08-18T22:01:31.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:31 smithi123 ceph-mon[18462]: osd.3 [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577] boot 2024-08-18T22:01:31.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:31 smithi123 ceph-mon[18462]: osdmap e25: 4 total, 4 up, 4 in 2024-08-18T22:01:31.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:01:31.582 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.b/config 2024-08-18T22:01:32.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.080+0000 7fbd24306640 1 -- 172.21.15.130:0/2044891305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd1c100800 msgr2=0x7fbd1c100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:01:32.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.080+0000 7fbd24306640 1 --2- 172.21.15.130:0/2044891305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd1c100800 0x7fbd1c100c00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009900 tx=0x7fbd1802a410 comp rx=0 tx=0).stop 2024-08-18T22:01:32.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.080+0000 7fbd24306640 1 -- 172.21.15.130:0/2044891305 shutdown_connections 2024-08-18T22:01:32.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.080+0000 7fbd24306640 1 --2- 172.21.15.130:0/2044891305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd1c1023c0 0x7fbd1c108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:32.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.080+0000 7fbd24306640 1 --2- 172.21.15.130:0/2044891305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd1c101a00 0x7fbd1c101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.080+0000 7fbd24306640 1 --2- 172.21.15.130:0/2044891305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd1c100800 0x7fbd1c100c00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.080+0000 7fbd24306640 1 -- 172.21.15.130:0/2044891305 >> 172.21.15.130:0/2044891305 conn(0x7fbd1c0fbfb0 msgr2=0x7fbd1c0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.080+0000 7fbd24306640 1 -- 172.21.15.130:0/2044891305 shutdown_connections 2024-08-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.080+0000 7fbd24306640 1 -- 172.21.15.130:0/2044891305 wait complete. 2024-08-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.080+0000 7fbd24306640 1 Processor -- start 2024-08-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd24306640 1 -- start start 2024-08-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd24306640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd1c100800 0x7fbd1c104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd24306640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd1c101a00 0x7fbd1c102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd24306640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd1c1023c0 0x7fbd1c103320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd24306640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c10c490 con 0x7fbd1c101a00 2024-08-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd24306640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c10c310 con 0x7fbd1c1023c0 2024-08-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd24306640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c10c610 con 0x7fbd1c100800 2024-08-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd228a3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd1c1023c0 0x7fbd1c103320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd228a3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd1c1023c0 0x7fbd1c103320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50510/0 (socket says 172.21.15.130:50510) 2024-08-18T22:01:32.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd228a3640 1 -- 172.21.15.130:0/3463336298 learned_addr learned my addr 172.21.15.130:0/3463336298 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-08-18T22:01:32.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd220a2640 1 --2- 172.21.15.130:0/3463336298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd1c100800 0x7fbd1c104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:01:32.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd218a1640 1 --2- 172.21.15.130:0/3463336298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd1c101a00 0x7fbd1c102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:01:32.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd228a3640 1 -- 172.21.15.130:0/3463336298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd1c100800 msgr2=0x7fbd1c104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:01:32.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd228a3640 1 --2- 172.21.15.130:0/3463336298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd1c100800 0x7fbd1c104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:32.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd228a3640 1 -- 172.21.15.130:0/3463336298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd1c101a00 msgr2=0x7fbd1c102de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:01:32.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd228a3640 1 --2- 172.21.15.130:0/3463336298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd1c101a00 0x7fbd1c102de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:32.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd228a3640 1 -- 172.21.15.130:0/3463336298 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1c103be0 con 0x7fbd1c1023c0 2024-08-18T22:01:32.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.081+0000 7fbd228a3640 1 --2- 172.21.15.130:0/3463336298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd1c1023c0 0x7fbd1c103320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400eaa0 tx=0x7fbd1400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:01:32.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.082+0000 7fbd0f7fe640 1 -- 172.21.15.130:0/3463336298 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1400cdb0 con 0x7fbd1c1023c0 2024-08-18T22:01:32.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.082+0000 7fbd0f7fe640 1 -- 172.21.15.130:0/3463336298 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd14005020 con 0x7fbd1c1023c0 2024-08-18T22:01:32.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.082+0000 7fbd24306640 1 -- 172.21.15.130:0/3463336298 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd1c1a1de0 con 0x7fbd1c1023c0 2024-08-18T22:01:32.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.082+0000 7fbd0f7fe640 1 -- 172.21.15.130:0/3463336298 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd140116b0 con 0x7fbd1c1023c0 2024-08-18T22:01:32.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.082+0000 7fbd24306640 1 -- 172.21.15.130:0/3463336298 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd1c1a2290 con 0x7fbd1c1023c0 2024-08-18T22:01:32.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.083+0000 7fbd24306640 1 -- 172.21.15.130:0/3463336298 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd1c1a2520 con 0x7fbd1c1023c0 2024-08-18T22:01:32.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.084+0000 7fbd0f7fe640 1 -- 172.21.15.130:0/3463336298 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fbd14005560 con 0x7fbd1c1023c0 2024-08-18T22:01:32.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.084+0000 7fbd0f7fe640 1 --2- 172.21.15.130:0/3463336298 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbd080a2b80 0x7fbd080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:01:32.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.085+0000 7fbd0f7fe640 1 -- 172.21.15.130:0/3463336298 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3702+0+0 (secure 0 0 0) 0x7fbd140ce340 con 0x7fbd1c1023c0 2024-08-18T22:01:32.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.085+0000 7fbd220a2640 1 --2- 172.21.15.130:0/3463336298 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbd080a2b80 0x7fbd080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:01:32.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.085+0000 7fbd220a2640 1 --2- 172.21.15.130:0/3463336298 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbd080a2b80 0x7fbd080a5040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbd18005ab0 tx=0x7fbd18000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:01:32.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.092+0000 7fbd0f7fe640 1 -- 172.21.15.130:0/3463336298 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbd14016030 con 0x7fbd1c1023c0 2024-08-18T22:01:32.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:32.277+0000 7fbd24306640 1 -- 172.21.15.130:0/3463336298 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbd1c1a26f0 con 0x7fbd080a2b80 2024-08-18T22:01:32.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:32 smithi183 ceph-mon[22097]: purged_snaps scrub starts 2024-08-18T22:01:32.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:32 smithi183 ceph-mon[22097]: purged_snaps scrub ok 2024-08-18T22:01:32.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:32 smithi183 ceph-mon[22097]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:32.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:32 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:32.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:32 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:32.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:32 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:01:32.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:32 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:01:32.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:32 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:32.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:32 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:32.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:32 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:32.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:32 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:32.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:32 smithi183 ceph-mon[22097]: osdmap e26: 4 total, 4 up, 4 in 2024-08-18T22:01:32.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:32 smithi123 ceph-mon[18462]: purged_snaps scrub starts 2024-08-18T22:01:32.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:32 smithi123 ceph-mon[18462]: purged_snaps scrub ok 2024-08-18T22:01:32.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:32 smithi123 ceph-mon[18462]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:32.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:32 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:32.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:32 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:32.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:32 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:01:32.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:32 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:01:32.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:32 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:32.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:32 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:32.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:32 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:32.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:32 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:32.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:32 smithi123 ceph-mon[18462]: osdmap e26: 4 total, 4 up, 4 in 2024-08-18T22:01:32.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:32 smithi130 ceph-mon[21698]: purged_snaps scrub starts 2024-08-18T22:01:32.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:32 smithi130 ceph-mon[21698]: purged_snaps scrub ok 2024-08-18T22:01:32.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:32 smithi130 ceph-mon[21698]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:32.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:32 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:32.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:32 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:32.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:32 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:01:32.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:32 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:01:32.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:32 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:32.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:32 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:32.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:32 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:32.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:32 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:32.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:32 smithi130 ceph-mon[21698]: osdmap e26: 4 total, 4 up, 4 in 2024-08-18T22:01:33.407 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:33 smithi130 ceph-mon[21698]: Detected new or changed devices on smithi123 2024-08-18T22:01:33.408 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:33 smithi130 ceph-mon[21698]: Adjusting osd_memory_target on smithi123 to 8544M 2024-08-18T22:01:33.408 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:33 smithi130 ceph-mon[21698]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:01:33.408 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:33 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:01:33.408 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:33 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:01:33.408 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:33 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:33.408 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:33 smithi130 ceph-mon[21698]: osdmap e27: 4 total, 4 up, 4 in 2024-08-18T22:01:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:33 smithi183 ceph-mon[22097]: Detected new or changed devices on smithi123 2024-08-18T22:01:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:33 smithi183 ceph-mon[22097]: Adjusting osd_memory_target on smithi123 to 8544M 2024-08-18T22:01:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:33 smithi183 ceph-mon[22097]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:01:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:33 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:01:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:33 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:01:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:33 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:33 smithi183 ceph-mon[22097]: osdmap e27: 4 total, 4 up, 4 in 2024-08-18T22:01:33.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:33 smithi123 ceph-mon[18462]: Detected new or changed devices on smithi123 2024-08-18T22:01:33.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:33 smithi123 ceph-mon[18462]: Adjusting osd_memory_target on smithi123 to 8544M 2024-08-18T22:01:33.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:33 smithi123 ceph-mon[18462]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:01:33.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:33 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:01:33.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:33 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:01:33.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:33 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:33.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:33 smithi123 ceph-mon[18462]: osdmap e27: 4 total, 4 up, 4 in 2024-08-18T22:01:34.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:34 smithi130 ceph-mon[21698]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:34.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:34 smithi123 ceph-mon[18462]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:34.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:34 smithi183 ceph-mon[22097]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:35.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:35 smithi123 ceph-mon[18462]: osdmap e28: 4 total, 4 up, 4 in 2024-08-18T22:01:35.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:35 smithi123 ceph-mon[18462]: from='client.? 172.21.15.130:0/822392825' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489f811e-7dc9-4c1b-8c2a-3b7a52f40432"}]: dispatch 2024-08-18T22:01:35.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:35 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489f811e-7dc9-4c1b-8c2a-3b7a52f40432"}]: dispatch 2024-08-18T22:01:35.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:35 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "489f811e-7dc9-4c1b-8c2a-3b7a52f40432"}]': finished 2024-08-18T22:01:35.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:35 smithi123 ceph-mon[18462]: osdmap e29: 5 total, 4 up, 5 in 2024-08-18T22:01:35.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:35 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:35.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:35 smithi130 ceph-mon[21698]: osdmap e28: 4 total, 4 up, 4 in 2024-08-18T22:01:35.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:35 smithi130 ceph-mon[21698]: from='client.? 172.21.15.130:0/822392825' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489f811e-7dc9-4c1b-8c2a-3b7a52f40432"}]: dispatch 2024-08-18T22:01:35.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:35 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489f811e-7dc9-4c1b-8c2a-3b7a52f40432"}]: dispatch 2024-08-18T22:01:35.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:35 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "489f811e-7dc9-4c1b-8c2a-3b7a52f40432"}]': finished 2024-08-18T22:01:35.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:35 smithi130 ceph-mon[21698]: osdmap e29: 5 total, 4 up, 5 in 2024-08-18T22:01:35.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:35 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:35.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:35 smithi183 ceph-mon[22097]: osdmap e28: 4 total, 4 up, 4 in 2024-08-18T22:01:35.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:35 smithi183 ceph-mon[22097]: from='client.? 172.21.15.130:0/822392825' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489f811e-7dc9-4c1b-8c2a-3b7a52f40432"}]: dispatch 2024-08-18T22:01:35.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:35 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489f811e-7dc9-4c1b-8c2a-3b7a52f40432"}]: dispatch 2024-08-18T22:01:35.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:35 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "489f811e-7dc9-4c1b-8c2a-3b7a52f40432"}]': finished 2024-08-18T22:01:35.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:35 smithi183 ceph-mon[22097]: osdmap e29: 5 total, 4 up, 5 in 2024-08-18T22:01:35.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:35 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:36.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:36 smithi123 ceph-mon[18462]: from='client.? 172.21.15.130:0/711090467' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:01:36.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:36 smithi123 ceph-mon[18462]: pgmap v92: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 376 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-18T22:01:36.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:36 smithi130 ceph-mon[21698]: from='client.? 172.21.15.130:0/711090467' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:01:36.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:36 smithi130 ceph-mon[21698]: pgmap v92: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 376 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-18T22:01:36.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:36 smithi183 ceph-mon[22097]: from='client.? 172.21.15.130:0/711090467' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:01:36.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:36 smithi183 ceph-mon[22097]: pgmap v92: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 376 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-18T22:01:38.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:38 smithi130 ceph-mon[21698]: pgmap v93: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-08-18T22:01:38.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:38 smithi183 ceph-mon[22097]: pgmap v93: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-08-18T22:01:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:38 smithi123 ceph-mon[18462]: pgmap v93: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-08-18T22:01:40.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:40 smithi183 ceph-mon[22097]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-18T22:01:40.687 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:40 smithi130 ceph-mon[21698]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-18T22:01:40.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:40 smithi123 ceph-mon[18462]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-18T22:01:42.626 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:42 smithi130 ceph-mon[21698]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-18T22:01:42.626 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:42 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-18T22:01:42.626 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:42 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:42.626 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:42 smithi130 ceph-mon[21698]: Deploying daemon osd.4 on smithi130 2024-08-18T22:01:42.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:42 smithi183 ceph-mon[22097]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-18T22:01:42.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-18T22:01:42.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:42.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:42 smithi183 ceph-mon[22097]: Deploying daemon osd.4 on smithi130 2024-08-18T22:01:42.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:42 smithi123 ceph-mon[18462]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-18T22:01:42.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:42 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-18T22:01:42.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:42 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:42.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:42 smithi123 ceph-mon[18462]: Deploying daemon osd.4 on smithi130 2024-08-18T22:01:44.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:44 smithi130 ceph-mon[21698]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:44.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:44 smithi183 ceph-mon[22097]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:44.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:44 smithi123 ceph-mon[18462]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:46.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:46 smithi183 ceph-mon[22097]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:46.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:46.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:46.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:46.681 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:46 smithi130 ceph-mon[21698]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:46.681 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:46.681 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:46.681 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:46.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:46 smithi123 ceph-mon[18462]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:46.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:46.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:46.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:48.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:48 smithi130 ceph-mon[21698]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:48.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:48 smithi183 ceph-mon[22097]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:48.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:48 smithi123 ceph-mon[18462]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:49.690 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 4 on host 'smithi130' 2024-08-18T22:01:49.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:49.688+0000 7fbd0f7fe640 1 -- 172.21.15.130:0/3463336298 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbd1c1a26f0 con 0x7fbd080a2b80 2024-08-18T22:01:49.692 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:49.691+0000 7fbd24306640 1 -- 172.21.15.130:0/3463336298 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbd080a2b80 msgr2=0x7fbd080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:01:49.692 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:49.691+0000 7fbd24306640 1 --2- 172.21.15.130:0/3463336298 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbd080a2b80 0x7fbd080a5040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbd18005ab0 tx=0x7fbd18000bc0 comp rx=0 tx=0).stop 2024-08-18T22:01:49.692 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:49.691+0000 7fbd24306640 1 -- 172.21.15.130:0/3463336298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd1c1023c0 msgr2=0x7fbd1c103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:01:49.692 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:49.691+0000 7fbd24306640 1 --2- 172.21.15.130:0/3463336298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd1c1023c0 0x7fbd1c103320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400eaa0 tx=0x7fbd1400ef60 comp rx=0 tx=0).stop 2024-08-18T22:01:49.692 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:49.691+0000 7fbd24306640 1 -- 172.21.15.130:0/3463336298 shutdown_connections 2024-08-18T22:01:49.692 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:49.691+0000 7fbd24306640 1 --2- 172.21.15.130:0/3463336298 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbd080a2b80 0x7fbd080a5040 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:49.692 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:49.691+0000 7fbd24306640 1 --2- 172.21.15.130:0/3463336298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd1c1023c0 0x7fbd1c103320 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:49.692 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:49.691+0000 7fbd24306640 1 --2- 172.21.15.130:0/3463336298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd1c101a00 0x7fbd1c102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:49.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:49.691+0000 7fbd24306640 1 --2- 172.21.15.130:0/3463336298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd1c100800 0x7fbd1c104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:49.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:49.691+0000 7fbd24306640 1 -- 172.21.15.130:0/3463336298 >> 172.21.15.130:0/3463336298 conn(0x7fbd1c0fbfb0 msgr2=0x7fbd1c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:01:49.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:49.691+0000 7fbd24306640 1 -- 172.21.15.130:0/3463336298 shutdown_connections 2024-08-18T22:01:49.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:01:49.691+0000 7fbd24306640 1 -- 172.21.15.130:0/3463336298 wait complete. 2024-08-18T22:01:50.009 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:49 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:50.009 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:49 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:50.010 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:49 smithi130 ceph-mon[21698]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:50.010 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:49 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:50.010 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:49 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:50.010 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:49 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:50.010 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:49 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:50.010 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:49 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:50.010 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:49 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:50.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:49 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:50.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:49 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:50.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:49 smithi183 ceph-mon[22097]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:50.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:49 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:50.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:49 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:50.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:49 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:50.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:49 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:50.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:49 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:50.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:49 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:50.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:49 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:50.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:49 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:50.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:49 smithi123 ceph-mon[18462]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:50.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:49 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:50.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:49 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:50.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:49 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:50.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:49 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:01:50.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:49 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:50.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:49 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:50.387 DEBUG:teuthology.orchestra.run.smithi130:osd.4> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.4.service 2024-08-18T22:01:50.390 INFO:tasks.cephadm:Deploying osd.5 on smithi183 with /dev/vg_nvme/lv_3... 2024-08-18T22:01:50.390 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-18T22:01:50.650 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T22:01:50.897 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:50 smithi130 ceph-mon[21698]: from='osd.4 [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-18T22:01:50.897 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:50 smithi130 ceph-mon[21698]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-18T22:01:51.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:50 smithi183 ceph-mon[22097]: from='osd.4 [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-18T22:01:51.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:50 smithi183 ceph-mon[22097]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-18T22:01:51.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:50 smithi123 ceph-mon[18462]: from='osd.4 [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-18T22:01:51.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:50 smithi123 ceph-mon[18462]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-18T22:01:52.009 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:51 smithi183 ceph-mon[22097]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-18T22:01:52.010 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:51 smithi183 ceph-mon[22097]: from='osd.4 [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:01:52.010 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:51 smithi183 ceph-mon[22097]: osdmap e30: 5 total, 4 up, 5 in 2024-08-18T22:01:52.010 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:51 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:52.010 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:51 smithi183 ceph-mon[22097]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:01:52.010 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:51 smithi183 ceph-mon[22097]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:52.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:51 smithi123 ceph-mon[18462]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-18T22:01:52.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:51 smithi123 ceph-mon[18462]: from='osd.4 [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:01:52.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:51 smithi123 ceph-mon[18462]: osdmap e30: 5 total, 4 up, 5 in 2024-08-18T22:01:52.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:51 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:52.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:51 smithi123 ceph-mon[18462]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:01:52.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:51 smithi123 ceph-mon[18462]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:52.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:51 smithi130 ceph-mon[21698]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-18T22:01:52.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:51 smithi130 ceph-mon[21698]: from='osd.4 [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:01:52.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:51 smithi130 ceph-mon[21698]: osdmap e30: 5 total, 4 up, 5 in 2024-08-18T22:01:52.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:51 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:52.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:51 smithi130 ceph-mon[21698]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:01:52.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:51 smithi130 ceph-mon[21698]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:52.864 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:01:52 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4[32842]: 2024-08-18T22:01:52.578+0000 7f6a79cd5640 -1 osd.4 0 waiting for initial osdmap 2024-08-18T22:01:52.864 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:01:52 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4[32842]: 2024-08-18T22:01:52.583+0000 7f6a71af5640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:01:53.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:52 smithi183 ceph-mon[22097]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-18T22:01:53.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:52 smithi183 ceph-mon[22097]: osdmap e31: 5 total, 4 up, 5 in 2024-08-18T22:01:53.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:52 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:53.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:52 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:53.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:52 smithi183 ceph-mon[22097]: from='osd.4 ' entity='osd.4' 2024-08-18T22:01:53.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:52 smithi130 ceph-mon[21698]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-18T22:01:53.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:52 smithi130 ceph-mon[21698]: osdmap e31: 5 total, 4 up, 5 in 2024-08-18T22:01:53.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:52 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:53.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:52 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:53.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:52 smithi130 ceph-mon[21698]: from='osd.4 ' entity='osd.4' 2024-08-18T22:01:53.200 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T22:01:53.227 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_3 2024-08-18T22:01:53.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:52 smithi123 ceph-mon[18462]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-18T22:01:53.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:52 smithi123 ceph-mon[18462]: osdmap e31: 5 total, 4 up, 5 in 2024-08-18T22:01:53.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:52 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:53.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:52 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:53.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:52 smithi123 ceph-mon[18462]: from='osd.4 ' entity='osd.4' 2024-08-18T22:01:53.482 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T22:01:54.051 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.035+0000 7ff18de42640 1 -- 172.21.15.183:0/1202398767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1881023c0 msgr2=0x7ff188108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:01:54.051 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.035+0000 7ff18de42640 1 --2- 172.21.15.183:0/1202398767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1881023c0 0x7ff188108c50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff180009ca0 tx=0x7ff18002a8c0 comp rx=0 tx=0).stop 2024-08-18T22:01:54.051 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.035+0000 7ff18de42640 1 -- 172.21.15.183:0/1202398767 shutdown_connections 2024-08-18T22:01:54.051 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.035+0000 7ff18de42640 1 --2- 172.21.15.183:0/1202398767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1881023c0 0x7ff188108c50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:54.051 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.035+0000 7ff18de42640 1 --2- 172.21.15.183:0/1202398767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff188101a00 0x7ff188101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:54.051 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.035+0000 7ff18de42640 1 --2- 172.21.15.183:0/1202398767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff188100800 0x7ff188100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:54.051 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.035+0000 7ff18de42640 1 -- 172.21.15.183:0/1202398767 >> 172.21.15.183:0/1202398767 conn(0x7ff1880fbfb0 msgr2=0x7ff1880fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:01:54.051 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.035+0000 7ff18de42640 1 -- 172.21.15.183:0/1202398767 shutdown_connections 2024-08-18T22:01:54.051 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.035+0000 7ff18de42640 1 -- 172.21.15.183:0/1202398767 wait complete. 2024-08-18T22:01:54.052 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.035+0000 7ff18de42640 1 Processor -- start 2024-08-18T22:01:54.052 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff18de42640 1 -- start start 2024-08-18T22:01:54.052 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff18de42640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff188100800 0x7ff18810d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:01:54.052 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff18de42640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff188101a00 0x7ff18810c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:01:54.052 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff18de42640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1881023c0 0x7ff18810c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:01:54.052 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff18de42640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff18806a2b0 con 0x7ff188100800 2024-08-18T22:01:54.052 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff18de42640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff18806a130 con 0x7ff1881023c0 2024-08-18T22:01:54.052 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff18de42640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff18806a430 con 0x7ff188101a00 2024-08-18T22:01:54.052 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff17effd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff188101a00 0x7ff18810c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:01:54.052 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff17effd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff188101a00 0x7ff18810c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:34222/0 (socket says 172.21.15.183:34222) 2024-08-18T22:01:54.053 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff17effd640 1 -- 172.21.15.183:0/2507125260 learned_addr learned my addr 172.21.15.183:0/2507125260 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-08-18T22:01:54.053 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff187fff640 1 --2- 172.21.15.183:0/2507125260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1881023c0 0x7ff18810c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:01:54.053 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff1877fe640 1 --2- 172.21.15.183:0/2507125260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff188100800 0x7ff18810d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:01:54.053 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff17effd640 1 -- 172.21.15.183:0/2507125260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1881023c0 msgr2=0x7ff18810c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:01:54.053 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff17effd640 1 --2- 172.21.15.183:0/2507125260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1881023c0 0x7ff18810c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:54.053 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff17effd640 1 -- 172.21.15.183:0/2507125260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff188100800 msgr2=0x7ff18810d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:01:54.053 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff17effd640 1 --2- 172.21.15.183:0/2507125260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff188100800 0x7ff18810d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:01:54.053 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff17effd640 1 -- 172.21.15.183:0/2507125260 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18810ce10 con 0x7ff188101a00 2024-08-18T22:01:54.053 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff17effd640 1 --2- 172.21.15.183:0/2507125260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff188101a00 0x7ff18810c010 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff17000c890 tx=0x7ff17000cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:01:54.053 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.036+0000 7ff1857fa640 1 -- 172.21.15.183:0/2507125260 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff170004220 con 0x7ff188101a00 2024-08-18T22:01:54.053 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.037+0000 7ff1857fa640 1 -- 172.21.15.183:0/2507125260 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1700043c0 con 0x7ff188101a00 2024-08-18T22:01:54.053 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.037+0000 7ff18de42640 1 -- 172.21.15.183:0/2507125260 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1881a1d30 con 0x7ff188101a00 2024-08-18T22:01:54.054 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.037+0000 7ff1857fa640 1 -- 172.21.15.183:0/2507125260 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1700049e0 con 0x7ff188101a00 2024-08-18T22:01:54.054 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.037+0000 7ff18de42640 1 -- 172.21.15.183:0/2507125260 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1881a21e0 con 0x7ff188101a00 2024-08-18T22:01:54.054 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.038+0000 7ff18de42640 1 -- 172.21.15.183:0/2507125260 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff188107ad0 con 0x7ff188101a00 2024-08-18T22:01:54.054 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.039+0000 7ff1857fa640 1 -- 172.21.15.183:0/2507125260 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7ff1700079b0 con 0x7ff188101a00 2024-08-18T22:01:54.054 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.040+0000 7ff1857fa640 1 --2- 172.21.15.183:0/2507125260 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff1740a2b80 0x7ff1740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:01:54.054 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.040+0000 7ff1877fe640 1 --2- 172.21.15.183:0/2507125260 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff1740a2b80 0x7ff1740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:01:54.054 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.040+0000 7ff1857fa640 1 -- 172.21.15.183:0/2507125260 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4101+0+0 (secure 0 0 0) 0x7ff1700ce030 con 0x7ff188101a00 2024-08-18T22:01:54.054 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.040+0000 7ff1877fe640 1 --2- 172.21.15.183:0/2507125260 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff1740a2b80 0x7ff1740a5040 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff178005db0 tx=0x7ff178005d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:01:54.054 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.044+0000 7ff1857fa640 1 -- 172.21.15.183:0/2507125260 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff170014030 con 0x7ff188101a00 2024-08-18T22:01:54.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: purged_snaps scrub starts 2024-08-18T22:01:54.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: purged_snaps scrub ok 2024-08-18T22:01:54.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:54.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: Detected new or changed devices on smithi130 2024-08-18T22:01:54.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:54.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:54.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:01:54.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:01:54.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: Adjusting osd_memory_target on smithi130 to 8544M 2024-08-18T22:01:54.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:54.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:54.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:54.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:54.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:54.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: osd.4 [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383] boot 2024-08-18T22:01:54.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: osdmap e32: 5 total, 5 up, 5 in 2024-08-18T22:01:54.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:54.219 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:01:54.219+0000 7ff18de42640 1 -- 172.21.15.183:0/2507125260 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff188062360 con 0x7ff1740a2b80 2024-08-18T22:01:54.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: purged_snaps scrub starts 2024-08-18T22:01:54.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: purged_snaps scrub ok 2024-08-18T22:01:54.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:54.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: Detected new or changed devices on smithi130 2024-08-18T22:01:54.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:54.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:54.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:01:54.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:01:54.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: Adjusting osd_memory_target on smithi130 to 8544M 2024-08-18T22:01:54.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:54.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:54.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:54.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:54.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:54.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: osd.4 [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383] boot 2024-08-18T22:01:54.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: osdmap e32: 5 total, 5 up, 5 in 2024-08-18T22:01:54.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:54.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: purged_snaps scrub starts 2024-08-18T22:01:54.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: purged_snaps scrub ok 2024-08-18T22:01:54.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:54.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: Detected new or changed devices on smithi130 2024-08-18T22:01:54.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:54.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:54.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:01:54.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:01:54.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: Adjusting osd_memory_target on smithi130 to 8544M 2024-08-18T22:01:54.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:54.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:54.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:01:54.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:01:54.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-18T22:01:54.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: osd.4 [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383] boot 2024-08-18T22:01:54.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: osdmap e32: 5 total, 5 up, 5 in 2024-08-18T22:01:54.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:01:54.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:54 smithi183 ceph-mon[22097]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:01:54.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:01:54.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:01:54.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:55.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:54 smithi123 ceph-mon[18462]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:01:55.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:01:55.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:01:55.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:55.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:54 smithi130 ceph-mon[21698]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:01:55.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:01:55.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:01:55.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:01:56.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:56 smithi123 ceph-mon[18462]: osdmap e33: 5 total, 5 up, 5 in 2024-08-18T22:01:56.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:56 smithi123 ceph-mon[18462]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:01:56.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:56 smithi130 ceph-mon[21698]: osdmap e33: 5 total, 5 up, 5 in 2024-08-18T22:01:56.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:56 smithi130 ceph-mon[21698]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:01:56.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:56 smithi183 ceph-mon[22097]: osdmap e33: 5 total, 5 up, 5 in 2024-08-18T22:01:56.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:56 smithi183 ceph-mon[22097]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:01:57.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:57 smithi123 ceph-mon[18462]: from='client.? 172.21.15.183:0/1511200116' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79675f4f-62df-4a95-9c74-4cf200b53e6b"}]: dispatch 2024-08-18T22:01:57.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:57 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79675f4f-62df-4a95-9c74-4cf200b53e6b"}]: dispatch 2024-08-18T22:01:57.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:57 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79675f4f-62df-4a95-9c74-4cf200b53e6b"}]': finished 2024-08-18T22:01:57.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:57 smithi123 ceph-mon[18462]: osdmap e34: 6 total, 5 up, 6 in 2024-08-18T22:01:57.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:57 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:01:57.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:57 smithi123 ceph-mon[18462]: from='client.? 172.21.15.183:0/3182148333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:01:57.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:57 smithi130 ceph-mon[21698]: from='client.? 172.21.15.183:0/1511200116' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79675f4f-62df-4a95-9c74-4cf200b53e6b"}]: dispatch 2024-08-18T22:01:57.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:57 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79675f4f-62df-4a95-9c74-4cf200b53e6b"}]: dispatch 2024-08-18T22:01:57.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:57 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79675f4f-62df-4a95-9c74-4cf200b53e6b"}]': finished 2024-08-18T22:01:57.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:57 smithi130 ceph-mon[21698]: osdmap e34: 6 total, 5 up, 6 in 2024-08-18T22:01:57.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:57 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:01:57.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:57 smithi130 ceph-mon[21698]: from='client.? 172.21.15.183:0/3182148333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:01:57.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:57 smithi183 ceph-mon[22097]: from='client.? 172.21.15.183:0/1511200116' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79675f4f-62df-4a95-9c74-4cf200b53e6b"}]: dispatch 2024-08-18T22:01:57.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:57 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79675f4f-62df-4a95-9c74-4cf200b53e6b"}]: dispatch 2024-08-18T22:01:57.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:57 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79675f4f-62df-4a95-9c74-4cf200b53e6b"}]': finished 2024-08-18T22:01:57.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:57 smithi183 ceph-mon[22097]: osdmap e34: 6 total, 5 up, 6 in 2024-08-18T22:01:57.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:57 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:01:57.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:57 smithi183 ceph-mon[22097]: from='client.? 172.21.15.183:0/3182148333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:01:58.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:01:58 smithi123 ceph-mon[18462]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:01:58.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:01:58 smithi130 ceph-mon[21698]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:01:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:01:58 smithi183 ceph-mon[22097]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:00.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:00 smithi183 ceph-mon[22097]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:00.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:00 smithi123 ceph-mon[18462]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:00.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:00 smithi130 ceph-mon[21698]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:02.591 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:02 smithi183 ceph-mon[22097]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:02.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:02 smithi123 ceph-mon[18462]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:02.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:02 smithi130 ceph-mon[21698]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:04.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:04 smithi183 ceph-mon[22097]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:04.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:04 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-18T22:02:04.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:04 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:04.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:04 smithi123 ceph-mon[18462]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:04.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:04 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-18T22:02:04.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:04 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:04.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:04 smithi130 ceph-mon[21698]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:04.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:04 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-18T22:02:04.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:04 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:05.572 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:05 smithi183 ceph-mon[22097]: Deploying daemon osd.5 on smithi183 2024-08-18T22:02:05.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:05 smithi123 ceph-mon[18462]: Deploying daemon osd.5 on smithi183 2024-08-18T22:02:05.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:05 smithi130 ceph-mon[21698]: Deploying daemon osd.5 on smithi183 2024-08-18T22:02:06.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:06 smithi183 ceph-mon[22097]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:06.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:06 smithi123 ceph-mon[18462]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:06.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:06 smithi130 ceph-mon[21698]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:08.632 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:08 smithi183 ceph-mon[22097]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:08.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:08 smithi123 ceph-mon[18462]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:08 smithi130 ceph-mon[21698]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:09.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:09.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:09.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:09.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:09.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:09.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:09.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:09.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:09.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:10.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:10 smithi183 ceph-mon[22097]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:10 smithi123 ceph-mon[18462]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:10 smithi130 ceph-mon[21698]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:11.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:02:11.891+0000 7ff1857fa640 1 -- 172.21.15.183:0/2507125260 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff188062360 con 0x7ff1740a2b80 2024-08-18T22:02:11.893 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 5 on host 'smithi183' 2024-08-18T22:02:11.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:02:11.893+0000 7ff18de42640 1 -- 172.21.15.183:0/2507125260 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff1740a2b80 msgr2=0x7ff1740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:02:11.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:02:11.893+0000 7ff18de42640 1 --2- 172.21.15.183:0/2507125260 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff1740a2b80 0x7ff1740a5040 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff178005db0 tx=0x7ff178005d40 comp rx=0 tx=0).stop 2024-08-18T22:02:11.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:02:11.893+0000 7ff18de42640 1 -- 172.21.15.183:0/2507125260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff188101a00 msgr2=0x7ff18810c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:02:11.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:02:11.893+0000 7ff18de42640 1 --2- 172.21.15.183:0/2507125260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff188101a00 0x7ff18810c010 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff17000c890 tx=0x7ff17000cd50 comp rx=0 tx=0).stop 2024-08-18T22:02:11.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:02:11.893+0000 7ff18de42640 1 -- 172.21.15.183:0/2507125260 shutdown_connections 2024-08-18T22:02:11.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:02:11.893+0000 7ff18de42640 1 --2- 172.21.15.183:0/2507125260 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff1740a2b80 0x7ff1740a5040 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:11.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:02:11.893+0000 7ff18de42640 1 --2- 172.21.15.183:0/2507125260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1881023c0 0x7ff18810c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:11.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:02:11.893+0000 7ff18de42640 1 --2- 172.21.15.183:0/2507125260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff188101a00 0x7ff18810c010 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:11.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:02:11.893+0000 7ff18de42640 1 --2- 172.21.15.183:0/2507125260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff188100800 0x7ff18810d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:11.896 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:02:11.893+0000 7ff18de42640 1 -- 172.21.15.183:0/2507125260 >> 172.21.15.183:0/2507125260 conn(0x7ff1880fbfb0 msgr2=0x7ff188104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:02:11.896 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:02:11.894+0000 7ff18de42640 1 -- 172.21.15.183:0/2507125260 shutdown_connections 2024-08-18T22:02:11.896 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:02:11.894+0000 7ff18de42640 1 -- 172.21.15.183:0/2507125260 wait complete. 2024-08-18T22:02:12.545 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:12 smithi183 ceph-mon[22097]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:12.545 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:12 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:12.546 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:12 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:12.625 DEBUG:teuthology.orchestra.run.smithi183:osd.5> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.5.service 2024-08-18T22:02:12.627 INFO:tasks.cephadm:Deploying osd.6 on smithi123 with /dev/vg_nvme/lv_2... 2024-08-18T22:02:12.628 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-18T22:02:12.657 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:12 smithi123 ceph-mon[18462]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:12.658 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:12 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:12.658 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:12 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:12 smithi130 ceph-mon[21698]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:12 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:12 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:12.902 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:02:13.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:13 smithi183 ceph-mon[22097]: from='osd.5 [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-18T22:02:13.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:13 smithi183 ceph-mon[22097]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-18T22:02:13.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:13 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:13.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:13 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:13.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:13 smithi123 ceph-mon[18462]: from='osd.5 [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-18T22:02:13.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:13 smithi123 ceph-mon[18462]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-18T22:02:13.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:13 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:13.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:13 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:13 smithi130 ceph-mon[21698]: from='osd.5 [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-18T22:02:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:13 smithi130 ceph-mon[21698]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-18T22:02:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:13 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:13 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:14.579 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:14 smithi123 ceph-mon[18462]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:14.579 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:14 smithi123 ceph-mon[18462]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-18T22:02:14.579 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:14 smithi123 ceph-mon[18462]: osdmap e35: 6 total, 5 up, 6 in 2024-08-18T22:02:14.579 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:14 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:02:14.579 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:14 smithi123 ceph-mon[18462]: from='osd.5 [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:02:14.579 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:14 smithi123 ceph-mon[18462]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:02:14.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:14 smithi183 ceph-mon[22097]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:14.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:14 smithi183 ceph-mon[22097]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-18T22:02:14.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:14 smithi183 ceph-mon[22097]: osdmap e35: 6 total, 5 up, 6 in 2024-08-18T22:02:14.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:14 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:02:14.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:14 smithi183 ceph-mon[22097]: from='osd.5 [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:02:14.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:14 smithi183 ceph-mon[22097]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:02:14.660 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:02:14 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:02:14.363+0000 7f609d65d640 -1 osd.5 0 waiting for initial osdmap 2024-08-18T22:02:14.660 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:02:14 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:02:14.372+0000 7f6099485640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:02:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:14 smithi130 ceph-mon[21698]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:14 smithi130 ceph-mon[21698]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-18T22:02:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:14 smithi130 ceph-mon[21698]: osdmap e35: 6 total, 5 up, 6 in 2024-08-18T22:02:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:14 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:02:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:14 smithi130 ceph-mon[21698]: from='osd.5 [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:02:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:14 smithi130 ceph-mon[21698]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:02:15.378 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:02:15.405 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi123:vg_nvme/lv_2 2024-08-18T22:02:15.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:15 smithi183 ceph-mon[22097]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-08-18T22:02:15.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:15 smithi183 ceph-mon[22097]: osdmap e36: 6 total, 5 up, 6 in 2024-08-18T22:02:15.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:15 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:02:15.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:15 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:02:15.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:15 smithi183 ceph-mon[22097]: osd.5 [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015] boot 2024-08-18T22:02:15.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:15 smithi183 ceph-mon[22097]: osdmap e37: 6 total, 6 up, 6 in 2024-08-18T22:02:15.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:15 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:02:15.676 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:15 smithi123 ceph-mon[18462]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-08-18T22:02:15.677 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:15 smithi123 ceph-mon[18462]: osdmap e36: 6 total, 5 up, 6 in 2024-08-18T22:02:15.677 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:15 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:02:15.677 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:15 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:02:15.677 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:15 smithi123 ceph-mon[18462]: osd.5 [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015] boot 2024-08-18T22:02:15.677 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:15 smithi123 ceph-mon[18462]: osdmap e37: 6 total, 6 up, 6 in 2024-08-18T22:02:15.677 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:15 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:02:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:02:15.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:15 smithi130 ceph-mon[21698]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-08-18T22:02:15.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:15 smithi130 ceph-mon[21698]: osdmap e36: 6 total, 5 up, 6 in 2024-08-18T22:02:15.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:15 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:02:15.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:15 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:02:15.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:15 smithi130 ceph-mon[21698]: osd.5 [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015] boot 2024-08-18T22:02:15.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:15 smithi130 ceph-mon[21698]: osdmap e37: 6 total, 6 up, 6 in 2024-08-18T22:02:15.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:15 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:02:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.187+0000 7f13a83a6640 1 -- 172.21.15.123:0/2997560776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13a01097c0 msgr2=0x7f13a010bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:02:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.187+0000 7f13a83a6640 1 --2- 172.21.15.123:0/2997560776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13a01097c0 0x7f13a010bc80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1398009ca0 tx=0x7f139802a8c0 comp rx=0 tx=0).stop 2024-08-18T22:02:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.187+0000 7f13a83a6640 1 -- 172.21.15.123:0/2997560776 shutdown_connections 2024-08-18T22:02:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.187+0000 7f13a83a6640 1 --2- 172.21.15.123:0/2997560776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13a01097c0 0x7f13a010bc80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.187+0000 7f13a83a6640 1 --2- 172.21.15.123:0/2997560776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a0074870 0x7f13a0074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.187+0000 7f13a83a6640 1 --2- 172.21.15.123:0/2997560776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13a0075ed0 0x7f13a0074330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.187+0000 7f13a83a6640 1 -- 172.21.15.123:0/2997560776 >> 172.21.15.123:0/2997560776 conn(0x7f13a00fd0e0 msgr2=0x7f13a00ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:02:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.188+0000 7f13a83a6640 1 -- 172.21.15.123:0/2997560776 shutdown_connections 2024-08-18T22:02:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.188+0000 7f13a83a6640 1 -- 172.21.15.123:0/2997560776 wait complete. 2024-08-18T22:02:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.188+0000 7f13a83a6640 1 Processor -- start 2024-08-18T22:02:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.188+0000 7f13a83a6640 1 -- start start 2024-08-18T22:02:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.188+0000 7f13a83a6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13a0074870 0x7f13a0199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:02:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.188+0000 7f13a83a6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13a0075ed0 0x7f13a019a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:02:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.188+0000 7f13a83a6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a01097c0 0x7f13a01a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:02:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.188+0000 7f13a83a6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f13a010f7a0 con 0x7f13a0074870 2024-08-18T22:02:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.188+0000 7f13a83a6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13a010f620 con 0x7f13a01097c0 2024-08-18T22:02:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.188+0000 7f13a83a6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f13a010f920 con 0x7f13a0075ed0 2024-08-18T22:02:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.188+0000 7f13a6142640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13a0074870 0x7f13a0199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:02:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.188+0000 7f13a6142640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13a0074870 0x7f13a0199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58878/0 (socket says 172.21.15.123:58878) 2024-08-18T22:02:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.188+0000 7f13a6142640 1 -- 172.21.15.123:0/3515463555 learned_addr learned my addr 172.21.15.123:0/3515463555 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:02:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.189+0000 7f13a5941640 1 --2- 172.21.15.123:0/3515463555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13a0075ed0 0x7f13a019a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:02:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.189+0000 7f13a6142640 1 -- 172.21.15.123:0/3515463555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13a0075ed0 msgr2=0x7f13a019a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:02:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.189+0000 7f13a6142640 1 --2- 172.21.15.123:0/3515463555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13a0075ed0 0x7f13a019a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.189+0000 7f13a6142640 1 -- 172.21.15.123:0/3515463555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a01097c0 msgr2=0x7f13a01a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:02:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.189+0000 7f13a6142640 1 --2- 172.21.15.123:0/3515463555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a01097c0 0x7f13a01a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.189+0000 7f13a6142640 1 -- 172.21.15.123:0/3515463555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a01a19f0 con 0x7f13a0074870 2024-08-18T22:02:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.189+0000 7f13a6142640 1 --2- 172.21.15.123:0/3515463555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13a0074870 0x7f13a0199dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f139c00d950 tx=0x7f139c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:02:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.189+0000 7f13977fe640 1 -- 172.21.15.123:0/3515463555 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c017030 con 0x7f13a0074870 2024-08-18T22:02:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.189+0000 7f13977fe640 1 -- 172.21.15.123:0/3515463555 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f139c004020 con 0x7f13a0074870 2024-08-18T22:02:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.189+0000 7f13977fe640 1 -- 172.21.15.123:0/3515463555 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c0047a0 con 0x7f13a0074870 2024-08-18T22:02:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.189+0000 7f13a83a6640 1 -- 172.21.15.123:0/3515463555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a01a1ce0 con 0x7f13a0074870 2024-08-18T22:02:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.189+0000 7f13a83a6640 1 -- 172.21.15.123:0/3515463555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a01a21c0 con 0x7f13a0074870 2024-08-18T22:02:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.190+0000 7f13a83a6640 1 -- 172.21.15.123:0/3515463555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a01085d0 con 0x7f13a0074870 2024-08-18T22:02:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.191+0000 7f13977fe640 1 -- 172.21.15.123:0/3515463555 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f139c0041d0 con 0x7f13a0074870 2024-08-18T22:02:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.192+0000 7f13977fe640 1 --2- 172.21.15.123:0/3515463555 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f138c0a2c30 0x7f138c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:02:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.192+0000 7f13a5941640 1 --2- 172.21.15.123:0/3515463555 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f138c0a2c30 0x7f138c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:02:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.192+0000 7f13977fe640 1 -- 172.21.15.123:0/3515463555 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4562+0+0 (secure 0 0 0) 0x7f139c0cdbb0 con 0x7f13a0074870 2024-08-18T22:02:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.192+0000 7f13a5941640 1 --2- 172.21.15.123:0/3515463555 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f138c0a2c30 0x7f138c0a50f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1390005fd0 tx=0x7f1390005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:02:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.196+0000 7f13977fe640 1 -- 172.21.15.123:0/3515463555 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f139c09b9b0 con 0x7f13a0074870 2024-08-18T22:02:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:16.379+0000 7f13a83a6640 1 -- 172.21.15.123:0/3515463555 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f13a0062360 con 0x7f138c0a2c30 2024-08-18T22:02:16.645 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: purged_snaps scrub starts 2024-08-18T22:02:16.645 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: purged_snaps scrub ok 2024-08-18T22:02:16.645 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:16.645 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:16.646 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:16.646 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:02:16.646 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:02:16.646 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:16.646 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:16.646 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:02:16.646 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:16.646 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:16.646 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:16.646 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:02:16.646 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:16.646 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:16 smithi123 ceph-mon[18462]: osdmap e38: 6 total, 6 up, 6 in 2024-08-18T22:02:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: purged_snaps scrub starts 2024-08-18T22:02:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: purged_snaps scrub ok 2024-08-18T22:02:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:02:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:02:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:02:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:16.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:02:16.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:16.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:16 smithi183 ceph-mon[22097]: osdmap e38: 6 total, 6 up, 6 in 2024-08-18T22:02:16.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: purged_snaps scrub starts 2024-08-18T22:02:16.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: purged_snaps scrub ok 2024-08-18T22:02:16.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-18T22:02:16.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:16.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:16.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:02:16.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:02:16.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:16.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:16.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:02:16.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:16.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:16.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:16.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:02:16.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:16.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:16 smithi130 ceph-mon[21698]: osdmap e38: 6 total, 6 up, 6 in 2024-08-18T22:02:17.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:17 smithi183 ceph-mon[22097]: Detected new or changed devices on smithi183 2024-08-18T22:02:17.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:17 smithi183 ceph-mon[22097]: Adjusting osd_memory_target on smithi183 to 8544M 2024-08-18T22:02:17.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:17 smithi183 ceph-mon[22097]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:02:17.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:17 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:02:17.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:17 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:02:17.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:17 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:17.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:17 smithi183 ceph-mon[22097]: osdmap e39: 6 total, 6 up, 6 in 2024-08-18T22:02:17.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:17 smithi123 ceph-mon[18462]: Detected new or changed devices on smithi183 2024-08-18T22:02:17.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:17 smithi123 ceph-mon[18462]: Adjusting osd_memory_target on smithi183 to 8544M 2024-08-18T22:02:17.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:17 smithi123 ceph-mon[18462]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:02:17.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:17 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:02:17.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:17 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:02:17.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:17 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:17.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:17 smithi123 ceph-mon[18462]: osdmap e39: 6 total, 6 up, 6 in 2024-08-18T22:02:17.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:17 smithi130 ceph-mon[21698]: Detected new or changed devices on smithi183 2024-08-18T22:02:17.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:17 smithi130 ceph-mon[21698]: Adjusting osd_memory_target on smithi183 to 8544M 2024-08-18T22:02:17.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:17 smithi130 ceph-mon[21698]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:02:17.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:17 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:02:17.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:17 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:02:17.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:17 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:17.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:17 smithi130 ceph-mon[21698]: osdmap e39: 6 total, 6 up, 6 in 2024-08-18T22:02:18.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:18 smithi183 ceph-mon[22097]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:18.665 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:18 smithi130 ceph-mon[21698]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:18.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:18 smithi123 ceph-mon[18462]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:19.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:19 smithi183 ceph-mon[22097]: osdmap e40: 6 total, 6 up, 6 in 2024-08-18T22:02:19.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:19 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1723305692' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4de09e6b-76c9-4dbf-99ee-b7a876b245b7"}]: dispatch 2024-08-18T22:02:19.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:19 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1723305692' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4de09e6b-76c9-4dbf-99ee-b7a876b245b7"}]': finished 2024-08-18T22:02:19.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:19 smithi183 ceph-mon[22097]: osdmap e41: 7 total, 6 up, 7 in 2024-08-18T22:02:19.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:19 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:19.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:19 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3703568924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:02:19.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:19 smithi123 ceph-mon[18462]: osdmap e40: 6 total, 6 up, 6 in 2024-08-18T22:02:19.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:19 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1723305692' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4de09e6b-76c9-4dbf-99ee-b7a876b245b7"}]: dispatch 2024-08-18T22:02:19.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:19 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1723305692' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4de09e6b-76c9-4dbf-99ee-b7a876b245b7"}]': finished 2024-08-18T22:02:19.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:19 smithi123 ceph-mon[18462]: osdmap e41: 7 total, 6 up, 7 in 2024-08-18T22:02:19.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:19 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:19.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:19 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3703568924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:02:19.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:19 smithi130 ceph-mon[21698]: osdmap e40: 6 total, 6 up, 6 in 2024-08-18T22:02:19.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:19 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1723305692' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4de09e6b-76c9-4dbf-99ee-b7a876b245b7"}]: dispatch 2024-08-18T22:02:19.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:19 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1723305692' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4de09e6b-76c9-4dbf-99ee-b7a876b245b7"}]': finished 2024-08-18T22:02:19.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:19 smithi130 ceph-mon[21698]: osdmap e41: 7 total, 6 up, 7 in 2024-08-18T22:02:19.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:19 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:19.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:19 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3703568924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:02:20.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:20 smithi183 ceph-mon[22097]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-18T22:02:20.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:20 smithi123 ceph-mon[18462]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-18T22:02:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:20 smithi130 ceph-mon[21698]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-18T22:02:22.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:22 smithi123 ceph-mon[18462]: pgmap v127: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-08-18T22:02:22.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:22 smithi183 ceph-mon[22097]: pgmap v127: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-08-18T22:02:22.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:22 smithi130 ceph-mon[21698]: pgmap v127: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-08-18T22:02:24.658 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:24 smithi123 ceph-mon[18462]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-08-18T22:02:24.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:24 smithi183 ceph-mon[22097]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-08-18T22:02:24.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:24 smithi130 ceph-mon[21698]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-08-18T22:02:26.534 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:26 smithi123 ceph-mon[18462]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-18T22:02:26.534 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:26 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-08-18T22:02:26.534 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:26 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:26.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:26 smithi183 ceph-mon[22097]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-18T22:02:26.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:26 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-08-18T22:02:26.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:26 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:26 smithi130 ceph-mon[21698]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-18T22:02:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:26 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-08-18T22:02:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:26 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:27.613 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:27 smithi123 ceph-mon[18462]: Deploying daemon osd.6 on smithi123 2024-08-18T22:02:27.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:27 smithi183 ceph-mon[22097]: Deploying daemon osd.6 on smithi123 2024-08-18T22:02:27.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:27 smithi130 ceph-mon[21698]: Deploying daemon osd.6 on smithi123 2024-08-18T22:02:28.508 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:28 smithi123 ceph-mon[18462]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-08-18T22:02:28.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:28 smithi183 ceph-mon[22097]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-08-18T22:02:28.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:28 smithi130 ceph-mon[21698]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-08-18T22:02:30.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:30 smithi123 ceph-mon[18462]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:30.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:30 smithi183 ceph-mon[22097]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:30.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:30 smithi130 ceph-mon[21698]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:31.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:31.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:31.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:31.707 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:31.708 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:31.708 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:31.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:31.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:31.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:32.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:32 smithi123 ceph-mon[18462]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:32.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:32 smithi183 ceph-mon[22097]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:32.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:32 smithi130 ceph-mon[21698]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:34.393 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 6 on host 'smithi123' 2024-08-18T22:02:34.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:34.392+0000 7f13977fe640 1 -- 172.21.15.123:0/3515463555 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f13a0062360 con 0x7f138c0a2c30 2024-08-18T22:02:34.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:34.394+0000 7f13a83a6640 1 -- 172.21.15.123:0/3515463555 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f138c0a2c30 msgr2=0x7f138c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:02:34.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:34.394+0000 7f13a83a6640 1 --2- 172.21.15.123:0/3515463555 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f138c0a2c30 0x7f138c0a50f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1390005fd0 tx=0x7f1390005850 comp rx=0 tx=0).stop 2024-08-18T22:02:34.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:34.394+0000 7f13a83a6640 1 -- 172.21.15.123:0/3515463555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13a0074870 msgr2=0x7f13a0199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:02:34.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:34.394+0000 7f13a83a6640 1 --2- 172.21.15.123:0/3515463555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13a0074870 0x7f13a0199dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f139c00d950 tx=0x7f139c00de10 comp rx=0 tx=0).stop 2024-08-18T22:02:34.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:34.394+0000 7f13a83a6640 1 -- 172.21.15.123:0/3515463555 shutdown_connections 2024-08-18T22:02:34.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:34.394+0000 7f13a83a6640 1 --2- 172.21.15.123:0/3515463555 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f138c0a2c30 0x7f138c0a50f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:34.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:34.394+0000 7f13a83a6640 1 --2- 172.21.15.123:0/3515463555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a01097c0 0x7f13a01a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:34.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:34.394+0000 7f13a83a6640 1 --2- 172.21.15.123:0/3515463555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13a0075ed0 0x7f13a019a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:34.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:34.394+0000 7f13a83a6640 1 --2- 172.21.15.123:0/3515463555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13a0074870 0x7f13a0199dc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:34.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:34.394+0000 7f13a83a6640 1 -- 172.21.15.123:0/3515463555 >> 172.21.15.123:0/3515463555 conn(0x7f13a00fd0e0 msgr2=0x7f13a01057a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:02:34.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:34.394+0000 7f13a83a6640 1 -- 172.21.15.123:0/3515463555 shutdown_connections 2024-08-18T22:02:34.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:02:34.394+0000 7f13a83a6640 1 -- 172.21.15.123:0/3515463555 wait complete. 2024-08-18T22:02:34.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:34 smithi183 ceph-mon[22097]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:34.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:34 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:34.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:34 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:34.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:34 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:34.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:34 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:02:34.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:34 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:34.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:34 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:34.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:34 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:34.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:34 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:34.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:34 smithi123 ceph-mon[18462]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:34.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:34 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:34.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:34 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:34.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:34 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:34.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:34 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:02:34.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:34 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:34.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:34 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:34.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:34 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:34.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:34 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:34 smithi130 ceph-mon[21698]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:34 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:34 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:34 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:34 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:02:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:34 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:34 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:34 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:34 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:35.087 DEBUG:teuthology.orchestra.run.smithi123:osd.6> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.6.service 2024-08-18T22:02:35.089 INFO:tasks.cephadm:Deploying osd.7 on smithi130 with /dev/vg_nvme/lv_2... 2024-08-18T22:02:35.089 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-18T22:02:35.353 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.b/config 2024-08-18T22:02:35.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:35 smithi183 ceph-mon[22097]: from='osd.6 [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-08-18T22:02:35.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:35 smithi130 ceph-mon[21698]: from='osd.6 [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-08-18T22:02:35.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:35 smithi123 ceph-mon[18462]: from='osd.6 [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-08-18T22:02:36.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:36 smithi123 ceph-mon[18462]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:36.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:36 smithi123 ceph-mon[18462]: from='osd.6 [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-18T22:02:36.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:36 smithi123 ceph-mon[18462]: osdmap e42: 7 total, 6 up, 7 in 2024-08-18T22:02:36.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:36 smithi123 ceph-mon[18462]: from='osd.6 [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-08-18T22:02:36.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:36 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:36.511 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:02:36 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:02:36.415+0000 7f11e99c6640 -1 osd.6 0 waiting for initial osdmap 2024-08-18T22:02:36.511 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:02:36 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:02:36.422+0000 7f11e57ee640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:02:36.633 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:36 smithi130 ceph-mon[21698]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:36.633 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:36 smithi130 ceph-mon[21698]: from='osd.6 [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-18T22:02:36.633 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:36 smithi130 ceph-mon[21698]: osdmap e42: 7 total, 6 up, 7 in 2024-08-18T22:02:36.633 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:36 smithi130 ceph-mon[21698]: from='osd.6 [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-08-18T22:02:36.633 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:36 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:36.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:36 smithi183 ceph-mon[22097]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:36.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:36 smithi183 ceph-mon[22097]: from='osd.6 [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-18T22:02:36.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:36 smithi183 ceph-mon[22097]: osdmap e42: 7 total, 6 up, 7 in 2024-08-18T22:02:36.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:36 smithi183 ceph-mon[22097]: from='osd.6 [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-08-18T22:02:36.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:36 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:37.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:37 smithi123 ceph-mon[18462]: from='osd.6 [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-08-18T22:02:37.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:37 smithi123 ceph-mon[18462]: osdmap e43: 7 total, 6 up, 7 in 2024-08-18T22:02:37.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:37 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:37.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:37 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:37.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:37 smithi130 ceph-mon[21698]: from='osd.6 [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-08-18T22:02:37.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:37 smithi130 ceph-mon[21698]: osdmap e43: 7 total, 6 up, 7 in 2024-08-18T22:02:37.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:37 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:37.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:37 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:37.791 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T22:02:37.817 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_2 2024-08-18T22:02:37.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:37 smithi183 ceph-mon[22097]: from='osd.6 [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-08-18T22:02:37.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:37 smithi183 ceph-mon[22097]: osdmap e43: 7 total, 6 up, 7 in 2024-08-18T22:02:37.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:37 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:37.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:37 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:38.071 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.b/config 2024-08-18T22:02:38.485 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: purged_snaps scrub starts 2024-08-18T22:02:38.485 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: purged_snaps scrub ok 2024-08-18T22:02:38.485 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:38.485 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:38.485 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: osd.6 [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973] boot 2024-08-18T22:02:38.485 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: osdmap e44: 7 total, 7 up, 7 in 2024-08-18T22:02:38.485 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:38.485 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:38.485 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:38.485 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:02:38.485 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:02:38.485 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:02:38.486 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:38.486 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:38.486 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:02:38.486 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:38.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.566+0000 7f769473a640 1 -- 172.21.15.130:0/2075327869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f768c102b30 msgr2=0x7f768c102fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:02:38.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.566+0000 7f769473a640 1 --2- 172.21.15.130:0/2075327869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f768c102b30 0x7f768c102fb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f767c009900 tx=0x7f767c02a410 comp rx=0 tx=0).stop 2024-08-18T22:02:38.593 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.566+0000 7f769473a640 1 -- 172.21.15.130:0/2075327869 shutdown_connections 2024-08-18T22:02:38.593 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.566+0000 7f769473a640 1 --2- 172.21.15.130:0/2075327869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f768c1034f0 0x7f768c109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:38.593 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.566+0000 7f769473a640 1 --2- 172.21.15.130:0/2075327869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f768c102b30 0x7f768c102fb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:38.593 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.566+0000 7f769473a640 1 --2- 172.21.15.130:0/2075327869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f768c101930 0x7f768c101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:38.593 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.566+0000 7f769473a640 1 -- 172.21.15.130:0/2075327869 >> 172.21.15.130:0/2075327869 conn(0x7f768c0fd0c0 msgr2=0x7f768c0ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:02:38.593 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.566+0000 7f769473a640 1 -- 172.21.15.130:0/2075327869 shutdown_connections 2024-08-18T22:02:38.593 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.566+0000 7f769473a640 1 -- 172.21.15.130:0/2075327869 wait complete. 2024-08-18T22:02:38.593 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f769473a640 1 Processor -- start 2024-08-18T22:02:38.593 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f769473a640 1 -- start start 2024-08-18T22:02:38.593 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f769473a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f768c101930 0x7f768c197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:02:38.593 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f769473a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f768c102b30 0x7f768c1980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:02:38.593 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f769473a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f768c1034f0 0x7f768c19f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:02:38.593 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f769473a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f768c10d5e0 con 0x7f768c101930 2024-08-18T22:02:38.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f769473a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f768c10d460 con 0x7f768c1034f0 2024-08-18T22:02:38.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f769473a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f768c10d760 con 0x7f768c102b30 2024-08-18T22:02:38.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f7692cd7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f768c1034f0 0x7f768c19f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:02:38.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f7692cd7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f768c1034f0 0x7f768c19f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34976/0 (socket says 172.21.15.130:34976) 2024-08-18T22:02:38.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f7692cd7640 1 -- 172.21.15.130:0/1679325515 learned_addr learned my addr 172.21.15.130:0/1679325515 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-08-18T22:02:38.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f76924d6640 1 --2- 172.21.15.130:0/1679325515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f768c101930 0x7f768c197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:02:38.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f7691cd5640 1 --2- 172.21.15.130:0/1679325515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f768c102b30 0x7f768c1980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:02:38.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f7692cd7640 1 -- 172.21.15.130:0/1679325515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f768c102b30 msgr2=0x7f768c1980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:02:38.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f7692cd7640 1 --2- 172.21.15.130:0/1679325515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f768c102b30 0x7f768c1980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:38.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f7692cd7640 1 -- 172.21.15.130:0/1679325515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f768c101930 msgr2=0x7f768c197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:02:38.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f7692cd7640 1 --2- 172.21.15.130:0/1679325515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f768c101930 0x7f768c197bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.567+0000 7f7692cd7640 1 -- 172.21.15.130:0/1679325515 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768c19f7e0 con 0x7f768c1034f0 2024-08-18T22:02:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.568+0000 7f7692cd7640 1 --2- 172.21.15.130:0/1679325515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f768c1034f0 0x7f768c19f170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f768400cad0 tx=0x7f768400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:02:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.568+0000 7f76837fe640 1 -- 172.21.15.130:0/1679325515 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768400ae20 con 0x7f768c1034f0 2024-08-18T22:02:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.568+0000 7f76837fe640 1 -- 172.21.15.130:0/1679325515 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7684005020 con 0x7f768c1034f0 2024-08-18T22:02:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.568+0000 7f769473a640 1 -- 172.21.15.130:0/1679325515 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f768c19fad0 con 0x7f768c1034f0 2024-08-18T22:02:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.568+0000 7f76837fe640 1 -- 172.21.15.130:0/1679325515 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768400f6f0 con 0x7f768c1034f0 2024-08-18T22:02:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.568+0000 7f769473a640 1 -- 172.21.15.130:0/1679325515 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f768c19ffe0 con 0x7f768c1034f0 2024-08-18T22:02:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.569+0000 7f769473a640 1 -- 172.21.15.130:0/1679325515 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f768c108c60 con 0x7f768c1034f0 2024-08-18T22:02:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.570+0000 7f76837fe640 1 -- 172.21.15.130:0/1679325515 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f76840051d0 con 0x7f768c1034f0 2024-08-18T22:02:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.571+0000 7f76837fe640 1 --2- 172.21.15.130:0/1679325515 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f76780a2c30 0x7f76780a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:02:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.571+0000 7f76837fe640 1 -- 172.21.15.130:0/1679325515 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7f76840ce6c0 con 0x7f768c1034f0 2024-08-18T22:02:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.571+0000 7f76924d6640 1 --2- 172.21.15.130:0/1679325515 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f76780a2c30 0x7f76780a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:02:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.571+0000 7f76924d6640 1 --2- 172.21.15.130:0/1679325515 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f76780a2c30 0x7f76780a50f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f768c102990 tx=0x7f7688005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:02:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.574+0000 7f76837fe640 1 -- 172.21.15.130:0/1679325515 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7684014030 con 0x7f768c1034f0 2024-08-18T22:02:38.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:38.750+0000 7f769473a640 1 -- 172.21.15.130:0/1679325515 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f768c062360 con 0x7f76780a2c30 2024-08-18T22:02:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: purged_snaps scrub starts 2024-08-18T22:02:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: purged_snaps scrub ok 2024-08-18T22:02:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: osd.6 [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973] boot 2024-08-18T22:02:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: osdmap e44: 7 total, 7 up, 7 in 2024-08-18T22:02:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:38.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:38.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:02:38.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:02:38.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:02:38.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:38.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:38.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:02:38.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:38.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: purged_snaps scrub starts 2024-08-18T22:02:38.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: purged_snaps scrub ok 2024-08-18T22:02:38.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:02:38.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:38.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: osd.6 [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973] boot 2024-08-18T22:02:38.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: osdmap e44: 7 total, 7 up, 7 in 2024-08-18T22:02:38.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-18T22:02:38.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:38.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:38.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:02:38.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:02:38.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:02:38.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:38.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:38.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:02:38.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:39.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:39 smithi123 ceph-mon[18462]: Detected new or changed devices on smithi123 2024-08-18T22:02:39.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:39 smithi123 ceph-mon[18462]: Adjusting osd_memory_target on smithi123 to 5696M 2024-08-18T22:02:39.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:39 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:02:39.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:39 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:02:39.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:39 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:39.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:39 smithi123 ceph-mon[18462]: osdmap e45: 7 total, 7 up, 7 in 2024-08-18T22:02:39.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:39 smithi130 ceph-mon[21698]: Detected new or changed devices on smithi123 2024-08-18T22:02:39.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:39 smithi130 ceph-mon[21698]: Adjusting osd_memory_target on smithi123 to 5696M 2024-08-18T22:02:39.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:39 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:02:39.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:39 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:02:39.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:39 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:39.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:39 smithi130 ceph-mon[21698]: osdmap e45: 7 total, 7 up, 7 in 2024-08-18T22:02:39.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:39 smithi183 ceph-mon[22097]: Detected new or changed devices on smithi123 2024-08-18T22:02:39.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:39 smithi183 ceph-mon[22097]: Adjusting osd_memory_target on smithi123 to 5696M 2024-08-18T22:02:39.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:39 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:02:39.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:39 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:02:39.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:39 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:39.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:39 smithi183 ceph-mon[22097]: osdmap e45: 7 total, 7 up, 7 in 2024-08-18T22:02:40.685 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:40 smithi130 ceph-mon[21698]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:02:40.686 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:40 smithi130 ceph-mon[21698]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:40.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:40 smithi123 ceph-mon[18462]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:02:40.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:40 smithi123 ceph-mon[18462]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:40.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:40 smithi183 ceph-mon[22097]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:02:40.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:40 smithi183 ceph-mon[22097]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:41.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:41 smithi130 ceph-mon[21698]: from='client.? 172.21.15.130:0/366126226' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe0b1bb-066d-4cd2-8089-b7719769d0da"}]: dispatch 2024-08-18T22:02:41.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:41 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe0b1bb-066d-4cd2-8089-b7719769d0da"}]: dispatch 2024-08-18T22:02:41.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:41 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfe0b1bb-066d-4cd2-8089-b7719769d0da"}]': finished 2024-08-18T22:02:41.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:41 smithi130 ceph-mon[21698]: osdmap e46: 8 total, 7 up, 8 in 2024-08-18T22:02:41.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:41 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-18T22:02:41.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:41 smithi123 ceph-mon[18462]: from='client.? 172.21.15.130:0/366126226' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe0b1bb-066d-4cd2-8089-b7719769d0da"}]: dispatch 2024-08-18T22:02:41.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:41 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe0b1bb-066d-4cd2-8089-b7719769d0da"}]: dispatch 2024-08-18T22:02:41.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:41 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfe0b1bb-066d-4cd2-8089-b7719769d0da"}]': finished 2024-08-18T22:02:41.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:41 smithi123 ceph-mon[18462]: osdmap e46: 8 total, 7 up, 8 in 2024-08-18T22:02:41.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:41 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-18T22:02:41.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:41 smithi183 ceph-mon[22097]: from='client.? 172.21.15.130:0/366126226' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe0b1bb-066d-4cd2-8089-b7719769d0da"}]: dispatch 2024-08-18T22:02:41.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:41 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe0b1bb-066d-4cd2-8089-b7719769d0da"}]: dispatch 2024-08-18T22:02:41.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:41 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfe0b1bb-066d-4cd2-8089-b7719769d0da"}]': finished 2024-08-18T22:02:41.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:41 smithi183 ceph-mon[22097]: osdmap e46: 8 total, 7 up, 8 in 2024-08-18T22:02:41.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:41 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-18T22:02:42.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:42 smithi123 ceph-mon[18462]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:42.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:42 smithi123 ceph-mon[18462]: from='client.? 172.21.15.130:0/481341774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:02:42.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:42 smithi130 ceph-mon[21698]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:42.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:42 smithi130 ceph-mon[21698]: from='client.? 172.21.15.130:0/481341774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:02:42.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:42 smithi183 ceph-mon[22097]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:42.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:42 smithi183 ceph-mon[22097]: from='client.? 172.21.15.130:0/481341774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:02:44.693 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:44 smithi130 ceph-mon[21698]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:44.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:44 smithi123 ceph-mon[18462]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:44.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:44 smithi183 ceph-mon[22097]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:46.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:46 smithi123 ceph-mon[18462]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:46.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:46 smithi130 ceph-mon[21698]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:46.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:46 smithi183 ceph-mon[22097]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:48.670 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:48 smithi130 ceph-mon[21698]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:48.670 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-08-18T22:02:48.670 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:48 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:48.711 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:48 smithi183 ceph-mon[22097]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:48.711 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-08-18T22:02:48.711 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:48 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:48.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:48 smithi123 ceph-mon[18462]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:48.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-08-18T22:02:48.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:48 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:49.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:49 smithi130 ceph-mon[21698]: Deploying daemon osd.7 on smithi130 2024-08-18T22:02:49.726 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:49 smithi183 ceph-mon[22097]: Deploying daemon osd.7 on smithi130 2024-08-18T22:02:49.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:49 smithi123 ceph-mon[18462]: Deploying daemon osd.7 on smithi130 2024-08-18T22:02:50.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:50 smithi123 ceph-mon[18462]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:50.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:50 smithi130 ceph-mon[21698]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:50.891 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:50 smithi183 ceph-mon[22097]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:52.692 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:52 smithi130 ceph-mon[21698]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:52.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:52 smithi123 ceph-mon[18462]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:52.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:52 smithi183 ceph-mon[22097]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:53.717 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:53.717 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:53.718 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:53.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:53.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:53.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:53.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:53.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:53.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:54.718 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:54 smithi130 ceph-mon[21698]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:54.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:54 smithi123 ceph-mon[18462]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:54.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:54 smithi183 ceph-mon[22097]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:56.645 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:56 smithi130 ceph-mon[21698]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:56.646 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:56 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:56.646 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:56 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:56.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:56 smithi123 ceph-mon[18462]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:56.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:56 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:56.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:56 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:56.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:56 smithi183 ceph-mon[22097]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:56.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:56 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:56.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:56 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:57.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:57.002+0000 7f76837fe640 1 -- 172.21.15.130:0/1679325515 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f768c062360 con 0x7f76780a2c30 2024-08-18T22:02:57.003 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 7 on host 'smithi130' 2024-08-18T22:02:57.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:57.004+0000 7f769473a640 1 -- 172.21.15.130:0/1679325515 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f76780a2c30 msgr2=0x7f76780a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:02:57.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:57.004+0000 7f769473a640 1 --2- 172.21.15.130:0/1679325515 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f76780a2c30 0x7f76780a50f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f768c102990 tx=0x7f7688005f90 comp rx=0 tx=0).stop 2024-08-18T22:02:57.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:57.004+0000 7f769473a640 1 -- 172.21.15.130:0/1679325515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f768c1034f0 msgr2=0x7f768c19f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:02:57.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:57.004+0000 7f769473a640 1 --2- 172.21.15.130:0/1679325515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f768c1034f0 0x7f768c19f170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f768400cad0 tx=0x7f768400cf90 comp rx=0 tx=0).stop 2024-08-18T22:02:57.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:57.004+0000 7f769473a640 1 -- 172.21.15.130:0/1679325515 shutdown_connections 2024-08-18T22:02:57.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:57.004+0000 7f769473a640 1 --2- 172.21.15.130:0/1679325515 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f76780a2c30 0x7f76780a50f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:57.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:57.004+0000 7f769473a640 1 --2- 172.21.15.130:0/1679325515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f768c1034f0 0x7f768c19f170 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:57.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:57.004+0000 7f769473a640 1 --2- 172.21.15.130:0/1679325515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f768c102b30 0x7f768c1980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:57.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:57.004+0000 7f769473a640 1 --2- 172.21.15.130:0/1679325515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f768c101930 0x7f768c197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:02:57.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:57.004+0000 7f769473a640 1 -- 172.21.15.130:0/1679325515 >> 172.21.15.130:0/1679325515 conn(0x7f768c0fd0c0 msgr2=0x7f768c105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:02:57.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:57.004+0000 7f769473a640 1 -- 172.21.15.130:0/1679325515 shutdown_connections 2024-08-18T22:02:57.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:02:57.004+0000 7f769473a640 1 -- 172.21.15.130:0/1679325515 wait complete. 2024-08-18T22:02:57.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:57 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:57.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:57 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:02:57.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:57 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:57.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:57 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:57.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:57 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:57.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:57 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:57.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:57 smithi130 ceph-mon[21698]: from='osd.7 [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-18T22:02:57.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:57 smithi130 ceph-mon[21698]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-18T22:02:57.609 DEBUG:teuthology.orchestra.run.smithi130:osd.7> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.7.service 2024-08-18T22:02:57.612 INFO:tasks.cephadm:Deploying osd.8 on smithi183 with /dev/vg_nvme/lv_2... 2024-08-18T22:02:57.612 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-18T22:02:57.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:57 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:57.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:57 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:02:57.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:57 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:57.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:57 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:57.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:57 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:57.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:57 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:57.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:57 smithi123 ceph-mon[18462]: from='osd.7 [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-18T22:02:57.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:57 smithi123 ceph-mon[18462]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-18T22:02:57.871 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T22:02:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:57 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:02:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:57 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:02:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:57 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:57 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:02:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:57 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:57 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:02:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:57 smithi183 ceph-mon[22097]: from='osd.7 [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-18T22:02:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:57 smithi183 ceph-mon[22097]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-18T22:02:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:58 smithi183 ceph-mon[22097]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:58 smithi183 ceph-mon[22097]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-18T22:02:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:58 smithi183 ceph-mon[22097]: osdmap e47: 8 total, 7 up, 8 in 2024-08-18T22:02:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-18T22:02:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:58 smithi183 ceph-mon[22097]: from='osd.7 [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:02:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:02:58 smithi183 ceph-mon[22097]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:02:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:58 smithi123 ceph-mon[18462]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:58 smithi123 ceph-mon[18462]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-18T22:02:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:58 smithi123 ceph-mon[18462]: osdmap e47: 8 total, 7 up, 8 in 2024-08-18T22:02:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-18T22:02:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:58 smithi123 ceph-mon[18462]: from='osd.7 [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:02:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:02:58 smithi123 ceph-mon[18462]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:02:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:58 smithi130 ceph-mon[21698]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:02:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:58 smithi130 ceph-mon[21698]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-18T22:02:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:58 smithi130 ceph-mon[21698]: osdmap e47: 8 total, 7 up, 8 in 2024-08-18T22:02:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-18T22:02:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:58 smithi130 ceph-mon[21698]: from='osd.7 [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:02:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:02:58 smithi130 ceph-mon[21698]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:03:00.007 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:02:59 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:02:59.742+0000 7f1b3c80e640 -1 osd.7 0 waiting for initial osdmap 2024-08-18T22:03:00.008 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:02:59 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:02:59.750+0000 7f1b3462e640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:03:00.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:00 smithi123 ceph-mon[18462]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-18T22:03:00.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:00 smithi123 ceph-mon[18462]: osdmap e48: 8 total, 7 up, 8 in 2024-08-18T22:03:00.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:00 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-18T22:03:00.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:00 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-18T22:03:00.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:00 smithi123 ceph-mon[18462]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:03:00.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:00 smithi123 ceph-mon[18462]: from='osd.7 ' entity='osd.7' 2024-08-18T22:03:00.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:00 smithi123 ceph-mon[18462]: osd.7 [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957] boot 2024-08-18T22:03:00.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:00 smithi123 ceph-mon[18462]: osdmap e49: 8 total, 8 up, 8 in 2024-08-18T22:03:00.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:00 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-18T22:03:00.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:00 smithi130 ceph-mon[21698]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-18T22:03:00.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:00 smithi130 ceph-mon[21698]: osdmap e48: 8 total, 7 up, 8 in 2024-08-18T22:03:00.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:00 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-18T22:03:00.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:00 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-18T22:03:00.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:00 smithi130 ceph-mon[21698]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:03:00.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:00 smithi130 ceph-mon[21698]: from='osd.7 ' entity='osd.7' 2024-08-18T22:03:00.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:00 smithi130 ceph-mon[21698]: osd.7 [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957] boot 2024-08-18T22:03:00.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:00 smithi130 ceph-mon[21698]: osdmap e49: 8 total, 8 up, 8 in 2024-08-18T22:03:00.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:00 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-18T22:03:00.396 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:00 smithi183 ceph-mon[22097]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-18T22:03:00.397 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:00 smithi183 ceph-mon[22097]: osdmap e48: 8 total, 7 up, 8 in 2024-08-18T22:03:00.397 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:00 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-18T22:03:00.397 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:00 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-18T22:03:00.397 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:00 smithi183 ceph-mon[22097]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-18T22:03:00.397 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:00 smithi183 ceph-mon[22097]: from='osd.7 ' entity='osd.7' 2024-08-18T22:03:00.397 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:00 smithi183 ceph-mon[22097]: osd.7 [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957] boot 2024-08-18T22:03:00.397 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:00 smithi183 ceph-mon[22097]: osdmap e49: 8 total, 8 up, 8 in 2024-08-18T22:03:00.397 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:00 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-18T22:03:00.407 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T22:03:00.433 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_2 2024-08-18T22:03:00.698 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T22:03:01.066 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:01 smithi183 ceph-mon[22097]: purged_snaps scrub starts 2024-08-18T22:03:01.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:01 smithi183 ceph-mon[22097]: purged_snaps scrub ok 2024-08-18T22:03:01.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:01 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:01.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:01 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:01.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:01 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:01.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:01 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:01.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:01 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:01.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:01 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:01.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:01 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:01.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:01 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:03:01.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:01 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:01.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:01 smithi183 ceph-mon[22097]: osdmap e50: 8 total, 8 up, 8 in 2024-08-18T22:03:01.158 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.150+0000 7f5aaf1c0640 1 -- 172.21.15.183:0/3018953782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa8100800 msgr2=0x7f5aa8100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:03:01.158 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.150+0000 7f5aaf1c0640 1 --2- 172.21.15.183:0/3018953782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa8100800 0x7f5aa8100c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c009900 tx=0x7f5a9c02a410 comp rx=0 tx=0).stop 2024-08-18T22:03:01.158 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.150+0000 7f5aaf1c0640 1 -- 172.21.15.183:0/3018953782 shutdown_connections 2024-08-18T22:03:01.158 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.150+0000 7f5aaf1c0640 1 --2- 172.21.15.183:0/3018953782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5aa81023c0 0x7f5aa8108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:01.158 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.150+0000 7f5aaf1c0640 1 --2- 172.21.15.183:0/3018953782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5aa8101a00 0x7f5aa8101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:01.158 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.150+0000 7f5aaf1c0640 1 --2- 172.21.15.183:0/3018953782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa8100800 0x7f5aa8100c00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:01.158 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.150+0000 7f5aaf1c0640 1 -- 172.21.15.183:0/3018953782 >> 172.21.15.183:0/3018953782 conn(0x7f5aa80fbfb0 msgr2=0x7f5aa80fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:03:01.158 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.150+0000 7f5aaf1c0640 1 -- 172.21.15.183:0/3018953782 shutdown_connections 2024-08-18T22:03:01.158 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.150+0000 7f5aaf1c0640 1 -- 172.21.15.183:0/3018953782 wait complete. 2024-08-18T22:03:01.158 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.150+0000 7f5aaf1c0640 1 Processor -- start 2024-08-18T22:03:01.159 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.150+0000 7f5aaf1c0640 1 -- start start 2024-08-18T22:03:01.159 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aaf1c0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5aa8100800 0x7f5aa8104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:03:01.159 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aaf1c0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa8101a00 0x7f5aa8102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:03:01.159 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aaf1c0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5aa81023c0 0x7f5aa8103320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:03:01.159 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aaf1c0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa810c500 con 0x7f5aa8100800 2024-08-18T22:03:01.159 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aaf1c0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa810c380 con 0x7f5aa81023c0 2024-08-18T22:03:01.159 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aaf1c0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa810c680 con 0x7f5aa8101a00 2024-08-18T22:03:01.159 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aa7fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa8101a00 0x7f5aa8102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:03:01.159 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aa7fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa8101a00 0x7f5aa8102de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:41782/0 (socket says 172.21.15.183:41782) 2024-08-18T22:03:01.159 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aa7fff640 1 -- 172.21.15.183:0/1778901506 learned_addr learned my addr 172.21.15.183:0/1778901506 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-08-18T22:03:01.159 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aad75d640 1 --2- 172.21.15.183:0/1778901506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5aa81023c0 0x7f5aa8103320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:03:01.159 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aa7fff640 1 -- 172.21.15.183:0/1778901506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5aa81023c0 msgr2=0x7f5aa8103320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:03:01.160 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aa7fff640 1 --2- 172.21.15.183:0/1778901506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5aa81023c0 0x7f5aa8103320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:01.160 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aa7fff640 1 -- 172.21.15.183:0/1778901506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5aa8100800 msgr2=0x7f5aa8104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:03:01.160 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aa7fff640 1 --2- 172.21.15.183:0/1778901506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5aa8100800 0x7f5aa8104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:01.160 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aa7fff640 1 -- 172.21.15.183:0/1778901506 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa8103be0 con 0x7f5aa8101a00 2024-08-18T22:03:01.160 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aa7fff640 1 --2- 172.21.15.183:0/1778901506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa8101a00 0x7f5aa8102de0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400e9f0 tx=0x7f5a9400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:03:01.160 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aa5ffb640 1 -- 172.21.15.183:0/1778901506 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9400cd80 con 0x7f5aa8101a00 2024-08-18T22:03:01.160 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aa5ffb640 1 -- 172.21.15.183:0/1778901506 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a94005500 con 0x7f5aa8101a00 2024-08-18T22:03:01.160 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aaf1c0640 1 -- 172.21.15.183:0/1778901506 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa81a1e50 con 0x7f5aa8101a00 2024-08-18T22:03:01.160 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.151+0000 7f5aa5ffb640 1 -- 172.21.15.183:0/1778901506 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a94010690 con 0x7f5aa8101a00 2024-08-18T22:03:01.160 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.152+0000 7f5aaf1c0640 1 -- 172.21.15.183:0/1778901506 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aa81a2330 con 0x7f5aa8101a00 2024-08-18T22:03:01.160 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.153+0000 7f5aaf1c0640 1 -- 172.21.15.183:0/1778901506 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aa81a25c0 con 0x7f5aa8101a00 2024-08-18T22:03:01.160 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.154+0000 7f5aa5ffb640 1 -- 172.21.15.183:0/1778901506 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5a940046c0 con 0x7f5aa8101a00 2024-08-18T22:03:01.160 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.154+0000 7f5aa5ffb640 1 --2- 172.21.15.183:0/1778901506 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a980a2b80 0x7f5a980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:03:01.161 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.155+0000 7f5aa5ffb640 1 -- 172.21.15.183:0/1778901506 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5426+0+0 (secure 0 0 0) 0x7f5a940cea40 con 0x7f5aa8101a00 2024-08-18T22:03:01.161 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.155+0000 7f5aacf5c640 1 --2- 172.21.15.183:0/1778901506 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a980a2b80 0x7f5a980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:03:01.161 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.155+0000 7f5aacf5c640 1 --2- 172.21.15.183:0/1778901506 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a980a2b80 0x7f5a980a5040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0096c0 tx=0x7f5a9c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:03:01.161 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.159+0000 7f5aa5ffb640 1 -- 172.21.15.183:0/1778901506 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5a9409c4e0 con 0x7f5aa8101a00 2024-08-18T22:03:01.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:01 smithi130 ceph-mon[21698]: purged_snaps scrub starts 2024-08-18T22:03:01.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:01 smithi130 ceph-mon[21698]: purged_snaps scrub ok 2024-08-18T22:03:01.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:01 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:01.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:01 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:01.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:01 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:01.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:01 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:01.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:01 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:01.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:01 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:01.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:01 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:01.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:01 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:03:01.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:01 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:01.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:01 smithi130 ceph-mon[21698]: osdmap e50: 8 total, 8 up, 8 in 2024-08-18T22:03:01.339 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:01.338+0000 7f5aaf1c0640 1 -- 172.21.15.183:0/1778901506 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5aa81a2790 con 0x7f5a980a2b80 2024-08-18T22:03:01.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:01 smithi123 ceph-mon[18462]: purged_snaps scrub starts 2024-08-18T22:03:01.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:01 smithi123 ceph-mon[18462]: purged_snaps scrub ok 2024-08-18T22:03:01.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:01 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:01.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:01 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:01.513 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:01 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:01.513 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:01 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:01.513 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:01 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:01.513 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:01 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:01.513 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:01 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:01.514 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:01 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:03:01.514 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:01 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:01.514 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:01 smithi123 ceph-mon[18462]: osdmap e50: 8 total, 8 up, 8 in 2024-08-18T22:03:02.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:02 smithi183 ceph-mon[22097]: Detected new or changed devices on smithi130 2024-08-18T22:03:02.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:02 smithi183 ceph-mon[22097]: Adjusting osd_memory_target on smithi130 to 5696M 2024-08-18T22:03:02.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:02 smithi183 ceph-mon[22097]: pgmap v156: 1 pgs: 1 remapped; 577 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:02.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:02 smithi183 ceph-mon[22097]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:03:02.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:02 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:03:02.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:02 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:03:02.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:02 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:02.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:02 smithi183 ceph-mon[22097]: osdmap e51: 8 total, 8 up, 8 in 2024-08-18T22:03:02.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:02 smithi123 ceph-mon[18462]: Detected new or changed devices on smithi130 2024-08-18T22:03:02.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:02 smithi123 ceph-mon[18462]: Adjusting osd_memory_target on smithi130 to 5696M 2024-08-18T22:03:02.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:02 smithi123 ceph-mon[18462]: pgmap v156: 1 pgs: 1 remapped; 577 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:02.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:02 smithi123 ceph-mon[18462]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:03:02.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:02 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:03:02.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:02 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:03:02.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:02 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:02.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:02 smithi123 ceph-mon[18462]: osdmap e51: 8 total, 8 up, 8 in 2024-08-18T22:03:02.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:02 smithi130 ceph-mon[21698]: Detected new or changed devices on smithi130 2024-08-18T22:03:02.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:02 smithi130 ceph-mon[21698]: Adjusting osd_memory_target on smithi130 to 5696M 2024-08-18T22:03:02.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:02 smithi130 ceph-mon[21698]: pgmap v156: 1 pgs: 1 remapped; 577 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:02.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:02 smithi130 ceph-mon[21698]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:03:02.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:02 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:03:02.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:02 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:03:02.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:02 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:02.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:02 smithi130 ceph-mon[21698]: osdmap e51: 8 total, 8 up, 8 in 2024-08-18T22:03:04.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:03 smithi123 ceph-mon[18462]: osdmap e52: 8 total, 8 up, 8 in 2024-08-18T22:03:04.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:03 smithi123 ceph-mon[18462]: pgmap v159: 1 pgs: 1 remapped; 577 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:04.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:03 smithi123 ceph-mon[18462]: from='client.? 172.21.15.183:0/3555179416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "457ed7c9-c4ab-4099-b8ef-e628f2a068db"}]: dispatch 2024-08-18T22:03:04.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:03 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "457ed7c9-c4ab-4099-b8ef-e628f2a068db"}]: dispatch 2024-08-18T22:03:04.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:03 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "457ed7c9-c4ab-4099-b8ef-e628f2a068db"}]': finished 2024-08-18T22:03:04.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:03 smithi123 ceph-mon[18462]: osdmap e53: 9 total, 8 up, 9 in 2024-08-18T22:03:04.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:04.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:03 smithi130 ceph-mon[21698]: osdmap e52: 8 total, 8 up, 8 in 2024-08-18T22:03:04.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:03 smithi130 ceph-mon[21698]: pgmap v159: 1 pgs: 1 remapped; 577 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:04.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:03 smithi130 ceph-mon[21698]: from='client.? 172.21.15.183:0/3555179416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "457ed7c9-c4ab-4099-b8ef-e628f2a068db"}]: dispatch 2024-08-18T22:03:04.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:03 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "457ed7c9-c4ab-4099-b8ef-e628f2a068db"}]: dispatch 2024-08-18T22:03:04.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:03 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "457ed7c9-c4ab-4099-b8ef-e628f2a068db"}]': finished 2024-08-18T22:03:04.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:03 smithi130 ceph-mon[21698]: osdmap e53: 9 total, 8 up, 9 in 2024-08-18T22:03:04.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:04.321 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:03 smithi183 ceph-mon[22097]: osdmap e52: 8 total, 8 up, 8 in 2024-08-18T22:03:04.321 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:03 smithi183 ceph-mon[22097]: pgmap v159: 1 pgs: 1 remapped; 577 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:04.321 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:03 smithi183 ceph-mon[22097]: from='client.? 172.21.15.183:0/3555179416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "457ed7c9-c4ab-4099-b8ef-e628f2a068db"}]: dispatch 2024-08-18T22:03:04.321 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:03 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "457ed7c9-c4ab-4099-b8ef-e628f2a068db"}]: dispatch 2024-08-18T22:03:04.321 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:03 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "457ed7c9-c4ab-4099-b8ef-e628f2a068db"}]': finished 2024-08-18T22:03:04.321 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:03 smithi183 ceph-mon[22097]: osdmap e53: 9 total, 8 up, 9 in 2024-08-18T22:03:04.321 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:05.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:04 smithi123 ceph-mon[18462]: from='client.? 172.21.15.183:0/3862276538' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:03:05.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:04 smithi130 ceph-mon[21698]: from='client.? 172.21.15.183:0/3862276538' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:03:05.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:04 smithi183 ceph-mon[22097]: from='client.? 172.21.15.183:0/3862276538' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:03:06.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:05 smithi123 ceph-mon[18462]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:06.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:05 smithi130 ceph-mon[21698]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:06.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:05 smithi183 ceph-mon[22097]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:08.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:08 smithi183 ceph-mon[22097]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:08.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:08 smithi123 ceph-mon[18462]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:08 smithi130 ceph-mon[21698]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:10.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:10 smithi183 ceph-mon[22097]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:10 smithi123 ceph-mon[18462]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:10 smithi130 ceph-mon[21698]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:11.401 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:11 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-08-18T22:03:11.401 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:11 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:11.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:11 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-08-18T22:03:11.810 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:11 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:11.811 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:11 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-08-18T22:03:11.811 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:11 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:12.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:12 smithi183 ceph-mon[22097]: Deploying daemon osd.8 on smithi183 2024-08-18T22:03:12.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:12 smithi183 ceph-mon[22097]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:12 smithi123 ceph-mon[18462]: Deploying daemon osd.8 on smithi183 2024-08-18T22:03:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:12 smithi123 ceph-mon[18462]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:12 smithi130 ceph-mon[21698]: Deploying daemon osd.8 on smithi183 2024-08-18T22:03:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:12 smithi130 ceph-mon[21698]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:14.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:14 smithi183 ceph-mon[22097]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:14.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:14 smithi123 ceph-mon[18462]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:14 smithi130 ceph-mon[21698]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:16.562 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:16 smithi183 ceph-mon[22097]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:16.562 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:03:16.562 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:16.563 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:16 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:16.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:16 smithi123 ceph-mon[18462]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:16.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:03:16.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:16.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:16 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:16.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:16 smithi130 ceph-mon[21698]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:16.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:03:16.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:16.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:16 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:18.614 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:18 smithi183 ceph-mon[22097]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:18.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:18 smithi123 ceph-mon[18462]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:18.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:18 smithi130 ceph-mon[21698]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:19.276 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 8 on host 'smithi183' 2024-08-18T22:03:19.277 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:19.274+0000 7f5aa5ffb640 1 -- 172.21.15.183:0/1778901506 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5aa81a2790 con 0x7f5a980a2b80 2024-08-18T22:03:19.279 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:19.277+0000 7f5aaf1c0640 1 -- 172.21.15.183:0/1778901506 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a980a2b80 msgr2=0x7f5a980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:03:19.279 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:19.277+0000 7f5aaf1c0640 1 --2- 172.21.15.183:0/1778901506 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a980a2b80 0x7f5a980a5040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0096c0 tx=0x7f5a9c031400 comp rx=0 tx=0).stop 2024-08-18T22:03:19.279 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:19.277+0000 7f5aaf1c0640 1 -- 172.21.15.183:0/1778901506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa8101a00 msgr2=0x7f5aa8102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:03:19.279 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:19.277+0000 7f5aaf1c0640 1 --2- 172.21.15.183:0/1778901506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa8101a00 0x7f5aa8102de0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400e9f0 tx=0x7f5a9400edf0 comp rx=0 tx=0).stop 2024-08-18T22:03:19.279 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:19.277+0000 7f5aaf1c0640 1 -- 172.21.15.183:0/1778901506 shutdown_connections 2024-08-18T22:03:19.279 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:19.277+0000 7f5aaf1c0640 1 --2- 172.21.15.183:0/1778901506 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a980a2b80 0x7f5a980a5040 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:19.279 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:19.277+0000 7f5aaf1c0640 1 --2- 172.21.15.183:0/1778901506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5aa81023c0 0x7f5aa8103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:19.279 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:19.277+0000 7f5aaf1c0640 1 --2- 172.21.15.183:0/1778901506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa8101a00 0x7f5aa8102de0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:19.279 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:19.277+0000 7f5aaf1c0640 1 --2- 172.21.15.183:0/1778901506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5aa8100800 0x7f5aa8104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:19.280 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:19.277+0000 7f5aaf1c0640 1 -- 172.21.15.183:0/1778901506 >> 172.21.15.183:0/1778901506 conn(0x7f5aa80fbfb0 msgr2=0x7f5aa8069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:03:19.280 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:19.277+0000 7f5aaf1c0640 1 -- 172.21.15.183:0/1778901506 shutdown_connections 2024-08-18T22:03:19.280 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:03:19.277+0000 7f5aaf1c0640 1 -- 172.21.15.183:0/1778901506 wait complete. 2024-08-18T22:03:19.949 DEBUG:teuthology.orchestra.run.smithi183:osd.8> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.8.service 2024-08-18T22:03:19.952 INFO:tasks.cephadm:Deploying osd.9 on smithi123 with /dev/vg_nvme/lv_1... 2024-08-18T22:03:19.952 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-18T22:03:20.218 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:03:20.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:20.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:20.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:20 smithi123 ceph-mon[18462]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:20.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:20 smithi123 ceph-mon[18462]: from='osd.8 [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-18T22:03:20.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:20 smithi123 ceph-mon[18462]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-18T22:03:20.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:20.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:20.608 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:20 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:20.608 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:20 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:20.608 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:20 smithi183 ceph-mon[22097]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:20.608 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:20 smithi183 ceph-mon[22097]: from='osd.8 [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-18T22:03:20.608 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:20 smithi183 ceph-mon[22097]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-18T22:03:20.608 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:20 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:20.608 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:20 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:20 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:20 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:20 smithi130 ceph-mon[21698]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:20 smithi130 ceph-mon[21698]: from='osd.8 [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-18T22:03:20.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:20 smithi130 ceph-mon[21698]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-18T22:03:20.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:20 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:20.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:20 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:21.381 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:21 smithi183 ceph-mon[22097]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-18T22:03:21.382 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:21 smithi183 ceph-mon[22097]: osdmap e54: 9 total, 8 up, 9 in 2024-08-18T22:03:21.382 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:21 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:21.382 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:21 smithi183 ceph-mon[22097]: from='osd.8 [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:03:21.382 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:21 smithi183 ceph-mon[22097]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:03:21.595 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:21 smithi123 ceph-mon[18462]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-18T22:03:21.595 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:21 smithi123 ceph-mon[18462]: osdmap e54: 9 total, 8 up, 9 in 2024-08-18T22:03:21.595 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:21 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:21.595 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:21 smithi123 ceph-mon[18462]: from='osd.8 [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:03:21.595 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:21 smithi123 ceph-mon[18462]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:03:21.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:21 smithi130 ceph-mon[21698]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-18T22:03:21.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:21 smithi130 ceph-mon[21698]: osdmap e54: 9 total, 8 up, 9 in 2024-08-18T22:03:21.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:21 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:21.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:21 smithi130 ceph-mon[21698]: from='osd.8 [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:03:21.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:21 smithi130 ceph-mon[21698]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:03:22.028 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:03:21 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:03:21.948+0000 7fe766af9640 -1 osd.8 0 waiting for initial osdmap 2024-08-18T22:03:22.028 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:03:21 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:03:21.961+0000 7fe75e105640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:03:22.466 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:22 smithi123 ceph-mon[18462]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-08-18T22:03:22.466 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:22 smithi123 ceph-mon[18462]: osdmap e55: 9 total, 8 up, 9 in 2024-08-18T22:03:22.466 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:22 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:22.466 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:22 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:22.466 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:22 smithi123 ceph-mon[18462]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:22.466 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:22 smithi123 ceph-mon[18462]: from='osd.8 ' entity='osd.8' 2024-08-18T22:03:22.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:22 smithi183 ceph-mon[22097]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-08-18T22:03:22.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:22 smithi183 ceph-mon[22097]: osdmap e55: 9 total, 8 up, 9 in 2024-08-18T22:03:22.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:22 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:22.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:22 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:22.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:22 smithi183 ceph-mon[22097]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:22.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:22 smithi183 ceph-mon[22097]: from='osd.8 ' entity='osd.8' 2024-08-18T22:03:22.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:22 smithi130 ceph-mon[21698]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-08-18T22:03:22.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:22 smithi130 ceph-mon[21698]: osdmap e55: 9 total, 8 up, 9 in 2024-08-18T22:03:22.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:22 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:22.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:22 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:22.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:22 smithi130 ceph-mon[21698]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-18T22:03:22.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:22 smithi130 ceph-mon[21698]: from='osd.8 ' entity='osd.8' 2024-08-18T22:03:22.817 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:03:22.844 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi123:vg_nvme/lv_1 2024-08-18T22:03:23.105 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:03:23.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:23 smithi123 ceph-mon[18462]: purged_snaps scrub starts 2024-08-18T22:03:23.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:23 smithi123 ceph-mon[18462]: purged_snaps scrub ok 2024-08-18T22:03:23.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:23.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:23 smithi123 ceph-mon[18462]: osd.8 [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594] boot 2024-08-18T22:03:23.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:23 smithi123 ceph-mon[18462]: osdmap e56: 9 total, 9 up, 9 in 2024-08-18T22:03:23.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:23.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:23.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:23.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:23.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:23.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:23.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:23.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:23.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:03:23.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.591+0000 7fcfd7436640 1 -- 172.21.15.123:0/3713993828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd0102390 msgr2=0x7fcfd0104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:03:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.591+0000 7fcfd7436640 1 --2- 172.21.15.123:0/3713993828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd0102390 0x7fcfd0104780 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009ca0 tx=0x7fcfc002a8c0 comp rx=0 tx=0).stop 2024-08-18T22:03:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.591+0000 7fcfd7436640 1 -- 172.21.15.123:0/3713993828 shutdown_connections 2024-08-18T22:03:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.591+0000 7fcfd7436640 1 --2- 172.21.15.123:0/3713993828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfd01075f0 0x7fcfd0109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.591+0000 7fcfd7436640 1 --2- 172.21.15.123:0/3713993828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfd0104cc0 0x7fcfd01070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.591+0000 7fcfd7436640 1 --2- 172.21.15.123:0/3713993828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd0102390 0x7fcfd0104780 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.591+0000 7fcfd7436640 1 -- 172.21.15.123:0/3713993828 >> 172.21.15.123:0/3713993828 conn(0x7fcfd00fbfb0 msgr2=0x7fcfd00fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:03:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.591+0000 7fcfd7436640 1 -- 172.21.15.123:0/3713993828 shutdown_connections 2024-08-18T22:03:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.591+0000 7fcfd7436640 1 -- 172.21.15.123:0/3713993828 wait complete. 2024-08-18T22:03:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.591+0000 7fcfd7436640 1 Processor -- start 2024-08-18T22:03:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.591+0000 7fcfd7436640 1 -- start start 2024-08-18T22:03:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd7436640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfd0102390 0x7fcfd0197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:03:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd7436640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd0104cc0 0x7fcfd0198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:03:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd7436640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfd01075f0 0x7fcfd019f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:03:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd7436640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd010d5c0 con 0x7fcfd0104cc0 2024-08-18T22:03:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd7436640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd010d440 con 0x7fcfd01075f0 2024-08-18T22:03:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd7436640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd010d740 con 0x7fcfd0102390 2024-08-18T22:03:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd49d1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd0104cc0 0x7fcfd0198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:03:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd49d1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd0104cc0 0x7fcfd0198150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39724/0 (socket says 172.21.15.123:39724) 2024-08-18T22:03:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd49d1640 1 -- 172.21.15.123:0/1556166024 learned_addr learned my addr 172.21.15.123:0/1556166024 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:03:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd51d2640 1 --2- 172.21.15.123:0/1556166024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfd0102390 0x7fcfd0197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:03:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd59d3640 1 --2- 172.21.15.123:0/1556166024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfd01075f0 0x7fcfd019f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:03:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd49d1640 1 -- 172.21.15.123:0/1556166024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfd0102390 msgr2=0x7fcfd0197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:03:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd49d1640 1 --2- 172.21.15.123:0/1556166024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfd0102390 0x7fcfd0197c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd49d1640 1 -- 172.21.15.123:0/1556166024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfd01075f0 msgr2=0x7fcfd019f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:03:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd49d1640 1 --2- 172.21.15.123:0/1556166024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfd01075f0 0x7fcfd019f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd49d1640 1 -- 172.21.15.123:0/1556166024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd019f830 con 0x7fcfd0104cc0 2024-08-18T22:03:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd49d1640 1 --2- 172.21.15.123:0/1556166024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd0104cc0 0x7fcfd0198150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400c970 tx=0x7fcfc400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:03:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfce7fc640 1 -- 172.21.15.123:0/1556166024 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4014070 con 0x7fcfd0104cc0 2024-08-18T22:03:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfce7fc640 1 -- 172.21.15.123:0/1556166024 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfc4004440 con 0x7fcfd0104cc0 2024-08-18T22:03:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfce7fc640 1 -- 172.21.15.123:0/1556166024 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc400f450 con 0x7fcfd0104cc0 2024-08-18T22:03:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.592+0000 7fcfd7436640 1 -- 172.21.15.123:0/1556166024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd019fb20 con 0x7fcfd0104cc0 2024-08-18T22:03:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.593+0000 7fcfd7436640 1 -- 172.21.15.123:0/1556166024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd01a00b0 con 0x7fcfd0104cc0 2024-08-18T22:03:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.593+0000 7fcfd7436640 1 -- 172.21.15.123:0/1556166024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd00fdaa0 con 0x7fcfd0104cc0 2024-08-18T22:03:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.594+0000 7fcfce7fc640 1 -- 172.21.15.123:0/1556166024 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fcfc4017070 con 0x7fcfd0104cc0 2024-08-18T22:03:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.595+0000 7fcfce7fc640 1 --2- 172.21.15.123:0/1556166024 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcfb80a2c00 0x7fcfb80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:03:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.595+0000 7fcfd51d2640 1 --2- 172.21.15.123:0/1556166024 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcfb80a2c00 0x7fcfb80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:03:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.596+0000 7fcfce7fc640 1 -- 172.21.15.123:0/1556166024 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5858+0+0 (secure 0 0 0) 0x7fcfc40ce3f0 con 0x7fcfd0104cc0 2024-08-18T22:03:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.596+0000 7fcfd51d2640 1 --2- 172.21.15.123:0/1556166024 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcfb80a2c00 0x7fcfb80a50c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0006010 tx=0x7fcfc0000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:03:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.600+0000 7fcfce7fc640 1 -- 172.21.15.123:0/1556166024 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcfc401e020 con 0x7fcfd0104cc0 2024-08-18T22:03:23.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:23 smithi183 ceph-mon[22097]: purged_snaps scrub starts 2024-08-18T22:03:23.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:23 smithi183 ceph-mon[22097]: purged_snaps scrub ok 2024-08-18T22:03:23.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:23.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:23 smithi183 ceph-mon[22097]: osd.8 [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594] boot 2024-08-18T22:03:23.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:23 smithi183 ceph-mon[22097]: osdmap e56: 9 total, 9 up, 9 in 2024-08-18T22:03:23.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:23.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:23.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:23.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:23.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:23.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:23.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:23.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:23.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:03:23.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:23.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:23 smithi130 ceph-mon[21698]: purged_snaps scrub starts 2024-08-18T22:03:23.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:23 smithi130 ceph-mon[21698]: purged_snaps scrub ok 2024-08-18T22:03:23.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:23.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:23 smithi130 ceph-mon[21698]: osd.8 [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594] boot 2024-08-18T22:03:23.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:23 smithi130 ceph-mon[21698]: osdmap e56: 9 total, 9 up, 9 in 2024-08-18T22:03:23.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-18T22:03:23.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:23.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:23.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:23.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:23.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:23.766 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:23.766 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:23.766 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:03:23.766 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:23.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:23.776+0000 7fcfd7436640 1 -- 172.21.15.123:0/1556166024 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fcfd0062360 con 0x7fcfb80a2c00 2024-08-18T22:03:24.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:24 smithi123 ceph-mon[18462]: Detected new or changed devices on smithi183 2024-08-18T22:03:24.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:24 smithi123 ceph-mon[18462]: Adjusting osd_memory_target on smithi183 to 5696M 2024-08-18T22:03:24.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:24 smithi123 ceph-mon[18462]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:24.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:24 smithi123 ceph-mon[18462]: osdmap e57: 9 total, 9 up, 9 in 2024-08-18T22:03:24.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:24 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:03:24.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:24 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:24.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:24 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:03:24.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:24 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:24.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:24 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:03:24.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:24 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:03:24.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:24 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:24 smithi183 ceph-mon[22097]: Detected new or changed devices on smithi183 2024-08-18T22:03:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:24 smithi183 ceph-mon[22097]: Adjusting osd_memory_target on smithi183 to 5696M 2024-08-18T22:03:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:24 smithi183 ceph-mon[22097]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:24 smithi183 ceph-mon[22097]: osdmap e57: 9 total, 9 up, 9 in 2024-08-18T22:03:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:24 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:03:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:24 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:24 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:03:24.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:24 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:24.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:24 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:03:24.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:24 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:03:24.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:24 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:24.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:24 smithi130 ceph-mon[21698]: Detected new or changed devices on smithi183 2024-08-18T22:03:24.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:24 smithi130 ceph-mon[21698]: Adjusting osd_memory_target on smithi183 to 5696M 2024-08-18T22:03:24.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:24 smithi130 ceph-mon[21698]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:24.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:24 smithi130 ceph-mon[21698]: osdmap e57: 9 total, 9 up, 9 in 2024-08-18T22:03:24.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:24 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:03:24.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:24 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:24.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:24 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:03:24.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:24 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:24.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:24 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:03:24.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:24 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:03:24.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:24 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:25.627 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:25 smithi123 ceph-mon[18462]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:03:25.627 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:25 smithi123 ceph-mon[18462]: osdmap e58: 9 total, 9 up, 9 in 2024-08-18T22:03:25.627 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:25 smithi123 ceph-mon[18462]: osdmap e59: 9 total, 9 up, 9 in 2024-08-18T22:03:25.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:25 smithi183 ceph-mon[22097]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:03:25.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:25 smithi183 ceph-mon[22097]: osdmap e58: 9 total, 9 up, 9 in 2024-08-18T22:03:25.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:25 smithi183 ceph-mon[22097]: osdmap e59: 9 total, 9 up, 9 in 2024-08-18T22:03:25.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:25 smithi130 ceph-mon[21698]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:03:25.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:25 smithi130 ceph-mon[21698]: osdmap e58: 9 total, 9 up, 9 in 2024-08-18T22:03:25.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:25 smithi130 ceph-mon[21698]: osdmap e59: 9 total, 9 up, 9 in 2024-08-18T22:03:26.564 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:26 smithi123 ceph-mon[18462]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-18T22:03:26.565 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:26 smithi123 ceph-mon[18462]: osdmap e60: 9 total, 9 up, 9 in 2024-08-18T22:03:26.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:26 smithi183 ceph-mon[22097]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-18T22:03:26.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:26 smithi183 ceph-mon[22097]: osdmap e60: 9 total, 9 up, 9 in 2024-08-18T22:03:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:26 smithi130 ceph-mon[21698]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-18T22:03:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:26 smithi130 ceph-mon[21698]: osdmap e60: 9 total, 9 up, 9 in 2024-08-18T22:03:27.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:27 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/770507168' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b869af87-d9cf-4504-b44e-e95d5a0e2e32"}]: dispatch 2024-08-18T22:03:27.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:27 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/770507168' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b869af87-d9cf-4504-b44e-e95d5a0e2e32"}]': finished 2024-08-18T22:03:27.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:27 smithi183 ceph-mon[22097]: osdmap e61: 10 total, 9 up, 10 in 2024-08-18T22:03:27.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:27 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-18T22:03:27.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:27 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/61433739' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:03:27.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:27 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/770507168' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b869af87-d9cf-4504-b44e-e95d5a0e2e32"}]: dispatch 2024-08-18T22:03:27.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:27 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/770507168' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b869af87-d9cf-4504-b44e-e95d5a0e2e32"}]': finished 2024-08-18T22:03:27.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:27 smithi123 ceph-mon[18462]: osdmap e61: 10 total, 9 up, 10 in 2024-08-18T22:03:27.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:27 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-18T22:03:27.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:27 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/61433739' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:03:27.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:27 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/770507168' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b869af87-d9cf-4504-b44e-e95d5a0e2e32"}]: dispatch 2024-08-18T22:03:27.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:27 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/770507168' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b869af87-d9cf-4504-b44e-e95d5a0e2e32"}]': finished 2024-08-18T22:03:27.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:27 smithi130 ceph-mon[21698]: osdmap e61: 10 total, 9 up, 10 in 2024-08-18T22:03:27.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:27 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-18T22:03:27.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:27 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/61433739' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:03:28.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:28 smithi183 ceph-mon[22097]: pgmap v180: 1 pgs: 1 peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 145 KiB/s, 0 objects/s recovering 2024-08-18T22:03:28.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:28 smithi123 ceph-mon[18462]: pgmap v180: 1 pgs: 1 peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 145 KiB/s, 0 objects/s recovering 2024-08-18T22:03:28.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:28 smithi130 ceph-mon[21698]: pgmap v180: 1 pgs: 1 peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 145 KiB/s, 0 objects/s recovering 2024-08-18T22:03:30.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:30 smithi183 ceph-mon[22097]: pgmap v181: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-08-18T22:03:30.662 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:30 smithi123 ceph-mon[18462]: pgmap v181: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-08-18T22:03:30.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:30 smithi130 ceph-mon[21698]: pgmap v181: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-08-18T22:03:32.454 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:32 smithi123 ceph-mon[18462]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-08-18T22:03:32.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:32 smithi183 ceph-mon[22097]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-08-18T22:03:32.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:32 smithi130 ceph-mon[21698]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-08-18T22:03:34.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:34 smithi123 ceph-mon[18462]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:34.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:34 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-08-18T22:03:34.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:34 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:34.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:34 smithi183 ceph-mon[22097]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:34.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:34 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-08-18T22:03:34.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:34 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:34 smithi130 ceph-mon[21698]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:34 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-08-18T22:03:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:34 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:35.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:35 smithi123 ceph-mon[18462]: Deploying daemon osd.9 on smithi123 2024-08-18T22:03:35.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:35 smithi183 ceph-mon[22097]: Deploying daemon osd.9 on smithi123 2024-08-18T22:03:35.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:35 smithi130 ceph-mon[21698]: Deploying daemon osd.9 on smithi123 2024-08-18T22:03:36.631 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:36 smithi123 ceph-mon[18462]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:36.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:36 smithi183 ceph-mon[22097]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:36.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:36 smithi130 ceph-mon[21698]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:38.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:38 smithi123 ceph-mon[18462]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:38.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:38 smithi183 ceph-mon[22097]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:38.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:38 smithi130 ceph-mon[21698]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:39.450 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:39 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:03:39.451 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:39 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:39.451 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:39 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:39 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:03:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:39 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:39 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:39.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:39 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:03:39.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:39 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:39.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:39 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:40.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:40 smithi183 ceph-mon[22097]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:40.737 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:40 smithi123 ceph-mon[18462]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:40.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:40 smithi130 ceph-mon[21698]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:42.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:42 smithi123 ceph-mon[18462]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:42.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:42 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:42.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:42 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:42.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:42 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:42.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:42 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:03:42.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:42 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:42.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:42.575+0000 7fcfce7fc640 1 -- 172.21.15.123:0/1556166024 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcfd0062360 con 0x7fcfb80a2c00 2024-08-18T22:03:42.577 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 9 on host 'smithi123' 2024-08-18T22:03:42.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:42.578+0000 7fcfd7436640 1 -- 172.21.15.123:0/1556166024 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcfb80a2c00 msgr2=0x7fcfb80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:03:42.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:42.578+0000 7fcfd7436640 1 --2- 172.21.15.123:0/1556166024 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcfb80a2c00 0x7fcfb80a50c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0006010 tx=0x7fcfc0000f40 comp rx=0 tx=0).stop 2024-08-18T22:03:42.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:42.578+0000 7fcfd7436640 1 -- 172.21.15.123:0/1556166024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd0104cc0 msgr2=0x7fcfd0198150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:03:42.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:42.578+0000 7fcfd7436640 1 --2- 172.21.15.123:0/1556166024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd0104cc0 0x7fcfd0198150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400c970 tx=0x7fcfc400ce30 comp rx=0 tx=0).stop 2024-08-18T22:03:42.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:42.578+0000 7fcfd7436640 1 -- 172.21.15.123:0/1556166024 shutdown_connections 2024-08-18T22:03:42.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:42.578+0000 7fcfd7436640 1 --2- 172.21.15.123:0/1556166024 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcfb80a2c00 0x7fcfb80a50c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:42.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:42.578+0000 7fcfd7436640 1 --2- 172.21.15.123:0/1556166024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfd01075f0 0x7fcfd019f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:42.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:42.578+0000 7fcfd7436640 1 --2- 172.21.15.123:0/1556166024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd0104cc0 0x7fcfd0198150 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:42.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:42.578+0000 7fcfd7436640 1 --2- 172.21.15.123:0/1556166024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfd0102390 0x7fcfd0197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:42.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:42.578+0000 7fcfd7436640 1 -- 172.21.15.123:0/1556166024 >> 172.21.15.123:0/1556166024 conn(0x7fcfd00fbfb0 msgr2=0x7fcfd0102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:03:42.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:42.578+0000 7fcfd7436640 1 -- 172.21.15.123:0/1556166024 shutdown_connections 2024-08-18T22:03:42.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:03:42.578+0000 7fcfd7436640 1 -- 172.21.15.123:0/1556166024 wait complete. 2024-08-18T22:03:42.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:42 smithi183 ceph-mon[22097]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:42.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:42.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:42.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:42.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:03:42.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:42.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:42 smithi130 ceph-mon[21698]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:42.770 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:42 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:42.770 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:42 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:42.770 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:42 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:42.770 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:42 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:03:42.770 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:42 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:43.354 DEBUG:teuthology.orchestra.run.smithi123:osd.9> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.9.service 2024-08-18T22:03:43.356 INFO:tasks.cephadm:Deploying osd.10 on smithi130 with /dev/vg_nvme/lv_1... 2024-08-18T22:03:43.356 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-18T22:03:43.621 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.b/config 2024-08-18T22:03:43.647 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:43 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:03:43.647 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:43 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:43.647 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:43 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:43.647 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:43 smithi123 ceph-mon[18462]: from='osd.9 [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-08-18T22:03:43.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:43 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:03:43.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:43 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:43.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:43 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:43.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:43 smithi183 ceph-mon[22097]: from='osd.9 [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-08-18T22:03:43.743 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:43 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:03:43.743 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:43 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:43.743 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:43 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:43.743 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:43 smithi130 ceph-mon[21698]: from='osd.9 [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-08-18T22:03:44.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:44 smithi123 ceph-mon[18462]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:44.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:44 smithi123 ceph-mon[18462]: from='osd.9 [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-18T22:03:44.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:44 smithi123 ceph-mon[18462]: osdmap e62: 10 total, 9 up, 10 in 2024-08-18T22:03:44.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:44 smithi123 ceph-mon[18462]: from='osd.9 [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-08-18T22:03:44.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:44 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-18T22:03:44.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:44 smithi183 ceph-mon[22097]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:44.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:44 smithi183 ceph-mon[22097]: from='osd.9 [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-18T22:03:44.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:44 smithi183 ceph-mon[22097]: osdmap e62: 10 total, 9 up, 10 in 2024-08-18T22:03:44.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:44 smithi183 ceph-mon[22097]: from='osd.9 [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-08-18T22:03:44.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:44 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-18T22:03:44.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:44 smithi130 ceph-mon[21698]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:44.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:44 smithi130 ceph-mon[21698]: from='osd.9 [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-18T22:03:44.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:44 smithi130 ceph-mon[21698]: osdmap e62: 10 total, 9 up, 10 in 2024-08-18T22:03:44.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:44 smithi130 ceph-mon[21698]: from='osd.9 [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-08-18T22:03:44.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:44 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-18T22:03:44.808 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:03:44 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:03:44.589+0000 7f9bfdbeb640 -1 osd.9 0 waiting for initial osdmap 2024-08-18T22:03:44.808 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:03:44 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:03:44.599+0000 7f9bf9a13640 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:03:45.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:45 smithi123 ceph-mon[18462]: from='osd.9 [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-08-18T22:03:45.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:45 smithi123 ceph-mon[18462]: osdmap e63: 10 total, 9 up, 10 in 2024-08-18T22:03:45.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:45 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-18T22:03:45.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:45 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-18T22:03:45.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:45 smithi123 ceph-mon[18462]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:45.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:45 smithi130 ceph-mon[21698]: from='osd.9 [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-08-18T22:03:45.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:45 smithi130 ceph-mon[21698]: osdmap e63: 10 total, 9 up, 10 in 2024-08-18T22:03:45.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:45 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-18T22:03:45.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:45 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-18T22:03:45.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:45 smithi130 ceph-mon[21698]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:45.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:45 smithi183 ceph-mon[22097]: from='osd.9 [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-08-18T22:03:45.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:45 smithi183 ceph-mon[22097]: osdmap e63: 10 total, 9 up, 10 in 2024-08-18T22:03:45.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:45 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-18T22:03:45.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:45 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-18T22:03:45.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:45 smithi183 ceph-mon[22097]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-08-18T22:03:46.294 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-18T22:03:46.317 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_1 2024-08-18T22:03:46.569 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.b/config 2024-08-18T22:03:46.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: purged_snaps scrub starts 2024-08-18T22:03:46.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: purged_snaps scrub ok 2024-08-18T22:03:46.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: osd.9 [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663] boot 2024-08-18T22:03:46.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: osdmap e64: 10 total, 10 up, 10 in 2024-08-18T22:03:46.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-18T22:03:46.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: Detected new or changed devices on smithi123 2024-08-18T22:03:46.850 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:46.850 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:46.850 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:46.850 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:46.850 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:46.850 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:46.850 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: Adjusting osd_memory_target on smithi123 to 4272M 2024-08-18T22:03:46.850 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:46.850 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:46.850 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:03:46.850 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:46.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: purged_snaps scrub starts 2024-08-18T22:03:46.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: purged_snaps scrub ok 2024-08-18T22:03:46.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: osd.9 [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663] boot 2024-08-18T22:03:46.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: osdmap e64: 10 total, 10 up, 10 in 2024-08-18T22:03:46.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-18T22:03:46.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: Detected new or changed devices on smithi123 2024-08-18T22:03:46.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:46.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:46.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:46.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:46.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:46.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:46.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: Adjusting osd_memory_target on smithi123 to 4272M 2024-08-18T22:03:46.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:46.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:46.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:03:46.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:47.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: purged_snaps scrub starts 2024-08-18T22:03:47.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: purged_snaps scrub ok 2024-08-18T22:03:47.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: osd.9 [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663] boot 2024-08-18T22:03:47.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: osdmap e64: 10 total, 10 up, 10 in 2024-08-18T22:03:47.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-18T22:03:47.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: Detected new or changed devices on smithi123 2024-08-18T22:03:47.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:47.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:47.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:47.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:47.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:47.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:03:47.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: Adjusting osd_memory_target on smithi123 to 4272M 2024-08-18T22:03:47.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:47.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:47.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:03:47.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:03:47.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.056+0000 7f1b4e34c640 1 -- 172.21.15.130:0/877536518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b481075f0 msgr2=0x7f1b48109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:03:47.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.056+0000 7f1b4e34c640 1 --2- 172.21.15.130:0/877536518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b481075f0 0x7f1b48109a40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009ca0 tx=0x7f1b4002a8c0 comp rx=0 tx=0).stop 2024-08-18T22:03:47.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.056+0000 7f1b4e34c640 1 -- 172.21.15.130:0/877536518 shutdown_connections 2024-08-18T22:03:47.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.056+0000 7f1b4e34c640 1 --2- 172.21.15.130:0/877536518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b481075f0 0x7f1b48109a40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:47.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.056+0000 7f1b4e34c640 1 --2- 172.21.15.130:0/877536518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b48104cc0 0x7f1b481070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:47.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.056+0000 7f1b4e34c640 1 --2- 172.21.15.130:0/877536518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b48102390 0x7f1b48104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:47.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.056+0000 7f1b4e34c640 1 -- 172.21.15.130:0/877536518 >> 172.21.15.130:0/877536518 conn(0x7f1b480fbfb0 msgr2=0x7f1b480fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:03:47.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.056+0000 7f1b4e34c640 1 -- 172.21.15.130:0/877536518 shutdown_connections 2024-08-18T22:03:47.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.056+0000 7f1b4e34c640 1 -- 172.21.15.130:0/877536518 wait complete. 2024-08-18T22:03:47.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.057+0000 7f1b4e34c640 1 Processor -- start 2024-08-18T22:03:47.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.057+0000 7f1b4e34c640 1 -- start start 2024-08-18T22:03:47.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.057+0000 7f1b4e34c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b48102390 0x7f1b48197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:03:47.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.057+0000 7f1b4e34c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b48104cc0 0x7f1b481982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:03:47.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.057+0000 7f1b4e34c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b481075f0 0x7f1b4819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:03:47.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.057+0000 7f1b4e34c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4810d680 con 0x7f1b481075f0 2024-08-18T22:03:47.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.057+0000 7f1b4e34c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4810d500 con 0x7f1b48102390 2024-08-18T22:03:47.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.057+0000 7f1b4e34c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4810d800 con 0x7f1b48104cc0 2024-08-18T22:03:47.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.057+0000 7f1b47fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b48102390 0x7f1b48197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:03:47.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.057+0000 7f1b47fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b48102390 0x7f1b48197d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:58088/0 (socket says 172.21.15.130:58088) 2024-08-18T22:03:47.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.057+0000 7f1b47fff640 1 -- 172.21.15.130:0/3957432402 learned_addr learned my addr 172.21.15.130:0/3957432402 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-08-18T22:03:47.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.057+0000 7f1b477fe640 1 --2- 172.21.15.130:0/3957432402 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b48104cc0 0x7f1b481982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:03:47.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.057+0000 7f1b4c8e9640 1 --2- 172.21.15.130:0/3957432402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b481075f0 0x7f1b4819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:03:47.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.058+0000 7f1b47fff640 1 -- 172.21.15.130:0/3957432402 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b48104cc0 msgr2=0x7f1b481982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:03:47.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.058+0000 7f1b47fff640 1 --2- 172.21.15.130:0/3957432402 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b48104cc0 0x7f1b481982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:47.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.058+0000 7f1b47fff640 1 -- 172.21.15.130:0/3957432402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b481075f0 msgr2=0x7f1b4819f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:03:47.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.058+0000 7f1b47fff640 1 --2- 172.21.15.130:0/3957432402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b481075f0 0x7f1b4819f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:03:47.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.058+0000 7f1b47fff640 1 -- 172.21.15.130:0/3957432402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4819f9b0 con 0x7f1b48102390 2024-08-18T22:03:47.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.058+0000 7f1b47fff640 1 --2- 172.21.15.130:0/3957432402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b48102390 0x7f1b48197d90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800b4a0 tx=0x7f1b3800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:03:47.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.058+0000 7f1b457fa640 1 -- 172.21.15.130:0/3957432402 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38015020 con 0x7f1b48102390 2024-08-18T22:03:47.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.058+0000 7f1b4e34c640 1 -- 172.21.15.130:0/3957432402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4819fca0 con 0x7f1b48102390 2024-08-18T22:03:47.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.058+0000 7f1b457fa640 1 -- 172.21.15.130:0/3957432402 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b38011d10 con 0x7f1b48102390 2024-08-18T22:03:47.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.058+0000 7f1b457fa640 1 -- 172.21.15.130:0/3957432402 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3800f2e0 con 0x7f1b48102390 2024-08-18T22:03:47.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.058+0000 7f1b4e34c640 1 -- 172.21.15.130:0/3957432402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b481a0190 con 0x7f1b48102390 2024-08-18T22:03:47.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.059+0000 7f1b4e34c640 1 -- 172.21.15.130:0/3957432402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b480fdaa0 con 0x7f1b48102390 2024-08-18T22:03:47.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.060+0000 7f1b457fa640 1 -- 172.21.15.130:0/3957432402 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f1b38018020 con 0x7f1b48102390 2024-08-18T22:03:47.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.061+0000 7f1b457fa640 1 --2- 172.21.15.130:0/3957432402 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1b300a2b80 0x7f1b300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:03:47.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.061+0000 7f1b457fa640 1 -- 172.21.15.130:0/3957432402 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6261+0+0 (secure 0 0 0) 0x7f1b380ce0e0 con 0x7f1b48102390 2024-08-18T22:03:47.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.061+0000 7f1b477fe640 1 --2- 172.21.15.130:0/3957432402 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1b300a2b80 0x7f1b300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:03:47.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.062+0000 7f1b477fe640 1 --2- 172.21.15.130:0/3957432402 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1b300a2b80 0x7f1b300a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1b4806a800 tx=0x7f1b3c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:03:47.066 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.065+0000 7f1b457fa640 1 -- 172.21.15.130:0/3957432402 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1b3801f020 con 0x7f1b48102390 2024-08-18T22:03:47.241 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:03:47.240+0000 7f1b4e34c640 1 -- 172.21.15.130:0/3957432402 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1b48062360 con 0x7f1b300a2b80 2024-08-18T22:03:47.902 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:47 smithi130 ceph-mon[21698]: osdmap e65: 10 total, 10 up, 10 in 2024-08-18T22:03:47.903 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:47 smithi130 ceph-mon[21698]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:03:47.903 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:47 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:03:47.903 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:47 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:03:47.903 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:47 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:47.903 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:47 smithi130 ceph-mon[21698]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:47.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:47 smithi183 ceph-mon[22097]: osdmap e65: 10 total, 10 up, 10 in 2024-08-18T22:03:47.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:47 smithi183 ceph-mon[22097]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:03:47.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:03:47.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:03:47.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:47.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:47 smithi183 ceph-mon[22097]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:48.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:47 smithi123 ceph-mon[18462]: osdmap e65: 10 total, 10 up, 10 in 2024-08-18T22:03:48.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:47 smithi123 ceph-mon[18462]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:03:48.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:03:48.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:03:48.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:48.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:47 smithi123 ceph-mon[18462]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:50.625 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:50 smithi183 ceph-mon[22097]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:50.625 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:50 smithi183 ceph-mon[22097]: from='client.? 172.21.15.130:0/606728889' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca063387-151b-4025-bed4-af51b9c4fa5d"}]: dispatch 2024-08-18T22:03:50.625 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:50 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca063387-151b-4025-bed4-af51b9c4fa5d"}]: dispatch 2024-08-18T22:03:50.625 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:50 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca063387-151b-4025-bed4-af51b9c4fa5d"}]': finished 2024-08-18T22:03:50.625 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:50 smithi183 ceph-mon[22097]: osdmap e66: 11 total, 10 up, 11 in 2024-08-18T22:03:50.625 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:50 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:03:50.626 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:50 smithi183 ceph-mon[22097]: from='client.? 172.21.15.130:0/1002448156' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:03:50.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:50 smithi123 ceph-mon[18462]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:50.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:50 smithi123 ceph-mon[18462]: from='client.? 172.21.15.130:0/606728889' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca063387-151b-4025-bed4-af51b9c4fa5d"}]: dispatch 2024-08-18T22:03:50.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:50 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca063387-151b-4025-bed4-af51b9c4fa5d"}]: dispatch 2024-08-18T22:03:50.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:50 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca063387-151b-4025-bed4-af51b9c4fa5d"}]': finished 2024-08-18T22:03:50.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:50 smithi123 ceph-mon[18462]: osdmap e66: 11 total, 10 up, 11 in 2024-08-18T22:03:50.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:50 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:03:50.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:50 smithi123 ceph-mon[18462]: from='client.? 172.21.15.130:0/1002448156' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:03:50.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:50 smithi130 ceph-mon[21698]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:50.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:50 smithi130 ceph-mon[21698]: from='client.? 172.21.15.130:0/606728889' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca063387-151b-4025-bed4-af51b9c4fa5d"}]: dispatch 2024-08-18T22:03:50.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:50 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca063387-151b-4025-bed4-af51b9c4fa5d"}]: dispatch 2024-08-18T22:03:50.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:50 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca063387-151b-4025-bed4-af51b9c4fa5d"}]': finished 2024-08-18T22:03:50.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:50 smithi130 ceph-mon[21698]: osdmap e66: 11 total, 10 up, 11 in 2024-08-18T22:03:50.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:50 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:03:50.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:50 smithi130 ceph-mon[21698]: from='client.? 172.21.15.130:0/1002448156' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:03:52.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:52 smithi183 ceph-mon[22097]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:52.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:52 smithi123 ceph-mon[18462]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:52 smithi130 ceph-mon[21698]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:54.635 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:54 smithi130 ceph-mon[21698]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:54.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:54 smithi183 ceph-mon[22097]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:54.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:54 smithi123 ceph-mon[18462]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:56.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:56 smithi183 ceph-mon[22097]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:56.680 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:56 smithi130 ceph-mon[21698]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:56.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:56 smithi123 ceph-mon[18462]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:57.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:57 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-08-18T22:03:57.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:57 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:57.742 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:57 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-08-18T22:03:57.742 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:57 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:57.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:57 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-08-18T22:03:57.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:57 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:03:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:58 smithi183 ceph-mon[22097]: Deploying daemon osd.10 on smithi130 2024-08-18T22:03:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:03:58 smithi183 ceph-mon[22097]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:58.715 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:58 smithi130 ceph-mon[21698]: Deploying daemon osd.10 on smithi130 2024-08-18T22:03:58.715 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:03:58 smithi130 ceph-mon[21698]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:03:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:58 smithi123 ceph-mon[18462]: Deploying daemon osd.10 on smithi130 2024-08-18T22:03:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:03:58 smithi123 ceph-mon[18462]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:00.499 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:00 smithi130 ceph-mon[21698]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:00.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:00 smithi183 ceph-mon[22097]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:00.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:00 smithi123 ceph-mon[18462]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:02.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:02 smithi130 ceph-mon[21698]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:02.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:02 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:04:02.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:02 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:02.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:02 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:02.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:02 smithi183 ceph-mon[22097]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:02.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:02 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:04:02.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:02 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:02.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:02 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:02.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:02 smithi123 ceph-mon[18462]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:02.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:02 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:04:02.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:02 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:02.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:02 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:04.429 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:04 smithi130 ceph-mon[21698]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:04.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:04 smithi183 ceph-mon[22097]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:04.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:04 smithi123 ceph-mon[18462]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:05.099 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 10 on host 'smithi130' 2024-08-18T22:04:05.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:04:05.097+0000 7f1b457fa640 1 -- 172.21.15.130:0/3957432402 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f1b48062360 con 0x7f1b300a2b80 2024-08-18T22:04:05.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:04:05.100+0000 7f1b4e34c640 1 -- 172.21.15.130:0/3957432402 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1b300a2b80 msgr2=0x7f1b300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:05.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:04:05.100+0000 7f1b4e34c640 1 --2- 172.21.15.130:0/3957432402 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1b300a2b80 0x7f1b300a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1b4806a800 tx=0x7f1b3c009110 comp rx=0 tx=0).stop 2024-08-18T22:04:05.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:04:05.100+0000 7f1b4e34c640 1 -- 172.21.15.130:0/3957432402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b48102390 msgr2=0x7f1b48197d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:05.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:04:05.100+0000 7f1b4e34c640 1 --2- 172.21.15.130:0/3957432402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b48102390 0x7f1b48197d90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800b4a0 tx=0x7f1b3800b8a0 comp rx=0 tx=0).stop 2024-08-18T22:04:05.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:04:05.100+0000 7f1b4e34c640 1 -- 172.21.15.130:0/3957432402 shutdown_connections 2024-08-18T22:04:05.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:04:05.100+0000 7f1b4e34c640 1 --2- 172.21.15.130:0/3957432402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b481075f0 0x7f1b4819f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:05.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:04:05.100+0000 7f1b4e34c640 1 --2- 172.21.15.130:0/3957432402 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b48104cc0 0x7f1b481982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:05.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:04:05.100+0000 7f1b4e34c640 1 --2- 172.21.15.130:0/3957432402 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1b300a2b80 0x7f1b300a5040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:05.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:04:05.100+0000 7f1b4e34c640 1 --2- 172.21.15.130:0/3957432402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b48102390 0x7f1b48197d90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:05.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:04:05.100+0000 7f1b4e34c640 1 -- 172.21.15.130:0/3957432402 >> 172.21.15.130:0/3957432402 conn(0x7f1b480fbfb0 msgr2=0x7f1b48102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:05.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:04:05.100+0000 7f1b4e34c640 1 -- 172.21.15.130:0/3957432402 shutdown_connections 2024-08-18T22:04:05.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-18T22:04:05.100+0000 7f1b4e34c640 1 -- 172.21.15.130:0/3957432402 wait complete. 2024-08-18T22:04:05.748 DEBUG:teuthology.orchestra.run.smithi130:osd.10> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.10.service 2024-08-18T22:04:05.750 INFO:tasks.cephadm:Deploying osd.11 on smithi183 with /dev/vg_nvme/lv_1... 2024-08-18T22:04:05.750 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-18T22:04:06.011 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T22:04:06.365 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:06 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:06.365 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:06 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:06.365 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:06 smithi183 ceph-mon[22097]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:06.365 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:06 smithi183 ceph-mon[22097]: from='osd.10 [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-18T22:04:06.365 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:06 smithi183 ceph-mon[22097]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-18T22:04:06.365 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:06 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:06.365 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:06 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:06.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:06 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:06.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:06 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:06.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:06 smithi123 ceph-mon[18462]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:06.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:06 smithi123 ceph-mon[18462]: from='osd.10 [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-18T22:04:06.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:06 smithi123 ceph-mon[18462]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-18T22:04:06.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:06 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:06.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:06 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:06.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:06 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:06.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:06 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:06.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:06 smithi130 ceph-mon[21698]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:06.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:06 smithi130 ceph-mon[21698]: from='osd.10 [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-18T22:04:06.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:06 smithi130 ceph-mon[21698]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-18T22:04:06.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:06 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:06.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:06 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:07.363 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:07 smithi183 ceph-mon[22097]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-18T22:04:07.364 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:07 smithi183 ceph-mon[22097]: osdmap e67: 11 total, 10 up, 11 in 2024-08-18T22:04:07.364 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:07 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:04:07.364 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:07 smithi183 ceph-mon[22097]: from='osd.10 [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:04:07.364 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:07 smithi183 ceph-mon[22097]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:04:07.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:07 smithi123 ceph-mon[18462]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-18T22:04:07.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:07 smithi123 ceph-mon[18462]: osdmap e67: 11 total, 10 up, 11 in 2024-08-18T22:04:07.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:07 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:04:07.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:07 smithi123 ceph-mon[18462]: from='osd.10 [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:04:07.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:07 smithi123 ceph-mon[18462]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:04:07.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:07 smithi130 ceph-mon[21698]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-18T22:04:07.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:07 smithi130 ceph-mon[21698]: osdmap e67: 11 total, 10 up, 11 in 2024-08-18T22:04:07.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:07 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:04:07.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:07 smithi130 ceph-mon[21698]: from='osd.10 [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:04:07.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:07 smithi130 ceph-mon[21698]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-08-18T22:04:07.874 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:04:07 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:04:07.773+0000 7fc212e85640 -1 osd.10 0 waiting for initial osdmap 2024-08-18T22:04:07.874 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:04:07 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:04:07.784+0000 7fc20aca5640 -1 osd.10 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:04:08.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:08 smithi130 ceph-mon[21698]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-18T22:04:08.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:08 smithi130 ceph-mon[21698]: osdmap e68: 11 total, 10 up, 11 in 2024-08-18T22:04:08.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:08 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:04:08.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:08 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:04:08.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:08 smithi130 ceph-mon[21698]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:08.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:08 smithi130 ceph-mon[21698]: from='osd.10 ' entity='osd.10' 2024-08-18T22:04:08.411 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:08 smithi183 ceph-mon[22097]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-18T22:04:08.412 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:08 smithi183 ceph-mon[22097]: osdmap e68: 11 total, 10 up, 11 in 2024-08-18T22:04:08.412 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:08 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:04:08.412 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:08 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:04:08.412 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:08 smithi183 ceph-mon[22097]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:08.412 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:08 smithi183 ceph-mon[22097]: from='osd.10 ' entity='osd.10' 2024-08-18T22:04:08.497 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-08-18T22:04:08.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:08 smithi123 ceph-mon[18462]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-18T22:04:08.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:08 smithi123 ceph-mon[18462]: osdmap e68: 11 total, 10 up, 11 in 2024-08-18T22:04:08.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:08 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:04:08.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:08 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:04:08.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:08 smithi123 ceph-mon[18462]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-08-18T22:04:08.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:08 smithi123 ceph-mon[18462]: from='osd.10 ' entity='osd.10' 2024-08-18T22:04:08.523 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_1 2024-08-18T22:04:08.781 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T22:04:09.220 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:09 smithi130 ceph-mon[21698]: purged_snaps scrub starts 2024-08-18T22:04:09.220 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:09 smithi130 ceph-mon[21698]: purged_snaps scrub ok 2024-08-18T22:04:09.220 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:04:09.220 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:09 smithi130 ceph-mon[21698]: osd.10 [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086] boot 2024-08-18T22:04:09.220 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:09 smithi130 ceph-mon[21698]: osdmap e69: 11 total, 11 up, 11 in 2024-08-18T22:04:09.220 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:04:09.265 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.259+0000 7fd637f64640 1 -- 172.21.15.183:0/4160005930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd630101930 msgr2=0x7fd630101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:09.265 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.259+0000 7fd637f64640 1 --2- 172.21.15.183:0/4160005930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd630101930 0x7fd630101d30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009900 tx=0x7fd62c02a410 comp rx=0 tx=0).stop 2024-08-18T22:04:09.265 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.259+0000 7fd637f64640 1 -- 172.21.15.183:0/4160005930 shutdown_connections 2024-08-18T22:04:09.265 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.259+0000 7fd637f64640 1 --2- 172.21.15.183:0/4160005930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6301034f0 0x7fd630109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:09.265 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.259+0000 7fd637f64640 1 --2- 172.21.15.183:0/4160005930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd630102b30 0x7fd630102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:09.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.259+0000 7fd637f64640 1 --2- 172.21.15.183:0/4160005930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd630101930 0x7fd630101d30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:09.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.259+0000 7fd637f64640 1 -- 172.21.15.183:0/4160005930 >> 172.21.15.183:0/4160005930 conn(0x7fd6300fd0e0 msgr2=0x7fd6300ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:09.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.259+0000 7fd637f64640 1 -- 172.21.15.183:0/4160005930 shutdown_connections 2024-08-18T22:04:09.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.259+0000 7fd637f64640 1 -- 172.21.15.183:0/4160005930 wait complete. 2024-08-18T22:04:09.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.259+0000 7fd637f64640 1 Processor -- start 2024-08-18T22:04:09.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.259+0000 7fd637f64640 1 -- start start 2024-08-18T22:04:09.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd637f64640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd630101930 0x7fd630075cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:09.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd637f64640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd630102b30 0x7fd630074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:09.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd637f64640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6301034f0 0x7fd630074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:09.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd637f64640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd63010d610 con 0x7fd6301034f0 2024-08-18T22:04:09.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd637f64640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd63010d490 con 0x7fd630101930 2024-08-18T22:04:09.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd637f64640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd63010d790 con 0x7fd630102b30 2024-08-18T22:04:09.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd6354ff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd630102b30 0x7fd630074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:09.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd6354ff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd630102b30 0x7fd630074310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:35432/0 (socket says 172.21.15.183:35432) 2024-08-18T22:04:09.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd6354ff640 1 -- 172.21.15.183:0/3777939774 learned_addr learned my addr 172.21.15.183:0/3777939774 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-08-18T22:04:09.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd636501640 1 --2- 172.21.15.183:0/3777939774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6301034f0 0x7fd630074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:09.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd635d00640 1 --2- 172.21.15.183:0/3777939774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd630101930 0x7fd630075cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:09.268 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd6354ff640 1 -- 172.21.15.183:0/3777939774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd630101930 msgr2=0x7fd630075cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:09.268 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd6354ff640 1 --2- 172.21.15.183:0/3777939774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd630101930 0x7fd630075cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:09.268 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd6354ff640 1 -- 172.21.15.183:0/3777939774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6301034f0 msgr2=0x7fd630074850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:09.268 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd6354ff640 1 --2- 172.21.15.183:0/3777939774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6301034f0 0x7fd630074850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:09.268 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd6354ff640 1 -- 172.21.15.183:0/3777939774 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd630075110 con 0x7fd630102b30 2024-08-18T22:04:09.268 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd6354ff640 1 --2- 172.21.15.183:0/3777939774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd630102b30 0x7fd630074310 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd62000d950 tx=0x7fd62000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:09.268 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd626ffd640 1 -- 172.21.15.183:0/3777939774 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620017030 con 0x7fd630102b30 2024-08-18T22:04:09.268 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd637f64640 1 -- 172.21.15.183:0/3777939774 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6301a1d90 con 0x7fd630102b30 2024-08-18T22:04:09.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd626ffd640 1 -- 172.21.15.183:0/3777939774 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd620004020 con 0x7fd630102b30 2024-08-18T22:04:09.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd626ffd640 1 -- 172.21.15.183:0/3777939774 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6200047a0 con 0x7fd630102b30 2024-08-18T22:04:09.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.260+0000 7fd637f64640 1 -- 172.21.15.183:0/3777939774 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6301a21f0 con 0x7fd630102b30 2024-08-18T22:04:09.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.262+0000 7fd637f64640 1 -- 172.21.15.183:0/3777939774 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd630108ce0 con 0x7fd630102b30 2024-08-18T22:04:09.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.263+0000 7fd626ffd640 1 -- 172.21.15.183:0/3777939774 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd6200041d0 con 0x7fd630102b30 2024-08-18T22:04:09.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.264+0000 7fd626ffd640 1 --2- 172.21.15.183:0/3777939774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd61c0a2b80 0x7fd61c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:09.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.264+0000 7fd626ffd640 1 -- 172.21.15.183:0/3777939774 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6723+0+0 (secure 0 0 0) 0x7fd6200cea50 con 0x7fd630102b30 2024-08-18T22:04:09.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.265+0000 7fd635d00640 1 --2- 172.21.15.183:0/3777939774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd61c0a2b80 0x7fd61c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:09.270 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.265+0000 7fd635d00640 1 --2- 172.21.15.183:0/3777939774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd61c0a2b80 0x7fd61c0a5040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd62c02aa00 tx=0x7fd62c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:09.270 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.268+0000 7fd626ffd640 1 -- 172.21.15.183:0/3777939774 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd62009bfe0 con 0x7fd630102b30 2024-08-18T22:04:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:09 smithi183 ceph-mon[22097]: purged_snaps scrub starts 2024-08-18T22:04:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:09 smithi183 ceph-mon[22097]: purged_snaps scrub ok 2024-08-18T22:04:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:04:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:09 smithi183 ceph-mon[22097]: osd.10 [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086] boot 2024-08-18T22:04:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:09 smithi183 ceph-mon[22097]: osdmap e69: 11 total, 11 up, 11 in 2024-08-18T22:04:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:04:09.451 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:09.450+0000 7fd637f64640 1 -- 172.21.15.183:0/3777939774 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd630062360 con 0x7fd61c0a2b80 2024-08-18T22:04:09.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:09 smithi123 ceph-mon[18462]: purged_snaps scrub starts 2024-08-18T22:04:09.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:09 smithi123 ceph-mon[18462]: purged_snaps scrub ok 2024-08-18T22:04:09.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:04:09.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:09 smithi123 ceph-mon[18462]: osd.10 [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086] boot 2024-08-18T22:04:09.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:09 smithi123 ceph-mon[18462]: osdmap e69: 11 total, 11 up, 11 in 2024-08-18T22:04:09.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-18T22:04:10.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: osdmap e70: 11 total, 11 up, 11 in 2024-08-18T22:04:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: Detected new or changed devices on smithi130 2024-08-18T22:04:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: Adjusting osd_memory_target on smithi130 to 4272M 2024-08-18T22:04:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:04:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:10.411 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:10.411 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:04:10.411 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:10.411 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:04:10.411 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:10.411 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:04:10.411 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:04:10.411 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:04:10.411 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:10.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: osdmap e70: 11 total, 11 up, 11 in 2024-08-18T22:04:10.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: Detected new or changed devices on smithi130 2024-08-18T22:04:10.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:10.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:10.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:10.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:10.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:10.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:10.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: Adjusting osd_memory_target on smithi130 to 4272M 2024-08-18T22:04:10.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:10.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:10.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:04:10.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:10.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:10.512 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:04:10.512 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:10.512 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:04:10.512 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:10.512 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:04:10.512 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:04:10.512 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:04:10.512 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:10.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: osdmap e70: 11 total, 11 up, 11 in 2024-08-18T22:04:10.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: Detected new or changed devices on smithi130 2024-08-18T22:04:10.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:10.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:10.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:10.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:10.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:10.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:10.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: Adjusting osd_memory_target on smithi130 to 4272M 2024-08-18T22:04:10.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:10.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:10.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:04:10.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:10.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:10.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:04:10.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:10.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:04:10.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:10.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:04:10.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:04:10.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:04:10.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:11.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:11 smithi183 ceph-mon[22097]: osdmap e71: 11 total, 11 up, 11 in 2024-08-18T22:04:11.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:11 smithi123 ceph-mon[18462]: osdmap e71: 11 total, 11 up, 11 in 2024-08-18T22:04:11.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:11 smithi130 ceph-mon[21698]: osdmap e71: 11 total, 11 up, 11 in 2024-08-18T22:04:12.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:12 smithi183 ceph-mon[22097]: osdmap e72: 11 total, 11 up, 11 in 2024-08-18T22:04:12.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:12 smithi183 ceph-mon[22097]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:12.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:12 smithi183 ceph-mon[22097]: from='client.? 172.21.15.183:0/154301624' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e39da61d-5326-4697-a188-321d5ba93b04"}]: dispatch 2024-08-18T22:04:12.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:12 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e39da61d-5326-4697-a188-321d5ba93b04"}]: dispatch 2024-08-18T22:04:12.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:12 smithi183 ceph-mon[22097]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e39da61d-5326-4697-a188-321d5ba93b04"}]': finished 2024-08-18T22:04:12.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:12 smithi183 ceph-mon[22097]: osdmap e73: 12 total, 11 up, 12 in 2024-08-18T22:04:12.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:12 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-18T22:04:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:12 smithi123 ceph-mon[18462]: osdmap e72: 11 total, 11 up, 11 in 2024-08-18T22:04:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:12 smithi123 ceph-mon[18462]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:12 smithi123 ceph-mon[18462]: from='client.? 172.21.15.183:0/154301624' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e39da61d-5326-4697-a188-321d5ba93b04"}]: dispatch 2024-08-18T22:04:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:12 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e39da61d-5326-4697-a188-321d5ba93b04"}]: dispatch 2024-08-18T22:04:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:12 smithi123 ceph-mon[18462]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e39da61d-5326-4697-a188-321d5ba93b04"}]': finished 2024-08-18T22:04:12.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:12 smithi123 ceph-mon[18462]: osdmap e73: 12 total, 11 up, 12 in 2024-08-18T22:04:12.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:12 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-18T22:04:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:12 smithi130 ceph-mon[21698]: osdmap e72: 11 total, 11 up, 11 in 2024-08-18T22:04:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:12 smithi130 ceph-mon[21698]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:12 smithi130 ceph-mon[21698]: from='client.? 172.21.15.183:0/154301624' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e39da61d-5326-4697-a188-321d5ba93b04"}]: dispatch 2024-08-18T22:04:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:12 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e39da61d-5326-4697-a188-321d5ba93b04"}]: dispatch 2024-08-18T22:04:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:12 smithi130 ceph-mon[21698]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e39da61d-5326-4697-a188-321d5ba93b04"}]': finished 2024-08-18T22:04:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:12 smithi130 ceph-mon[21698]: osdmap e73: 12 total, 11 up, 12 in 2024-08-18T22:04:12.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:12 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-18T22:04:13.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:13 smithi183 ceph-mon[22097]: from='client.? 172.21.15.183:0/3246253267' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:04:13.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:13 smithi123 ceph-mon[18462]: from='client.? 172.21.15.183:0/3246253267' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:04:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:13 smithi130 ceph-mon[21698]: from='client.? 172.21.15.183:0/3246253267' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:04:14.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:14 smithi183 ceph-mon[22097]: pgmap v215: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:14.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:14 smithi123 ceph-mon[18462]: pgmap v215: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:14 smithi130 ceph-mon[21698]: pgmap v215: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:16.647 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:16 smithi183 ceph-mon[22097]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-18T22:04:16.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:16 smithi123 ceph-mon[18462]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-18T22:04:16.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:16 smithi130 ceph-mon[21698]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-18T22:04:18.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:18 smithi183 ceph-mon[22097]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-08-18T22:04:18.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:18 smithi123 ceph-mon[18462]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-08-18T22:04:18.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:18 smithi130 ceph-mon[21698]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-08-18T22:04:19.513 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:19 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-08-18T22:04:19.513 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:19 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:19.747 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:19 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-08-18T22:04:19.747 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:19 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:19.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:19 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-08-18T22:04:19.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:19 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:20.647 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:20 smithi183 ceph-mon[22097]: Deploying daemon osd.11 on smithi183 2024-08-18T22:04:20.648 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:20 smithi183 ceph-mon[22097]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-18T22:04:20.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:20 smithi123 ceph-mon[18462]: Deploying daemon osd.11 on smithi183 2024-08-18T22:04:20.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:20 smithi123 ceph-mon[18462]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-18T22:04:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:20 smithi130 ceph-mon[21698]: Deploying daemon osd.11 on smithi183 2024-08-18T22:04:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:20 smithi130 ceph-mon[21698]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-18T22:04:22.608 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:22 smithi183 ceph-mon[22097]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-18T22:04:22.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:22 smithi123 ceph-mon[18462]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-18T22:04:22.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:22 smithi130 ceph-mon[21698]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-18T22:04:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:24 smithi183 ceph-mon[22097]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-18T22:04:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:24 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:04:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:24 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:24 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:24.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:24 smithi123 ceph-mon[18462]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-18T22:04:24.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:24 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:04:24.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:24 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:24.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:24 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:24.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:24 smithi130 ceph-mon[21698]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-18T22:04:24.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:24 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:04:24.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:24 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:24.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:24 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:26.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:26 smithi183 ceph-mon[22097]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-18T22:04:26.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:26 smithi123 ceph-mon[18462]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-18T22:04:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:26 smithi130 ceph-mon[21698]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-18T22:04:27.974 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 11 on host 'smithi183' 2024-08-18T22:04:27.974 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:27.972+0000 7fd626ffd640 1 -- 172.21.15.183:0/3777939774 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fd630062360 con 0x7fd61c0a2b80 2024-08-18T22:04:27.976 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:27.974+0000 7fd637f64640 1 -- 172.21.15.183:0/3777939774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd61c0a2b80 msgr2=0x7fd61c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:27.976 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:27.974+0000 7fd637f64640 1 --2- 172.21.15.183:0/3777939774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd61c0a2b80 0x7fd61c0a5040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd62c02aa00 tx=0x7fd62c0315b0 comp rx=0 tx=0).stop 2024-08-18T22:04:27.976 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:27.974+0000 7fd637f64640 1 -- 172.21.15.183:0/3777939774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd630102b30 msgr2=0x7fd630074310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:27.976 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:27.974+0000 7fd637f64640 1 --2- 172.21.15.183:0/3777939774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd630102b30 0x7fd630074310 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd62000d950 tx=0x7fd62000de10 comp rx=0 tx=0).stop 2024-08-18T22:04:27.976 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:27.975+0000 7fd637f64640 1 -- 172.21.15.183:0/3777939774 shutdown_connections 2024-08-18T22:04:27.976 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:27.975+0000 7fd637f64640 1 --2- 172.21.15.183:0/3777939774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6301034f0 0x7fd630074850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:27.977 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:27.975+0000 7fd637f64640 1 --2- 172.21.15.183:0/3777939774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd630102b30 0x7fd630074310 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:27.977 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:27.975+0000 7fd637f64640 1 --2- 172.21.15.183:0/3777939774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd61c0a2b80 0x7fd61c0a5040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:27.977 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:27.975+0000 7fd637f64640 1 --2- 172.21.15.183:0/3777939774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd630101930 0x7fd630075cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:27.977 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:27.975+0000 7fd637f64640 1 -- 172.21.15.183:0/3777939774 >> 172.21.15.183:0/3777939774 conn(0x7fd6300fd0e0 msgr2=0x7fd630105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:27.977 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:27.975+0000 7fd637f64640 1 -- 172.21.15.183:0/3777939774 shutdown_connections 2024-08-18T22:04:27.977 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:27.975+0000 7fd637f64640 1 -- 172.21.15.183:0/3777939774 wait complete. 2024-08-18T22:04:28.259 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:28.259 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:28.259 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:28.259 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:04:28.259 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:28.260 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:28 smithi183 ceph-mon[22097]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:28.260 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:04:28.260 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:28.260 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:28 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:28.260 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:28 smithi183 ceph-mon[22097]: from='osd.11 [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-18T22:04:28.260 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:28 smithi183 ceph-mon[22097]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-18T22:04:28.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:28.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:28.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:28.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:04:28.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:28.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:28 smithi123 ceph-mon[18462]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:04:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:28 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:28 smithi123 ceph-mon[18462]: from='osd.11 [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-18T22:04:28.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:28 smithi123 ceph-mon[18462]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-18T22:04:28.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:28.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:28.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:28.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:04:28.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:28.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:28 smithi130 ceph-mon[21698]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:28.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:04:28.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:28.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:28 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:28.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:28 smithi130 ceph-mon[21698]: from='osd.11 [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-18T22:04:28.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:28 smithi130 ceph-mon[21698]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-18T22:04:28.579 DEBUG:teuthology.orchestra.run.smithi183:osd.11> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.11.service 2024-08-18T22:04:28.582 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-08-18T22:04:28.582 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-18T22:04:28.846 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:04:29.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.289+0000 7f243f0e0640 1 -- 172.21.15.123:0/1441113037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2438107650 msgr2=0x7f2438109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:29.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.289+0000 7f243f0e0640 1 --2- 172.21.15.123:0/1441113037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2438107650 0x7f2438109a40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2430009ca0 tx=0x7f243002a8c0 comp rx=0 tx=0).stop 2024-08-18T22:04:29.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.289+0000 7f243f0e0640 1 -- 172.21.15.123:0/1441113037 shutdown_connections 2024-08-18T22:04:29.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.289+0000 7f243f0e0640 1 --2- 172.21.15.123:0/1441113037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2438107650 0x7f2438109a40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:29.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.289+0000 7f243f0e0640 1 --2- 172.21.15.123:0/1441113037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2438104d20 0x7f2438107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:29.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.289+0000 7f243f0e0640 1 --2- 172.21.15.123:0/1441113037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24381023f0 0x7f24381047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:29.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.289+0000 7f243f0e0640 1 -- 172.21.15.123:0/1441113037 >> 172.21.15.123:0/1441113037 conn(0x7f24380fbfb0 msgr2=0x7f24380fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:29.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.289+0000 7f243f0e0640 1 -- 172.21.15.123:0/1441113037 shutdown_connections 2024-08-18T22:04:29.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.289+0000 7f243f0e0640 1 -- 172.21.15.123:0/1441113037 wait complete. 2024-08-18T22:04:29.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f243f0e0640 1 Processor -- start 2024-08-18T22:04:29.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f243f0e0640 1 -- start start 2024-08-18T22:04:29.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f243f0e0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24381023f0 0x7f2438101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:29.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f243f0e0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2438104d20 0x7f24381003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:29.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f243f0e0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2438107650 0x7f24381008e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:29.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f243f0e0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f243810d5b0 con 0x7f2438104d20 2024-08-18T22:04:29.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f243f0e0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f243810d430 con 0x7f24381023f0 2024-08-18T22:04:29.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f243f0e0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f243810d730 con 0x7f2438107650 2024-08-18T22:04:29.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f2437fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2438104d20 0x7f24381003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:29.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f2437fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2438104d20 0x7f24381003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47868/0 (socket says 172.21.15.123:47868) 2024-08-18T22:04:29.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f2437fff640 1 -- 172.21.15.123:0/232391901 learned_addr learned my addr 172.21.15.123:0/232391901 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:04:29.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f243d67d640 1 --2- 172.21.15.123:0/232391901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2438107650 0x7f24381008e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:29.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f243ce7c640 1 --2- 172.21.15.123:0/232391901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24381023f0 0x7f2438101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:29.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f2437fff640 1 -- 172.21.15.123:0/232391901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2438107650 msgr2=0x7f24381008e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:29.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f2437fff640 1 --2- 172.21.15.123:0/232391901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2438107650 0x7f24381008e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:29.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f2437fff640 1 -- 172.21.15.123:0/232391901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24381023f0 msgr2=0x7f2438101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:29.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f2437fff640 1 --2- 172.21.15.123:0/232391901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24381023f0 0x7f2438101d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:29.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.290+0000 7f2437fff640 1 -- 172.21.15.123:0/232391901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24381011a0 con 0x7f2438104d20 2024-08-18T22:04:29.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.291+0000 7f2437fff640 1 --2- 172.21.15.123:0/232391901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2438104d20 0x7f24381003a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f242400e9c0 tx=0x7f242400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:29.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.291+0000 7f2435ffb640 1 -- 172.21.15.123:0/232391901 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242400cd80 con 0x7f2438104d20 2024-08-18T22:04:29.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.291+0000 7f2435ffb640 1 -- 172.21.15.123:0/232391901 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2424005500 con 0x7f2438104d20 2024-08-18T22:04:29.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.291+0000 7f243f0e0640 1 -- 172.21.15.123:0/232391901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24381a1da0 con 0x7f2438104d20 2024-08-18T22:04:29.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.291+0000 7f2435ffb640 1 -- 172.21.15.123:0/232391901 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424010690 con 0x7f2438104d20 2024-08-18T22:04:29.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.291+0000 7f243f0e0640 1 -- 172.21.15.123:0/232391901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24381a2250 con 0x7f2438104d20 2024-08-18T22:04:29.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.292+0000 7f243f0e0640 1 -- 172.21.15.123:0/232391901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24380fdaa0 con 0x7f2438104d20 2024-08-18T22:04:29.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.293+0000 7f2435ffb640 1 -- 172.21.15.123:0/232391901 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f24240046c0 con 0x7f2438104d20 2024-08-18T22:04:29.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.294+0000 7f2435ffb640 1 --2- 172.21.15.123:0/232391901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f24280a2c00 0x7f24280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:29.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.294+0000 7f243ce7c640 1 --2- 172.21.15.123:0/232391901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f24280a2c00 0x7f24280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:29.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.294+0000 7f2435ffb640 1 -- 172.21.15.123:0/232391901 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6831+0+0 (secure 0 0 0) 0x7f24240ceec0 con 0x7f2438104d20 2024-08-18T22:04:29.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.294+0000 7f243ce7c640 1 --2- 172.21.15.123:0/232391901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f24280a2c00 0x7f24280a50c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f242c009aa0 tx=0x7f242c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:29.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.298+0000 7f2435ffb640 1 -- 172.21.15.123:0/232391901 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f242409c3f0 con 0x7f2438104d20 2024-08-18T22:04:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.472+0000 7f243f0e0640 1 -- 172.21.15.123:0/232391901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f243802d7b0 con 0x7f2438104d20 2024-08-18T22:04:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.473+0000 7f2435ffb640 1 -- 172.21.15.123:0/232391901 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f242409bcf0 con 0x7f2438104d20 2024-08-18T22:04:29.474 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:04:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.475+0000 7f243f0e0640 1 -- 172.21.15.123:0/232391901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f24280a2c00 msgr2=0x7f24280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.475+0000 7f243f0e0640 1 --2- 172.21.15.123:0/232391901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f24280a2c00 0x7f24280a50c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f242c009aa0 tx=0x7f242c005f90 comp rx=0 tx=0).stop 2024-08-18T22:04:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.475+0000 7f243f0e0640 1 -- 172.21.15.123:0/232391901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2438104d20 msgr2=0x7f24381003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.475+0000 7f243f0e0640 1 --2- 172.21.15.123:0/232391901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2438104d20 0x7f24381003a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f242400e9c0 tx=0x7f242400ee80 comp rx=0 tx=0).stop 2024-08-18T22:04:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.475+0000 7f243f0e0640 1 -- 172.21.15.123:0/232391901 shutdown_connections 2024-08-18T22:04:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.475+0000 7f243f0e0640 1 --2- 172.21.15.123:0/232391901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2438107650 0x7f24381008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.475+0000 7f243f0e0640 1 --2- 172.21.15.123:0/232391901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2438104d20 0x7f24381003a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.475+0000 7f243f0e0640 1 --2- 172.21.15.123:0/232391901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f24280a2c00 0x7f24280a50c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.475+0000 7f243f0e0640 1 --2- 172.21.15.123:0/232391901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24381023f0 0x7f2438101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.475+0000 7f243f0e0640 1 -- 172.21.15.123:0/232391901 >> 172.21.15.123:0/232391901 conn(0x7f24380fbfb0 msgr2=0x7f2438102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.475+0000 7f243f0e0640 1 -- 172.21.15.123:0/232391901 shutdown_connections 2024-08-18T22:04:29.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:29.475+0000 7f243f0e0640 1 -- 172.21.15.123:0/232391901 wait complete. 2024-08-18T22:04:29.978 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:29 smithi123 ceph-mon[18462]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-18T22:04:29.978 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:29 smithi123 ceph-mon[18462]: osdmap e74: 12 total, 11 up, 12 in 2024-08-18T22:04:29.978 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:29 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-18T22:04:29.979 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:29 smithi123 ceph-mon[18462]: from='osd.11 [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:04:29.979 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:29 smithi123 ceph-mon[18462]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:04:29.979 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:29 smithi123 ceph-mon[18462]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:29.979 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:29 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/232391901' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-18T22:04:30.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:29 smithi183 ceph-mon[22097]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-18T22:04:30.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:29 smithi183 ceph-mon[22097]: osdmap e74: 12 total, 11 up, 12 in 2024-08-18T22:04:30.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:29 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-18T22:04:30.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:29 smithi183 ceph-mon[22097]: from='osd.11 [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:04:30.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:29 smithi183 ceph-mon[22097]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:04:30.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:29 smithi183 ceph-mon[22097]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:30.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:29 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/232391901' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-18T22:04:30.076 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:04:29 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:04:29.978+0000 7f8d77ba7640 -1 osd.11 0 waiting for initial osdmap 2024-08-18T22:04:30.076 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:04:29 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:04:29.995+0000 7f8d739cf640 -1 osd.11 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:04:30.250 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1724018648,"num_in_osds":12,"osd_in_since":1724018651,"num_remapped_pgs":0} 2024-08-18T22:04:30.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:29 smithi130 ceph-mon[21698]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-18T22:04:30.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:29 smithi130 ceph-mon[21698]: osdmap e74: 12 total, 11 up, 12 in 2024-08-18T22:04:30.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:29 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-18T22:04:30.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:29 smithi130 ceph-mon[21698]: from='osd.11 [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:04:30.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:29 smithi130 ceph-mon[21698]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-08-18T22:04:30.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:29 smithi130 ceph-mon[21698]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:30.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:29 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/232391901' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-18T22:04:31.117 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:30 smithi183 ceph-mon[22097]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-08-18T22:04:31.117 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:30 smithi183 ceph-mon[22097]: osdmap e75: 12 total, 11 up, 12 in 2024-08-18T22:04:31.117 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:30 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-18T22:04:31.117 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:30 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-18T22:04:31.251 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-18T22:04:31.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:30 smithi123 ceph-mon[18462]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-08-18T22:04:31.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:30 smithi123 ceph-mon[18462]: osdmap e75: 12 total, 11 up, 12 in 2024-08-18T22:04:31.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:30 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-18T22:04:31.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:30 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-18T22:04:31.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:30 smithi130 ceph-mon[21698]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-08-18T22:04:31.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:30 smithi130 ceph-mon[21698]: osdmap e75: 12 total, 11 up, 12 in 2024-08-18T22:04:31.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:30 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-18T22:04:31.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:30 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-18T22:04:31.519 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:04:32.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.979+0000 7f892934a640 1 -- 172.21.15.123:0/2705899692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89241023f0 msgr2=0x7f89241047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:32.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.979+0000 7f892934a640 1 --2- 172.21.15.123:0/2705899692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89241023f0 0x7f89241047e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f891c009900 tx=0x7f891c02a410 comp rx=0 tx=0).stop 2024-08-18T22:04:32.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.980+0000 7f892934a640 1 -- 172.21.15.123:0/2705899692 shutdown_connections 2024-08-18T22:04:32.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.980+0000 7f892934a640 1 --2- 172.21.15.123:0/2705899692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8924107650 0x7f8924109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:32.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.980+0000 7f892934a640 1 --2- 172.21.15.123:0/2705899692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8924104d20 0x7f8924107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:32.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.980+0000 7f892934a640 1 --2- 172.21.15.123:0/2705899692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89241023f0 0x7f89241047e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:32.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.980+0000 7f892934a640 1 -- 172.21.15.123:0/2705899692 >> 172.21.15.123:0/2705899692 conn(0x7f89240fbfb0 msgr2=0x7f89240fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:32.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.980+0000 7f892934a640 1 -- 172.21.15.123:0/2705899692 shutdown_connections 2024-08-18T22:04:32.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.980+0000 7f892934a640 1 -- 172.21.15.123:0/2705899692 wait complete. 2024-08-18T22:04:32.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.980+0000 7f892934a640 1 Processor -- start 2024-08-18T22:04:32.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.980+0000 7f892934a640 1 -- start start 2024-08-18T22:04:32.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f892934a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89241023f0 0x7f8924197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:32.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f892934a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8924104d20 0x7f89241981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:32.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f892934a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8924107650 0x7f892419f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:32.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f892934a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f892410d630 con 0x7f8924107650 2024-08-18T22:04:32.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f892934a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f892410d4b0 con 0x7f89241023f0 2024-08-18T22:04:32.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f892934a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f892410d7b0 con 0x7f8924104d20 2024-08-18T22:04:32.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f89237fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8924107650 0x7f892419f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:32.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f89237fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8924107650 0x7f892419f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47888/0 (socket says 172.21.15.123:47888) 2024-08-18T22:04:32.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f89237fe640 1 -- 172.21.15.123:0/3293890541 learned_addr learned my addr 172.21.15.123:0/3293890541 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:04:32.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f8922ffd640 1 --2- 172.21.15.123:0/3293890541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89241023f0 0x7f8924197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:32.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f89227fc640 1 --2- 172.21.15.123:0/3293890541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8924104d20 0x7f89241981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:32.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f89237fe640 1 -- 172.21.15.123:0/3293890541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8924104d20 msgr2=0x7f89241981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:32.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f89237fe640 1 --2- 172.21.15.123:0/3293890541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8924104d20 0x7f89241981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:32.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f89237fe640 1 -- 172.21.15.123:0/3293890541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89241023f0 msgr2=0x7f8924197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:32.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f89237fe640 1 --2- 172.21.15.123:0/3293890541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89241023f0 0x7f8924197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:32.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f89237fe640 1 -- 172.21.15.123:0/3293890541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892419f8d0 con 0x7f8924107650 2024-08-18T22:04:32.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.981+0000 7f89237fe640 1 --2- 172.21.15.123:0/3293890541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8924107650 0x7f892419f260 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8914009fd0 tx=0x7f891400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:32.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.982+0000 7f890bfff640 1 -- 172.21.15.123:0/3293890541 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914011830 con 0x7f8924107650 2024-08-18T22:04:32.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.982+0000 7f892934a640 1 -- 172.21.15.123:0/3293890541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892419fbc0 con 0x7f8924107650 2024-08-18T22:04:32.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.982+0000 7f890bfff640 1 -- 172.21.15.123:0/3293890541 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8914016070 con 0x7f8924107650 2024-08-18T22:04:32.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.982+0000 7f890bfff640 1 -- 172.21.15.123:0/3293890541 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891400f2e0 con 0x7f8924107650 2024-08-18T22:04:32.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.982+0000 7f892934a640 1 -- 172.21.15.123:0/3293890541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89241a0180 con 0x7f8924107650 2024-08-18T22:04:32.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.983+0000 7f892934a640 1 -- 172.21.15.123:0/3293890541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89240fdaa0 con 0x7f8924107650 2024-08-18T22:04:32.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.984+0000 7f890bfff640 1 -- 172.21.15.123:0/3293890541 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f89140119d0 con 0x7f8924107650 2024-08-18T22:04:32.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.985+0000 7f890bfff640 1 --2- 172.21.15.123:0/3293890541 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f890c0a2b80 0x7f890c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:32.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.985+0000 7f8922ffd640 1 --2- 172.21.15.123:0/3293890541 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f890c0a2b80 0x7f890c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:32.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.985+0000 7f890bfff640 1 -- 172.21.15.123:0/3293890541 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f89140ce900 con 0x7f8924107650 2024-08-18T22:04:32.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.986+0000 7f8922ffd640 1 --2- 172.21.15.123:0/3293890541 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f890c0a2b80 0x7f890c0a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8924198b90 tx=0x7f891c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:32.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:31.988+0000 7f890bfff640 1 -- 172.21.15.123:0/3293890541 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f891409bd00 con 0x7f8924107650 2024-08-18T22:04:32.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:32.157+0000 7f892934a640 1 -- 172.21.15.123:0/3293890541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f892402d790 con 0x7f8924107650 2024-08-18T22:04:32.159 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: purged_snaps scrub starts 2024-08-18T22:04:32.159 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: purged_snaps scrub ok 2024-08-18T22:04:32.159 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: osd.11 [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724] boot 2024-08-18T22:04:32.159 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: osdmap e76: 12 total, 12 up, 12 in 2024-08-18T22:04:32.159 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-18T22:04:32.159 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:32.159 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: Detected new or changed devices on smithi183 2024-08-18T22:04:32.159 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:32.159 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:32.159 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:32.160 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:32.160 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:32.160 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:32.160 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: Adjusting osd_memory_target on smithi183 to 4272M 2024-08-18T22:04:32.160 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:32.160 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:32.160 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:04:32.160 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:31 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:32.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:32.158+0000 7f890bfff640 1 -- 172.21.15.123:0/3293890541 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) ==== 74+0+133 (secure 0 0 0) 0x7f891409b600 con 0x7f8924107650 2024-08-18T22:04:32.161 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:04:32.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:32.160+0000 7f892934a640 1 -- 172.21.15.123:0/3293890541 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f890c0a2b80 msgr2=0x7f890c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:32.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:32.160+0000 7f892934a640 1 --2- 172.21.15.123:0/3293890541 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f890c0a2b80 0x7f890c0a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8924198b90 tx=0x7f891c000bc0 comp rx=0 tx=0).stop 2024-08-18T22:04:32.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:32.160+0000 7f892934a640 1 -- 172.21.15.123:0/3293890541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8924107650 msgr2=0x7f892419f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:32.160+0000 7f892934a640 1 --2- 172.21.15.123:0/3293890541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8924107650 0x7f892419f260 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8914009fd0 tx=0x7f891400b8e0 comp rx=0 tx=0).stop 2024-08-18T22:04:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:32.160+0000 7f892934a640 1 -- 172.21.15.123:0/3293890541 shutdown_connections 2024-08-18T22:04:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:32.160+0000 7f892934a640 1 --2- 172.21.15.123:0/3293890541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8924107650 0x7f892419f260 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:32.160+0000 7f892934a640 1 --2- 172.21.15.123:0/3293890541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8924104d20 0x7f89241981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:32.160+0000 7f892934a640 1 --2- 172.21.15.123:0/3293890541 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f890c0a2b80 0x7f890c0a5040 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:32.160+0000 7f892934a640 1 --2- 172.21.15.123:0/3293890541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89241023f0 0x7f8924197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:32.160+0000 7f892934a640 1 -- 172.21.15.123:0/3293890541 >> 172.21.15.123:0/3293890541 conn(0x7f89240fbfb0 msgr2=0x7f8924102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:32.160+0000 7f892934a640 1 -- 172.21.15.123:0/3293890541 shutdown_connections 2024-08-18T22:04:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:32.160+0000 7f892934a640 1 -- 172.21.15.123:0/3293890541 wait complete. 2024-08-18T22:04:32.163 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: purged_snaps scrub starts 2024-08-18T22:04:32.163 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: purged_snaps scrub ok 2024-08-18T22:04:32.163 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: osd.11 [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724] boot 2024-08-18T22:04:32.163 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: osdmap e76: 12 total, 12 up, 12 in 2024-08-18T22:04:32.163 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-18T22:04:32.163 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:32.163 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: Detected new or changed devices on smithi183 2024-08-18T22:04:32.163 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:32.163 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:32.163 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:32.164 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:32.164 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:32.164 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:32.164 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: Adjusting osd_memory_target on smithi183 to 4272M 2024-08-18T22:04:32.164 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:32.164 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:32.164 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:04:32.164 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:31 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:32.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: purged_snaps scrub starts 2024-08-18T22:04:32.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: purged_snaps scrub ok 2024-08-18T22:04:32.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: osd.11 [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724] boot 2024-08-18T22:04:32.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: osdmap e76: 12 total, 12 up, 12 in 2024-08-18T22:04:32.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-18T22:04:32.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-08-18T22:04:32.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: Detected new or changed devices on smithi183 2024-08-18T22:04:32.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:32.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:32.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:32.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:32.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:32.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:04:32.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: Adjusting osd_memory_target on smithi183 to 4272M 2024-08-18T22:04:32.266 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:32.266 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:32.266 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:04:32.266 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:31 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:32.886 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":77,"num_osds":12,"num_up_osds":12,"osd_up_since":1724018670,"num_in_osds":12,"osd_in_since":1724018651,"num_remapped_pgs":0} 2024-08-18T22:04:32.887 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:04:33.176 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:04:33.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:32 smithi123 ceph-mon[18462]: osdmap e77: 12 total, 12 up, 12 in 2024-08-18T22:04:33.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:32 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3293890541' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-18T22:04:33.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:32 smithi130 ceph-mon[21698]: osdmap e77: 12 total, 12 up, 12 in 2024-08-18T22:04:33.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:32 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3293890541' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-18T22:04:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:32 smithi183 ceph-mon[22097]: osdmap e77: 12 total, 12 up, 12 in 2024-08-18T22:04:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:32 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3293890541' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-18T22:04:33.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.653+0000 7ff8ab2fb640 1 -- 172.21.15.123:0/3212263881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a4102a70 msgr2=0x7ff8a4102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:33.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.653+0000 7ff8ab2fb640 1 --2- 172.21.15.123:0/3212263881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a4102a70 0x7ff8a4102e50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff894009ca0 tx=0x7ff89402a950 comp rx=0 tx=0).stop 2024-08-18T22:04:33.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.653+0000 7ff8ab2fb640 1 -- 172.21.15.123:0/3212263881 shutdown_connections 2024-08-18T22:04:33.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.653+0000 7ff8ab2fb640 1 --2- 172.21.15.123:0/3212263881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8a410bea0 0x7ff8a410e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:33.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.653+0000 7ff8ab2fb640 1 --2- 172.21.15.123:0/3212263881 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a4103390 0x7ff8a410b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:33.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.653+0000 7ff8ab2fb640 1 --2- 172.21.15.123:0/3212263881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a4102a70 0x7ff8a4102e50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:33.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.653+0000 7ff8ab2fb640 1 -- 172.21.15.123:0/3212263881 >> 172.21.15.123:0/3212263881 conn(0x7ff8a40fc4d0 msgr2=0x7ff8a40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:33.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.654+0000 7ff8ab2fb640 1 -- 172.21.15.123:0/3212263881 shutdown_connections 2024-08-18T22:04:33.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.654+0000 7ff8ab2fb640 1 -- 172.21.15.123:0/3212263881 wait complete. 2024-08-18T22:04:33.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.654+0000 7ff8ab2fb640 1 Processor -- start 2024-08-18T22:04:33.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.654+0000 7ff8ab2fb640 1 -- start start 2024-08-18T22:04:33.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.654+0000 7ff8ab2fb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8a4102a70 0x7ff8a41006d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:33.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.654+0000 7ff8ab2fb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a4103390 0x7ff8a4100c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:33.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.654+0000 7ff8ab2fb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a410bea0 0x7ff8a4101150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:33.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.654+0000 7ff8ab2fb640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4111ca0 con 0x7ff8a4103390 2024-08-18T22:04:33.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.654+0000 7ff8ab2fb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4111b20 con 0x7ff8a4102a70 2024-08-18T22:04:33.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.654+0000 7ff8ab2fb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4111e20 con 0x7ff8a410bea0 2024-08-18T22:04:33.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.654+0000 7ff8a8896640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a4103390 0x7ff8a4100c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:33.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.654+0000 7ff8a8896640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a4103390 0x7ff8a4100c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43462/0 (socket says 172.21.15.123:43462) 2024-08-18T22:04:33.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.654+0000 7ff8a8896640 1 -- 172.21.15.123:0/954326793 learned_addr learned my addr 172.21.15.123:0/954326793 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:04:33.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.655+0000 7ff8a9898640 1 --2- 172.21.15.123:0/954326793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a410bea0 0x7ff8a4101150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:33.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.655+0000 7ff8a8896640 1 -- 172.21.15.123:0/954326793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a410bea0 msgr2=0x7ff8a4101150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:33.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.655+0000 7ff8a8896640 1 --2- 172.21.15.123:0/954326793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a410bea0 0x7ff8a4101150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:33.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.655+0000 7ff8a8896640 1 -- 172.21.15.123:0/954326793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8a4102a70 msgr2=0x7ff8a41006d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:33.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.655+0000 7ff8a8896640 1 --2- 172.21.15.123:0/954326793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8a4102a70 0x7ff8a41006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:33.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.655+0000 7ff8a8896640 1 -- 172.21.15.123:0/954326793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a41a6640 con 0x7ff8a4103390 2024-08-18T22:04:33.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.655+0000 7ff8a9898640 1 --2- 172.21.15.123:0/954326793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a410bea0 0x7ff8a4101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:04:33.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.655+0000 7ff8a8896640 1 --2- 172.21.15.123:0/954326793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a4103390 0x7ff8a4100c10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff89800c970 tx=0x7ff89800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:33.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.655+0000 7ff8a27fc640 1 -- 172.21.15.123:0/954326793 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898007bb0 con 0x7ff8a4103390 2024-08-18T22:04:33.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.655+0000 7ff8ab2fb640 1 -- 172.21.15.123:0/954326793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a41a6930 con 0x7ff8a4103390 2024-08-18T22:04:33.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.655+0000 7ff8a27fc640 1 -- 172.21.15.123:0/954326793 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff898007d50 con 0x7ff8a4103390 2024-08-18T22:04:33.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.655+0000 7ff8a27fc640 1 -- 172.21.15.123:0/954326793 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898018820 con 0x7ff8a4103390 2024-08-18T22:04:33.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.655+0000 7ff8ab2fb640 1 -- 172.21.15.123:0/954326793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a41a6ec0 con 0x7ff8a4103390 2024-08-18T22:04:33.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.656+0000 7ff8ab2fb640 1 -- 172.21.15.123:0/954326793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8a4102e50 con 0x7ff8a4103390 2024-08-18T22:04:33.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.658+0000 7ff8a27fc640 1 -- 172.21.15.123:0/954326793 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7ff8980189c0 con 0x7ff8a4103390 2024-08-18T22:04:33.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.659+0000 7ff8a27fc640 1 --2- 172.21.15.123:0/954326793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff88c0a2b80 0x7ff88c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:33.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.659+0000 7ff8a9097640 1 --2- 172.21.15.123:0/954326793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff88c0a2b80 0x7ff88c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:33.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.659+0000 7ff8a27fc640 1 -- 172.21.15.123:0/954326793 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7ff8980cefa0 con 0x7ff8a4103390 2024-08-18T22:04:33.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.659+0000 7ff8a9097640 1 --2- 172.21.15.123:0/954326793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff88c0a2b80 0x7ff88c0a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff894009ca0 tx=0x7ff894005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:33.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.662+0000 7ff8a27fc640 1 -- 172.21.15.123:0/954326793 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff898014030 con 0x7ff8a4103390 2024-08-18T22:04:33.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.828+0000 7ff8ab2fb640 1 -- 172.21.15.123:0/954326793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8a4101c00 con 0x7ff8a4103390 2024-08-18T22:04:33.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.828+0000 7ff8a27fc640 1 -- 172.21.15.123:0/954326793 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+18516 (secure 0 0 0) 0x7ff89809c430 con 0x7ff8a4103390 2024-08-18T22:04:33.830 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:04:33.830 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":77,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:04:31.982767+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:04:33.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.830+0000 7ff8ab2fb640 1 -- 172.21.15.123:0/954326793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff88c0a2b80 msgr2=0x7ff88c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:33.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.830+0000 7ff8ab2fb640 1 --2- 172.21.15.123:0/954326793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff88c0a2b80 0x7ff88c0a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff894009ca0 tx=0x7ff894005ef0 comp rx=0 tx=0).stop 2024-08-18T22:04:33.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.831+0000 7ff8ab2fb640 1 -- 172.21.15.123:0/954326793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a4103390 msgr2=0x7ff8a4100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:33.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.831+0000 7ff8ab2fb640 1 --2- 172.21.15.123:0/954326793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a4103390 0x7ff8a4100c10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff89800c970 tx=0x7ff89800ce30 comp rx=0 tx=0).stop 2024-08-18T22:04:33.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.831+0000 7ff8ab2fb640 1 -- 172.21.15.123:0/954326793 shutdown_connections 2024-08-18T22:04:33.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.831+0000 7ff8ab2fb640 1 --2- 172.21.15.123:0/954326793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a410bea0 0x7ff8a4101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:33.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.831+0000 7ff8ab2fb640 1 --2- 172.21.15.123:0/954326793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a4103390 0x7ff8a4100c10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:33.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.831+0000 7ff8ab2fb640 1 --2- 172.21.15.123:0/954326793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff88c0a2b80 0x7ff88c0a5040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:33.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.831+0000 7ff8ab2fb640 1 --2- 172.21.15.123:0/954326793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8a4102a70 0x7ff8a41006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:33.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.831+0000 7ff8ab2fb640 1 -- 172.21.15.123:0/954326793 >> 172.21.15.123:0/954326793 conn(0x7ff8a40fc4d0 msgr2=0x7ff8a40fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:33.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.831+0000 7ff8ab2fb640 1 -- 172.21.15.123:0/954326793 shutdown_connections 2024-08-18T22:04:33.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:33.831+0000 7ff8ab2fb640 1 -- 172.21.15.123:0/954326793 wait complete. 2024-08-18T22:04:34.206 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:34 smithi123 ceph-mon[18462]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:34.206 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:34 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/954326793' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:04:34.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:34 smithi130 ceph-mon[21698]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:34.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:34 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/954326793' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:04:34.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:34 smithi183 ceph-mon[22097]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:34.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:34 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/954326793' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:04:34.637 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:01:09.550765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-18T22:04:34.638 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-18T22:04:34.884 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:04:35.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.342+0000 7f6d7d900640 1 -- 172.21.15.123:0/3483628885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d78102250 msgr2=0x7f6d7810e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:35.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.342+0000 7f6d7d900640 1 --2- 172.21.15.123:0/3483628885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d78102250 0x7f6d7810e780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009cd0 tx=0x7f6d7002a8e0 comp rx=0 tx=0).stop 2024-08-18T22:04:35.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.342+0000 7f6d7d900640 1 -- 172.21.15.123:0/3483628885 shutdown_connections 2024-08-18T22:04:35.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.342+0000 7f6d7d900640 1 --2- 172.21.15.123:0/3483628885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d78102250 0x7f6d7810e780 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:35.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.342+0000 7f6d7d900640 1 --2- 172.21.15.123:0/3483628885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d781018b0 0x7f6d78101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:35.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.342+0000 7f6d7d900640 1 --2- 172.21.15.123:0/3483628885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d781078b0 0x7f6d78107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:35.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.342+0000 7f6d7d900640 1 -- 172.21.15.123:0/3483628885 >> 172.21.15.123:0/3483628885 conn(0x7f6d780fd5f0 msgr2=0x7f6d780ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:35.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.342+0000 7f6d7d900640 1 -- 172.21.15.123:0/3483628885 shutdown_connections 2024-08-18T22:04:35.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.342+0000 7f6d7d900640 1 -- 172.21.15.123:0/3483628885 wait complete. 2024-08-18T22:04:35.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d7d900640 1 Processor -- start 2024-08-18T22:04:35.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d7d900640 1 -- start start 2024-08-18T22:04:35.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d7d900640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d781018b0 0x7f6d78198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:35.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d7d900640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d78102250 0x7f6d781986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:35.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d7d900640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d781078b0 0x7f6d7819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:35.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d7d900640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6d78111cb0 con 0x7f6d781018b0 2024-08-18T22:04:35.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d7d900640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6d78111b30 con 0x7f6d781078b0 2024-08-18T22:04:35.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d7d900640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6d78111e30 con 0x7f6d78102250 2024-08-18T22:04:35.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d76ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d781018b0 0x7f6d78198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:35.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d76ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d781018b0 0x7f6d78198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43486/0 (socket says 172.21.15.123:43486) 2024-08-18T22:04:35.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d76ffd640 1 -- 172.21.15.123:0/3702840610 learned_addr learned my addr 172.21.15.123:0/3702840610 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:04:35.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d777fe640 1 --2- 172.21.15.123:0/3702840610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d781078b0 0x7f6d7819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:35.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d6ffff640 1 --2- 172.21.15.123:0/3702840610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d78102250 0x7f6d781986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:35.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d76ffd640 1 -- 172.21.15.123:0/3702840610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d78102250 msgr2=0x7f6d781986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:35.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d76ffd640 1 --2- 172.21.15.123:0/3702840610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d78102250 0x7f6d781986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:35.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d76ffd640 1 -- 172.21.15.123:0/3702840610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d781078b0 msgr2=0x7f6d7819ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:35.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.343+0000 7f6d76ffd640 1 --2- 172.21.15.123:0/3702840610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d781078b0 0x7f6d7819ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:35.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.344+0000 7f6d76ffd640 1 -- 172.21.15.123:0/3702840610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d7819d120 con 0x7f6d781018b0 2024-08-18T22:04:35.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.344+0000 7f6d76ffd640 1 --2- 172.21.15.123:0/3702840610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d781018b0 0x7f6d78198170 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800d770 tx=0x7f6d6800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:35.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.344+0000 7f6d7c8fe640 1 -- 172.21.15.123:0/3702840610 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d68017070 con 0x7f6d781018b0 2024-08-18T22:04:35.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.344+0000 7f6d7c8fe640 1 -- 172.21.15.123:0/3702840610 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d68005500 con 0x7f6d781018b0 2024-08-18T22:04:35.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.344+0000 7f6d7d900640 1 -- 172.21.15.123:0/3702840610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d7819d410 con 0x7f6d781018b0 2024-08-18T22:04:35.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.344+0000 7f6d7c8fe640 1 -- 172.21.15.123:0/3702840610 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d68004e00 con 0x7f6d781018b0 2024-08-18T22:04:35.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.344+0000 7f6d7d900640 1 -- 172.21.15.123:0/3702840610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d781a4cf0 con 0x7f6d781018b0 2024-08-18T22:04:35.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.345+0000 7f6d7d900640 1 -- 172.21.15.123:0/3702840610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d78101d10 con 0x7f6d781018b0 2024-08-18T22:04:35.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.346+0000 7f6d7c8fe640 1 -- 172.21.15.123:0/3702840610 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6d68004fa0 con 0x7f6d781018b0 2024-08-18T22:04:35.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.347+0000 7f6d7c8fe640 1 --2- 172.21.15.123:0/3702840610 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6d640a2b80 0x7f6d640a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:35.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.347+0000 7f6d6ffff640 1 --2- 172.21.15.123:0/3702840610 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6d640a2b80 0x7f6d640a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:35.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.347+0000 7f6d7c8fe640 1 -- 172.21.15.123:0/3702840610 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f6d680ce510 con 0x7f6d781018b0 2024-08-18T22:04:35.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.347+0000 7f6d6ffff640 1 --2- 172.21.15.123:0/3702840610 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6d640a2b80 0x7f6d640a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6d780ffbe0 tx=0x7f6d6000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:35.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.351+0000 7f6d7c8fe640 1 -- 172.21.15.123:0/3702840610 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6d6809b2c0 con 0x7f6d781018b0 2024-08-18T22:04:35.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.519+0000 7f6d7d900640 1 -- 172.21.15.123:0/3702840610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6d7802d5e0 con 0x7f6d781018b0 2024-08-18T22:04:35.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.520+0000 7f6d7c8fe640 1 -- 172.21.15.123:0/3702840610 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f6d6809f5c0 con 0x7f6d781018b0 2024-08-18T22:04:35.521 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-08-18T22:04:35.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.522+0000 7f6d7d900640 1 -- 172.21.15.123:0/3702840610 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6d640a2b80 msgr2=0x7f6d640a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:35.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.522+0000 7f6d7d900640 1 --2- 172.21.15.123:0/3702840610 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6d640a2b80 0x7f6d640a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6d780ffbe0 tx=0x7f6d6000b390 comp rx=0 tx=0).stop 2024-08-18T22:04:35.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.522+0000 7f6d7d900640 1 -- 172.21.15.123:0/3702840610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d781018b0 msgr2=0x7f6d78198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:35.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.522+0000 7f6d7d900640 1 --2- 172.21.15.123:0/3702840610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d781018b0 0x7f6d78198170 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800d770 tx=0x7f6d6800dc30 comp rx=0 tx=0).stop 2024-08-18T22:04:35.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.522+0000 7f6d7d900640 1 -- 172.21.15.123:0/3702840610 shutdown_connections 2024-08-18T22:04:35.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.522+0000 7f6d7d900640 1 --2- 172.21.15.123:0/3702840610 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6d640a2b80 0x7f6d640a5040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:35.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.522+0000 7f6d7d900640 1 --2- 172.21.15.123:0/3702840610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d781078b0 0x7f6d7819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:35.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.522+0000 7f6d7d900640 1 --2- 172.21.15.123:0/3702840610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d78102250 0x7f6d781986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:35.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.522+0000 7f6d7d900640 1 --2- 172.21.15.123:0/3702840610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d781018b0 0x7f6d78198170 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:35.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.522+0000 7f6d7d900640 1 -- 172.21.15.123:0/3702840610 >> 172.21.15.123:0/3702840610 conn(0x7f6d780fd5f0 msgr2=0x7f6d780fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:35.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.522+0000 7f6d7d900640 1 -- 172.21.15.123:0/3702840610 shutdown_connections 2024-08-18T22:04:35.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:35.522+0000 7f6d7d900640 1 -- 172.21.15.123:0/3702840610 wait complete. 2024-08-18T22:04:36.163 INFO:tasks.cephadm:Adding mds.a on smithi123 2024-08-18T22:04:36.163 INFO:tasks.cephadm:Adding mds.d on smithi123 2024-08-18T22:04:36.163 INFO:tasks.cephadm:Adding mds.g on smithi123 2024-08-18T22:04:36.163 INFO:tasks.cephadm:Adding mds.j on smithi123 2024-08-18T22:04:36.163 INFO:tasks.cephadm:Adding mds.b on smithi130 2024-08-18T22:04:36.163 INFO:tasks.cephadm:Adding mds.e on smithi130 2024-08-18T22:04:36.163 INFO:tasks.cephadm:Adding mds.h on smithi130 2024-08-18T22:04:36.163 INFO:tasks.cephadm:Adding mds.k on smithi130 2024-08-18T22:04:36.163 INFO:tasks.cephadm:Adding mds.c on smithi183 2024-08-18T22:04:36.163 INFO:tasks.cephadm:Adding mds.f on smithi183 2024-08-18T22:04:36.163 INFO:tasks.cephadm:Adding mds.i on smithi183 2024-08-18T22:04:36.164 INFO:tasks.cephadm:Adding mds.l on smithi183 2024-08-18T22:04:36.164 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph orch apply mds all '12;smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l' 2024-08-18T22:04:36.430 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T22:04:36.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:36 smithi123 ceph-mon[18462]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:36.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:36 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3702840610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-18T22:04:36.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:36 smithi183 ceph-mon[22097]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:36.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:36 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3702840610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-18T22:04:36.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:36 smithi130 ceph-mon[21698]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:36.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:36 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3702840610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-18T22:04:36.930 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.904+0000 7f8011f8d640 1 -- 172.21.15.183:0/2471581471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c102bd0 msgr2=0x7f800c103050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:36.930 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.904+0000 7f8011f8d640 1 --2- 172.21.15.183:0/2471581471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c102bd0 0x7f800c103050 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8000009930 tx=0x7f800002a420 comp rx=0 tx=0).stop 2024-08-18T22:04:36.930 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.904+0000 7f8011f8d640 1 -- 172.21.15.183:0/2471581471 shutdown_connections 2024-08-18T22:04:36.930 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.904+0000 7f8011f8d640 1 --2- 172.21.15.183:0/2471581471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c103590 0x7f800c109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:36.930 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.904+0000 7f8011f8d640 1 --2- 172.21.15.183:0/2471581471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c102bd0 0x7f800c103050 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:36.930 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.904+0000 7f8011f8d640 1 --2- 172.21.15.183:0/2471581471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f800c0ffbf0 0x7f800c0ffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:36.930 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.904+0000 7f8011f8d640 1 -- 172.21.15.183:0/2471581471 >> 172.21.15.183:0/2471581471 conn(0x7f800c0fb760 msgr2=0x7f800c0fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:36.930 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.904+0000 7f8011f8d640 1 -- 172.21.15.183:0/2471581471 shutdown_connections 2024-08-18T22:04:36.930 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.904+0000 7f8011f8d640 1 -- 172.21.15.183:0/2471581471 wait complete. 2024-08-18T22:04:36.930 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.905+0000 7f8011f8d640 1 Processor -- start 2024-08-18T22:04:36.931 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.905+0000 7f8011f8d640 1 -- start start 2024-08-18T22:04:36.931 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.905+0000 7f8011f8d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c0ffbf0 0x7f800c102530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:36.931 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.905+0000 7f8011f8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c102bd0 0x7f800c100b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:36.931 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.905+0000 7f8011f8d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f800c103590 0x7f800c1010c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:36.931 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.905+0000 7f8011f8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f800c10d6d0 con 0x7f800c102bd0 2024-08-18T22:04:36.931 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.905+0000 7f8011f8d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f800c10d550 con 0x7f800c103590 2024-08-18T22:04:36.931 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.905+0000 7f8011f8d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f800c10d850 con 0x7f800c0ffbf0 2024-08-18T22:04:36.931 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.905+0000 7f800b7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c0ffbf0 0x7f800c102530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:36.931 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.905+0000 7f800b7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c0ffbf0 0x7f800c102530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:35626/0 (socket says 172.21.15.183:35626) 2024-08-18T22:04:36.931 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.905+0000 7f800b7fe640 1 -- 172.21.15.183:0/3085916653 learned_addr learned my addr 172.21.15.183:0/3085916653 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-08-18T22:04:36.931 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.905+0000 7f800affd640 1 --2- 172.21.15.183:0/3085916653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c102bd0 0x7f800c100b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:36.931 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.905+0000 7f800bfff640 1 --2- 172.21.15.183:0/3085916653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f800c103590 0x7f800c1010c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:36.931 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.906+0000 7f800b7fe640 1 -- 172.21.15.183:0/3085916653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f800c103590 msgr2=0x7f800c1010c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:36.932 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.906+0000 7f800b7fe640 1 --2- 172.21.15.183:0/3085916653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f800c103590 0x7f800c1010c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:36.932 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.906+0000 7f800b7fe640 1 -- 172.21.15.183:0/3085916653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c102bd0 msgr2=0x7f800c100b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:36.932 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.906+0000 7f800b7fe640 1 --2- 172.21.15.183:0/3085916653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c102bd0 0x7f800c100b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:36.932 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.906+0000 7f800b7fe640 1 -- 172.21.15.183:0/3085916653 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800c101980 con 0x7f800c0ffbf0 2024-08-18T22:04:36.932 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.906+0000 7f800affd640 1 --2- 172.21.15.183:0/3085916653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c102bd0 0x7f800c100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:04:36.932 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.906+0000 7f800b7fe640 1 --2- 172.21.15.183:0/3085916653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c0ffbf0 0x7f800c102530 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00b450 tx=0x7f7ffc00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:36.932 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.906+0000 7f8008ff9640 1 -- 172.21.15.183:0/3085916653 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc015020 con 0x7f800c0ffbf0 2024-08-18T22:04:36.932 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.906+0000 7f8008ff9640 1 -- 172.21.15.183:0/3085916653 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ffc011d70 con 0x7f800c0ffbf0 2024-08-18T22:04:36.932 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.906+0000 7f8011f8d640 1 -- 172.21.15.183:0/3085916653 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800c1a1fa0 con 0x7f800c0ffbf0 2024-08-18T22:04:36.932 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.906+0000 7f8008ff9640 1 -- 172.21.15.183:0/3085916653 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00f340 con 0x7f800c0ffbf0 2024-08-18T22:04:36.932 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.906+0000 7f8011f8d640 1 -- 172.21.15.183:0/3085916653 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f800c1a23c0 con 0x7f800c0ffbf0 2024-08-18T22:04:36.932 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.907+0000 7f8011f8d640 1 -- 172.21.15.183:0/3085916653 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f800c108ee0 con 0x7f800c0ffbf0 2024-08-18T22:04:36.932 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.909+0000 7f8008ff9640 1 -- 172.21.15.183:0/3085916653 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f7ffc018020 con 0x7f800c0ffbf0 2024-08-18T22:04:36.933 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.909+0000 7f8008ff9640 1 --2- 172.21.15.183:0/3085916653 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7ff40a2b80 0x7f7ff40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:36.933 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.910+0000 7f8008ff9640 1 -- 172.21.15.183:0/3085916653 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f7ffc0cec10 con 0x7f800c0ffbf0 2024-08-18T22:04:36.933 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.910+0000 7f800affd640 1 --2- 172.21.15.183:0/3085916653 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7ff40a2b80 0x7f7ff40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:36.933 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.910+0000 7f800affd640 1 --2- 172.21.15.183:0/3085916653 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7ff40a2b80 0x7f7ff40a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8000006010 tx=0x7f8000000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:36.933 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:36.913+0000 7f8008ff9640 1 -- 172.21.15.183:0/3085916653 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7ffc01f020 con 0x7f800c0ffbf0 2024-08-18T22:04:37.093 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:37.091+0000 7f8011f8d640 1 -- 172.21.15.183:0/3085916653 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l", "target": ["mon-mgr", ""]}) -- 0x7f800c062460 con 0x7f7ff40a2b80 2024-08-18T22:04:37.100 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:37.099+0000 7f8008ff9640 1 -- 172.21.15.183:0/3085916653 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f800c062460 con 0x7f7ff40a2b80 2024-08-18T22:04:37.101 INFO:teuthology.orchestra.run.smithi183.stdout:Scheduled mds.all update... 2024-08-18T22:04:37.103 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:37.101+0000 7f8011f8d640 1 -- 172.21.15.183:0/3085916653 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7ff40a2b80 msgr2=0x7f7ff40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:37.103 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:37.101+0000 7f8011f8d640 1 --2- 172.21.15.183:0/3085916653 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7ff40a2b80 0x7f7ff40a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8000006010 tx=0x7f8000000bc0 comp rx=0 tx=0).stop 2024-08-18T22:04:37.103 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:37.101+0000 7f8011f8d640 1 -- 172.21.15.183:0/3085916653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c0ffbf0 msgr2=0x7f800c102530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:37.103 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:37.101+0000 7f8011f8d640 1 --2- 172.21.15.183:0/3085916653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c0ffbf0 0x7f800c102530 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00b450 tx=0x7f7ffc00b910 comp rx=0 tx=0).stop 2024-08-18T22:04:37.103 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:37.101+0000 7f8011f8d640 1 -- 172.21.15.183:0/3085916653 shutdown_connections 2024-08-18T22:04:37.103 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:37.101+0000 7f8011f8d640 1 --2- 172.21.15.183:0/3085916653 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7ff40a2b80 0x7f7ff40a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:37.103 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:37.101+0000 7f8011f8d640 1 --2- 172.21.15.183:0/3085916653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f800c103590 0x7f800c1010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:37.103 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:37.101+0000 7f8011f8d640 1 --2- 172.21.15.183:0/3085916653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c102bd0 0x7f800c100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:37.103 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:37.101+0000 7f8011f8d640 1 --2- 172.21.15.183:0/3085916653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c0ffbf0 0x7f800c102530 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:37.103 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:37.101+0000 7f8011f8d640 1 -- 172.21.15.183:0/3085916653 >> 172.21.15.183:0/3085916653 conn(0x7f800c0fb760 msgr2=0x7f800c1060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:37.104 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:37.101+0000 7f8011f8d640 1 -- 172.21.15.183:0/3085916653 shutdown_connections 2024-08-18T22:04:37.104 INFO:teuthology.orchestra.run.smithi183.stderr:2024-08-18T22:04:37.102+0000 7f8011f8d640 1 -- 172.21.15.183:0/3085916653 wait complete. 2024-08-18T22:04:37.919 DEBUG:teuthology.orchestra.run.smithi123:mds.a> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.a.service 2024-08-18T22:04:37.922 DEBUG:teuthology.orchestra.run.smithi123:mds.d> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.d.service 2024-08-18T22:04:37.964 DEBUG:teuthology.orchestra.run.smithi123:mds.g> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.g.service 2024-08-18T22:04:38.008 DEBUG:teuthology.orchestra.run.smithi123:mds.j> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.j.service 2024-08-18T22:04:38.052 DEBUG:teuthology.orchestra.run.smithi130:mds.b> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.b.service 2024-08-18T22:04:38.054 DEBUG:teuthology.orchestra.run.smithi130:mds.e> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.e.service 2024-08-18T22:04:38.099 DEBUG:teuthology.orchestra.run.smithi130:mds.h> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.h.service 2024-08-18T22:04:38.142 DEBUG:teuthology.orchestra.run.smithi130:mds.k> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.k.service 2024-08-18T22:04:38.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:38 smithi183 ceph-mon[22097]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:04:38.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:38 smithi183 ceph-mon[22097]: Saving service mds.all spec with placement smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l;count:12 2024-08-18T22:04:38.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:38.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:04:38.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:38.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:04:38.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:38.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:38.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:38.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:38 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:38.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:38 smithi183 ceph-mon[22097]: Deploying daemon mds.l on smithi183 2024-08-18T22:04:38.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:38 smithi183 ceph-mon[22097]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:38.185 DEBUG:teuthology.orchestra.run.smithi183:mds.c> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.c.service 2024-08-18T22:04:38.187 DEBUG:teuthology.orchestra.run.smithi183:mds.f> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.f.service 2024-08-18T22:04:38.230 DEBUG:teuthology.orchestra.run.smithi183:mds.i> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.i.service 2024-08-18T22:04:38.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:38 smithi123 ceph-mon[18462]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:04:38.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:38 smithi123 ceph-mon[18462]: Saving service mds.all spec with placement smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l;count:12 2024-08-18T22:04:38.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:38.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:04:38.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:38.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:04:38.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:38.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:38.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:38.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:38 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:38.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:38 smithi123 ceph-mon[18462]: Deploying daemon mds.l on smithi183 2024-08-18T22:04:38.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:38 smithi123 ceph-mon[18462]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:38.273 DEBUG:teuthology.orchestra.run.smithi183:mds.l> sudo journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.l.service 2024-08-18T22:04:38.316 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-08-18T22:04:38.316 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:04:38.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:38 smithi130 ceph-mon[21698]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:04:38.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:38 smithi130 ceph-mon[21698]: Saving service mds.all spec with placement smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l;count:12 2024-08-18T22:04:38.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:38.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:04:38.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:38.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:04:38.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:38.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:38.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:38.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:38 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:38.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:38 smithi130 ceph-mon[21698]: Deploying daemon mds.l on smithi183 2024-08-18T22:04:38.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:38 smithi130 ceph-mon[21698]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:38.572 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:04:39.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.041+0000 7f5a42a30640 1 -- 172.21.15.123:0/1318964500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3c100020 msgr2=0x7f5a3c100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:39.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.041+0000 7f5a42a30640 1 --2- 172.21.15.123:0/1318964500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3c100020 0x7f5a3c100400 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009930 tx=0x7f5a2c02a420 comp rx=0 tx=0).stop 2024-08-18T22:04:39.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.041+0000 7f5a42a30640 1 -- 172.21.15.123:0/1318964500 shutdown_connections 2024-08-18T22:04:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.041+0000 7f5a42a30640 1 --2- 172.21.15.123:0/1318964500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a3c106c80 0x7f5a3c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.041+0000 7f5a42a30640 1 --2- 172.21.15.123:0/1318964500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a3c1009d0 0x7f5a3c106570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.041+0000 7f5a42a30640 1 --2- 172.21.15.123:0/1318964500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3c100020 0x7f5a3c100400 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.041+0000 7f5a42a30640 1 -- 172.21.15.123:0/1318964500 >> 172.21.15.123:0/1318964500 conn(0x7f5a3c076f40 msgr2=0x7f5a3c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.041+0000 7f5a42a30640 1 -- 172.21.15.123:0/1318964500 shutdown_connections 2024-08-18T22:04:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.041+0000 7f5a42a30640 1 -- 172.21.15.123:0/1318964500 wait complete. 2024-08-18T22:04:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.041+0000 7f5a42a30640 1 Processor -- start 2024-08-18T22:04:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.041+0000 7f5a42a30640 1 -- start start 2024-08-18T22:04:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a42a30640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a3c100020 0x7f5a3c19a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a42a30640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a3c1009d0 0x7f5a3c19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a42a30640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3c106c80 0x7f5a3c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a42a30640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c111cd0 con 0x7f5a3c106c80 2024-08-18T22:04:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a42a30640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c111b50 con 0x7f5a3c100020 2024-08-18T22:04:39.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a42a30640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c111e50 con 0x7f5a3c1009d0 2024-08-18T22:04:39.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a40fcd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3c106c80 0x7f5a3c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:39.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a40fcd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3c106c80 0x7f5a3c19eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43506/0 (socket says 172.21.15.123:43506) 2024-08-18T22:04:39.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a40fcd640 1 -- 172.21.15.123:0/399137771 learned_addr learned my addr 172.21.15.123:0/399137771 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:04:39.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a3b7fe640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a3c1009d0 0x7f5a3c19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:39.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a3bfff640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a3c100020 0x7f5a3c19a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:39.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a40fcd640 1 -- 172.21.15.123:0/399137771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a3c1009d0 msgr2=0x7f5a3c19a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:39.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a40fcd640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a3c1009d0 0x7f5a3c19a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:39.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a40fcd640 1 -- 172.21.15.123:0/399137771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a3c100020 msgr2=0x7f5a3c19a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:39.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a40fcd640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a3c100020 0x7f5a3c19a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:39.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a40fcd640 1 -- 172.21.15.123:0/399137771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3c19f240 con 0x7f5a3c106c80 2024-08-18T22:04:39.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a3b7fe640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a3c1009d0 0x7f5a3c19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:04:39.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a3bfff640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a3c100020 0x7f5a3c19a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:04:39.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.042+0000 7f5a40fcd640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3c106c80 0x7f5a3c19eb60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400cce0 tx=0x7f5a3400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:39.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.043+0000 7f5a397fa640 1 -- 172.21.15.123:0/399137771 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3400f450 con 0x7f5a3c106c80 2024-08-18T22:04:39.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.043+0000 7f5a397fa640 1 -- 172.21.15.123:0/399137771 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a3400fad0 con 0x7f5a3c106c80 2024-08-18T22:04:39.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.043+0000 7f5a397fa640 1 -- 172.21.15.123:0/399137771 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34018c10 con 0x7f5a3c106c80 2024-08-18T22:04:39.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.043+0000 7f5a42a30640 1 -- 172.21.15.123:0/399137771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3c19f530 con 0x7f5a3c106c80 2024-08-18T22:04:39.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.043+0000 7f5a42a30640 1 -- 172.21.15.123:0/399137771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a3c1a6e10 con 0x7f5a3c106c80 2024-08-18T22:04:39.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.044+0000 7f5a42a30640 1 -- 172.21.15.123:0/399137771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a3c100400 con 0x7f5a3c106c80 2024-08-18T22:04:39.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.045+0000 7f5a397fa640 1 -- 172.21.15.123:0/399137771 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5a3400f5f0 con 0x7f5a3c106c80 2024-08-18T22:04:39.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.045+0000 7f5a397fa640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a240a2b80 0x7f5a240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:39.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.045+0000 7f5a3bfff640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a240a2b80 0x7f5a240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:39.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.045+0000 7f5a397fa640 1 -- 172.21.15.123:0/399137771 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f5a340cf330 con 0x7f5a3c106c80 2024-08-18T22:04:39.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.046+0000 7f5a3bfff640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a240a2b80 0x7f5a240a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c000c00 tx=0x7f5a2c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:39.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.049+0000 7f5a397fa640 1 -- 172.21.15.123:0/399137771 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5a34014030 con 0x7f5a3c106c80 2024-08-18T22:04:39.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.247+0000 7f5a42a30640 1 -- 172.21.15.123:0/399137771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a3c1a70f0 con 0x7f5a3c106c80 2024-08-18T22:04:39.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.248+0000 7f5a397fa640 1 -- 172.21.15.123:0/399137771 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f5a3409c690 con 0x7f5a3c106c80 2024-08-18T22:04:39.249 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:04:39.249 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":1,"btime":"2024-08-18T21:58:23:301079+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-08-18T22:04:39.250 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 1 2024-08-18T22:04:39.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.250+0000 7f5a42a30640 1 -- 172.21.15.123:0/399137771 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a240a2b80 msgr2=0x7f5a240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:39.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.250+0000 7f5a42a30640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a240a2b80 0x7f5a240a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c000c00 tx=0x7f5a2c005a20 comp rx=0 tx=0).stop 2024-08-18T22:04:39.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.250+0000 7f5a42a30640 1 -- 172.21.15.123:0/399137771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3c106c80 msgr2=0x7f5a3c19eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:39.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.250+0000 7f5a42a30640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3c106c80 0x7f5a3c19eb60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400cce0 tx=0x7f5a3400a620 comp rx=0 tx=0).stop 2024-08-18T22:04:39.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.250+0000 7f5a42a30640 1 -- 172.21.15.123:0/399137771 shutdown_connections 2024-08-18T22:04:39.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.250+0000 7f5a42a30640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3c106c80 0x7f5a3c19eb60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:39.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.250+0000 7f5a42a30640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a3c1009d0 0x7f5a3c19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:39.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.250+0000 7f5a42a30640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a240a2b80 0x7f5a240a5040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:39.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.250+0000 7f5a42a30640 1 --2- 172.21.15.123:0/399137771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a3c100020 0x7f5a3c19a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:39.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.250+0000 7f5a42a30640 1 -- 172.21.15.123:0/399137771 >> 172.21.15.123:0/399137771 conn(0x7f5a3c076f40 msgr2=0x7f5a3c105360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:39.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.250+0000 7f5a42a30640 1 -- 172.21.15.123:0/399137771 shutdown_connections 2024-08-18T22:04:39.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:39.250+0000 7f5a42a30640 1 -- 172.21.15.123:0/399137771 wait complete. 2024-08-18T22:04:39.475 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:39 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/399137771' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:39.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:39 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/399137771' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:39.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:39 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/399137771' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:39.881 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:04:39 smithi183 systemd[1]: Starting Ceph mds.l for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:04:40.150 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:04:39 smithi183 podman[51302]: 2024-08-18 22:04:39.782710304 +0000 UTC m=+0.017600400 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:04:40.150 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:04:39 smithi183 podman[51302]: 2024-08-18 22:04:39.904974525 +0000 UTC m=+0.139864656 container create 44d1e94f470eecddc02126c12753f39ea1e73f94adefc5610b76ba8da9681ac3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:04:40.151 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:04:40 smithi183 podman[51302]: 2024-08-18 22:04:40.124160861 +0000 UTC m=+0.359050937 container init 44d1e94f470eecddc02126c12753f39ea1e73f94adefc5610b76ba8da9681ac3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-08-18T22:04:40.151 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:04:40 smithi183 podman[51302]: 2024-08-18 22:04:40.126886037 +0000 UTC m=+0.361776121 container start 44d1e94f470eecddc02126c12753f39ea1e73f94adefc5610b76ba8da9681ac3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-l, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:04:40.409 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:04:40 smithi183 ceph-mds[51320]: -- 172.21.15.183:0/3813021986 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56008c88fc20 con 0x56008c86d400 2024-08-18T22:04:40.409 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:04:40 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-l[51316]: starting mds.l at 2024-08-18T22:04:40.409 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:04:40 smithi183 bash[51302]: 44d1e94f470eecddc02126c12753f39ea1e73f94adefc5610b76ba8da9681ac3 2024-08-18T22:04:40.409 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:04:40 smithi183 systemd[1]: Started Ceph mds.l for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T22:04:40.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:40 smithi183 ceph-mon[22097]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:40.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:40 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.183:6832/3134276,v1:172.21.15.183:6833/3134276] up:boot 2024-08-18T22:04:40.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:40 smithi183 ceph-mon[22097]: fsmap 1 up:standby 2024-08-18T22:04:40.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:40 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-18T22:04:40.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:40 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:40.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:40 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:40.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:40 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:40.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:40 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:40.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:40 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:40.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:40 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:40.721 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:40 smithi130 ceph-mon[21698]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:40.721 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:40 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.183:6832/3134276,v1:172.21.15.183:6833/3134276] up:boot 2024-08-18T22:04:40.721 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:40 smithi130 ceph-mon[21698]: fsmap 1 up:standby 2024-08-18T22:04:40.721 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:40 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-18T22:04:40.721 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:40 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:40.721 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:40 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:40.722 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:40 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:40.722 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:40 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:40.722 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:40 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:40.722 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:40 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:40.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:40 smithi123 ceph-mon[18462]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:40.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:40 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.183:6832/3134276,v1:172.21.15.183:6833/3134276] up:boot 2024-08-18T22:04:40.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:40 smithi123 ceph-mon[18462]: fsmap 1 up:standby 2024-08-18T22:04:40.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:40 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-18T22:04:40.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:40 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:40.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:40 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:40.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:40 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:40.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:40 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:40.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:40 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:40.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:40 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:41.547 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:41 smithi183 ceph-mon[22097]: Deploying daemon mds.k on smithi130 2024-08-18T22:04:41.755 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:41 smithi130 ceph-mon[21698]: Deploying daemon mds.k on smithi130 2024-08-18T22:04:41.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:41 smithi123 ceph-mon[18462]: Deploying daemon mds.k on smithi130 2024-08-18T22:04:42.037 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:04:42.304 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:04:42.427 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:42 smithi123 ceph-mon[18462]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:42.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:42 smithi130 ceph-mon[21698]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:42.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:42 smithi183 ceph-mon[22097]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:42.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.756+0000 7fcec7a16640 1 -- 172.21.15.123:0/4245048471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcec0100b50 msgr2=0x7fcec0100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.756+0000 7fcec7a16640 1 --2- 172.21.15.123:0/4245048471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcec0100b50 0x7fcec0100f30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009900 tx=0x7fcebc02a480 comp rx=0 tx=0).stop 2024-08-18T22:04:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.756+0000 7fcec7a16640 1 -- 172.21.15.123:0/4245048471 shutdown_connections 2024-08-18T22:04:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.756+0000 7fcec7a16640 1 --2- 172.21.15.123:0/4245048471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcec0102c20 0x7fcec010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.756+0000 7fcec7a16640 1 --2- 172.21.15.123:0/4245048471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcec01022a0 0x7fcec01026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.756+0000 7fcec7a16640 1 --2- 172.21.15.123:0/4245048471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcec0100b50 0x7fcec0100f30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.756+0000 7fcec7a16640 1 -- 172.21.15.123:0/4245048471 >> 172.21.15.123:0/4245048471 conn(0x7fcec00fc500 msgr2=0x7fcec00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.756+0000 7fcec7a16640 1 -- 172.21.15.123:0/4245048471 shutdown_connections 2024-08-18T22:04:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.756+0000 7fcec7a16640 1 -- 172.21.15.123:0/4245048471 wait complete. 2024-08-18T22:04:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.756+0000 7fcec7a16640 1 Processor -- start 2024-08-18T22:04:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.756+0000 7fcec7a16640 1 -- start start 2024-08-18T22:04:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec7a16640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcec0100b50 0x7fcec0198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec7a16640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcec01022a0 0x7fcec0198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec7a16640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcec0102c20 0x7fcec019cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec7a16640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcec0110cb0 con 0x7fcec0102c20 2024-08-18T22:04:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec7a16640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcec0110b30 con 0x7fcec01022a0 2024-08-18T22:04:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec7a16640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcec0110e30 con 0x7fcec0100b50 2024-08-18T22:04:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec5fb3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcec0102c20 0x7fcec019cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec5fb3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcec0102c20 0x7fcec019cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34548/0 (socket says 172.21.15.123:34548) 2024-08-18T22:04:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec5fb3640 1 -- 172.21.15.123:0/707399011 learned_addr learned my addr 172.21.15.123:0/707399011 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:04:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec57b2640 1 --2- 172.21.15.123:0/707399011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcec0100b50 0x7fcec0198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec4fb1640 1 --2- 172.21.15.123:0/707399011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcec01022a0 0x7fcec0198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec5fb3640 1 -- 172.21.15.123:0/707399011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcec0100b50 msgr2=0x7fcec0198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec5fb3640 1 --2- 172.21.15.123:0/707399011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcec0100b50 0x7fcec0198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec5fb3640 1 -- 172.21.15.123:0/707399011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcec01022a0 msgr2=0x7fcec0198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:42.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec5fb3640 1 --2- 172.21.15.123:0/707399011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcec01022a0 0x7fcec0198790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:42.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec5fb3640 1 -- 172.21.15.123:0/707399011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec019d200 con 0x7fcec0102c20 2024-08-18T22:04:42.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec5fb3640 1 --2- 172.21.15.123:0/707399011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcec0102c20 0x7fcec019cb20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fceb800eaa0 tx=0x7fceb800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:42.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fceb67fc640 1 -- 172.21.15.123:0/707399011 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb800cdb0 con 0x7fcec0102c20 2024-08-18T22:04:42.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fceb67fc640 1 -- 172.21.15.123:0/707399011 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fceb8005020 con 0x7fcec0102c20 2024-08-18T22:04:42.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec7a16640 1 -- 172.21.15.123:0/707399011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec019d4f0 con 0x7fcec0102c20 2024-08-18T22:04:42.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fceb67fc640 1 -- 172.21.15.123:0/707399011 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb80116b0 con 0x7fcec0102c20 2024-08-18T22:04:42.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.757+0000 7fcec7a16640 1 -- 172.21.15.123:0/707399011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec01a4dd0 con 0x7fcec0102c20 2024-08-18T22:04:42.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.758+0000 7fcec7a16640 1 -- 172.21.15.123:0/707399011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec0100f30 con 0x7fcec0102c20 2024-08-18T22:04:42.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.760+0000 7fceb67fc640 1 -- 172.21.15.123:0/707399011 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fceb8005560 con 0x7fcec0102c20 2024-08-18T22:04:42.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.760+0000 7fceb67fc640 1 --2- 172.21.15.123:0/707399011 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fceac0a2b80 0x7fceac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:42.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.761+0000 7fcec57b2640 1 --2- 172.21.15.123:0/707399011 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fceac0a2b80 0x7fceac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:42.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.761+0000 7fceb67fc640 1 -- 172.21.15.123:0/707399011 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fceb80ceec0 con 0x7fcec0102c20 2024-08-18T22:04:42.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.761+0000 7fcec57b2640 1 --2- 172.21.15.123:0/707399011 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fceac0a2b80 0x7fceac0a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009230 tx=0x7fcebc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:42.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.765+0000 7fceb67fc640 1 -- 172.21.15.123:0/707399011 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fceb8016030 con 0x7fcec0102c20 2024-08-18T22:04:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.977+0000 7fcec7a16640 1 -- 172.21.15.123:0/707399011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcec01a4fa0 con 0x7fcec0102c20 2024-08-18T22:04:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.977+0000 7fceb67fc640 1 -- 172.21.15.123:0/707399011 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1429 (secure 0 0 0) 0x7fceb809c220 con 0x7fcec0102c20 2024-08-18T22:04:42.979 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:04:42.979 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":2,"btime":"2024-08-18T22:04:40:155164+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-18T22:04:42.979 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 2 2024-08-18T22:04:42.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.979+0000 7fcec7a16640 1 -- 172.21.15.123:0/707399011 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fceac0a2b80 msgr2=0x7fceac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.979+0000 7fcec7a16640 1 --2- 172.21.15.123:0/707399011 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fceac0a2b80 0x7fceac0a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009230 tx=0x7fcebc0058d0 comp rx=0 tx=0).stop 2024-08-18T22:04:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.979+0000 7fcec7a16640 1 -- 172.21.15.123:0/707399011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcec0102c20 msgr2=0x7fcec019cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.979+0000 7fcec7a16640 1 --2- 172.21.15.123:0/707399011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcec0102c20 0x7fcec019cb20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fceb800eaa0 tx=0x7fceb800ef60 comp rx=0 tx=0).stop 2024-08-18T22:04:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.980+0000 7fcec7a16640 1 -- 172.21.15.123:0/707399011 shutdown_connections 2024-08-18T22:04:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.980+0000 7fcec7a16640 1 --2- 172.21.15.123:0/707399011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcec0102c20 0x7fcec019cb20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.980+0000 7fcec7a16640 1 --2- 172.21.15.123:0/707399011 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fceac0a2b80 0x7fceac0a5040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.980+0000 7fcec7a16640 1 --2- 172.21.15.123:0/707399011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcec01022a0 0x7fcec0198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.980+0000 7fcec7a16640 1 --2- 172.21.15.123:0/707399011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcec0100b50 0x7fcec0198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.980+0000 7fcec7a16640 1 -- 172.21.15.123:0/707399011 >> 172.21.15.123:0/707399011 conn(0x7fcec00fc500 msgr2=0x7fcec0069f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.980+0000 7fcec7a16640 1 -- 172.21.15.123:0/707399011 shutdown_connections 2024-08-18T22:04:42.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:42.980+0000 7fcec7a16640 1 -- 172.21.15.123:0/707399011 wait complete. 2024-08-18T22:04:43.264 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 18 22:04:42 smithi130 systemd[1]: Started Ceph mds.k for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T22:04:44.090 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:43 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:44.090 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:43 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:44.090 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:43 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:44.090 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:43 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:44.090 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:43 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:44.091 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:43 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:44.091 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:43 smithi123 ceph-mon[18462]: Deploying daemon mds.j on smithi123 2024-08-18T22:04:44.091 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:43 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/707399011' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:44.091 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:43 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.130:6832/2515758332,v1:172.21.15.130:6833/2515758332] up:boot 2024-08-18T22:04:44.091 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:43 smithi123 ceph-mon[18462]: fsmap 2 up:standby 2024-08-18T22:04:44.091 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:43 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-18T22:04:44.091 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:43 smithi123 ceph-mon[18462]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:44.266 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:43 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:44.323 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:43 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:44.323 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:43 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:44.323 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:43 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:44.323 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:43 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:44.323 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:43 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:44.323 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:43 smithi130 ceph-mon[21698]: Deploying daemon mds.j on smithi123 2024-08-18T22:04:44.324 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:43 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/707399011' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:44.324 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:43 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.130:6832/2515758332,v1:172.21.15.130:6833/2515758332] up:boot 2024-08-18T22:04:44.324 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:43 smithi130 ceph-mon[21698]: fsmap 2 up:standby 2024-08-18T22:04:44.324 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:43 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-18T22:04:44.324 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:43 smithi130 ceph-mon[21698]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:44.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:43 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:44.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:43 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:44.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:43 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:44.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:43 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:44.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:43 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:44.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:43 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:44.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:43 smithi183 ceph-mon[22097]: Deploying daemon mds.j on smithi123 2024-08-18T22:04:44.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:43 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/707399011' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:44.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:43 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.130:6832/2515758332,v1:172.21.15.130:6833/2515758332] up:boot 2024-08-18T22:04:44.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:43 smithi183 ceph-mon[22097]: fsmap 2 up:standby 2024-08-18T22:04:44.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:43 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-18T22:04:44.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:43 smithi183 ceph-mon[22097]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:45.412 INFO:journalctl@ceph.mds.j.smithi123.stdout:Aug 18 22:04:45 smithi123 systemd[1]: Starting Ceph mds.j for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:04:45.646 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:04:45.670 INFO:journalctl@ceph.mds.j.smithi123.stdout:Aug 18 22:04:45 smithi123 podman[55120]: 2024-08-18 22:04:45.313719795 +0000 UTC m=+0.016850810 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:04:45.670 INFO:journalctl@ceph.mds.j.smithi123.stdout:Aug 18 22:04:45 smithi123 podman[55120]: 2024-08-18 22:04:45.446677619 +0000 UTC m=+0.149808627 container create 6f9c82a6bd43fab61c35321a903c486139c19e34467c35b1b165e8c6257c6310 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-j, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-08-18T22:04:45.914 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:04:46.010 INFO:journalctl@ceph.mds.j.smithi123.stdout:Aug 18 22:04:45 smithi123 podman[55120]: 2024-08-18 22:04:45.691000673 +0000 UTC m=+0.394131682 container init 6f9c82a6bd43fab61c35321a903c486139c19e34467c35b1b165e8c6257c6310 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True) 2024-08-18T22:04:46.010 INFO:journalctl@ceph.mds.j.smithi123.stdout:Aug 18 22:04:45 smithi123 podman[55120]: 2024-08-18 22:04:45.694764591 +0000 UTC m=+0.397895599 container start 6f9c82a6bd43fab61c35321a903c486139c19e34467c35b1b165e8c6257c6310 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-j, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-18T22:04:46.010 INFO:journalctl@ceph.mds.j.smithi123.stdout:Aug 18 22:04:45 smithi123 ceph-mds[55157]: -- 172.21.15.123:0/3558977261 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5631145f5860 con 0x5631145d3400 2024-08-18T22:04:46.010 INFO:journalctl@ceph.mds.j.smithi123.stdout:Aug 18 22:04:45 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-j[55135]: starting mds.j at 2024-08-18T22:04:46.010 INFO:journalctl@ceph.mds.j.smithi123.stdout:Aug 18 22:04:45 smithi123 bash[55120]: 6f9c82a6bd43fab61c35321a903c486139c19e34467c35b1b165e8c6257c6310 2024-08-18T22:04:46.010 INFO:journalctl@ceph.mds.j.smithi123.stdout:Aug 18 22:04:45 smithi123 systemd[1]: Started Ceph mds.j for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T22:04:46.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.412+0000 7fcfdf3a9640 1 -- 172.21.15.123:0/698942166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd8074350 msgr2=0x7fcfd8074730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:46.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.412+0000 7fcfdf3a9640 1 --2- 172.21.15.123:0/698942166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd8074350 0x7fcfd8074730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009900 tx=0x7fcfc802a480 comp rx=0 tx=0).stop 2024-08-18T22:04:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.412+0000 7fcfdf3a9640 1 -- 172.21.15.123:0/698942166 shutdown_connections 2024-08-18T22:04:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.412+0000 7fcfdf3a9640 1 --2- 172.21.15.123:0/698942166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfd810e0f0 0x7fcfd8110540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.412+0000 7fcfdf3a9640 1 --2- 172.21.15.123:0/698942166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfd8074c70 0x7fcfd810dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.412+0000 7fcfdf3a9640 1 --2- 172.21.15.123:0/698942166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd8074350 0x7fcfd8074730 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.412+0000 7fcfdf3a9640 1 -- 172.21.15.123:0/698942166 >> 172.21.15.123:0/698942166 conn(0x7fcfd80fd5f0 msgr2=0x7fcfd80ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.412+0000 7fcfdf3a9640 1 -- 172.21.15.123:0/698942166 shutdown_connections 2024-08-18T22:04:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.412+0000 7fcfdf3a9640 1 -- 172.21.15.123:0/698942166 wait complete. 2024-08-18T22:04:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.413+0000 7fcfdf3a9640 1 Processor -- start 2024-08-18T22:04:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.413+0000 7fcfdf3a9640 1 -- start start 2024-08-18T22:04:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.413+0000 7fcfdf3a9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd8074350 0x7fcfd819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.413+0000 7fcfdf3a9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfd8074c70 0x7fcfd819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.413+0000 7fcfdf3a9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfd810e0f0 0x7fcfd819ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.413+0000 7fcfdf3a9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd8113ea0 con 0x7fcfd8074350 2024-08-18T22:04:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.413+0000 7fcfdf3a9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd8113d20 con 0x7fcfd8074c70 2024-08-18T22:04:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.413+0000 7fcfdf3a9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd8114020 con 0x7fcfd810e0f0 2024-08-18T22:04:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.413+0000 7fcfdd145640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd8074350 0x7fcfd819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.413+0000 7fcfdd145640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd8074350 0x7fcfd819a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34574/0 (socket says 172.21.15.123:34574) 2024-08-18T22:04:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.413+0000 7fcfdd145640 1 -- 172.21.15.123:0/3727336901 learned_addr learned my addr 172.21.15.123:0/3727336901 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:04:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.413+0000 7fcfdc944640 1 --2- 172.21.15.123:0/3727336901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfd8074c70 0x7fcfd819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.413+0000 7fcfdd946640 1 --2- 172.21.15.123:0/3727336901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfd810e0f0 0x7fcfd819ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.414+0000 7fcfdd145640 1 -- 172.21.15.123:0/3727336901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfd810e0f0 msgr2=0x7fcfd819ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.414+0000 7fcfdd145640 1 --2- 172.21.15.123:0/3727336901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfd810e0f0 0x7fcfd819ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.414+0000 7fcfdd145640 1 -- 172.21.15.123:0/3727336901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfd8074c70 msgr2=0x7fcfd819a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.414+0000 7fcfdd145640 1 --2- 172.21.15.123:0/3727336901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfd8074c70 0x7fcfd819a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.414+0000 7fcfdd145640 1 -- 172.21.15.123:0/3727336901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd819f390 con 0x7fcfd8074350 2024-08-18T22:04:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.414+0000 7fcfdd145640 1 --2- 172.21.15.123:0/3727336901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd8074350 0x7fcfd819a3e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8005ab0 tx=0x7fcfc80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.414+0000 7fcfce7fc640 1 -- 172.21.15.123:0/3727336901 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc803f030 con 0x7fcfd8074350 2024-08-18T22:04:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.414+0000 7fcfdf3a9640 1 -- 172.21.15.123:0/3727336901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd819f620 con 0x7fcfd8074350 2024-08-18T22:04:46.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.414+0000 7fcfce7fc640 1 -- 172.21.15.123:0/3727336901 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfc8003ce0 con 0x7fcfd8074350 2024-08-18T22:04:46.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.414+0000 7fcfce7fc640 1 -- 172.21.15.123:0/3727336901 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8035070 con 0x7fcfd8074350 2024-08-18T22:04:46.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.414+0000 7fcfdf3a9640 1 -- 172.21.15.123:0/3727336901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd81a6f60 con 0x7fcfd8074350 2024-08-18T22:04:46.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.415+0000 7fcfdf3a9640 1 -- 172.21.15.123:0/3727336901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd8075a00 con 0x7fcfd8074350 2024-08-18T22:04:46.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.416+0000 7fcfce7fc640 1 -- 172.21.15.123:0/3727336901 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fcfc8042030 con 0x7fcfd8074350 2024-08-18T22:04:46.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.417+0000 7fcfce7fc640 1 --2- 172.21.15.123:0/3727336901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcfc40a2b80 0x7fcfc40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:46.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.417+0000 7fcfdc944640 1 --2- 172.21.15.123:0/3727336901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcfc40a2b80 0x7fcfc40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:46.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.417+0000 7fcfce7fc640 1 -- 172.21.15.123:0/3727336901 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fcfc80ef780 con 0x7fcfd8074350 2024-08-18T22:04:46.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.417+0000 7fcfdc944640 1 --2- 172.21.15.123:0/3727336901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcfc40a2b80 0x7fcfc40a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcfd810f400 tx=0x7fcfd400a570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:46.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.420+0000 7fcfce7fc640 1 -- 172.21.15.123:0/3727336901 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcfc80bcae0 con 0x7fcfd8074350 2024-08-18T22:04:46.618 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:46 smithi123 ceph-mon[18462]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:46.618 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:46.618 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:46.618 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:46.618 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:46.618 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:46.618 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:46 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:46.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.648+0000 7fcfdf3a9640 1 -- 172.21.15.123:0/3727336901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfd8074730 con 0x7fcfd8074350 2024-08-18T22:04:46.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.649+0000 7fcfce7fc640 1 -- 172.21.15.123:0/3727336901 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7fcfd8074730 con 0x7fcfd8074350 2024-08-18T22:04:46.650 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:04:46.650 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":4,"btime":"2024-08-18T22:04:46:377974+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-18T22:04:46.650 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 4 2024-08-18T22:04:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.651+0000 7fcfdf3a9640 1 -- 172.21.15.123:0/3727336901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcfc40a2b80 msgr2=0x7fcfc40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.651+0000 7fcfdf3a9640 1 --2- 172.21.15.123:0/3727336901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcfc40a2b80 0x7fcfc40a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcfd810f400 tx=0x7fcfd400a570 comp rx=0 tx=0).stop 2024-08-18T22:04:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.651+0000 7fcfdf3a9640 1 -- 172.21.15.123:0/3727336901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd8074350 msgr2=0x7fcfd819a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.651+0000 7fcfdf3a9640 1 --2- 172.21.15.123:0/3727336901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd8074350 0x7fcfd819a3e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8005ab0 tx=0x7fcfc80042f0 comp rx=0 tx=0).stop 2024-08-18T22:04:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.651+0000 7fcfdf3a9640 1 -- 172.21.15.123:0/3727336901 shutdown_connections 2024-08-18T22:04:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.651+0000 7fcfdf3a9640 1 --2- 172.21.15.123:0/3727336901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfd810e0f0 0x7fcfd819ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.651+0000 7fcfdf3a9640 1 --2- 172.21.15.123:0/3727336901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcfc40a2b80 0x7fcfc40a5040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.651+0000 7fcfdf3a9640 1 --2- 172.21.15.123:0/3727336901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfd8074c70 0x7fcfd819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.651+0000 7fcfdf3a9640 1 --2- 172.21.15.123:0/3727336901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfd8074350 0x7fcfd819a3e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.651+0000 7fcfdf3a9640 1 -- 172.21.15.123:0/3727336901 >> 172.21.15.123:0/3727336901 conn(0x7fcfd80fd5f0 msgr2=0x7fcfd80fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.651+0000 7fcfdf3a9640 1 -- 172.21.15.123:0/3727336901 shutdown_connections 2024-08-18T22:04:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:46.651+0000 7fcfdf3a9640 1 -- 172.21.15.123:0/3727336901 wait complete. 2024-08-18T22:04:46.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:46 smithi183 ceph-mon[22097]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:46.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:46.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:46.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:46.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:46.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:46.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:46 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:46.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:46 smithi130 ceph-mon[21698]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:46.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:46.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:46.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:46.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:46.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:46.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:46 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:47.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:47 smithi183 ceph-mon[22097]: Deploying daemon mds.d on smithi123 2024-08-18T22:04:47.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:47 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.123:6834/3015555290,v1:172.21.15.123:6835/3015555290] up:boot 2024-08-18T22:04:47.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:47 smithi183 ceph-mon[22097]: fsmap 3 up:standby 2024-08-18T22:04:47.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:47 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-18T22:04:47.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:47 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3727336901' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:47.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:47 smithi123 ceph-mon[18462]: Deploying daemon mds.d on smithi123 2024-08-18T22:04:47.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:47 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.123:6834/3015555290,v1:172.21.15.123:6835/3015555290] up:boot 2024-08-18T22:04:47.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:47 smithi123 ceph-mon[18462]: fsmap 3 up:standby 2024-08-18T22:04:47.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:47 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-18T22:04:47.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:47 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3727336901' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:47.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:47 smithi130 ceph-mon[21698]: Deploying daemon mds.d on smithi123 2024-08-18T22:04:47.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:47 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.123:6834/3015555290,v1:172.21.15.123:6835/3015555290] up:boot 2024-08-18T22:04:47.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:47 smithi130 ceph-mon[21698]: fsmap 3 up:standby 2024-08-18T22:04:47.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:47 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-18T22:04:47.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:47 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3727336901' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:48.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:48 smithi123 ceph-mon[18462]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:48.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:48 smithi183 ceph-mon[22097]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:48.665 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:48 smithi130 ceph-mon[21698]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:48.941 INFO:journalctl@ceph.mds.d.smithi123.stdout:Aug 18 22:04:48 smithi123 systemd[1]: Starting Ceph mds.d for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:04:49.192 INFO:journalctl@ceph.mds.d.smithi123.stdout:Aug 18 22:04:48 smithi123 podman[55534]: 2024-08-18 22:04:48.843372776 +0000 UTC m=+0.017338641 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:04:49.192 INFO:journalctl@ceph.mds.d.smithi123.stdout:Aug 18 22:04:48 smithi123 podman[55534]: 2024-08-18 22:04:48.960770786 +0000 UTC m=+0.134736642 container create ec3e4f2e0ff6d0e7a005163c563001019059c96832708c8eb90d9444a1cd5d8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-08-18T22:04:49.192 INFO:journalctl@ceph.mds.d.smithi123.stdout:Aug 18 22:04:49 smithi123 podman[55534]: 2024-08-18 22:04:49.188839186 +0000 UTC m=+0.362805037 container init ec3e4f2e0ff6d0e7a005163c563001019059c96832708c8eb90d9444a1cd5d8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-d, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:04:49.192 INFO:journalctl@ceph.mds.d.smithi123.stdout:Aug 18 22:04:49 smithi123 podman[55534]: 2024-08-18 22:04:49.191719841 +0000 UTC m=+0.365685700 container start ec3e4f2e0ff6d0e7a005163c563001019059c96832708c8eb90d9444a1cd5d8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-d, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-18T22:04:49.510 INFO:journalctl@ceph.mds.d.smithi123.stdout:Aug 18 22:04:49 smithi123 ceph-mds[55553]: -- 172.21.15.123:0/1392281964 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eab1631860 con 0x55eab160f400 2024-08-18T22:04:49.510 INFO:journalctl@ceph.mds.d.smithi123.stdout:Aug 18 22:04:49 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-d[55549]: starting mds.d at 2024-08-18T22:04:49.510 INFO:journalctl@ceph.mds.d.smithi123.stdout:Aug 18 22:04:49 smithi123 bash[55534]: ec3e4f2e0ff6d0e7a005163c563001019059c96832708c8eb90d9444a1cd5d8b 2024-08-18T22:04:49.510 INFO:journalctl@ceph.mds.d.smithi123.stdout:Aug 18 22:04:49 smithi123 systemd[1]: Started Ceph mds.d for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T22:04:49.811 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:04:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:04:50.477 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:50 smithi123 ceph-mon[18462]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:50.477 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:50 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:50.477 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:50 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:50.477 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:50 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:50.477 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:50 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:50.477 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:50 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:50.477 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:50 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:50.477 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:50 smithi123 ceph-mon[18462]: Deploying daemon mds.e on smithi130 2024-08-18T22:04:50.477 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:50 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.123:6836/1466506081,v1:172.21.15.123:6837/1466506081] up:boot 2024-08-18T22:04:50.478 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:50 smithi123 ceph-mon[18462]: fsmap 4 up:standby 2024-08-18T22:04:50.478 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:50 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-18T22:04:50.480 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:50 smithi130 ceph-mon[21698]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:50.480 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:50 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:50.480 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:50 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:50.480 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:50 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:50.480 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:50 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:50.480 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:50 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:50.480 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:50 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:50.480 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:50 smithi130 ceph-mon[21698]: Deploying daemon mds.e on smithi130 2024-08-18T22:04:50.480 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:50 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.123:6836/1466506081,v1:172.21.15.123:6837/1466506081] up:boot 2024-08-18T22:04:50.480 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:50 smithi130 ceph-mon[21698]: fsmap 4 up:standby 2024-08-18T22:04:50.480 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:50 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-18T22:04:50.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.555+0000 7f0efdfd1640 1 -- 172.21.15.123:0/1546907904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ef810bea0 msgr2=0x7f0ef810e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.555+0000 7f0efdfd1640 1 --2- 172.21.15.123:0/1546907904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ef810bea0 0x7f0ef810e340 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009ca0 tx=0x7f0ef002a950 comp rx=0 tx=0).stop 2024-08-18T22:04:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.555+0000 7f0efdfd1640 1 -- 172.21.15.123:0/1546907904 shutdown_connections 2024-08-18T22:04:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.555+0000 7f0efdfd1640 1 --2- 172.21.15.123:0/1546907904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ef810bea0 0x7f0ef810e340 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.555+0000 7f0efdfd1640 1 --2- 172.21.15.123:0/1546907904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ef8103390 0x7f0ef810b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.555+0000 7f0efdfd1640 1 --2- 172.21.15.123:0/1546907904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef8102a70 0x7f0ef8102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.555+0000 7f0efdfd1640 1 -- 172.21.15.123:0/1546907904 >> 172.21.15.123:0/1546907904 conn(0x7f0ef80fc4d0 msgr2=0x7f0ef80fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.555+0000 7f0efdfd1640 1 -- 172.21.15.123:0/1546907904 shutdown_connections 2024-08-18T22:04:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.555+0000 7f0efdfd1640 1 -- 172.21.15.123:0/1546907904 wait complete. 2024-08-18T22:04:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.556+0000 7f0efdfd1640 1 Processor -- start 2024-08-18T22:04:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.556+0000 7f0efdfd1640 1 -- start start 2024-08-18T22:04:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.556+0000 7f0efdfd1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef8102a70 0x7f0ef81006d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.556+0000 7f0efdfd1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ef8103390 0x7f0ef8100c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.556+0000 7f0efdfd1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ef810bea0 0x7f0ef8101150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.556+0000 7f0efdfd1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef8111ca0 con 0x7f0ef8103390 2024-08-18T22:04:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.556+0000 7f0efdfd1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef8111b20 con 0x7f0ef810bea0 2024-08-18T22:04:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.556+0000 7f0efdfd1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef8111e20 con 0x7f0ef8102a70 2024-08-18T22:04:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.556+0000 7f0ef6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ef8103390 0x7f0ef8100c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.556+0000 7f0ef6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ef8103390 0x7f0ef8100c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34626/0 (socket says 172.21.15.123:34626) 2024-08-18T22:04:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.556+0000 7f0ef6ffd640 1 -- 172.21.15.123:0/3595599724 learned_addr learned my addr 172.21.15.123:0/3595599724 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:04:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.556+0000 7f0ef77fe640 1 --2- 172.21.15.123:0/3595599724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef8102a70 0x7f0ef81006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.557+0000 7f0ef7fff640 1 --2- 172.21.15.123:0/3595599724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ef810bea0 0x7f0ef8101150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.557+0000 7f0ef6ffd640 1 -- 172.21.15.123:0/3595599724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef8102a70 msgr2=0x7f0ef81006d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.557+0000 7f0ef6ffd640 1 --2- 172.21.15.123:0/3595599724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef8102a70 0x7f0ef81006d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.557+0000 7f0ef6ffd640 1 -- 172.21.15.123:0/3595599724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ef810bea0 msgr2=0x7f0ef8101150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.557+0000 7f0ef6ffd640 1 --2- 172.21.15.123:0/3595599724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ef810bea0 0x7f0ef8101150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.557+0000 7f0ef6ffd640 1 -- 172.21.15.123:0/3595599724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef81a65b0 con 0x7f0ef8103390 2024-08-18T22:04:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.557+0000 7f0ef6ffd640 1 --2- 172.21.15.123:0/3595599724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ef8103390 0x7f0ef8100c10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00c940 tx=0x7f0eec00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.557+0000 7f0ef4ff9640 1 -- 172.21.15.123:0/3595599724 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec004220 con 0x7f0ef8103390 2024-08-18T22:04:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.557+0000 7f0efdfd1640 1 -- 172.21.15.123:0/3595599724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef81a68a0 con 0x7f0ef8103390 2024-08-18T22:04:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.557+0000 7f0ef4ff9640 1 -- 172.21.15.123:0/3595599724 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0eec0043c0 con 0x7f0ef8103390 2024-08-18T22:04:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.557+0000 7f0ef4ff9640 1 -- 172.21.15.123:0/3595599724 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec004a00 con 0x7f0ef8103390 2024-08-18T22:04:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.557+0000 7f0efdfd1640 1 -- 172.21.15.123:0/3595599724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef81a6e30 con 0x7f0ef8103390 2024-08-18T22:04:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.558+0000 7f0efdfd1640 1 -- 172.21.15.123:0/3595599724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef8102e50 con 0x7f0ef8103390 2024-08-18T22:04:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.559+0000 7f0ef4ff9640 1 -- 172.21.15.123:0/3595599724 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f0eec0079b0 con 0x7f0ef8103390 2024-08-18T22:04:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.560+0000 7f0ef4ff9640 1 --2- 172.21.15.123:0/3595599724 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0ee00a2b80 0x7f0ee00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.560+0000 7f0ef77fe640 1 --2- 172.21.15.123:0/3595599724 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0ee00a2b80 0x7f0ee00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.560+0000 7f0ef4ff9640 1 -- 172.21.15.123:0/3595599724 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f0eec0ceb90 con 0x7f0ef8103390 2024-08-18T22:04:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.560+0000 7f0ef77fe640 1 --2- 172.21.15.123:0/3595599724 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0ee00a2b80 0x7f0ee00a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8005fd0 tx=0x7f0ee8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.564+0000 7f0ef4ff9640 1 -- 172.21.15.123:0/3595599724 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0eec014030 con 0x7f0ef8103390 2024-08-18T22:04:50.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:50 smithi183 ceph-mon[22097]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:50.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:50 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:50.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:50 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:50.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:50 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:50.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:50 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:50.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:50 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:50.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:50 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:50.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:50 smithi183 ceph-mon[22097]: Deploying daemon mds.e on smithi130 2024-08-18T22:04:50.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:50 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.123:6836/1466506081,v1:172.21.15.123:6837/1466506081] up:boot 2024-08-18T22:04:50.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:50 smithi183 ceph-mon[22097]: fsmap 4 up:standby 2024-08-18T22:04:50.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:50 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-18T22:04:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.763+0000 7f0efdfd1640 1 -- 172.21.15.123:0/3595599724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ef81a7120 con 0x7f0ef8103390 2024-08-18T22:04:50.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.764+0000 7f0ef4ff9640 1 -- 172.21.15.123:0/3595599724 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f0eec084e20 con 0x7f0ef8103390 2024-08-18T22:04:50.766 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:04:50.766 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":5,"btime":"2024-08-18T22:04:49:391122+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-18T22:04:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 5 2024-08-18T22:04:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.766+0000 7f0efdfd1640 1 -- 172.21.15.123:0/3595599724 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0ee00a2b80 msgr2=0x7f0ee00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.766+0000 7f0efdfd1640 1 --2- 172.21.15.123:0/3595599724 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0ee00a2b80 0x7f0ee00a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8005fd0 tx=0x7f0ee8005850 comp rx=0 tx=0).stop 2024-08-18T22:04:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.766+0000 7f0efdfd1640 1 -- 172.21.15.123:0/3595599724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ef8103390 msgr2=0x7f0ef8100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.766+0000 7f0efdfd1640 1 --2- 172.21.15.123:0/3595599724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ef8103390 0x7f0ef8100c10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00c940 tx=0x7f0eec00ce00 comp rx=0 tx=0).stop 2024-08-18T22:04:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.766+0000 7f0efdfd1640 1 -- 172.21.15.123:0/3595599724 shutdown_connections 2024-08-18T22:04:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.766+0000 7f0efdfd1640 1 --2- 172.21.15.123:0/3595599724 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0ee00a2b80 0x7f0ee00a5040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.766+0000 7f0efdfd1640 1 --2- 172.21.15.123:0/3595599724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ef810bea0 0x7f0ef8101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.766+0000 7f0efdfd1640 1 --2- 172.21.15.123:0/3595599724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ef8103390 0x7f0ef8100c10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.766+0000 7f0efdfd1640 1 --2- 172.21.15.123:0/3595599724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef8102a70 0x7f0ef81006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.766+0000 7f0efdfd1640 1 -- 172.21.15.123:0/3595599724 >> 172.21.15.123:0/3595599724 conn(0x7f0ef80fc4d0 msgr2=0x7f0ef80fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.766+0000 7f0efdfd1640 1 -- 172.21.15.123:0/3595599724 shutdown_connections 2024-08-18T22:04:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:50.766+0000 7f0efdfd1640 1 -- 172.21.15.123:0/3595599724 wait complete. 2024-08-18T22:04:51.467 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:51 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3595599724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:51.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:51 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3595599724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:51.514 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:04:51 smithi130 systemd[1]: Starting Ceph mds.e for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:04:51.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:51 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3595599724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:51.871 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:04:51 smithi130 podman[50937]: 2024-08-18 22:04:51.507321628 +0000 UTC m=+0.017622985 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:04:51.871 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:04:51 smithi130 podman[50937]: 2024-08-18 22:04:51.625408269 +0000 UTC m=+0.135709609 container create 615d28a876dac3c1396b54e55f4e339dd8c0d0f8f60308f1c858aa481bc6b2f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-08-18T22:04:51.871 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:04:51 smithi130 podman[50937]: 2024-08-18 22:04:51.844311613 +0000 UTC m=+0.354612951 container init 615d28a876dac3c1396b54e55f4e339dd8c0d0f8f60308f1c858aa481bc6b2f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-e, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:04:51.871 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:04:51 smithi130 podman[50937]: 2024-08-18 22:04:51.847077339 +0000 UTC m=+0.357378681 container start 615d28a876dac3c1396b54e55f4e339dd8c0d0f8f60308f1c858aa481bc6b2f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-e, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-08-18T22:04:51.871 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:04:51 smithi130 ceph-mds[50956]: -- 172.21.15.130:0/501415843 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a4d660f860 con 0x55a4d65ec800 2024-08-18T22:04:52.264 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:04:51 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-e[50952]: starting mds.e at 2024-08-18T22:04:52.264 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:04:51 smithi130 bash[50937]: 615d28a876dac3c1396b54e55f4e339dd8c0d0f8f60308f1c858aa481bc6b2f0 2024-08-18T22:04:52.264 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:04:51 smithi130 systemd[1]: Started Ceph mds.e for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T22:04:52.611 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:52 smithi183 ceph-mon[22097]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:52.612 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:52 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:52.612 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:52 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:52.612 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:52 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:52.612 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:52 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:52.612 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:52 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:52.612 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:52 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:52.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:52 smithi123 ceph-mon[18462]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:52.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:52 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:52.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:52 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:52.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:52 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:52.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:52 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:52.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:52 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:52.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:52 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:52 smithi130 ceph-mon[21698]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:52 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:52 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:52 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:52 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:52 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:52 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:53.469 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:04:53.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:53 smithi183 ceph-mon[22097]: Deploying daemon mds.f on smithi183 2024-08-18T22:04:53.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:53 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.130:6834/579024659,v1:172.21.15.130:6835/579024659] up:boot 2024-08-18T22:04:53.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:53 smithi183 ceph-mon[22097]: fsmap 5 up:standby 2024-08-18T22:04:53.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-18T22:04:53.728 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:04:53.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:53 smithi123 ceph-mon[18462]: Deploying daemon mds.f on smithi183 2024-08-18T22:04:53.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:53 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.130:6834/579024659,v1:172.21.15.130:6835/579024659] up:boot 2024-08-18T22:04:53.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:53 smithi123 ceph-mon[18462]: fsmap 5 up:standby 2024-08-18T22:04:53.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-18T22:04:53.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:53 smithi130 ceph-mon[21698]: Deploying daemon mds.f on smithi183 2024-08-18T22:04:53.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:53 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.130:6834/579024659,v1:172.21.15.130:6835/579024659] up:boot 2024-08-18T22:04:53.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:53 smithi130 ceph-mon[21698]: fsmap 5 up:standby 2024-08-18T22:04:53.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-18T22:04:54.047 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:04:54 smithi183 systemd[1]: Starting Ceph mds.f for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:04:54.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.253+0000 7f4788a0a640 1 -- 172.21.15.123:0/1680332131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47841078b0 msgr2=0x7f4784107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.253+0000 7f4788a0a640 1 --2- 172.21.15.123:0/1680332131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47841078b0 0x7f4784107c90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4774009930 tx=0x7f477402a420 comp rx=0 tx=0).stop 2024-08-18T22:04:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.253+0000 7f4788a0a640 1 -- 172.21.15.123:0/1680332131 shutdown_connections 2024-08-18T22:04:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.253+0000 7f4788a0a640 1 --2- 172.21.15.123:0/1680332131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4784102250 0x7f478410e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.253+0000 7f4788a0a640 1 --2- 172.21.15.123:0/1680332131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f47841018b0 0x7f4784101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.253+0000 7f4788a0a640 1 --2- 172.21.15.123:0/1680332131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47841078b0 0x7f4784107c90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.253+0000 7f4788a0a640 1 -- 172.21.15.123:0/1680332131 >> 172.21.15.123:0/1680332131 conn(0x7f47840fd5f0 msgr2=0x7f47840ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.253+0000 7f4788a0a640 1 -- 172.21.15.123:0/1680332131 shutdown_connections 2024-08-18T22:04:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.253+0000 7f4788a0a640 1 -- 172.21.15.123:0/1680332131 wait complete. 2024-08-18T22:04:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.253+0000 7f4788a0a640 1 Processor -- start 2024-08-18T22:04:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f4788a0a640 1 -- start start 2024-08-18T22:04:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f4788a0a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f47841018b0 0x7f4784198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f4788a0a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4784102250 0x7f4784198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f4788a0a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47841078b0 0x7f478419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f4788a0a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4784111d50 con 0x7f4784102250 2024-08-18T22:04:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f4788a0a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4784111bd0 con 0x7f47841018b0 2024-08-18T22:04:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f4788a0a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4784111ed0 con 0x7f47841078b0 2024-08-18T22:04:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f477bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4784102250 0x7f4784198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f477bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4784102250 0x7f4784198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47830/0 (socket says 172.21.15.123:47830) 2024-08-18T22:04:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f477bfff640 1 -- 172.21.15.123:0/1514598415 learned_addr learned my addr 172.21.15.123:0/1514598415 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:04:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f478259c640 1 --2- 172.21.15.123:0/1514598415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f47841018b0 0x7f4784198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f4782d9d640 1 --2- 172.21.15.123:0/1514598415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47841078b0 0x7f478419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f477bfff640 1 -- 172.21.15.123:0/1514598415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47841078b0 msgr2=0x7f478419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f477bfff640 1 --2- 172.21.15.123:0/1514598415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47841078b0 0x7f478419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f477bfff640 1 -- 172.21.15.123:0/1514598415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f47841018b0 msgr2=0x7f4784198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f477bfff640 1 --2- 172.21.15.123:0/1514598415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f47841018b0 0x7f4784198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f477bfff640 1 -- 172.21.15.123:0/1514598415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478419d2c0 con 0x7f4784102250 2024-08-18T22:04:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f478259c640 1 --2- 172.21.15.123:0/1514598415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f47841018b0 0x7f4784198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:04:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f477bfff640 1 --2- 172.21.15.123:0/1514598415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4784102250 0x7f4784198850 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f476c00b4a0 tx=0x7f476c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.254+0000 7f477b7fe640 1 -- 172.21.15.123:0/1514598415 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c014070 con 0x7f4784102250 2024-08-18T22:04:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.255+0000 7f4788a0a640 1 -- 172.21.15.123:0/1514598415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478419d5b0 con 0x7f4784102250 2024-08-18T22:04:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.255+0000 7f477b7fe640 1 -- 172.21.15.123:0/1514598415 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f476c010af0 con 0x7f4784102250 2024-08-18T22:04:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.255+0000 7f477b7fe640 1 -- 172.21.15.123:0/1514598415 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c017d10 con 0x7f4784102250 2024-08-18T22:04:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.255+0000 7f4788a0a640 1 -- 172.21.15.123:0/1514598415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47841a4e90 con 0x7f4784102250 2024-08-18T22:04:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.256+0000 7f4788a0a640 1 -- 172.21.15.123:0/1514598415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4784101d90 con 0x7f4784102250 2024-08-18T22:04:54.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.257+0000 7f477b7fe640 1 -- 172.21.15.123:0/1514598415 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f476c017070 con 0x7f4784102250 2024-08-18T22:04:54.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.257+0000 7f477b7fe640 1 --2- 172.21.15.123:0/1514598415 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f47700a2b80 0x7f47700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:54.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.257+0000 7f478259c640 1 --2- 172.21.15.123:0/1514598415 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f47700a2b80 0x7f47700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:54.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.257+0000 7f477b7fe640 1 -- 172.21.15.123:0/1514598415 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f476c0ce020 con 0x7f4784102250 2024-08-18T22:04:54.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.258+0000 7f478259c640 1 --2- 172.21.15.123:0/1514598415 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f47700a2b80 0x7f47700a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4774000c00 tx=0x7f4774005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:54.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.261+0000 7f477b7fe640 1 -- 172.21.15.123:0/1514598415 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f476c09b420 con 0x7f4784102250 2024-08-18T22:04:54.358 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:04:54 smithi183 podman[51613]: 2024-08-18 22:04:54.168200325 +0000 UTC m=+0.017420036 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:04:54.359 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:04:54 smithi183 podman[51613]: 2024-08-18 22:04:54.285447321 +0000 UTC m=+0.134667024 container create d92ded7cbce38e995fe69ad3ff07ddb47c1c81cdef101afd90953b05423a0336 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-f, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-18T22:04:54.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.463+0000 7f4788a0a640 1 -- 172.21.15.123:0/1514598415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f478402d5e0 con 0x7f4784102250 2024-08-18T22:04:54.465 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:54 smithi123 ceph-mon[18462]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:54.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.463+0000 7f477b7fe640 1 -- 172.21.15.123:0/1514598415 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7f476c09ad20 con 0x7f4784102250 2024-08-18T22:04:54.466 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:04:54.466 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":6,"btime":"2024-08-18T22:04:52:343006+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-08-18T22:04:54.466 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 6 2024-08-18T22:04:54.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.467+0000 7f4788a0a640 1 -- 172.21.15.123:0/1514598415 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f47700a2b80 msgr2=0x7f47700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:54.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.467+0000 7f4788a0a640 1 --2- 172.21.15.123:0/1514598415 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f47700a2b80 0x7f47700a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4774000c00 tx=0x7f4774005a20 comp rx=0 tx=0).stop 2024-08-18T22:04:54.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.467+0000 7f4788a0a640 1 -- 172.21.15.123:0/1514598415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4784102250 msgr2=0x7f4784198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:54.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.467+0000 7f4788a0a640 1 --2- 172.21.15.123:0/1514598415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4784102250 0x7f4784198850 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f476c00b4a0 tx=0x7f476c00b960 comp rx=0 tx=0).stop 2024-08-18T22:04:54.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.468+0000 7f4788a0a640 1 -- 172.21.15.123:0/1514598415 shutdown_connections 2024-08-18T22:04:54.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.468+0000 7f4788a0a640 1 --2- 172.21.15.123:0/1514598415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47841078b0 0x7f478419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:54.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.468+0000 7f4788a0a640 1 --2- 172.21.15.123:0/1514598415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4784102250 0x7f4784198850 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:54.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.468+0000 7f4788a0a640 1 --2- 172.21.15.123:0/1514598415 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f47700a2b80 0x7f47700a5040 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:54.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.468+0000 7f4788a0a640 1 --2- 172.21.15.123:0/1514598415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f47841018b0 0x7f4784198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:54.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.468+0000 7f4788a0a640 1 -- 172.21.15.123:0/1514598415 >> 172.21.15.123:0/1514598415 conn(0x7f47840fd5f0 msgr2=0x7f47840fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:54.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.468+0000 7f4788a0a640 1 -- 172.21.15.123:0/1514598415 shutdown_connections 2024-08-18T22:04:54.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:54.468+0000 7f4788a0a640 1 -- 172.21.15.123:0/1514598415 wait complete. 2024-08-18T22:04:54.638 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:54 smithi183 ceph-mon[22097]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:54.638 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:04:54 smithi183 podman[51613]: 2024-08-18 22:04:54.521365515 +0000 UTC m=+0.370585213 container init d92ded7cbce38e995fe69ad3ff07ddb47c1c81cdef101afd90953b05423a0336 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-f, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=) 2024-08-18T22:04:54.639 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:04:54 smithi183 podman[51613]: 2024-08-18 22:04:54.52405029 +0000 UTC m=+0.373269993 container start d92ded7cbce38e995fe69ad3ff07ddb47c1c81cdef101afd90953b05423a0336 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-18T22:04:54.639 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:04:54 smithi183 ceph-mds[51632]: -- 172.21.15.183:0/1272594080 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564f74b67860 con 0x564f74b45400 2024-08-18T22:04:54.639 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:04:54 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-f[51628]: starting mds.f at 2024-08-18T22:04:54.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:54 smithi130 ceph-mon[21698]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:54.909 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:04:54 smithi183 bash[51613]: d92ded7cbce38e995fe69ad3ff07ddb47c1c81cdef101afd90953b05423a0336 2024-08-18T22:04:54.909 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:04:54 smithi183 systemd[1]: Started Ceph mds.f for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T22:04:55.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:55 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1514598415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:55.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:55 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:55.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:55 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:55.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:55 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:55.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:55 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:55.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:55 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:55.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:55 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:55.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:55 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1514598415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:55.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:55 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:55.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:55 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:55.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:55 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:55.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:55 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:55.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:55 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:55.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:55 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:55.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:55 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1514598415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:55.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:55 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:55.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:55 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:55.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:55 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:55.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:55 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:55.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:55 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:55.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:55 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:56.630 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:56 smithi183 ceph-mon[22097]: Deploying daemon mds.c on smithi183 2024-08-18T22:04:56.630 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:56 smithi183 ceph-mon[22097]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:56.630 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:56 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.183:6834/1138667446,v1:172.21.15.183:6835/1138667446] up:boot 2024-08-18T22:04:56.631 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:56 smithi183 ceph-mon[22097]: fsmap 6 up:standby 2024-08-18T22:04:56.631 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:56 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-18T22:04:56.662 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:56 smithi123 ceph-mon[18462]: Deploying daemon mds.c on smithi183 2024-08-18T22:04:56.662 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:56 smithi123 ceph-mon[18462]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:56.662 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:56 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.183:6834/1138667446,v1:172.21.15.183:6835/1138667446] up:boot 2024-08-18T22:04:56.662 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:56 smithi123 ceph-mon[18462]: fsmap 6 up:standby 2024-08-18T22:04:56.662 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:56 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-18T22:04:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:56 smithi130 ceph-mon[21698]: Deploying daemon mds.c on smithi183 2024-08-18T22:04:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:56 smithi130 ceph-mon[21698]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:56 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.183:6834/1138667446,v1:172.21.15.183:6835/1138667446] up:boot 2024-08-18T22:04:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:56 smithi130 ceph-mon[21698]: fsmap 6 up:standby 2024-08-18T22:04:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:56 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-18T22:04:56.909 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:04:56 smithi183 systemd[1]: Starting Ceph mds.c for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:04:57.093 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:04:57.312 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:04:57 smithi183 podman[51915]: 2024-08-18 22:04:56.930974498 +0000 UTC m=+0.017276859 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:04:57.312 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:04:57 smithi183 podman[51915]: 2024-08-18 22:04:57.059565193 +0000 UTC m=+0.145867545 container create f3078d6d77023e0f9f25572eb6f78f199f28bc7ac5bcced94cfa02d272a5fd87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-c, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2) 2024-08-18T22:04:57.312 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:04:57 smithi183 podman[51915]: 2024-08-18 22:04:57.311987638 +0000 UTC m=+0.398289991 container init f3078d6d77023e0f9f25572eb6f78f199f28bc7ac5bcced94cfa02d272a5fd87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-18T22:04:57.352 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:04:57.659 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:04:57 smithi183 podman[51915]: 2024-08-18 22:04:57.314838906 +0000 UTC m=+0.401141261 container start f3078d6d77023e0f9f25572eb6f78f199f28bc7ac5bcced94cfa02d272a5fd87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-18T22:04:57.659 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:04:57 smithi183 ceph-mds[51934]: -- 172.21.15.183:0/681727666 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eb45bdf860 con 0x55eb45bbd400 2024-08-18T22:04:57.659 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:04:57 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-c[51930]: starting mds.c at 2024-08-18T22:04:57.659 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:04:57 smithi183 bash[51915]: f3078d6d77023e0f9f25572eb6f78f199f28bc7ac5bcced94cfa02d272a5fd87 2024-08-18T22:04:57.659 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:04:57 smithi183 systemd[1]: Started Ceph mds.c for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T22:04:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.848+0000 7f44edb4e640 1 -- 172.21.15.123:0/829588806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e8100b50 msgr2=0x7f44e8100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.848+0000 7f44edb4e640 1 --2- 172.21.15.123:0/829588806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e8100b50 0x7f44e8100f30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009900 tx=0x7f44d802a480 comp rx=0 tx=0).stop 2024-08-18T22:04:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.848+0000 7f44edb4e640 1 -- 172.21.15.123:0/829588806 shutdown_connections 2024-08-18T22:04:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.848+0000 7f44edb4e640 1 --2- 172.21.15.123:0/829588806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44e8102c20 0x7f44e810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.848+0000 7f44edb4e640 1 --2- 172.21.15.123:0/829588806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44e81022a0 0x7f44e81026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.848+0000 7f44edb4e640 1 --2- 172.21.15.123:0/829588806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e8100b50 0x7f44e8100f30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.848+0000 7f44edb4e640 1 -- 172.21.15.123:0/829588806 >> 172.21.15.123:0/829588806 conn(0x7f44e80fc500 msgr2=0x7f44e80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.848+0000 7f44edb4e640 1 -- 172.21.15.123:0/829588806 shutdown_connections 2024-08-18T22:04:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.848+0000 7f44edb4e640 1 -- 172.21.15.123:0/829588806 wait complete. 2024-08-18T22:04:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.848+0000 7f44edb4e640 1 Processor -- start 2024-08-18T22:04:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44edb4e640 1 -- start start 2024-08-18T22:04:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44edb4e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44e8100b50 0x7f44e81981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44edb4e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44e81022a0 0x7f44e81986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44edb4e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e8102c20 0x7f44e819ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44edb4e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f44e8110cb0 con 0x7f44e8102c20 2024-08-18T22:04:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44edb4e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f44e8110b30 con 0x7f44e8100b50 2024-08-18T22:04:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44edb4e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f44e8110e30 con 0x7f44e81022a0 2024-08-18T22:04:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44e7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e8102c20 0x7f44e819ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44e7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e8102c20 0x7f44e819ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47852/0 (socket says 172.21.15.123:47852) 2024-08-18T22:04:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44e7fff640 1 -- 172.21.15.123:0/2218366984 learned_addr learned my addr 172.21.15.123:0/2218366984 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:04:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44e77fe640 1 --2- 172.21.15.123:0/2218366984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44e8100b50 0x7f44e81981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44e6ffd640 1 --2- 172.21.15.123:0/2218366984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44e81022a0 0x7f44e81986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44e7fff640 1 -- 172.21.15.123:0/2218366984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44e81022a0 msgr2=0x7f44e81986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44e7fff640 1 --2- 172.21.15.123:0/2218366984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44e81022a0 0x7f44e81986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44e7fff640 1 -- 172.21.15.123:0/2218366984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44e8100b50 msgr2=0x7f44e81981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44e7fff640 1 --2- 172.21.15.123:0/2218366984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44e8100b50 0x7f44e81981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44e7fff640 1 -- 172.21.15.123:0/2218366984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e819d150 con 0x7f44e8102c20 2024-08-18T22:04:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44e6ffd640 1 --2- 172.21.15.123:0/2218366984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44e81022a0 0x7f44e81986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:04:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.849+0000 7f44e7fff640 1 --2- 172.21.15.123:0/2218366984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e8102c20 0x7f44e819ca70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f44e000eaa0 tx=0x7f44e000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.850+0000 7f44e4ff9640 1 -- 172.21.15.123:0/2218366984 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e000cdb0 con 0x7f44e8102c20 2024-08-18T22:04:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.850+0000 7f44e4ff9640 1 -- 172.21.15.123:0/2218366984 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44e0005020 con 0x7f44e8102c20 2024-08-18T22:04:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.850+0000 7f44edb4e640 1 -- 172.21.15.123:0/2218366984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e819d440 con 0x7f44e8102c20 2024-08-18T22:04:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.850+0000 7f44e4ff9640 1 -- 172.21.15.123:0/2218366984 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e00116b0 con 0x7f44e8102c20 2024-08-18T22:04:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.850+0000 7f44edb4e640 1 -- 172.21.15.123:0/2218366984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e81a4d20 con 0x7f44e8102c20 2024-08-18T22:04:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.851+0000 7f44edb4e640 1 -- 172.21.15.123:0/2218366984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e8100f30 con 0x7f44e8102c20 2024-08-18T22:04:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.852+0000 7f44e4ff9640 1 -- 172.21.15.123:0/2218366984 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f44e0005560 con 0x7f44e8102c20 2024-08-18T22:04:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.853+0000 7f44e4ff9640 1 --2- 172.21.15.123:0/2218366984 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f44d00a2b80 0x7f44d00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:04:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.853+0000 7f44e77fe640 1 --2- 172.21.15.123:0/2218366984 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f44d00a2b80 0x7f44d00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:04:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.853+0000 7f44e4ff9640 1 -- 172.21.15.123:0/2218366984 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f44e00cf170 con 0x7f44e8102c20 2024-08-18T22:04:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.853+0000 7f44e77fe640 1 --2- 172.21.15.123:0/2218366984 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f44d00a2b80 0x7f44d00a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009230 tx=0x7f44d80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:04:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:57.856+0000 7f44e4ff9640 1 -- 172.21.15.123:0/2218366984 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f44e0016030 con 0x7f44e8102c20 2024-08-18T22:04:58.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:58.060+0000 7f44edb4e640 1 -- 172.21.15.123:0/2218366984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44e8199500 con 0x7f44e8102c20 2024-08-18T22:04:58.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:58.060+0000 7f44e4ff9640 1 -- 172.21.15.123:0/2218366984 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f44e009c570 con 0x7f44e8102c20 2024-08-18T22:04:58.062 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:04:58.062 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"btime":"2024-08-18T22:04:57:364887+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-18T22:04:58.062 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-08-18T22:04:58.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:58.063+0000 7f44edb4e640 1 -- 172.21.15.123:0/2218366984 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f44d00a2b80 msgr2=0x7f44d00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:58.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:58.063+0000 7f44edb4e640 1 --2- 172.21.15.123:0/2218366984 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f44d00a2b80 0x7f44d00a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009230 tx=0x7f44d80058d0 comp rx=0 tx=0).stop 2024-08-18T22:04:58.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:58.063+0000 7f44edb4e640 1 -- 172.21.15.123:0/2218366984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e8102c20 msgr2=0x7f44e819ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:04:58.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:58.063+0000 7f44edb4e640 1 --2- 172.21.15.123:0/2218366984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e8102c20 0x7f44e819ca70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f44e000eaa0 tx=0x7f44e000ef60 comp rx=0 tx=0).stop 2024-08-18T22:04:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:58.063+0000 7f44edb4e640 1 -- 172.21.15.123:0/2218366984 shutdown_connections 2024-08-18T22:04:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:58.063+0000 7f44edb4e640 1 --2- 172.21.15.123:0/2218366984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e8102c20 0x7f44e819ca70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:58.063+0000 7f44edb4e640 1 --2- 172.21.15.123:0/2218366984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44e81022a0 0x7f44e81986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:58.063+0000 7f44edb4e640 1 --2- 172.21.15.123:0/2218366984 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f44d00a2b80 0x7f44d00a5040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:58.063+0000 7f44edb4e640 1 --2- 172.21.15.123:0/2218366984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44e8100b50 0x7f44e81981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:04:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:58.063+0000 7f44edb4e640 1 -- 172.21.15.123:0/2218366984 >> 172.21.15.123:0/2218366984 conn(0x7f44e80fc500 msgr2=0x7f44e8069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:04:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:58.064+0000 7f44edb4e640 1 -- 172.21.15.123:0/2218366984 shutdown_connections 2024-08-18T22:04:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:04:58.064+0000 7f44edb4e640 1 -- 172.21.15.123:0/2218366984 wait complete. 2024-08-18T22:04:58.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:58 smithi130 ceph-mon[21698]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:58.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:58 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] up:boot 2024-08-18T22:04:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:58 smithi130 ceph-mon[21698]: fsmap 7 up:standby 2024-08-18T22:04:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-18T22:04:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:58 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:58 smithi130 ceph-mon[21698]: Deploying daemon mds.h on smithi130 2024-08-18T22:04:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:04:58 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2218366984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:58 smithi183 ceph-mon[22097]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:58 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] up:boot 2024-08-18T22:04:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:58 smithi183 ceph-mon[22097]: fsmap 7 up:standby 2024-08-18T22:04:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-18T22:04:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:58.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:58.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:58 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:58.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:58 smithi183 ceph-mon[22097]: Deploying daemon mds.h on smithi130 2024-08-18T22:04:58.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:04:58 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2218366984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:04:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:58 smithi123 ceph-mon[18462]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:04:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:58 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] up:boot 2024-08-18T22:04:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:58 smithi123 ceph-mon[18462]: fsmap 7 up:standby 2024-08-18T22:04:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-18T22:04:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:04:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:04:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:04:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:58 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:04:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:58 smithi123 ceph-mon[18462]: Deploying daemon mds.h on smithi130 2024-08-18T22:04:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:04:58 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2218366984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:00.264 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 18 22:04:59 smithi130 systemd[1]: Started Ceph mds.h for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T22:05:00.632 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:00 smithi183 ceph-mon[22097]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:00.633 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:00 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:00.633 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:00 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:00.633 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:00 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:00.633 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:00 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:05:00.633 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:00 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:05:00.633 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:00 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:00.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:00 smithi123 ceph-mon[18462]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:00.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:00 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:00.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:00 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:00.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:00 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:00.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:00 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:05:00.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:00 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:05:00.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:00 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:00.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:00 smithi130 ceph-mon[21698]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:00.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:00 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:00.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:00 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:00.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:00 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:00.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:00 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:05:00.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:00 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:05:00.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:00 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:00.835 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:05:01.102 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:01.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:01 smithi123 ceph-mon[18462]: Deploying daemon mds.i on smithi183 2024-08-18T22:05:01.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:01 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.130:6836/29028326,v1:172.21.15.130:6837/29028326] up:boot 2024-08-18T22:05:01.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:01 smithi123 ceph-mon[18462]: fsmap 8 up:standby 2024-08-18T22:05:01.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:01 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-18T22:05:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.597+0000 7f5c9931e640 1 -- 172.21.15.123:0/871208165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94103430 msgr2=0x7f5c9410b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.597+0000 7f5c9931e640 1 --2- 172.21.15.123:0/871208165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94103430 0x7f5c9410b920 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c009900 tx=0x7f5c7c02a480 comp rx=0 tx=0).stop 2024-08-18T22:05:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.597+0000 7f5c9931e640 1 -- 172.21.15.123:0/871208165 shutdown_connections 2024-08-18T22:05:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.597+0000 7f5c9931e640 1 --2- 172.21.15.123:0/871208165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c9410beb0 0x7f5c9410e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.597+0000 7f5c9931e640 1 --2- 172.21.15.123:0/871208165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94103430 0x7f5c9410b920 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:01.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.597+0000 7f5c9931e640 1 --2- 172.21.15.123:0/871208165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c94102b10 0x7f5c94102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:01.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.597+0000 7f5c9931e640 1 -- 172.21.15.123:0/871208165 >> 172.21.15.123:0/871208165 conn(0x7f5c940fc4d0 msgr2=0x7f5c940fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:01.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.597+0000 7f5c9931e640 1 -- 172.21.15.123:0/871208165 shutdown_connections 2024-08-18T22:05:01.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.597+0000 7f5c9931e640 1 -- 172.21.15.123:0/871208165 wait complete. 2024-08-18T22:05:01.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c9931e640 1 Processor -- start 2024-08-18T22:05:01.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c9931e640 1 -- start start 2024-08-18T22:05:01.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c9931e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102b10 0x7f5c941981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:01.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c9931e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c94103430 0x7f5c94198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:01.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c9931e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c9410beb0 0x7f5c9419cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:01.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c9931e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5c94111ca0 con 0x7f5c94102b10 2024-08-18T22:05:01.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c9931e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5c94111b20 con 0x7f5c94103430 2024-08-18T22:05:01.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c9931e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5c94111e20 con 0x7f5c9410beb0 2024-08-18T22:05:01.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c92ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102b10 0x7f5c941981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c92ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102b10 0x7f5c941981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47880/0 (socket says 172.21.15.123:47880) 2024-08-18T22:05:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c92ffd640 1 -- 172.21.15.123:0/4084750406 learned_addr learned my addr 172.21.15.123:0/4084750406 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c937fe640 1 --2- 172.21.15.123:0/4084750406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c9410beb0 0x7f5c9419cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c8bfff640 1 --2- 172.21.15.123:0/4084750406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c94103430 0x7f5c94198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c92ffd640 1 -- 172.21.15.123:0/4084750406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c9410beb0 msgr2=0x7f5c9419cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c92ffd640 1 --2- 172.21.15.123:0/4084750406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c9410beb0 0x7f5c9419cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c92ffd640 1 -- 172.21.15.123:0/4084750406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c94103430 msgr2=0x7f5c94198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c92ffd640 1 --2- 172.21.15.123:0/4084750406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c94103430 0x7f5c94198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c92ffd640 1 -- 172.21.15.123:0/4084750406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9419d190 con 0x7f5c94102b10 2024-08-18T22:05:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.598+0000 7f5c92ffd640 1 --2- 172.21.15.123:0/4084750406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102b10 0x7f5c941981e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400e9f0 tx=0x7f5c8400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.599+0000 7f5c90ff9640 1 -- 172.21.15.123:0/4084750406 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8400cd80 con 0x7f5c94102b10 2024-08-18T22:05:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.599+0000 7f5c9931e640 1 -- 172.21.15.123:0/4084750406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c9419d480 con 0x7f5c94102b10 2024-08-18T22:05:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.599+0000 7f5c90ff9640 1 -- 172.21.15.123:0/4084750406 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c84005500 con 0x7f5c94102b10 2024-08-18T22:05:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.599+0000 7f5c90ff9640 1 -- 172.21.15.123:0/4084750406 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c84010690 con 0x7f5c94102b10 2024-08-18T22:05:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.599+0000 7f5c9931e640 1 -- 172.21.15.123:0/4084750406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c941a4d60 con 0x7f5c94102b10 2024-08-18T22:05:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.600+0000 7f5c9931e640 1 -- 172.21.15.123:0/4084750406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c94102ef0 con 0x7f5c94102b10 2024-08-18T22:05:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.601+0000 7f5c90ff9640 1 -- 172.21.15.123:0/4084750406 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5c840046c0 con 0x7f5c94102b10 2024-08-18T22:05:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.602+0000 7f5c90ff9640 1 --2- 172.21.15.123:0/4084750406 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5c800a2b80 0x7f5c800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.602+0000 7f5c8bfff640 1 --2- 172.21.15.123:0/4084750406 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5c800a2b80 0x7f5c800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.602+0000 7f5c90ff9640 1 -- 172.21.15.123:0/4084750406 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f5c840cf030 con 0x7f5c94102b10 2024-08-18T22:05:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.602+0000 7f5c8bfff640 1 --2- 172.21.15.123:0/4084750406 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5c800a2b80 0x7f5c800a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5c940feb40 tx=0x7f5c7c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.606+0000 7f5c90ff9640 1 -- 172.21.15.123:0/4084750406 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5c8409c430 con 0x7f5c94102b10 2024-08-18T22:05:01.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:01 smithi183 ceph-mon[22097]: Deploying daemon mds.i on smithi183 2024-08-18T22:05:01.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:01 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.130:6836/29028326,v1:172.21.15.130:6837/29028326] up:boot 2024-08-18T22:05:01.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:01 smithi183 ceph-mon[22097]: fsmap 8 up:standby 2024-08-18T22:05:01.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:01 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-18T22:05:01.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:01 smithi130 ceph-mon[21698]: Deploying daemon mds.i on smithi183 2024-08-18T22:05:01.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:01 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.130:6836/29028326,v1:172.21.15.130:6837/29028326] up:boot 2024-08-18T22:05:01.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:01 smithi130 ceph-mon[21698]: fsmap 8 up:standby 2024-08-18T22:05:01.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:01 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-18T22:05:01.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.806+0000 7f5c9931e640 1 -- 172.21.15.123:0/4084750406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c94106f60 con 0x7f5c94102b10 2024-08-18T22:05:01.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.807+0000 7f5c90ff9640 1 -- 172.21.15.123:0/4084750406 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7216 (secure 0 0 0) 0x7f5c8409bd30 con 0x7f5c94102b10 2024-08-18T22:05:01.808 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:05:01.808 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"btime":"2024-08-18T22:05:00:373035+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-18T22:05:01.808 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2024-08-18T22:05:01.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.809+0000 7f5c9931e640 1 -- 172.21.15.123:0/4084750406 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5c800a2b80 msgr2=0x7f5c800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:01.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.809+0000 7f5c9931e640 1 --2- 172.21.15.123:0/4084750406 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5c800a2b80 0x7f5c800a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5c940feb40 tx=0x7f5c7c005a20 comp rx=0 tx=0).stop 2024-08-18T22:05:01.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.809+0000 7f5c9931e640 1 -- 172.21.15.123:0/4084750406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102b10 msgr2=0x7f5c941981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:01.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.809+0000 7f5c9931e640 1 --2- 172.21.15.123:0/4084750406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102b10 0x7f5c941981e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400e9f0 tx=0x7f5c8400edf0 comp rx=0 tx=0).stop 2024-08-18T22:05:01.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.809+0000 7f5c9931e640 1 -- 172.21.15.123:0/4084750406 shutdown_connections 2024-08-18T22:05:01.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.809+0000 7f5c9931e640 1 --2- 172.21.15.123:0/4084750406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c9410beb0 0x7f5c9419cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:01.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.809+0000 7f5c9931e640 1 --2- 172.21.15.123:0/4084750406 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5c800a2b80 0x7f5c800a5040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:01.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.809+0000 7f5c9931e640 1 --2- 172.21.15.123:0/4084750406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c94103430 0x7f5c94198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:01.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.809+0000 7f5c9931e640 1 --2- 172.21.15.123:0/4084750406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c94102b10 0x7f5c941981e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:01.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.809+0000 7f5c9931e640 1 -- 172.21.15.123:0/4084750406 >> 172.21.15.123:0/4084750406 conn(0x7f5c940fc4d0 msgr2=0x7f5c940fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:01.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.809+0000 7f5c9931e640 1 -- 172.21.15.123:0/4084750406 shutdown_connections 2024-08-18T22:05:01.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:01.809+0000 7f5c9931e640 1 -- 172.21.15.123:0/4084750406 wait complete. 2024-08-18T22:05:02.331 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:05:02 smithi183 podman[52217]: 2024-08-18 22:05:02.3311731 +0000 UTC m=+0.146648179 container create 9f6d80154c0d34ec5c7306b1b7d9b35a14e87213db1228fb4ca1ee3a2f08948d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:05:02.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:02 smithi123 ceph-mon[18462]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:02.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:02 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/4084750406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:02.609 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:02 smithi183 ceph-mon[22097]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:02.609 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:02 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/4084750406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:02.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:02 smithi130 ceph-mon[21698]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:02.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:02 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/4084750406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:02.909 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:05:02 smithi183 podman[52217]: 2024-08-18 22:05:02.609079088 +0000 UTC m=+0.424554092 container init 9f6d80154c0d34ec5c7306b1b7d9b35a14e87213db1228fb4ca1ee3a2f08948d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-08-18T22:05:02.909 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:05:02 smithi183 podman[52217]: 2024-08-18 22:05:02.612219584 +0000 UTC m=+0.427694590 container start 9f6d80154c0d34ec5c7306b1b7d9b35a14e87213db1228fb4ca1ee3a2f08948d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:05:02.909 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:05:02 smithi183 ceph-mds[52236]: -- 172.21.15.183:0/1790460404 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560b49785c20 con 0x560b49763000 2024-08-18T22:05:02.909 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:05:02 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: starting mds.i at 2024-08-18T22:05:02.909 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:05:02 smithi183 bash[52217]: 9f6d80154c0d34ec5c7306b1b7d9b35a14e87213db1228fb4ca1ee3a2f08948d 2024-08-18T22:05:02.909 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:05:02 smithi183 systemd[1]: Started Ceph mds.i for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T22:05:04.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:04.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:04.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:04.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:05:04.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:05:04.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:04.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:03 smithi123 ceph-mon[18462]: Deploying daemon mds.g on smithi123 2024-08-18T22:05:04.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:03 smithi123 ceph-mon[18462]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:04.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:03 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] up:boot 2024-08-18T22:05:04.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:03 smithi123 ceph-mon[18462]: fsmap 9 up:standby 2024-08-18T22:05:04.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:03 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-18T22:05:04.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:04.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:04.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:04.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:05:04.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:05:04.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:04.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:03 smithi130 ceph-mon[21698]: Deploying daemon mds.g on smithi123 2024-08-18T22:05:04.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:03 smithi130 ceph-mon[21698]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:04.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:03 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] up:boot 2024-08-18T22:05:04.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:03 smithi130 ceph-mon[21698]: fsmap 9 up:standby 2024-08-18T22:05:04.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:03 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-18T22:05:04.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:04.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:04.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:04.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:05:04.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:05:04.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:04.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:03 smithi183 ceph-mon[22097]: Deploying daemon mds.g on smithi123 2024-08-18T22:05:04.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:03 smithi183 ceph-mon[22097]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:04.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:03 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] up:boot 2024-08-18T22:05:04.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:03 smithi183 ceph-mon[22097]: fsmap 9 up:standby 2024-08-18T22:05:04.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:03 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-18T22:05:04.517 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:05:04.815 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:04.942 INFO:journalctl@ceph.mds.g.smithi123.stdout:Aug 18 22:05:04 smithi123 systemd[1]: Starting Ceph mds.g for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:05:05.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.326+0000 7fca88798640 1 -- 172.21.15.123:0/143808342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80101150 msgr2=0x7fca8010d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:05.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.326+0000 7fca88798640 1 --2- 172.21.15.123:0/143808342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80101150 0x7fca8010d680 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fca78009cd0 tx=0x7fca7802a8e0 comp rx=0 tx=0).stop 2024-08-18T22:05:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.326+0000 7fca88798640 1 -- 172.21.15.123:0/143808342 shutdown_connections 2024-08-18T22:05:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.326+0000 7fca88798640 1 --2- 172.21.15.123:0/143808342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80101150 0x7fca8010d680 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.326+0000 7fca88798640 1 --2- 172.21.15.123:0/143808342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca801007b0 0x7fca80100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.326+0000 7fca88798640 1 --2- 172.21.15.123:0/143808342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca801067b0 0x7fca80106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.326+0000 7fca88798640 1 -- 172.21.15.123:0/143808342 >> 172.21.15.123:0/143808342 conn(0x7fca800fc4d0 msgr2=0x7fca800fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.326+0000 7fca88798640 1 -- 172.21.15.123:0/143808342 shutdown_connections 2024-08-18T22:05:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.326+0000 7fca88798640 1 -- 172.21.15.123:0/143808342 wait complete. 2024-08-18T22:05:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca88798640 1 Processor -- start 2024-08-18T22:05:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca88798640 1 -- start start 2024-08-18T22:05:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca88798640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca801007b0 0x7fca80199000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca88798640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80101150 0x7fca80199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca88798640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca801067b0 0x7fca801a4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca88798640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fca80110bd0 con 0x7fca80101150 2024-08-18T22:05:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca88798640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fca80110a50 con 0x7fca801067b0 2024-08-18T22:05:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca88798640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fca80110d50 con 0x7fca801007b0 2024-08-18T22:05:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca85d33640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80101150 0x7fca80199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca85d33640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80101150 0x7fca80199540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60412/0 (socket says 172.21.15.123:60412) 2024-08-18T22:05:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca85d33640 1 -- 172.21.15.123:0/27421268 learned_addr learned my addr 172.21.15.123:0/27421268 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca86534640 1 --2- 172.21.15.123:0/27421268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca801007b0 0x7fca80199000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca86d35640 1 --2- 172.21.15.123:0/27421268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca801067b0 0x7fca801a4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca85d33640 1 -- 172.21.15.123:0/27421268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca801007b0 msgr2=0x7fca80199000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca85d33640 1 --2- 172.21.15.123:0/27421268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca801007b0 0x7fca80199000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca85d33640 1 -- 172.21.15.123:0/27421268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca801067b0 msgr2=0x7fca801a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca85d33640 1 --2- 172.21.15.123:0/27421268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca801067b0 0x7fca801a4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca85d33640 1 -- 172.21.15.123:0/27421268 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca801a45c0 con 0x7fca80101150 2024-08-18T22:05:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca86d35640 1 --2- 172.21.15.123:0/27421268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca801067b0 0x7fca801a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:05:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.327+0000 7fca85d33640 1 --2- 172.21.15.123:0/27421268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80101150 0x7fca80199540 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00c890 tx=0x7fca7c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.328+0000 7fca737fe640 1 -- 172.21.15.123:0/27421268 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c004220 con 0x7fca80101150 2024-08-18T22:05:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.328+0000 7fca88798640 1 -- 172.21.15.123:0/27421268 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca801a4790 con 0x7fca80101150 2024-08-18T22:05:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.328+0000 7fca737fe640 1 -- 172.21.15.123:0/27421268 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca7c0043c0 con 0x7fca80101150 2024-08-18T22:05:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.328+0000 7fca737fe640 1 -- 172.21.15.123:0/27421268 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c004a00 con 0x7fca80101150 2024-08-18T22:05:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.328+0000 7fca88798640 1 -- 172.21.15.123:0/27421268 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca801a4c80 con 0x7fca80101150 2024-08-18T22:05:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.329+0000 7fca88798640 1 -- 172.21.15.123:0/27421268 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca80100c10 con 0x7fca80101150 2024-08-18T22:05:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.330+0000 7fca737fe640 1 -- 172.21.15.123:0/27421268 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fca7c0079b0 con 0x7fca80101150 2024-08-18T22:05:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.330+0000 7fca737fe640 1 --2- 172.21.15.123:0/27421268 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fca6c0a2b80 0x7fca6c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.331+0000 7fca86534640 1 --2- 172.21.15.123:0/27421268 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fca6c0a2b80 0x7fca6c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.331+0000 7fca737fe640 1 -- 172.21.15.123:0/27421268 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fca7c0ce950 con 0x7fca80101150 2024-08-18T22:05:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.331+0000 7fca86534640 1 --2- 172.21.15.123:0/27421268 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fca6c0a2b80 0x7fca6c0a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fca7400a810 tx=0x7fca74008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.335+0000 7fca737fe640 1 -- 172.21.15.123:0/27421268 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fca7c014030 con 0x7fca80101150 2024-08-18T22:05:05.510 INFO:journalctl@ceph.mds.g.smithi123.stdout:Aug 18 22:05:05 smithi123 podman[56395]: 2024-08-18 22:05:05.384852793 +0000 UTC m=+0.019383036 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:05:05.510 INFO:journalctl@ceph.mds.g.smithi123.stdout:Aug 18 22:05:05 smithi123 podman[56395]: 2024-08-18 22:05:05.488816843 +0000 UTC m=+0.123347075 container create 3d4cd7dae5adcce8b481e0267db3d7f8b9db5810f4f43ded45bb40476877d7e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-g, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-18T22:05:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.546+0000 7fca88798640 1 -- 172.21.15.123:0/27421268 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca8006aab0 con 0x7fca80101150 2024-08-18T22:05:05.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.546+0000 7fca737fe640 1 -- 172.21.15.123:0/27421268 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8046 (secure 0 0 0) 0x7fca7c09bd50 con 0x7fca80101150 2024-08-18T22:05:05.547 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:05:05.547 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":10,"btime":"2024-08-18T22:05:03:385837+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-18T22:05:05.548 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 10 2024-08-18T22:05:05.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.549+0000 7fca88798640 1 -- 172.21.15.123:0/27421268 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fca6c0a2b80 msgr2=0x7fca6c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:05.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.549+0000 7fca88798640 1 --2- 172.21.15.123:0/27421268 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fca6c0a2b80 0x7fca6c0a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fca7400a810 tx=0x7fca74008040 comp rx=0 tx=0).stop 2024-08-18T22:05:05.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.549+0000 7fca88798640 1 -- 172.21.15.123:0/27421268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80101150 msgr2=0x7fca80199540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:05.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.549+0000 7fca88798640 1 --2- 172.21.15.123:0/27421268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80101150 0x7fca80199540 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00c890 tx=0x7fca7c00cd50 comp rx=0 tx=0).stop 2024-08-18T22:05:05.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.549+0000 7fca88798640 1 -- 172.21.15.123:0/27421268 shutdown_connections 2024-08-18T22:05:05.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.549+0000 7fca88798640 1 --2- 172.21.15.123:0/27421268 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fca6c0a2b80 0x7fca6c0a5040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:05.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.549+0000 7fca88798640 1 --2- 172.21.15.123:0/27421268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca801067b0 0x7fca801a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:05.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.549+0000 7fca88798640 1 --2- 172.21.15.123:0/27421268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80101150 0x7fca80199540 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:05.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.549+0000 7fca88798640 1 --2- 172.21.15.123:0/27421268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca801007b0 0x7fca80199000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:05.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.549+0000 7fca88798640 1 -- 172.21.15.123:0/27421268 >> 172.21.15.123:0/27421268 conn(0x7fca800fc4d0 msgr2=0x7fca800fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:05.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.549+0000 7fca88798640 1 -- 172.21.15.123:0/27421268 shutdown_connections 2024-08-18T22:05:05.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:05.549+0000 7fca88798640 1 -- 172.21.15.123:0/27421268 wait complete. 2024-08-18T22:05:06.260 INFO:journalctl@ceph.mds.g.smithi123.stdout:Aug 18 22:05:05 smithi123 podman[56395]: 2024-08-18 22:05:05.926821769 +0000 UTC m=+0.561352014 container init 3d4cd7dae5adcce8b481e0267db3d7f8b9db5810f4f43ded45bb40476877d7e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-18T22:05:06.260 INFO:journalctl@ceph.mds.g.smithi123.stdout:Aug 18 22:05:05 smithi123 podman[56395]: 2024-08-18 22:05:05.929737432 +0000 UTC m=+0.564267666 container start 3d4cd7dae5adcce8b481e0267db3d7f8b9db5810f4f43ded45bb40476877d7e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-g, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:05:06.260 INFO:journalctl@ceph.mds.g.smithi123.stdout:Aug 18 22:05:05 smithi123 ceph-mds[56426]: -- 172.21.15.123:0/1698412750 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5560f1281860 con 0x5560f125f000 2024-08-18T22:05:06.260 INFO:journalctl@ceph.mds.g.smithi123.stdout:Aug 18 22:05:05 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-g[56422]: starting mds.g at 2024-08-18T22:05:06.260 INFO:journalctl@ceph.mds.g.smithi123.stdout:Aug 18 22:05:06 smithi123 bash[56395]: 3d4cd7dae5adcce8b481e0267db3d7f8b9db5810f4f43ded45bb40476877d7e5 2024-08-18T22:05:06.260 INFO:journalctl@ceph.mds.g.smithi123.stdout:Aug 18 22:05:06 smithi123 systemd[1]: Started Ceph mds.g for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T22:05:06.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:06 smithi183 ceph-mon[22097]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:06.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:06 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/27421268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:06.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:06 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:06.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:06 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:06.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:06 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:06.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:06 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:05:06.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:06 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:05:06.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:06 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:06.664 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:06 smithi123 ceph-mon[18462]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:06.665 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:06 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/27421268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:06.665 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:06 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:06.665 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:06 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:06.665 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:06 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:06.665 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:06 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:05:06.665 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:06 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:05:06.665 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:06 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:06.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:06 smithi130 ceph-mon[21698]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:06.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:06 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/27421268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:06.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:06 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:06.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:06 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:06.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:06 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:06.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:06 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:05:06.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:06 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:05:06.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:06 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:07.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:07 smithi123 ceph-mon[18462]: Deploying daemon mds.a on smithi123 2024-08-18T22:05:07.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:07 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.123:6838/1921278824,v1:172.21.15.123:6839/1921278824] up:boot 2024-08-18T22:05:07.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:07 smithi123 ceph-mon[18462]: fsmap 10 up:standby 2024-08-18T22:05:07.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:07 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-18T22:05:07.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:07 smithi183 ceph-mon[22097]: Deploying daemon mds.a on smithi123 2024-08-18T22:05:07.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:07 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.123:6838/1921278824,v1:172.21.15.123:6839/1921278824] up:boot 2024-08-18T22:05:07.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:07 smithi183 ceph-mon[22097]: fsmap 10 up:standby 2024-08-18T22:05:07.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:07 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-18T22:05:07.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:07 smithi130 ceph-mon[21698]: Deploying daemon mds.a on smithi123 2024-08-18T22:05:07.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:07 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.123:6838/1921278824,v1:172.21.15.123:6839/1921278824] up:boot 2024-08-18T22:05:07.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:07 smithi130 ceph-mon[21698]: fsmap 10 up:standby 2024-08-18T22:05:07.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:07 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-18T22:05:08.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:08 smithi183 ceph-mon[22097]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:08.691 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:05:08.699 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:08 smithi123 ceph-mon[18462]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:08.699 INFO:journalctl@ceph.mds.a.smithi123.stdout:Aug 18 22:05:08 smithi123 systemd[1]: Starting Ceph mds.a for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:05:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:08 smithi130 ceph-mon[21698]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:08.953 INFO:journalctl@ceph.mds.a.smithi123.stdout:Aug 18 22:05:08 smithi123 podman[56712]: 2024-08-18 22:05:08.601206128 +0000 UTC m=+0.017282984 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:05:08.953 INFO:journalctl@ceph.mds.a.smithi123.stdout:Aug 18 22:05:08 smithi123 podman[56712]: 2024-08-18 22:05:08.724925542 +0000 UTC m=+0.141002384 container create 9da9ee9cac777d0f26f3b46f24c380eb096b2d0d4536962f589beaca4d496fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-18T22:05:08.953 INFO:journalctl@ceph.mds.a.smithi123.stdout:Aug 18 22:05:08 smithi123 podman[56712]: 2024-08-18 22:05:08.952740806 +0000 UTC m=+0.368817646 container init 9da9ee9cac777d0f26f3b46f24c380eb096b2d0d4536962f589beaca4d496fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0) 2024-08-18T22:05:09.134 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:09.257 INFO:journalctl@ceph.mds.a.smithi123.stdout:Aug 18 22:05:08 smithi123 podman[56712]: 2024-08-18 22:05:08.955905877 +0000 UTC m=+0.371982718 container start 9da9ee9cac777d0f26f3b46f24c380eb096b2d0d4536962f589beaca4d496fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-a, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:05:09.258 INFO:journalctl@ceph.mds.a.smithi123.stdout:Aug 18 22:05:08 smithi123 ceph-mds[56760]: -- 172.21.15.123:0/1442277305 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559826273860 con 0x559826250800 2024-08-18T22:05:09.258 INFO:journalctl@ceph.mds.a.smithi123.stdout:Aug 18 22:05:08 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-a[56745]: starting mds.a at 2024-08-18T22:05:09.258 INFO:journalctl@ceph.mds.a.smithi123.stdout:Aug 18 22:05:09 smithi123 bash[56712]: 9da9ee9cac777d0f26f3b46f24c380eb096b2d0d4536962f589beaca4d496fd3 2024-08-18T22:05:09.258 INFO:journalctl@ceph.mds.a.smithi123.stdout:Aug 18 22:05:09 smithi123 systemd[1]: Started Ceph mds.a for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T22:05:09.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.628+0000 7f5ce3bcd640 1 -- 172.21.15.123:0/2186934514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc0742c0 msgr2=0x7f5cdc0746a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:09.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.628+0000 7f5ce3bcd640 1 --2- 172.21.15.123:0/2186934514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc0742c0 0x7f5cdc0746a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009ca0 tx=0x7f5ccc02a950 comp rx=0 tx=0).stop 2024-08-18T22:05:09.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.629+0000 7f5ce3bcd640 1 -- 172.21.15.123:0/2186934514 shutdown_connections 2024-08-18T22:05:09.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.629+0000 7f5ce3bcd640 1 --2- 172.21.15.123:0/2186934514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cdc1128d0 0x7f5cdc114cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:09.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.629+0000 7f5ce3bcd640 1 --2- 172.21.15.123:0/2186934514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cdc074be0 0x7f5cdc112390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:09.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.629+0000 7f5ce3bcd640 1 --2- 172.21.15.123:0/2186934514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc0742c0 0x7f5cdc0746a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:09.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.629+0000 7f5ce3bcd640 1 -- 172.21.15.123:0/2186934514 >> 172.21.15.123:0/2186934514 conn(0x7f5cdc0fd5e0 msgr2=0x7f5cdc0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:09.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.629+0000 7f5ce3bcd640 1 -- 172.21.15.123:0/2186934514 shutdown_connections 2024-08-18T22:05:09.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.629+0000 7f5ce3bcd640 1 -- 172.21.15.123:0/2186934514 wait complete. 2024-08-18T22:05:09.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.629+0000 7f5ce3bcd640 1 Processor -- start 2024-08-18T22:05:09.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.629+0000 7f5ce3bcd640 1 -- start start 2024-08-18T22:05:09.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.629+0000 7f5ce3bcd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cdc0742c0 0x7f5cdc1a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:09.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.629+0000 7f5ce3bcd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc074be0 0x7f5cdc1a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:09.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.629+0000 7f5ce3bcd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cdc1128d0 0x7f5cdc19e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:09.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.629+0000 7f5ce3bcd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc118320 con 0x7f5cdc074be0 2024-08-18T22:05:09.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.629+0000 7f5ce3bcd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc1181a0 con 0x7f5cdc1128d0 2024-08-18T22:05:09.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.629+0000 7f5ce3bcd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc1184a0 con 0x7f5cdc0742c0 2024-08-18T22:05:09.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5ce1168640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc074be0 0x7f5cdc1a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:09.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5ce1168640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc074be0 0x7f5cdc1a4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60454/0 (socket says 172.21.15.123:60454) 2024-08-18T22:05:09.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5ce1168640 1 -- 172.21.15.123:0/3728737224 learned_addr learned my addr 172.21.15.123:0/3728737224 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:09.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5ce216a640 1 --2- 172.21.15.123:0/3728737224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cdc1128d0 0x7f5cdc19e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:09.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5ce1969640 1 --2- 172.21.15.123:0/3728737224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cdc0742c0 0x7f5cdc1a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:09.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5ce1168640 1 -- 172.21.15.123:0/3728737224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cdc0742c0 msgr2=0x7f5cdc1a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:09.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5ce1168640 1 --2- 172.21.15.123:0/3728737224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cdc0742c0 0x7f5cdc1a45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:09.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5ce1168640 1 -- 172.21.15.123:0/3728737224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cdc1128d0 msgr2=0x7f5cdc19e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:09.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5ce1168640 1 --2- 172.21.15.123:0/3728737224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cdc1128d0 0x7f5cdc19e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:09.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5ce1168640 1 -- 172.21.15.123:0/3728737224 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cdc19ef20 con 0x7f5cdc074be0 2024-08-18T22:05:09.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5ce1969640 1 --2- 172.21.15.123:0/3728737224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cdc0742c0 0x7f5cdc1a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:05:09.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5ce1168640 1 --2- 172.21.15.123:0/3728737224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc074be0 0x7f5cdc1a4b20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000b4a0 tx=0x7f5cd000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:09.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5cdaffd640 1 -- 172.21.15.123:0/3728737224 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0014070 con 0x7f5cdc074be0 2024-08-18T22:05:09.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5ce3bcd640 1 -- 172.21.15.123:0/3728737224 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cdc19f210 con 0x7f5cdc074be0 2024-08-18T22:05:09.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5cdaffd640 1 -- 172.21.15.123:0/3728737224 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cd0010af0 con 0x7f5cdc074be0 2024-08-18T22:05:09.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5cdaffd640 1 -- 172.21.15.123:0/3728737224 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0017d10 con 0x7f5cdc074be0 2024-08-18T22:05:09.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.630+0000 7f5ce3bcd640 1 -- 172.21.15.123:0/3728737224 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cdc1ab560 con 0x7f5cdc074be0 2024-08-18T22:05:09.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.631+0000 7f5ce3bcd640 1 -- 172.21.15.123:0/3728737224 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cdc075a00 con 0x7f5cdc074be0 2024-08-18T22:05:09.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.632+0000 7f5cdaffd640 1 -- 172.21.15.123:0/3728737224 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5cd0017070 con 0x7f5cdc074be0 2024-08-18T22:05:09.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.633+0000 7f5cdaffd640 1 --2- 172.21.15.123:0/3728737224 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5cc40a2b80 0x7f5cc40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:09.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.633+0000 7f5ce1969640 1 --2- 172.21.15.123:0/3728737224 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5cc40a2b80 0x7f5cc40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:09.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.633+0000 7f5cdaffd640 1 -- 172.21.15.123:0/3728737224 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f5cd00ce300 con 0x7f5cdc074be0 2024-08-18T22:05:09.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.633+0000 7f5ce1969640 1 --2- 172.21.15.123:0/3728737224 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5cc40a2b80 0x7f5cc40a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc006010 tx=0x7f5ccc005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:09.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.636+0000 7f5cdaffd640 1 -- 172.21.15.123:0/3728737224 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5cd009b700 con 0x7f5cdc074be0 2024-08-18T22:05:09.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.836+0000 7f5ce3bcd640 1 -- 172.21.15.123:0/3728737224 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cdc104d10 con 0x7f5cdc074be0 2024-08-18T22:05:09.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.837+0000 7f5cdaffd640 1 -- 172.21.15.123:0/3728737224 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9701 (secure 0 0 0) 0x7f5cd009b000 con 0x7f5cdc074be0 2024-08-18T22:05:09.838 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:05:09.839 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":12,"btime":"2024-08-18T22:05:09:393465+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-18T22:05:09.839 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 12 2024-08-18T22:05:09.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.839+0000 7f5ce3bcd640 1 -- 172.21.15.123:0/3728737224 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5cc40a2b80 msgr2=0x7f5cc40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:09.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.839+0000 7f5ce3bcd640 1 --2- 172.21.15.123:0/3728737224 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5cc40a2b80 0x7f5cc40a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc006010 tx=0x7f5ccc005f80 comp rx=0 tx=0).stop 2024-08-18T22:05:09.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.839+0000 7f5ce3bcd640 1 -- 172.21.15.123:0/3728737224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc074be0 msgr2=0x7f5cdc1a4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:09.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.839+0000 7f5ce3bcd640 1 --2- 172.21.15.123:0/3728737224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc074be0 0x7f5cdc1a4b20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000b4a0 tx=0x7f5cd000b960 comp rx=0 tx=0).stop 2024-08-18T22:05:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.839+0000 7f5ce3bcd640 1 -- 172.21.15.123:0/3728737224 shutdown_connections 2024-08-18T22:05:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.839+0000 7f5ce3bcd640 1 --2- 172.21.15.123:0/3728737224 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5cc40a2b80 0x7f5cc40a5040 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.839+0000 7f5ce3bcd640 1 --2- 172.21.15.123:0/3728737224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cdc1128d0 0x7f5cdc19e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.839+0000 7f5ce3bcd640 1 --2- 172.21.15.123:0/3728737224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc074be0 0x7f5cdc1a4b20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.839+0000 7f5ce3bcd640 1 --2- 172.21.15.123:0/3728737224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cdc0742c0 0x7f5cdc1a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.839+0000 7f5ce3bcd640 1 -- 172.21.15.123:0/3728737224 >> 172.21.15.123:0/3728737224 conn(0x7f5cdc0fd5e0 msgr2=0x7f5cdc0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.840+0000 7f5ce3bcd640 1 -- 172.21.15.123:0/3728737224 shutdown_connections 2024-08-18T22:05:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:09.840+0000 7f5ce3bcd640 1 -- 172.21.15.123:0/3728737224 wait complete. 2024-08-18T22:05:10.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:10.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:10.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:10.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:05:10.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:05:10.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:10.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:10 smithi130 ceph-mon[21698]: Deploying daemon mds.b on smithi130 2024-08-18T22:05:10.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:10 smithi130 ceph-mon[21698]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:10.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:10 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.123:6840/344960390,v1:172.21.15.123:6841/344960390] up:boot 2024-08-18T22:05:10.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:10 smithi130 ceph-mon[21698]: fsmap 11 up:standby 2024-08-18T22:05:10.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-18T22:05:10.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:10 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3728737224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:10.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:10.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:10.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:10.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:05:10.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:05:10.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:10.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:10 smithi183 ceph-mon[22097]: Deploying daemon mds.b on smithi130 2024-08-18T22:05:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:10 smithi183 ceph-mon[22097]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:10 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.123:6840/344960390,v1:172.21.15.123:6841/344960390] up:boot 2024-08-18T22:05:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:10 smithi183 ceph-mon[22097]: fsmap 11 up:standby 2024-08-18T22:05:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-18T22:05:10.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:10 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3728737224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:10.504 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:10.504 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:10.504 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:10.504 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:05:10.504 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:05:10.504 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:10.504 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:10 smithi123 ceph-mon[18462]: Deploying daemon mds.b on smithi130 2024-08-18T22:05:10.504 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:10 smithi123 ceph-mon[18462]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:10.505 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:10 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.123:6840/344960390,v1:172.21.15.123:6841/344960390] up:boot 2024-08-18T22:05:10.505 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:10 smithi123 ceph-mon[18462]: fsmap 11 up:standby 2024-08-18T22:05:10.505 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-18T22:05:10.505 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:10 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3728737224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:11.264 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:05:11 smithi130 systemd[1]: Starting Ceph mds.b for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:05:11.620 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:05:11 smithi130 podman[51543]: 2024-08-18 22:05:11.262051865 +0000 UTC m=+0.017532121 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:05:11.620 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:05:11 smithi130 podman[51543]: 2024-08-18 22:05:11.375816245 +0000 UTC m=+0.131296495 container create f6df05a461af3e96e7ecff33104ed9ed979516f7f572b49aecd9c6c345ace9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=squid-de09dd0) 2024-08-18T22:05:12.014 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:05:11 smithi130 podman[51543]: 2024-08-18 22:05:11.620170896 +0000 UTC m=+0.375651142 container init f6df05a461af3e96e7ecff33104ed9ed979516f7f572b49aecd9c6c345ace9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-08-18T22:05:12.014 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:05:11 smithi130 podman[51543]: 2024-08-18 22:05:11.623134006 +0000 UTC m=+0.378614257 container start f6df05a461af3e96e7ecff33104ed9ed979516f7f572b49aecd9c6c345ace9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:05:12.014 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:05:11 smithi130 ceph-mds[51563]: -- 172.21.15.130:0/2631532945 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55be6cbbb860 con 0x55be6cb98800 2024-08-18T22:05:12.014 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:05:11 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: starting mds.b at 2024-08-18T22:05:12.015 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:05:11 smithi130 bash[51543]: f6df05a461af3e96e7ecff33104ed9ed979516f7f572b49aecd9c6c345ace9a5 2024-08-18T22:05:12.015 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:05:11 smithi130 systemd[1]: Started Ceph mds.b for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T22:05:12.534 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:05:12.648 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:12 smithi123 ceph-mon[18462]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:12.648 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:12 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:12.648 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:12 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:12.648 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:12 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:12.648 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:12 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:12.648 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:12 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:12.648 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:12 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:05:12.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:12 smithi183 ceph-mon[22097]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:12.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:12 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:12.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:12 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:12.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:12 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:12.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:12 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:12.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:12 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:12.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:12 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:05:12.689 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:12 smithi130 ceph-mon[21698]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:12.689 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:12 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:12.690 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:12 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:12.690 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:12 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:12.690 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:12 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:12.690 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:12 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:12.690 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:12 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:05:13.025 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:13.429 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:13 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] up:boot 2024-08-18T22:05:13.429 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:13 smithi123 ceph-mon[18462]: fsmap 12 up:standby 2024-08-18T22:05:13.429 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:13 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-18T22:05:13.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.509+0000 7facf9dc7640 1 -- 172.21.15.123:0/3936080204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facf4100b50 msgr2=0x7facf4100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:13.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.509+0000 7facf9dc7640 1 --2- 172.21.15.123:0/3936080204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facf4100b50 0x7facf4100f30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7face4009900 tx=0x7face402a480 comp rx=0 tx=0).stop 2024-08-18T22:05:13.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.509+0000 7facf9dc7640 1 -- 172.21.15.123:0/3936080204 shutdown_connections 2024-08-18T22:05:13.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.509+0000 7facf9dc7640 1 --2- 172.21.15.123:0/3936080204 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facf4102c20 0x7facf410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:13.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.509+0000 7facf9dc7640 1 --2- 172.21.15.123:0/3936080204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facf41022a0 0x7facf41026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:13.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.509+0000 7facf9dc7640 1 --2- 172.21.15.123:0/3936080204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facf4100b50 0x7facf4100f30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:13.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.509+0000 7facf9dc7640 1 -- 172.21.15.123:0/3936080204 >> 172.21.15.123:0/3936080204 conn(0x7facf40fc500 msgr2=0x7facf40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:13.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.509+0000 7facf9dc7640 1 -- 172.21.15.123:0/3936080204 shutdown_connections 2024-08-18T22:05:13.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.509+0000 7facf9dc7640 1 -- 172.21.15.123:0/3936080204 wait complete. 2024-08-18T22:05:13.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.510+0000 7facf9dc7640 1 Processor -- start 2024-08-18T22:05:13.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.510+0000 7facf9dc7640 1 -- start start 2024-08-18T22:05:13.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.510+0000 7facf9dc7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facf4100b50 0x7facf41970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:13.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.510+0000 7facf9dc7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facf41022a0 0x7facf4197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:13.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.510+0000 7facf9dc7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facf4102c20 0x7facf419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:13.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.510+0000 7facf9dc7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7facf4110cb0 con 0x7facf4102c20 2024-08-18T22:05:13.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.510+0000 7facf9dc7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7facf4110b30 con 0x7facf41022a0 2024-08-18T22:05:13.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.510+0000 7facf9dc7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7facf4110e30 con 0x7facf4100b50 2024-08-18T22:05:13.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.510+0000 7facf3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facf4102c20 0x7facf419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:13.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.510+0000 7facf3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facf4102c20 0x7facf419b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60448/0 (socket says 172.21.15.123:60448) 2024-08-18T22:05:13.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.510+0000 7facf37fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facf4100b50 0x7facf41970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:13.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.510+0000 7facf3fff640 1 -- 172.21.15.123:0/992343932 learned_addr learned my addr 172.21.15.123:0/992343932 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:13.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.510+0000 7facf2ffd640 1 --2- 172.21.15.123:0/992343932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facf41022a0 0x7facf4197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:13.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.511+0000 7facf2ffd640 1 -- 172.21.15.123:0/992343932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facf4100b50 msgr2=0x7facf41970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:13.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.511+0000 7facf2ffd640 1 --2- 172.21.15.123:0/992343932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facf4100b50 0x7facf41970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:13.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.511+0000 7facf2ffd640 1 -- 172.21.15.123:0/992343932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facf4102c20 msgr2=0x7facf419b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:13.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.511+0000 7facf2ffd640 1 --2- 172.21.15.123:0/992343932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facf4102c20 0x7facf419b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:13.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.511+0000 7facf2ffd640 1 -- 172.21.15.123:0/992343932 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf419c0a0 con 0x7facf41022a0 2024-08-18T22:05:13.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.511+0000 7facf3fff640 1 --2- 172.21.15.123:0/992343932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facf4102c20 0x7facf419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:05:13.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.511+0000 7facf37fe640 1 --2- 172.21.15.123:0/992343932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facf4100b50 0x7facf41970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:05:13.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.511+0000 7facf2ffd640 1 --2- 172.21.15.123:0/992343932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facf41022a0 0x7facf4197630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7face800e9f0 tx=0x7face800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:13.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.511+0000 7facf0ff9640 1 -- 172.21.15.123:0/992343932 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face800ccc0 con 0x7facf41022a0 2024-08-18T22:05:13.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.511+0000 7facf0ff9640 1 -- 172.21.15.123:0/992343932 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7face8010910 con 0x7facf41022a0 2024-08-18T22:05:13.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.511+0000 7facf9dc7640 1 -- 172.21.15.123:0/992343932 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf419c390 con 0x7facf41022a0 2024-08-18T22:05:13.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.511+0000 7facf0ff9640 1 -- 172.21.15.123:0/992343932 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8018960 con 0x7facf41022a0 2024-08-18T22:05:13.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.511+0000 7facf9dc7640 1 -- 172.21.15.123:0/992343932 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facf41a3c70 con 0x7facf41022a0 2024-08-18T22:05:13.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.512+0000 7facf9dc7640 1 -- 172.21.15.123:0/992343932 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facf4100f30 con 0x7facf41022a0 2024-08-18T22:05:13.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.513+0000 7facf0ff9640 1 -- 172.21.15.123:0/992343932 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7face8010ac0 con 0x7facf41022a0 2024-08-18T22:05:13.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.514+0000 7facf0ff9640 1 --2- 172.21.15.123:0/992343932 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7facdc0a2b80 0x7facdc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:13.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.514+0000 7facf37fe640 1 --2- 172.21.15.123:0/992343932 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7facdc0a2b80 0x7facdc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:13.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.514+0000 7facf0ff9640 1 -- 172.21.15.123:0/992343932 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7face80cf350 con 0x7facf41022a0 2024-08-18T22:05:13.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.514+0000 7facf37fe640 1 --2- 172.21.15.123:0/992343932 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7facdc0a2b80 0x7facdc0a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7face4009230 tx=0x7face40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:13.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.517+0000 7facf0ff9640 1 -- 172.21.15.123:0/992343932 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7face809c060 con 0x7facf41022a0 2024-08-18T22:05:13.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:13 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] up:boot 2024-08-18T22:05:13.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:13 smithi183 ceph-mon[22097]: fsmap 12 up:standby 2024-08-18T22:05:13.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:13 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-18T22:05:13.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.739+0000 7facf9dc7640 1 -- 172.21.15.123:0/992343932 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facf4108dc0 con 0x7facf41022a0 2024-08-18T22:05:13.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.740+0000 7facf0ff9640 1 -- 172.21.15.123:0/992343932 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10527 (secure 0 0 0) 0x7face80a0360 con 0x7facf41022a0 2024-08-18T22:05:13.741 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:05:13.741 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":13,"btime":"2024-08-18T22:05:12:383613+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-18T22:05:13.742 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 13 2024-08-18T22:05:13.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.743+0000 7facf9dc7640 1 -- 172.21.15.123:0/992343932 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7facdc0a2b80 msgr2=0x7facdc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:13.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.743+0000 7facf9dc7640 1 --2- 172.21.15.123:0/992343932 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7facdc0a2b80 0x7facdc0a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7face4009230 tx=0x7face40058d0 comp rx=0 tx=0).stop 2024-08-18T22:05:13.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.743+0000 7facf9dc7640 1 -- 172.21.15.123:0/992343932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facf41022a0 msgr2=0x7facf4197630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:13.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.743+0000 7facf9dc7640 1 --2- 172.21.15.123:0/992343932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facf41022a0 0x7facf4197630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7face800e9f0 tx=0x7face800eeb0 comp rx=0 tx=0).stop 2024-08-18T22:05:13.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.743+0000 7facf9dc7640 1 -- 172.21.15.123:0/992343932 shutdown_connections 2024-08-18T22:05:13.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.743+0000 7facf9dc7640 1 --2- 172.21.15.123:0/992343932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facf4102c20 0x7facf419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:13.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.743+0000 7facf9dc7640 1 --2- 172.21.15.123:0/992343932 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7facdc0a2b80 0x7facdc0a5040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:13.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.743+0000 7facf9dc7640 1 --2- 172.21.15.123:0/992343932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facf41022a0 0x7facf4197630 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:13.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.743+0000 7facf9dc7640 1 --2- 172.21.15.123:0/992343932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facf4100b50 0x7facf41970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:13.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.743+0000 7facf9dc7640 1 -- 172.21.15.123:0/992343932 >> 172.21.15.123:0/992343932 conn(0x7facf40fc500 msgr2=0x7facf40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:13.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.743+0000 7facf9dc7640 1 -- 172.21.15.123:0/992343932 shutdown_connections 2024-08-18T22:05:13.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:13.743+0000 7facf9dc7640 1 -- 172.21.15.123:0/992343932 wait complete. 2024-08-18T22:05:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:13 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] up:boot 2024-08-18T22:05:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:13 smithi130 ceph-mon[21698]: fsmap 12 up:standby 2024-08-18T22:05:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:13 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-18T22:05:14.540 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-08-18T22:05:14.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:14 smithi183 ceph-mon[22097]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:14.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:14 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:14.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:14 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:14.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:14 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:14.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:14 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:14.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:14 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/992343932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:14.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:14 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:14.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:14 smithi123 ceph-mon[18462]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:14.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:14 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:14.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:14 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:14.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:14 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:14.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:14 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:14.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:14 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/992343932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:14.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:14 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:14 smithi130 ceph-mon[21698]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:14 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:14 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:14 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:14 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:14 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/992343932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:14 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:14.808 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.290+0000 7fb568bd0640 1 -- 172.21.15.123:0/224927307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb564102c20 msgr2=0x7fb56410d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.290+0000 7fb568bd0640 1 --2- 172.21.15.123:0/224927307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb564102c20 0x7fb56410d770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009ca0 tx=0x7fb55c02a950 comp rx=0 tx=0).stop 2024-08-18T22:05:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.290+0000 7fb568bd0640 1 -- 172.21.15.123:0/224927307 shutdown_connections 2024-08-18T22:05:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.290+0000 7fb568bd0640 1 --2- 172.21.15.123:0/224927307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb564102c20 0x7fb56410d770 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.290+0000 7fb568bd0640 1 --2- 172.21.15.123:0/224927307 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5641022a0 0x7fb5641026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.290+0000 7fb568bd0640 1 --2- 172.21.15.123:0/224927307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb564100b50 0x7fb564100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.290+0000 7fb568bd0640 1 -- 172.21.15.123:0/224927307 >> 172.21.15.123:0/224927307 conn(0x7fb5640fc500 msgr2=0x7fb5640fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.290+0000 7fb568bd0640 1 -- 172.21.15.123:0/224927307 shutdown_connections 2024-08-18T22:05:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.290+0000 7fb568bd0640 1 -- 172.21.15.123:0/224927307 wait complete. 2024-08-18T22:05:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.290+0000 7fb568bd0640 1 Processor -- start 2024-08-18T22:05:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.290+0000 7fb568bd0640 1 -- start start 2024-08-18T22:05:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb568bd0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb564100b50 0x7fb5641990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb568bd0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5641022a0 0x7fb5641995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb568bd0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb564102c20 0x7fb5641a4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb568bd0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb564110cb0 con 0x7fb564102c20 2024-08-18T22:05:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb568bd0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb564110b30 con 0x7fb5641022a0 2024-08-18T22:05:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb568bd0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb564110e30 con 0x7fb564100b50 2024-08-18T22:05:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb562d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb564102c20 0x7fb5641a4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb562d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb564102c20 0x7fb5641a4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60472/0 (socket says 172.21.15.123:60472) 2024-08-18T22:05:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb562d9d640 1 -- 172.21.15.123:0/1642793876 learned_addr learned my addr 172.21.15.123:0/1642793876 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb561d9b640 1 --2- 172.21.15.123:0/1642793876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5641022a0 0x7fb5641995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb56259c640 1 --2- 172.21.15.123:0/1642793876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb564100b50 0x7fb5641990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb562d9d640 1 -- 172.21.15.123:0/1642793876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb564100b50 msgr2=0x7fb5641990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb562d9d640 1 --2- 172.21.15.123:0/1642793876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb564100b50 0x7fb5641990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb562d9d640 1 -- 172.21.15.123:0/1642793876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5641022a0 msgr2=0x7fb5641995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb562d9d640 1 --2- 172.21.15.123:0/1642793876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5641022a0 0x7fb5641995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb562d9d640 1 -- 172.21.15.123:0/1642793876 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5641a4660 con 0x7fb564102c20 2024-08-18T22:05:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb562d9d640 1 --2- 172.21.15.123:0/1642793876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb564102c20 0x7fb5641a4120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb55c004af0 tx=0x7fb55c02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb5537fe640 1 -- 172.21.15.123:0/1642793876 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c034040 con 0x7fb564102c20 2024-08-18T22:05:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb568bd0640 1 -- 172.21.15.123:0/1642793876 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5641a4830 con 0x7fb564102c20 2024-08-18T22:05:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.291+0000 7fb5537fe640 1 -- 172.21.15.123:0/1642793876 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb55c030920 con 0x7fb564102c20 2024-08-18T22:05:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.292+0000 7fb5537fe640 1 -- 172.21.15.123:0/1642793876 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c004820 con 0x7fb564102c20 2024-08-18T22:05:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.292+0000 7fb568bd0640 1 -- 172.21.15.123:0/1642793876 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5641a4c90 con 0x7fb564102c20 2024-08-18T22:05:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.293+0000 7fb568bd0640 1 -- 172.21.15.123:0/1642793876 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb564100f30 con 0x7fb564102c20 2024-08-18T22:05:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.294+0000 7fb5537fe640 1 -- 172.21.15.123:0/1642793876 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fb55c037020 con 0x7fb564102c20 2024-08-18T22:05:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.295+0000 7fb5537fe640 1 --2- 172.21.15.123:0/1642793876 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb54c0a2b80 0x7fb54c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.295+0000 7fb56259c640 1 --2- 172.21.15.123:0/1642793876 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb54c0a2b80 0x7fb54c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.295+0000 7fb5537fe640 1 -- 172.21.15.123:0/1642793876 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fb55c0efa70 con 0x7fb564102c20 2024-08-18T22:05:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.295+0000 7fb56259c640 1 --2- 172.21.15.123:0/1642793876 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb54c0a2b80 0x7fb54c0a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb554009b60 tx=0x7fb554005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.299+0000 7fb5537fe640 1 -- 172.21.15.123:0/1642793876 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb55c0bce70 con 0x7fb564102c20 2024-08-18T22:05:15.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.476+0000 7fb568bd0640 1 -- 172.21.15.123:0/1642793876 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb5641a4ec0 con 0x7fb564102c20 2024-08-18T22:05:15.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.476+0000 7fb5537fe640 1 -- 172.21.15.123:0/1642793876 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7fb55c0bc770 con 0x7fb564102c20 2024-08-18T22:05:15.477 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:05:15.478 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-08-18T22:05:15.478 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:05:15.478 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-08-18T22:05:15.478 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-08-18T22:05:15.478 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:05:15.478 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-08-18T22:05:15.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.479+0000 7fb568bd0640 1 -- 172.21.15.123:0/1642793876 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb54c0a2b80 msgr2=0x7fb54c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:15.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.479+0000 7fb568bd0640 1 --2- 172.21.15.123:0/1642793876 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb54c0a2b80 0x7fb54c0a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb554009b60 tx=0x7fb554005f90 comp rx=0 tx=0).stop 2024-08-18T22:05:15.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.479+0000 7fb568bd0640 1 -- 172.21.15.123:0/1642793876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb564102c20 msgr2=0x7fb5641a4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:15.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.479+0000 7fb568bd0640 1 --2- 172.21.15.123:0/1642793876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb564102c20 0x7fb5641a4120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb55c004af0 tx=0x7fb55c02f5b0 comp rx=0 tx=0).stop 2024-08-18T22:05:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.479+0000 7fb568bd0640 1 -- 172.21.15.123:0/1642793876 shutdown_connections 2024-08-18T22:05:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.479+0000 7fb568bd0640 1 --2- 172.21.15.123:0/1642793876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb564102c20 0x7fb5641a4120 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.479+0000 7fb568bd0640 1 --2- 172.21.15.123:0/1642793876 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb54c0a2b80 0x7fb54c0a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.479+0000 7fb568bd0640 1 --2- 172.21.15.123:0/1642793876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5641022a0 0x7fb5641995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.479+0000 7fb568bd0640 1 --2- 172.21.15.123:0/1642793876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb564100b50 0x7fb5641990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.479+0000 7fb568bd0640 1 -- 172.21.15.123:0/1642793876 >> 172.21.15.123:0/1642793876 conn(0x7fb5640fc500 msgr2=0x7fb5641065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.479+0000 7fb568bd0640 1 -- 172.21.15.123:0/1642793876 shutdown_connections 2024-08-18T22:05:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:15.479+0000 7fb568bd0640 1 -- 172.21.15.123:0/1642793876 wait complete. 2024-08-18T22:05:15.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:15 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:15.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:15 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:15.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:15 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:15.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:15 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:05:15.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:15 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:15.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:15 smithi123 ceph-mon[18462]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:15.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:15 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:05:15.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:15 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1642793876' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-08-18T22:05:15.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:15 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:15.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:15 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:15.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:15 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:15.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:15 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:05:15.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:15 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:15.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:15 smithi183 ceph-mon[22097]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:15.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:15 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:05:15.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:15 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1642793876' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-08-18T22:05:15.969 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:15 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:15.969 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:15 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:15.969 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:15 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:15.969 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:15 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:05:15.969 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:15 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:15.969 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:15 smithi130 ceph-mon[21698]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:15.969 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:15 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:05:15.969 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:15 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1642793876' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-08-18T22:05:16.226 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T22:05:16.226 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T22:05:17.142 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:17.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.618+0000 7f28b5ccb640 1 -- 172.21.15.123:0/2156728778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b0102ad0 msgr2=0x7f28b0102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.618+0000 7f28b5ccb640 1 --2- 172.21.15.123:0/2156728778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b0102ad0 0x7f28b0102eb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009900 tx=0x7f28a002a480 comp rx=0 tx=0).stop 2024-08-18T22:05:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.618+0000 7f28b5ccb640 1 -- 172.21.15.123:0/2156728778 shutdown_connections 2024-08-18T22:05:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.618+0000 7f28b5ccb640 1 --2- 172.21.15.123:0/2156728778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28b010beb0 0x7f28b010e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.618+0000 7f28b5ccb640 1 --2- 172.21.15.123:0/2156728778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28b01033f0 0x7f28b010b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.618+0000 7f28b5ccb640 1 --2- 172.21.15.123:0/2156728778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b0102ad0 0x7f28b0102eb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.618+0000 7f28b5ccb640 1 -- 172.21.15.123:0/2156728778 >> 172.21.15.123:0/2156728778 conn(0x7f28b00fc4d0 msgr2=0x7f28b00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.618+0000 7f28b5ccb640 1 -- 172.21.15.123:0/2156728778 shutdown_connections 2024-08-18T22:05:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.618+0000 7f28b5ccb640 1 -- 172.21.15.123:0/2156728778 wait complete. 2024-08-18T22:05:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.618+0000 7f28b5ccb640 1 Processor -- start 2024-08-18T22:05:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28b5ccb640 1 -- start start 2024-08-18T22:05:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28b5ccb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b0102ad0 0x7f28b019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28b5ccb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28b01033f0 0x7f28b019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28b5ccb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28b010beb0 0x7f28b019ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28b5ccb640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f28b0111cd0 con 0x7f28b0102ad0 2024-08-18T22:05:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28b5ccb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f28b0111b50 con 0x7f28b01033f0 2024-08-18T22:05:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28b5ccb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f28b0111e50 con 0x7f28b010beb0 2024-08-18T22:05:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28af7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b0102ad0 0x7f28b019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28af7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b0102ad0 0x7f28b019a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60482/0 (socket says 172.21.15.123:60482) 2024-08-18T22:05:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28af7fe640 1 -- 172.21.15.123:0/1930057451 learned_addr learned my addr 172.21.15.123:0/1930057451 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28aeffd640 1 --2- 172.21.15.123:0/1930057451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28b01033f0 0x7f28b019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28af7fe640 1 -- 172.21.15.123:0/1930057451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28b010beb0 msgr2=0x7f28b019ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28af7fe640 1 --2- 172.21.15.123:0/1930057451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28b010beb0 0x7f28b019ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28af7fe640 1 -- 172.21.15.123:0/1930057451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28b01033f0 msgr2=0x7f28b019a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28af7fe640 1 --2- 172.21.15.123:0/1930057451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28b01033f0 0x7f28b019a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28af7fe640 1 -- 172.21.15.123:0/1930057451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b019f350 con 0x7f28b0102ad0 2024-08-18T22:05:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.619+0000 7f28af7fe640 1 --2- 172.21.15.123:0/1930057451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b0102ad0 0x7f28b019a3a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f28a0005ab0 tx=0x7f28a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.620+0000 7f28acff9640 1 -- 172.21.15.123:0/1930057451 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a003f030 con 0x7f28b0102ad0 2024-08-18T22:05:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.620+0000 7f28acff9640 1 -- 172.21.15.123:0/1930057451 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28a0003ce0 con 0x7f28b0102ad0 2024-08-18T22:05:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.620+0000 7f28acff9640 1 -- 172.21.15.123:0/1930057451 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a0035070 con 0x7f28b0102ad0 2024-08-18T22:05:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.620+0000 7f28b5ccb640 1 -- 172.21.15.123:0/1930057451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b019f5e0 con 0x7f28b0102ad0 2024-08-18T22:05:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.620+0000 7f28b5ccb640 1 -- 172.21.15.123:0/1930057451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b01a6f20 con 0x7f28b0102ad0 2024-08-18T22:05:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.621+0000 7f28b5ccb640 1 -- 172.21.15.123:0/1930057451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b006ad40 con 0x7f28b0102ad0 2024-08-18T22:05:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.622+0000 7f28acff9640 1 -- 172.21.15.123:0/1930057451 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f28a0042030 con 0x7f28b0102ad0 2024-08-18T22:05:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.622+0000 7f28acff9640 1 --2- 172.21.15.123:0/1930057451 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f28980a2b80 0x7f28980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.622+0000 7f28aeffd640 1 --2- 172.21.15.123:0/1930057451 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f28980a2b80 0x7f28980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.623+0000 7f28acff9640 1 -- 172.21.15.123:0/1930057451 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f28a00ef540 con 0x7f28b0102ad0 2024-08-18T22:05:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.623+0000 7f28aeffd640 1 --2- 172.21.15.123:0/1930057451 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f28980a2b80 0x7f28980a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f28b00fe910 tx=0x7f28a4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:17.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.626+0000 7f28acff9640 1 -- 172.21.15.123:0/1930057451 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f28a00bc940 con 0x7f28b0102ad0 2024-08-18T22:05:17.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:17.831+0000 7f28b5ccb640 1 -- 172.21.15.123:0/1930057451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f28b01a70f0 con 0x7f28b0102ad0 2024-08-18T22:05:18.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:17 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:18.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:17 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:18.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:17 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:18.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:17 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:18.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:17 smithi130 ceph-mon[21698]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:18.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:17 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:18.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:17 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:18.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:17 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:18.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:17 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:18.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:17 smithi183 ceph-mon[22097]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:18.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:17 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:18.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:17 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:18.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:17 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:18.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:17 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:18.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:17 smithi123 ceph-mon[18462]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:18.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:18.826+0000 7f28acff9640 1 -- 172.21.15.123:0/1930057451 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7f28a00bc240 con 0x7f28b0102ad0 2024-08-18T22:05:18.827 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-08-18T22:05:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:18.829+0000 7f28b5ccb640 1 -- 172.21.15.123:0/1930057451 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f28980a2b80 msgr2=0x7f28980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:18.829+0000 7f28b5ccb640 1 --2- 172.21.15.123:0/1930057451 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f28980a2b80 0x7f28980a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f28b00fe910 tx=0x7f28a4008040 comp rx=0 tx=0).stop 2024-08-18T22:05:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:18.829+0000 7f28b5ccb640 1 -- 172.21.15.123:0/1930057451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b0102ad0 msgr2=0x7f28b019a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:18.829+0000 7f28b5ccb640 1 --2- 172.21.15.123:0/1930057451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b0102ad0 0x7f28b019a3a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f28a0005ab0 tx=0x7f28a00042f0 comp rx=0 tx=0).stop 2024-08-18T22:05:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:18.830+0000 7f28b5ccb640 1 -- 172.21.15.123:0/1930057451 shutdown_connections 2024-08-18T22:05:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:18.830+0000 7f28b5ccb640 1 --2- 172.21.15.123:0/1930057451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28b010beb0 0x7f28b019ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:18.830+0000 7f28b5ccb640 1 --2- 172.21.15.123:0/1930057451 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f28980a2b80 0x7f28980a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:18.830+0000 7f28b5ccb640 1 --2- 172.21.15.123:0/1930057451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28b01033f0 0x7f28b019a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:18.830+0000 7f28b5ccb640 1 --2- 172.21.15.123:0/1930057451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b0102ad0 0x7f28b019a3a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:18.830+0000 7f28b5ccb640 1 -- 172.21.15.123:0/1930057451 >> 172.21.15.123:0/1930057451 conn(0x7f28b00fc4d0 msgr2=0x7f28b0100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:18.830+0000 7f28b5ccb640 1 -- 172.21.15.123:0/1930057451 shutdown_connections 2024-08-18T22:05:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:18.830+0000 7f28b5ccb640 1 -- 172.21.15.123:0/1930057451 wait complete. 2024-08-18T22:05:19.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:18 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1930057451' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-08-18T22:05:19.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:18 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:19.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:18 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:19.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:18 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:19.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:18 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:05:19.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:18 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:19.199 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:18 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1930057451' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-08-18T22:05:19.199 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:18 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:19.199 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:18 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:19.199 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:18 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:19.199 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:18 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:05:19.199 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:18 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:19.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:18 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1930057451' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-08-18T22:05:19.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:18 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:19.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:18 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:19.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:18 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:05:19.248 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:18 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:05:19.248 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:18 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:05:19.616 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-08-18T22:05:19.875 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:19.996 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:19 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1930057451' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-18T22:05:19.996 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:19 smithi123 ceph-mon[18462]: osdmap e78: 12 total, 12 up, 12 in 2024-08-18T22:05:19.997 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:19 smithi123 ceph-mon[18462]: pgmap v253: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:20.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:19 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1930057451' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-18T22:05:20.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:19 smithi183 ceph-mon[22097]: osdmap e78: 12 total, 12 up, 12 in 2024-08-18T22:05:20.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:19 smithi183 ceph-mon[22097]: pgmap v253: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:20.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:19 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1930057451' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-18T22:05:20.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:19 smithi130 ceph-mon[21698]: osdmap e78: 12 total, 12 up, 12 in 2024-08-18T22:05:20.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:19 smithi130 ceph-mon[21698]: pgmap v253: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:20.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.398+0000 7f6626af1640 1 -- 172.21.15.123:0/1439410079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66201018b0 msgr2=0x7f6620101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:20.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.398+0000 7f6626af1640 1 --2- 172.21.15.123:0/1439410079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66201018b0 0x7f6620101d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6614009930 tx=0x7f661402a420 comp rx=0 tx=0).stop 2024-08-18T22:05:20.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.398+0000 7f6626af1640 1 -- 172.21.15.123:0/1439410079 shutdown_connections 2024-08-18T22:05:20.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.398+0000 7f6626af1640 1 --2- 172.21.15.123:0/1439410079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6620102250 0x7f662010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:20.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.398+0000 7f6626af1640 1 --2- 172.21.15.123:0/1439410079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66201018b0 0x7f6620101d10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:20.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.398+0000 7f6626af1640 1 --2- 172.21.15.123:0/1439410079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66201078b0 0x7f6620107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:20.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.398+0000 7f6626af1640 1 -- 172.21.15.123:0/1439410079 >> 172.21.15.123:0/1439410079 conn(0x7f66200fd5f0 msgr2=0x7f66200ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:20.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.398+0000 7f6626af1640 1 -- 172.21.15.123:0/1439410079 shutdown_connections 2024-08-18T22:05:20.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.398+0000 7f6626af1640 1 -- 172.21.15.123:0/1439410079 wait complete. 2024-08-18T22:05:20.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.399+0000 7f6626af1640 1 Processor -- start 2024-08-18T22:05:20.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.399+0000 7f6626af1640 1 -- start start 2024-08-18T22:05:20.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.399+0000 7f6626af1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66201018b0 0x7f6620198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:20.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.399+0000 7f6626af1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6620102250 0x7f6620198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:20.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.399+0000 7f6626af1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66201078b0 0x7f662019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:20.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.399+0000 7f6626af1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6620111cb0 con 0x7f66201018b0 2024-08-18T22:05:20.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.399+0000 7f6626af1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6620111b30 con 0x7f66201078b0 2024-08-18T22:05:20.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.399+0000 7f6626af1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6620111e30 con 0x7f6620102250 2024-08-18T22:05:20.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.399+0000 7f662488d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66201018b0 0x7f6620198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.399+0000 7f662488d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66201018b0 0x7f6620198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60506/0 (socket says 172.21.15.123:60506) 2024-08-18T22:05:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.399+0000 7f662488d640 1 -- 172.21.15.123:0/3235388299 learned_addr learned my addr 172.21.15.123:0/3235388299 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.399+0000 7f661ffff640 1 --2- 172.21.15.123:0/3235388299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6620102250 0x7f6620198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.399+0000 7f662508e640 1 --2- 172.21.15.123:0/3235388299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66201078b0 0x7f662019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.399+0000 7f662488d640 1 -- 172.21.15.123:0/3235388299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6620102250 msgr2=0x7f6620198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.399+0000 7f662488d640 1 --2- 172.21.15.123:0/3235388299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6620102250 0x7f6620198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.400+0000 7f662488d640 1 -- 172.21.15.123:0/3235388299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66201078b0 msgr2=0x7f662019cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.400+0000 7f662488d640 1 --2- 172.21.15.123:0/3235388299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66201078b0 0x7f662019cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.400+0000 7f662488d640 1 -- 172.21.15.123:0/3235388299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662019d1c0 con 0x7f66201018b0 2024-08-18T22:05:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.400+0000 7f662488d640 1 --2- 172.21.15.123:0/3235388299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66201018b0 0x7f6620198210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f661000d950 tx=0x7f661000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.400+0000 7f661dffb640 1 -- 172.21.15.123:0/3235388299 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610017070 con 0x7f66201018b0 2024-08-18T22:05:20.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.400+0000 7f661dffb640 1 -- 172.21.15.123:0/3235388299 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6610009c30 con 0x7f66201018b0 2024-08-18T22:05:20.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.400+0000 7f661dffb640 1 -- 172.21.15.123:0/3235388299 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661000f6b0 con 0x7f66201018b0 2024-08-18T22:05:20.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.400+0000 7f6626af1640 1 -- 172.21.15.123:0/3235388299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f662019d4b0 con 0x7f66201018b0 2024-08-18T22:05:20.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.400+0000 7f6626af1640 1 -- 172.21.15.123:0/3235388299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66201a4d90 con 0x7f66201018b0 2024-08-18T22:05:20.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.401+0000 7f6626af1640 1 -- 172.21.15.123:0/3235388299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6620101d10 con 0x7f66201018b0 2024-08-18T22:05:20.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.402+0000 7f661dffb640 1 -- 172.21.15.123:0/3235388299 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f66100109d0 con 0x7f66201018b0 2024-08-18T22:05:20.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.403+0000 7f661dffb640 1 --2- 172.21.15.123:0/3235388299 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66080a2c00 0x7f66080a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:20.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.403+0000 7f661ffff640 1 --2- 172.21.15.123:0/3235388299 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66080a2c00 0x7f66080a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:20.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.403+0000 7f661dffb640 1 -- 172.21.15.123:0/3235388299 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7497+0+0 (secure 0 0 0) 0x7f66100ce7b0 con 0x7f66201018b0 2024-08-18T22:05:20.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.403+0000 7f661ffff640 1 --2- 172.21.15.123:0/3235388299 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66080a2c00 0x7f66080a50c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6614009900 tx=0x7f66140058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:20.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.407+0000 7f661dffb640 1 -- 172.21.15.123:0/3235388299 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6610009de0 con 0x7f66201018b0 2024-08-18T22:05:20.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.572+0000 7f6626af1640 1 -- 172.21.15.123:0/3235388299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f6620109e50 con 0x7f66201018b0 2024-08-18T22:05:20.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.833+0000 7f661dffb640 1 -- 172.21.15.123:0/3235388299 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v80) ==== 171+0+0 (secure 0 0 0) 0x7f661009b3f0 con 0x7f66201018b0 2024-08-18T22:05:20.835 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-08-18T22:05:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.836+0000 7f6626af1640 1 -- 172.21.15.123:0/3235388299 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66080a2c00 msgr2=0x7f66080a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.836+0000 7f6626af1640 1 --2- 172.21.15.123:0/3235388299 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66080a2c00 0x7f66080a50c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6614009900 tx=0x7f66140058d0 comp rx=0 tx=0).stop 2024-08-18T22:05:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.836+0000 7f6626af1640 1 -- 172.21.15.123:0/3235388299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66201018b0 msgr2=0x7f6620198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.836+0000 7f6626af1640 1 --2- 172.21.15.123:0/3235388299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66201018b0 0x7f6620198210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f661000d950 tx=0x7f661000de10 comp rx=0 tx=0).stop 2024-08-18T22:05:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.836+0000 7f6626af1640 1 -- 172.21.15.123:0/3235388299 shutdown_connections 2024-08-18T22:05:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.836+0000 7f6626af1640 1 --2- 172.21.15.123:0/3235388299 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66080a2c00 0x7f66080a50c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.836+0000 7f6626af1640 1 --2- 172.21.15.123:0/3235388299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66201078b0 0x7f662019cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.836+0000 7f6626af1640 1 --2- 172.21.15.123:0/3235388299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6620102250 0x7f6620198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.836+0000 7f6626af1640 1 --2- 172.21.15.123:0/3235388299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66201018b0 0x7f6620198210 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.836+0000 7f6626af1640 1 -- 172.21.15.123:0/3235388299 >> 172.21.15.123:0/3235388299 conn(0x7f66200fd5f0 msgr2=0x7f66200fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.836+0000 7f6626af1640 1 -- 172.21.15.123:0/3235388299 shutdown_connections 2024-08-18T22:05:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:20.836+0000 7f6626af1640 1 -- 172.21.15.123:0/3235388299 wait complete. 2024-08-18T22:05:21.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:20 smithi183 ceph-mon[22097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-18T22:05:21.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:20 smithi183 ceph-mon[22097]: osdmap e79: 12 total, 12 up, 12 in 2024-08-18T22:05:21.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:20 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3235388299' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-08-18T22:05:21.200 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:20 smithi123 ceph-mon[18462]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-18T22:05:21.200 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:20 smithi123 ceph-mon[18462]: osdmap e79: 12 total, 12 up, 12 in 2024-08-18T22:05:21.200 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:20 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3235388299' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-08-18T22:05:21.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:20 smithi130 ceph-mon[21698]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-18T22:05:21.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:20 smithi130 ceph-mon[21698]: osdmap e79: 12 total, 12 up, 12 in 2024-08-18T22:05:21.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:20 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3235388299' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-08-18T22:05:21.613 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T22:05:21.854 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:21 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3235388299' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-18T22:05:21.877 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:22.144 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:21 smithi123 ceph-mon[18462]: osdmap e80: 12 total, 12 up, 12 in 2024-08-18T22:05:22.144 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:21 smithi123 ceph-mon[18462]: pgmap v256: 97 pgs: 11 active+clean, 14 creating+peering, 72 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:22.144 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:21 smithi123 ceph-mon[18462]: osdmap e81: 12 total, 12 up, 12 in 2024-08-18T22:05:22.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:21 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3235388299' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-18T22:05:22.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:21 smithi183 ceph-mon[22097]: osdmap e80: 12 total, 12 up, 12 in 2024-08-18T22:05:22.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:21 smithi183 ceph-mon[22097]: pgmap v256: 97 pgs: 11 active+clean, 14 creating+peering, 72 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:22.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:21 smithi183 ceph-mon[22097]: osdmap e81: 12 total, 12 up, 12 in 2024-08-18T22:05:22.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:21 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3235388299' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-18T22:05:22.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:21 smithi130 ceph-mon[21698]: osdmap e80: 12 total, 12 up, 12 in 2024-08-18T22:05:22.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:21 smithi130 ceph-mon[21698]: pgmap v256: 97 pgs: 11 active+clean, 14 creating+peering, 72 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:22.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:21 smithi130 ceph-mon[21698]: osdmap e81: 12 total, 12 up, 12 in 2024-08-18T22:05:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.386+0000 7f6a79116640 1 -- 172.21.15.123:0/3673040476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a74101910 msgr2=0x7f6a7410d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.386+0000 7f6a79116640 1 --2- 172.21.15.123:0/3673040476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a74101910 0x7f6a7410d640 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009ca0 tx=0x7f6a6c02a8c0 comp rx=0 tx=0).stop 2024-08-18T22:05:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.386+0000 7f6a79116640 1 -- 172.21.15.123:0/3673040476 shutdown_connections 2024-08-18T22:05:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.386+0000 7f6a79116640 1 --2- 172.21.15.123:0/3673040476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a74101910 0x7f6a7410d640 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.386+0000 7f6a79116640 1 --2- 172.21.15.123:0/3673040476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a74100f70 0x7f6a741013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.386+0000 7f6a79116640 1 --2- 172.21.15.123:0/3673040476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a741057a0 0x7f6a74105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.386+0000 7f6a79116640 1 -- 172.21.15.123:0/3673040476 >> 172.21.15.123:0/3673040476 conn(0x7f6a74076f40 msgr2=0x7f6a740fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.386+0000 7f6a79116640 1 -- 172.21.15.123:0/3673040476 shutdown_connections 2024-08-18T22:05:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.386+0000 7f6a79116640 1 -- 172.21.15.123:0/3673040476 wait complete. 2024-08-18T22:05:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a79116640 1 Processor -- start 2024-08-18T22:05:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a79116640 1 -- start start 2024-08-18T22:05:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a79116640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a74100f70 0x7f6a7419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a79116640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a74101910 0x7f6a7419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a79116640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a741057a0 0x7f6a7419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a79116640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6a74110c60 con 0x7f6a741057a0 2024-08-18T22:05:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a79116640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6a74110ae0 con 0x7f6a74100f70 2024-08-18T22:05:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a79116640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6a74110de0 con 0x7f6a74101910 2024-08-18T22:05:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a7359e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a741057a0 0x7f6a7419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a7359e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a741057a0 0x7f6a7419ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60530/0 (socket says 172.21.15.123:60530) 2024-08-18T22:05:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a7359e640 1 -- 172.21.15.123:0/1701166898 learned_addr learned my addr 172.21.15.123:0/1701166898 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a7359e640 1 -- 172.21.15.123:0/1701166898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a74101910 msgr2=0x7f6a7419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a7359e640 1 --2- 172.21.15.123:0/1701166898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a74101910 0x7f6a7419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a7359e640 1 -- 172.21.15.123:0/1701166898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a74100f70 msgr2=0x7f6a7419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a72d9d640 1 --2- 172.21.15.123:0/1701166898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a74100f70 0x7f6a7419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a7359e640 1 --2- 172.21.15.123:0/1701166898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a74100f70 0x7f6a7419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a7359e640 1 -- 172.21.15.123:0/1701166898 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7419f430 con 0x7f6a741057a0 2024-08-18T22:05:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.387+0000 7f6a72d9d640 1 --2- 172.21.15.123:0/1701166898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a74100f70 0x7f6a7419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:05:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.388+0000 7f6a7359e640 1 --2- 172.21.15.123:0/1701166898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a741057a0 0x7f6a7419ed50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c031a60 tx=0x7f6a6c031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.388+0000 7f6a70d99640 1 -- 172.21.15.123:0/1701166898 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c003c30 con 0x7f6a741057a0 2024-08-18T22:05:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.388+0000 7f6a79116640 1 -- 172.21.15.123:0/1701166898 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a7419f6c0 con 0x7f6a741057a0 2024-08-18T22:05:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.388+0000 7f6a70d99640 1 -- 172.21.15.123:0/1701166898 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a6c003dd0 con 0x7f6a741057a0 2024-08-18T22:05:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.388+0000 7f6a70d99640 1 -- 172.21.15.123:0/1701166898 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0047e0 con 0x7f6a741057a0 2024-08-18T22:05:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.388+0000 7f6a79116640 1 -- 172.21.15.123:0/1701166898 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a741a7000 con 0x7f6a741057a0 2024-08-18T22:05:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.389+0000 7f6a79116640 1 -- 172.21.15.123:0/1701166898 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a74101450 con 0x7f6a741057a0 2024-08-18T22:05:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.390+0000 7f6a70d99640 1 -- 172.21.15.123:0/1701166898 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6a6c02f790 con 0x7f6a741057a0 2024-08-18T22:05:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.390+0000 7f6a70d99640 1 --2- 172.21.15.123:0/1701166898 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6a600a2b80 0x7f6a600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.391+0000 7f6a72d9d640 1 --2- 172.21.15.123:0/1701166898 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6a600a2b80 0x7f6a600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.391+0000 7f6a70d99640 1 -- 172.21.15.123:0/1701166898 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7879+0+0 (secure 0 0 0) 0x7f6a6c0f04c0 con 0x7f6a741057a0 2024-08-18T22:05:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.391+0000 7f6a72d9d640 1 --2- 172.21.15.123:0/1701166898 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6a600a2b80 0x7f6a600a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a64006fd0 tx=0x7f6a64008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.394+0000 7f6a70d99640 1 -- 172.21.15.123:0/1701166898 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6a6c0bd5d0 con 0x7f6a741057a0 2024-08-18T22:05:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.595+0000 7f6a79116640 1 -- 172.21.15.123:0/1701166898 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6a7419b7e0 con 0x7f6a741057a0 2024-08-18T22:05:22.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.859+0000 7f6a70d99640 1 -- 172.21.15.123:0/1701166898 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f6a7419b7e0 con 0x7f6a741057a0 2024-08-18T22:05:22.860 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 2 and data pool 3 2024-08-18T22:05:22.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.861+0000 7f6a79116640 1 -- 172.21.15.123:0/1701166898 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6a600a2b80 msgr2=0x7f6a600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:22.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.861+0000 7f6a79116640 1 --2- 172.21.15.123:0/1701166898 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6a600a2b80 0x7f6a600a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a64006fd0 tx=0x7f6a64008040 comp rx=0 tx=0).stop 2024-08-18T22:05:22.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.861+0000 7f6a79116640 1 -- 172.21.15.123:0/1701166898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a741057a0 msgr2=0x7f6a7419ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:22.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.861+0000 7f6a79116640 1 --2- 172.21.15.123:0/1701166898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a741057a0 0x7f6a7419ed50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c031a60 tx=0x7f6a6c031a90 comp rx=0 tx=0).stop 2024-08-18T22:05:22.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.861+0000 7f6a79116640 1 -- 172.21.15.123:0/1701166898 shutdown_connections 2024-08-18T22:05:22.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.861+0000 7f6a79116640 1 --2- 172.21.15.123:0/1701166898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a741057a0 0x7f6a7419ed50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:22.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.861+0000 7f6a79116640 1 --2- 172.21.15.123:0/1701166898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a74101910 0x7f6a7419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:22.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.861+0000 7f6a79116640 1 --2- 172.21.15.123:0/1701166898 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6a600a2b80 0x7f6a600a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:22.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.861+0000 7f6a79116640 1 --2- 172.21.15.123:0/1701166898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a74100f70 0x7f6a7419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:22.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.861+0000 7f6a79116640 1 -- 172.21.15.123:0/1701166898 >> 172.21.15.123:0/1701166898 conn(0x7f6a74076f40 msgr2=0x7f6a74104690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:22.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.861+0000 7f6a79116640 1 -- 172.21.15.123:0/1701166898 shutdown_connections 2024-08-18T22:05:22.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:22.861+0000 7f6a79116640 1 -- 172.21.15.123:0/1701166898 wait complete. 2024-08-18T22:05:23.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:22 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1701166898' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-08-18T22:05:23.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:22 smithi183 ceph-mon[22097]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-08-18T22:05:23.201 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:22 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1701166898' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-08-18T22:05:23.201 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:22 smithi123 ceph-mon[18462]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-08-18T22:05:23.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:22 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1701166898' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-08-18T22:05:23.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:22 smithi130 ceph-mon[21698]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-08-18T22:05:23.650 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-08-18T22:05:23.650 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-08-18T22:05:23.902 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:24.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:23 smithi123 ceph-mon[18462]: osdmap e82: 12 total, 12 up, 12 in 2024-08-18T22:05:24.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:23 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1701166898' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-18T22:05:24.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:23 smithi123 ceph-mon[18462]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-08-18T22:05:24.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:23 smithi123 ceph-mon[18462]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-08-18T22:05:24.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:23 smithi123 ceph-mon[18462]: pgmap v259: 97 pgs: 39 active+clean, 16 creating+peering, 42 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2024-08-18T22:05:24.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:23 smithi183 ceph-mon[22097]: osdmap e82: 12 total, 12 up, 12 in 2024-08-18T22:05:24.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:23 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1701166898' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-18T22:05:24.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:23 smithi183 ceph-mon[22097]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-08-18T22:05:24.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:23 smithi183 ceph-mon[22097]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-08-18T22:05:24.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:23 smithi183 ceph-mon[22097]: pgmap v259: 97 pgs: 39 active+clean, 16 creating+peering, 42 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2024-08-18T22:05:24.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:23 smithi130 ceph-mon[21698]: osdmap e82: 12 total, 12 up, 12 in 2024-08-18T22:05:24.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:23 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1701166898' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-18T22:05:24.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:23 smithi130 ceph-mon[21698]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-08-18T22:05:24.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:23 smithi130 ceph-mon[21698]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-08-18T22:05:24.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:23 smithi130 ceph-mon[21698]: pgmap v259: 97 pgs: 39 active+clean, 16 creating+peering, 42 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2024-08-18T22:05:24.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.405+0000 7f75d9ad6640 1 -- 172.21.15.123:0/3705088693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d41067c0 msgr2=0x7f75d4106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:24.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.405+0000 7f75d9ad6640 1 --2- 172.21.15.123:0/3705088693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d41067c0 0x7f75d4106ba0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009930 tx=0x7f75c402a420 comp rx=0 tx=0).stop 2024-08-18T22:05:24.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.405+0000 7f75d9ad6640 1 -- 172.21.15.123:0/3705088693 shutdown_connections 2024-08-18T22:05:24.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.405+0000 7f75d9ad6640 1 --2- 172.21.15.123:0/3705088693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75d4101160 0x7f75d410d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:24.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.405+0000 7f75d9ad6640 1 --2- 172.21.15.123:0/3705088693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75d41007c0 0x7f75d4100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:24.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.405+0000 7f75d9ad6640 1 --2- 172.21.15.123:0/3705088693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d41067c0 0x7f75d4106ba0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:24.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.405+0000 7f75d9ad6640 1 -- 172.21.15.123:0/3705088693 >> 172.21.15.123:0/3705088693 conn(0x7f75d40fc500 msgr2=0x7f75d40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:24.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.405+0000 7f75d9ad6640 1 -- 172.21.15.123:0/3705088693 shutdown_connections 2024-08-18T22:05:24.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.405+0000 7f75d9ad6640 1 -- 172.21.15.123:0/3705088693 wait complete. 2024-08-18T22:05:24.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.405+0000 7f75d9ad6640 1 Processor -- start 2024-08-18T22:05:24.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d9ad6640 1 -- start start 2024-08-18T22:05:24.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d9ad6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75d41007c0 0x7f75d4199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:24.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d9ad6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75d4101160 0x7f75d4199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:24.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d9ad6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d41067c0 0x7f75d41a40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:24.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d9ad6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f75d4110be0 con 0x7f75d41067c0 2024-08-18T22:05:24.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d9ad6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f75d4110a60 con 0x7f75d41007c0 2024-08-18T22:05:24.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d9ad6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f75d4110d60 con 0x7f75d4101160 2024-08-18T22:05:24.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d41067c0 0x7f75d41a40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:24.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d41067c0 0x7f75d41a40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54398/0 (socket says 172.21.15.123:54398) 2024-08-18T22:05:24.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d3fff640 1 -- 172.21.15.123:0/1316446702 learned_addr learned my addr 172.21.15.123:0/1316446702 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:24.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d37fe640 1 --2- 172.21.15.123:0/1316446702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75d41007c0 0x7f75d4199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:24.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d3fff640 1 -- 172.21.15.123:0/1316446702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75d4101160 msgr2=0x7f75d4199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:24.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d2ffd640 1 --2- 172.21.15.123:0/1316446702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75d4101160 0x7f75d4199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:24.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d3fff640 1 --2- 172.21.15.123:0/1316446702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75d4101160 0x7f75d4199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:24.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d3fff640 1 -- 172.21.15.123:0/1316446702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75d41007c0 msgr2=0x7f75d4199050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:24.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d3fff640 1 --2- 172.21.15.123:0/1316446702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75d41007c0 0x7f75d4199050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:24.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d3fff640 1 -- 172.21.15.123:0/1316446702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d41a4610 con 0x7f75d41067c0 2024-08-18T22:05:24.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.406+0000 7f75d3fff640 1 --2- 172.21.15.123:0/1316446702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d41067c0 0x7f75d41a40d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00b970 tx=0x7f75cc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:24.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.407+0000 7f75d0ff9640 1 -- 172.21.15.123:0/1316446702 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc019070 con 0x7f75d41067c0 2024-08-18T22:05:24.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.407+0000 7f75d0ff9640 1 -- 172.21.15.123:0/1316446702 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75cc00cb40 con 0x7f75d41067c0 2024-08-18T22:05:24.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.407+0000 7f75d9ad6640 1 -- 172.21.15.123:0/1316446702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d41a47e0 con 0x7f75d41067c0 2024-08-18T22:05:24.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.407+0000 7f75d0ff9640 1 -- 172.21.15.123:0/1316446702 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc007650 con 0x7f75d41067c0 2024-08-18T22:05:24.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.407+0000 7f75d9ad6640 1 -- 172.21.15.123:0/1316446702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d41a4d20 con 0x7f75d41067c0 2024-08-18T22:05:24.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.408+0000 7f75d9ad6640 1 -- 172.21.15.123:0/1316446702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d4100c20 con 0x7f75d41067c0 2024-08-18T22:05:24.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.409+0000 7f75d0ff9640 1 -- 172.21.15.123:0/1316446702 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f75cc01c070 con 0x7f75d41067c0 2024-08-18T22:05:24.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.410+0000 7f75d0ff9640 1 --2- 172.21.15.123:0/1316446702 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f75bc0a2c00 0x7f75bc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:24.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.410+0000 7f75d37fe640 1 --2- 172.21.15.123:0/1316446702 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f75bc0a2c00 0x7f75bc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:24.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.410+0000 7f75d0ff9640 1 -- 172.21.15.123:0/1316446702 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f75cc0ce870 con 0x7f75d41067c0 2024-08-18T22:05:24.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.410+0000 7f75d37fe640 1 --2- 172.21.15.123:0/1316446702 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f75bc0a2c00 0x7f75bc0a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009900 tx=0x7f75c40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:24.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.413+0000 7f75d0ff9640 1 -- 172.21.15.123:0/1316446702 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f75cc09b2d0 con 0x7f75d41067c0 2024-08-18T22:05:24.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.586+0000 7f75d9ad6640 1 -- 172.21.15.123:0/1316446702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f75d4108d60 con 0x7f75d41067c0 2024-08-18T22:05:24.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.878+0000 7f75d0ff9640 1 -- 172.21.15.123:0/1316446702 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v83) ==== 157+0+0 (secure 0 0 0) 0x7f75cc09f5d0 con 0x7f75d41067c0 2024-08-18T22:05:24.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.881+0000 7f75d9ad6640 1 -- 172.21.15.123:0/1316446702 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f75bc0a2c00 msgr2=0x7f75bc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:24.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.881+0000 7f75d9ad6640 1 --2- 172.21.15.123:0/1316446702 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f75bc0a2c00 0x7f75bc0a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009900 tx=0x7f75c40058d0 comp rx=0 tx=0).stop 2024-08-18T22:05:24.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.881+0000 7f75d9ad6640 1 -- 172.21.15.123:0/1316446702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d41067c0 msgr2=0x7f75d41a40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:24.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.881+0000 7f75d9ad6640 1 --2- 172.21.15.123:0/1316446702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d41067c0 0x7f75d41a40d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00b970 tx=0x7f75cc00be30 comp rx=0 tx=0).stop 2024-08-18T22:05:24.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.881+0000 7f75d9ad6640 1 -- 172.21.15.123:0/1316446702 shutdown_connections 2024-08-18T22:05:24.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.881+0000 7f75d9ad6640 1 --2- 172.21.15.123:0/1316446702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d41067c0 0x7f75d41a40d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:24.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.881+0000 7f75d9ad6640 1 --2- 172.21.15.123:0/1316446702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75d4101160 0x7f75d4199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:24.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.881+0000 7f75d9ad6640 1 --2- 172.21.15.123:0/1316446702 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f75bc0a2c00 0x7f75bc0a50c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:24.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.881+0000 7f75d9ad6640 1 --2- 172.21.15.123:0/1316446702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75d41007c0 0x7f75d4199050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:24.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.881+0000 7f75d9ad6640 1 -- 172.21.15.123:0/1316446702 >> 172.21.15.123:0/1316446702 conn(0x7f75d40fc500 msgr2=0x7f75d40fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:24.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.881+0000 7f75d9ad6640 1 -- 172.21.15.123:0/1316446702 shutdown_connections 2024-08-18T22:05:24.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:24.881+0000 7f75d9ad6640 1 -- 172.21.15.123:0/1316446702 wait complete. 2024-08-18T22:05:25.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:24 smithi183 ceph-mon[22097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-18T22:05:25.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:24 smithi183 ceph-mon[22097]: Cluster is now healthy 2024-08-18T22:05:25.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:24 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] up:active 2024-08-18T22:05:25.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:24 smithi183 ceph-mon[22097]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-18T22:05:25.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:24 smithi183 ceph-mon[22097]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-18T22:05:25.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:24 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1316446702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-08-18T22:05:25.243 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:24 smithi123 ceph-mon[18462]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-18T22:05:25.243 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:24 smithi123 ceph-mon[18462]: Cluster is now healthy 2024-08-18T22:05:25.243 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:24 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] up:active 2024-08-18T22:05:25.243 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:24 smithi123 ceph-mon[18462]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-18T22:05:25.244 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:24 smithi123 ceph-mon[18462]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-18T22:05:25.244 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:24 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1316446702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-08-18T22:05:25.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:24 smithi130 ceph-mon[21698]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-18T22:05:25.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:24 smithi130 ceph-mon[21698]: Cluster is now healthy 2024-08-18T22:05:25.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:24 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] up:active 2024-08-18T22:05:25.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:24 smithi130 ceph-mon[21698]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-18T22:05:25.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:24 smithi130 ceph-mon[21698]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-18T22:05:25.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:24 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1316446702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-08-18T22:05:25.658 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T22:05:25.911 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:26.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:25 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1316446702' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-18T22:05:26.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:25 smithi183 ceph-mon[22097]: osdmap e83: 12 total, 12 up, 12 in 2024-08-18T22:05:26.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:25 smithi183 ceph-mon[22097]: pgmap v261: 97 pgs: 82 active+clean, 10 creating+peering, 5 unknown; 578 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-08-18T22:05:26.177 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:25 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1316446702' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-18T22:05:26.177 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:25 smithi123 ceph-mon[18462]: osdmap e83: 12 total, 12 up, 12 in 2024-08-18T22:05:26.177 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:25 smithi123 ceph-mon[18462]: pgmap v261: 97 pgs: 82 active+clean, 10 creating+peering, 5 unknown; 578 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-08-18T22:05:26.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:25 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1316446702' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-18T22:05:26.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:25 smithi130 ceph-mon[21698]: osdmap e83: 12 total, 12 up, 12 in 2024-08-18T22:05:26.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:25 smithi130 ceph-mon[21698]: pgmap v261: 97 pgs: 82 active+clean, 10 creating+peering, 5 unknown; 578 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-08-18T22:05:26.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.466+0000 7ff231c87640 1 -- 172.21.15.123:0/2285254417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff22c1022a0 msgr2=0x7ff22c1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:26.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.466+0000 7ff231c87640 1 --2- 172.21.15.123:0/2285254417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff22c1022a0 0x7ff22c1026e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff214009900 tx=0x7ff21402a480 comp rx=0 tx=0).stop 2024-08-18T22:05:26.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.466+0000 7ff231c87640 1 -- 172.21.15.123:0/2285254417 shutdown_connections 2024-08-18T22:05:26.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.466+0000 7ff231c87640 1 --2- 172.21.15.123:0/2285254417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff22c102c20 0x7ff22c10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:26.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.466+0000 7ff231c87640 1 --2- 172.21.15.123:0/2285254417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff22c1022a0 0x7ff22c1026e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:26.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.466+0000 7ff231c87640 1 --2- 172.21.15.123:0/2285254417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff22c100b50 0x7ff22c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:26.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.466+0000 7ff231c87640 1 -- 172.21.15.123:0/2285254417 >> 172.21.15.123:0/2285254417 conn(0x7ff22c0fc500 msgr2=0x7ff22c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:26.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.466+0000 7ff231c87640 1 -- 172.21.15.123:0/2285254417 shutdown_connections 2024-08-18T22:05:26.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.466+0000 7ff231c87640 1 -- 172.21.15.123:0/2285254417 wait complete. 2024-08-18T22:05:26.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.466+0000 7ff231c87640 1 Processor -- start 2024-08-18T22:05:26.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.466+0000 7ff231c87640 1 -- start start 2024-08-18T22:05:26.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff231c87640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff22c100b50 0x7ff22c199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:26.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff231c87640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff22c1022a0 0x7ff22c199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:26.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff231c87640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff22c102c20 0x7ff22c1a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:26.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff231c87640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c110cd0 con 0x7ff22c1022a0 2024-08-18T22:05:26.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff231c87640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c110b50 con 0x7ff22c100b50 2024-08-18T22:05:26.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff231c87640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c110e50 con 0x7ff22c102c20 2024-08-18T22:05:26.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff223fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff22c1022a0 0x7ff22c199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:26.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff223fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff22c1022a0 0x7ff22c199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54416/0 (socket says 172.21.15.123:54416) 2024-08-18T22:05:26.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff223fff640 1 -- 172.21.15.123:0/3583307862 learned_addr learned my addr 172.21.15.123:0/3583307862 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:26.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff22b7fe640 1 --2- 172.21.15.123:0/3583307862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff22c100b50 0x7ff22c199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:26.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff22bfff640 1 --2- 172.21.15.123:0/3583307862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff22c102c20 0x7ff22c1a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:26.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff223fff640 1 -- 172.21.15.123:0/3583307862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff22c102c20 msgr2=0x7ff22c1a4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:26.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff223fff640 1 --2- 172.21.15.123:0/3583307862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff22c102c20 0x7ff22c1a4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:26.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff223fff640 1 -- 172.21.15.123:0/3583307862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff22c100b50 msgr2=0x7ff22c199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:26.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff223fff640 1 --2- 172.21.15.123:0/3583307862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff22c100b50 0x7ff22c199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:26.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff223fff640 1 -- 172.21.15.123:0/3583307862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22c196ef0 con 0x7ff22c1022a0 2024-08-18T22:05:26.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff223fff640 1 --2- 172.21.15.123:0/3583307862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff22c1022a0 0x7ff22c199640 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff214006010 tx=0x7ff214003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:26.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff2297fa640 1 -- 172.21.15.123:0/3583307862 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21403f070 con 0x7ff22c1022a0 2024-08-18T22:05:26.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff2297fa640 1 -- 172.21.15.123:0/3583307862 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff214031e30 con 0x7ff22c1022a0 2024-08-18T22:05:26.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff231c87640 1 -- 172.21.15.123:0/3583307862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff22c197180 con 0x7ff22c1022a0 2024-08-18T22:05:26.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff2297fa640 1 -- 172.21.15.123:0/3583307862 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214035030 con 0x7ff22c1022a0 2024-08-18T22:05:26.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.467+0000 7ff231c87640 1 -- 172.21.15.123:0/3583307862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff22c197660 con 0x7ff22c1022a0 2024-08-18T22:05:26.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.468+0000 7ff231c87640 1 -- 172.21.15.123:0/3583307862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff22c101ee0 con 0x7ff22c1022a0 2024-08-18T22:05:26.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.470+0000 7ff2297fa640 1 -- 172.21.15.123:0/3583307862 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7ff214042070 con 0x7ff22c1022a0 2024-08-18T22:05:26.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.471+0000 7ff2297fa640 1 --2- 172.21.15.123:0/3583307862 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff2180a2b80 0x7ff2180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:26.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.471+0000 7ff22b7fe640 1 --2- 172.21.15.123:0/3583307862 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff2180a2b80 0x7ff2180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:26.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.472+0000 7ff2297fa640 1 -- 172.21.15.123:0/3583307862 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8277+0+0 (secure 0 0 0) 0x7ff2140f0060 con 0x7ff22c1022a0 2024-08-18T22:05:26.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.472+0000 7ff22b7fe640 1 --2- 172.21.15.123:0/3583307862 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff2180a2b80 0x7ff2180a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009890 tx=0x7ff21c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:26.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.475+0000 7ff2297fa640 1 -- 172.21.15.123:0/3583307862 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff2140bd020 con 0x7ff22c1022a0 2024-08-18T22:05:26.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:26.648+0000 7ff231c87640 1 -- 172.21.15.123:0/3583307862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff22c06a290 con 0x7ff22c1022a0 2024-08-18T22:05:27.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:26 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3583307862' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-08-18T22:05:27.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:26 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3583307862' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-08-18T22:05:27.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:26 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3583307862' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-08-18T22:05:27.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:27.895+0000 7ff2297fa640 1 -- 172.21.15.123:0/3583307862 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v85) ==== 228+0+0 (secure 0 0 0) 0x7ff2140bc920 con 0x7ff22c1022a0 2024-08-18T22:05:27.897 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data_ec' created 2024-08-18T22:05:27.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:27.898+0000 7ff231c87640 1 -- 172.21.15.123:0/3583307862 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff2180a2b80 msgr2=0x7ff2180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:27.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:27.898+0000 7ff231c87640 1 --2- 172.21.15.123:0/3583307862 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff2180a2b80 0x7ff2180a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009890 tx=0x7ff21c008040 comp rx=0 tx=0).stop 2024-08-18T22:05:27.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:27.898+0000 7ff231c87640 1 -- 172.21.15.123:0/3583307862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff22c1022a0 msgr2=0x7ff22c199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:27.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:27.898+0000 7ff231c87640 1 --2- 172.21.15.123:0/3583307862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff22c1022a0 0x7ff22c199640 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff214006010 tx=0x7ff214003c80 comp rx=0 tx=0).stop 2024-08-18T22:05:27.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:27.898+0000 7ff231c87640 1 -- 172.21.15.123:0/3583307862 shutdown_connections 2024-08-18T22:05:27.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:27.898+0000 7ff231c87640 1 --2- 172.21.15.123:0/3583307862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff22c102c20 0x7ff22c1a4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:27.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:27.898+0000 7ff231c87640 1 --2- 172.21.15.123:0/3583307862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff22c1022a0 0x7ff22c199640 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:27.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:27.898+0000 7ff231c87640 1 --2- 172.21.15.123:0/3583307862 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff2180a2b80 0x7ff2180a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:27.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:27.898+0000 7ff231c87640 1 --2- 172.21.15.123:0/3583307862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff22c100b50 0x7ff22c199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:27.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:27.898+0000 7ff231c87640 1 -- 172.21.15.123:0/3583307862 >> 172.21.15.123:0/3583307862 conn(0x7ff22c0fc500 msgr2=0x7ff22c106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:27.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:27.898+0000 7ff231c87640 1 -- 172.21.15.123:0/3583307862 shutdown_connections 2024-08-18T22:05:27.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:27.898+0000 7ff231c87640 1 -- 172.21.15.123:0/3583307862 wait complete. 2024-08-18T22:05:28.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:27 smithi183 ceph-mon[22097]: osdmap e84: 12 total, 12 up, 12 in 2024-08-18T22:05:28.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:27 smithi183 ceph-mon[22097]: pgmap v263: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-08-18T22:05:28.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:27 smithi123 ceph-mon[18462]: osdmap e84: 12 total, 12 up, 12 in 2024-08-18T22:05:28.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:27 smithi123 ceph-mon[18462]: pgmap v263: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-08-18T22:05:28.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:27 smithi130 ceph-mon[21698]: osdmap e84: 12 total, 12 up, 12 in 2024-08-18T22:05:28.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:27 smithi130 ceph-mon[21698]: pgmap v263: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-08-18T22:05:28.659 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:05:28 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: 2024-08-18T22:05:28.394+0000 7fcbda086640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:05:28.721 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-08-18T22:05:28.993 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:29.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:28 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3583307862' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-18T22:05:29.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:28 smithi123 ceph-mon[18462]: osdmap e85: 12 total, 12 up, 12 in 2024-08-18T22:05:29.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:28 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3583307862' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-18T22:05:29.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:28 smithi130 ceph-mon[21698]: osdmap e85: 12 total, 12 up, 12 in 2024-08-18T22:05:29.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:28 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3583307862' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-18T22:05:29.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:28 smithi183 ceph-mon[22097]: osdmap e85: 12 total, 12 up, 12 in 2024-08-18T22:05:29.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.566+0000 7fa8e325a640 1 -- 172.21.15.123:0/3747225055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8dc102260 msgr2=0x7fa8dc10e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:29.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.566+0000 7fa8e325a640 1 --2- 172.21.15.123:0/3747225055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8dc102260 0x7fa8dc10e790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009cd0 tx=0x7fa8d402a8e0 comp rx=0 tx=0).stop 2024-08-18T22:05:29.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.566+0000 7fa8e325a640 1 -- 172.21.15.123:0/3747225055 shutdown_connections 2024-08-18T22:05:29.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.566+0000 7fa8e325a640 1 --2- 172.21.15.123:0/3747225055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8dc102260 0x7fa8dc10e790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:29.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.566+0000 7fa8e325a640 1 --2- 172.21.15.123:0/3747225055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8dc1018c0 0x7fa8dc101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:29.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.566+0000 7fa8e325a640 1 --2- 172.21.15.123:0/3747225055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8dc1078c0 0x7fa8dc107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:29.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.566+0000 7fa8e325a640 1 -- 172.21.15.123:0/3747225055 >> 172.21.15.123:0/3747225055 conn(0x7fa8dc0fd5e0 msgr2=0x7fa8dc0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:29.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.566+0000 7fa8e325a640 1 -- 172.21.15.123:0/3747225055 shutdown_connections 2024-08-18T22:05:29.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.566+0000 7fa8e325a640 1 -- 172.21.15.123:0/3747225055 wait complete. 2024-08-18T22:05:29.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.566+0000 7fa8e325a640 1 Processor -- start 2024-08-18T22:05:29.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.566+0000 7fa8e325a640 1 -- start start 2024-08-18T22:05:29.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e325a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8dc1018c0 0x7fa8dc198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:29.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e325a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8dc102260 0x7fa8dc198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:29.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e325a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8dc1078c0 0x7fa8dc19c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:29.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e325a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc111d30 con 0x7fa8dc1018c0 2024-08-18T22:05:29.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e325a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc111bb0 con 0x7fa8dc1078c0 2024-08-18T22:05:29.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e325a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc111eb0 con 0x7fa8dc102260 2024-08-18T22:05:29.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e0ff6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8dc1018c0 0x7fa8dc198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:29.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e0ff6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8dc1018c0 0x7fa8dc198110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54432/0 (socket says 172.21.15.123:54432) 2024-08-18T22:05:29.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e0ff6640 1 -- 172.21.15.123:0/3718021872 learned_addr learned my addr 172.21.15.123:0/3718021872 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:29.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8dbfff640 1 --2- 172.21.15.123:0/3718021872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8dc102260 0x7fa8dc198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:29.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e17f7640 1 --2- 172.21.15.123:0/3718021872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8dc1078c0 0x7fa8dc19c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:29.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e0ff6640 1 -- 172.21.15.123:0/3718021872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8dc102260 msgr2=0x7fa8dc198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e0ff6640 1 --2- 172.21.15.123:0/3718021872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8dc102260 0x7fa8dc198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e0ff6640 1 -- 172.21.15.123:0/3718021872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8dc1078c0 msgr2=0x7fa8dc19c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e0ff6640 1 --2- 172.21.15.123:0/3718021872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8dc1078c0 0x7fa8dc19c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e0ff6640 1 -- 172.21.15.123:0/3718021872 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc19d0c0 con 0x7fa8dc1018c0 2024-08-18T22:05:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8dbfff640 1 --2- 172.21.15.123:0/3718021872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8dc102260 0x7fa8dc198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:05:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e0ff6640 1 --2- 172.21.15.123:0/3718021872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8dc1018c0 0x7fa8dc198110 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00c920 tx=0x7fa8cc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8d9ffb640 1 -- 172.21.15.123:0/3718021872 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc007c70 con 0x7fa8dc1018c0 2024-08-18T22:05:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8d9ffb640 1 -- 172.21.15.123:0/3718021872 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8cc007e10 con 0x7fa8dc1018c0 2024-08-18T22:05:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8e325a640 1 -- 172.21.15.123:0/3718021872 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8dc19d3b0 con 0x7fa8dc1018c0 2024-08-18T22:05:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.567+0000 7fa8d9ffb640 1 -- 172.21.15.123:0/3718021872 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc018890 con 0x7fa8dc1018c0 2024-08-18T22:05:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.568+0000 7fa8e325a640 1 -- 172.21.15.123:0/3718021872 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8dc1a4c90 con 0x7fa8dc1018c0 2024-08-18T22:05:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.568+0000 7fa8e325a640 1 -- 172.21.15.123:0/3718021872 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8dc101d20 con 0x7fa8dc1018c0 2024-08-18T22:05:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.569+0000 7fa8d9ffb640 1 -- 172.21.15.123:0/3718021872 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa8cc018a70 con 0x7fa8dc1018c0 2024-08-18T22:05:29.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.570+0000 7fa8d9ffb640 1 --2- 172.21.15.123:0/3718021872 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa8c40a2b80 0x7fa8c40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:29.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.570+0000 7fa8dbfff640 1 --2- 172.21.15.123:0/3718021872 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa8c40a2b80 0x7fa8c40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:29.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.570+0000 7fa8d9ffb640 1 -- 172.21.15.123:0/3718021872 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8770+0+0 (secure 0 0 0) 0x7fa8cc0cf460 con 0x7fa8dc1018c0 2024-08-18T22:05:29.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.571+0000 7fa8dbfff640 1 --2- 172.21.15.123:0/3718021872 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa8c40a2b80 0x7fa8c40a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc0ffac0 tx=0x7fa8d0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:29.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.574+0000 7fa8d9ffb640 1 -- 172.21.15.123:0/3718021872 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa8cc014030 con 0x7fa8dc1018c0 2024-08-18T22:05:29.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.740+0000 7fa8e325a640 1 -- 172.21.15.123:0/3718021872 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fa8dc199470 con 0x7fa8dc1018c0 2024-08-18T22:05:29.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.908+0000 7fa8d9ffb640 1 -- 172.21.15.123:0/3718021872 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v87) ==== 169+0+0 (secure 0 0 0) 0x7fa8cc00de20 con 0x7fa8dc1018c0 2024-08-18T22:05:29.909 INFO:teuthology.orchestra.run.smithi123.stderr:set pool 4 allow_ec_overwrites to true 2024-08-18T22:05:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.911+0000 7fa8e325a640 1 -- 172.21.15.123:0/3718021872 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa8c40a2b80 msgr2=0x7fa8c40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.911+0000 7fa8e325a640 1 --2- 172.21.15.123:0/3718021872 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa8c40a2b80 0x7fa8c40a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc0ffac0 tx=0x7fa8d0008040 comp rx=0 tx=0).stop 2024-08-18T22:05:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.911+0000 7fa8e325a640 1 -- 172.21.15.123:0/3718021872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8dc1018c0 msgr2=0x7fa8dc198110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.911+0000 7fa8e325a640 1 --2- 172.21.15.123:0/3718021872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8dc1018c0 0x7fa8dc198110 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00c920 tx=0x7fa8cc00cde0 comp rx=0 tx=0).stop 2024-08-18T22:05:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.911+0000 7fa8e325a640 1 -- 172.21.15.123:0/3718021872 shutdown_connections 2024-08-18T22:05:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.911+0000 7fa8e325a640 1 --2- 172.21.15.123:0/3718021872 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa8c40a2b80 0x7fa8c40a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.911+0000 7fa8e325a640 1 --2- 172.21.15.123:0/3718021872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8dc1078c0 0x7fa8dc19c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.911+0000 7fa8e325a640 1 --2- 172.21.15.123:0/3718021872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8dc102260 0x7fa8dc198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.911+0000 7fa8e325a640 1 --2- 172.21.15.123:0/3718021872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8dc1018c0 0x7fa8dc198110 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.911+0000 7fa8e325a640 1 -- 172.21.15.123:0/3718021872 >> 172.21.15.123:0/3718021872 conn(0x7fa8dc0fd5e0 msgr2=0x7fa8dc0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.911+0000 7fa8e325a640 1 -- 172.21.15.123:0/3718021872 shutdown_connections 2024-08-18T22:05:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:29.911+0000 7fa8e325a640 1 -- 172.21.15.123:0/3718021872 wait complete. 2024-08-18T22:05:30.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:29 smithi123 ceph-mon[18462]: osdmap e86: 12 total, 12 up, 12 in 2024-08-18T22:05:30.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:29 smithi123 ceph-mon[18462]: pgmap v266: 129 pgs: 16 creating+peering, 16 unknown, 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 689 B/s wr, 2 op/s 2024-08-18T22:05:30.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:29 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3718021872' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-08-18T22:05:30.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:29 smithi130 ceph-mon[21698]: osdmap e86: 12 total, 12 up, 12 in 2024-08-18T22:05:30.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:29 smithi130 ceph-mon[21698]: pgmap v266: 129 pgs: 16 creating+peering, 16 unknown, 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 689 B/s wr, 2 op/s 2024-08-18T22:05:30.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:29 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3718021872' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-08-18T22:05:30.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:29 smithi183 ceph-mon[22097]: osdmap e86: 12 total, 12 up, 12 in 2024-08-18T22:05:30.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:29 smithi183 ceph-mon[22097]: pgmap v266: 129 pgs: 16 creating+peering, 16 unknown, 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 689 B/s wr, 2 op/s 2024-08-18T22:05:30.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:29 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3718021872' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-08-18T22:05:30.607 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-08-18T22:05:30.856 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:31.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:30 smithi183 ceph-mon[22097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-18T22:05:31.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:30 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3718021872' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-18T22:05:31.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:30 smithi183 ceph-mon[22097]: osdmap e87: 12 total, 12 up, 12 in 2024-08-18T22:05:31.258 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:30 smithi123 ceph-mon[18462]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-18T22:05:31.259 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:30 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3718021872' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-18T22:05:31.259 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:30 smithi123 ceph-mon[18462]: osdmap e87: 12 total, 12 up, 12 in 2024-08-18T22:05:31.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:30 smithi130 ceph-mon[21698]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-18T22:05:31.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:30 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3718021872' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-18T22:05:31.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:30 smithi130 ceph-mon[21698]: osdmap e87: 12 total, 12 up, 12 in 2024-08-18T22:05:31.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.340+0000 7f4a5a57f640 1 -- 172.21.15.123:0/2605761679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a54107fd0 msgr2=0x7f4a5410e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:31.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.340+0000 7f4a5a57f640 1 --2- 172.21.15.123:0/2605761679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a54107fd0 0x7f4a5410e970 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009cd0 tx=0x7f4a4c02a8e0 comp rx=0 tx=0).stop 2024-08-18T22:05:31.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.340+0000 7f4a5a57f640 1 -- 172.21.15.123:0/2605761679 shutdown_connections 2024-08-18T22:05:31.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.340+0000 7f4a5a57f640 1 --2- 172.21.15.123:0/2605761679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a54107fd0 0x7f4a5410e970 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:31.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.340+0000 7f4a5a57f640 1 --2- 172.21.15.123:0/2605761679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a54103410 0x7f4a541078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:31.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.340+0000 7f4a5a57f640 1 --2- 172.21.15.123:0/2605761679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a54102a60 0x7f4a54102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:31.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.340+0000 7f4a5a57f640 1 -- 172.21.15.123:0/2605761679 >> 172.21.15.123:0/2605761679 conn(0x7f4a540fc500 msgr2=0x7f4a540fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:31.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.340+0000 7f4a5a57f640 1 -- 172.21.15.123:0/2605761679 shutdown_connections 2024-08-18T22:05:31.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.340+0000 7f4a5a57f640 1 -- 172.21.15.123:0/2605761679 wait complete. 2024-08-18T22:05:31.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a5a57f640 1 Processor -- start 2024-08-18T22:05:31.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a5a57f640 1 -- start start 2024-08-18T22:05:31.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a5a57f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a54102a60 0x7f4a5419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:31.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a5a57f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a54103410 0x7f4a5419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:31.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a5a57f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a54107fd0 0x7f4a5419ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:31.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a5a57f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4a54111dd0 con 0x7f4a54107fd0 2024-08-18T22:05:31.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a5a57f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4a54111c50 con 0x7f4a54102a60 2024-08-18T22:05:31.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a5a57f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4a54111f50 con 0x7f4a54103410 2024-08-18T22:05:31.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a58b1c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a54107fd0 0x7f4a5419ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:31.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a58b1c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a54107fd0 0x7f4a5419ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54452/0 (socket says 172.21.15.123:54452) 2024-08-18T22:05:31.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a58b1c640 1 -- 172.21.15.123:0/2890416402 learned_addr learned my addr 172.21.15.123:0/2890416402 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:31.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a4bfff640 1 --2- 172.21.15.123:0/2890416402 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a54103410 0x7f4a5419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:31.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a53fff640 1 --2- 172.21.15.123:0/2890416402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a54102a60 0x7f4a5419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:31.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a58b1c640 1 -- 172.21.15.123:0/2890416402 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a54103410 msgr2=0x7f4a5419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:31.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a58b1c640 1 --2- 172.21.15.123:0/2890416402 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a54103410 0x7f4a5419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:31.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a58b1c640 1 -- 172.21.15.123:0/2890416402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a54102a60 msgr2=0x7f4a5419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:31.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a58b1c640 1 --2- 172.21.15.123:0/2890416402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a54102a60 0x7f4a5419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:31.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a58b1c640 1 -- 172.21.15.123:0/2890416402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5419f450 con 0x7f4a54107fd0 2024-08-18T22:05:31.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a53fff640 1 --2- 172.21.15.123:0/2890416402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a54102a60 0x7f4a5419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:05:31.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.341+0000 7f4a58b1c640 1 --2- 172.21.15.123:0/2890416402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a54107fd0 0x7f4a5419ed70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c005cc0 tx=0x7f4a4c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:31.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.342+0000 7f4a51ffb640 1 -- 172.21.15.123:0/2890416402 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c004040 con 0x7f4a54107fd0 2024-08-18T22:05:31.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.342+0000 7f4a51ffb640 1 -- 172.21.15.123:0/2890416402 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a4c0046c0 con 0x7f4a54107fd0 2024-08-18T22:05:31.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.342+0000 7f4a5a57f640 1 -- 172.21.15.123:0/2890416402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5419f6e0 con 0x7f4a54107fd0 2024-08-18T22:05:31.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.342+0000 7f4a51ffb640 1 -- 172.21.15.123:0/2890416402 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c046480 con 0x7f4a54107fd0 2024-08-18T22:05:31.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.342+0000 7f4a5a57f640 1 -- 172.21.15.123:0/2890416402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a541a7020 con 0x7f4a54107fd0 2024-08-18T22:05:31.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.343+0000 7f4a5a57f640 1 -- 172.21.15.123:0/2890416402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a54102e40 con 0x7f4a54107fd0 2024-08-18T22:05:31.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.344+0000 7f4a51ffb640 1 -- 172.21.15.123:0/2890416402 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f4a4c0305a0 con 0x7f4a54107fd0 2024-08-18T22:05:31.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.344+0000 7f4a51ffb640 1 --2- 172.21.15.123:0/2890416402 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4a400a2c00 0x7f4a400a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:31.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.344+0000 7f4a53fff640 1 --2- 172.21.15.123:0/2890416402 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4a400a2c00 0x7f4a400a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:31.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.344+0000 7f4a51ffb640 1 -- 172.21.15.123:0/2890416402 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8770+0+0 (secure 0 0 0) 0x7f4a4c02e030 con 0x7f4a54107fd0 2024-08-18T22:05:31.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.345+0000 7f4a53fff640 1 --2- 172.21.15.123:0/2890416402 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4a400a2c00 0x7f4a400a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4a44005fd0 tx=0x7f4a4400b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:31.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.349+0000 7f4a51ffb640 1 -- 172.21.15.123:0/2890416402 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4a4c04b060 con 0x7f4a54107fd0 2024-08-18T22:05:31.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.551+0000 7f4a5a57f640 1 -- 172.21.15.123:0/2890416402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f4a5410bff0 con 0x7f4a54107fd0 2024-08-18T22:05:31.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.918+0000 7f4a51ffb640 1 -- 172.21.15.123:0/2890416402 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f4a4c0bd780 con 0x7f4a54107fd0 2024-08-18T22:05:31.919 INFO:teuthology.orchestra.run.smithi123.stderr:added data pool 4 to fsmap 2024-08-18T22:05:31.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.920+0000 7f4a5a57f640 1 -- 172.21.15.123:0/2890416402 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4a400a2c00 msgr2=0x7f4a400a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:31.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.920+0000 7f4a5a57f640 1 --2- 172.21.15.123:0/2890416402 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4a400a2c00 0x7f4a400a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4a44005fd0 tx=0x7f4a4400b5f0 comp rx=0 tx=0).stop 2024-08-18T22:05:31.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.920+0000 7f4a5a57f640 1 -- 172.21.15.123:0/2890416402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a54107fd0 msgr2=0x7f4a5419ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:31.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.920+0000 7f4a5a57f640 1 --2- 172.21.15.123:0/2890416402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a54107fd0 0x7f4a5419ed70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c005cc0 tx=0x7f4a4c003970 comp rx=0 tx=0).stop 2024-08-18T22:05:31.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.920+0000 7f4a5a57f640 1 -- 172.21.15.123:0/2890416402 shutdown_connections 2024-08-18T22:05:31.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.920+0000 7f4a5a57f640 1 --2- 172.21.15.123:0/2890416402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a54107fd0 0x7f4a5419ed70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:31.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.920+0000 7f4a5a57f640 1 --2- 172.21.15.123:0/2890416402 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a54103410 0x7f4a5419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:31.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.920+0000 7f4a5a57f640 1 --2- 172.21.15.123:0/2890416402 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4a400a2c00 0x7f4a400a50c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:31.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.920+0000 7f4a5a57f640 1 --2- 172.21.15.123:0/2890416402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a54102a60 0x7f4a5419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:31.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.920+0000 7f4a5a57f640 1 -- 172.21.15.123:0/2890416402 >> 172.21.15.123:0/2890416402 conn(0x7f4a540fc500 msgr2=0x7f4a54101030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:31.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.920+0000 7f4a5a57f640 1 -- 172.21.15.123:0/2890416402 shutdown_connections 2024-08-18T22:05:31.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:31.920+0000 7f4a5a57f640 1 -- 172.21.15.123:0/2890416402 wait complete. 2024-08-18T22:05:32.230 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:31 smithi123 ceph-mon[18462]: pgmap v268: 129 pgs: 16 creating+peering, 9 unknown, 104 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:32.231 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:31 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2890416402' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-08-18T22:05:32.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:31 smithi130 ceph-mon[21698]: pgmap v268: 129 pgs: 16 creating+peering, 9 unknown, 104 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:32.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:31 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2890416402' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-08-18T22:05:32.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:31 smithi183 ceph-mon[22097]: pgmap v268: 129 pgs: 16 creating+peering, 9 unknown, 104 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:32.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:31 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2890416402' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-08-18T22:05:32.560 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:05:32.809 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:33.209 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:32 smithi123 ceph-mon[18462]: osdmap e88: 12 total, 12 up, 12 in 2024-08-18T22:05:33.209 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:32 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2890416402' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-18T22:05:33.209 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:32 smithi123 ceph-mon[18462]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-18T22:05:33.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:32 smithi130 ceph-mon[21698]: osdmap e88: 12 total, 12 up, 12 in 2024-08-18T22:05:33.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:32 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2890416402' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-18T22:05:33.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:32 smithi130 ceph-mon[21698]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-18T22:05:33.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.287+0000 7fcd67a8b640 1 -- 172.21.15.123:0/2761765202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd60107fd0 msgr2=0x7fcd6010e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:33.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.287+0000 7fcd67a8b640 1 --2- 172.21.15.123:0/2761765202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd60107fd0 0x7fcd6010e970 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009cd0 tx=0x7fcd5802a910 comp rx=0 tx=0).stop 2024-08-18T22:05:33.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.287+0000 7fcd67a8b640 1 -- 172.21.15.123:0/2761765202 shutdown_connections 2024-08-18T22:05:33.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.287+0000 7fcd67a8b640 1 --2- 172.21.15.123:0/2761765202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd60107fd0 0x7fcd6010e970 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:33.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.287+0000 7fcd67a8b640 1 --2- 172.21.15.123:0/2761765202 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd60103410 0x7fcd601078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.287+0000 7fcd67a8b640 1 --2- 172.21.15.123:0/2761765202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd60102a60 0x7fcd60102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.287+0000 7fcd67a8b640 1 -- 172.21.15.123:0/2761765202 >> 172.21.15.123:0/2761765202 conn(0x7fcd600fc500 msgr2=0x7fcd600fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.287+0000 7fcd67a8b640 1 -- 172.21.15.123:0/2761765202 shutdown_connections 2024-08-18T22:05:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.287+0000 7fcd67a8b640 1 -- 172.21.15.123:0/2761765202 wait complete. 2024-08-18T22:05:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.288+0000 7fcd67a8b640 1 Processor -- start 2024-08-18T22:05:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.288+0000 7fcd67a8b640 1 -- start start 2024-08-18T22:05:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.288+0000 7fcd67a8b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd60102a60 0x7fcd60198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.288+0000 7fcd67a8b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd60103410 0x7fcd60198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.288+0000 7fcd67a8b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd60107fd0 0x7fcd6019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.288+0000 7fcd67a8b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcd60111e10 con 0x7fcd60107fd0 2024-08-18T22:05:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.288+0000 7fcd67a8b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcd60111c90 con 0x7fcd60102a60 2024-08-18T22:05:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.288+0000 7fcd67a8b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcd60111f90 con 0x7fcd60103410 2024-08-18T22:05:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.288+0000 7fcd66028640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd60107fd0 0x7fcd6019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.288+0000 7fcd66028640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd60107fd0 0x7fcd6019cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38194/0 (socket says 172.21.15.123:38194) 2024-08-18T22:05:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.288+0000 7fcd66028640 1 -- 172.21.15.123:0/1611920762 learned_addr learned my addr 172.21.15.123:0/1611920762 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.288+0000 7fcd65827640 1 --2- 172.21.15.123:0/1611920762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd60102a60 0x7fcd60198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.288+0000 7fcd65026640 1 --2- 172.21.15.123:0/1611920762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd60103410 0x7fcd60198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.288+0000 7fcd66028640 1 -- 172.21.15.123:0/1611920762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd60103410 msgr2=0x7fcd60198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.288+0000 7fcd66028640 1 --2- 172.21.15.123:0/1611920762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd60103410 0x7fcd60198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.289+0000 7fcd66028640 1 -- 172.21.15.123:0/1611920762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd60102a60 msgr2=0x7fcd60198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.289+0000 7fcd66028640 1 --2- 172.21.15.123:0/1611920762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd60102a60 0x7fcd60198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.289+0000 7fcd66028640 1 -- 172.21.15.123:0/1611920762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6019d300 con 0x7fcd60107fd0 2024-08-18T22:05:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.289+0000 7fcd65026640 1 --2- 172.21.15.123:0/1611920762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd60103410 0x7fcd60198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:05:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.289+0000 7fcd66028640 1 --2- 172.21.15.123:0/1611920762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd60107fd0 0x7fcd6019cc20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcd58005cc0 tx=0x7fcd58003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.289+0000 7fcd56ffd640 1 -- 172.21.15.123:0/1611920762 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd58031660 con 0x7fcd60107fd0 2024-08-18T22:05:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.289+0000 7fcd56ffd640 1 -- 172.21.15.123:0/1611920762 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd58031800 con 0x7fcd60107fd0 2024-08-18T22:05:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.289+0000 7fcd67a8b640 1 -- 172.21.15.123:0/1611920762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd6019d590 con 0x7fcd60107fd0 2024-08-18T22:05:33.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.289+0000 7fcd56ffd640 1 -- 172.21.15.123:0/1611920762 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5802fb50 con 0x7fcd60107fd0 2024-08-18T22:05:33.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.289+0000 7fcd67a8b640 1 -- 172.21.15.123:0/1611920762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd601a4ed0 con 0x7fcd60107fd0 2024-08-18T22:05:33.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.290+0000 7fcd67a8b640 1 -- 172.21.15.123:0/1611920762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd60102e40 con 0x7fcd60107fd0 2024-08-18T22:05:33.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.291+0000 7fcd56ffd640 1 -- 172.21.15.123:0/1611920762 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fcd5802fd10 con 0x7fcd60107fd0 2024-08-18T22:05:33.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.291+0000 7fcd56ffd640 1 --2- 172.21.15.123:0/1611920762 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcd4c0a2b80 0x7fcd4c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:33.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.292+0000 7fcd65827640 1 --2- 172.21.15.123:0/1611920762 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcd4c0a2b80 0x7fcd4c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:33.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.292+0000 7fcd56ffd640 1 -- 172.21.15.123:0/1611920762 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fcd580f0910 con 0x7fcd60107fd0 2024-08-18T22:05:33.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.292+0000 7fcd65827640 1 --2- 172.21.15.123:0/1611920762 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcd4c0a2b80 0x7fcd4c0a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00bbe0 tx=0x7fcd5c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:33.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.295+0000 7fcd56ffd640 1 -- 172.21.15.123:0/1611920762 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcd580bd6c0 con 0x7fcd60107fd0 2024-08-18T22:05:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:32 smithi183 ceph-mon[22097]: osdmap e88: 12 total, 12 up, 12 in 2024-08-18T22:05:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:32 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2890416402' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-18T22:05:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:32 smithi183 ceph-mon[22097]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-18T22:05:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.496+0000 7fcd67a8b640 1 -- 172.21.15.123:0/1611920762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd60109fe0 con 0x7fcd60107fd0 2024-08-18T22:05:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.496+0000 7fcd56ffd640 1 -- 172.21.15.123:0/1611920762 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11845 (secure 0 0 0) 0x7fcd580bcfc0 con 0x7fcd60107fd0 2024-08-18T22:05:33.498 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:05:33.498 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"btime":"2024-08-18T22:05:31:910740+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:05:31.553100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24466,"qdb_cluster":[24466]},"id":1}]} 2024-08-18T22:05:33.498 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-08-18T22:05:33.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.498+0000 7fcd67a8b640 1 -- 172.21.15.123:0/1611920762 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcd4c0a2b80 msgr2=0x7fcd4c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:33.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.498+0000 7fcd67a8b640 1 --2- 172.21.15.123:0/1611920762 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcd4c0a2b80 0x7fcd4c0a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00bbe0 tx=0x7fcd5c00b390 comp rx=0 tx=0).stop 2024-08-18T22:05:33.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.498+0000 7fcd67a8b640 1 -- 172.21.15.123:0/1611920762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd60107fd0 msgr2=0x7fcd6019cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:33.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.498+0000 7fcd67a8b640 1 --2- 172.21.15.123:0/1611920762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd60107fd0 0x7fcd6019cc20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcd58005cc0 tx=0x7fcd58003f90 comp rx=0 tx=0).stop 2024-08-18T22:05:33.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.499+0000 7fcd67a8b640 1 -- 172.21.15.123:0/1611920762 shutdown_connections 2024-08-18T22:05:33.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.499+0000 7fcd67a8b640 1 --2- 172.21.15.123:0/1611920762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd60107fd0 0x7fcd6019cc20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:33.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.499+0000 7fcd67a8b640 1 --2- 172.21.15.123:0/1611920762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd60103410 0x7fcd60198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:33.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.499+0000 7fcd67a8b640 1 --2- 172.21.15.123:0/1611920762 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcd4c0a2b80 0x7fcd4c0a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:33.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.499+0000 7fcd67a8b640 1 --2- 172.21.15.123:0/1611920762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd60102a60 0x7fcd60198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:33.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.499+0000 7fcd67a8b640 1 -- 172.21.15.123:0/1611920762 >> 172.21.15.123:0/1611920762 conn(0x7fcd600fc500 msgr2=0x7fcd601060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:33.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.499+0000 7fcd67a8b640 1 -- 172.21.15.123:0/1611920762 shutdown_connections 2024-08-18T22:05:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:33.499+0000 7fcd67a8b640 1 -- 172.21.15.123:0/1611920762 wait complete. 2024-08-18T22:05:34.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:33 smithi123 ceph-mon[18462]: pgmap v270: 129 pgs: 15 creating+peering, 114 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:34.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:33 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1611920762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:34.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:33 smithi130 ceph-mon[21698]: pgmap v270: 129 pgs: 15 creating+peering, 114 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:34.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:33 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1611920762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:34.378 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:05:34.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:33 smithi183 ceph-mon[22097]: pgmap v270: 129 pgs: 15 creating+peering, 114 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:34.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:33 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1611920762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:34.632 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:35.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:34 smithi123 ceph-mon[18462]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-18T22:05:35.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:34 smithi123 ceph-mon[18462]: Cluster is now healthy 2024-08-18T22:05:35.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.116+0000 7f2053933640 1 -- 172.21.15.123:0/1378154348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101150 msgr2=0x7f204c10d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:35.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.116+0000 7f2053933640 1 --2- 172.21.15.123:0/1378154348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101150 0x7f204c10d680 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f203c009cd0 tx=0x7f203c02a8e0 comp rx=0 tx=0).stop 2024-08-18T22:05:35.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.116+0000 7f2053933640 1 -- 172.21.15.123:0/1378154348 shutdown_connections 2024-08-18T22:05:35.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.116+0000 7f2053933640 1 --2- 172.21.15.123:0/1378154348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101150 0x7f204c10d680 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:35.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.116+0000 7f2053933640 1 --2- 172.21.15.123:0/1378154348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f204c1007b0 0x7f204c100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:35.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.116+0000 7f2053933640 1 --2- 172.21.15.123:0/1378154348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f204c1067b0 0x7f204c106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:35.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.116+0000 7f2053933640 1 -- 172.21.15.123:0/1378154348 >> 172.21.15.123:0/1378154348 conn(0x7f204c0fc4d0 msgr2=0x7f204c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:35.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.116+0000 7f2053933640 1 -- 172.21.15.123:0/1378154348 shutdown_connections 2024-08-18T22:05:35.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.116+0000 7f2053933640 1 -- 172.21.15.123:0/1378154348 wait complete. 2024-08-18T22:05:35.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.116+0000 7f2053933640 1 Processor -- start 2024-08-18T22:05:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.116+0000 7f2053933640 1 -- start start 2024-08-18T22:05:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2053933640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f204c1007b0 0x7f204c198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2053933640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101150 0x7f204c198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2053933640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f204c1067b0 0x7f204c19ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2053933640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f204c110bb0 con 0x7f204c101150 2024-08-18T22:05:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2053933640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f204c110a30 con 0x7f204c1007b0 2024-08-18T22:05:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2053933640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f204c110d30 con 0x7f204c1067b0 2024-08-18T22:05:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2050ece640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101150 0x7f204c198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2050ece640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101150 0x7f204c198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38216/0 (socket says 172.21.15.123:38216) 2024-08-18T22:05:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2050ece640 1 -- 172.21.15.123:0/3958601366 learned_addr learned my addr 172.21.15.123:0/3958601366 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2051ed0640 1 --2- 172.21.15.123:0/3958601366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f204c1067b0 0x7f204c19ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f20516cf640 1 --2- 172.21.15.123:0/3958601366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f204c1007b0 0x7f204c198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2050ece640 1 -- 172.21.15.123:0/3958601366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f204c1067b0 msgr2=0x7f204c19ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2050ece640 1 --2- 172.21.15.123:0/3958601366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f204c1067b0 0x7f204c19ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:35.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2050ece640 1 -- 172.21.15.123:0/3958601366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f204c1007b0 msgr2=0x7f204c198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:35.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2050ece640 1 --2- 172.21.15.123:0/3958601366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f204c1007b0 0x7f204c198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:35.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2050ece640 1 -- 172.21.15.123:0/3958601366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204c19d0f0 con 0x7f204c101150 2024-08-18T22:05:35.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2050ece640 1 --2- 172.21.15.123:0/3958601366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101150 0x7f204c198680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f204000c890 tx=0x7f204000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:35.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f204a7fc640 1 -- 172.21.15.123:0/3958601366 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2040004220 con 0x7f204c101150 2024-08-18T22:05:35.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2053933640 1 -- 172.21.15.123:0/3958601366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204c19d3e0 con 0x7f204c101150 2024-08-18T22:05:35.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f204a7fc640 1 -- 172.21.15.123:0/3958601366 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20400043c0 con 0x7f204c101150 2024-08-18T22:05:35.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f204a7fc640 1 -- 172.21.15.123:0/3958601366 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2040004a00 con 0x7f204c101150 2024-08-18T22:05:35.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.117+0000 7f2053933640 1 -- 172.21.15.123:0/3958601366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f204c1a4cc0 con 0x7f204c101150 2024-08-18T22:05:35.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.118+0000 7f2053933640 1 -- 172.21.15.123:0/3958601366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f204c100c10 con 0x7f204c101150 2024-08-18T22:05:35.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.120+0000 7f204a7fc640 1 -- 172.21.15.123:0/3958601366 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f20400079b0 con 0x7f204c101150 2024-08-18T22:05:35.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.120+0000 7f204a7fc640 1 --2- 172.21.15.123:0/3958601366 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f20340a2b80 0x7f20340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:35.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.120+0000 7f20516cf640 1 --2- 172.21.15.123:0/3958601366 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f20340a2b80 0x7f20340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:35.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.120+0000 7f204a7fc640 1 -- 172.21.15.123:0/3958601366 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f20400cf210 con 0x7f204c101150 2024-08-18T22:05:35.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.121+0000 7f20516cf640 1 --2- 172.21.15.123:0/3958601366 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f20340a2b80 0x7f20340a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2044009b50 tx=0x7f2044005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:35.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.124+0000 7f204a7fc640 1 -- 172.21.15.123:0/3958601366 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2040014030 con 0x7f204c101150 2024-08-18T22:05:35.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:34 smithi130 ceph-mon[21698]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-18T22:05:35.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:34 smithi130 ceph-mon[21698]: Cluster is now healthy 2024-08-18T22:05:35.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.291+0000 7f2053933640 1 -- 172.21.15.123:0/3958601366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f204c1994a0 con 0x7f204c101150 2024-08-18T22:05:35.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.294+0000 7f204a7fc640 1 -- 172.21.15.123:0/3958601366 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24188 (secure 0 0 0) 0x7f204c1994a0 con 0x7f204c101150 2024-08-18T22:05:35.296 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:05:35.296 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":88,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:05:31.552970+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:05:18.077632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:05:20.808463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:05:27.136662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:05:35.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.296+0000 7f2053933640 1 -- 172.21.15.123:0/3958601366 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f20340a2b80 msgr2=0x7f20340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:35.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.296+0000 7f2053933640 1 --2- 172.21.15.123:0/3958601366 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f20340a2b80 0x7f20340a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2044009b50 tx=0x7f2044005f90 comp rx=0 tx=0).stop 2024-08-18T22:05:35.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.296+0000 7f2053933640 1 -- 172.21.15.123:0/3958601366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101150 msgr2=0x7f204c198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:35.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.296+0000 7f2053933640 1 --2- 172.21.15.123:0/3958601366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101150 0x7f204c198680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f204000c890 tx=0x7f204000cd50 comp rx=0 tx=0).stop 2024-08-18T22:05:35.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.296+0000 7f2053933640 1 -- 172.21.15.123:0/3958601366 shutdown_connections 2024-08-18T22:05:35.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.296+0000 7f2053933640 1 --2- 172.21.15.123:0/3958601366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f204c1067b0 0x7f204c19ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:35.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.296+0000 7f2053933640 1 --2- 172.21.15.123:0/3958601366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f204c101150 0x7f204c198680 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:35.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.296+0000 7f2053933640 1 --2- 172.21.15.123:0/3958601366 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f20340a2b80 0x7f20340a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:35.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.296+0000 7f2053933640 1 --2- 172.21.15.123:0/3958601366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f204c1007b0 0x7f204c198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:35.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.296+0000 7f2053933640 1 -- 172.21.15.123:0/3958601366 >> 172.21.15.123:0/3958601366 conn(0x7f204c0fc4d0 msgr2=0x7f204c104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:35.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.296+0000 7f2053933640 1 -- 172.21.15.123:0/3958601366 shutdown_connections 2024-08-18T22:05:35.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:35.296+0000 7f2053933640 1 -- 172.21.15.123:0/3958601366 wait complete. 2024-08-18T22:05:35.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:34 smithi183 ceph-mon[22097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-18T22:05:35.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:34 smithi183 ceph-mon[22097]: Cluster is now healthy 2024-08-18T22:05:36.032 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:35 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3958601366' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:05:36.032 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:35 smithi123 ceph-mon[18462]: pgmap v271: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:36.034 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:05:36.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:35 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3958601366' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:05:36.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:35 smithi130 ceph-mon[21698]: pgmap v271: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:36.282 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:36.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:35 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3958601366' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:05:36.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:35 smithi183 ceph-mon[22097]: pgmap v271: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:36.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.787+0000 7ff24bfff640 1 -- 172.21.15.123:0/2250521468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff24c0ffc70 msgr2=0x7ff24c1000d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:36.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.787+0000 7ff24bfff640 1 --2- 172.21.15.123:0/2250521468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff24c0ffc70 0x7ff24c1000d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff234009930 tx=0x7ff23402a420 comp rx=0 tx=0).stop 2024-08-18T22:05:36.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.787+0000 7ff24bfff640 1 -- 172.21.15.123:0/2250521468 shutdown_connections 2024-08-18T22:05:36.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.787+0000 7ff24bfff640 1 --2- 172.21.15.123:0/2250521468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff24c100610 0x7ff24c10e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:36.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.787+0000 7ff24bfff640 1 --2- 172.21.15.123:0/2250521468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff24c0ffc70 0x7ff24c1000d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:36.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.787+0000 7ff24bfff640 1 --2- 172.21.15.123:0/2250521468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24c107780 0x7ff24c107b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:36.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.787+0000 7ff24bfff640 1 -- 172.21.15.123:0/2250521468 >> 172.21.15.123:0/2250521468 conn(0x7ff24c076da0 msgr2=0x7ff24c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.787+0000 7ff24bfff640 1 -- 172.21.15.123:0/2250521468 shutdown_connections 2024-08-18T22:05:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.787+0000 7ff24bfff640 1 -- 172.21.15.123:0/2250521468 wait complete. 2024-08-18T22:05:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.787+0000 7ff24bfff640 1 Processor -- start 2024-08-18T22:05:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24bfff640 1 -- start start 2024-08-18T22:05:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff24c0ffc70 0x7ff24c198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24bfff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff24c100610 0x7ff24c198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24c107780 0x7ff24c19c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24bfff640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c111ba0 con 0x7ff24c0ffc70 2024-08-18T22:05:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24bfff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c111a20 con 0x7ff24c107780 2024-08-18T22:05:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24bfff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c111d20 con 0x7ff24c100610 2024-08-18T22:05:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff24c0ffc70 0x7ff24c198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff24c0ffc70 0x7ff24c198120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38232/0 (socket says 172.21.15.123:38232) 2024-08-18T22:05:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24affd640 1 -- 172.21.15.123:0/3486054484 learned_addr learned my addr 172.21.15.123:0/3486054484 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24b7fe640 1 --2- 172.21.15.123:0/3486054484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24c107780 0x7ff24c19c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24a7fc640 1 --2- 172.21.15.123:0/3486054484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff24c100610 0x7ff24c198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24affd640 1 -- 172.21.15.123:0/3486054484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff24c100610 msgr2=0x7ff24c198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24affd640 1 --2- 172.21.15.123:0/3486054484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff24c100610 0x7ff24c198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24affd640 1 -- 172.21.15.123:0/3486054484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24c107780 msgr2=0x7ff24c19c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24affd640 1 --2- 172.21.15.123:0/3486054484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24c107780 0x7ff24c19c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24affd640 1 -- 172.21.15.123:0/3486054484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24c19d0d0 con 0x7ff24c0ffc70 2024-08-18T22:05:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.788+0000 7ff24b7fe640 1 --2- 172.21.15.123:0/3486054484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24c107780 0x7ff24c19c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:05:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.789+0000 7ff24affd640 1 --2- 172.21.15.123:0/3486054484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff24c0ffc70 0x7ff24c198120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff24400cce0 tx=0x7ff24400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.789+0000 7ff243fff640 1 -- 172.21.15.123:0/3486054484 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff244004b20 con 0x7ff24c0ffc70 2024-08-18T22:05:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.789+0000 7ff243fff640 1 -- 172.21.15.123:0/3486054484 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff244004cc0 con 0x7ff24c0ffc70 2024-08-18T22:05:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.789+0000 7ff24bfff640 1 -- 172.21.15.123:0/3486054484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff24c19d3c0 con 0x7ff24c0ffc70 2024-08-18T22:05:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.789+0000 7ff243fff640 1 -- 172.21.15.123:0/3486054484 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24400f7d0 con 0x7ff24c0ffc70 2024-08-18T22:05:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.789+0000 7ff24bfff640 1 -- 172.21.15.123:0/3486054484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff24c1a4ca0 con 0x7ff24c0ffc70 2024-08-18T22:05:36.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.790+0000 7ff24bfff640 1 -- 172.21.15.123:0/3486054484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff24c1000d0 con 0x7ff24c0ffc70 2024-08-18T22:05:36.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.791+0000 7ff243fff640 1 -- 172.21.15.123:0/3486054484 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7ff24400f970 con 0x7ff24c0ffc70 2024-08-18T22:05:36.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.791+0000 7ff243fff640 1 --2- 172.21.15.123:0/3486054484 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff2380a2b80 0x7ff2380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:36.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.792+0000 7ff24a7fc640 1 --2- 172.21.15.123:0/3486054484 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff2380a2b80 0x7ff2380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:36.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.792+0000 7ff243fff640 1 -- 172.21.15.123:0/3486054484 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7ff2440cf460 con 0x7ff24c0ffc70 2024-08-18T22:05:36.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.792+0000 7ff24a7fc640 1 --2- 172.21.15.123:0/3486054484 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff2380a2b80 0x7ff2380a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff234000c00 tx=0x7ff234031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:36.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.796+0000 7ff243fff640 1 -- 172.21.15.123:0/3486054484 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff244014030 con 0x7ff24c0ffc70 2024-08-18T22:05:36.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.967+0000 7ff24bfff640 1 -- 172.21.15.123:0/3486054484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff24c109d60 con 0x7ff24c0ffc70 2024-08-18T22:05:36.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.968+0000 7ff243fff640 1 -- 172.21.15.123:0/3486054484 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24188 (secure 0 0 0) 0x7ff24c109d60 con 0x7ff24c0ffc70 2024-08-18T22:05:36.970 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:05:36.971 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":88,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:05:31.552970+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:05:18.077632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:05:20.808463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:05:27.136662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:05:36.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.970+0000 7ff24bfff640 1 -- 172.21.15.123:0/3486054484 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff2380a2b80 msgr2=0x7ff2380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:36.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.970+0000 7ff24bfff640 1 --2- 172.21.15.123:0/3486054484 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff2380a2b80 0x7ff2380a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff234000c00 tx=0x7ff234031490 comp rx=0 tx=0).stop 2024-08-18T22:05:36.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.970+0000 7ff24bfff640 1 -- 172.21.15.123:0/3486054484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff24c0ffc70 msgr2=0x7ff24c198120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:36.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.970+0000 7ff24bfff640 1 --2- 172.21.15.123:0/3486054484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff24c0ffc70 0x7ff24c198120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff24400cce0 tx=0x7ff24400a620 comp rx=0 tx=0).stop 2024-08-18T22:05:36.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.970+0000 7ff24bfff640 1 -- 172.21.15.123:0/3486054484 shutdown_connections 2024-08-18T22:05:36.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.970+0000 7ff24bfff640 1 --2- 172.21.15.123:0/3486054484 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff2380a2b80 0x7ff2380a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:36.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.970+0000 7ff24bfff640 1 --2- 172.21.15.123:0/3486054484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24c107780 0x7ff24c19c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:36.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.970+0000 7ff24bfff640 1 --2- 172.21.15.123:0/3486054484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff24c100610 0x7ff24c198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:36.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.970+0000 7ff24bfff640 1 --2- 172.21.15.123:0/3486054484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff24c0ffc70 0x7ff24c198120 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:36.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.970+0000 7ff24bfff640 1 -- 172.21.15.123:0/3486054484 >> 172.21.15.123:0/3486054484 conn(0x7ff24c076da0 msgr2=0x7ff24c1045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:36.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.970+0000 7ff24bfff640 1 -- 172.21.15.123:0/3486054484 shutdown_connections 2024-08-18T22:05:36.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:36.970+0000 7ff24bfff640 1 -- 172.21.15.123:0/3486054484 wait complete. 2024-08-18T22:05:37.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:37 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3486054484' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:05:37.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:37 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3486054484' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:05:37.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:37 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3486054484' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:05:37.627 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:05:37.876 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:38.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:38 smithi123 ceph-mon[18462]: pgmap v272: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:38.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:38 smithi183 ceph-mon[22097]: pgmap v272: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:38.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.383+0000 7f62b61ca640 1 -- 172.21.15.123:0/1554857626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62b01067b0 msgr2=0x7f62b0106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:38.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.383+0000 7f62b61ca640 1 --2- 172.21.15.123:0/1554857626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62b01067b0 0x7f62b0106b90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009930 tx=0x7f62a002a420 comp rx=0 tx=0).stop 2024-08-18T22:05:38.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.383+0000 7f62b61ca640 1 -- 172.21.15.123:0/1554857626 shutdown_connections 2024-08-18T22:05:38.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.383+0000 7f62b61ca640 1 --2- 172.21.15.123:0/1554857626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62b0101150 0x7f62b010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:38.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.383+0000 7f62b61ca640 1 --2- 172.21.15.123:0/1554857626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62b01007b0 0x7f62b0100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:38.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.383+0000 7f62b61ca640 1 --2- 172.21.15.123:0/1554857626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62b01067b0 0x7f62b0106b90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:38.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.383+0000 7f62b61ca640 1 -- 172.21.15.123:0/1554857626 >> 172.21.15.123:0/1554857626 conn(0x7f62b00fc4d0 msgr2=0x7f62b00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:38.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.383+0000 7f62b61ca640 1 -- 172.21.15.123:0/1554857626 shutdown_connections 2024-08-18T22:05:38.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.383+0000 7f62b61ca640 1 -- 172.21.15.123:0/1554857626 wait complete. 2024-08-18T22:05:38.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.383+0000 7f62b61ca640 1 Processor -- start 2024-08-18T22:05:38.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.383+0000 7f62b61ca640 1 -- start start 2024-08-18T22:05:38.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62b61ca640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62b01007b0 0x7f62b0199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:38.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62b61ca640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62b0101150 0x7f62b0199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:38.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62b61ca640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62b01067b0 0x7f62b01a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:38.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62b61ca640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f62b0110bd0 con 0x7f62b0101150 2024-08-18T22:05:38.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62b61ca640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f62b0110a50 con 0x7f62b01007b0 2024-08-18T22:05:38.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62b61ca640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f62b0110d50 con 0x7f62b01067b0 2024-08-18T22:05:38.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62aeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62b0101150 0x7f62b0199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:38.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62aeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62b0101150 0x7f62b0199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38248/0 (socket says 172.21.15.123:38248) 2024-08-18T22:05:38.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62aeffd640 1 -- 172.21.15.123:0/417295824 learned_addr learned my addr 172.21.15.123:0/417295824 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:38.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62af7fe640 1 --2- 172.21.15.123:0/417295824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62b01007b0 0x7f62b0199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:38.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62affff640 1 --2- 172.21.15.123:0/417295824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62b01067b0 0x7f62b01a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:38.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62aeffd640 1 -- 172.21.15.123:0/417295824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62b01067b0 msgr2=0x7f62b01a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:38.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62aeffd640 1 --2- 172.21.15.123:0/417295824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62b01067b0 0x7f62b01a40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:38.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62aeffd640 1 -- 172.21.15.123:0/417295824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62b01007b0 msgr2=0x7f62b0199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:38.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62aeffd640 1 --2- 172.21.15.123:0/417295824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62b01007b0 0x7f62b0199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:38.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62aeffd640 1 -- 172.21.15.123:0/417295824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b01a45e0 con 0x7f62b0101150 2024-08-18T22:05:38.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62affff640 1 --2- 172.21.15.123:0/417295824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62b01067b0 0x7f62b01a40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:05:38.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62aeffd640 1 --2- 172.21.15.123:0/417295824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62b0101150 0x7f62b0199560 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f629800b4a0 tx=0x7f629800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:38.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62acff9640 1 -- 172.21.15.123:0/417295824 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6298014070 con 0x7f62b0101150 2024-08-18T22:05:38.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62acff9640 1 -- 172.21.15.123:0/417295824 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6298010af0 con 0x7f62b0101150 2024-08-18T22:05:38.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62b61ca640 1 -- 172.21.15.123:0/417295824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b01a47b0 con 0x7f62b0101150 2024-08-18T22:05:38.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62acff9640 1 -- 172.21.15.123:0/417295824 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6298017d10 con 0x7f62b0101150 2024-08-18T22:05:38.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.384+0000 7f62b61ca640 1 -- 172.21.15.123:0/417295824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b01a4c70 con 0x7f62b0101150 2024-08-18T22:05:38.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.385+0000 7f62b61ca640 1 -- 172.21.15.123:0/417295824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62b0100c10 con 0x7f62b0101150 2024-08-18T22:05:38.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.387+0000 7f62acff9640 1 -- 172.21.15.123:0/417295824 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6298017070 con 0x7f62b0101150 2024-08-18T22:05:38.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.387+0000 7f62acff9640 1 --2- 172.21.15.123:0/417295824 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f629c0a2b80 0x7f629c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:38.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.387+0000 7f62af7fe640 1 --2- 172.21.15.123:0/417295824 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f629c0a2b80 0x7f629c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:38.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.387+0000 7f62acff9640 1 -- 172.21.15.123:0/417295824 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f62980cea60 con 0x7f62b0101150 2024-08-18T22:05:38.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.388+0000 7f62af7fe640 1 --2- 172.21.15.123:0/417295824 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f629c0a2b80 0x7f629c0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009900 tx=0x7f62a00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:38.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.390+0000 7f62acff9640 1 -- 172.21.15.123:0/417295824 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f629809b780 con 0x7f62b0101150 2024-08-18T22:05:38.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:38 smithi130 ceph-mon[21698]: pgmap v272: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:38.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.590+0000 7f62b61ca640 1 -- 172.21.15.123:0/417295824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62b006aab0 con 0x7f62b0101150 2024-08-18T22:05:38.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.591+0000 7f62acff9640 1 -- 172.21.15.123:0/417295824 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11845 (secure 0 0 0) 0x7f62b006aab0 con 0x7f62b0101150 2024-08-18T22:05:38.592 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:05:38.592 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"btime":"2024-08-18T22:05:31:910740+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:05:31.553100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24466,"qdb_cluster":[24466]},"id":1}]} 2024-08-18T22:05:38.592 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-08-18T22:05:38.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.593+0000 7f62b61ca640 1 -- 172.21.15.123:0/417295824 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f629c0a2b80 msgr2=0x7f629c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:38.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.593+0000 7f62b61ca640 1 --2- 172.21.15.123:0/417295824 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f629c0a2b80 0x7f629c0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009900 tx=0x7f62a00058d0 comp rx=0 tx=0).stop 2024-08-18T22:05:38.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.593+0000 7f62b61ca640 1 -- 172.21.15.123:0/417295824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62b0101150 msgr2=0x7f62b0199560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:38.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.593+0000 7f62b61ca640 1 --2- 172.21.15.123:0/417295824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62b0101150 0x7f62b0199560 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f629800b4a0 tx=0x7f629800b960 comp rx=0 tx=0).stop 2024-08-18T22:05:38.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.593+0000 7f62b61ca640 1 -- 172.21.15.123:0/417295824 shutdown_connections 2024-08-18T22:05:38.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.593+0000 7f62b61ca640 1 --2- 172.21.15.123:0/417295824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62b01067b0 0x7f62b01a40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:38.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.593+0000 7f62b61ca640 1 --2- 172.21.15.123:0/417295824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62b0101150 0x7f62b0199560 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:38.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.593+0000 7f62b61ca640 1 --2- 172.21.15.123:0/417295824 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f629c0a2b80 0x7f629c0a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:38.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.593+0000 7f62b61ca640 1 --2- 172.21.15.123:0/417295824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62b01007b0 0x7f62b0199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:38.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.593+0000 7f62b61ca640 1 -- 172.21.15.123:0/417295824 >> 172.21.15.123:0/417295824 conn(0x7f62b00fc4d0 msgr2=0x7f62b00fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:38.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.593+0000 7f62b61ca640 1 -- 172.21.15.123:0/417295824 shutdown_connections 2024-08-18T22:05:38.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:38.593+0000 7f62b61ca640 1 -- 172.21.15.123:0/417295824 wait complete. 2024-08-18T22:05:39.224 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:39 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/417295824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:39.251 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:05:39.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:39 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/417295824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:39.501 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:39.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:39 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/417295824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:05:40.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.015+0000 7f359f68b640 1 -- 172.21.15.123:0/1158205509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35981067b0 msgr2=0x7f3598106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:40.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.015+0000 7f359f68b640 1 --2- 172.21.15.123:0/1158205509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35981067b0 0x7f3598106b90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f358c009930 tx=0x7f358c02a420 comp rx=0 tx=0).stop 2024-08-18T22:05:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.015+0000 7f359f68b640 1 -- 172.21.15.123:0/1158205509 shutdown_connections 2024-08-18T22:05:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.015+0000 7f359f68b640 1 --2- 172.21.15.123:0/1158205509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3598101150 0x7f359810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.015+0000 7f359f68b640 1 --2- 172.21.15.123:0/1158205509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35981007b0 0x7f3598100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.015+0000 7f359f68b640 1 --2- 172.21.15.123:0/1158205509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35981067b0 0x7f3598106b90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.015+0000 7f359f68b640 1 -- 172.21.15.123:0/1158205509 >> 172.21.15.123:0/1158205509 conn(0x7f35980fc4d0 msgr2=0x7f35980fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.015+0000 7f359f68b640 1 -- 172.21.15.123:0/1158205509 shutdown_connections 2024-08-18T22:05:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.015+0000 7f359f68b640 1 -- 172.21.15.123:0/1158205509 wait complete. 2024-08-18T22:05:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.015+0000 7f359f68b640 1 Processor -- start 2024-08-18T22:05:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359f68b640 1 -- start start 2024-08-18T22:05:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359f68b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35981007b0 0x7f359810e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359f68b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3598101150 0x7f359810e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359f68b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35981067b0 0x7f359810eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359f68b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3598111cd0 con 0x7f35981007b0 2024-08-18T22:05:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359f68b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3598111b50 con 0x7f35981067b0 2024-08-18T22:05:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359f68b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3598111e50 con 0x7f3598101150 2024-08-18T22:05:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359d427640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35981007b0 0x7f359810e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359d427640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35981007b0 0x7f359810e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38270/0 (socket says 172.21.15.123:38270) 2024-08-18T22:05:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359d427640 1 -- 172.21.15.123:0/2234246580 learned_addr learned my addr 172.21.15.123:0/2234246580 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359d427640 1 -- 172.21.15.123:0/2234246580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3598101150 msgr2=0x7f359810e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359dc28640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35981067b0 0x7f359810eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359cc26640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3598101150 0x7f359810e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359d427640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3598101150 0x7f359810e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359d427640 1 -- 172.21.15.123:0/2234246580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35981067b0 msgr2=0x7f359810eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359d427640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35981067b0 0x7f359810eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359d427640 1 -- 172.21.15.123:0/2234246580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35981a66b0 con 0x7f35981007b0 2024-08-18T22:05:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359dc28640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35981067b0 0x7f359810eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:05:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359cc26640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3598101150 0x7f359810e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:05:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359d427640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35981007b0 0x7f359810e110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f358c009a50 tx=0x7f358c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f358a7fc640 1 -- 172.21.15.123:0/2234246580 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c03f030 con 0x7f35981007b0 2024-08-18T22:05:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f359f68b640 1 -- 172.21.15.123:0/2234246580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35981a6940 con 0x7f35981007b0 2024-08-18T22:05:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.016+0000 7f358a7fc640 1 -- 172.21.15.123:0/2234246580 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f358c003ce0 con 0x7f35981007b0 2024-08-18T22:05:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.017+0000 7f358a7fc640 1 -- 172.21.15.123:0/2234246580 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c035070 con 0x7f35981007b0 2024-08-18T22:05:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.017+0000 7f359f68b640 1 -- 172.21.15.123:0/2234246580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35981a6e70 con 0x7f35981007b0 2024-08-18T22:05:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.018+0000 7f359f68b640 1 -- 172.21.15.123:0/2234246580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3598100c10 con 0x7f35981007b0 2024-08-18T22:05:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.019+0000 7f358a7fc640 1 -- 172.21.15.123:0/2234246580 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f358c042030 con 0x7f35981007b0 2024-08-18T22:05:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.019+0000 7f358a7fc640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f35840a2b80 0x7f35840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:40.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.019+0000 7f359cc26640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f35840a2b80 0x7f35840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:40.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.019+0000 7f358a7fc640 1 -- 172.21.15.123:0/2234246580 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f358c0ef8c0 con 0x7f35981007b0 2024-08-18T22:05:40.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.020+0000 7f359cc26640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f35840a2b80 0x7f35840a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f359810fba0 tx=0x7f3594005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:40.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.023+0000 7f358a7fc640 1 -- 172.21.15.123:0/2234246580 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f358c0bc5e0 con 0x7f35981007b0 2024-08-18T22:05:40.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.194+0000 7f359f68b640 1 -- 172.21.15.123:0/2234246580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3598108d20 con 0x7f35981007b0 2024-08-18T22:05:40.195 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:40 smithi123 ceph-mon[18462]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:40.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.196+0000 7f358a7fc640 1 -- 172.21.15.123:0/2234246580 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24188 (secure 0 0 0) 0x7f358c0bbee0 con 0x7f35981007b0 2024-08-18T22:05:40.197 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:05:40.197 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":88,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:05:31.552970+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:05:18.077632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:05:20.808463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:05:27.136662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:05:40.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.199+0000 7f359f68b640 1 -- 172.21.15.123:0/2234246580 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f35840a2b80 msgr2=0x7f35840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:40.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.199+0000 7f359f68b640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f35840a2b80 0x7f35840a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f359810fba0 tx=0x7f3594005d30 comp rx=0 tx=0).stop 2024-08-18T22:05:40.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.199+0000 7f359f68b640 1 -- 172.21.15.123:0/2234246580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35981007b0 msgr2=0x7f359810e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:40.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.199+0000 7f359f68b640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35981007b0 0x7f359810e110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f358c009a50 tx=0x7f358c004270 comp rx=0 tx=0).stop 2024-08-18T22:05:40.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.199+0000 7f359f68b640 1 -- 172.21.15.123:0/2234246580 shutdown_connections 2024-08-18T22:05:40.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.199+0000 7f359f68b640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f35840a2b80 0x7f35840a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:40.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.199+0000 7f359f68b640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35981067b0 0x7f359810eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:40.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.199+0000 7f359f68b640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3598101150 0x7f359810e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:40.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.199+0000 7f359f68b640 1 --2- 172.21.15.123:0/2234246580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35981007b0 0x7f359810e110 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:40.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.199+0000 7f359f68b640 1 -- 172.21.15.123:0/2234246580 >> 172.21.15.123:0/2234246580 conn(0x7f35980fc4d0 msgr2=0x7f35980fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:40.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.199+0000 7f359f68b640 1 -- 172.21.15.123:0/2234246580 shutdown_connections 2024-08-18T22:05:40.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:40.199+0000 7f359f68b640 1 -- 172.21.15.123:0/2234246580 wait complete. 2024-08-18T22:05:40.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:40 smithi183 ceph-mon[22097]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:40.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:40 smithi130 ceph-mon[21698]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:40.829 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:05:22.597053+0000', 'modified': '2024-08-18T22:05:31.553100+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24466}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.183:6839/1902275683', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6838', 'nonce': 1902275683}, {'type': 'v1', 'addr': '172.21.15.183:6839', 'nonce': 1902275683}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24466, 'qdb_cluster': [24466]} 2024-08-18T22:05:40.829 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:05:40.830 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.i status 2024-08-18T22:05:41.078 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:41.298 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:41 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2234246580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:05:41.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:41 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2234246580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:05:41.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:41 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2234246580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:05:41.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.542+0000 7f1da344f640 1 -- 172.21.15.123:0/1032379331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d9c10e0f0 msgr2=0x7f1d9c110540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:41.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.542+0000 7f1da344f640 1 --2- 172.21.15.123:0/1032379331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d9c10e0f0 0x7f1d9c110540 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009ca0 tx=0x7f1d8c02a950 comp rx=0 tx=0).stop 2024-08-18T22:05:41.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.542+0000 7f1da344f640 1 -- 172.21.15.123:0/1032379331 shutdown_connections 2024-08-18T22:05:41.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.542+0000 7f1da344f640 1 --2- 172.21.15.123:0/1032379331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d9c10e0f0 0x7f1d9c110540 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.542+0000 7f1da344f640 1 --2- 172.21.15.123:0/1032379331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d9c074c70 0x7f1d9c10dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.542+0000 7f1da344f640 1 --2- 172.21.15.123:0/1032379331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d9c074350 0x7f1d9c074730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.542+0000 7f1da344f640 1 -- 172.21.15.123:0/1032379331 >> 172.21.15.123:0/1032379331 conn(0x7f1d9c0fd5f0 msgr2=0x7f1d9c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:41.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.543+0000 7f1da344f640 1 -- 172.21.15.123:0/1032379331 shutdown_connections 2024-08-18T22:05:41.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.543+0000 7f1da344f640 1 -- 172.21.15.123:0/1032379331 wait complete. 2024-08-18T22:05:41.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.543+0000 7f1da344f640 1 Processor -- start 2024-08-18T22:05:41.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.543+0000 7f1da344f640 1 -- start start 2024-08-18T22:05:41.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.543+0000 7f1da344f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d9c074350 0x7f1d9c19a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.543+0000 7f1da344f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d9c074c70 0x7f1d9c19a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.543+0000 7f1da344f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d9c10e0f0 0x7f1d9c19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.543+0000 7f1da344f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9c113e80 con 0x7f1d9c074c70 2024-08-18T22:05:41.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.543+0000 7f1da344f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9c113d00 con 0x7f1d9c074350 2024-08-18T22:05:41.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.543+0000 7f1da344f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9c114000 con 0x7f1d9c10e0f0 2024-08-18T22:05:41.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.543+0000 7f1da09ea640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d9c074c70 0x7f1d9c19a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.544+0000 7f1da09ea640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d9c074c70 0x7f1d9c19a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38286/0 (socket says 172.21.15.123:38286) 2024-08-18T22:05:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.544+0000 7f1da09ea640 1 -- 172.21.15.123:0/3208589520 learned_addr learned my addr 172.21.15.123:0/3208589520 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.544+0000 7f1da11eb640 1 --2- 172.21.15.123:0/3208589520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d9c074350 0x7f1d9c19a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.544+0000 7f1da19ec640 1 --2- 172.21.15.123:0/3208589520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d9c10e0f0 0x7f1d9c19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.544+0000 7f1da09ea640 1 -- 172.21.15.123:0/3208589520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d9c10e0f0 msgr2=0x7f1d9c19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.544+0000 7f1da09ea640 1 --2- 172.21.15.123:0/3208589520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d9c10e0f0 0x7f1d9c19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.544+0000 7f1da09ea640 1 -- 172.21.15.123:0/3208589520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d9c074350 msgr2=0x7f1d9c19a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.544+0000 7f1da09ea640 1 --2- 172.21.15.123:0/3208589520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d9c074350 0x7f1d9c19a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.544+0000 7f1da09ea640 1 -- 172.21.15.123:0/3208589520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d9c19f2c0 con 0x7f1d9c074c70 2024-08-18T22:05:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.544+0000 7f1da09ea640 1 --2- 172.21.15.123:0/3208589520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d9c074c70 0x7f1d9c19a850 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000d770 tx=0x7f1d9000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.544+0000 7f1d9a7fc640 1 -- 172.21.15.123:0/3208589520 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d90017070 con 0x7f1d9c074c70 2024-08-18T22:05:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.544+0000 7f1da344f640 1 -- 172.21.15.123:0/3208589520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d9c19f5b0 con 0x7f1d9c074c70 2024-08-18T22:05:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.544+0000 7f1d9a7fc640 1 -- 172.21.15.123:0/3208589520 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d90005500 con 0x7f1d9c074c70 2024-08-18T22:05:41.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.544+0000 7f1d9a7fc640 1 -- 172.21.15.123:0/3208589520 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d90004e00 con 0x7f1d9c074c70 2024-08-18T22:05:41.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.544+0000 7f1da344f640 1 -- 172.21.15.123:0/3208589520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d9c1a6e90 con 0x7f1d9c074c70 2024-08-18T22:05:41.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.547+0000 7f1d9a7fc640 1 -- 172.21.15.123:0/3208589520 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f1d90004fa0 con 0x7f1d9c074c70 2024-08-18T22:05:41.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.547+0000 7f1da584d740 1 Processor -- start 2024-08-18T22:05:41.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.547+0000 7f1da584d740 1 -- start start 2024-08-18T22:05:41.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da584d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9d88a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da584d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9d932d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da584d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d95c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da584d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d9b9ced710 con 0x55d9b9d93810 2024-08-18T22:05:41.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da584d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d9b9c85770 con 0x55d9b9d88f50 2024-08-18T22:05:41.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da584d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d9b9ce96d0 con 0x55d9b9d88630 2024-08-18T22:05:41.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1d9a7fc640 1 --2- 172.21.15.123:0/3208589520 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d840a2b80 0x7f1d840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da09ea640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d95c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da19ec640 1 --2- 172.21.15.123:0/3208589520 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d840a2b80 0x7f1d840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da09ea640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d95c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38298/0 (socket says 172.21.15.123:38298) 2024-08-18T22:05:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da09ea640 1 -- 172.21.15.123:0/3389236913 learned_addr learned my addr 172.21.15.123:0/3389236913 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da11eb640 1 --2- 172.21.15.123:0/3389236913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9d932d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da19ec640 1 --2- 172.21.15.123:0/3389236913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9d88a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1d9a7fc640 1 -- 172.21.15.123:0/3208589520 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f1d900cecf0 con 0x7f1d9c074c70 2024-08-18T22:05:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da09ea640 1 -- 172.21.15.123:0/3389236913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 msgr2=0x55d9b9d88a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:05:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da09ea640 1 --2- 172.21.15.123:0/3389236913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9d88a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da09ea640 1 -- 172.21.15.123:0/3389236913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 msgr2=0x55d9b9d932d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:05:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da09ea640 1 --2- 172.21.15.123:0/3389236913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9d932d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da09ea640 1 -- 172.21.15.123:0/3389236913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b9c8c3e0 con 0x55d9b9d93810 2024-08-18T22:05:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da19ec640 1 --2- 172.21.15.123:0/3389236913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9d88a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:05:41.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.548+0000 7f1da09ea640 1 --2- 172.21.15.123:0/3389236913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d95c00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d900a3a50 tx=0x7f1d9001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86bdf4a4271af929 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:41.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.549+0000 7f1da19ec640 1 --2- 172.21.15.123:0/3208589520 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d840a2b80 0x7f1d840a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c005e30 tx=0x7f1d8c005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:41.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.549+0000 7f1d837fe640 1 -- 172.21.15.123:0/3389236913 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d90020030 con 0x55d9b9d93810 2024-08-18T22:05:41.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.549+0000 7f1d837fe640 1 -- 172.21.15.123:0/3389236913 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d900046c0 con 0x55d9b9d93810 2024-08-18T22:05:41.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.549+0000 7f1d837fe640 1 -- 172.21.15.123:0/3389236913 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d90099610 con 0x55d9b9d93810 2024-08-18T22:05:41.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.549+0000 7f1da584d740 1 -- 172.21.15.123:0/3389236913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 msgr2=0x55d9b9d95c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:41.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.549+0000 7f1da584d740 1 --2- 172.21.15.123:0/3389236913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d95c00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d900a3a50 tx=0x7f1d9001e000 comp rx=0 tx=0).stop 2024-08-18T22:05:41.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.549+0000 7f1da584d740 1 -- 172.21.15.123:0/3389236913 shutdown_connections 2024-08-18T22:05:41.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.549+0000 7f1da584d740 1 --2- 172.21.15.123:0/3389236913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d95c00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da584d740 1 --2- 172.21.15.123:0/3389236913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9d932d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da584d740 1 --2- 172.21.15.123:0/3389236913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9d88a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da584d740 1 -- 172.21.15.123:0/3389236913 >> 172.21.15.123:0/3389236913 conn(0x55d9b9d84bc0 msgr2=0x55d9b9d84fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:41.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da584d740 1 -- 172.21.15.123:0/3389236913 shutdown_connections 2024-08-18T22:05:41.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da584d740 1 -- 172.21.15.123:0/3389236913 wait complete. 2024-08-18T22:05:41.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da584d740 1 -- start start 2024-08-18T22:05:41.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da584d740 1 Processor -- start 2024-08-18T22:05:41.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da584d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9d90740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da584d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9d90c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da584d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d911c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da584d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d9b9d963e0 con 0x55d9b9d93810 2024-08-18T22:05:41.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da584d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d9b9ca8970 con 0x55d9b9d88f50 2024-08-18T22:05:41.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da584d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d9b9d96560 con 0x55d9b9d88630 2024-08-18T22:05:41.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da584d740 10 client.0 _ll_register_callbacks cb 0x55d9b99fc7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:05:41.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da19ec640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d911c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da19ec640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d911c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38310/0 (socket says 172.21.15.123:38310) 2024-08-18T22:05:41.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.550+0000 7f1da19ec640 1 -- 172.21.15.123:0/2333480606 learned_addr learned my addr 172.21.15.123:0/2333480606 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:41.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1da11eb640 1 --2- 172.21.15.123:0/2333480606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9d90740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1da09ea640 1 --2- 172.21.15.123:0/2333480606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9d90c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1da19ec640 1 -- 172.21.15.123:0/2333480606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 msgr2=0x55d9b9d90740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:05:41.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1da19ec640 1 --2- 172.21.15.123:0/2333480606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9d90740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1da19ec640 1 -- 172.21.15.123:0/2333480606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 msgr2=0x55d9b9d90c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:05:41.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1da19ec640 1 --2- 172.21.15.123:0/2333480606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9d90c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1da19ec640 1 -- 172.21.15.123:0/2333480606 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9b9a5f2b0 con 0x55d9b9d93810 2024-08-18T22:05:41.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1da11eb640 1 --2- 172.21.15.123:0/2333480606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9d90740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:05:41.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1da19ec640 1 --2- 172.21.15.123:0/2333480606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d911c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c005f20 tx=0x7f1d8c02a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b8d756f5a07a73 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:41.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1d80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:05:41.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1d80ff9640 1 -- 172.21.15.123:0/2333480606 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c04e030 con 0x55d9b9d93810 2024-08-18T22:05:41.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1d80ff9640 1 -- 172.21.15.123:0/2333480606 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f1d8c044070 con 0x55d9b9d93810 2024-08-18T22:05:41.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1da584d740 1 -- 172.21.15.123:0/2333480606 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d9b9cfac80 con 0x55d9b9d93810 2024-08-18T22:05:41.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1d80ff9640 1 -- 172.21.15.123:0/2333480606 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f1d8c034040 con 0x55d9b9d93810 2024-08-18T22:05:41.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1da584d740 10 client.14688 fetch_fsmap learned FSMap version 17 2024-08-18T22:05:41.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1da584d740 1 -- 172.21.15.123:0/2333480606 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55d9b9da2020 con 0x55d9b9d93810 2024-08-18T22:05:41.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.551+0000 7f1d80ff9640 1 -- 172.21.15.123:0/2333480606 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d9b9cfac80 con 0x55d9b9d93810 2024-08-18T22:05:41.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.552+0000 7f1d80ff9640 1 -- 172.21.15.123:0/2333480606 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f1d8c047050 con 0x55d9b9d93810 2024-08-18T22:05:41.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.552+0000 7f1da584d740 10 client.14688 fetch_fsmap finished waiting for FSMap version 17 2024-08-18T22:05:41.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.552+0000 7f1da584d740 10 client.14688 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-18T22:05:41.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.552+0000 7f1da584d740 20 client.14688 populate_metadata read hostname 'smithi123' 2024-08-18T22:05:41.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.552+0000 7f1da584d740 1 --2- 172.21.15.123:0/2333480606 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d9b9da46c0 0x55d9b9da5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.552+0000 7f1da584d740 4 client.14688 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:05:41.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.552+0000 7f1da584d740 1 -- 172.21.15.123:0/2333480606 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9b9cf5190 con 0x55d9b9da46c0 2024-08-18T22:05:41.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.552+0000 7f1da11eb640 1 --2- 172.21.15.123:0/2333480606 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d9b9da46c0 0x55d9b9da5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.552+0000 7f1da11eb640 1 --2- 172.21.15.123:0/2333480606 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d9b9da46c0 0x55d9b9da5b30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a3f8a5e9a2f063a server_cookie=815bba12d4bd9114 in_seq=0 out_seq=0 2024-08-18T22:05:41.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.552+0000 7f1d80ff9640 10 client.14688 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:05:41.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.553+0000 7f1d80ff9640 1 -- 172.21.15.123:0/2333480606 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d9b9cf5190 con 0x55d9b9da46c0 2024-08-18T22:05:41.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.553+0000 7f1d80ff9640 10 client.14688 handle_command_reply: tid=0 2024-08-18T22:05:41.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.553+0000 7f1da584d740 1 client.14688 shutdown 2024-08-18T22:05:41.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.554+0000 7f1da584d740 1 -- 172.21.15.123:0/2333480606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 msgr2=0x55d9b9d911c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:41.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.554+0000 7f1da584d740 1 --2- 172.21.15.123:0/2333480606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d911c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c005f20 tx=0x7f1d8c02a950 comp rx=0 tx=0).stop 2024-08-18T22:05:41.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.554+0000 7f1da584d740 1 -- 172.21.15.123:0/2333480606 shutdown_connections 2024-08-18T22:05:41.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.554+0000 7f1da584d740 1 --2- 172.21.15.123:0/2333480606 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d9b9da46c0 0x55d9b9da5b30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.554+0000 7f1da584d740 1 --2- 172.21.15.123:0/2333480606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d911c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.554+0000 7f1da584d740 1 --2- 172.21.15.123:0/2333480606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9d90c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.554+0000 7f1d80ff9640 0 client.14688 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:05:41.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.554+0000 7f1da584d740 1 --2- 172.21.15.123:0/2333480606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9d90740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.554+0000 7f1da584d740 1 -- 172.21.15.123:0/2333480606 >> 172.21.15.123:0/2333480606 conn(0x55d9b9d84bc0 msgr2=0x55d9b9d8a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:41.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.554+0000 7f1da584d740 1 -- 172.21.15.123:0/2333480606 shutdown_connections 2024-08-18T22:05:41.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.554+0000 7f1da584d740 1 -- 172.21.15.123:0/2333480606 wait complete. 2024-08-18T22:05:41.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.554+0000 7f1da584d740 20 client.14688 trim_cache size 0 max 16384 2024-08-18T22:05:41.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da584d740 1 Processor -- start 2024-08-18T22:05:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da584d740 1 -- start start 2024-08-18T22:05:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da584d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9da5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da584d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9d8f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da584d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d8f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da584d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d9b9da3e70 con 0x55d9b9d93810 2024-08-18T22:05:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da584d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d9b9da4540 con 0x55d9b9d88f50 2024-08-18T22:05:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da584d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d9b9da4c10 con 0x55d9b9d88630 2024-08-18T22:05:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da19ec640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d8f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da19ec640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d8f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38322/0 (socket says 172.21.15.123:38322) 2024-08-18T22:05:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da19ec640 1 -- 172.21.15.123:0/3338807034 learned_addr learned my addr 172.21.15.123:0/3338807034 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da11eb640 1 --2- 172.21.15.123:0/3338807034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9da5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da09ea640 1 --2- 172.21.15.123:0/3338807034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9d8f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da19ec640 1 -- 172.21.15.123:0/3338807034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 msgr2=0x55d9b9da5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:05:41.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da19ec640 1 --2- 172.21.15.123:0/3338807034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9da5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da19ec640 1 -- 172.21.15.123:0/3338807034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 msgr2=0x55d9b9d8f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:05:41.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da19ec640 1 --2- 172.21.15.123:0/3338807034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9d8f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da19ec640 1 -- 172.21.15.123:0/3338807034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b9d80130 con 0x55d9b9d93810 2024-08-18T22:05:41.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.572+0000 7f1da19ec640 1 --2- 172.21.15.123:0/3338807034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d8f550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c005ef0 tx=0x7f1d8c003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2870ea90f8acadb2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:41.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.573+0000 7f1d82ffd640 1 -- 172.21.15.123:0/3338807034 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c04e020 con 0x55d9b9d93810 2024-08-18T22:05:41.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.573+0000 7f1d82ffd640 1 -- 172.21.15.123:0/3338807034 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d8c02fb70 con 0x55d9b9d93810 2024-08-18T22:05:41.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.573+0000 7f1d82ffd640 1 -- 172.21.15.123:0/3338807034 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0307b0 con 0x55d9b9d93810 2024-08-18T22:05:41.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.573+0000 7f1da584d740 1 -- 172.21.15.123:0/3338807034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 msgr2=0x55d9b9d8f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:41.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.573+0000 7f1da584d740 1 --2- 172.21.15.123:0/3338807034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d8f550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c005ef0 tx=0x7f1d8c003e00 comp rx=0 tx=0).stop 2024-08-18T22:05:41.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.573+0000 7f1da584d740 1 -- 172.21.15.123:0/3338807034 shutdown_connections 2024-08-18T22:05:41.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.573+0000 7f1da584d740 1 --2- 172.21.15.123:0/3338807034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9d8f550 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.573+0000 7f1da584d740 1 --2- 172.21.15.123:0/3338807034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9d8f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.573+0000 7f1da584d740 1 --2- 172.21.15.123:0/3338807034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9da5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.573+0000 7f1da584d740 1 -- 172.21.15.123:0/3338807034 >> 172.21.15.123:0/3338807034 conn(0x55d9b9d84bc0 msgr2=0x55d9b9d8ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:41.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.573+0000 7f1da584d740 1 -- 172.21.15.123:0/3338807034 shutdown_connections 2024-08-18T22:05:41.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.573+0000 7f1da584d740 1 -- 172.21.15.123:0/3338807034 wait complete. 2024-08-18T22:05:41.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.574+0000 7f1da584d740 1 -- start start 2024-08-18T22:05:41.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.574+0000 7f1da584d740 1 Processor -- start 2024-08-18T22:05:41.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.574+0000 7f1da584d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9dae310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.574+0000 7f1da584d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9da7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.574+0000 7f1da584d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9da8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.574+0000 7f1da584d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d9b9da59b0 con 0x55d9b9d93810 2024-08-18T22:05:41.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.574+0000 7f1da584d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d9b9da52e0 con 0x55d9b9d88f50 2024-08-18T22:05:41.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.574+0000 7f1da584d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d9b9da6080 con 0x55d9b9d88630 2024-08-18T22:05:41.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.574+0000 7f1da584d740 10 client.0 _ll_register_callbacks cb 0x7f1d8c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:05:41.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.574+0000 7f1da19ec640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9da8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.574+0000 7f1da19ec640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9da8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38326/0 (socket says 172.21.15.123:38326) 2024-08-18T22:05:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.574+0000 7f1da11eb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9dae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.574+0000 7f1da19ec640 1 -- 172.21.15.123:0/3018926703 learned_addr learned my addr 172.21.15.123:0/3018926703 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.574+0000 7f1da09ea640 1 --2- 172.21.15.123:0/3018926703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9da7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1da19ec640 1 -- 172.21.15.123:0/3018926703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 msgr2=0x55d9b9dae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:05:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1da19ec640 1 --2- 172.21.15.123:0/3018926703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9dae310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1da19ec640 1 -- 172.21.15.123:0/3018926703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 msgr2=0x55d9b9da7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:05:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1da19ec640 1 --2- 172.21.15.123:0/3018926703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9da7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1da19ec640 1 -- 172.21.15.123:0/3018926703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9b9da8b50 con 0x55d9b9d93810 2024-08-18T22:05:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1da09ea640 1 --2- 172.21.15.123:0/3018926703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9da7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:05:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1da19ec640 1 --2- 172.21.15.123:0/3018926703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9da8510 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c006010 tx=0x7f1d8c04a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e73ca074e184b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1d80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:05:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1d80ff9640 1 -- 172.21.15.123:0/3018926703 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c04e030 con 0x55d9b9d93810 2024-08-18T22:05:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1d80ff9640 1 -- 172.21.15.123:0/3018926703 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f1d8c0045e0 con 0x55d9b9d93810 2024-08-18T22:05:41.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1da584d740 1 -- 172.21.15.123:0/3018926703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d8c02fb70 con 0x55d9b9d93810 2024-08-18T22:05:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1d80ff9640 1 -- 172.21.15.123:0/3018926703 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f1d8c06f050 con 0x55d9b9d93810 2024-08-18T22:05:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1da584d740 10 client.14694 fetch_fsmap learned FSMap version 17 2024-08-18T22:05:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1da584d740 1 -- 172.21.15.123:0/3018926703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55d9b9e0edd0 con 0x55d9b9d93810 2024-08-18T22:05:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1d80ff9640 1 -- 172.21.15.123:0/3018926703 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d8c02fb70 con 0x55d9b9d93810 2024-08-18T22:05:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1d80ff9640 1 -- 172.21.15.123:0/3018926703 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f1d8c06a030 con 0x55d9b9d93810 2024-08-18T22:05:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.575+0000 7f1da584d740 10 client.14694 fetch_fsmap finished waiting for FSMap version 17 2024-08-18T22:05:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.576+0000 7f1da584d740 10 client.14694 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-18T22:05:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.576+0000 7f1da584d740 20 client.14694 populate_metadata read hostname 'smithi123' 2024-08-18T22:05:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.576+0000 7f1da584d740 1 --2- 172.21.15.123:0/3018926703 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d9b9e133b0 0x55d9b9e120c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.576+0000 7f1da584d740 4 client.14694 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:05:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.576+0000 7f1da584d740 1 -- 172.21.15.123:0/3018926703 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "status"}) -- 0x55d9b9c720e0 con 0x55d9b9e133b0 2024-08-18T22:05:41.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.576+0000 7f1da11eb640 1 --2- 172.21.15.123:0/3018926703 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d9b9e133b0 0x55d9b9e120c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.576+0000 7f1d80ff9640 10 client.14694 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:05:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.576+0000 7f1da11eb640 1 --2- 172.21.15.123:0/3018926703 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d9b9e133b0 0x55d9b9e120c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a03344008ac339c server_cookie=6f3ff00660506fbd in_seq=0 out_seq=0 2024-08-18T22:05:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.576+0000 7f1d80ff9640 1 -- 172.21.15.123:0/3018926703 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55d9b9c720e0 con 0x55d9b9e133b0 2024-08-18T22:05:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.576+0000 7f1d80ff9640 10 client.14694 handle_command_reply: tid=0 2024-08-18T22:05:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.576+0000 7f1da584d740 1 client.14694 shutdown 2024-08-18T22:05:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.577+0000 7f1da584d740 1 -- 172.21.15.123:0/3018926703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 msgr2=0x55d9b9da8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.577+0000 7f1da584d740 1 --2- 172.21.15.123:0/3018926703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9da8510 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c006010 tx=0x7f1d8c04a6b0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.577+0000 7f1da584d740 1 -- 172.21.15.123:0/3018926703 shutdown_connections 2024-08-18T22:05:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.577+0000 7f1da584d740 1 --2- 172.21.15.123:0/3018926703 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d9b9e133b0 0x55d9b9e120c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.577+0000 7f1da584d740 1 --2- 172.21.15.123:0/3018926703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d9b9d93810 0x55d9b9da8510 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.577+0000 7f1da584d740 1 --2- 172.21.15.123:0/3018926703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d9b9d88f50 0x55d9b9da7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.577+0000 7f1d80ff9640 0 client.14694 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:05:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.577+0000 7f1da584d740 1 --2- 172.21.15.123:0/3018926703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d9b9d88630 0x55d9b9dae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.577+0000 7f1da584d740 1 -- 172.21.15.123:0/3018926703 >> 172.21.15.123:0/3018926703 conn(0x55d9b9d84bc0 msgr2=0x55d9b9d9e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:41.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.577+0000 7f1da584d740 1 -- 172.21.15.123:0/3018926703 shutdown_connections 2024-08-18T22:05:41.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.577+0000 7f1da584d740 1 -- 172.21.15.123:0/3018926703 wait complete. 2024-08-18T22:05:41.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.577+0000 7f1da584d740 20 client.14694 trim_cache size 0 max 16384 2024-08-18T22:05:41.584 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:05:41.584 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "dfa1db70-5dac-11ef-bccf-c7b262605968", 2024-08-18T22:05:41.584 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-08-18T22:05:41.584 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24466, 2024-08-18T22:05:41.584 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-08-18T22:05:41.584 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-08-18T22:05:41.585 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-08-18T22:05:41.585 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 18.715918665, 2024-08-18T22:05:41.585 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 17, 2024-08-18T22:05:41.585 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 88, 2024-08-18T22:05:41.585 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 88, 2024-08-18T22:05:41.585 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 38.939586538999997 2024-08-18T22:05:41.585 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:05:41.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.577+0000 7f1da344f640 1 -- 172.21.15.123:0/3208589520 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d840a2b80 msgr2=0x7f1d840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:41.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.578+0000 7f1da344f640 1 --2- 172.21.15.123:0/3208589520 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d840a2b80 0x7f1d840a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c005e30 tx=0x7f1d8c005d80 comp rx=0 tx=0).stop 2024-08-18T22:05:41.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.578+0000 7f1da344f640 1 -- 172.21.15.123:0/3208589520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d9c074c70 msgr2=0x7f1d9c19a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:41.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.578+0000 7f1da344f640 1 --2- 172.21.15.123:0/3208589520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d9c074c70 0x7f1d9c19a850 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000d770 tx=0x7f1d9000dc30 comp rx=0 tx=0).stop 2024-08-18T22:05:41.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.578+0000 7f1da344f640 1 -- 172.21.15.123:0/3208589520 shutdown_connections 2024-08-18T22:05:41.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.578+0000 7f1da344f640 1 --2- 172.21.15.123:0/3208589520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d9c10e0f0 0x7f1d9c19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.578+0000 7f1da344f640 1 --2- 172.21.15.123:0/3208589520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d9c074c70 0x7f1d9c19a850 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.578+0000 7f1da344f640 1 --2- 172.21.15.123:0/3208589520 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d840a2b80 0x7f1d840a5040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.578+0000 7f1da344f640 1 --2- 172.21.15.123:0/3208589520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d9c074350 0x7f1d9c19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:41.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.578+0000 7f1da344f640 1 -- 172.21.15.123:0/3208589520 >> 172.21.15.123:0/3208589520 conn(0x7f1d9c0fd5f0 msgr2=0x7f1d9c0fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:41.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.578+0000 7f1da344f640 1 -- 172.21.15.123:0/3208589520 shutdown_connections 2024-08-18T22:05:41.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:41.578+0000 7f1da344f640 1 -- 172.21.15.123:0/3208589520 wait complete. 2024-08-18T22:05:42.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:42 smithi123 ceph-mon[18462]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:42.337 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-18T22:05:42.337 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:05:42.337 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs ls 2024-08-18T22:05:42.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:42 smithi183 ceph-mon[22097]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:42.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:42 smithi130 ceph-mon[21698]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:42.585 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:43.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.075+0000 7f66c8197640 1 -- 172.21.15.123:0/1362102358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c01078b0 msgr2=0x7f66c0107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:43.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.075+0000 7f66c8197640 1 --2- 172.21.15.123:0/1362102358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c01078b0 0x7f66c0107c90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009930 tx=0x7f66bc02a420 comp rx=0 tx=0).stop 2024-08-18T22:05:43.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.075+0000 7f66c8197640 1 -- 172.21.15.123:0/1362102358 shutdown_connections 2024-08-18T22:05:43.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.075+0000 7f66c8197640 1 --2- 172.21.15.123:0/1362102358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c0102250 0x7f66c010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:43.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.075+0000 7f66c8197640 1 --2- 172.21.15.123:0/1362102358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66c01018b0 0x7f66c0101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.075+0000 7f66c8197640 1 --2- 172.21.15.123:0/1362102358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c01078b0 0x7f66c0107c90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.075+0000 7f66c8197640 1 -- 172.21.15.123:0/1362102358 >> 172.21.15.123:0/1362102358 conn(0x7f66c00fd5f0 msgr2=0x7f66c00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.075+0000 7f66c8197640 1 -- 172.21.15.123:0/1362102358 shutdown_connections 2024-08-18T22:05:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.075+0000 7f66c8197640 1 -- 172.21.15.123:0/1362102358 wait complete. 2024-08-18T22:05:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.076+0000 7f66c8197640 1 Processor -- start 2024-08-18T22:05:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.076+0000 7f66c8197640 1 -- start start 2024-08-18T22:05:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.076+0000 7f66c8197640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c01018b0 0x7f66c0074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.076+0000 7f66c8197640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66c0102250 0x7f66c0074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.076+0000 7f66c8197640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c01078b0 0x7f66c0074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.076+0000 7f66c8197640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f66c0111cb0 con 0x7f66c01018b0 2024-08-18T22:05:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.076+0000 7f66c8197640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f66c0111b30 con 0x7f66c0102250 2024-08-18T22:05:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.076+0000 7f66c8197640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f66c0111e30 con 0x7f66c01078b0 2024-08-18T22:05:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.076+0000 7f66c5f33640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c01018b0 0x7f66c0074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.076+0000 7f66c5f33640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c01018b0 0x7f66c0074220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41934/0 (socket says 172.21.15.123:41934) 2024-08-18T22:05:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.076+0000 7f66c5f33640 1 -- 172.21.15.123:0/3367241159 learned_addr learned my addr 172.21.15.123:0/3367241159 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.076+0000 7f66c6734640 1 --2- 172.21.15.123:0/3367241159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c01078b0 0x7f66c0074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.077+0000 7f66c5732640 1 --2- 172.21.15.123:0/3367241159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66c0102250 0x7f66c0074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.077+0000 7f66c5f33640 1 -- 172.21.15.123:0/3367241159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c01078b0 msgr2=0x7f66c0074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.077+0000 7f66c5f33640 1 --2- 172.21.15.123:0/3367241159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c01078b0 0x7f66c0074ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.077+0000 7f66c5f33640 1 -- 172.21.15.123:0/3367241159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66c0102250 msgr2=0x7f66c0074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.077+0000 7f66c5f33640 1 --2- 172.21.15.123:0/3367241159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66c0102250 0x7f66c0074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.077+0000 7f66c5f33640 1 -- 172.21.15.123:0/3367241159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c01a65e0 con 0x7f66c01018b0 2024-08-18T22:05:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.077+0000 7f66c5732640 1 --2- 172.21.15.123:0/3367241159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66c0102250 0x7f66c0074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:05:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.077+0000 7f66c5f33640 1 --2- 172.21.15.123:0/3367241159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c01018b0 0x7f66c0074220 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009a50 tx=0x7f66bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.077+0000 7f66b6ffd640 1 -- 172.21.15.123:0/3367241159 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc03f030 con 0x7f66c01018b0 2024-08-18T22:05:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.077+0000 7f66c8197640 1 -- 172.21.15.123:0/3367241159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c01a6870 con 0x7f66c01018b0 2024-08-18T22:05:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.077+0000 7f66b6ffd640 1 -- 172.21.15.123:0/3367241159 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66bc003ce0 con 0x7f66c01018b0 2024-08-18T22:05:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.077+0000 7f66b6ffd640 1 -- 172.21.15.123:0/3367241159 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc035070 con 0x7f66c01018b0 2024-08-18T22:05:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.077+0000 7f66c8197640 1 -- 172.21.15.123:0/3367241159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c01a6da0 con 0x7f66c01018b0 2024-08-18T22:05:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.078+0000 7f66c8197640 1 -- 172.21.15.123:0/3367241159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c0101d10 con 0x7f66c01018b0 2024-08-18T22:05:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.079+0000 7f66b6ffd640 1 -- 172.21.15.123:0/3367241159 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f66bc042030 con 0x7f66c01018b0 2024-08-18T22:05:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.080+0000 7f66b6ffd640 1 --2- 172.21.15.123:0/3367241159 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66ac0a2b80 0x7f66ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.080+0000 7f66c5732640 1 --2- 172.21.15.123:0/3367241159 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66ac0a2b80 0x7f66ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.080+0000 7f66b6ffd640 1 -- 172.21.15.123:0/3367241159 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f66bc0efcc0 con 0x7f66c01018b0 2024-08-18T22:05:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.080+0000 7f66c5732640 1 --2- 172.21.15.123:0/3367241159 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66ac0a2b80 0x7f66ac0a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f66c0075cb0 tx=0x7f66b0005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.083+0000 7f66b6ffd640 1 -- 172.21.15.123:0/3367241159 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f66bc0bc9e0 con 0x7f66c01018b0 2024-08-18T22:05:43.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.286+0000 7f66c8197640 1 -- 172.21.15.123:0/3367241159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f66c0109e20 con 0x7f66c01018b0 2024-08-18T22:05:43.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.287+0000 7f66b6ffd640 1 -- 172.21.15.123:0/3367241159 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f66bc0bc2e0 con 0x7f66c01018b0 2024-08-18T22:05:43.288 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-18T22:05:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.289+0000 7f66c8197640 1 -- 172.21.15.123:0/3367241159 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66ac0a2b80 msgr2=0x7f66ac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.289+0000 7f66c8197640 1 --2- 172.21.15.123:0/3367241159 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66ac0a2b80 0x7f66ac0a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f66c0075cb0 tx=0x7f66b0005d30 comp rx=0 tx=0).stop 2024-08-18T22:05:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.289+0000 7f66c8197640 1 -- 172.21.15.123:0/3367241159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c01018b0 msgr2=0x7f66c0074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.289+0000 7f66c8197640 1 --2- 172.21.15.123:0/3367241159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c01018b0 0x7f66c0074220 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009a50 tx=0x7f66bc004270 comp rx=0 tx=0).stop 2024-08-18T22:05:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.289+0000 7f66c8197640 1 -- 172.21.15.123:0/3367241159 shutdown_connections 2024-08-18T22:05:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.289+0000 7f66c8197640 1 --2- 172.21.15.123:0/3367241159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c01078b0 0x7f66c0074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.289+0000 7f66c8197640 1 --2- 172.21.15.123:0/3367241159 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66ac0a2b80 0x7f66ac0a5040 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.289+0000 7f66c8197640 1 --2- 172.21.15.123:0/3367241159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66c0102250 0x7f66c0074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.289+0000 7f66c8197640 1 --2- 172.21.15.123:0/3367241159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66c01018b0 0x7f66c0074220 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.289+0000 7f66c8197640 1 -- 172.21.15.123:0/3367241159 >> 172.21.15.123:0/3367241159 conn(0x7f66c00fd5f0 msgr2=0x7f66c00fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.289+0000 7f66c8197640 1 -- 172.21.15.123:0/3367241159 shutdown_connections 2024-08-18T22:05:43.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:43.289+0000 7f66c8197640 1 -- 172.21.15.123:0/3367241159 wait complete. 2024-08-18T22:05:43.601 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:43 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3367241159' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-18T22:05:43.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:43 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3367241159' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-18T22:05:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:43 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3367241159' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-18T22:05:43.931 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:05:43.931 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:05:43.931 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-08-18T22:05:43.932 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-08-18T22:05:43.932 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:05:43.932 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:05:43.932 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-18T22:05:43.932 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:05:43.932 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-08-18T22:05:43.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:05:43.932 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-08-18T22:05:43.949 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:05:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:05:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:05:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:05:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-08-18T22:05:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:05:43.950 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T22:05:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-08-18T22:05:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-08-18T22:05:43.950 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T22:05:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-08-18T22:05:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-08-18T22:05:43.950 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T22:05:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:05:43.950 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:05:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:05:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-18T22:05:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42426sec preferred_lft 42426sec 2024-08-18T22:05:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-08-18T22:05:43.951 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:05:43.951 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-18T22:05:43.951 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:05:43.951 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-18T22:05:43.951 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add name ceph-brx type bridge 2024-08-18T22:05:43.952 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr flush dev ceph-brx 2024-08-18T22:05:43.952 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set ceph-brx up 2024-08-18T22:05:43.952 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-18T22:05:43.952 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-18T22:05:44.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:05:44.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:05:44.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:05:44.149 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:05:44.174 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-08-18T22:05:44.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:05:44.175 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-08-18T22:05:44.244 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-08-18T22:05:44.244 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:05:44.244 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-18T22:05:44.244 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-18T22:05:44.244 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:05:44.245 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:05:44.245 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-18T22:05:44.245 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-18T22:05:44.245 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-18T22:05:44.245 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-18T22:05:44.245 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-18T22:05:44.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:05:44.448 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:44 smithi123 ceph-mon[18462]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:05:44.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:05:44.534 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-08-18T22:05:44.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:05:44.550 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-08-18T22:05:44.605 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:05:44.605 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-18T22:05:44.605 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T22:05:44.605 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-08-18T22:05:44.605 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-18T22:05:44.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:44 smithi183 ceph-mon[22097]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:44.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:05:44.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:05:44.722 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-08-18T22:05:44.722 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:05:44.722 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-18T22:05:44.722 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-08-18T22:05:44.722 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-18T22:05:44.722 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-08-18T22:05:44.722 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-08-18T22:05:44.722 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-08-18T22:05:44.722 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-18T22:05:44.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:44 smithi130 ceph-mon[21698]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:44.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:05:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:05:44.849 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:05:44.849 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-18T22:05:44.849 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-08-18T22:05:44.850 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.0 master ceph-brx 2024-08-18T22:05:44.850 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-18T22:05:44.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:05:44.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:05:44.927 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-08-18T22:05:44.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:05:44.927 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:05:44.942 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-08-18T22:05:44.942 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:05:44.942 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:05:44.997 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-08-18T22:05:45.063 DEBUG:teuthology.orchestra.run.smithi123:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T22:05:45.119 INFO:teuthology.orchestra.run.smithi123.stdout:/proc 2024-08-18T22:05:45.120 INFO:teuthology.orchestra.run.smithi123.stdout:/sys 2024-08-18T22:05:45.120 INFO:teuthology.orchestra.run.smithi123.stdout:/dev 2024-08-18T22:05:45.120 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/security 2024-08-18T22:05:45.120 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/shm 2024-08-18T22:05:45.120 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/pts 2024-08-18T22:05:45.120 INFO:teuthology.orchestra.run.smithi123.stdout:/run 2024-08-18T22:05:45.120 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/cgroup 2024-08-18T22:05:45.120 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/pstore 2024-08-18T22:05:45.120 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/bpf 2024-08-18T22:05:45.120 INFO:teuthology.orchestra.run.smithi123.stdout:/ 2024-08-18T22:05:45.120 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/selinux 2024-08-18T22:05:45.120 INFO:teuthology.orchestra.run.smithi123.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/debug 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/mqueue 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/hugepages 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/tracing 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/fuse/connections 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/config 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/run/user/1000 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/f85d27fba7dcc0276a9c0d336483c59638564a2cd9bd7237c839047ddc6b9490/merged 2024-08-18T22:05:45.121 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/3f5208081e862364f43b0bdeb6e50d55122e6c36be40db475e15683b8ae5afef/merged 2024-08-18T22:05:45.122 INFO:teuthology.orchestra.run.smithi123.stdout:/run/user/0 2024-08-18T22:05:45.122 INFO:teuthology.orchestra.run.smithi123.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T22:05:45.122 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/022e868d9be277263a8f20a8b2000ae27c0cc4f25a8e5c058349bf10061e9fc7/merged 2024-08-18T22:05:45.122 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/1f89ca5bde06412ae304cc60384d28ed2b9fd12a80e9bf41623f7ab470005c4c/merged 2024-08-18T22:05:45.122 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/f4ae48aff30dd2e1b73f9a50ecd11fe74d42b6e07b96bb1956bf2cf8355a5b66/merged 2024-08-18T22:05:45.122 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/f762c9807ac6a04b82b1c10a91803697e953eb76f06945fe19b1573033c3f056/merged 2024-08-18T22:05:45.122 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/6fbdd3ce5c76966dd230bfa817a60394018dc201e644c858711bb12efa7285d3/merged 2024-08-18T22:05:45.122 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/a17abd626c07b13c434029397d6210195bba25b9ab70377a89ddb46178fdb0d2/merged 2024-08-18T22:05:45.122 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/bd713078f547564557107d4b9534758ceae6ad7f6936ff75cdf2d5ade9dc3994/merged 2024-08-18T22:05:45.123 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/f681884c48f56e5074e1346ba4c08969df14a731fffad6d4adb1ff859766e2da/merged 2024-08-18T22:05:45.123 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns 2024-08-18T22:05:45.123 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T22:05:45.123 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T22:05:45.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:05:45.123 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-08-18T22:05:45.175 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-18T22:05:45.175 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-08-18T22:05:45.217 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-08-18T22:05:45.241 DEBUG:teuthology.orchestra.run.smithi123:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T22:05:45.296 INFO:teuthology.orchestra.run.smithi123.stdout:/proc 2024-08-18T22:05:45.296 INFO:teuthology.orchestra.run.smithi123.stdout:/sys 2024-08-18T22:05:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/dev 2024-08-18T22:05:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/security 2024-08-18T22:05:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/shm 2024-08-18T22:05:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/pts 2024-08-18T22:05:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/run 2024-08-18T22:05:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/cgroup 2024-08-18T22:05:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/pstore 2024-08-18T22:05:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/bpf 2024-08-18T22:05:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/ 2024-08-18T22:05:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/selinux 2024-08-18T22:05:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T22:05:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/debug 2024-08-18T22:05:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/mqueue 2024-08-18T22:05:45.297 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/hugepages 2024-08-18T22:05:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/tracing 2024-08-18T22:05:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T22:05:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/fuse/connections 2024-08-18T22:05:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/config 2024-08-18T22:05:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T22:05:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T22:05:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T22:05:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T22:05:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/run/user/1000 2024-08-18T22:05:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph 2024-08-18T22:05:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay 2024-08-18T22:05:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/f85d27fba7dcc0276a9c0d336483c59638564a2cd9bd7237c839047ddc6b9490/merged 2024-08-18T22:05:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/3f5208081e862364f43b0bdeb6e50d55122e6c36be40db475e15683b8ae5afef/merged 2024-08-18T22:05:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/run/user/0 2024-08-18T22:05:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T22:05:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/022e868d9be277263a8f20a8b2000ae27c0cc4f25a8e5c058349bf10061e9fc7/merged 2024-08-18T22:05:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/1f89ca5bde06412ae304cc60384d28ed2b9fd12a80e9bf41623f7ab470005c4c/merged 2024-08-18T22:05:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/f4ae48aff30dd2e1b73f9a50ecd11fe74d42b6e07b96bb1956bf2cf8355a5b66/merged 2024-08-18T22:05:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/f762c9807ac6a04b82b1c10a91803697e953eb76f06945fe19b1573033c3f056/merged 2024-08-18T22:05:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/6fbdd3ce5c76966dd230bfa817a60394018dc201e644c858711bb12efa7285d3/merged 2024-08-18T22:05:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/a17abd626c07b13c434029397d6210195bba25b9ab70377a89ddb46178fdb0d2/merged 2024-08-18T22:05:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/bd713078f547564557107d4b9534758ceae6ad7f6936ff75cdf2d5ade9dc3994/merged 2024-08-18T22:05:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/containers/storage/overlay/f681884c48f56e5074e1346ba4c08969df14a731fffad6d4adb1ff859766e2da/merged 2024-08-18T22:05:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns 2024-08-18T22:05:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T22:05:45.299 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T22:05:45.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:05:45.300 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-08-18T22:05:45.322 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi123.stderr:2024-08-18T22:05:45.321+0000 7fea459ff480 -1 init, newargv = 0x5558cdeaea80 newargc=15 2024-08-18T22:05:45.322 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi123.stderr:ceph-fuse[59994]: starting ceph client 2024-08-18T22:05:45.327 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi123.stderr:ceph-fuse[59994]: starting fuse 2024-08-18T22:05:45.337 INFO:teuthology.orchestra.run.smithi123.stdout:121 2024-08-18T22:05:45.337 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2024-08-18T22:05:45.337 DEBUG:teuthology.orchestra.run.smithi123:> sudo stdin-killer -- python3 -c ' 2024-08-18T22:05:45.337 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2024-08-18T22:05:45.337 DEBUG:teuthology.orchestra.run.smithi123:> import re 2024-08-18T22:05:45.337 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-08-18T22:05:45.338 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2024-08-18T22:05:45.338 DEBUG:teuthology.orchestra.run.smithi123:> 2024-08-18T22:05:45.338 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2024-08-18T22:05:45.338 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-08-18T22:05:45.338 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2024-08-18T22:05:45.338 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-08-18T22:05:45.338 DEBUG:teuthology.orchestra.run.smithi123:> 2024-08-18T22:05:45.338 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2024-08-18T22:05:45.338 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2024-08-18T22:05:45.339 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2024-08-18T22:05:45.339 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2024-08-18T22:05:45.339 DEBUG:teuthology.orchestra.run.smithi123:> 2024-08-18T22:05:45.339 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2024-08-18T22:05:45.339 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-18T22:05:45.339 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-18T22:05:45.339 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-18T22:05:45.339 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2024-08-18T22:05:45.339 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2024-08-18T22:05:45.339 DEBUG:teuthology.orchestra.run.smithi123:> return f 2024-08-18T22:05:45.339 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-18T22:05:45.339 DEBUG:teuthology.orchestra.run.smithi123:> 2024-08-18T22:05:45.339 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.admin")) 2024-08-18T22:05:45.339 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-08-18T22:05:45.456 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.admin.59994.asok 2024-08-18T22:05:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:05:45.467 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.59994.asok 2024-08-18T22:05:45.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:05:45.467 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.59994.asok status 2024-08-18T22:05:45.601 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:05:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2024-08-18T22:05:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "de09dd018de4baddfa6ca4d43bc8fb784cf75833", 2024-08-18T22:05:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)", 2024-08-18T22:05:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "admin", 2024-08-18T22:05:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2024-08-18T22:05:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-08-18T22:05:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "59994", 2024-08-18T22:05:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2024-08-18T22:05:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:05:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2024-08-18T22:05:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2024-08-18T22:05:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 14706, 2024-08-18T22:05:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2024-08-18T22:05:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2024-08-18T22:05:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2024-08-18T22:05:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 14706 2024-08-18T22:05:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:05:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-08-18T22:05:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-08-18T22:05:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-08-18T22:05:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 123242252 2024-08-18T22:05:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:05:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:05:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-08-18T22:05:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-08-18T22:05:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-08-18T22:05:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 123242252 2024-08-18T22:05:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:05:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.14706 192.168.0.1:0/123242252", 2024-08-18T22:05:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "192.168.0.1:0/123242252", 2024-08-18T22:05:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2024-08-18T22:05:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 17, 2024-08-18T22:05:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 88, 2024-08-18T22:05:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2024-08-18T22:05:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2024-08-18T22:05:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2024-08-18T22:05:45.604 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:05:45.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:05:45.610 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2024-08-18T22:05:45.611 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:05:45.626 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2024-08-18T22:05:45.626 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:05:45.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:05:45.626 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:05:45.692 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-08-18T22:05:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:05:45.796 INFO:teuthology.orchestra.run.smithi123.stdout:# file: . 2024-08-18T22:05:45.796 INFO:teuthology.orchestra.run.smithi123.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-08-18T22:05:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:05:45.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:05:45.802 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T22:05:45.802 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:05:45.820 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-18T22:05:46.112 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:46.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:46 smithi123 ceph-mon[18462]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.616+0000 7feed7e31640 1 -- 172.21.15.123:0/3439527976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feed0100f70 msgr2=0x7feed01013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.616+0000 7feed7e31640 1 --2- 172.21.15.123:0/3439527976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feed0100f70 0x7feed01013d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7feec0009900 tx=0x7feec002a410 comp rx=0 tx=0).stop 2024-08-18T22:05:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.616+0000 7feed7e31640 1 -- 172.21.15.123:0/3439527976 shutdown_connections 2024-08-18T22:05:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.616+0000 7feed7e31640 1 --2- 172.21.15.123:0/3439527976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feed0101910 0x7feed010d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.616+0000 7feed7e31640 1 --2- 172.21.15.123:0/3439527976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feed0100f70 0x7feed01013d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.616+0000 7feed7e31640 1 --2- 172.21.15.123:0/3439527976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feed01057a0 0x7feed0105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.616+0000 7feed7e31640 1 -- 172.21.15.123:0/3439527976 >> 172.21.15.123:0/3439527976 conn(0x7feed0076f40 msgr2=0x7feed00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.616+0000 7feed7e31640 1 -- 172.21.15.123:0/3439527976 shutdown_connections 2024-08-18T22:05:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.616+0000 7feed7e31640 1 -- 172.21.15.123:0/3439527976 wait complete. 2024-08-18T22:05:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed7e31640 1 Processor -- start 2024-08-18T22:05:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed7e31640 1 -- start start 2024-08-18T22:05:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed7e31640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feed0100f70 0x7feed0196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed7e31640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feed0101910 0x7feed0197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed7e31640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feed01057a0 0x7feed019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed7e31640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feed0110be0 con 0x7feed01057a0 2024-08-18T22:05:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed7e31640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feed0110a60 con 0x7feed0100f70 2024-08-18T22:05:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed7e31640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7feed0110d60 con 0x7feed0101910 2024-08-18T22:05:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed63ce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feed01057a0 0x7feed019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed63ce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feed01057a0 0x7feed019bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41950/0 (socket says 172.21.15.123:41950) 2024-08-18T22:05:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed63ce640 1 -- 172.21.15.123:0/986699879 learned_addr learned my addr 172.21.15.123:0/986699879 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed5bcd640 1 --2- 172.21.15.123:0/986699879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feed0100f70 0x7feed0196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed53cc640 1 --2- 172.21.15.123:0/986699879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feed0101910 0x7feed0197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed63ce640 1 -- 172.21.15.123:0/986699879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feed0101910 msgr2=0x7feed0197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed63ce640 1 --2- 172.21.15.123:0/986699879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feed0101910 0x7feed0197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed63ce640 1 -- 172.21.15.123:0/986699879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feed0100f70 msgr2=0x7feed0196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed63ce640 1 --2- 172.21.15.123:0/986699879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feed0100f70 0x7feed0196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed63ce640 1 -- 172.21.15.123:0/986699879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed019c2e0 con 0x7feed01057a0 2024-08-18T22:05:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.617+0000 7feed53cc640 1 --2- 172.21.15.123:0/986699879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feed0101910 0x7feed0197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:05:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.618+0000 7feed63ce640 1 --2- 172.21.15.123:0/986699879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feed01057a0 0x7feed019bda0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feec800cad0 tx=0x7feec800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.618+0000 7feec6ffd640 1 -- 172.21.15.123:0/986699879 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec800ae20 con 0x7feed01057a0 2024-08-18T22:05:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.618+0000 7feec6ffd640 1 -- 172.21.15.123:0/986699879 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feec8005020 con 0x7feed01057a0 2024-08-18T22:05:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.618+0000 7feec6ffd640 1 -- 172.21.15.123:0/986699879 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec800f6f0 con 0x7feed01057a0 2024-08-18T22:05:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.618+0000 7feed7e31640 1 -- 172.21.15.123:0/986699879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed019c5d0 con 0x7feed01057a0 2024-08-18T22:05:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.618+0000 7feed7e31640 1 -- 172.21.15.123:0/986699879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed019cac0 con 0x7feed01057a0 2024-08-18T22:05:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.619+0000 7feed7e31640 1 -- 172.21.15.123:0/986699879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feed0101f80 con 0x7feed01057a0 2024-08-18T22:05:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.620+0000 7feec6ffd640 1 -- 172.21.15.123:0/986699879 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7feec80051d0 con 0x7feed01057a0 2024-08-18T22:05:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.621+0000 7feec6ffd640 1 --2- 172.21.15.123:0/986699879 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feebc0a2b80 0x7feebc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.621+0000 7feed5bcd640 1 --2- 172.21.15.123:0/986699879 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feebc0a2b80 0x7feebc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:46.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.621+0000 7feec6ffd640 1 -- 172.21.15.123:0/986699879 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7feec80cf320 con 0x7feed01057a0 2024-08-18T22:05:46.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.621+0000 7feed5bcd640 1 --2- 172.21.15.123:0/986699879 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feebc0a2b80 0x7feebc0a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feecc00bb60 tx=0x7feecc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:46.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.625+0000 7feec6ffd640 1 -- 172.21.15.123:0/986699879 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7feec8014030 con 0x7feed01057a0 2024-08-18T22:05:46.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:46 smithi183 ceph-mon[22097]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:46.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:46 smithi130 ceph-mon[21698]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:46.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.801+0000 7feed7e31640 1 -- 172.21.15.123:0/986699879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7feed002d5e0 con 0x7feed01057a0 2024-08-18T22:05:46.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.802+0000 7feec6ffd640 1 -- 172.21.15.123:0/986699879 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) ==== 81+0+602 (secure 0 0 0) 0x7feec809c040 con 0x7feed01057a0 2024-08-18T22:05:46.803 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/4048905381 2024-08-19T21:59:09.243300+0000 2024-08-18T22:05:46.803 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/4048905381 2024-08-19T21:59:09.243300+0000 2024-08-18T22:05:46.803 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3344429295 2024-08-19T21:58:46.762466+0000 2024-08-18T22:05:46.803 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1091246574 2024-08-19T21:58:46.762466+0000 2024-08-18T22:05:46.803 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1435078155 2024-08-19T21:59:09.243300+0000 2024-08-18T22:05:46.804 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3196395967 2024-08-19T21:58:46.762466+0000 2024-08-18T22:05:46.804 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3505218516 2024-08-19T21:59:09.243300+0000 2024-08-18T22:05:46.804 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2299071339 2024-08-19T21:59:09.243300+0000 2024-08-18T22:05:46.804 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/1909168969 2024-08-19T21:58:46.762466+0000 2024-08-18T22:05:46.804 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/1909168969 2024-08-19T21:58:46.762466+0000 2024-08-18T22:05:46.804 INFO:teuthology.orchestra.run.smithi123.stderr:listed 10 entries 2024-08-18T22:05:46.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.804+0000 7feed7e31640 1 -- 172.21.15.123:0/986699879 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feebc0a2b80 msgr2=0x7feebc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:46.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.804+0000 7feed7e31640 1 --2- 172.21.15.123:0/986699879 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feebc0a2b80 0x7feebc0a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feecc00bb60 tx=0x7feecc00b390 comp rx=0 tx=0).stop 2024-08-18T22:05:46.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.804+0000 7feed7e31640 1 -- 172.21.15.123:0/986699879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feed01057a0 msgr2=0x7feed019bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:46.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.804+0000 7feed7e31640 1 --2- 172.21.15.123:0/986699879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feed01057a0 0x7feed019bda0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feec800cad0 tx=0x7feec800cf90 comp rx=0 tx=0).stop 2024-08-18T22:05:46.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.804+0000 7feed7e31640 1 -- 172.21.15.123:0/986699879 shutdown_connections 2024-08-18T22:05:46.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.804+0000 7feed7e31640 1 --2- 172.21.15.123:0/986699879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feed01057a0 0x7feed019bda0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:46.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.804+0000 7feed7e31640 1 --2- 172.21.15.123:0/986699879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feed0101910 0x7feed0197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:46.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.804+0000 7feed7e31640 1 --2- 172.21.15.123:0/986699879 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feebc0a2b80 0x7feebc0a5040 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:46.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.804+0000 7feed7e31640 1 --2- 172.21.15.123:0/986699879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feed0100f70 0x7feed0196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:46.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.804+0000 7feed7e31640 1 -- 172.21.15.123:0/986699879 >> 172.21.15.123:0/986699879 conn(0x7feed0076f40 msgr2=0x7feed0103520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:46.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.804+0000 7feed7e31640 1 -- 172.21.15.123:0/986699879 shutdown_connections 2024-08-18T22:05:46.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:46.804+0000 7feed7e31640 1 -- 172.21.15.123:0/986699879 wait complete. 2024-08-18T22:05:47.531 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:47 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/986699879' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-18T22:05:47.533 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T22:05:47.533 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:05:47.550 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-18T22:05:47.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:47 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/986699879' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-18T22:05:47.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:47 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/986699879' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-18T22:05:47.838 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:48.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.314+0000 7f646bd12640 1 -- 172.21.15.123:0/46689242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6464102c20 msgr2=0x7f646410d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:48.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.314+0000 7f646bd12640 1 --2- 172.21.15.123:0/46689242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6464102c20 0x7f646410d770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f645c009ca0 tx=0x7f645c02a950 comp rx=0 tx=0).stop 2024-08-18T22:05:48.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.315+0000 7f646bd12640 1 -- 172.21.15.123:0/46689242 shutdown_connections 2024-08-18T22:05:48.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.315+0000 7f646bd12640 1 --2- 172.21.15.123:0/46689242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6464102c20 0x7f646410d770 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:48.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.315+0000 7f646bd12640 1 --2- 172.21.15.123:0/46689242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64641022a0 0x7f64641026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:48.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.315+0000 7f646bd12640 1 --2- 172.21.15.123:0/46689242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6464100b50 0x7f6464100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:48.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.315+0000 7f646bd12640 1 -- 172.21.15.123:0/46689242 >> 172.21.15.123:0/46689242 conn(0x7f64640fc500 msgr2=0x7f64640fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.315+0000 7f646bd12640 1 -- 172.21.15.123:0/46689242 shutdown_connections 2024-08-18T22:05:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.315+0000 7f646bd12640 1 -- 172.21.15.123:0/46689242 wait complete. 2024-08-18T22:05:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.315+0000 7f646bd12640 1 Processor -- start 2024-08-18T22:05:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.315+0000 7f646bd12640 1 -- start start 2024-08-18T22:05:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.315+0000 7f646bd12640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6464100b50 0x7f6464198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.315+0000 7f646bd12640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64641022a0 0x7f64641994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.315+0000 7f646bd12640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6464102c20 0x7f64641a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.315+0000 7f646bd12640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6464110cd0 con 0x7f64641022a0 2024-08-18T22:05:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.315+0000 7f646bd12640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6464110b50 con 0x7f6464102c20 2024-08-18T22:05:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.315+0000 7f646bd12640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6464110e50 con 0x7f6464100b50 2024-08-18T22:05:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f64692ad640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64641022a0 0x7f64641994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f64692ad640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64641022a0 0x7f64641994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41962/0 (socket says 172.21.15.123:41962) 2024-08-18T22:05:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f64692ad640 1 -- 172.21.15.123:0/500881744 learned_addr learned my addr 172.21.15.123:0/500881744 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f6469aae640 1 --2- 172.21.15.123:0/500881744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6464100b50 0x7f6464198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f646a2af640 1 --2- 172.21.15.123:0/500881744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6464102c20 0x7f64641a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f64692ad640 1 -- 172.21.15.123:0/500881744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6464100b50 msgr2=0x7f6464198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f64692ad640 1 --2- 172.21.15.123:0/500881744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6464100b50 0x7f6464198f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f64692ad640 1 -- 172.21.15.123:0/500881744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6464102c20 msgr2=0x7f64641a4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f64692ad640 1 --2- 172.21.15.123:0/500881744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6464102c20 0x7f64641a4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f64692ad640 1 -- 172.21.15.123:0/500881744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64641a4550 con 0x7f64641022a0 2024-08-18T22:05:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f646a2af640 1 --2- 172.21.15.123:0/500881744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6464102c20 0x7f64641a4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:05:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f64692ad640 1 --2- 172.21.15.123:0/500881744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64641022a0 0x7f64641994d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f645400b4a0 tx=0x7f645400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f645affd640 1 -- 172.21.15.123:0/500881744 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454015020 con 0x7f64641022a0 2024-08-18T22:05:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f645affd640 1 -- 172.21.15.123:0/500881744 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6454011d10 con 0x7f64641022a0 2024-08-18T22:05:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f645affd640 1 -- 172.21.15.123:0/500881744 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645400f2e0 con 0x7f64641022a0 2024-08-18T22:05:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f646bd12640 1 -- 172.21.15.123:0/500881744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64641a4720 con 0x7f64641022a0 2024-08-18T22:05:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.316+0000 7f646bd12640 1 -- 172.21.15.123:0/500881744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64641a4cb0 con 0x7f64641022a0 2024-08-18T22:05:48.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.317+0000 7f646bd12640 1 -- 172.21.15.123:0/500881744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6464100f30 con 0x7f64641022a0 2024-08-18T22:05:48.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.319+0000 7f645affd640 1 -- 172.21.15.123:0/500881744 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6454018020 con 0x7f64641022a0 2024-08-18T22:05:48.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.319+0000 7f645affd640 1 --2- 172.21.15.123:0/500881744 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f64500a2c00 0x7f64500a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:48.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.319+0000 7f6469aae640 1 --2- 172.21.15.123:0/500881744 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f64500a2c00 0x7f64500a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:48.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.319+0000 7f645affd640 1 -- 172.21.15.123:0/500881744 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f64540cef70 con 0x7f64641022a0 2024-08-18T22:05:48.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.320+0000 7f6469aae640 1 --2- 172.21.15.123:0/500881744 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f64500a2c00 0x7f64500a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f646000abe0 tx=0x7f646000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:48.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.322+0000 7f645affd640 1 -- 172.21.15.123:0/500881744 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f645401f020 con 0x7f64641022a0 2024-08-18T22:05:48.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.502+0000 7f646bd12640 1 -- 172.21.15.123:0/500881744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f646406a2d0 con 0x7f64641022a0 2024-08-18T22:05:48.503 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:48 smithi123 ceph-mon[18462]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:48.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.502+0000 7f645affd640 1 -- 172.21.15.123:0/500881744 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) ==== 81+0+602 (secure 0 0 0) 0x7f646406a2d0 con 0x7f64641022a0 2024-08-18T22:05:48.504 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/4048905381 2024-08-19T21:59:09.243300+0000 2024-08-18T22:05:48.504 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/4048905381 2024-08-19T21:59:09.243300+0000 2024-08-18T22:05:48.504 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3344429295 2024-08-19T21:58:46.762466+0000 2024-08-18T22:05:48.504 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1091246574 2024-08-19T21:58:46.762466+0000 2024-08-18T22:05:48.504 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1435078155 2024-08-19T21:59:09.243300+0000 2024-08-18T22:05:48.504 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3196395967 2024-08-19T21:58:46.762466+0000 2024-08-18T22:05:48.504 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3505218516 2024-08-19T21:59:09.243300+0000 2024-08-18T22:05:48.504 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2299071339 2024-08-19T21:59:09.243300+0000 2024-08-18T22:05:48.504 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/1909168969 2024-08-19T21:58:46.762466+0000 2024-08-18T22:05:48.504 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/1909168969 2024-08-19T21:58:46.762466+0000 2024-08-18T22:05:48.505 INFO:teuthology.orchestra.run.smithi123.stderr:listed 10 entries 2024-08-18T22:05:48.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.504+0000 7f646bd12640 1 -- 172.21.15.123:0/500881744 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f64500a2c00 msgr2=0x7f64500a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:48.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.504+0000 7f646bd12640 1 --2- 172.21.15.123:0/500881744 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f64500a2c00 0x7f64500a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f646000abe0 tx=0x7f646000a2d0 comp rx=0 tx=0).stop 2024-08-18T22:05:48.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.504+0000 7f646bd12640 1 -- 172.21.15.123:0/500881744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64641022a0 msgr2=0x7f64641994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:48.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.504+0000 7f646bd12640 1 --2- 172.21.15.123:0/500881744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64641022a0 0x7f64641994d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f645400b4a0 tx=0x7f645400b8a0 comp rx=0 tx=0).stop 2024-08-18T22:05:48.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.504+0000 7f646bd12640 1 -- 172.21.15.123:0/500881744 shutdown_connections 2024-08-18T22:05:48.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.504+0000 7f646bd12640 1 --2- 172.21.15.123:0/500881744 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f64500a2c00 0x7f64500a50c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:48.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.504+0000 7f646bd12640 1 --2- 172.21.15.123:0/500881744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6464102c20 0x7f64641a4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:48.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.504+0000 7f646bd12640 1 --2- 172.21.15.123:0/500881744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64641022a0 0x7f64641994d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:48.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.504+0000 7f646bd12640 1 --2- 172.21.15.123:0/500881744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6464100b50 0x7f6464198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:48.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.504+0000 7f646bd12640 1 -- 172.21.15.123:0/500881744 >> 172.21.15.123:0/500881744 conn(0x7f64640fc500 msgr2=0x7f6464106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:48.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.504+0000 7f646bd12640 1 -- 172.21.15.123:0/500881744 shutdown_connections 2024-08-18T22:05:48.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:48.504+0000 7f646bd12640 1 -- 172.21.15.123:0/500881744 wait complete. 2024-08-18T22:05:48.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:48 smithi183 ceph-mon[22097]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:48.665 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:48 smithi130 ceph-mon[21698]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:05:49.186 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi123.front.sepia.ceph.com... 2024-08-18T22:05:49.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:05:49.186 DEBUG:teuthology.orchestra.run.smithi123:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:05:49.212 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi123.stderr:ceph-fuse[59994]: fuse finished with error 0 and tester_r 0 2024-08-18T22:05:49.214 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:05:49.314 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-08-18T22:05:49.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:05:49.314 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-08-18T22:05:49.343 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:05:49.631 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:49.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:49 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/500881744' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-18T22:05:49.753 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:49 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/500881744' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-18T22:05:49.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:49 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/500881744' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-18T22:05:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.097+0000 7fb5e33c9640 1 -- 172.21.15.123:0/923513571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5dc102c20 msgr2=0x7fb5dc10d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.097+0000 7fb5e33c9640 1 --2- 172.21.15.123:0/923513571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5dc102c20 0x7fb5dc10d770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009ca0 tx=0x7fb5d802a950 comp rx=0 tx=0).stop 2024-08-18T22:05:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.097+0000 7fb5e33c9640 1 -- 172.21.15.123:0/923513571 shutdown_connections 2024-08-18T22:05:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.097+0000 7fb5e33c9640 1 --2- 172.21.15.123:0/923513571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5dc102c20 0x7fb5dc10d770 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.097+0000 7fb5e33c9640 1 --2- 172.21.15.123:0/923513571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5dc1022a0 0x7fb5dc1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.097+0000 7fb5e33c9640 1 --2- 172.21.15.123:0/923513571 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5dc100b50 0x7fb5dc100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.097+0000 7fb5e33c9640 1 -- 172.21.15.123:0/923513571 >> 172.21.15.123:0/923513571 conn(0x7fb5dc0fc500 msgr2=0x7fb5dc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.097+0000 7fb5e33c9640 1 -- 172.21.15.123:0/923513571 shutdown_connections 2024-08-18T22:05:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.097+0000 7fb5e33c9640 1 -- 172.21.15.123:0/923513571 wait complete. 2024-08-18T22:05:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e33c9640 1 Processor -- start 2024-08-18T22:05:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e33c9640 1 -- start start 2024-08-18T22:05:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e33c9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5dc100b50 0x7fb5dc1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e33c9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5dc1022a0 0x7fb5dc198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e33c9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5dc102c20 0x7fb5dc19ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e33c9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc110cb0 con 0x7fb5dc1022a0 2024-08-18T22:05:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e33c9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc110b30 con 0x7fb5dc100b50 2024-08-18T22:05:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e33c9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc110e30 con 0x7fb5dc102c20 2024-08-18T22:05:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e0964640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5dc1022a0 0x7fb5dc198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e0964640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5dc1022a0 0x7fb5dc198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41992/0 (socket says 172.21.15.123:41992) 2024-08-18T22:05:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e0964640 1 -- 172.21.15.123:0/1312832719 learned_addr learned my addr 172.21.15.123:0/1312832719 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e1165640 1 --2- 172.21.15.123:0/1312832719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5dc100b50 0x7fb5dc1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e1966640 1 --2- 172.21.15.123:0/1312832719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5dc102c20 0x7fb5dc19ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e0964640 1 -- 172.21.15.123:0/1312832719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5dc102c20 msgr2=0x7fb5dc19ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e0964640 1 --2- 172.21.15.123:0/1312832719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5dc102c20 0x7fb5dc19ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e0964640 1 -- 172.21.15.123:0/1312832719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5dc100b50 msgr2=0x7fb5dc1981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e0964640 1 --2- 172.21.15.123:0/1312832719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5dc100b50 0x7fb5dc1981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e0964640 1 -- 172.21.15.123:0/1312832719 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5dc19d170 con 0x7fb5dc1022a0 2024-08-18T22:05:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e1165640 1 --2- 172.21.15.123:0/1312832719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5dc100b50 0x7fb5dc1981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:05:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.098+0000 7fb5e0964640 1 --2- 172.21.15.123:0/1312832719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5dc1022a0 0x7fb5dc198700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00e9f0 tx=0x7fb5cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.099+0000 7fb5d27fc640 1 -- 172.21.15.123:0/1312832719 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc00cd80 con 0x7fb5dc1022a0 2024-08-18T22:05:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.099+0000 7fb5e33c9640 1 -- 172.21.15.123:0/1312832719 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5dc19d460 con 0x7fb5dc1022a0 2024-08-18T22:05:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.099+0000 7fb5d27fc640 1 -- 172.21.15.123:0/1312832719 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5cc010910 con 0x7fb5dc1022a0 2024-08-18T22:05:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.099+0000 7fb5d27fc640 1 -- 172.21.15.123:0/1312832719 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc018990 con 0x7fb5dc1022a0 2024-08-18T22:05:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.099+0000 7fb5e33c9640 1 -- 172.21.15.123:0/1312832719 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5dc1a4d40 con 0x7fb5dc1022a0 2024-08-18T22:05:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.100+0000 7fb5e33c9640 1 -- 172.21.15.123:0/1312832719 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5dc100f30 con 0x7fb5dc1022a0 2024-08-18T22:05:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.101+0000 7fb5d27fc640 1 -- 172.21.15.123:0/1312832719 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fb5cc010ac0 con 0x7fb5dc1022a0 2024-08-18T22:05:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.101+0000 7fb5d27fc640 1 --2- 172.21.15.123:0/1312832719 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb5c80a2b80 0x7fb5c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.101+0000 7fb5e1165640 1 --2- 172.21.15.123:0/1312832719 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb5c80a2b80 0x7fb5c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.101+0000 7fb5d27fc640 1 -- 172.21.15.123:0/1312832719 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fb5cc0cf6a0 con 0x7fb5dc1022a0 2024-08-18T22:05:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.102+0000 7fb5e1165640 1 --2- 172.21.15.123:0/1312832719 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb5c80a2b80 0x7fb5c80a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4005fd0 tx=0x7fb5d400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.105+0000 7fb5d27fc640 1 -- 172.21.15.123:0/1312832719 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb5cc09c360 con 0x7fb5dc1022a0 2024-08-18T22:05:50.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.274+0000 7fb5e33c9640 1 -- 172.21.15.123:0/1312832719 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5dc109e00 con 0x7fb5dc1022a0 2024-08-18T22:05:50.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.275+0000 7fb5d27fc640 1 -- 172.21.15.123:0/1312832719 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24188 (secure 0 0 0) 0x7fb5cc09bc60 con 0x7fb5dc1022a0 2024-08-18T22:05:50.276 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:05:50.276 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":88,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:05:31.552970+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:05:18.077632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:05:20.808463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:05:27.136662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:05:50.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.277+0000 7fb5e33c9640 1 -- 172.21.15.123:0/1312832719 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb5c80a2b80 msgr2=0x7fb5c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:50.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.277+0000 7fb5e33c9640 1 --2- 172.21.15.123:0/1312832719 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb5c80a2b80 0x7fb5c80a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4005fd0 tx=0x7fb5d400b390 comp rx=0 tx=0).stop 2024-08-18T22:05:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.277+0000 7fb5e33c9640 1 -- 172.21.15.123:0/1312832719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5dc1022a0 msgr2=0x7fb5dc198700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.277+0000 7fb5e33c9640 1 --2- 172.21.15.123:0/1312832719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5dc1022a0 0x7fb5dc198700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00e9f0 tx=0x7fb5cc00eeb0 comp rx=0 tx=0).stop 2024-08-18T22:05:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.277+0000 7fb5e33c9640 1 -- 172.21.15.123:0/1312832719 shutdown_connections 2024-08-18T22:05:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.277+0000 7fb5e33c9640 1 --2- 172.21.15.123:0/1312832719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5dc102c20 0x7fb5dc19ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.277+0000 7fb5e33c9640 1 --2- 172.21.15.123:0/1312832719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5dc1022a0 0x7fb5dc198700 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.277+0000 7fb5e33c9640 1 --2- 172.21.15.123:0/1312832719 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb5c80a2b80 0x7fb5c80a5040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.277+0000 7fb5e33c9640 1 --2- 172.21.15.123:0/1312832719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5dc100b50 0x7fb5dc1981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.277+0000 7fb5e33c9640 1 -- 172.21.15.123:0/1312832719 >> 172.21.15.123:0/1312832719 conn(0x7fb5dc0fc500 msgr2=0x7fb5dc069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.277+0000 7fb5e33c9640 1 -- 172.21.15.123:0/1312832719 shutdown_connections 2024-08-18T22:05:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:50.277+0000 7fb5e33c9640 1 -- 172.21.15.123:0/1312832719 wait complete. 2024-08-18T22:05:50.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:50 smithi123 ceph-mon[18462]: pgmap v278: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-08-18T22:05:50.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:50 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1312832719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:05:50.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:50 smithi130 ceph-mon[21698]: pgmap v278: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-08-18T22:05:50.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:50 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1312832719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:05:50.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:50 smithi183 ceph-mon[22097]: pgmap v278: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-08-18T22:05:50.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:50 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1312832719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:05:50.969 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:05:51.217 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:51.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.715+0000 7feb319ec640 1 -- 172.21.15.123:0/614036970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb2c1078a0 msgr2=0x7feb2c107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:51.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.715+0000 7feb319ec640 1 --2- 172.21.15.123:0/614036970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb2c1078a0 0x7feb2c107c80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feb24009930 tx=0x7feb2402a420 comp rx=0 tx=0).stop 2024-08-18T22:05:51.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.715+0000 7feb319ec640 1 -- 172.21.15.123:0/614036970 shutdown_connections 2024-08-18T22:05:51.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.715+0000 7feb319ec640 1 --2- 172.21.15.123:0/614036970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2c102240 0x7feb2c10e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:51.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.715+0000 7feb319ec640 1 --2- 172.21.15.123:0/614036970 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb2c1018a0 0x7feb2c101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:51.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.715+0000 7feb319ec640 1 --2- 172.21.15.123:0/614036970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb2c1078a0 0x7feb2c107c80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:51.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.715+0000 7feb319ec640 1 -- 172.21.15.123:0/614036970 >> 172.21.15.123:0/614036970 conn(0x7feb2c0fd5e0 msgr2=0x7feb2c0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:51.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.715+0000 7feb319ec640 1 -- 172.21.15.123:0/614036970 shutdown_connections 2024-08-18T22:05:51.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.715+0000 7feb319ec640 1 -- 172.21.15.123:0/614036970 wait complete. 2024-08-18T22:05:51.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.715+0000 7feb319ec640 1 Processor -- start 2024-08-18T22:05:51.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb319ec640 1 -- start start 2024-08-18T22:05:51.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb319ec640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb2c1018a0 0x7feb2c198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:51.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb319ec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb2c102240 0x7feb2c198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:51.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb319ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2c1078a0 0x7feb2c19cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:51.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb319ec640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c111ca0 con 0x7feb2c1018a0 2024-08-18T22:05:51.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb319ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c111b20 con 0x7feb2c1078a0 2024-08-18T22:05:51.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb319ec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c111e20 con 0x7feb2c102240 2024-08-18T22:05:51.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb2affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb2c1018a0 0x7feb2c198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:51.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb2affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb2c1018a0 0x7feb2c198200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42004/0 (socket says 172.21.15.123:42004) 2024-08-18T22:05:51.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb2affd640 1 -- 172.21.15.123:0/1623635199 learned_addr learned my addr 172.21.15.123:0/1623635199 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:51.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb2a7fc640 1 --2- 172.21.15.123:0/1623635199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb2c102240 0x7feb2c198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:51.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb2b7fe640 1 --2- 172.21.15.123:0/1623635199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2c1078a0 0x7feb2c19cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:51.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb2affd640 1 -- 172.21.15.123:0/1623635199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb2c102240 msgr2=0x7feb2c198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb2affd640 1 --2- 172.21.15.123:0/1623635199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb2c102240 0x7feb2c198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb2affd640 1 -- 172.21.15.123:0/1623635199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2c1078a0 msgr2=0x7feb2c19cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb2affd640 1 --2- 172.21.15.123:0/1623635199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2c1078a0 0x7feb2c19cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb2affd640 1 -- 172.21.15.123:0/1623635199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2c19d1b0 con 0x7feb2c1018a0 2024-08-18T22:05:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb2b7fe640 1 --2- 172.21.15.123:0/1623635199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2c1078a0 0x7feb2c19cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:05:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.716+0000 7feb2affd640 1 --2- 172.21.15.123:0/1623635199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb2c1018a0 0x7feb2c198200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feb24009230 tx=0x7feb24004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.717+0000 7feb309ea640 1 -- 172.21.15.123:0/1623635199 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2403f030 con 0x7feb2c1018a0 2024-08-18T22:05:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.717+0000 7feb319ec640 1 -- 172.21.15.123:0/1623635199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2c19d440 con 0x7feb2c1018a0 2024-08-18T22:05:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.717+0000 7feb309ea640 1 -- 172.21.15.123:0/1623635199 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb24003ad0 con 0x7feb2c1018a0 2024-08-18T22:05:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.717+0000 7feb309ea640 1 -- 172.21.15.123:0/1623635199 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb24035070 con 0x7feb2c1018a0 2024-08-18T22:05:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.717+0000 7feb319ec640 1 -- 172.21.15.123:0/1623635199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb2c1a4d80 con 0x7feb2c1018a0 2024-08-18T22:05:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.718+0000 7feb319ec640 1 -- 172.21.15.123:0/1623635199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb2c101d00 con 0x7feb2c1018a0 2024-08-18T22:05:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.719+0000 7feb309ea640 1 -- 172.21.15.123:0/1623635199 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7feb24042030 con 0x7feb2c1018a0 2024-08-18T22:05:51.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.719+0000 7feb309ea640 1 --2- 172.21.15.123:0/1623635199 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feb140a2b80 0x7feb140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:51.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.719+0000 7feb2a7fc640 1 --2- 172.21.15.123:0/1623635199 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feb140a2b80 0x7feb140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:51.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.719+0000 7feb309ea640 1 -- 172.21.15.123:0/1623635199 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7feb240ef400 con 0x7feb2c1018a0 2024-08-18T22:05:51.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.720+0000 7feb2a7fc640 1 --2- 172.21.15.123:0/1623635199 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feb140a2b80 0x7feb140a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0ffc20 tx=0x7feb20009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:51.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.724+0000 7feb309ea640 1 -- 172.21.15.123:0/1623635199 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7feb240bc120 con 0x7feb2c1018a0 2024-08-18T22:05:51.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.897+0000 7feb319ec640 1 -- 172.21.15.123:0/1623635199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb2c109e10 con 0x7feb2c1018a0 2024-08-18T22:05:51.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.898+0000 7feb309ea640 1 -- 172.21.15.123:0/1623635199 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24188 (secure 0 0 0) 0x7feb240bba20 con 0x7feb2c1018a0 2024-08-18T22:05:51.899 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:05:51.900 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":88,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:05:31.552970+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:05:18.077632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:05:20.808463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:05:27.136662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:05:51.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.900+0000 7feb319ec640 1 -- 172.21.15.123:0/1623635199 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feb140a2b80 msgr2=0x7feb140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:51.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.900+0000 7feb319ec640 1 --2- 172.21.15.123:0/1623635199 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feb140a2b80 0x7feb140a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0ffc20 tx=0x7feb20009680 comp rx=0 tx=0).stop 2024-08-18T22:05:51.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.900+0000 7feb319ec640 1 -- 172.21.15.123:0/1623635199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb2c1018a0 msgr2=0x7feb2c198200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:51.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.900+0000 7feb319ec640 1 --2- 172.21.15.123:0/1623635199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb2c1018a0 0x7feb2c198200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feb24009230 tx=0x7feb24004270 comp rx=0 tx=0).stop 2024-08-18T22:05:51.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.900+0000 7feb319ec640 1 -- 172.21.15.123:0/1623635199 shutdown_connections 2024-08-18T22:05:51.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.900+0000 7feb319ec640 1 --2- 172.21.15.123:0/1623635199 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feb140a2b80 0x7feb140a5040 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:51.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.900+0000 7feb319ec640 1 --2- 172.21.15.123:0/1623635199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2c1078a0 0x7feb2c19cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:51.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.900+0000 7feb319ec640 1 --2- 172.21.15.123:0/1623635199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb2c102240 0x7feb2c198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:51.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.900+0000 7feb319ec640 1 --2- 172.21.15.123:0/1623635199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb2c1018a0 0x7feb2c198200 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:51.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.900+0000 7feb319ec640 1 -- 172.21.15.123:0/1623635199 >> 172.21.15.123:0/1623635199 conn(0x7feb2c0fd5e0 msgr2=0x7feb2c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:51.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.901+0000 7feb319ec640 1 -- 172.21.15.123:0/1623635199 shutdown_connections 2024-08-18T22:05:51.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:51.901+0000 7feb319ec640 1 -- 172.21.15.123:0/1623635199 wait complete. 2024-08-18T22:05:52.582 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:52 smithi123 ceph-mon[18462]: pgmap v279: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-08-18T22:05:52.582 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:52 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1623635199' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:05:52.608 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-08-18T22:05:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:52 smithi130 ceph-mon[21698]: pgmap v279: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-08-18T22:05:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:52 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1623635199' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:05:52.765 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:52 smithi183 ceph-mon[22097]: pgmap v279: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-08-18T22:05:52.765 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:52 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1623635199' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:05:52.857 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:53.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.335+0000 7f809b131640 1 -- 172.21.15.123:0/1662700668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80941068b0 msgr2=0x7f8094106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:53.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.335+0000 7f809b131640 1 --2- 172.21.15.123:0/1662700668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80941068b0 0x7f8094106c90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8090009900 tx=0x7f809002a410 comp rx=0 tx=0).stop 2024-08-18T22:05:53.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.335+0000 7f809b131640 1 -- 172.21.15.123:0/1662700668 shutdown_connections 2024-08-18T22:05:53.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.335+0000 7f809b131640 1 --2- 172.21.15.123:0/1662700668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8094100780 0x7f809410e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:53.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.335+0000 7f809b131640 1 --2- 172.21.15.123:0/1662700668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80940ffde0 0x7f8094100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.335+0000 7f809b131640 1 --2- 172.21.15.123:0/1662700668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80941068b0 0x7f8094106c90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.335+0000 7f809b131640 1 -- 172.21.15.123:0/1662700668 >> 172.21.15.123:0/1662700668 conn(0x7f80940fbc10 msgr2=0x7f80940fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.335+0000 7f809b131640 1 -- 172.21.15.123:0/1662700668 shutdown_connections 2024-08-18T22:05:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.335+0000 7f809b131640 1 -- 172.21.15.123:0/1662700668 wait complete. 2024-08-18T22:05:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.336+0000 7f809b131640 1 Processor -- start 2024-08-18T22:05:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.336+0000 7f809b131640 1 -- start start 2024-08-18T22:05:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.336+0000 7f809b131640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80940ffde0 0x7f8094198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.336+0000 7f809b131640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8094100780 0x7f8094198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.336+0000 7f809b131640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80941068b0 0x7f809419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.336+0000 7f809b131640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8094111da0 con 0x7f8094100780 2024-08-18T22:05:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.336+0000 7f809b131640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8094111c20 con 0x7f80941068b0 2024-08-18T22:05:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.336+0000 7f809b131640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8094111f20 con 0x7f80940ffde0 2024-08-18T22:05:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.336+0000 7f808bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8094100780 0x7f8094198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.336+0000 7f808bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8094100780 0x7f8094198780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56286/0 (socket says 172.21.15.123:56286) 2024-08-18T22:05:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.336+0000 7f808bfff640 1 -- 172.21.15.123:0/3170367488 learned_addr learned my addr 172.21.15.123:0/3170367488 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.336+0000 7f8098ecd640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80940ffde0 0x7f8094198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.337+0000 7f80996ce640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80941068b0 0x7f809419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.337+0000 7f808bfff640 1 -- 172.21.15.123:0/3170367488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80940ffde0 msgr2=0x7f8094198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.337+0000 7f808bfff640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80940ffde0 0x7f8094198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.337+0000 7f808bfff640 1 -- 172.21.15.123:0/3170367488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80941068b0 msgr2=0x7f809419cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.337+0000 7f808bfff640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80941068b0 0x7f809419cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.337+0000 7f808bfff640 1 -- 172.21.15.123:0/3170367488 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809419d1f0 con 0x7f8094100780 2024-08-18T22:05:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.337+0000 7f80996ce640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80941068b0 0x7f809419cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:05:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.337+0000 7f8098ecd640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80940ffde0 0x7f8094198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:05:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.337+0000 7f808bfff640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8094100780 0x7f8094198780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f808400e9f0 tx=0x7f808400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.337+0000 7f8089ffb640 1 -- 172.21.15.123:0/3170367488 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808400cd80 con 0x7f8094100780 2024-08-18T22:05:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.337+0000 7f809b131640 1 -- 172.21.15.123:0/3170367488 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809419d4e0 con 0x7f8094100780 2024-08-18T22:05:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.337+0000 7f8089ffb640 1 -- 172.21.15.123:0/3170367488 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8084005500 con 0x7f8094100780 2024-08-18T22:05:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.337+0000 7f8089ffb640 1 -- 172.21.15.123:0/3170367488 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084010690 con 0x7f8094100780 2024-08-18T22:05:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.337+0000 7f809b131640 1 -- 172.21.15.123:0/3170367488 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80941a4dc0 con 0x7f8094100780 2024-08-18T22:05:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.338+0000 7f809b131640 1 -- 172.21.15.123:0/3170367488 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8094100240 con 0x7f8094100780 2024-08-18T22:05:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.339+0000 7f8089ffb640 1 -- 172.21.15.123:0/3170367488 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f80840046c0 con 0x7f8094100780 2024-08-18T22:05:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.340+0000 7f8089ffb640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f807c0a2b80 0x7f807c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.340+0000 7f8098ecd640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f807c0a2b80 0x7f807c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.340+0000 7f8089ffb640 1 -- 172.21.15.123:0/3170367488 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f80840cf7e0 con 0x7f8094100780 2024-08-18T22:05:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.340+0000 7f8098ecd640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f807c0a2b80 0x7f807c0a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8090005ab0 tx=0x7f8090005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.344+0000 7f8089ffb640 1 -- 172.21.15.123:0/3170367488 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f808409c500 con 0x7f8094100780 2024-08-18T22:05:53.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:53.548+0000 7f809b131640 1 -- 172.21.15.123:0/3170367488 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8094109da0 con 0x7f8094100780 2024-08-18T22:05:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:54.413+0000 7f8089ffb640 1 -- 172.21.15.123:0/3170367488 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f808409be00 con 0x7f8094100780 2024-08-18T22:05:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:54.416+0000 7f809b131640 1 -- 172.21.15.123:0/3170367488 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f807c0a2b80 msgr2=0x7f807c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:54.416+0000 7f809b131640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f807c0a2b80 0x7f807c0a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8090005ab0 tx=0x7f8090005a20 comp rx=0 tx=0).stop 2024-08-18T22:05:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:54.416+0000 7f809b131640 1 -- 172.21.15.123:0/3170367488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8094100780 msgr2=0x7f8094198780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:54.416+0000 7f809b131640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8094100780 0x7f8094198780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f808400e9f0 tx=0x7f808400edf0 comp rx=0 tx=0).stop 2024-08-18T22:05:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:54.416+0000 7f809b131640 1 -- 172.21.15.123:0/3170367488 shutdown_connections 2024-08-18T22:05:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:54.416+0000 7f809b131640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f807c0a2b80 0x7f807c0a5040 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:54.416+0000 7f809b131640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80941068b0 0x7f809419cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:54.416+0000 7f809b131640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8094100780 0x7f8094198780 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:54.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:54.416+0000 7f809b131640 1 --2- 172.21.15.123:0/3170367488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80940ffde0 0x7f8094198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:54.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:54.416+0000 7f809b131640 1 -- 172.21.15.123:0/3170367488 >> 172.21.15.123:0/3170367488 conn(0x7f80940fbc10 msgr2=0x7f80940fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:54.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:54.416+0000 7f809b131640 1 -- 172.21.15.123:0/3170367488 shutdown_connections 2024-08-18T22:05:54.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:54.416+0000 7f809b131640 1 -- 172.21.15.123:0/3170367488 wait complete. 2024-08-18T22:05:54.427 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:54 smithi123 ceph-mon[18462]: pgmap v280: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-08-18T22:05:54.427 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:54 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3170367488' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-08-18T22:05:54.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:54 smithi130 ceph-mon[21698]: pgmap v280: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-08-18T22:05:54.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:54 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3170367488' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-08-18T22:05:54.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:54 smithi183 ceph-mon[22097]: pgmap v280: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-08-18T22:05:54.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:54 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3170367488' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-08-18T22:05:55.067 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-08-18T22:05:55.067 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-08-18T22:05:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:55.745 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:55 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3170367488' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-18T22:05:55.745 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:55 smithi123 ceph-mon[18462]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-18T22:05:55.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:55 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3170367488' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-18T22:05:55.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:55 smithi130 ceph-mon[21698]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-18T22:05:55.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.825+0000 7f08bcf3f640 1 -- 172.21.15.123:0/1860647931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b81007a0 msgr2=0x7f08b8100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:55.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.825+0000 7f08bcf3f640 1 --2- 172.21.15.123:0/1860647931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b81007a0 0x7f08b8100c00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009930 tx=0x7f08ac02a420 comp rx=0 tx=0).stop 2024-08-18T22:05:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.825+0000 7f08bcf3f640 1 -- 172.21.15.123:0/1860647931 shutdown_connections 2024-08-18T22:05:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.825+0000 7f08bcf3f640 1 --2- 172.21.15.123:0/1860647931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b8101140 0x7f08b810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.825+0000 7f08bcf3f640 1 --2- 172.21.15.123:0/1860647931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b81007a0 0x7f08b8100c00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.825+0000 7f08bcf3f640 1 --2- 172.21.15.123:0/1860647931 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08b81067a0 0x7f08b8106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.825+0000 7f08bcf3f640 1 -- 172.21.15.123:0/1860647931 >> 172.21.15.123:0/1860647931 conn(0x7f08b80fc4c0 msgr2=0x7f08b80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.825+0000 7f08bcf3f640 1 -- 172.21.15.123:0/1860647931 shutdown_connections 2024-08-18T22:05:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.825+0000 7f08bcf3f640 1 -- 172.21.15.123:0/1860647931 wait complete. 2024-08-18T22:05:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.826+0000 7f08bcf3f640 1 Processor -- start 2024-08-18T22:05:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.826+0000 7f08bcf3f640 1 -- start start 2024-08-18T22:05:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.826+0000 7f08bcf3f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08b81007a0 0x7f08b81981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.826+0000 7f08bcf3f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b8101140 0x7f08b8198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.826+0000 7f08bcf3f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b81067a0 0x7f08b819ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.826+0000 7f08bcf3f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f08b8111cc0 con 0x7f08b8101140 2024-08-18T22:05:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.826+0000 7f08bcf3f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f08b8111b40 con 0x7f08b81067a0 2024-08-18T22:05:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.826+0000 7f08bcf3f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f08b8111e40 con 0x7f08b81007a0 2024-08-18T22:05:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08b5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b8101140 0x7f08b8198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08b5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b8101140 0x7f08b8198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56304/0 (socket says 172.21.15.123:56304) 2024-08-18T22:05:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08b5d9b640 1 -- 172.21.15.123:0/1849294853 learned_addr learned my addr 172.21.15.123:0/1849294853 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08b659c640 1 --2- 172.21.15.123:0/1849294853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08b81007a0 0x7f08b81981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08b6d9d640 1 --2- 172.21.15.123:0/1849294853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b81067a0 0x7f08b819ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08b5d9b640 1 -- 172.21.15.123:0/1849294853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08b81007a0 msgr2=0x7f08b81981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08b5d9b640 1 --2- 172.21.15.123:0/1849294853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08b81007a0 0x7f08b81981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08b5d9b640 1 -- 172.21.15.123:0/1849294853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b81067a0 msgr2=0x7f08b819ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08b5d9b640 1 --2- 172.21.15.123:0/1849294853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b81067a0 0x7f08b819ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08b5d9b640 1 -- 172.21.15.123:0/1849294853 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b819d170 con 0x7f08b8101140 2024-08-18T22:05:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08b6d9d640 1 --2- 172.21.15.123:0/1849294853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b81067a0 0x7f08b819ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:05:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08b5d9b640 1 --2- 172.21.15.123:0/1849294853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b8101140 0x7f08b8198700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009230 tx=0x7f08ac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08a77fe640 1 -- 172.21.15.123:0/1849294853 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac03f030 con 0x7f08b8101140 2024-08-18T22:05:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08bcf3f640 1 -- 172.21.15.123:0/1849294853 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b819d400 con 0x7f08b8101140 2024-08-18T22:05:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08a77fe640 1 -- 172.21.15.123:0/1849294853 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08ac003ad0 con 0x7f08b8101140 2024-08-18T22:05:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08a77fe640 1 -- 172.21.15.123:0/1849294853 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac035070 con 0x7f08b8101140 2024-08-18T22:05:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.827+0000 7f08bcf3f640 1 -- 172.21.15.123:0/1849294853 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b81a4d40 con 0x7f08b8101140 2024-08-18T22:05:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.828+0000 7f08bcf3f640 1 -- 172.21.15.123:0/1849294853 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b8100c00 con 0x7f08b8101140 2024-08-18T22:05:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.830+0000 7f08a77fe640 1 -- 172.21.15.123:0/1849294853 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f08ac042030 con 0x7f08b8101140 2024-08-18T22:05:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.830+0000 7f08a77fe640 1 --2- 172.21.15.123:0/1849294853 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f08a00a2b80 0x7f08a00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.830+0000 7f08b659c640 1 --2- 172.21.15.123:0/1849294853 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f08a00a2b80 0x7f08a00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.830+0000 7f08a77fe640 1 -- 172.21.15.123:0/1849294853 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f08ac0ef820 con 0x7f08b8101140 2024-08-18T22:05:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.831+0000 7f08b659c640 1 --2- 172.21.15.123:0/1849294853 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f08a00a2b80 0x7f08a00a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f08a8005fd0 tx=0x7f08a8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:55.834+0000 7f08a77fe640 1 -- 172.21.15.123:0/1849294853 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f08ac0bc540 con 0x7f08b8101140 2024-08-18T22:05:55.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:55 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3170367488' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-18T22:05:55.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:55 smithi183 ceph-mon[22097]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-18T22:05:56.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:56.038+0000 7f08bcf3f640 1 -- 172.21.15.123:0/1849294853 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f08b8108d60 con 0x7f08b8101140 2024-08-18T22:05:56.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:56.429+0000 7f08a77fe640 1 -- 172.21.15.123:0/1849294853 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f08ac0bbe40 con 0x7f08b8101140 2024-08-18T22:05:56.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:56.432+0000 7f08bcf3f640 1 -- 172.21.15.123:0/1849294853 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f08a00a2b80 msgr2=0x7f08a00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:56.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:56.432+0000 7f08bcf3f640 1 --2- 172.21.15.123:0/1849294853 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f08a00a2b80 0x7f08a00a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f08a8005fd0 tx=0x7f08a8005850 comp rx=0 tx=0).stop 2024-08-18T22:05:56.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:56.432+0000 7f08bcf3f640 1 -- 172.21.15.123:0/1849294853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b8101140 msgr2=0x7f08b8198700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:56.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:56.432+0000 7f08bcf3f640 1 --2- 172.21.15.123:0/1849294853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b8101140 0x7f08b8198700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009230 tx=0x7f08ac004270 comp rx=0 tx=0).stop 2024-08-18T22:05:56.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:56.432+0000 7f08bcf3f640 1 -- 172.21.15.123:0/1849294853 shutdown_connections 2024-08-18T22:05:56.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:56.432+0000 7f08bcf3f640 1 --2- 172.21.15.123:0/1849294853 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f08a00a2b80 0x7f08a00a5040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:56.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:56.432+0000 7f08bcf3f640 1 --2- 172.21.15.123:0/1849294853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b81067a0 0x7f08b819ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:56.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:56.432+0000 7f08bcf3f640 1 --2- 172.21.15.123:0/1849294853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b8101140 0x7f08b8198700 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:56.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:56.432+0000 7f08bcf3f640 1 --2- 172.21.15.123:0/1849294853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08b81007a0 0x7f08b81981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:56.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:56.432+0000 7f08bcf3f640 1 -- 172.21.15.123:0/1849294853 >> 172.21.15.123:0/1849294853 conn(0x7f08b80fc4c0 msgr2=0x7f08b80fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:56.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:56.432+0000 7f08bcf3f640 1 -- 172.21.15.123:0/1849294853 shutdown_connections 2024-08-18T22:05:56.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:56.432+0000 7f08bcf3f640 1 -- 172.21.15.123:0/1849294853 wait complete. 2024-08-18T22:05:56.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:56 smithi123 ceph-mon[18462]: pgmap v281: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-18T22:05:56.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:56 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1849294853' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-08-18T22:05:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:56 smithi130 ceph-mon[21698]: pgmap v281: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-18T22:05:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:56 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1849294853' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-08-18T22:05:56.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:56 smithi183 ceph-mon[22097]: pgmap v281: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-18T22:05:56.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:56 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1849294853' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-08-18T22:05:57.136 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-08-18T22:05:57.390 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:57.690 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:57 smithi123 ceph-mon[18462]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-18T22:05:57.691 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:57 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1849294853' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-18T22:05:57.691 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:57 smithi123 ceph-mon[18462]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-18T22:05:57.691 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:57 smithi123 ceph-mon[18462]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-18T22:05:57.691 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:57 smithi123 ceph-mon[18462]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-08-18T22:05:57.692 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:57 smithi123 ceph-mon[18462]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-08-18T22:05:57.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:57 smithi130 ceph-mon[21698]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-18T22:05:57.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:57 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1849294853' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-18T22:05:57.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:57 smithi130 ceph-mon[21698]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-18T22:05:57.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:57 smithi130 ceph-mon[21698]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-18T22:05:57.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:57 smithi130 ceph-mon[21698]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-08-18T22:05:57.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:57 smithi130 ceph-mon[21698]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-08-18T22:05:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:57 smithi183 ceph-mon[22097]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-18T22:05:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:57 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1849294853' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-18T22:05:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:57 smithi183 ceph-mon[22097]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-18T22:05:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:57 smithi183 ceph-mon[22097]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-18T22:05:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:57 smithi183 ceph-mon[22097]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-08-18T22:05:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:57 smithi183 ceph-mon[22097]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-08-18T22:05:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.902+0000 7f130935c640 1 -- 172.21.15.123:0/3320666605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13041078b0 msgr2=0x7f1304107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.902+0000 7f130935c640 1 --2- 172.21.15.123:0/3320666605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13041078b0 0x7f1304107c90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009930 tx=0x7f12f402a420 comp rx=0 tx=0).stop 2024-08-18T22:05:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.902+0000 7f130935c640 1 -- 172.21.15.123:0/3320666605 shutdown_connections 2024-08-18T22:05:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.902+0000 7f130935c640 1 --2- 172.21.15.123:0/3320666605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1304102250 0x7f130410e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.902+0000 7f130935c640 1 --2- 172.21.15.123:0/3320666605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13041018b0 0x7f1304101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.902+0000 7f130935c640 1 --2- 172.21.15.123:0/3320666605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13041078b0 0x7f1304107c90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.902+0000 7f130935c640 1 -- 172.21.15.123:0/3320666605 >> 172.21.15.123:0/3320666605 conn(0x7f13040fd5f0 msgr2=0x7f13040ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.902+0000 7f130935c640 1 -- 172.21.15.123:0/3320666605 shutdown_connections 2024-08-18T22:05:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.902+0000 7f130935c640 1 -- 172.21.15.123:0/3320666605 wait complete. 2024-08-18T22:05:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.903+0000 7f130935c640 1 Processor -- start 2024-08-18T22:05:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.903+0000 7f130935c640 1 -- start start 2024-08-18T22:05:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.903+0000 7f130935c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13041018b0 0x7f1304074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.903+0000 7f130935c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1304102250 0x7f1304074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.903+0000 7f130935c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13041078b0 0x7f1304074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.903+0000 7f130935c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1304111cd0 con 0x7f13041018b0 2024-08-18T22:05:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.903+0000 7f130935c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1304111b50 con 0x7f13041078b0 2024-08-18T22:05:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.903+0000 7f130935c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1304111e50 con 0x7f1304102250 2024-08-18T22:05:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.903+0000 7f1302ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13041018b0 0x7f1304074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.903+0000 7f1302ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13041018b0 0x7f1304074220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56320/0 (socket says 172.21.15.123:56320) 2024-08-18T22:05:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.903+0000 7f1302ffd640 1 -- 172.21.15.123:0/1993873205 learned_addr learned my addr 172.21.15.123:0/1993873205 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.904+0000 7f13027fc640 1 --2- 172.21.15.123:0/1993873205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1304102250 0x7f1304074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.904+0000 7f13037fe640 1 --2- 172.21.15.123:0/1993873205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13041078b0 0x7f1304074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.904+0000 7f1302ffd640 1 -- 172.21.15.123:0/1993873205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1304102250 msgr2=0x7f1304074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.904+0000 7f1302ffd640 1 --2- 172.21.15.123:0/1993873205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1304102250 0x7f1304074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.904+0000 7f1302ffd640 1 -- 172.21.15.123:0/1993873205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13041078b0 msgr2=0x7f1304074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.904+0000 7f1302ffd640 1 --2- 172.21.15.123:0/1993873205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13041078b0 0x7f1304074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.904+0000 7f1302ffd640 1 -- 172.21.15.123:0/1993873205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13041a6610 con 0x7f13041018b0 2024-08-18T22:05:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.904+0000 7f1302ffd640 1 --2- 172.21.15.123:0/1993873205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13041018b0 0x7f1304074220 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009a50 tx=0x7f12f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.904+0000 7f12ebfff640 1 -- 172.21.15.123:0/1993873205 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f403f030 con 0x7f13041018b0 2024-08-18T22:05:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.904+0000 7f130935c640 1 -- 172.21.15.123:0/1993873205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13041a68a0 con 0x7f13041018b0 2024-08-18T22:05:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.904+0000 7f12ebfff640 1 -- 172.21.15.123:0/1993873205 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12f4003ce0 con 0x7f13041018b0 2024-08-18T22:05:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.904+0000 7f12ebfff640 1 -- 172.21.15.123:0/1993873205 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f4035070 con 0x7f13041018b0 2024-08-18T22:05:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.904+0000 7f130935c640 1 -- 172.21.15.123:0/1993873205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13041a6dd0 con 0x7f13041018b0 2024-08-18T22:05:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.905+0000 7f130935c640 1 -- 172.21.15.123:0/1993873205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1304101d10 con 0x7f13041018b0 2024-08-18T22:05:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.906+0000 7f12ebfff640 1 -- 172.21.15.123:0/1993873205 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f12f4042030 con 0x7f13041018b0 2024-08-18T22:05:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.907+0000 7f12ebfff640 1 --2- 172.21.15.123:0/1993873205 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f12ec0a2b80 0x7f12ec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.908+0000 7f13027fc640 1 --2- 172.21.15.123:0/1993873205 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f12ec0a2b80 0x7f12ec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.908+0000 7f12ebfff640 1 -- 172.21.15.123:0/1993873205 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f12f40efd80 con 0x7f13041018b0 2024-08-18T22:05:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.908+0000 7f13027fc640 1 --2- 172.21.15.123:0/1993873205 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f12ec0a2b80 0x7f12ec0a5040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f12f8005e10 tx=0x7f12f8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:57.911+0000 7f12ebfff640 1 -- 172.21.15.123:0/1993873205 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f12f40bca40 con 0x7f13041018b0 2024-08-18T22:05:58.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:58.113+0000 7f130935c640 1 -- 172.21.15.123:0/1993873205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f13041a7030 con 0x7f13041018b0 2024-08-18T22:05:58.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:58.446+0000 7f12ebfff640 1 -- 172.21.15.123:0/1993873205 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f12f40bc340 con 0x7f13041018b0 2024-08-18T22:05:58.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:58.448+0000 7f130935c640 1 -- 172.21.15.123:0/1993873205 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f12ec0a2b80 msgr2=0x7f12ec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:58.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:58.448+0000 7f130935c640 1 --2- 172.21.15.123:0/1993873205 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f12ec0a2b80 0x7f12ec0a5040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f12f8005e10 tx=0x7f12f8005da0 comp rx=0 tx=0).stop 2024-08-18T22:05:58.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:58.448+0000 7f130935c640 1 -- 172.21.15.123:0/1993873205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13041018b0 msgr2=0x7f1304074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:58.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:58.448+0000 7f130935c640 1 --2- 172.21.15.123:0/1993873205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13041018b0 0x7f1304074220 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009a50 tx=0x7f12f4004270 comp rx=0 tx=0).stop 2024-08-18T22:05:58.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:58.448+0000 7f130935c640 1 -- 172.21.15.123:0/1993873205 shutdown_connections 2024-08-18T22:05:58.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:58.448+0000 7f130935c640 1 --2- 172.21.15.123:0/1993873205 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f12ec0a2b80 0x7f12ec0a5040 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:58.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:58.448+0000 7f130935c640 1 --2- 172.21.15.123:0/1993873205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13041078b0 0x7f1304074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:58.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:58.448+0000 7f130935c640 1 --2- 172.21.15.123:0/1993873205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1304102250 0x7f1304074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:58.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:58.448+0000 7f130935c640 1 --2- 172.21.15.123:0/1993873205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13041018b0 0x7f1304074220 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:58.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:58.448+0000 7f130935c640 1 -- 172.21.15.123:0/1993873205 >> 172.21.15.123:0/1993873205 conn(0x7f13040fd5f0 msgr2=0x7f13040fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:58.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:58.448+0000 7f130935c640 1 -- 172.21.15.123:0/1993873205 shutdown_connections 2024-08-18T22:05:58.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:58.448+0000 7f130935c640 1 -- 172.21.15.123:0/1993873205 wait complete. 2024-08-18T22:05:58.659 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:05:58 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: 2024-08-18T22:05:58.395+0000 7fcbda086640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-08-18T22:05:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:58 smithi183 ceph-mon[22097]: pgmap v282: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-18T22:05:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:58 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] up:active 2024-08-18T22:05:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:58 smithi183 ceph-mon[22097]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-18T22:05:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:58 smithi183 ceph-mon[22097]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-18T22:05:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:58 smithi183 ceph-mon[22097]: Cluster is now healthy 2024-08-18T22:05:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:58 smithi183 ceph-mon[22097]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-08-18T22:05:58.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:58 smithi183 ceph-mon[22097]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-08-18T22:05:58.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:58 smithi183 ceph-mon[22097]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-18T22:05:58.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:58 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1993873205' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-18T22:05:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:58 smithi123 ceph-mon[18462]: pgmap v282: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-18T22:05:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:58 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] up:active 2024-08-18T22:05:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:58 smithi123 ceph-mon[18462]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-18T22:05:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:58 smithi123 ceph-mon[18462]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-18T22:05:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:58 smithi123 ceph-mon[18462]: Cluster is now healthy 2024-08-18T22:05:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:58 smithi123 ceph-mon[18462]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-08-18T22:05:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:58 smithi123 ceph-mon[18462]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-08-18T22:05:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:58 smithi123 ceph-mon[18462]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-18T22:05:58.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:58 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1993873205' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-18T22:05:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:58 smithi130 ceph-mon[21698]: pgmap v282: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-18T22:05:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:58 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] up:active 2024-08-18T22:05:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:58 smithi130 ceph-mon[21698]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-18T22:05:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:58 smithi130 ceph-mon[21698]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-18T22:05:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:58 smithi130 ceph-mon[21698]: Cluster is now healthy 2024-08-18T22:05:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:58 smithi130 ceph-mon[21698]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-08-18T22:05:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:58 smithi130 ceph-mon[21698]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-08-18T22:05:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:58 smithi130 ceph-mon[21698]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-18T22:05:58.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:58 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1993873205' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-18T22:05:59.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-08-18T22:05:59.408 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:05:59.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:59 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1993873205' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-18T22:05:59.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:59 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] up:active 2024-08-18T22:05:59.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:59 smithi123 ceph-mon[18462]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-08-18T22:05:59.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:05:59 smithi123 ceph-mon[18462]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:05:59.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:59 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1993873205' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-18T22:05:59.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:59 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] up:active 2024-08-18T22:05:59.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:59 smithi130 ceph-mon[21698]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-08-18T22:05:59.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:05:59 smithi130 ceph-mon[21698]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:05:59.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.880+0000 7f35ef903640 1 -- 172.21.15.123:0/2947663766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e81007b0 msgr2=0x7f35e8100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:59.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.880+0000 7f35ef903640 1 --2- 172.21.15.123:0/2947663766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e81007b0 0x7f35e8100c10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009930 tx=0x7f35e402a420 comp rx=0 tx=0).stop 2024-08-18T22:05:59.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.880+0000 7f35ef903640 1 -- 172.21.15.123:0/2947663766 shutdown_connections 2024-08-18T22:05:59.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.880+0000 7f35ef903640 1 --2- 172.21.15.123:0/2947663766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e8101150 0x7f35e810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:59.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.880+0000 7f35ef903640 1 --2- 172.21.15.123:0/2947663766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e81007b0 0x7f35e8100c10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:59.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.880+0000 7f35ef903640 1 --2- 172.21.15.123:0/2947663766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35e81067b0 0x7f35e8106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:59.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.880+0000 7f35ef903640 1 -- 172.21.15.123:0/2947663766 >> 172.21.15.123:0/2947663766 conn(0x7f35e80fc4d0 msgr2=0x7f35e80fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:05:59.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.880+0000 7f35ef903640 1 -- 172.21.15.123:0/2947663766 shutdown_connections 2024-08-18T22:05:59.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.880+0000 7f35ef903640 1 -- 172.21.15.123:0/2947663766 wait complete. 2024-08-18T22:05:59.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.880+0000 7f35ef903640 1 Processor -- start 2024-08-18T22:05:59.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.880+0000 7f35ef903640 1 -- start start 2024-08-18T22:05:59.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35ef903640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35e81007b0 0x7f35e8199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:59.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35ef903640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e8101150 0x7f35e8199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:59.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35ef903640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e81067b0 0x7f35e81a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:59.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35ef903640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8110bd0 con 0x7f35e81067b0 2024-08-18T22:05:59.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35ef903640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8110a50 con 0x7f35e8101150 2024-08-18T22:05:59.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35ef903640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8110d50 con 0x7f35e81007b0 2024-08-18T22:05:59.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35edea0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e81067b0 0x7f35e81a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:59.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35edea0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e81067b0 0x7f35e81a40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56346/0 (socket says 172.21.15.123:56346) 2024-08-18T22:05:59.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35ece9e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e8101150 0x7f35e8199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:59.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35edea0640 1 -- 172.21.15.123:0/3406365310 learned_addr learned my addr 172.21.15.123:0/3406365310 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:05:59.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35ed69f640 1 --2- 172.21.15.123:0/3406365310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35e81007b0 0x7f35e8199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:59.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35edea0640 1 -- 172.21.15.123:0/3406365310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35e81007b0 msgr2=0x7f35e8199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:59.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35edea0640 1 --2- 172.21.15.123:0/3406365310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35e81007b0 0x7f35e8199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:59.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35edea0640 1 -- 172.21.15.123:0/3406365310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e8101150 msgr2=0x7f35e8199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:05:59.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35edea0640 1 --2- 172.21.15.123:0/3406365310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e8101150 0x7f35e8199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:05:59.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35edea0640 1 -- 172.21.15.123:0/3406365310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e81a45e0 con 0x7f35e81067b0 2024-08-18T22:05:59.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35edea0640 1 --2- 172.21.15.123:0/3406365310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e81067b0 0x7f35e81a40a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f35e000cce0 tx=0x7f35e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:59.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.881+0000 7f35de7fc640 1 -- 172.21.15.123:0/3406365310 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e000f450 con 0x7f35e81067b0 2024-08-18T22:05:59.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.882+0000 7f35ef903640 1 -- 172.21.15.123:0/3406365310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e81a47b0 con 0x7f35e81067b0 2024-08-18T22:05:59.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.882+0000 7f35de7fc640 1 -- 172.21.15.123:0/3406365310 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35e000fad0 con 0x7f35e81067b0 2024-08-18T22:05:59.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.882+0000 7f35de7fc640 1 -- 172.21.15.123:0/3406365310 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e0018c10 con 0x7f35e81067b0 2024-08-18T22:05:59.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.882+0000 7f35ef903640 1 -- 172.21.15.123:0/3406365310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e81a4c70 con 0x7f35e81067b0 2024-08-18T22:05:59.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.882+0000 7f35ef903640 1 -- 172.21.15.123:0/3406365310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e8100c10 con 0x7f35e81067b0 2024-08-18T22:05:59.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.884+0000 7f35de7fc640 1 -- 172.21.15.123:0/3406365310 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f35e000f5f0 con 0x7f35e81067b0 2024-08-18T22:05:59.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.884+0000 7f35de7fc640 1 --2- 172.21.15.123:0/3406365310 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f35d40a2b80 0x7f35d40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:05:59.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.884+0000 7f35ed69f640 1 --2- 172.21.15.123:0/3406365310 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f35d40a2b80 0x7f35d40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:05:59.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.884+0000 7f35de7fc640 1 -- 172.21.15.123:0/3406365310 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f35e00cf970 con 0x7f35e81067b0 2024-08-18T22:05:59.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.885+0000 7f35ed69f640 1 --2- 172.21.15.123:0/3406365310 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f35d40a2b80 0x7f35d40a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009890 tx=0x7f35d8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:05:59.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:05:59.888+0000 7f35de7fc640 1 -- 172.21.15.123:0/3406365310 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f35e0014030 con 0x7f35e81067b0 2024-08-18T22:05:59.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:59 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1993873205' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-18T22:05:59.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:59 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] up:active 2024-08-18T22:05:59.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:59 smithi183 ceph-mon[22097]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-08-18T22:05:59.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:05:59 smithi183 ceph-mon[22097]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:06:00.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:00.090+0000 7f35ef903640 1 -- 172.21.15.123:0/3406365310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f35e8108d40 con 0x7f35e81067b0 2024-08-18T22:06:00.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:00.464+0000 7f35de7fc640 1 -- 172.21.15.123:0/3406365310 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7f35e009c690 con 0x7f35e81067b0 2024-08-18T22:06:00.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:00.467+0000 7f35ef903640 1 -- 172.21.15.123:0/3406365310 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f35d40a2b80 msgr2=0x7f35d40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:00.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:00.467+0000 7f35ef903640 1 --2- 172.21.15.123:0/3406365310 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f35d40a2b80 0x7f35d40a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009890 tx=0x7f35d8008040 comp rx=0 tx=0).stop 2024-08-18T22:06:00.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:00.467+0000 7f35ef903640 1 -- 172.21.15.123:0/3406365310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e81067b0 msgr2=0x7f35e81a40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:00.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:00.467+0000 7f35ef903640 1 --2- 172.21.15.123:0/3406365310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e81067b0 0x7f35e81a40a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f35e000cce0 tx=0x7f35e000a620 comp rx=0 tx=0).stop 2024-08-18T22:06:00.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:00.467+0000 7f35ef903640 1 -- 172.21.15.123:0/3406365310 shutdown_connections 2024-08-18T22:06:00.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:00.467+0000 7f35ef903640 1 --2- 172.21.15.123:0/3406365310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35e81067b0 0x7f35e81a40a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:00.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:00.467+0000 7f35ef903640 1 --2- 172.21.15.123:0/3406365310 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f35d40a2b80 0x7f35d40a5040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:00.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:00.467+0000 7f35ef903640 1 --2- 172.21.15.123:0/3406365310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e8101150 0x7f35e8199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:00.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:00.467+0000 7f35ef903640 1 --2- 172.21.15.123:0/3406365310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35e81007b0 0x7f35e8199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:00.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:00.467+0000 7f35ef903640 1 -- 172.21.15.123:0/3406365310 >> 172.21.15.123:0/3406365310 conn(0x7f35e80fc4d0 msgr2=0x7f35e80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:00.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:00.467+0000 7f35ef903640 1 -- 172.21.15.123:0/3406365310 shutdown_connections 2024-08-18T22:06:00.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:00.467+0000 7f35ef903640 1 -- 172.21.15.123:0/3406365310 wait complete. 2024-08-18T22:06:00.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:00 smithi123 ceph-mon[18462]: pgmap v283: 129 pgs: 129 active+clean; 583 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2.1 KiB/s wr, 5 op/s 2024-08-18T22:06:00.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:00 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3406365310' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-08-18T22:06:00.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:00 smithi130 ceph-mon[21698]: pgmap v283: 129 pgs: 129 active+clean; 583 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2.1 KiB/s wr, 5 op/s 2024-08-18T22:06:00.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:00 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3406365310' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-08-18T22:06:00.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:00 smithi183 ceph-mon[22097]: pgmap v283: 129 pgs: 129 active+clean; 583 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2.1 KiB/s wr, 5 op/s 2024-08-18T22:06:00.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:00 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3406365310' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-08-18T22:06:01.196 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-08-18T22:06:01.196 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-08-18T22:06:01.445 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:01.736 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:01 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3406365310' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-18T22:06:01.736 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:01 smithi123 ceph-mon[18462]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:06:01.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:01 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3406365310' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-18T22:06:01.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:01 smithi130 ceph-mon[21698]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:06:01.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:01 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3406365310' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-18T22:06:01.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:01 smithi183 ceph-mon[22097]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:06:01.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.945+0000 7fba4a510640 1 -- 172.21.15.123:0/3954972764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba441078b0 msgr2=0x7fba44107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:01.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.945+0000 7fba4a510640 1 --2- 172.21.15.123:0/3954972764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba441078b0 0x7fba44107c90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fba34009930 tx=0x7fba3402a420 comp rx=0 tx=0).stop 2024-08-18T22:06:01.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.945+0000 7fba4a510640 1 -- 172.21.15.123:0/3954972764 shutdown_connections 2024-08-18T22:06:01.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.945+0000 7fba4a510640 1 --2- 172.21.15.123:0/3954972764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba44102250 0x7fba4410e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:01.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.945+0000 7fba4a510640 1 --2- 172.21.15.123:0/3954972764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba441018b0 0x7fba44101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:01.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.945+0000 7fba4a510640 1 --2- 172.21.15.123:0/3954972764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba441078b0 0x7fba44107c90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:01.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.945+0000 7fba4a510640 1 -- 172.21.15.123:0/3954972764 >> 172.21.15.123:0/3954972764 conn(0x7fba440fd5f0 msgr2=0x7fba440ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:01.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.946+0000 7fba4a510640 1 -- 172.21.15.123:0/3954972764 shutdown_connections 2024-08-18T22:06:01.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.946+0000 7fba4a510640 1 -- 172.21.15.123:0/3954972764 wait complete. 2024-08-18T22:06:01.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.946+0000 7fba4a510640 1 Processor -- start 2024-08-18T22:06:01.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.946+0000 7fba4a510640 1 -- start start 2024-08-18T22:06:01.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.946+0000 7fba4a510640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba441018b0 0x7fba44198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:01.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.946+0000 7fba4a510640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba44102250 0x7fba441987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:01.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.946+0000 7fba4a510640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba441078b0 0x7fba4419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:01.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.946+0000 7fba4a510640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fba44111cd0 con 0x7fba441078b0 2024-08-18T22:06:01.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.946+0000 7fba4a510640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fba44111b50 con 0x7fba441018b0 2024-08-18T22:06:01.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.946+0000 7fba4a510640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fba44111e50 con 0x7fba44102250 2024-08-18T22:06:01.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba48aad640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba441078b0 0x7fba4419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:01.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba48aad640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba441078b0 0x7fba4419cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56366/0 (socket says 172.21.15.123:56366) 2024-08-18T22:06:01.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba48aad640 1 -- 172.21.15.123:0/747292413 learned_addr learned my addr 172.21.15.123:0/747292413 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:01.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba43fff640 1 --2- 172.21.15.123:0/747292413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba441018b0 0x7fba44198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:01.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba437fe640 1 --2- 172.21.15.123:0/747292413 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba44102250 0x7fba441987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:01.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba48aad640 1 -- 172.21.15.123:0/747292413 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba44102250 msgr2=0x7fba441987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:01.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba48aad640 1 --2- 172.21.15.123:0/747292413 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba44102250 0x7fba441987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:01.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba48aad640 1 -- 172.21.15.123:0/747292413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba441018b0 msgr2=0x7fba44198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:01.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba48aad640 1 --2- 172.21.15.123:0/747292413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba441018b0 0x7fba44198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:01.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba48aad640 1 -- 172.21.15.123:0/747292413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4419d240 con 0x7fba441078b0 2024-08-18T22:06:01.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba437fe640 1 --2- 172.21.15.123:0/747292413 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba44102250 0x7fba441987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:01.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba48aad640 1 --2- 172.21.15.123:0/747292413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba441078b0 0x7fba4419cb60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00cad0 tx=0x7fba3c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:01.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba417fa640 1 -- 172.21.15.123:0/747292413 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c00ae20 con 0x7fba441078b0 2024-08-18T22:06:01.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba417fa640 1 -- 172.21.15.123:0/747292413 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba3c005020 con 0x7fba441078b0 2024-08-18T22:06:01.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba417fa640 1 -- 172.21.15.123:0/747292413 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c00f6f0 con 0x7fba441078b0 2024-08-18T22:06:01.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba4a510640 1 -- 172.21.15.123:0/747292413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4419d530 con 0x7fba441078b0 2024-08-18T22:06:01.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.947+0000 7fba4a510640 1 -- 172.21.15.123:0/747292413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba441a4e10 con 0x7fba441078b0 2024-08-18T22:06:01.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.949+0000 7fba4a510640 1 -- 172.21.15.123:0/747292413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba44101d10 con 0x7fba441078b0 2024-08-18T22:06:01.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.949+0000 7fba417fa640 1 -- 172.21.15.123:0/747292413 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fba3c0051d0 con 0x7fba441078b0 2024-08-18T22:06:01.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.950+0000 7fba417fa640 1 --2- 172.21.15.123:0/747292413 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fba2c0a2b80 0x7fba2c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:01.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.950+0000 7fba43fff640 1 --2- 172.21.15.123:0/747292413 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fba2c0a2b80 0x7fba2c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:01.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.950+0000 7fba417fa640 1 -- 172.21.15.123:0/747292413 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fba3c0cf320 con 0x7fba441078b0 2024-08-18T22:06:01.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.951+0000 7fba43fff640 1 --2- 172.21.15.123:0/747292413 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fba2c0a2b80 0x7fba2c0a5040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fba34009900 tx=0x7fba340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:01.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:01.955+0000 7fba417fa640 1 -- 172.21.15.123:0/747292413 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fba3c014030 con 0x7fba441078b0 2024-08-18T22:06:02.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:02.146+0000 7fba4a510640 1 -- 172.21.15.123:0/747292413 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fba44062360 con 0x7fba2c0a2b80 2024-08-18T22:06:02.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:02.172+0000 7fba417fa640 1 -- 172.21.15.123:0/747292413 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fba44062360 con 0x7fba2c0a2b80 2024-08-18T22:06:02.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:02.174+0000 7fba4a510640 1 -- 172.21.15.123:0/747292413 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fba2c0a2b80 msgr2=0x7fba2c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:02.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:02.174+0000 7fba4a510640 1 --2- 172.21.15.123:0/747292413 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fba2c0a2b80 0x7fba2c0a5040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fba34009900 tx=0x7fba340058d0 comp rx=0 tx=0).stop 2024-08-18T22:06:02.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:02.174+0000 7fba4a510640 1 -- 172.21.15.123:0/747292413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba441078b0 msgr2=0x7fba4419cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:02.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:02.174+0000 7fba4a510640 1 --2- 172.21.15.123:0/747292413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba441078b0 0x7fba4419cb60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00cad0 tx=0x7fba3c00cf90 comp rx=0 tx=0).stop 2024-08-18T22:06:02.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:02.174+0000 7fba4a510640 1 -- 172.21.15.123:0/747292413 shutdown_connections 2024-08-18T22:06:02.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:02.174+0000 7fba4a510640 1 --2- 172.21.15.123:0/747292413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba441078b0 0x7fba4419cb60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:02.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:02.174+0000 7fba4a510640 1 --2- 172.21.15.123:0/747292413 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba44102250 0x7fba441987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:02.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:02.174+0000 7fba4a510640 1 --2- 172.21.15.123:0/747292413 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fba2c0a2b80 0x7fba2c0a5040 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:02.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:02.174+0000 7fba4a510640 1 --2- 172.21.15.123:0/747292413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba441018b0 0x7fba44198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:02.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:02.174+0000 7fba4a510640 1 -- 172.21.15.123:0/747292413 >> 172.21.15.123:0/747292413 conn(0x7fba440fd5f0 msgr2=0x7fba440fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:02.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:02.174+0000 7fba4a510640 1 -- 172.21.15.123:0/747292413 shutdown_connections 2024-08-18T22:06:02.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:02.174+0000 7fba4a510640 1 -- 172.21.15.123:0/747292413 wait complete. 2024-08-18T22:06:02.472 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 22:06:02 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T22:06:02.151+0000 7f3ea5c70640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-18T22:06:02.472 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 22:06:02 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T22:06:02.151+0000 7f3ea5c70640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-18T22:06:02.473 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 22:06:02 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T22:06:02.151+0000 7f3ea5c70640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-18T22:06:02.473 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 22:06:02 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T22:06:02.151+0000 7f3ea5c70640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-18T22:06:02.473 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 22:06:02 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x[18689]: 2024-08-18T22:06:02.151+0000 7f3ea5c70640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-18T22:06:02.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:02 smithi183 ceph-mon[22097]: pgmap v284: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-08-18T22:06:02.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:02 smithi123 ceph-mon[18462]: pgmap v284: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-08-18T22:06:02.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:02 smithi130 ceph-mon[21698]: pgmap v284: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-08-18T22:06:02.907 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-08-18T22:06:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:03.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:03 smithi123 ceph-mon[18462]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:06:03.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.656+0000 7fa016e35640 1 -- 172.21.15.123:0/4097322203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0101078c0 msgr2=0x7fa010107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:03.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.656+0000 7fa016e35640 1 --2- 172.21.15.123:0/4097322203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0101078c0 0x7fa010107ca0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa000009930 tx=0x7fa00002a420 comp rx=0 tx=0).stop 2024-08-18T22:06:03.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.656+0000 7fa016e35640 1 -- 172.21.15.123:0/4097322203 shutdown_connections 2024-08-18T22:06:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.656+0000 7fa016e35640 1 --2- 172.21.15.123:0/4097322203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa010102260 0x7fa01010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.656+0000 7fa016e35640 1 --2- 172.21.15.123:0/4097322203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0101018c0 0x7fa010101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.656+0000 7fa016e35640 1 --2- 172.21.15.123:0/4097322203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0101078c0 0x7fa010107ca0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.656+0000 7fa016e35640 1 -- 172.21.15.123:0/4097322203 >> 172.21.15.123:0/4097322203 conn(0x7fa0100fd620 msgr2=0x7fa0100ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.656+0000 7fa016e35640 1 -- 172.21.15.123:0/4097322203 shutdown_connections 2024-08-18T22:06:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.656+0000 7fa016e35640 1 -- 172.21.15.123:0/4097322203 wait complete. 2024-08-18T22:06:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.656+0000 7fa016e35640 1 Processor -- start 2024-08-18T22:06:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.656+0000 7fa016e35640 1 -- start start 2024-08-18T22:06:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.656+0000 7fa016e35640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0101018c0 0x7fa0101981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.656+0000 7fa016e35640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa010102260 0x7fa0101986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa016e35640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0101078c0 0x7fa01019ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa016e35640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa010111cc0 con 0x7fa0101018c0 2024-08-18T22:06:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa016e35640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa010111b40 con 0x7fa0101078c0 2024-08-18T22:06:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa016e35640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa010111e40 con 0x7fa010102260 2024-08-18T22:06:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa014bd1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0101018c0 0x7fa0101981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa014bd1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0101018c0 0x7fa0101981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36168/0 (socket says 172.21.15.123:36168) 2024-08-18T22:06:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa014bd1640 1 -- 172.21.15.123:0/622417569 learned_addr learned my addr 172.21.15.123:0/622417569 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa0153d2640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0101078c0 0x7fa01019ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa00ffff640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa010102260 0x7fa0101986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa014bd1640 1 -- 172.21.15.123:0/622417569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa010102260 msgr2=0x7fa0101986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa014bd1640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa010102260 0x7fa0101986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa014bd1640 1 -- 172.21.15.123:0/622417569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0101078c0 msgr2=0x7fa01019ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa014bd1640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0101078c0 0x7fa01019ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa014bd1640 1 -- 172.21.15.123:0/622417569 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01019d150 con 0x7fa0101018c0 2024-08-18T22:06:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa00ffff640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa010102260 0x7fa0101986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa0153d2640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0101078c0 0x7fa01019ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa014bd1640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0101018c0 0x7fa0101981a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa000009230 tx=0x7fa000004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa00dffb640 1 -- 172.21.15.123:0/622417569 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00003f030 con 0x7fa0101018c0 2024-08-18T22:06:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa016e35640 1 -- 172.21.15.123:0/622417569 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa01019d3e0 con 0x7fa0101018c0 2024-08-18T22:06:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa00dffb640 1 -- 172.21.15.123:0/622417569 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa000003ad0 con 0x7fa0101018c0 2024-08-18T22:06:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.657+0000 7fa00dffb640 1 -- 172.21.15.123:0/622417569 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000035070 con 0x7fa0101018c0 2024-08-18T22:06:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.658+0000 7fa016e35640 1 -- 172.21.15.123:0/622417569 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0101a4d20 con 0x7fa0101018c0 2024-08-18T22:06:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.659+0000 7fa016e35640 1 -- 172.21.15.123:0/622417569 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa010101d20 con 0x7fa0101018c0 2024-08-18T22:06:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.660+0000 7fa00dffb640 1 -- 172.21.15.123:0/622417569 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa000042030 con 0x7fa0101018c0 2024-08-18T22:06:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.661+0000 7fa00dffb640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9ff80a2c10 0x7f9ff80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.661+0000 7fa00ffff640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9ff80a2c10 0x7f9ff80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.661+0000 7fa00dffb640 1 -- 172.21.15.123:0/622417569 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fa0000ef9b0 con 0x7fa0101018c0 2024-08-18T22:06:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.661+0000 7fa00ffff640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9ff80a2c10 0x7f9ff80a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa0040058c0 tx=0x7fa004005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.665+0000 7fa00dffb640 1 -- 172.21.15.123:0/622417569 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa0000bc570 con 0x7fa0101018c0 2024-08-18T22:06:03.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:03 smithi130 ceph-mon[21698]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:06:03.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.854+0000 7fa016e35640 1 -- 172.21.15.123:0/622417569 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa010062360 con 0x7f9ff80a2c10 2024-08-18T22:06:03.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.878+0000 7fa00dffb640 1 -- 172.21.15.123:0/622417569 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa010062360 con 0x7f9ff80a2c10 2024-08-18T22:06:03.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.881+0000 7fa016e35640 1 -- 172.21.15.123:0/622417569 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9ff80a2c10 msgr2=0x7f9ff80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:03.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.881+0000 7fa016e35640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9ff80a2c10 0x7f9ff80a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa0040058c0 tx=0x7fa004005850 comp rx=0 tx=0).stop 2024-08-18T22:06:03.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.881+0000 7fa016e35640 1 -- 172.21.15.123:0/622417569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0101018c0 msgr2=0x7fa0101981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:03.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.881+0000 7fa016e35640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0101018c0 0x7fa0101981a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa000009230 tx=0x7fa000004270 comp rx=0 tx=0).stop 2024-08-18T22:06:03.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.881+0000 7fa016e35640 1 -- 172.21.15.123:0/622417569 shutdown_connections 2024-08-18T22:06:03.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.881+0000 7fa016e35640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9ff80a2c10 0x7f9ff80a50d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:03.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.881+0000 7fa016e35640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0101078c0 0x7fa01019ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:03.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.881+0000 7fa016e35640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa010102260 0x7fa0101986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:03.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.881+0000 7fa016e35640 1 --2- 172.21.15.123:0/622417569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0101018c0 0x7fa0101981a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:03.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.881+0000 7fa016e35640 1 -- 172.21.15.123:0/622417569 >> 172.21.15.123:0/622417569 conn(0x7fa0100fd620 msgr2=0x7fa0100fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:03.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.881+0000 7fa016e35640 1 -- 172.21.15.123:0/622417569 shutdown_connections 2024-08-18T22:06:03.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:03.881+0000 7fa016e35640 1 -- 172.21.15.123:0/622417569 wait complete. 2024-08-18T22:06:03.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:03 smithi183 ceph-mon[22097]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:06:04.561 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:04 smithi123 ceph-mon[18462]: pgmap v285: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-08-18T22:06:04.561 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:04 smithi123 ceph-mon[18462]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-08-18T22:06:04.589 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-08-18T22:06:04.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:04 smithi130 ceph-mon[21698]: pgmap v285: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-08-18T22:06:04.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:04 smithi130 ceph-mon[21698]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-08-18T22:06:04.840 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:04.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:04 smithi183 ceph-mon[22097]: pgmap v285: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-08-18T22:06:04.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:04 smithi183 ceph-mon[22097]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-08-18T22:06:05.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.348+0000 7faf78d25640 1 -- 172.21.15.123:0/972216929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf74103390 msgr2=0x7faf7410b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.348+0000 7faf78d25640 1 --2- 172.21.15.123:0/972216929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf74103390 0x7faf7410b880 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf68009900 tx=0x7faf6802a480 comp rx=0 tx=0).stop 2024-08-18T22:06:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.348+0000 7faf78d25640 1 -- 172.21.15.123:0/972216929 shutdown_connections 2024-08-18T22:06:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.348+0000 7faf78d25640 1 --2- 172.21.15.123:0/972216929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf7410bea0 0x7faf7410e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.348+0000 7faf78d25640 1 --2- 172.21.15.123:0/972216929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf74103390 0x7faf7410b880 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.348+0000 7faf78d25640 1 --2- 172.21.15.123:0/972216929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf74102a70 0x7faf74102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.348+0000 7faf78d25640 1 -- 172.21.15.123:0/972216929 >> 172.21.15.123:0/972216929 conn(0x7faf740fc4d0 msgr2=0x7faf740fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.348+0000 7faf78d25640 1 -- 172.21.15.123:0/972216929 shutdown_connections 2024-08-18T22:06:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.348+0000 7faf78d25640 1 -- 172.21.15.123:0/972216929 wait complete. 2024-08-18T22:06:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.349+0000 7faf78d25640 1 Processor -- start 2024-08-18T22:06:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.349+0000 7faf78d25640 1 -- start start 2024-08-18T22:06:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.349+0000 7faf78d25640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf74102a70 0x7faf741982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.349+0000 7faf78d25640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf74103390 0x7faf741987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.349+0000 7faf78d25640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf7410bea0 0x7faf7419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.349+0000 7faf78d25640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faf74111d60 con 0x7faf74103390 2024-08-18T22:06:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.349+0000 7faf78d25640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faf74111be0 con 0x7faf7410bea0 2024-08-18T22:06:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.349+0000 7faf78d25640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faf74111ee0 con 0x7faf74102a70 2024-08-18T22:06:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.349+0000 7faf71d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf74103390 0x7faf741987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.349+0000 7faf71d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf74103390 0x7faf741987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36188/0 (socket says 172.21.15.123:36188) 2024-08-18T22:06:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.349+0000 7faf71d9b640 1 -- 172.21.15.123:0/2796101523 learned_addr learned my addr 172.21.15.123:0/2796101523 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.350+0000 7faf72d9d640 1 --2- 172.21.15.123:0/2796101523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf7410bea0 0x7faf7419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.350+0000 7faf7259c640 1 --2- 172.21.15.123:0/2796101523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf74102a70 0x7faf741982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.350+0000 7faf71d9b640 1 -- 172.21.15.123:0/2796101523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf74102a70 msgr2=0x7faf741982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.350+0000 7faf71d9b640 1 --2- 172.21.15.123:0/2796101523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf74102a70 0x7faf741982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.350+0000 7faf71d9b640 1 -- 172.21.15.123:0/2796101523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf7410bea0 msgr2=0x7faf7419cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.350+0000 7faf71d9b640 1 --2- 172.21.15.123:0/2796101523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf7410bea0 0x7faf7419cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:05.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.350+0000 7faf71d9b640 1 -- 172.21.15.123:0/2796101523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7419d260 con 0x7faf74103390 2024-08-18T22:06:05.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.350+0000 7faf71d9b640 1 --2- 172.21.15.123:0/2796101523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf74103390 0x7faf741987f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faf68005ab0 tx=0x7faf680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:05.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.350+0000 7faf637fe640 1 -- 172.21.15.123:0/2796101523 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6803f030 con 0x7faf74103390 2024-08-18T22:06:05.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.350+0000 7faf78d25640 1 -- 172.21.15.123:0/2796101523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7419d4f0 con 0x7faf74103390 2024-08-18T22:06:05.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.350+0000 7faf637fe640 1 -- 172.21.15.123:0/2796101523 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf68003ce0 con 0x7faf74103390 2024-08-18T22:06:05.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.350+0000 7faf637fe640 1 -- 172.21.15.123:0/2796101523 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf68035070 con 0x7faf74103390 2024-08-18T22:06:05.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.350+0000 7faf78d25640 1 -- 172.21.15.123:0/2796101523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf741a4e30 con 0x7faf74103390 2024-08-18T22:06:05.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.351+0000 7faf78d25640 1 -- 172.21.15.123:0/2796101523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf7406ada0 con 0x7faf74103390 2024-08-18T22:06:05.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.352+0000 7faf637fe640 1 -- 172.21.15.123:0/2796101523 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7faf68042030 con 0x7faf74103390 2024-08-18T22:06:05.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.353+0000 7faf637fe640 1 --2- 172.21.15.123:0/2796101523 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faf5c0a2c10 0x7faf5c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:05.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.353+0000 7faf7259c640 1 --2- 172.21.15.123:0/2796101523 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faf5c0a2c10 0x7faf5c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:05.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.353+0000 7faf637fe640 1 -- 172.21.15.123:0/2796101523 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7faf680efcd0 con 0x7faf74103390 2024-08-18T22:06:05.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.353+0000 7faf7259c640 1 --2- 172.21.15.123:0/2796101523 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faf5c0a2c10 0x7faf5c0a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faf64009890 tx=0x7faf64008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:05.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.357+0000 7faf637fe640 1 -- 172.21.15.123:0/2796101523 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7faf680bc830 con 0x7faf74103390 2024-08-18T22:06:05.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.553+0000 7faf78d25640 1 -- 172.21.15.123:0/2796101523 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7faf74062360 con 0x7faf5c0a2c10 2024-08-18T22:06:05.554 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:05 smithi123 ceph-mon[18462]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:06:05.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.557+0000 7faf637fe640 1 -- 172.21.15.123:0/2796101523 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7faf74062360 con 0x7faf5c0a2c10 2024-08-18T22:06:05.558 INFO:teuthology.orchestra.run.smithi123.stdout:/volumes/qa/sv_0/89582dfe-2fd1-4001-b422-db1b77cba90f 2024-08-18T22:06:05.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.559+0000 7faf78d25640 1 -- 172.21.15.123:0/2796101523 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faf5c0a2c10 msgr2=0x7faf5c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:05.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.559+0000 7faf78d25640 1 --2- 172.21.15.123:0/2796101523 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faf5c0a2c10 0x7faf5c0a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faf64009890 tx=0x7faf64008040 comp rx=0 tx=0).stop 2024-08-18T22:06:05.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.559+0000 7faf78d25640 1 -- 172.21.15.123:0/2796101523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf74103390 msgr2=0x7faf741987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:05.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.559+0000 7faf78d25640 1 --2- 172.21.15.123:0/2796101523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf74103390 0x7faf741987f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faf68005ab0 tx=0x7faf680042f0 comp rx=0 tx=0).stop 2024-08-18T22:06:05.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.559+0000 7faf78d25640 1 -- 172.21.15.123:0/2796101523 shutdown_connections 2024-08-18T22:06:05.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.559+0000 7faf78d25640 1 --2- 172.21.15.123:0/2796101523 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faf5c0a2c10 0x7faf5c0a50d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:05.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.559+0000 7faf78d25640 1 --2- 172.21.15.123:0/2796101523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf7410bea0 0x7faf7419cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:05.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.559+0000 7faf78d25640 1 --2- 172.21.15.123:0/2796101523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf74103390 0x7faf741987f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:05.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.559+0000 7faf78d25640 1 --2- 172.21.15.123:0/2796101523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf74102a70 0x7faf741982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:05.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.560+0000 7faf78d25640 1 -- 172.21.15.123:0/2796101523 >> 172.21.15.123:0/2796101523 conn(0x7faf740fc4d0 msgr2=0x7faf740fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:05.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.560+0000 7faf78d25640 1 -- 172.21.15.123:0/2796101523 shutdown_connections 2024-08-18T22:06:05.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:05.560+0000 7faf78d25640 1 -- 172.21.15.123:0/2796101523 wait complete. 2024-08-18T22:06:05.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:05 smithi130 ceph-mon[21698]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:06:05.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:05 smithi183 ceph-mon[22097]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:06:06.382 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-08-18T22:06:06.634 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:06.756 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:06 smithi123 ceph-mon[18462]: pgmap v286: 129 pgs: 129 active+clean; 605 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-08-18T22:06:06.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:06 smithi130 ceph-mon[21698]: pgmap v286: 129 pgs: 129 active+clean; 605 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-08-18T22:06:06.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:06 smithi183 ceph-mon[22097]: pgmap v286: 129 pgs: 129 active+clean; 605 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-08-18T22:06:07.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.175+0000 7f3f8146e640 1 -- 172.21.15.123:0/2939447143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f7c100b50 msgr2=0x7f3f7c100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:07.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.175+0000 7f3f8146e640 1 --2- 172.21.15.123:0/2939447143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f7c100b50 0x7f3f7c100f30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009900 tx=0x7f3f6c02a480 comp rx=0 tx=0).stop 2024-08-18T22:06:07.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.175+0000 7f3f8146e640 1 -- 172.21.15.123:0/2939447143 shutdown_connections 2024-08-18T22:06:07.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.175+0000 7f3f8146e640 1 --2- 172.21.15.123:0/2939447143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f7c102c20 0x7f3f7c10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:07.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.175+0000 7f3f8146e640 1 --2- 172.21.15.123:0/2939447143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f7c1022a0 0x7f3f7c1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:07.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.175+0000 7f3f8146e640 1 --2- 172.21.15.123:0/2939447143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f7c100b50 0x7f3f7c100f30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:07.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.175+0000 7f3f8146e640 1 -- 172.21.15.123:0/2939447143 >> 172.21.15.123:0/2939447143 conn(0x7f3f7c0fc500 msgr2=0x7f3f7c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:07.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.175+0000 7f3f8146e640 1 -- 172.21.15.123:0/2939447143 shutdown_connections 2024-08-18T22:06:07.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.175+0000 7f3f8146e640 1 -- 172.21.15.123:0/2939447143 wait complete. 2024-08-18T22:06:07.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.175+0000 7f3f8146e640 1 Processor -- start 2024-08-18T22:06:07.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f8146e640 1 -- start start 2024-08-18T22:06:07.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f8146e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f7c100b50 0x7f3f7c195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:07.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f8146e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f7c1022a0 0x7f3f7c196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:07.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f8146e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f7c102c20 0x7f3f7c19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:07.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f8146e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c10fbb0 con 0x7f3f7c1022a0 2024-08-18T22:06:07.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f8146e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c10fa30 con 0x7f3f7c100b50 2024-08-18T22:06:07.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f8146e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c10fd30 con 0x7f3f7c102c20 2024-08-18T22:06:07.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f73fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f7c1022a0 0x7f3f7c196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:07.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f73fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f7c1022a0 0x7f3f7c196520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36220/0 (socket says 172.21.15.123:36220) 2024-08-18T22:06:07.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f73fff640 1 -- 172.21.15.123:0/12308704 learned_addr learned my addr 172.21.15.123:0/12308704 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:07.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f7affd640 1 --2- 172.21.15.123:0/12308704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f7c100b50 0x7f3f7c195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:07.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f73fff640 1 -- 172.21.15.123:0/12308704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f7c102c20 msgr2=0x7f3f7c19a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:07.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f73fff640 1 --2- 172.21.15.123:0/12308704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f7c102c20 0x7f3f7c19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:07.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f73fff640 1 -- 172.21.15.123:0/12308704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f7c100b50 msgr2=0x7f3f7c195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:07.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f73fff640 1 --2- 172.21.15.123:0/12308704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f7c100b50 0x7f3f7c195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:07.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f73fff640 1 -- 172.21.15.123:0/12308704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7c19af90 con 0x7f3f7c1022a0 2024-08-18T22:06:07.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.176+0000 7f3f73fff640 1 --2- 172.21.15.123:0/12308704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f7c1022a0 0x7f3f7c196520 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3f64010ad0 tx=0x7f3f64010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:07.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.177+0000 7f3f78ff9640 1 -- 172.21.15.123:0/12308704 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6401a020 con 0x7f3f7c1022a0 2024-08-18T22:06:07.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.177+0000 7f3f78ff9640 1 -- 172.21.15.123:0/12308704 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f6400ec30 con 0x7f3f7c1022a0 2024-08-18T22:06:07.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.177+0000 7f3f8146e640 1 -- 172.21.15.123:0/12308704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7c19b280 con 0x7f3f7c1022a0 2024-08-18T22:06:07.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.177+0000 7f3f78ff9640 1 -- 172.21.15.123:0/12308704 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f64015760 con 0x7f3f7c1022a0 2024-08-18T22:06:07.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.177+0000 7f3f8146e640 1 -- 172.21.15.123:0/12308704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f7c1a2b60 con 0x7f3f7c1022a0 2024-08-18T22:06:07.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.178+0000 7f3f8146e640 1 -- 172.21.15.123:0/12308704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f7c100f30 con 0x7f3f7c1022a0 2024-08-18T22:06:07.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.179+0000 7f3f78ff9640 1 -- 172.21.15.123:0/12308704 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f3f6401d020 con 0x7f3f7c1022a0 2024-08-18T22:06:07.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.179+0000 7f3f78ff9640 1 --2- 172.21.15.123:0/12308704 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3f680a2c10 0x7f3f680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:07.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.180+0000 7f3f7affd640 1 --2- 172.21.15.123:0/12308704 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3f680a2c10 0x7f3f680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:07.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.180+0000 7f3f78ff9640 1 -- 172.21.15.123:0/12308704 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f3f640d1930 con 0x7f3f7c1022a0 2024-08-18T22:06:07.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.180+0000 7f3f7affd640 1 --2- 172.21.15.123:0/12308704 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3f680a2c10 0x7f3f680a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009230 tx=0x7f3f6c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:07.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.183+0000 7f3f78ff9640 1 -- 172.21.15.123:0/12308704 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3f64024020 con 0x7f3f7c1022a0 2024-08-18T22:06:07.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.376+0000 7f3f8146e640 1 -- 172.21.15.123:0/12308704 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3f7c106ce0 con 0x7f3f680a2c10 2024-08-18T22:06:07.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.401+0000 7f3f78ff9640 1 -- 172.21.15.123:0/12308704 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3f7c106ce0 con 0x7f3f680a2c10 2024-08-18T22:06:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.403+0000 7f3f8146e640 1 -- 172.21.15.123:0/12308704 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3f680a2c10 msgr2=0x7f3f680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.403+0000 7f3f8146e640 1 --2- 172.21.15.123:0/12308704 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3f680a2c10 0x7f3f680a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009230 tx=0x7f3f6c0058d0 comp rx=0 tx=0).stop 2024-08-18T22:06:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.403+0000 7f3f8146e640 1 -- 172.21.15.123:0/12308704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f7c1022a0 msgr2=0x7f3f7c196520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:07.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.403+0000 7f3f8146e640 1 --2- 172.21.15.123:0/12308704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f7c1022a0 0x7f3f7c196520 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3f64010ad0 tx=0x7f3f64010f90 comp rx=0 tx=0).stop 2024-08-18T22:06:07.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.404+0000 7f3f8146e640 1 -- 172.21.15.123:0/12308704 shutdown_connections 2024-08-18T22:06:07.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.404+0000 7f3f8146e640 1 --2- 172.21.15.123:0/12308704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f7c102c20 0x7f3f7c19a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:07.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.404+0000 7f3f8146e640 1 --2- 172.21.15.123:0/12308704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f7c1022a0 0x7f3f7c196520 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:07.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.404+0000 7f3f8146e640 1 --2- 172.21.15.123:0/12308704 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3f680a2c10 0x7f3f680a50d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:07.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.404+0000 7f3f8146e640 1 --2- 172.21.15.123:0/12308704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f7c100b50 0x7f3f7c195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:07.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.404+0000 7f3f8146e640 1 -- 172.21.15.123:0/12308704 >> 172.21.15.123:0/12308704 conn(0x7f3f7c0fc500 msgr2=0x7f3f7c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:07.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.404+0000 7f3f8146e640 1 -- 172.21.15.123:0/12308704 shutdown_connections 2024-08-18T22:06:07.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:07.404+0000 7f3f8146e640 1 -- 172.21.15.123:0/12308704 wait complete. 2024-08-18T22:06:07.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:07 smithi123 ceph-mon[18462]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:06:07.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:07 smithi130 ceph-mon[21698]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:06:07.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:07 smithi183 ceph-mon[22097]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:06:08.166 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-08-18T22:06:08.414 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:08.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:08 smithi123 ceph-mon[18462]: pgmap v287: 129 pgs: 129 active+clean; 605 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-08-18T22:06:08.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:08 smithi123 ceph-mon[18462]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:06:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:08 smithi130 ceph-mon[21698]: pgmap v287: 129 pgs: 129 active+clean; 605 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-08-18T22:06:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:08 smithi130 ceph-mon[21698]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:06:08.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:08 smithi183 ceph-mon[22097]: pgmap v287: 129 pgs: 129 active+clean; 605 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-08-18T22:06:08.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:08 smithi183 ceph-mon[22097]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:06:08.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.917+0000 7f3444ce0640 1 -- 172.21.15.123:0/4101822530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34401007c0 msgr2=0x7f3440100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:08.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.917+0000 7f3444ce0640 1 --2- 172.21.15.123:0/4101822530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34401007c0 0x7f3440100c20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3430009930 tx=0x7f343002a420 comp rx=0 tx=0).stop 2024-08-18T22:06:08.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.917+0000 7f3444ce0640 1 -- 172.21.15.123:0/4101822530 shutdown_connections 2024-08-18T22:06:08.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.917+0000 7f3444ce0640 1 --2- 172.21.15.123:0/4101822530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3440101160 0x7f344010d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:08.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.917+0000 7f3444ce0640 1 --2- 172.21.15.123:0/4101822530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34401007c0 0x7f3440100c20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:08.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.917+0000 7f3444ce0640 1 --2- 172.21.15.123:0/4101822530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34401067c0 0x7f3440106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:08.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.917+0000 7f3444ce0640 1 -- 172.21.15.123:0/4101822530 >> 172.21.15.123:0/4101822530 conn(0x7f34400fc500 msgr2=0x7f34400fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:08.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.917+0000 7f3444ce0640 1 -- 172.21.15.123:0/4101822530 shutdown_connections 2024-08-18T22:06:08.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.917+0000 7f3444ce0640 1 -- 172.21.15.123:0/4101822530 wait complete. 2024-08-18T22:06:08.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f3444ce0640 1 Processor -- start 2024-08-18T22:06:08.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f3444ce0640 1 -- start start 2024-08-18T22:06:08.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f3444ce0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34401007c0 0x7f34401982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:08.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f3444ce0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3440101160 0x7f3440198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:08.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f3444ce0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34401067c0 0x7f344019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:08.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f3444ce0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3440110c60 con 0x7f34401007c0 2024-08-18T22:06:08.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f3444ce0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3440110ae0 con 0x7f3440101160 2024-08-18T22:06:08.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f3444ce0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3440110de0 con 0x7f34401067c0 2024-08-18T22:06:08.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f343e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34401007c0 0x7f34401982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:08.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f343e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34401007c0 0x7f34401982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36230/0 (socket says 172.21.15.123:36230) 2024-08-18T22:06:08.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f343e59c640 1 -- 172.21.15.123:0/2888526699 learned_addr learned my addr 172.21.15.123:0/2888526699 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f343dd9b640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3440101160 0x7f3440198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f343ed9d640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34401067c0 0x7f344019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f343e59c640 1 -- 172.21.15.123:0/2888526699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34401067c0 msgr2=0x7f344019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f343e59c640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34401067c0 0x7f344019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f343e59c640 1 -- 172.21.15.123:0/2888526699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3440101160 msgr2=0x7f3440198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f343e59c640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3440101160 0x7f3440198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f343e59c640 1 -- 172.21.15.123:0/2888526699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344019d290 con 0x7f34401007c0 2024-08-18T22:06:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f343dd9b640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3440101160 0x7f3440198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.918+0000 7f343ed9d640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34401067c0 0x7f344019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.919+0000 7f343e59c640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34401007c0 0x7f34401982e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f342800b4a0 tx=0x7f342800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.919+0000 7f34377fe640 1 -- 172.21.15.123:0/2888526699 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3428014070 con 0x7f34401007c0 2024-08-18T22:06:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.919+0000 7f34377fe640 1 -- 172.21.15.123:0/2888526699 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3428010af0 con 0x7f34401007c0 2024-08-18T22:06:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.919+0000 7f3444ce0640 1 -- 172.21.15.123:0/2888526699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f344019d580 con 0x7f34401007c0 2024-08-18T22:06:08.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.919+0000 7f34377fe640 1 -- 172.21.15.123:0/2888526699 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3428017d10 con 0x7f34401007c0 2024-08-18T22:06:08.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.919+0000 7f3444ce0640 1 -- 172.21.15.123:0/2888526699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34401a4e60 con 0x7f34401007c0 2024-08-18T22:06:08.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.920+0000 7f3444ce0640 1 -- 172.21.15.123:0/2888526699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3440100ca0 con 0x7f34401007c0 2024-08-18T22:06:08.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.921+0000 7f34377fe640 1 -- 172.21.15.123:0/2888526699 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f3428017070 con 0x7f34401007c0 2024-08-18T22:06:08.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.922+0000 7f34377fe640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f342c0a2c10 0x7f342c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:08.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.922+0000 7f343dd9b640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f342c0a2c10 0x7f342c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:08.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.923+0000 7f34377fe640 1 -- 172.21.15.123:0/2888526699 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f34280ce720 con 0x7f34401007c0 2024-08-18T22:06:08.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.923+0000 7f343dd9b640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f342c0a2c10 0x7f342c0a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3430000c00 tx=0x7f3430005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:08.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:08.927+0000 7f34377fe640 1 -- 172.21.15.123:0/2888526699 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f342809b3f0 con 0x7f34401007c0 2024-08-18T22:06:09.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:09.119+0000 7f3444ce0640 1 -- 172.21.15.123:0/2888526699 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f3440062360 con 0x7f342c0a2c10 2024-08-18T22:06:09.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:09.124+0000 7f34377fe640 1 -- 172.21.15.123:0/2888526699 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f3440062360 con 0x7f342c0a2c10 2024-08-18T22:06:09.125 INFO:teuthology.orchestra.run.smithi123.stdout:/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235 2024-08-18T22:06:09.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:09.126+0000 7f3444ce0640 1 -- 172.21.15.123:0/2888526699 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f342c0a2c10 msgr2=0x7f342c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:09.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:09.126+0000 7f3444ce0640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f342c0a2c10 0x7f342c0a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3430000c00 tx=0x7f3430005a20 comp rx=0 tx=0).stop 2024-08-18T22:06:09.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:09.126+0000 7f3444ce0640 1 -- 172.21.15.123:0/2888526699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34401007c0 msgr2=0x7f34401982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:09.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:09.126+0000 7f3444ce0640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34401007c0 0x7f34401982e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f342800b4a0 tx=0x7f342800b960 comp rx=0 tx=0).stop 2024-08-18T22:06:09.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:09.126+0000 7f3444ce0640 1 -- 172.21.15.123:0/2888526699 shutdown_connections 2024-08-18T22:06:09.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:09.126+0000 7f3444ce0640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34401067c0 0x7f344019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:09.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:09.126+0000 7f3444ce0640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f342c0a2c10 0x7f342c0a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:09.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:09.126+0000 7f3444ce0640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3440101160 0x7f3440198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:09.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:09.126+0000 7f3444ce0640 1 --2- 172.21.15.123:0/2888526699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34401007c0 0x7f34401982e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:09.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:09.126+0000 7f3444ce0640 1 -- 172.21.15.123:0/2888526699 >> 172.21.15.123:0/2888526699 conn(0x7f34400fc500 msgr2=0x7f344006a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:09.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:09.126+0000 7f3444ce0640 1 -- 172.21.15.123:0/2888526699 shutdown_connections 2024-08-18T22:06:09.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:09.126+0000 7f3444ce0640 1 -- 172.21.15.123:0/2888526699 wait complete. 2024-08-18T22:06:09.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-08-18T22:06:09.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-08-18T22:06:09.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-08-18T22:06:09.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-08-18T22:06:09.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-08-18T22:06:09.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-08-18T22:06:09.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-08-18T22:06:09.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2024-08-18T22:06:09.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]: dispatch 2024-08-18T22:06:09.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:09 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]: dispatch 2024-08-18T22:06:09.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-08-18T22:06:09.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-08-18T22:06:09.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-08-18T22:06:09.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-08-18T22:06:09.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-08-18T22:06:09.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-08-18T22:06:09.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-08-18T22:06:09.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2024-08-18T22:06:09.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]: dispatch 2024-08-18T22:06:09.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:09 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]: dispatch 2024-08-18T22:06:09.880 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:06:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-08-18T22:06:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-08-18T22:06:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-08-18T22:06:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-08-18T22:06:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-08-18T22:06:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-08-18T22:06:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-08-18T22:06:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2024-08-18T22:06:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]: dispatch 2024-08-18T22:06:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:09 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]: dispatch 2024-08-18T22:06:10.127 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:10.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.616+0000 7f772e85c640 1 -- 172.21.15.123:0/3538588669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7728102260 msgr2=0x7f772810e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:10.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.616+0000 7f772e85c640 1 --2- 172.21.15.123:0/3538588669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7728102260 0x7f772810e790 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7720009cd0 tx=0x7f772002a8e0 comp rx=0 tx=0).stop 2024-08-18T22:06:10.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.616+0000 7f772e85c640 1 -- 172.21.15.123:0/3538588669 shutdown_connections 2024-08-18T22:06:10.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.616+0000 7f772e85c640 1 --2- 172.21.15.123:0/3538588669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7728102260 0x7f772810e790 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:10.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.616+0000 7f772e85c640 1 --2- 172.21.15.123:0/3538588669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77281018c0 0x7f7728101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:10.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.616+0000 7f772e85c640 1 --2- 172.21.15.123:0/3538588669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77281078c0 0x7f7728107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:10.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.616+0000 7f772e85c640 1 -- 172.21.15.123:0/3538588669 >> 172.21.15.123:0/3538588669 conn(0x7f77280fd5e0 msgr2=0x7f77280ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:10.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.616+0000 7f772e85c640 1 -- 172.21.15.123:0/3538588669 shutdown_connections 2024-08-18T22:06:10.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.616+0000 7f772e85c640 1 -- 172.21.15.123:0/3538588669 wait complete. 2024-08-18T22:06:10.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f772e85c640 1 Processor -- start 2024-08-18T22:06:10.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f772e85c640 1 -- start start 2024-08-18T22:06:10.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f772e85c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77281018c0 0x7f7728198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:10.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f772e85c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7728102260 0x7f7728198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:10.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f772e85c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77281078c0 0x7f772819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:10.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f772e85c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7728111d60 con 0x7f7728102260 2024-08-18T22:06:10.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f772e85c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7728111be0 con 0x7f77281018c0 2024-08-18T22:06:10.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f772e85c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7728111ee0 con 0x7f77281078c0 2024-08-18T22:06:10.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f771ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7728102260 0x7f7728198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:10.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f771ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7728102260 0x7f7728198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36250/0 (socket says 172.21.15.123:36250) 2024-08-18T22:06:10.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f771ffff640 1 -- 172.21.15.123:0/133989170 learned_addr learned my addr 172.21.15.123:0/133989170 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:10.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f772cdf9640 1 --2- 172.21.15.123:0/133989170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77281078c0 0x7f772819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:10.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f7727fff640 1 --2- 172.21.15.123:0/133989170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77281018c0 0x7f7728198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:10.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f771ffff640 1 -- 172.21.15.123:0/133989170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77281078c0 msgr2=0x7f772819cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:10.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f771ffff640 1 --2- 172.21.15.123:0/133989170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77281078c0 0x7f772819cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:10.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f771ffff640 1 -- 172.21.15.123:0/133989170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77281018c0 msgr2=0x7f7728198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f771ffff640 1 --2- 172.21.15.123:0/133989170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77281018c0 0x7f7728198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f771ffff640 1 -- 172.21.15.123:0/133989170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772819d2b0 con 0x7f7728102260 2024-08-18T22:06:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f771ffff640 1 --2- 172.21.15.123:0/133989170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7728102260 0x7f7728198840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f771000b4a0 tx=0x7f771000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.617+0000 7f7725ffb640 1 -- 172.21.15.123:0/133989170 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710014070 con 0x7f7728102260 2024-08-18T22:06:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.618+0000 7f7725ffb640 1 -- 172.21.15.123:0/133989170 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7710010af0 con 0x7f7728102260 2024-08-18T22:06:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.618+0000 7f7725ffb640 1 -- 172.21.15.123:0/133989170 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710017d10 con 0x7f7728102260 2024-08-18T22:06:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.618+0000 7f772e85c640 1 -- 172.21.15.123:0/133989170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772819d5a0 con 0x7f7728102260 2024-08-18T22:06:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.618+0000 7f772e85c640 1 -- 172.21.15.123:0/133989170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77281a4e80 con 0x7f7728102260 2024-08-18T22:06:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.619+0000 7f772e85c640 1 -- 172.21.15.123:0/133989170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7728101da0 con 0x7f7728102260 2024-08-18T22:06:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.620+0000 7f7725ffb640 1 -- 172.21.15.123:0/133989170 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7710017070 con 0x7f7728102260 2024-08-18T22:06:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.620+0000 7f7725ffb640 1 --2- 172.21.15.123:0/133989170 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f77140a2c90 0x7f77140a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.620+0000 7f7727fff640 1 --2- 172.21.15.123:0/133989170 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f77140a2c90 0x7f77140a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.620+0000 7f7725ffb640 1 -- 172.21.15.123:0/133989170 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f77100ce7c0 con 0x7f7728102260 2024-08-18T22:06:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.621+0000 7f7727fff640 1 --2- 172.21.15.123:0/133989170 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f77140a2c90 0x7f77140a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f771800a810 tx=0x7f7718008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:10.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.625+0000 7f7725ffb640 1 -- 172.21.15.123:0/133989170 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f771009b370 con 0x7f7728102260 2024-08-18T22:06:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:10 smithi130 ceph-mon[21698]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:06:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:10 smithi130 ceph-mon[21698]: pgmap v288: 129 pgs: 129 active+clean; 629 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.8 KiB/s wr, 15 op/s 2024-08-18T22:06:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-08-18T22:06:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-08-18T22:06:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-08-18T22:06:10.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-08-18T22:06:10.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-08-18T22:06:10.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-08-18T22:06:10.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-08-18T22:06:10.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-08-18T22:06:10.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]': finished 2024-08-18T22:06:10.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]': finished 2024-08-18T22:06:10.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:10 smithi130 ceph-mon[21698]: osdmap e89: 12 total, 12 up, 12 in 2024-08-18T22:06:10.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.827+0000 7f772e85c640 1 -- 172.21.15.123:0/133989170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f772802d5e0 con 0x7f7728102260 2024-08-18T22:06:10.828 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:10 smithi123 ceph-mon[18462]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:06:10.828 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:10 smithi123 ceph-mon[18462]: pgmap v288: 129 pgs: 129 active+clean; 629 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.8 KiB/s wr, 15 op/s 2024-08-18T22:06:10.828 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-08-18T22:06:10.828 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-08-18T22:06:10.828 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-08-18T22:06:10.828 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-08-18T22:06:10.828 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-08-18T22:06:10.828 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-08-18T22:06:10.829 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-08-18T22:06:10.829 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-08-18T22:06:10.829 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]': finished 2024-08-18T22:06:10.829 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]': finished 2024-08-18T22:06:10.829 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:10 smithi123 ceph-mon[18462]: osdmap e89: 12 total, 12 up, 12 in 2024-08-18T22:06:10.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.827+0000 7f7725ffb640 1 -- 172.21.15.123:0/133989170 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11918 (secure 0 0 0) 0x7f771009ac70 con 0x7f7728102260 2024-08-18T22:06:10.830 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:06:10.830 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":25,"btime":"2024-08-18T22:06:00:456703+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:06:00.091798+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24448,24458,24466]},"id":1}]} 2024-08-18T22:06:10.830 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 25 2024-08-18T22:06:10.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.830+0000 7f772e85c640 1 -- 172.21.15.123:0/133989170 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f77140a2c90 msgr2=0x7f77140a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:10.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.830+0000 7f772e85c640 1 --2- 172.21.15.123:0/133989170 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f77140a2c90 0x7f77140a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f771800a810 tx=0x7f7718008040 comp rx=0 tx=0).stop 2024-08-18T22:06:10.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.830+0000 7f772e85c640 1 -- 172.21.15.123:0/133989170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7728102260 msgr2=0x7f7728198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:10.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.830+0000 7f772e85c640 1 --2- 172.21.15.123:0/133989170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7728102260 0x7f7728198840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f771000b4a0 tx=0x7f771000b960 comp rx=0 tx=0).stop 2024-08-18T22:06:10.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.830+0000 7f772e85c640 1 -- 172.21.15.123:0/133989170 shutdown_connections 2024-08-18T22:06:10.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.830+0000 7f772e85c640 1 --2- 172.21.15.123:0/133989170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77281078c0 0x7f772819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:10.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.830+0000 7f772e85c640 1 --2- 172.21.15.123:0/133989170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7728102260 0x7f7728198840 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:10.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.830+0000 7f772e85c640 1 --2- 172.21.15.123:0/133989170 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f77140a2c90 0x7f77140a5150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:10.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.830+0000 7f772e85c640 1 --2- 172.21.15.123:0/133989170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77281018c0 0x7f7728198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:10.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.830+0000 7f772e85c640 1 -- 172.21.15.123:0/133989170 >> 172.21.15.123:0/133989170 conn(0x7f77280fd5e0 msgr2=0x7f77280fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:10.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.831+0000 7f772e85c640 1 -- 172.21.15.123:0/133989170 shutdown_connections 2024-08-18T22:06:10.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:10.831+0000 7f772e85c640 1 -- 172.21.15.123:0/133989170 wait complete. 2024-08-18T22:06:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:10 smithi183 ceph-mon[22097]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:06:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:10 smithi183 ceph-mon[22097]: pgmap v288: 129 pgs: 129 active+clean; 629 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.8 KiB/s wr, 15 op/s 2024-08-18T22:06:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-08-18T22:06:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-08-18T22:06:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-08-18T22:06:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-08-18T22:06:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-08-18T22:06:10.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-08-18T22:06:10.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-08-18T22:06:10.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-08-18T22:06:10.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]': finished 2024-08-18T22:06:10.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]': finished 2024-08-18T22:06:10.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:10 smithi183 ceph-mon[22097]: osdmap e89: 12 total, 12 up, 12 in 2024-08-18T22:06:11.551 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:06:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:11 smithi183 ceph-mon[22097]: osdmap e90: 12 total, 12 up, 12 in 2024-08-18T22:06:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:11 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/133989170' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:06:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:11 smithi183 ceph-mon[22097]: pgmap v291: 129 pgs: 2 peering, 127 active+clean; 629 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2024-08-18T22:06:11.926 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:11 smithi123 ceph-mon[18462]: osdmap e90: 12 total, 12 up, 12 in 2024-08-18T22:06:11.926 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:11 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/133989170' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:06:11.926 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:11 smithi123 ceph-mon[18462]: pgmap v291: 129 pgs: 2 peering, 127 active+clean; 629 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2024-08-18T22:06:12.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:11 smithi130 ceph-mon[21698]: osdmap e90: 12 total, 12 up, 12 in 2024-08-18T22:06:12.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:11 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/133989170' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:06:12.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:11 smithi130 ceph-mon[21698]: pgmap v291: 129 pgs: 2 peering, 127 active+clean; 629 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2024-08-18T22:06:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.270+0000 7efef2479640 1 -- 172.21.15.123:0/1890430698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efeec074b60 msgr2=0x7efeec10dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.270+0000 7efef2479640 1 --2- 172.21.15.123:0/1890430698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efeec074b60 0x7efeec10dc40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efee0009900 tx=0x7efee002a480 comp rx=0 tx=0).stop 2024-08-18T22:06:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.271+0000 7efef2479640 1 -- 172.21.15.123:0/1890430698 shutdown_connections 2024-08-18T22:06:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.271+0000 7efef2479640 1 --2- 172.21.15.123:0/1890430698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeec10e180 0x7efeec110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.271+0000 7efef2479640 1 --2- 172.21.15.123:0/1890430698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efeec074b60 0x7efeec10dc40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.271+0000 7efef2479640 1 --2- 172.21.15.123:0/1890430698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeec074240 0x7efeec074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.271+0000 7efef2479640 1 -- 172.21.15.123:0/1890430698 >> 172.21.15.123:0/1890430698 conn(0x7efeec0fd5e0 msgr2=0x7efeec0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.271+0000 7efef2479640 1 -- 172.21.15.123:0/1890430698 shutdown_connections 2024-08-18T22:06:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.271+0000 7efef2479640 1 -- 172.21.15.123:0/1890430698 wait complete. 2024-08-18T22:06:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.271+0000 7efef2479640 1 Processor -- start 2024-08-18T22:06:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.271+0000 7efef2479640 1 -- start start 2024-08-18T22:06:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efef2479640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeec074240 0x7efeec19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efef2479640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeec074b60 0x7efeec19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efef2479640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efeec10e180 0x7efeec19ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efef2479640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efeec113eb0 con 0x7efeec10e180 2024-08-18T22:06:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efef2479640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efeec113d30 con 0x7efeec074b60 2024-08-18T22:06:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efef2479640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efeec114030 con 0x7efeec074240 2024-08-18T22:06:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efef0a16640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efeec10e180 0x7efeec19ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efef0a16640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efeec10e180 0x7efeec19ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36266/0 (socket says 172.21.15.123:36266) 2024-08-18T22:06:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efef0a16640 1 -- 172.21.15.123:0/774026777 learned_addr learned my addr 172.21.15.123:0/774026777 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efeeb7fe640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeec074b60 0x7efeec19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efeebfff640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeec074240 0x7efeec19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efef0a16640 1 -- 172.21.15.123:0/774026777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeec074240 msgr2=0x7efeec19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efef0a16640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeec074240 0x7efeec19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efef0a16640 1 -- 172.21.15.123:0/774026777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeec074b60 msgr2=0x7efeec19a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efef0a16640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeec074b60 0x7efeec19a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efef0a16640 1 -- 172.21.15.123:0/774026777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeec19f3f0 con 0x7efeec10e180 2024-08-18T22:06:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efeebfff640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeec074240 0x7efeec19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:06:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efeeb7fe640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeec074b60 0x7efeec19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.272+0000 7efef0a16640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efeec10e180 0x7efeec19ed10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efee400e9d0 tx=0x7efee400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.273+0000 7efee97fa640 1 -- 172.21.15.123:0/774026777 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee400cd80 con 0x7efeec10e180 2024-08-18T22:06:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.273+0000 7efee97fa640 1 -- 172.21.15.123:0/774026777 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efee4005020 con 0x7efeec10e180 2024-08-18T22:06:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.273+0000 7efef2479640 1 -- 172.21.15.123:0/774026777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeec19f6e0 con 0x7efeec10e180 2024-08-18T22:06:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.273+0000 7efee97fa640 1 -- 172.21.15.123:0/774026777 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee40116d0 con 0x7efeec10e180 2024-08-18T22:06:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.273+0000 7efef2479640 1 -- 172.21.15.123:0/774026777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeec1a6fc0 con 0x7efeec10e180 2024-08-18T22:06:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.274+0000 7efef2479640 1 -- 172.21.15.123:0/774026777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeec074620 con 0x7efeec10e180 2024-08-18T22:06:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.275+0000 7efee97fa640 1 -- 172.21.15.123:0/774026777 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7efee40051d0 con 0x7efeec10e180 2024-08-18T22:06:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.275+0000 7efee97fa640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efed40a2c10 0x7efed40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.275+0000 7efeebfff640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efed40a2c10 0x7efed40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.275+0000 7efee97fa640 1 -- 172.21.15.123:0/774026777 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7efee40cfb70 con 0x7efeec10e180 2024-08-18T22:06:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.276+0000 7efeebfff640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efed40a2c10 0x7efed40a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efedc009b40 tx=0x7efedc005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.280+0000 7efee97fa640 1 -- 172.21.15.123:0/774026777 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7efee4016030 con 0x7efeec10e180 2024-08-18T22:06:12.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.447+0000 7efef2479640 1 -- 172.21.15.123:0/774026777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efeec19b7a0 con 0x7efeec10e180 2024-08-18T22:06:12.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.449+0000 7efee97fa640 1 -- 172.21.15.123:0/774026777 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24715 (secure 0 0 0) 0x7efee409c610 con 0x7efeec10e180 2024-08-18T22:06:12.450 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:06:12.451 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":90,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:06:10.502014+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:05:18.077632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:05:20.808463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:05:27.136662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:06:12.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.451+0000 7efef2479640 1 -- 172.21.15.123:0/774026777 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efed40a2c10 msgr2=0x7efed40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:12.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.451+0000 7efef2479640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efed40a2c10 0x7efed40a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efedc009b40 tx=0x7efedc005e50 comp rx=0 tx=0).stop 2024-08-18T22:06:12.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.451+0000 7efef2479640 1 -- 172.21.15.123:0/774026777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efeec10e180 msgr2=0x7efeec19ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:12.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.451+0000 7efef2479640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efeec10e180 0x7efeec19ed10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efee400e9d0 tx=0x7efee400ee90 comp rx=0 tx=0).stop 2024-08-18T22:06:12.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.451+0000 7efef2479640 1 -- 172.21.15.123:0/774026777 shutdown_connections 2024-08-18T22:06:12.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.451+0000 7efef2479640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efeec10e180 0x7efeec19ed10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:12.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.451+0000 7efef2479640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efed40a2c10 0x7efed40a50d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:12.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.451+0000 7efef2479640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeec074b60 0x7efeec19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:12.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.451+0000 7efef2479640 1 --2- 172.21.15.123:0/774026777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeec074240 0x7efeec19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:12.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.451+0000 7efef2479640 1 -- 172.21.15.123:0/774026777 >> 172.21.15.123:0/774026777 conn(0x7efeec0fd5e0 msgr2=0x7efeec0fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:12.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.451+0000 7efef2479640 1 -- 172.21.15.123:0/774026777 shutdown_connections 2024-08-18T22:06:12.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:12.451+0000 7efef2479640 1 -- 172.21.15.123:0/774026777 wait complete. 2024-08-18T22:06:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:12 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/774026777' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:06:12.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:12 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/774026777' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:06:13.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:12 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/774026777' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:06:13.159 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-18T22:06:13.159 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-18T22:06:13.413 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:13.862 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:13 smithi123 ceph-mon[18462]: pgmap v292: 129 pgs: 2 peering, 127 active+clean; 629 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.1 KiB/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:06:13.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:13 smithi183 ceph-mon[22097]: pgmap v292: 129 pgs: 2 peering, 127 active+clean; 629 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.1 KiB/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:06:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.940+0000 7fa0e8e92640 1 -- 172.21.15.123:0/896580324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e41078a0 msgr2=0x7fa0e4107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.940+0000 7fa0e8e92640 1 --2- 172.21.15.123:0/896580324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e41078a0 0x7fa0e4107c80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009930 tx=0x7fa0d402a420 comp rx=0 tx=0).stop 2024-08-18T22:06:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.941+0000 7fa0e8e92640 1 -- 172.21.15.123:0/896580324 shutdown_connections 2024-08-18T22:06:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.941+0000 7fa0e8e92640 1 --2- 172.21.15.123:0/896580324 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0e4102240 0x7fa0e410e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.941+0000 7fa0e8e92640 1 --2- 172.21.15.123:0/896580324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0e41018a0 0x7fa0e4101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.941+0000 7fa0e8e92640 1 --2- 172.21.15.123:0/896580324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e41078a0 0x7fa0e4107c80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.941+0000 7fa0e8e92640 1 -- 172.21.15.123:0/896580324 >> 172.21.15.123:0/896580324 conn(0x7fa0e40fd5c0 msgr2=0x7fa0e40ff9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.941+0000 7fa0e8e92640 1 -- 172.21.15.123:0/896580324 shutdown_connections 2024-08-18T22:06:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.941+0000 7fa0e8e92640 1 -- 172.21.15.123:0/896580324 wait complete. 2024-08-18T22:06:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.941+0000 7fa0e8e92640 1 Processor -- start 2024-08-18T22:06:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.941+0000 7fa0e8e92640 1 -- start start 2024-08-18T22:06:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e8e92640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e41018a0 0x7fa0e4198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e8e92640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0e4102240 0x7fa0e4198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e8e92640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0e41078a0 0x7fa0e419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e8e92640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4111d10 con 0x7fa0e41018a0 2024-08-18T22:06:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e8e92640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4111b90 con 0x7fa0e41078a0 2024-08-18T22:06:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e8e92640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4111e90 con 0x7fa0e4102240 2024-08-18T22:06:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e41018a0 0x7fa0e4198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e41018a0 0x7fa0e4198200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48774/0 (socket says 172.21.15.123:48774) 2024-08-18T22:06:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e259c640 1 -- 172.21.15.123:0/1442575180 learned_addr learned my addr 172.21.15.123:0/1442575180 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e2d9d640 1 --2- 172.21.15.123:0/1442575180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0e41078a0 0x7fa0e419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e1d9b640 1 --2- 172.21.15.123:0/1442575180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0e4102240 0x7fa0e4198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e259c640 1 -- 172.21.15.123:0/1442575180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0e4102240 msgr2=0x7fa0e4198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:13.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e259c640 1 --2- 172.21.15.123:0/1442575180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0e4102240 0x7fa0e4198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:13.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e259c640 1 -- 172.21.15.123:0/1442575180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0e41078a0 msgr2=0x7fa0e419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:13.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e259c640 1 --2- 172.21.15.123:0/1442575180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0e41078a0 0x7fa0e419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:13.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e259c640 1 -- 172.21.15.123:0/1442575180 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e419d1b0 con 0x7fa0e41018a0 2024-08-18T22:06:13.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.942+0000 7fa0e259c640 1 --2- 172.21.15.123:0/1442575180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e41018a0 0x7fa0e4198200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa0d402a940 tx=0x7fa0d4003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:13.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.943+0000 7fa0d37fe640 1 -- 172.21.15.123:0/1442575180 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d403f070 con 0x7fa0e41018a0 2024-08-18T22:06:13.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.943+0000 7fa0d37fe640 1 -- 172.21.15.123:0/1442575180 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0d403b460 con 0x7fa0e41018a0 2024-08-18T22:06:13.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.943+0000 7fa0d37fe640 1 -- 172.21.15.123:0/1442575180 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4035030 con 0x7fa0e41018a0 2024-08-18T22:06:13.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.943+0000 7fa0e8e92640 1 -- 172.21.15.123:0/1442575180 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e419d440 con 0x7fa0e41018a0 2024-08-18T22:06:13.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.943+0000 7fa0e8e92640 1 -- 172.21.15.123:0/1442575180 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e41a4d80 con 0x7fa0e41018a0 2024-08-18T22:06:13.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.944+0000 7fa0e8e92640 1 -- 172.21.15.123:0/1442575180 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e4101d00 con 0x7fa0e41018a0 2024-08-18T22:06:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.945+0000 7fa0d37fe640 1 -- 172.21.15.123:0/1442575180 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa0d4042070 con 0x7fa0e41018a0 2024-08-18T22:06:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.945+0000 7fa0d37fe640 1 --2- 172.21.15.123:0/1442575180 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa0cc0a2c90 0x7fa0cc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.945+0000 7fa0e1d9b640 1 --2- 172.21.15.123:0/1442575180 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa0cc0a2c90 0x7fa0cc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.946+0000 7fa0d37fe640 1 -- 172.21.15.123:0/1442575180 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fa0d40efd60 con 0x7fa0e41018a0 2024-08-18T22:06:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.946+0000 7fa0e1d9b640 1 --2- 172.21.15.123:0/1442575180 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa0cc0a2c90 0x7fa0cc0a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4100e30 tx=0x7fa0d800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:13.949+0000 7fa0d37fe640 1 -- 172.21.15.123:0/1442575180 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa0d40bc800 con 0x7fa0e41018a0 2024-08-18T22:06:14.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:13 smithi130 ceph-mon[21698]: pgmap v292: 129 pgs: 2 peering, 127 active+clean; 629 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.1 KiB/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:06:14.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:14.111+0000 7fa0e8e92640 1 -- 172.21.15.123:0/1442575180 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0e4062360 con 0x7fa0cc0a2c90 2024-08-18T22:06:14.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:14.120+0000 7fa0d37fe640 1 -- 172.21.15.123:0/1442575180 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340273 (secure 0 0 0) 0x7fa0e4062360 con 0x7fa0cc0a2c90 2024-08-18T22:06:14.124 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:06:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-08-18T22:06:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:14.123+0000 7fa0e8e92640 1 -- 172.21.15.123:0/1442575180 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa0cc0a2c90 msgr2=0x7fa0cc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:14.123+0000 7fa0e8e92640 1 --2- 172.21.15.123:0/1442575180 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa0cc0a2c90 0x7fa0cc0a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4100e30 tx=0x7fa0d800a4c0 comp rx=0 tx=0).stop 2024-08-18T22:06:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:14.123+0000 7fa0e8e92640 1 -- 172.21.15.123:0/1442575180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e41018a0 msgr2=0x7fa0e4198200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:14.123+0000 7fa0e8e92640 1 --2- 172.21.15.123:0/1442575180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e41018a0 0x7fa0e4198200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa0d402a940 tx=0x7fa0d4003c00 comp rx=0 tx=0).stop 2024-08-18T22:06:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:14.123+0000 7fa0e8e92640 1 -- 172.21.15.123:0/1442575180 shutdown_connections 2024-08-18T22:06:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:14.123+0000 7fa0e8e92640 1 --2- 172.21.15.123:0/1442575180 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa0cc0a2c90 0x7fa0cc0a5150 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:14.123+0000 7fa0e8e92640 1 --2- 172.21.15.123:0/1442575180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0e41078a0 0x7fa0e419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:14.123+0000 7fa0e8e92640 1 --2- 172.21.15.123:0/1442575180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0e4102240 0x7fa0e4198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:14.123+0000 7fa0e8e92640 1 --2- 172.21.15.123:0/1442575180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e41018a0 0x7fa0e4198200 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:14.123+0000 7fa0e8e92640 1 -- 172.21.15.123:0/1442575180 >> 172.21.15.123:0/1442575180 conn(0x7fa0e40fd5c0 msgr2=0x7fa0e40fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:14.123+0000 7fa0e8e92640 1 -- 172.21.15.123:0/1442575180 shutdown_connections 2024-08-18T22:06:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:14.123+0000 7fa0e8e92640 1 -- 172.21.15.123:0/1442575180 wait complete. 2024-08-18T22:06:14.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:14 smithi123 ceph-mon[18462]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:06:14.804 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-08-18T22:06:13.346917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644084,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":338,"num_write_kb":3040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375428,"kb_used_data":13768,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566396,"statfs":{"total":1151940427776,"available":1151555989504,"internally_reserved":0,"allocated":14098432,"data_stored":7819257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25025,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":53,"num_write":18,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002304"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509743+0000","last_change":"2024-08-18T22:05:19.844674+0000","last_active":"2024-08-18T22:06:10.509743+0000","last_peered":"2024-08-18T22:06:10.509743+0000","last_clean":"2024-08-18T22:06:10.509743+0000","last_became_active":"2024-08-18T22:05:19.844381+0000","last_became_peered":"2024-08-18T22:05:19.844381+0000","last_unstale":"2024-08-18T22:06:10.509743+0000","last_undegraded":"2024-08-18T22:06:10.509743+0000","last_fullsized":"2024-08-18T22:06:10.509743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:58.783222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772174+0000","last_change":"2024-08-18T22:05:21.859013+0000","last_active":"2024-08-18T22:06:10.772174+0000","last_peered":"2024-08-18T22:06:10.772174+0000","last_clean":"2024-08-18T22:06:10.772174+0000","last_became_active":"2024-08-18T22:05:21.858709+0000","last_became_peered":"2024-08-18T22:05:21.858709+0000","last_unstale":"2024-08-18T22:06:10.772174+0000","last_undegraded":"2024-08-18T22:06:10.772174+0000","last_fullsized":"2024-08-18T22:06:10.772174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:34.272340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:32.865553+0000","last_change":"2024-08-18T22:05:28.925735+0000","last_active":"2024-08-18T22:05:32.865553+0000","last_peered":"2024-08-18T22:05:32.865553+0000","last_clean":"2024-08-18T22:05:32.865553+0000","last_became_active":"2024-08-18T22:05:28.925324+0000","last_became_peered":"2024-08-18T22:05:28.925324+0000","last_unstale":"2024-08-18T22:05:32.865553+0000","last_undegraded":"2024-08-18T22:05:32.865553+0000","last_fullsized":"2024-08-18T22:05:32.865553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:15:58.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772359+0000","last_change":"2024-08-18T22:05:20.290861+0000","last_active":"2024-08-18T22:06:10.772359+0000","last_peered":"2024-08-18T22:06:10.772359+0000","last_clean":"2024-08-18T22:06:10.772359+0000","last_became_active":"2024-08-18T22:05:20.290508+0000","last_became_peered":"2024-08-18T22:05:20.290508+0000","last_unstale":"2024-08-18T22:06:10.772359+0000","last_undegraded":"2024-08-18T22:06:10.772359+0000","last_fullsized":"2024-08-18T22:06:10.772359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:21.462206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509155+0000","last_change":"2024-08-18T22:05:21.863441+0000","last_active":"2024-08-18T22:06:10.509155+0000","last_peered":"2024-08-18T22:06:10.509155+0000","last_clean":"2024-08-18T22:06:10.509155+0000","last_became_active":"2024-08-18T22:05:21.863121+0000","last_became_peered":"2024-08-18T22:05:21.863121+0000","last_unstale":"2024-08-18T22:06:10.509155+0000","last_undegraded":"2024-08-18T22:06:10.509155+0000","last_fullsized":"2024-08-18T22:06:10.509155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:47.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.129654+0000","last_change":"2024-08-18T22:05:28.925477+0000","last_active":"2024-08-18T22:05:33.129654+0000","last_peered":"2024-08-18T22:05:33.129654+0000","last_clean":"2024-08-18T22:05:33.129654+0000","last_became_active":"2024-08-18T22:05:28.924922+0000","last_became_peered":"2024-08-18T22:05:28.924922+0000","last_unstale":"2024-08-18T22:05:33.129654+0000","last_undegraded":"2024-08-18T22:05:33.129654+0000","last_fullsized":"2024-08-18T22:05:33.129654+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:35.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514293+0000","last_change":"2024-08-18T22:05:19.847979+0000","last_active":"2024-08-18T22:06:10.514293+0000","last_peered":"2024-08-18T22:06:10.514293+0000","last_clean":"2024-08-18T22:06:10.514293+0000","last_became_active":"2024-08-18T22:05:19.847643+0000","last_became_peered":"2024-08-18T22:05:19.847643+0000","last_unstale":"2024-08-18T22:06:10.514293+0000","last_undegraded":"2024-08-18T22:06:10.514293+0000","last_fullsized":"2024-08-18T22:06:10.514293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:33.875378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.131663+0000","last_change":"2024-08-18T22:05:21.860225+0000","last_active":"2024-08-18T22:05:33.131663+0000","last_peered":"2024-08-18T22:05:33.131663+0000","last_clean":"2024-08-18T22:05:33.131663+0000","last_became_active":"2024-08-18T22:05:21.859889+0000","last_became_peered":"2024-08-18T22:05:21.859889+0000","last_unstale":"2024-08-18T22:05:33.131663+0000","last_undegraded":"2024-08-18T22:05:33.131663+0000","last_fullsized":"2024-08-18T22:05:33.131663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:06:27.084401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.130657+0000","last_change":"2024-08-18T22:05:28.922230+0000","last_active":"2024-08-18T22:05:33.130657+0000","last_peered":"2024-08-18T22:05:33.130657+0000","last_clean":"2024-08-18T22:05:33.130657+0000","last_became_active":"2024-08-18T22:05:28.921804+0000","last_became_peered":"2024-08-18T22:05:28.921804+0000","last_unstale":"2024-08-18T22:05:33.130657+0000","last_undegraded":"2024-08-18T22:05:33.130657+0000","last_fullsized":"2024-08-18T22:05:33.130657+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:17.735645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514907+0000","last_change":"2024-08-18T22:05:19.841452+0000","last_active":"2024-08-18T22:06:10.514907+0000","last_peered":"2024-08-18T22:06:10.514907+0000","last_clean":"2024-08-18T22:06:10.514907+0000","last_became_active":"2024-08-18T22:05:19.840997+0000","last_became_peered":"2024-08-18T22:05:19.840997+0000","last_unstale":"2024-08-18T22:06:10.514907+0000","last_undegraded":"2024-08-18T22:06:10.514907+0000","last_fullsized":"2024-08-18T22:06:10.514907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:27:26.208279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"peering","last_fresh":"2024-08-18T22:05:33.130875+0000","last_change":"2024-08-18T22:06:09.511756+0000","last_active":"2024-08-18T22:06:09.511756+0000","last_peered":"2024-08-18T22:05:33.130875+0000","last_clean":"2024-08-18T22:05:33.130875+0000","last_became_active":"2024-08-18T22:05:21.856426+0000","last_became_peered":"2024-08-18T22:05:21.856426+0000","last_unstale":"2024-08-18T22:05:33.130875+0000","last_undegraded":"2024-08-18T22:05:33.130875+0000","last_fullsized":"2024-08-18T22:05:33.130875+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4,8],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.129930+0000","last_change":"2024-08-18T22:05:28.924521+0000","last_active":"2024-08-18T22:05:33.129930+0000","last_peered":"2024-08-18T22:05:33.129930+0000","last_clean":"2024-08-18T22:05:33.129930+0000","last_became_active":"2024-08-18T22:05:28.924107+0000","last_became_peered":"2024-08-18T22:05:28.924107+0000","last_unstale":"2024-08-18T22:05:33.129930+0000","last_undegraded":"2024-08-18T22:05:33.129930+0000","last_fullsized":"2024-08-18T22:05:33.129930+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:37.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.504631+0000","last_change":"2024-08-18T22:05:21.861696+0000","last_active":"2024-08-18T22:06:09.504631+0000","last_peered":"2024-08-18T22:06:09.504631+0000","last_clean":"2024-08-18T22:06:09.504631+0000","last_became_active":"2024-08-18T22:05:21.861220+0000","last_became_peered":"2024-08-18T22:05:21.861220+0000","last_unstale":"2024-08-18T22:06:09.504631+0000","last_undegraded":"2024-08-18T22:06:09.504631+0000","last_fullsized":"2024-08-18T22:06:09.504631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:01.098281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.520590+0000","last_change":"2024-08-18T22:06:10.520097+0000","last_active":"2024-08-18T22:06:10.520590+0000","last_peered":"2024-08-18T22:06:10.520590+0000","last_clean":"2024-08-18T22:06:10.520590+0000","last_became_active":"2024-08-18T22:06:10.513286+0000","last_became_peered":"2024-08-18T22:06:10.513286+0000","last_unstale":"2024-08-18T22:06:10.520590+0000","last_undegraded":"2024-08-18T22:06:10.520590+0000","last_fullsized":"2024-08-18T22:06:10.520590+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:08:18.861243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.129871+0000","last_change":"2024-08-18T22:05:29.013139+0000","last_active":"2024-08-18T22:05:33.129871+0000","last_peered":"2024-08-18T22:05:33.129871+0000","last_clean":"2024-08-18T22:05:33.129871+0000","last_became_active":"2024-08-18T22:05:29.012322+0000","last_became_peered":"2024-08-18T22:05:29.012322+0000","last_unstale":"2024-08-18T22:05:33.129871+0000","last_undegraded":"2024-08-18T22:05:33.129871+0000","last_fullsized":"2024-08-18T22:05:33.129871+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:32.348201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772162+0000","last_change":"2024-08-18T22:05:21.860410+0000","last_active":"2024-08-18T22:06:10.772162+0000","last_peered":"2024-08-18T22:06:10.772162+0000","last_clean":"2024-08-18T22:06:10.772162+0000","last_became_active":"2024-08-18T22:05:21.860173+0000","last_became_peered":"2024-08-18T22:05:21.860173+0000","last_unstale":"2024-08-18T22:06:10.772162+0000","last_undegraded":"2024-08-18T22:06:10.772162+0000","last_fullsized":"2024-08-18T22:06:10.772162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:00.879178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:32.865645+0000","last_change":"2024-08-18T22:05:19.845785+0000","last_active":"2024-08-18T22:05:32.865645+0000","last_peered":"2024-08-18T22:05:32.865645+0000","last_clean":"2024-08-18T22:05:32.865645+0000","last_became_active":"2024-08-18T22:05:19.845414+0000","last_became_peered":"2024-08-18T22:05:19.845414+0000","last_unstale":"2024-08-18T22:05:32.865645+0000","last_undegraded":"2024-08-18T22:05:32.865645+0000","last_fullsized":"2024-08-18T22:05:32.865645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:13.504885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.130766+0000","last_change":"2024-08-18T22:05:28.921647+0000","last_active":"2024-08-18T22:05:33.130766+0000","last_peered":"2024-08-18T22:05:33.130766+0000","last_clean":"2024-08-18T22:05:33.130766+0000","last_became_active":"2024-08-18T22:05:28.921045+0000","last_became_peered":"2024-08-18T22:05:28.921045+0000","last_unstale":"2024-08-18T22:05:33.130766+0000","last_undegraded":"2024-08-18T22:05:33.130766+0000","last_fullsized":"2024-08-18T22:05:33.130766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:45.933489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510102+0000","last_change":"2024-08-18T22:05:21.858329+0000","last_active":"2024-08-18T22:06:10.510102+0000","last_peered":"2024-08-18T22:06:10.510102+0000","last_clean":"2024-08-18T22:06:10.510102+0000","last_became_active":"2024-08-18T22:05:21.857854+0000","last_became_peered":"2024-08-18T22:05:21.857854+0000","last_unstale":"2024-08-18T22:06:10.510102+0000","last_undegraded":"2024-08-18T22:06:10.510102+0000","last_fullsized":"2024-08-18T22:06:10.510102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:45:19.934647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772068+0000","last_change":"2024-08-18T22:05:19.843031+0000","last_active":"2024-08-18T22:06:10.772068+0000","last_peered":"2024-08-18T22:06:10.772068+0000","last_clean":"2024-08-18T22:06:10.772068+0000","last_became_active":"2024-08-18T22:05:19.842694+0000","last_became_peered":"2024-08-18T22:05:19.842694+0000","last_unstale":"2024-08-18T22:06:10.772068+0000","last_undegraded":"2024-08-18T22:06:10.772068+0000","last_fullsized":"2024-08-18T22:06:10.772068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:01.135449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509575+0000","last_change":"2024-08-18T22:05:28.920647+0000","last_active":"2024-08-18T22:06:10.509575+0000","last_peered":"2024-08-18T22:06:10.509575+0000","last_clean":"2024-08-18T22:06:10.509575+0000","last_became_active":"2024-08-18T22:05:28.920295+0000","last_became_peered":"2024-08-18T22:05:28.920295+0000","last_unstale":"2024-08-18T22:06:10.509575+0000","last_undegraded":"2024-08-18T22:06:10.509575+0000","last_fullsized":"2024-08-18T22:06:10.509575+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:41.295009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513283+0000","last_change":"2024-08-18T22:05:21.858413+0000","last_active":"2024-08-18T22:06:10.513283+0000","last_peered":"2024-08-18T22:06:10.513283+0000","last_clean":"2024-08-18T22:06:10.513283+0000","last_became_active":"2024-08-18T22:05:21.858102+0000","last_became_peered":"2024-08-18T22:05:21.858102+0000","last_unstale":"2024-08-18T22:06:10.513283+0000","last_undegraded":"2024-08-18T22:06:10.513283+0000","last_fullsized":"2024-08-18T22:06:10.513283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:24:59.432666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:56.447686+0000","last_change":"2024-08-18T22:05:20.292085+0000","last_active":"2024-08-18T22:05:56.447686+0000","last_peered":"2024-08-18T22:05:56.447686+0000","last_clean":"2024-08-18T22:05:56.447686+0000","last_became_active":"2024-08-18T22:05:20.291606+0000","last_became_peered":"2024-08-18T22:05:20.291606+0000","last_unstale":"2024-08-18T22:05:56.447686+0000","last_undegraded":"2024-08-18T22:05:56.447686+0000","last_fullsized":"2024-08-18T22:05:56.447686+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:22:46.801719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.130148+0000","last_change":"2024-08-18T22:05:29.012959+0000","last_active":"2024-08-18T22:05:33.130148+0000","last_peered":"2024-08-18T22:05:33.130148+0000","last_clean":"2024-08-18T22:05:33.130148+0000","last_became_active":"2024-08-18T22:05:29.012293+0000","last_became_peered":"2024-08-18T22:05:29.012293+0000","last_unstale":"2024-08-18T22:05:33.130148+0000","last_undegraded":"2024-08-18T22:05:33.130148+0000","last_fullsized":"2024-08-18T22:05:33.130148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:50:40.359605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508880+0000","last_change":"2024-08-18T22:05:21.855163+0000","last_active":"2024-08-18T22:06:10.508880+0000","last_peered":"2024-08-18T22:06:10.508880+0000","last_clean":"2024-08-18T22:06:10.508880+0000","last_became_active":"2024-08-18T22:05:21.854867+0000","last_became_peered":"2024-08-18T22:05:21.854867+0000","last_unstale":"2024-08-18T22:06:10.508880+0000","last_undegraded":"2024-08-18T22:06:10.508880+0000","last_fullsized":"2024-08-18T22:06:10.508880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:10.300307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:56.446707+0000","last_change":"2024-08-18T22:05:20.082363+0000","last_active":"2024-08-18T22:05:56.446707+0000","last_peered":"2024-08-18T22:05:56.446707+0000","last_clean":"2024-08-18T22:05:56.446707+0000","last_became_active":"2024-08-18T22:05:20.081998+0000","last_became_peered":"2024-08-18T22:05:20.081998+0000","last_unstale":"2024-08-18T22:05:56.446707+0000","last_undegraded":"2024-08-18T22:05:56.446707+0000","last_fullsized":"2024-08-18T22:05:56.446707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:44.960512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:32.865743+0000","last_change":"2024-08-18T22:05:28.924072+0000","last_active":"2024-08-18T22:05:32.865743+0000","last_peered":"2024-08-18T22:05:32.865743+0000","last_clean":"2024-08-18T22:05:32.865743+0000","last_became_active":"2024-08-18T22:05:28.923673+0000","last_became_peered":"2024-08-18T22:05:28.923673+0000","last_unstale":"2024-08-18T22:05:32.865743+0000","last_undegraded":"2024-08-18T22:05:32.865743+0000","last_fullsized":"2024-08-18T22:05:32.865743+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:44.593009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772399+0000","last_change":"2024-08-18T22:05:21.851377+0000","last_active":"2024-08-18T22:06:10.772399+0000","last_peered":"2024-08-18T22:06:10.772399+0000","last_clean":"2024-08-18T22:06:10.772399+0000","last_became_active":"2024-08-18T22:05:21.851031+0000","last_became_peered":"2024-08-18T22:05:21.851031+0000","last_unstale":"2024-08-18T22:06:10.772399+0000","last_undegraded":"2024-08-18T22:06:10.772399+0000","last_fullsized":"2024-08-18T22:06:10.772399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.547244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509550+0000","last_change":"2024-08-18T22:05:19.840697+0000","last_active":"2024-08-18T22:06:10.509550+0000","last_peered":"2024-08-18T22:06:10.509550+0000","last_clean":"2024-08-18T22:06:10.509550+0000","last_became_active":"2024-08-18T22:05:19.840382+0000","last_became_peered":"2024-08-18T22:05:19.840382+0000","last_unstale":"2024-08-18T22:06:10.509550+0000","last_undegraded":"2024-08-18T22:06:10.509550+0000","last_fullsized":"2024-08-18T22:06:10.509550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:24.514428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771817+0000","last_change":"2024-08-18T22:05:29.012305+0000","last_active":"2024-08-18T22:06:10.771817+0000","last_peered":"2024-08-18T22:06:10.771817+0000","last_clean":"2024-08-18T22:06:10.771817+0000","last_became_active":"2024-08-18T22:05:29.011846+0000","last_became_peered":"2024-08-18T22:05:29.011846+0000","last_unstale":"2024-08-18T22:06:10.771817+0000","last_undegraded":"2024-08-18T22:06:10.771817+0000","last_fullsized":"2024-08-18T22:06:10.771817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:36.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.129678+0000","last_change":"2024-08-18T22:05:21.856182+0000","last_active":"2024-08-18T22:05:33.129678+0000","last_peered":"2024-08-18T22:05:33.129678+0000","last_clean":"2024-08-18T22:05:33.129678+0000","last_became_active":"2024-08-18T22:05:21.855855+0000","last_became_peered":"2024-08-18T22:05:21.855855+0000","last_unstale":"2024-08-18T22:05:33.129678+0000","last_undegraded":"2024-08-18T22:05:33.129678+0000","last_fullsized":"2024-08-18T22:05:33.129678+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:00.166809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514793+0000","last_change":"2024-08-18T22:05:20.291272+0000","last_active":"2024-08-18T22:06:10.514793+0000","last_peered":"2024-08-18T22:06:10.514793+0000","last_clean":"2024-08-18T22:06:10.514793+0000","last_became_active":"2024-08-18T22:05:20.290970+0000","last_became_peered":"2024-08-18T22:05:20.290970+0000","last_unstale":"2024-08-18T22:06:10.514793+0000","last_undegraded":"2024-08-18T22:06:10.514793+0000","last_fullsized":"2024-08-18T22:06:10.514793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:29.438996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510601+0000","last_change":"2024-08-18T22:05:28.923141+0000","last_active":"2024-08-18T22:06:10.510601+0000","last_peered":"2024-08-18T22:06:10.510601+0000","last_clean":"2024-08-18T22:06:10.510601+0000","last_became_active":"2024-08-18T22:05:28.922269+0000","last_became_peered":"2024-08-18T22:05:28.922269+0000","last_unstale":"2024-08-18T22:06:10.510601+0000","last_undegraded":"2024-08-18T22:06:10.510601+0000","last_fullsized":"2024-08-18T22:06:10.510601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:58.092640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:31.917097+0000","last_change":"2024-08-18T22:05:21.850124+0000","last_active":"2024-08-18T22:05:31.917097+0000","last_peered":"2024-08-18T22:05:31.917097+0000","last_clean":"2024-08-18T22:05:31.917097+0000","last_became_active":"2024-08-18T22:05:21.849805+0000","last_became_peered":"2024-08-18T22:05:21.849805+0000","last_unstale":"2024-08-18T22:05:31.917097+0000","last_undegraded":"2024-08-18T22:05:31.917097+0000","last_fullsized":"2024-08-18T22:05:31.917097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:53.492613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509230+0000","last_change":"2024-08-18T22:05:20.292836+0000","last_active":"2024-08-18T22:06:10.509230+0000","last_peered":"2024-08-18T22:06:10.509230+0000","last_clean":"2024-08-18T22:06:10.509230+0000","last_became_active":"2024-08-18T22:05:20.292456+0000","last_became_peered":"2024-08-18T22:05:20.292456+0000","last_unstale":"2024-08-18T22:06:10.509230+0000","last_undegraded":"2024-08-18T22:06:10.509230+0000","last_fullsized":"2024-08-18T22:06:10.509230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:19.525037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513298+0000","last_change":"2024-08-18T22:05:29.012439+0000","last_active":"2024-08-18T22:06:10.513298+0000","last_peered":"2024-08-18T22:06:10.513298+0000","last_clean":"2024-08-18T22:06:10.513298+0000","last_became_active":"2024-08-18T22:05:29.011860+0000","last_became_peered":"2024-08-18T22:05:29.011860+0000","last_unstale":"2024-08-18T22:06:10.513298+0000","last_undegraded":"2024-08-18T22:06:10.513298+0000","last_fullsized":"2024-08-18T22:06:10.513298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:03.432217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:31.916937+0000","last_change":"2024-08-18T22:05:21.855598+0000","last_active":"2024-08-18T22:05:31.916937+0000","last_peered":"2024-08-18T22:05:31.916937+0000","last_clean":"2024-08-18T22:05:31.916937+0000","last_became_active":"2024-08-18T22:05:21.855228+0000","last_became_peered":"2024-08-18T22:05:21.855228+0000","last_unstale":"2024-08-18T22:05:31.916937+0000","last_undegraded":"2024-08-18T22:05:31.916937+0000","last_fullsized":"2024-08-18T22:05:31.916937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:33.762700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.504842+0000","last_change":"2024-08-18T22:05:19.844638+0000","last_active":"2024-08-18T22:06:09.504842+0000","last_peered":"2024-08-18T22:06:09.504842+0000","last_clean":"2024-08-18T22:06:09.504842+0000","last_became_active":"2024-08-18T22:05:19.844333+0000","last_became_peered":"2024-08-18T22:05:19.844333+0000","last_unstale":"2024-08-18T22:06:09.504842+0000","last_undegraded":"2024-08-18T22:06:09.504842+0000","last_fullsized":"2024-08-18T22:06:09.504842+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:26.947512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.129581+0000","last_change":"2024-08-18T22:05:28.919965+0000","last_active":"2024-08-18T22:05:33.129581+0000","last_peered":"2024-08-18T22:05:33.129581+0000","last_clean":"2024-08-18T22:05:33.129581+0000","last_became_active":"2024-08-18T22:05:28.919546+0000","last_became_peered":"2024-08-18T22:05:28.919546+0000","last_unstale":"2024-08-18T22:05:33.129581+0000","last_undegraded":"2024-08-18T22:05:33.129581+0000","last_fullsized":"2024-08-18T22:05:33.129581+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:49.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.510656+0000","last_change":"2024-08-18T22:05:21.857867+0000","last_active":"2024-08-18T22:06:09.510656+0000","last_peered":"2024-08-18T22:06:09.510656+0000","last_clean":"2024-08-18T22:06:09.510656+0000","last_became_active":"2024-08-18T22:05:21.857515+0000","last_became_peered":"2024-08-18T22:05:21.857515+0000","last_unstale":"2024-08-18T22:06:09.510656+0000","last_undegraded":"2024-08-18T22:06:09.510656+0000","last_fullsized":"2024-08-18T22:06:09.510656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:51.148321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:06:06.472550+0000","last_change":"2024-08-18T22:05:20.290924+0000","last_active":"2024-08-18T22:06:06.472550+0000","last_peered":"2024-08-18T22:06:06.472550+0000","last_clean":"2024-08-18T22:06:06.472550+0000","last_became_active":"2024-08-18T22:05:20.290587+0000","last_became_peered":"2024-08-18T22:05:20.290587+0000","last_unstale":"2024-08-18T22:06:06.472550+0000","last_undegraded":"2024-08-18T22:06:06.472550+0000","last_fullsized":"2024-08-18T22:06:06.472550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:35.029634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.129740+0000","last_change":"2024-08-18T22:05:29.012876+0000","last_active":"2024-08-18T22:05:33.129740+0000","last_peered":"2024-08-18T22:05:33.129740+0000","last_clean":"2024-08-18T22:05:33.129740+0000","last_became_active":"2024-08-18T22:05:29.011930+0000","last_became_peered":"2024-08-18T22:05:29.011930+0000","last_unstale":"2024-08-18T22:05:33.129740+0000","last_undegraded":"2024-08-18T22:05:33.129740+0000","last_fullsized":"2024-08-18T22:05:33.129740+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:22:35.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.129279+0000","last_change":"2024-08-18T22:05:21.860798+0000","last_active":"2024-08-18T22:05:33.129279+0000","last_peered":"2024-08-18T22:05:33.129279+0000","last_clean":"2024-08-18T22:05:33.129279+0000","last_became_active":"2024-08-18T22:05:21.856968+0000","last_became_peered":"2024-08-18T22:05:21.856968+0000","last_unstale":"2024-08-18T22:05:33.129279+0000","last_undegraded":"2024-08-18T22:05:33.129279+0000","last_fullsized":"2024-08-18T22:05:33.129279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:54.934400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.504484+0000","last_change":"2024-08-18T22:05:19.844775+0000","last_active":"2024-08-18T22:06:09.504484+0000","last_peered":"2024-08-18T22:06:09.504484+0000","last_clean":"2024-08-18T22:06:09.504484+0000","last_became_active":"2024-08-18T22:05:19.844465+0000","last_became_peered":"2024-08-18T22:05:19.844465+0000","last_unstale":"2024-08-18T22:06:09.504484+0000","last_undegraded":"2024-08-18T22:06:09.504484+0000","last_fullsized":"2024-08-18T22:06:09.504484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.042335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.511865+0000","last_change":"2024-08-18T22:05:29.013275+0000","last_active":"2024-08-18T22:06:09.511865+0000","last_peered":"2024-08-18T22:06:09.511865+0000","last_clean":"2024-08-18T22:06:09.511865+0000","last_became_active":"2024-08-18T22:05:29.012537+0000","last_became_peered":"2024-08-18T22:05:29.012537+0000","last_unstale":"2024-08-18T22:06:09.511865+0000","last_undegraded":"2024-08-18T22:06:09.511865+0000","last_fullsized":"2024-08-18T22:06:09.511865+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:15:39.775360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772046+0000","last_change":"2024-08-18T22:05:21.853358+0000","last_active":"2024-08-18T22:06:10.772046+0000","last_peered":"2024-08-18T22:06:10.772046+0000","last_clean":"2024-08-18T22:06:10.772046+0000","last_became_active":"2024-08-18T22:05:21.853071+0000","last_became_peered":"2024-08-18T22:05:21.853071+0000","last_unstale":"2024-08-18T22:06:10.772046+0000","last_undegraded":"2024-08-18T22:06:10.772046+0000","last_fullsized":"2024-08-18T22:06:10.772046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:23.755263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:58.458406+0000","last_change":"2024-08-18T22:05:19.846922+0000","last_active":"2024-08-18T22:05:58.458406+0000","last_peered":"2024-08-18T22:05:58.458406+0000","last_clean":"2024-08-18T22:05:58.458406+0000","last_became_active":"2024-08-18T22:05:19.846619+0000","last_became_peered":"2024-08-18T22:05:19.846619+0000","last_unstale":"2024-08-18T22:05:58.458406+0000","last_undegraded":"2024-08-18T22:05:58.458406+0000","last_fullsized":"2024-08-18T22:05:58.458406+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:36:16.232344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.504607+0000","last_change":"2024-08-18T22:04:11.878703+0000","last_active":"2024-08-18T22:06:09.504607+0000","last_peered":"2024-08-18T22:06:09.504607+0000","last_clean":"2024-08-18T22:06:09.504607+0000","last_became_active":"2024-08-18T22:04:11.878157+0000","last_became_peered":"2024-08-18T22:04:11.878157+0000","last_unstale":"2024-08-18T22:06:09.504607+0000","last_undegraded":"2024-08-18T22:06:09.504607+0000","last_fullsized":"2024-08-18T22:06:09.504607+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_clean_scrub_stamp":"2024-08-18T22:01:09.551264+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:24:07.391758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.504946+0000","last_change":"2024-08-18T22:05:28.928882+0000","last_active":"2024-08-18T22:06:09.504946+0000","last_peered":"2024-08-18T22:06:09.504946+0000","last_clean":"2024-08-18T22:06:09.504946+0000","last_became_active":"2024-08-18T22:05:28.928482+0000","last_became_peered":"2024-08-18T22:05:28.928482+0000","last_unstale":"2024-08-18T22:06:09.504946+0000","last_undegraded":"2024-08-18T22:06:09.504946+0000","last_fullsized":"2024-08-18T22:06:09.504946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:41.739482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.505125+0000","last_change":"2024-08-18T22:05:21.863045+0000","last_active":"2024-08-18T22:06:09.505125+0000","last_peered":"2024-08-18T22:06:09.505125+0000","last_clean":"2024-08-18T22:06:09.505125+0000","last_became_active":"2024-08-18T22:05:21.862758+0000","last_became_peered":"2024-08-18T22:05:21.862758+0000","last_unstale":"2024-08-18T22:06:09.505125+0000","last_undegraded":"2024-08-18T22:06:09.505125+0000","last_fullsized":"2024-08-18T22:06:09.505125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:08:39.111147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:57.455238+0000","last_change":"2024-08-18T22:05:20.291030+0000","last_active":"2024-08-18T22:05:57.455238+0000","last_peered":"2024-08-18T22:05:57.455238+0000","last_clean":"2024-08-18T22:05:57.455238+0000","last_became_active":"2024-08-18T22:05:20.290427+0000","last_became_peered":"2024-08-18T22:05:20.290427+0000","last_unstale":"2024-08-18T22:05:57.455238+0000","last_undegraded":"2024-08-18T22:05:57.455238+0000","last_fullsized":"2024-08-18T22:05:57.455238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:14:42.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.130173+0000","last_change":"2024-08-18T22:05:28.923700+0000","last_active":"2024-08-18T22:05:33.130173+0000","last_peered":"2024-08-18T22:05:33.130173+0000","last_clean":"2024-08-18T22:05:33.130173+0000","last_became_active":"2024-08-18T22:05:28.923280+0000","last_became_peered":"2024-08-18T22:05:28.923280+0000","last_unstale":"2024-08-18T22:05:33.130173+0000","last_undegraded":"2024-08-18T22:05:33.130173+0000","last_fullsized":"2024-08-18T22:05:33.130173+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:25:45.343542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.505094+0000","last_change":"2024-08-18T22:05:21.856107+0000","last_active":"2024-08-18T22:06:09.505094+0000","last_peered":"2024-08-18T22:06:09.505094+0000","last_clean":"2024-08-18T22:06:09.505094+0000","last_became_active":"2024-08-18T22:05:21.853276+0000","last_became_peered":"2024-08-18T22:05:21.853276+0000","last_unstale":"2024-08-18T22:06:09.505094+0000","last_undegraded":"2024-08-18T22:06:09.505094+0000","last_fullsized":"2024-08-18T22:06:09.505094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:58.280375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.511618+0000","last_change":"2024-08-18T22:05:19.843445+0000","last_active":"2024-08-18T22:06:09.511618+0000","last_peered":"2024-08-18T22:06:09.511618+0000","last_clean":"2024-08-18T22:06:09.511618+0000","last_became_active":"2024-08-18T22:05:19.843000+0000","last_became_peered":"2024-08-18T22:05:19.843000+0000","last_unstale":"2024-08-18T22:06:09.511618+0000","last_undegraded":"2024-08-18T22:06:09.511618+0000","last_fullsized":"2024-08-18T22:06:09.511618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:23.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515953+0000","last_change":"2024-08-18T22:06:10.515953+0000","last_active":"2024-08-18T22:06:10.515953+0000","last_peered":"2024-08-18T22:06:10.515953+0000","last_clean":"2024-08-18T22:06:10.515953+0000","last_became_active":"2024-08-18T22:06:10.515662+0000","last_became_peered":"2024-08-18T22:06:10.515662+0000","last_unstale":"2024-08-18T22:06:10.515953+0000","last_undegraded":"2024-08-18T22:06:10.515953+0000","last_fullsized":"2024-08-18T22:06:10.515953+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:43.150180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.504996+0000","last_change":"2024-08-18T22:05:21.864029+0000","last_active":"2024-08-18T22:06:09.504996+0000","last_peered":"2024-08-18T22:06:09.504996+0000","last_clean":"2024-08-18T22:06:09.504996+0000","last_became_active":"2024-08-18T22:05:21.863509+0000","last_became_peered":"2024-08-18T22:05:21.863509+0000","last_unstale":"2024-08-18T22:06:09.504996+0000","last_undegraded":"2024-08-18T22:06:09.504996+0000","last_fullsized":"2024-08-18T22:06:09.504996+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:42.879243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.129711+0000","last_change":"2024-08-18T22:05:19.846514+0000","last_active":"2024-08-18T22:05:33.129711+0000","last_peered":"2024-08-18T22:05:33.129711+0000","last_clean":"2024-08-18T22:05:33.129711+0000","last_became_active":"2024-08-18T22:05:19.846190+0000","last_became_peered":"2024-08-18T22:05:19.846190+0000","last_unstale":"2024-08-18T22:05:33.129711+0000","last_undegraded":"2024-08-18T22:05:33.129711+0000","last_fullsized":"2024-08-18T22:05:33.129711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:49:00.317597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.510358+0000","last_change":"2024-08-18T22:05:28.923183+0000","last_active":"2024-08-18T22:06:09.510358+0000","last_peered":"2024-08-18T22:06:09.510358+0000","last_clean":"2024-08-18T22:06:09.510358+0000","last_became_active":"2024-08-18T22:05:28.922809+0000","last_became_peered":"2024-08-18T22:05:28.922809+0000","last_unstale":"2024-08-18T22:06:09.510358+0000","last_undegraded":"2024-08-18T22:06:09.510358+0000","last_fullsized":"2024-08-18T22:06:09.510358+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:26.416920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510283+0000","last_change":"2024-08-18T22:05:21.849075+0000","last_active":"2024-08-18T22:06:10.510283+0000","last_peered":"2024-08-18T22:06:10.510283+0000","last_clean":"2024-08-18T22:06:10.510283+0000","last_became_active":"2024-08-18T22:05:21.848759+0000","last_became_peered":"2024-08-18T22:05:21.848759+0000","last_unstale":"2024-08-18T22:06:10.510283+0000","last_undegraded":"2024-08-18T22:06:10.510283+0000","last_fullsized":"2024-08-18T22:06:10.510283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:26.531534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515145+0000","last_change":"2024-08-18T22:05:19.849210+0000","last_active":"2024-08-18T22:06:10.515145+0000","last_peered":"2024-08-18T22:06:10.515145+0000","last_clean":"2024-08-18T22:06:10.515145+0000","last_became_active":"2024-08-18T22:05:19.848829+0000","last_became_peered":"2024-08-18T22:05:19.848829+0000","last_unstale":"2024-08-18T22:06:10.515145+0000","last_undegraded":"2024-08-18T22:06:10.515145+0000","last_fullsized":"2024-08-18T22:06:10.515145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:19.321686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.510313+0000","last_change":"2024-08-18T22:05:28.924577+0000","last_active":"2024-08-18T22:06:09.510313+0000","last_peered":"2024-08-18T22:06:09.510313+0000","last_clean":"2024-08-18T22:06:09.510313+0000","last_became_active":"2024-08-18T22:05:28.924183+0000","last_became_peered":"2024-08-18T22:05:28.924183+0000","last_unstale":"2024-08-18T22:06:09.510313+0000","last_undegraded":"2024-08-18T22:06:09.510313+0000","last_fullsized":"2024-08-18T22:06:09.510313+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:22.702757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513994+0000","last_change":"2024-08-18T22:06:10.513610+0000","last_active":"2024-08-18T22:06:10.513994+0000","last_peered":"2024-08-18T22:06:10.513994+0000","last_clean":"2024-08-18T22:06:10.513994+0000","last_became_active":"2024-08-18T22:06:10.513400+0000","last_became_peered":"2024-08-18T22:06:10.513400+0000","last_unstale":"2024-08-18T22:06:10.513994+0000","last_undegraded":"2024-08-18T22:06:10.513994+0000","last_fullsized":"2024-08-18T22:06:10.513994+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:49.275223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513546+0000","last_change":"2024-08-18T22:05:20.291752+0000","last_active":"2024-08-18T22:06:10.513546+0000","last_peered":"2024-08-18T22:06:10.513546+0000","last_clean":"2024-08-18T22:06:10.513546+0000","last_became_active":"2024-08-18T22:05:20.291431+0000","last_became_peered":"2024-08-18T22:05:20.291431+0000","last_unstale":"2024-08-18T22:06:10.513546+0000","last_undegraded":"2024-08-18T22:06:10.513546+0000","last_fullsized":"2024-08-18T22:06:10.513546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:32.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.129716+0000","last_change":"2024-08-18T22:05:28.924121+0000","last_active":"2024-08-18T22:05:33.129716+0000","last_peered":"2024-08-18T22:05:33.129716+0000","last_clean":"2024-08-18T22:05:33.129716+0000","last_became_active":"2024-08-18T22:05:28.923753+0000","last_became_peered":"2024-08-18T22:05:28.923753+0000","last_unstale":"2024-08-18T22:05:33.129716+0000","last_undegraded":"2024-08-18T22:05:33.129716+0000","last_fullsized":"2024-08-18T22:05:33.129716+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:57.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.504391+0000","last_change":"2024-08-18T22:05:21.858366+0000","last_active":"2024-08-18T22:06:09.504391+0000","last_peered":"2024-08-18T22:06:09.504391+0000","last_clean":"2024-08-18T22:06:09.504391+0000","last_became_active":"2024-08-18T22:05:21.858021+0000","last_became_peered":"2024-08-18T22:05:21.858021+0000","last_unstale":"2024-08-18T22:06:09.504391+0000","last_undegraded":"2024-08-18T22:06:09.504391+0000","last_fullsized":"2024-08-18T22:06:09.504391+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:55.662965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:06:07.474411+0000","last_change":"2024-08-18T22:05:19.850013+0000","last_active":"2024-08-18T22:06:07.474411+0000","last_peered":"2024-08-18T22:06:07.474411+0000","last_clean":"2024-08-18T22:06:07.474411+0000","last_became_active":"2024-08-18T22:05:19.849551+0000","last_became_peered":"2024-08-18T22:05:19.849551+0000","last_unstale":"2024-08-18T22:06:07.474411+0000","last_undegraded":"2024-08-18T22:06:07.474411+0000","last_fullsized":"2024-08-18T22:06:07.474411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:15.182999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509627+0000","last_change":"2024-08-18T22:05:28.927318+0000","last_active":"2024-08-18T22:06:10.509627+0000","last_peered":"2024-08-18T22:06:10.509627+0000","last_clean":"2024-08-18T22:06:10.509627+0000","last_became_active":"2024-08-18T22:05:28.926786+0000","last_became_peered":"2024-08-18T22:05:28.926786+0000","last_unstale":"2024-08-18T22:06:10.509627+0000","last_undegraded":"2024-08-18T22:06:10.509627+0000","last_fullsized":"2024-08-18T22:06:10.509627+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:45.798247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"peering","last_fresh":"2024-08-18T22:05:33.130911+0000","last_change":"2024-08-18T22:06:09.505317+0000","last_active":"2024-08-18T22:06:09.505317+0000","last_peered":"2024-08-18T22:05:33.130911+0000","last_clean":"2024-08-18T22:05:33.130911+0000","last_became_active":"2024-08-18T22:05:21.857245+0000","last_became_peered":"2024-08-18T22:05:21.857245+0000","last_unstale":"2024-08-18T22:05:33.130911+0000","last_undegraded":"2024-08-18T22:05:33.130911+0000","last_fullsized":"2024-08-18T22:05:33.130911+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,6,9],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.511231+0000","last_change":"2024-08-18T22:05:19.844061+0000","last_active":"2024-08-18T22:06:09.511231+0000","last_peered":"2024-08-18T22:06:09.511231+0000","last_clean":"2024-08-18T22:06:09.511231+0000","last_became_active":"2024-08-18T22:05:19.843513+0000","last_became_peered":"2024-08-18T22:05:19.843513+0000","last_unstale":"2024-08-18T22:06:09.511231+0000","last_undegraded":"2024-08-18T22:06:09.511231+0000","last_fullsized":"2024-08-18T22:06:09.511231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:53.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510069+0000","last_change":"2024-08-18T22:05:28.922986+0000","last_active":"2024-08-18T22:06:10.510069+0000","last_peered":"2024-08-18T22:06:10.510069+0000","last_clean":"2024-08-18T22:06:10.510069+0000","last_became_active":"2024-08-18T22:05:28.922322+0000","last_became_peered":"2024-08-18T22:05:28.922322+0000","last_unstale":"2024-08-18T22:06:10.510069+0000","last_undegraded":"2024-08-18T22:06:10.510069+0000","last_fullsized":"2024-08-18T22:06:10.510069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:28.168299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.129419+0000","last_change":"2024-08-18T22:05:21.853389+0000","last_active":"2024-08-18T22:05:33.129419+0000","last_peered":"2024-08-18T22:05:33.129419+0000","last_clean":"2024-08-18T22:05:33.129419+0000","last_became_active":"2024-08-18T22:05:21.853095+0000","last_became_peered":"2024-08-18T22:05:21.853095+0000","last_unstale":"2024-08-18T22:05:33.129419+0000","last_undegraded":"2024-08-18T22:05:33.129419+0000","last_fullsized":"2024-08-18T22:05:33.129419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:14.126983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:57.456590+0000","last_change":"2024-08-18T22:05:19.846788+0000","last_active":"2024-08-18T22:05:57.456590+0000","last_peered":"2024-08-18T22:05:57.456590+0000","last_clean":"2024-08-18T22:05:57.456590+0000","last_became_active":"2024-08-18T22:05:19.846248+0000","last_became_peered":"2024-08-18T22:05:19.846248+0000","last_unstale":"2024-08-18T22:05:57.456590+0000","last_undegraded":"2024-08-18T22:05:57.456590+0000","last_fullsized":"2024-08-18T22:05:57.456590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:46.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.511186+0000","last_change":"2024-08-18T22:05:28.920294+0000","last_active":"2024-08-18T22:06:09.511186+0000","last_peered":"2024-08-18T22:06:09.511186+0000","last_clean":"2024-08-18T22:06:09.511186+0000","last_became_active":"2024-08-18T22:05:28.919351+0000","last_became_peered":"2024-08-18T22:05:28.919351+0000","last_unstale":"2024-08-18T22:06:09.511186+0000","last_undegraded":"2024-08-18T22:06:09.511186+0000","last_fullsized":"2024-08-18T22:06:09.511186+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:49.425281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514189+0000","last_change":"2024-08-18T22:05:21.864529+0000","last_active":"2024-08-18T22:06:10.514189+0000","last_peered":"2024-08-18T22:06:10.514189+0000","last_clean":"2024-08-18T22:06:10.514189+0000","last_became_active":"2024-08-18T22:05:21.864062+0000","last_became_peered":"2024-08-18T22:05:21.864062+0000","last_unstale":"2024-08-18T22:06:10.514189+0000","last_undegraded":"2024-08-18T22:06:10.514189+0000","last_fullsized":"2024-08-18T22:06:10.514189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:24:49.037343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'26","reported_seq":84,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:06:08.478908+0000","last_change":"2024-08-18T22:05:19.846706+0000","last_active":"2024-08-18T22:06:08.478908+0000","last_peered":"2024-08-18T22:06:08.478908+0000","last_clean":"2024-08-18T22:06:08.478908+0000","last_became_active":"2024-08-18T22:05:19.846401+0000","last_became_peered":"2024-08-18T22:05:19.846401+0000","last_unstale":"2024-08-18T22:06:08.478908+0000","last_undegraded":"2024-08-18T22:06:08.478908+0000","last_fullsized":"2024-08-18T22:06:08.478908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:34:04.458642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49092,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":62,"num_write":27,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508344+0000","last_change":"2024-08-18T22:05:28.926357+0000","last_active":"2024-08-18T22:06:10.508344+0000","last_peered":"2024-08-18T22:06:10.508344+0000","last_clean":"2024-08-18T22:06:10.508344+0000","last_became_active":"2024-08-18T22:05:28.926016+0000","last_became_peered":"2024-08-18T22:05:28.926016+0000","last_unstale":"2024-08-18T22:06:10.508344+0000","last_undegraded":"2024-08-18T22:06:10.508344+0000","last_fullsized":"2024-08-18T22:06:10.508344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:16.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.131736+0000","last_change":"2024-08-18T22:05:21.860237+0000","last_active":"2024-08-18T22:05:33.131736+0000","last_peered":"2024-08-18T22:05:33.131736+0000","last_clean":"2024-08-18T22:05:33.131736+0000","last_became_active":"2024-08-18T22:05:21.859919+0000","last_became_peered":"2024-08-18T22:05:21.859919+0000","last_unstale":"2024-08-18T22:05:33.131736+0000","last_undegraded":"2024-08-18T22:05:33.131736+0000","last_fullsized":"2024-08-18T22:05:33.131736+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:21.048413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.511482+0000","last_change":"2024-08-18T22:05:20.291233+0000","last_active":"2024-08-18T22:06:09.511482+0000","last_peered":"2024-08-18T22:06:09.511482+0000","last_clean":"2024-08-18T22:06:09.511482+0000","last_became_active":"2024-08-18T22:05:20.290893+0000","last_became_peered":"2024-08-18T22:05:20.290893+0000","last_unstale":"2024-08-18T22:06:09.511482+0000","last_undegraded":"2024-08-18T22:06:09.511482+0000","last_fullsized":"2024-08-18T22:06:09.511482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:36.889561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.130435+0000","last_change":"2024-08-18T22:05:28.923076+0000","last_active":"2024-08-18T22:05:33.130435+0000","last_peered":"2024-08-18T22:05:33.130435+0000","last_clean":"2024-08-18T22:05:33.130435+0000","last_became_active":"2024-08-18T22:05:28.922688+0000","last_became_peered":"2024-08-18T22:05:28.922688+0000","last_unstale":"2024-08-18T22:05:33.130435+0000","last_undegraded":"2024-08-18T22:05:33.130435+0000","last_fullsized":"2024-08-18T22:05:33.130435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:34.360540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509085+0000","last_change":"2024-08-18T22:05:21.855174+0000","last_active":"2024-08-18T22:06:10.509085+0000","last_peered":"2024-08-18T22:06:10.509085+0000","last_clean":"2024-08-18T22:06:10.509085+0000","last_became_active":"2024-08-18T22:05:21.854818+0000","last_became_peered":"2024-08-18T22:05:21.854818+0000","last_unstale":"2024-08-18T22:06:10.509085+0000","last_undegraded":"2024-08-18T22:06:10.509085+0000","last_fullsized":"2024-08-18T22:06:10.509085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:48:55.094624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.504866+0000","last_change":"2024-08-18T22:05:19.847876+0000","last_active":"2024-08-18T22:06:09.504866+0000","last_peered":"2024-08-18T22:06:09.504866+0000","last_clean":"2024-08-18T22:06:09.504866+0000","last_became_active":"2024-08-18T22:05:19.847505+0000","last_became_peered":"2024-08-18T22:05:19.847505+0000","last_unstale":"2024-08-18T22:06:09.504866+0000","last_undegraded":"2024-08-18T22:06:09.504866+0000","last_fullsized":"2024-08-18T22:06:09.504866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:50:15.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508005+0000","last_change":"2024-08-18T22:05:28.921647+0000","last_active":"2024-08-18T22:06:10.508005+0000","last_peered":"2024-08-18T22:06:10.508005+0000","last_clean":"2024-08-18T22:06:10.508005+0000","last_became_active":"2024-08-18T22:05:28.921305+0000","last_became_peered":"2024-08-18T22:05:28.921305+0000","last_unstale":"2024-08-18T22:06:10.508005+0000","last_undegraded":"2024-08-18T22:06:10.508005+0000","last_fullsized":"2024-08-18T22:06:10.508005+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:29.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.131219+0000","last_change":"2024-08-18T22:05:21.861151+0000","last_active":"2024-08-18T22:05:33.131219+0000","last_peered":"2024-08-18T22:05:33.131219+0000","last_clean":"2024-08-18T22:05:33.131219+0000","last_became_active":"2024-08-18T22:05:21.860834+0000","last_became_peered":"2024-08-18T22:05:21.860834+0000","last_unstale":"2024-08-18T22:05:33.131219+0000","last_undegraded":"2024-08-18T22:05:33.131219+0000","last_fullsized":"2024-08-18T22:05:33.131219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:32.890750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:06:07.474523+0000","last_change":"2024-08-18T22:05:19.846145+0000","last_active":"2024-08-18T22:06:07.474523+0000","last_peered":"2024-08-18T22:06:07.474523+0000","last_clean":"2024-08-18T22:06:07.474523+0000","last_became_active":"2024-08-18T22:05:19.845711+0000","last_became_peered":"2024-08-18T22:05:19.845711+0000","last_unstale":"2024-08-18T22:06:07.474523+0000","last_undegraded":"2024-08-18T22:06:07.474523+0000","last_fullsized":"2024-08-18T22:06:07.474523+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:20.376131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771915+0000","last_change":"2024-08-18T22:05:28.923256+0000","last_active":"2024-08-18T22:06:10.771915+0000","last_peered":"2024-08-18T22:06:10.771915+0000","last_clean":"2024-08-18T22:06:10.771915+0000","last_became_active":"2024-08-18T22:05:28.922845+0000","last_became_peered":"2024-08-18T22:05:28.922845+0000","last_unstale":"2024-08-18T22:06:10.771915+0000","last_undegraded":"2024-08-18T22:06:10.771915+0000","last_fullsized":"2024-08-18T22:06:10.771915+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:41.930937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508677+0000","last_change":"2024-08-18T22:05:28.924743+0000","last_active":"2024-08-18T22:06:10.508677+0000","last_peered":"2024-08-18T22:06:10.508677+0000","last_clean":"2024-08-18T22:06:10.508677+0000","last_became_active":"2024-08-18T22:05:28.923674+0000","last_became_peered":"2024-08-18T22:05:28.923674+0000","last_unstale":"2024-08-18T22:06:10.508677+0000","last_undegraded":"2024-08-18T22:06:10.508677+0000","last_fullsized":"2024-08-18T22:06:10.508677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:19.834998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508496+0000","last_change":"2024-08-18T22:05:21.857194+0000","last_active":"2024-08-18T22:06:10.508496+0000","last_peered":"2024-08-18T22:06:10.508496+0000","last_clean":"2024-08-18T22:06:10.508496+0000","last_became_active":"2024-08-18T22:05:21.856916+0000","last_became_peered":"2024-08-18T22:05:21.856916+0000","last_unstale":"2024-08-18T22:06:10.508496+0000","last_undegraded":"2024-08-18T22:06:10.508496+0000","last_fullsized":"2024-08-18T22:06:10.508496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:24.759501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.510882+0000","last_change":"2024-08-18T22:05:19.844919+0000","last_active":"2024-08-18T22:06:09.510882+0000","last_peered":"2024-08-18T22:06:09.510882+0000","last_clean":"2024-08-18T22:06:09.510882+0000","last_became_active":"2024-08-18T22:05:19.844539+0000","last_became_peered":"2024-08-18T22:05:19.844539+0000","last_unstale":"2024-08-18T22:06:09.510882+0000","last_undegraded":"2024-08-18T22:06:09.510882+0000","last_fullsized":"2024-08-18T22:06:09.510882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:01.598535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510256+0000","last_change":"2024-08-18T22:05:28.923304+0000","last_active":"2024-08-18T22:06:10.510256+0000","last_peered":"2024-08-18T22:06:10.510256+0000","last_clean":"2024-08-18T22:06:10.510256+0000","last_became_active":"2024-08-18T22:05:28.922912+0000","last_became_peered":"2024-08-18T22:05:28.922912+0000","last_unstale":"2024-08-18T22:06:10.510256+0000","last_undegraded":"2024-08-18T22:06:10.510256+0000","last_fullsized":"2024-08-18T22:06:10.510256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:24:47.834354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771950+0000","last_change":"2024-08-18T22:05:21.849448+0000","last_active":"2024-08-18T22:06:10.771950+0000","last_peered":"2024-08-18T22:06:10.771950+0000","last_clean":"2024-08-18T22:06:10.771950+0000","last_became_active":"2024-08-18T22:05:21.849154+0000","last_became_peered":"2024-08-18T22:05:21.849154+0000","last_unstale":"2024-08-18T22:06:10.771950+0000","last_undegraded":"2024-08-18T22:06:10.771950+0000","last_fullsized":"2024-08-18T22:06:10.771950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:38.583121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:57.455666+0000","last_change":"2024-08-18T22:05:19.848483+0000","last_active":"2024-08-18T22:05:57.455666+0000","last_peered":"2024-08-18T22:05:57.455666+0000","last_clean":"2024-08-18T22:05:57.455666+0000","last_became_active":"2024-08-18T22:05:19.848190+0000","last_became_peered":"2024-08-18T22:05:19.848190+0000","last_unstale":"2024-08-18T22:05:57.455666+0000","last_undegraded":"2024-08-18T22:05:57.455666+0000","last_fullsized":"2024-08-18T22:05:57.455666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:01.719565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:57.455847+0000","last_change":"2024-08-18T22:05:19.843796+0000","last_active":"2024-08-18T22:05:57.455847+0000","last_peered":"2024-08-18T22:05:57.455847+0000","last_clean":"2024-08-18T22:05:57.455847+0000","last_became_active":"2024-08-18T22:05:19.843495+0000","last_became_peered":"2024-08-18T22:05:19.843495+0000","last_unstale":"2024-08-18T22:05:57.455847+0000","last_undegraded":"2024-08-18T22:05:57.455847+0000","last_fullsized":"2024-08-18T22:05:57.455847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:21.583561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.511229+0000","last_change":"2024-08-18T22:05:21.856370+0000","last_active":"2024-08-18T22:06:09.511229+0000","last_peered":"2024-08-18T22:06:09.511229+0000","last_clean":"2024-08-18T22:06:09.511229+0000","last_became_active":"2024-08-18T22:05:21.855954+0000","last_became_peered":"2024-08-18T22:05:21.855954+0000","last_unstale":"2024-08-18T22:06:09.511229+0000","last_undegraded":"2024-08-18T22:06:09.511229+0000","last_fullsized":"2024-08-18T22:06:09.511229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:30.828305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:32.865829+0000","last_change":"2024-08-18T22:05:28.920996+0000","last_active":"2024-08-18T22:05:32.865829+0000","last_peered":"2024-08-18T22:05:32.865829+0000","last_clean":"2024-08-18T22:05:32.865829+0000","last_became_active":"2024-08-18T22:05:28.920446+0000","last_became_peered":"2024-08-18T22:05:28.920446+0000","last_unstale":"2024-08-18T22:05:32.865829+0000","last_undegraded":"2024-08-18T22:05:32.865829+0000","last_fullsized":"2024-08-18T22:05:32.865829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:38.402738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":53,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.511366+0000","last_change":"2024-08-18T22:05:19.846860+0000","last_active":"2024-08-18T22:06:09.511366+0000","last_peered":"2024-08-18T22:06:09.511366+0000","last_clean":"2024-08-18T22:06:09.511366+0000","last_became_active":"2024-08-18T22:05:19.846496+0000","last_became_peered":"2024-08-18T22:05:19.846496+0000","last_unstale":"2024-08-18T22:06:09.511366+0000","last_undegraded":"2024-08-18T22:06:09.511366+0000","last_fullsized":"2024-08-18T22:06:09.511366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:16.555137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513529+0000","last_change":"2024-08-18T22:05:21.849058+0000","last_active":"2024-08-18T22:06:10.513529+0000","last_peered":"2024-08-18T22:06:10.513529+0000","last_clean":"2024-08-18T22:06:10.513529+0000","last_became_active":"2024-08-18T22:05:21.848703+0000","last_became_peered":"2024-08-18T22:05:21.848703+0000","last_unstale":"2024-08-18T22:06:10.513529+0000","last_undegraded":"2024-08-18T22:06:10.513529+0000","last_fullsized":"2024-08-18T22:06:10.513529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:10.024156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:32.866046+0000","last_change":"2024-08-18T22:05:28.922968+0000","last_active":"2024-08-18T22:05:32.866046+0000","last_peered":"2024-08-18T22:05:32.866046+0000","last_clean":"2024-08-18T22:05:32.866046+0000","last_became_active":"2024-08-18T22:05:28.922378+0000","last_became_peered":"2024-08-18T22:05:28.922378+0000","last_unstale":"2024-08-18T22:05:32.866046+0000","last_undegraded":"2024-08-18T22:05:32.866046+0000","last_fullsized":"2024-08-18T22:05:32.866046+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:23:07.241028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509985+0000","last_change":"2024-08-18T22:05:21.858572+0000","last_active":"2024-08-18T22:06:10.509985+0000","last_peered":"2024-08-18T22:06:10.509985+0000","last_clean":"2024-08-18T22:06:10.509985+0000","last_became_active":"2024-08-18T22:05:21.858254+0000","last_became_peered":"2024-08-18T22:05:21.858254+0000","last_unstale":"2024-08-18T22:06:10.509985+0000","last_undegraded":"2024-08-18T22:06:10.509985+0000","last_fullsized":"2024-08-18T22:06:10.509985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:52.456087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:32.866028+0000","last_change":"2024-08-18T22:05:21.856710+0000","last_active":"2024-08-18T22:05:32.866028+0000","last_peered":"2024-08-18T22:05:32.866028+0000","last_clean":"2024-08-18T22:05:32.866028+0000","last_became_active":"2024-08-18T22:05:21.855399+0000","last_became_peered":"2024-08-18T22:05:21.855399+0000","last_unstale":"2024-08-18T22:05:32.866028+0000","last_undegraded":"2024-08-18T22:05:32.866028+0000","last_fullsized":"2024-08-18T22:05:32.866028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:36.039953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:32.865565+0000","last_change":"2024-08-18T22:05:21.856085+0000","last_active":"2024-08-18T22:05:32.865565+0000","last_peered":"2024-08-18T22:05:32.865565+0000","last_clean":"2024-08-18T22:05:32.865565+0000","last_became_active":"2024-08-18T22:05:21.855263+0000","last_became_peered":"2024-08-18T22:05:21.855263+0000","last_unstale":"2024-08-18T22:05:32.865565+0000","last_undegraded":"2024-08-18T22:05:32.865565+0000","last_fullsized":"2024-08-18T22:05:32.865565+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:31.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509110+0000","last_change":"2024-08-18T22:05:21.855385+0000","last_active":"2024-08-18T22:06:10.509110+0000","last_peered":"2024-08-18T22:06:10.509110+0000","last_clean":"2024-08-18T22:06:10.509110+0000","last_became_active":"2024-08-18T22:05:21.854829+0000","last_became_peered":"2024-08-18T22:05:21.854829+0000","last_unstale":"2024-08-18T22:06:10.509110+0000","last_undegraded":"2024-08-18T22:06:10.509110+0000","last_fullsized":"2024-08-18T22:06:10.509110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:59.704154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.129617+0000","last_change":"2024-08-18T22:05:21.860816+0000","last_active":"2024-08-18T22:05:33.129617+0000","last_peered":"2024-08-18T22:05:33.129617+0000","last_clean":"2024-08-18T22:05:33.129617+0000","last_became_active":"2024-08-18T22:05:21.856601+0000","last_became_peered":"2024-08-18T22:05:21.856601+0000","last_unstale":"2024-08-18T22:05:33.129617+0000","last_undegraded":"2024-08-18T22:05:33.129617+0000","last_fullsized":"2024-08-18T22:05:33.129617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:56:31.060798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510420+0000","last_change":"2024-08-18T22:05:21.856137+0000","last_active":"2024-08-18T22:06:10.510420+0000","last_peered":"2024-08-18T22:06:10.510420+0000","last_clean":"2024-08-18T22:06:10.510420+0000","last_became_active":"2024-08-18T22:05:21.855425+0000","last_became_peered":"2024-08-18T22:05:21.855425+0000","last_unstale":"2024-08-18T22:06:10.510420+0000","last_undegraded":"2024-08-18T22:06:10.510420+0000","last_fullsized":"2024-08-18T22:06:10.510420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:37.514710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:32.866034+0000","last_change":"2024-08-18T22:05:21.856084+0000","last_active":"2024-08-18T22:05:32.866034+0000","last_peered":"2024-08-18T22:05:32.866034+0000","last_clean":"2024-08-18T22:05:32.866034+0000","last_became_active":"2024-08-18T22:05:21.855779+0000","last_became_peered":"2024-08-18T22:05:21.855779+0000","last_unstale":"2024-08-18T22:05:32.866034+0000","last_undegraded":"2024-08-18T22:05:32.866034+0000","last_fullsized":"2024-08-18T22:05:32.866034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:02:47.833634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772328+0000","last_change":"2024-08-18T22:05:21.856729+0000","last_active":"2024-08-18T22:06:10.772328+0000","last_peered":"2024-08-18T22:06:10.772328+0000","last_clean":"2024-08-18T22:06:10.772328+0000","last_became_active":"2024-08-18T22:05:21.856446+0000","last_became_peered":"2024-08-18T22:05:21.856446+0000","last_unstale":"2024-08-18T22:06:10.772328+0000","last_undegraded":"2024-08-18T22:06:10.772328+0000","last_fullsized":"2024-08-18T22:06:10.772328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.482225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.510552+0000","last_change":"2024-08-18T22:05:21.851772+0000","last_active":"2024-08-18T22:06:09.510552+0000","last_peered":"2024-08-18T22:06:09.510552+0000","last_clean":"2024-08-18T22:06:09.510552+0000","last_became_active":"2024-08-18T22:05:21.851417+0000","last_became_peered":"2024-08-18T22:05:21.851417+0000","last_unstale":"2024-08-18T22:06:09.510552+0000","last_undegraded":"2024-08-18T22:06:09.510552+0000","last_fullsized":"2024-08-18T22:06:09.510552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:32.509318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771984+0000","last_change":"2024-08-18T22:05:21.857887+0000","last_active":"2024-08-18T22:06:10.771984+0000","last_peered":"2024-08-18T22:06:10.771984+0000","last_clean":"2024-08-18T22:06:10.771984+0000","last_became_active":"2024-08-18T22:05:21.857585+0000","last_became_peered":"2024-08-18T22:05:21.857585+0000","last_unstale":"2024-08-18T22:06:10.771984+0000","last_undegraded":"2024-08-18T22:06:10.771984+0000","last_fullsized":"2024-08-18T22:06:10.771984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:23.299033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.130394+0000","last_change":"2024-08-18T22:05:21.854626+0000","last_active":"2024-08-18T22:05:33.130394+0000","last_peered":"2024-08-18T22:05:33.130394+0000","last_clean":"2024-08-18T22:05:33.130394+0000","last_became_active":"2024-08-18T22:05:21.854290+0000","last_became_peered":"2024-08-18T22:05:21.854290+0000","last_unstale":"2024-08-18T22:05:33.130394+0000","last_undegraded":"2024-08-18T22:05:33.130394+0000","last_fullsized":"2024-08-18T22:05:33.130394+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:45:24.988669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.129496+0000","last_change":"2024-08-18T22:05:21.865863+0000","last_active":"2024-08-18T22:05:33.129496+0000","last_peered":"2024-08-18T22:05:33.129496+0000","last_clean":"2024-08-18T22:05:33.129496+0000","last_became_active":"2024-08-18T22:05:21.864634+0000","last_became_peered":"2024-08-18T22:05:21.864634+0000","last_unstale":"2024-08-18T22:05:33.129496+0000","last_undegraded":"2024-08-18T22:05:33.129496+0000","last_fullsized":"2024-08-18T22:05:33.129496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:34.051147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510087+0000","last_change":"2024-08-18T22:05:21.860193+0000","last_active":"2024-08-18T22:06:10.510087+0000","last_peered":"2024-08-18T22:06:10.510087+0000","last_clean":"2024-08-18T22:06:10.510087+0000","last_became_active":"2024-08-18T22:05:21.859761+0000","last_became_peered":"2024-08-18T22:05:21.859761+0000","last_unstale":"2024-08-18T22:06:10.510087+0000","last_undegraded":"2024-08-18T22:06:10.510087+0000","last_fullsized":"2024-08-18T22:06:10.510087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:18.465913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:32.866157+0000","last_change":"2024-08-18T22:05:21.860569+0000","last_active":"2024-08-18T22:05:32.866157+0000","last_peered":"2024-08-18T22:05:32.866157+0000","last_clean":"2024-08-18T22:05:32.866157+0000","last_became_active":"2024-08-18T22:05:21.860250+0000","last_became_peered":"2024-08-18T22:05:21.860250+0000","last_unstale":"2024-08-18T22:05:32.866157+0000","last_undegraded":"2024-08-18T22:05:32.866157+0000","last_fullsized":"2024-08-18T22:05:32.866157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:52.097840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509523+0000","last_change":"2024-08-18T22:05:21.858271+0000","last_active":"2024-08-18T22:06:10.509523+0000","last_peered":"2024-08-18T22:06:10.509523+0000","last_clean":"2024-08-18T22:06:10.509523+0000","last_became_active":"2024-08-18T22:05:21.857968+0000","last_became_peered":"2024-08-18T22:05:21.857968+0000","last_unstale":"2024-08-18T22:06:10.509523+0000","last_undegraded":"2024-08-18T22:06:10.509523+0000","last_fullsized":"2024-08-18T22:06:10.509523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:24.023136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510630+0000","last_change":"2024-08-18T22:05:21.853799+0000","last_active":"2024-08-18T22:06:10.510630+0000","last_peered":"2024-08-18T22:06:10.510630+0000","last_clean":"2024-08-18T22:06:10.510630+0000","last_became_active":"2024-08-18T22:05:21.853432+0000","last_became_peered":"2024-08-18T22:05:21.853432+0000","last_unstale":"2024-08-18T22:06:10.510630+0000","last_undegraded":"2024-08-18T22:06:10.510630+0000","last_fullsized":"2024-08-18T22:06:10.510630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:07.429169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.131219+0000","last_change":"2024-08-18T22:05:21.855117+0000","last_active":"2024-08-18T22:05:33.131219+0000","last_peered":"2024-08-18T22:05:33.131219+0000","last_clean":"2024-08-18T22:05:33.131219+0000","last_became_active":"2024-08-18T22:05:21.854041+0000","last_became_peered":"2024-08-18T22:05:21.854041+0000","last_unstale":"2024-08-18T22:05:33.131219+0000","last_undegraded":"2024-08-18T22:05:33.131219+0000","last_fullsized":"2024-08-18T22:05:33.131219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:17.222658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508062+0000","last_change":"2024-08-18T22:05:21.861745+0000","last_active":"2024-08-18T22:06:10.508062+0000","last_peered":"2024-08-18T22:06:10.508062+0000","last_clean":"2024-08-18T22:06:10.508062+0000","last_became_active":"2024-08-18T22:05:21.861427+0000","last_became_peered":"2024-08-18T22:05:21.861427+0000","last_unstale":"2024-08-18T22:06:10.508062+0000","last_undegraded":"2024-08-18T22:06:10.508062+0000","last_fullsized":"2024-08-18T22:06:10.508062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:17.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508302+0000","last_change":"2024-08-18T22:05:21.860046+0000","last_active":"2024-08-18T22:06:10.508302+0000","last_peered":"2024-08-18T22:06:10.508302+0000","last_clean":"2024-08-18T22:06:10.508302+0000","last_became_active":"2024-08-18T22:05:21.859674+0000","last_became_peered":"2024-08-18T22:05:21.859674+0000","last_unstale":"2024-08-18T22:06:10.508302+0000","last_undegraded":"2024-08-18T22:06:10.508302+0000","last_fullsized":"2024-08-18T22:06:10.508302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:44.615270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.129490+0000","last_change":"2024-08-18T22:05:21.847647+0000","last_active":"2024-08-18T22:05:33.129490+0000","last_peered":"2024-08-18T22:05:33.129490+0000","last_clean":"2024-08-18T22:05:33.129490+0000","last_became_active":"2024-08-18T22:05:21.847367+0000","last_became_peered":"2024-08-18T22:05:21.847367+0000","last_unstale":"2024-08-18T22:05:33.129490+0000","last_undegraded":"2024-08-18T22:05:33.129490+0000","last_fullsized":"2024-08-18T22:05:33.129490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:33.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.130807+0000","last_change":"2024-08-18T22:05:21.861326+0000","last_active":"2024-08-18T22:05:33.130807+0000","last_peered":"2024-08-18T22:05:33.130807+0000","last_clean":"2024-08-18T22:05:33.130807+0000","last_became_active":"2024-08-18T22:05:21.860968+0000","last_became_peered":"2024-08-18T22:05:21.860968+0000","last_unstale":"2024-08-18T22:05:33.130807+0000","last_undegraded":"2024-08-18T22:05:33.130807+0000","last_fullsized":"2024-08-18T22:05:33.130807+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:49.150670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.504866+0000","last_change":"2024-08-18T22:05:21.852618+0000","last_active":"2024-08-18T22:06:09.504866+0000","last_peered":"2024-08-18T22:06:09.504866+0000","last_clean":"2024-08-18T22:06:09.504866+0000","last_became_active":"2024-08-18T22:05:21.852318+0000","last_became_peered":"2024-08-18T22:05:21.852318+0000","last_unstale":"2024-08-18T22:06:09.504866+0000","last_undegraded":"2024-08-18T22:06:09.504866+0000","last_fullsized":"2024-08-18T22:06:09.504866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:06:49.085150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:31.917369+0000","last_change":"2024-08-18T22:05:21.860108+0000","last_active":"2024-08-18T22:05:31.917369+0000","last_peered":"2024-08-18T22:05:31.917369+0000","last_clean":"2024-08-18T22:05:31.917369+0000","last_became_active":"2024-08-18T22:05:21.859794+0000","last_became_peered":"2024-08-18T22:05:21.859794+0000","last_unstale":"2024-08-18T22:05:31.917369+0000","last_undegraded":"2024-08-18T22:05:31.917369+0000","last_fullsized":"2024-08-18T22:05:31.917369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:01.974202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.131660+0000","last_change":"2024-08-18T22:05:21.856404+0000","last_active":"2024-08-18T22:05:33.131660+0000","last_peered":"2024-08-18T22:05:33.131660+0000","last_clean":"2024-08-18T22:05:33.131660+0000","last_became_active":"2024-08-18T22:05:21.855800+0000","last_became_peered":"2024-08-18T22:05:21.855800+0000","last_unstale":"2024-08-18T22:05:33.131660+0000","last_undegraded":"2024-08-18T22:05:33.131660+0000","last_fullsized":"2024-08-18T22:05:33.131660+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:09.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771944+0000","last_change":"2024-08-18T22:05:21.859891+0000","last_active":"2024-08-18T22:06:10.771944+0000","last_peered":"2024-08-18T22:06:10.771944+0000","last_clean":"2024-08-18T22:06:10.771944+0000","last_became_active":"2024-08-18T22:05:21.859407+0000","last_became_peered":"2024-08-18T22:05:21.859407+0000","last_unstale":"2024-08-18T22:06:10.771944+0000","last_undegraded":"2024-08-18T22:06:10.771944+0000","last_fullsized":"2024-08-18T22:06:10.771944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:59.285627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.504476+0000","last_change":"2024-08-18T22:05:21.856428+0000","last_active":"2024-08-18T22:06:09.504476+0000","last_peered":"2024-08-18T22:06:09.504476+0000","last_clean":"2024-08-18T22:06:09.504476+0000","last_became_active":"2024-08-18T22:05:21.853374+0000","last_became_peered":"2024-08-18T22:05:21.853374+0000","last_unstale":"2024-08-18T22:06:09.504476+0000","last_undegraded":"2024-08-18T22:06:09.504476+0000","last_fullsized":"2024-08-18T22:06:09.504476+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:07.087171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:31.916809+0000","last_change":"2024-08-18T22:05:21.852688+0000","last_active":"2024-08-18T22:05:31.916809+0000","last_peered":"2024-08-18T22:05:31.916809+0000","last_clean":"2024-08-18T22:05:31.916809+0000","last_became_active":"2024-08-18T22:05:21.851107+0000","last_became_peered":"2024-08-18T22:05:21.851107+0000","last_unstale":"2024-08-18T22:05:31.916809+0000","last_undegraded":"2024-08-18T22:05:31.916809+0000","last_fullsized":"2024-08-18T22:05:31.916809+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:48.267166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513864+0000","last_change":"2024-08-18T22:05:21.850809+0000","last_active":"2024-08-18T22:06:10.513864+0000","last_peered":"2024-08-18T22:06:10.513864+0000","last_clean":"2024-08-18T22:06:10.513864+0000","last_became_active":"2024-08-18T22:05:21.850510+0000","last_became_peered":"2024-08-18T22:05:21.850510+0000","last_unstale":"2024-08-18T22:06:10.513864+0000","last_undegraded":"2024-08-18T22:06:10.513864+0000","last_fullsized":"2024-08-18T22:06:10.513864+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:39.338051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-18T22:05:33.130701+0000","last_change":"2024-08-18T22:05:21.856156+0000","last_active":"2024-08-18T22:05:33.130701+0000","last_peered":"2024-08-18T22:05:33.130701+0000","last_clean":"2024-08-18T22:05:33.130701+0000","last_became_active":"2024-08-18T22:05:21.855830+0000","last_became_peered":"2024-08-18T22:05:21.855830+0000","last_unstale":"2024-08-18T22:05:33.130701+0000","last_undegraded":"2024-08-18T22:05:33.130701+0000","last_fullsized":"2024-08-18T22:05:33.130701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:10.670405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508858+0000","last_change":"2024-08-18T22:05:21.865162+0000","last_active":"2024-08-18T22:06:10.508858+0000","last_peered":"2024-08-18T22:06:10.508858+0000","last_clean":"2024-08-18T22:06:10.508858+0000","last_became_active":"2024-08-18T22:05:21.864842+0000","last_became_peered":"2024-08-18T22:05:21.864842+0000","last_unstale":"2024-08-18T22:06:10.508858+0000","last_undegraded":"2024-08-18T22:06:10.508858+0000","last_fullsized":"2024-08-18T22:06:10.508858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:21.388638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508777+0000","last_change":"2024-08-18T22:05:21.859227+0000","last_active":"2024-08-18T22:06:10.508777+0000","last_peered":"2024-08-18T22:06:10.508777+0000","last_clean":"2024-08-18T22:06:10.508777+0000","last_became_active":"2024-08-18T22:05:21.858886+0000","last_became_peered":"2024-08-18T22:05:21.858886+0000","last_unstale":"2024-08-18T22:06:10.508777+0000","last_undegraded":"2024-08-18T22:06:10.508777+0000","last_fullsized":"2024-08-18T22:06:10.508777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:08.710772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510562+0000","last_change":"2024-08-18T22:05:21.854864+0000","last_active":"2024-08-18T22:06:10.510562+0000","last_peered":"2024-08-18T22:06:10.510562+0000","last_clean":"2024-08-18T22:06:10.510562+0000","last_became_active":"2024-08-18T22:05:21.854522+0000","last_became_peered":"2024-08-18T22:05:21.854522+0000","last_unstale":"2024-08-18T22:06:10.510562+0000","last_undegraded":"2024-08-18T22:06:10.510562+0000","last_fullsized":"2024-08-18T22:06:10.510562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:32.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":28672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53482,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":90,"num_read_kb":101,"num_write":155,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":160446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514517,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":504444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743451,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32800,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712352,"statfs":{"total":95995035648,"available":95961448448,"internally_reserved":0,"allocated":1662976,"data_stored":1122248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906976,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":504680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168613,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1036288,"data_stored":504600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397544,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36896,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708256,"statfs":{"total":95995035648,"available":95957254144,"internally_reserved":0,"allocated":1597440,"data_stored":1081952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561069,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":480910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790001,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1622016,"data_stored":1086732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953526,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":995328,"data_stored":485950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1011712,"data_stored":490686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":525899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":529912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":501244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":49092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":50832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":51060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:06:14.810 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-18T22:06:14.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:14 smithi183 ceph-mon[22097]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:06:15.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:14 smithi130 ceph-mon[21698]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:06:15.059 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:15.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.542+0000 7f5ec0308640 1 -- 172.21.15.123:0/3700315709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5eb810beb0 msgr2=0x7f5eb810e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:15.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.542+0000 7f5ec0308640 1 --2- 172.21.15.123:0/3700315709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5eb810beb0 0x7f5eb810e340 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8009ca0 tx=0x7f5ea802a950 comp rx=0 tx=0).stop 2024-08-18T22:06:15.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.543+0000 7f5ec0308640 1 -- 172.21.15.123:0/3700315709 shutdown_connections 2024-08-18T22:06:15.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.543+0000 7f5ec0308640 1 --2- 172.21.15.123:0/3700315709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5eb810beb0 0x7f5eb810e340 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:15.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.543+0000 7f5ec0308640 1 --2- 172.21.15.123:0/3700315709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5eb8103430 0x7f5eb810b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.543+0000 7f5ec0308640 1 --2- 172.21.15.123:0/3700315709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5eb8102b10 0x7f5eb8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.543+0000 7f5ec0308640 1 -- 172.21.15.123:0/3700315709 >> 172.21.15.123:0/3700315709 conn(0x7f5eb80fc4f0 msgr2=0x7f5eb80fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.543+0000 7f5ec0308640 1 -- 172.21.15.123:0/3700315709 shutdown_connections 2024-08-18T22:06:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.543+0000 7f5ec0308640 1 -- 172.21.15.123:0/3700315709 wait complete. 2024-08-18T22:06:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.543+0000 7f5ec0308640 1 Processor -- start 2024-08-18T22:06:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.543+0000 7f5ec0308640 1 -- start start 2024-08-18T22:06:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.543+0000 7f5ec0308640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5eb8102b10 0x7f5eb819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.543+0000 7f5ec0308640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5eb8103430 0x7f5eb819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.543+0000 7f5ec0308640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5eb810beb0 0x7f5eb819ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.543+0000 7f5ec0308640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8111d60 con 0x7f5eb810beb0 2024-08-18T22:06:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.543+0000 7f5ec0308640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8111be0 con 0x7f5eb8103430 2024-08-18T22:06:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.543+0000 7f5ec0308640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8111ee0 con 0x7f5eb8102b10 2024-08-18T22:06:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5ebe8a5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5eb810beb0 0x7f5eb819ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:15.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5ebe8a5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5eb810beb0 0x7f5eb819ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48792/0 (socket says 172.21.15.123:48792) 2024-08-18T22:06:15.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5ebe8a5640 1 -- 172.21.15.123:0/1073455194 learned_addr learned my addr 172.21.15.123:0/1073455194 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:15.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5ebe0a4640 1 --2- 172.21.15.123:0/1073455194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5eb8102b10 0x7f5eb819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:15.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5ebd8a3640 1 --2- 172.21.15.123:0/1073455194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5eb8103430 0x7f5eb819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:15.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5ebe8a5640 1 -- 172.21.15.123:0/1073455194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5eb8102b10 msgr2=0x7f5eb819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:15.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5ebe8a5640 1 --2- 172.21.15.123:0/1073455194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5eb8102b10 0x7f5eb819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:15.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5ebe8a5640 1 -- 172.21.15.123:0/1073455194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5eb8103430 msgr2=0x7f5eb819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:15.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5ebe8a5640 1 --2- 172.21.15.123:0/1073455194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5eb8103430 0x7f5eb819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:15.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5ebe8a5640 1 -- 172.21.15.123:0/1073455194 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb819f470 con 0x7f5eb810beb0 2024-08-18T22:06:15.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5ebd8a3640 1 --2- 172.21.15.123:0/1073455194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5eb8103430 0x7f5eb819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:06:15.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5ebe8a5640 1 --2- 172.21.15.123:0/1073455194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5eb810beb0 0x7f5eb819ed90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8006010 tx=0x7f5ea802f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:15.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5eb77fe640 1 -- 172.21.15.123:0/1073455194 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8034040 con 0x7f5eb810beb0 2024-08-18T22:06:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5eb77fe640 1 -- 172.21.15.123:0/1073455194 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ea8003e00 con 0x7f5eb810beb0 2024-08-18T22:06:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5ec0308640 1 -- 172.21.15.123:0/1073455194 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb819f700 con 0x7f5eb810beb0 2024-08-18T22:06:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5eb77fe640 1 -- 172.21.15.123:0/1073455194 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea80456e0 con 0x7f5eb810beb0 2024-08-18T22:06:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.544+0000 7f5ec0308640 1 -- 172.21.15.123:0/1073455194 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb81a7040 con 0x7f5eb810beb0 2024-08-18T22:06:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.545+0000 7f5ec0308640 1 -- 172.21.15.123:0/1073455194 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb806ad00 con 0x7f5eb810beb0 2024-08-18T22:06:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.546+0000 7f5eb77fe640 1 -- 172.21.15.123:0/1073455194 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5ea8037020 con 0x7f5eb810beb0 2024-08-18T22:06:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.547+0000 7f5eb77fe640 1 --2- 172.21.15.123:0/1073455194 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5ea00a2c10 0x7f5ea00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.547+0000 7f5ebe0a4640 1 --2- 172.21.15.123:0/1073455194 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5ea00a2c10 0x7f5ea00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.547+0000 7f5eb77fe640 1 -- 172.21.15.123:0/1073455194 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f5ea80f0590 con 0x7f5eb810beb0 2024-08-18T22:06:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.548+0000 7f5ebe0a4640 1 --2- 172.21.15.123:0/1073455194 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5ea00a2c10 0x7f5ea00a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009890 tx=0x7f5eb0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.551+0000 7f5eb77fe640 1 -- 172.21.15.123:0/1073455194 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5ea80bd140 con 0x7f5eb810beb0 2024-08-18T22:06:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.717+0000 7f5ec0308640 1 -- 172.21.15.123:0/1073455194 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5eb8101e90 con 0x7f5ea00a2c10 2024-08-18T22:06:15.718 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:15 smithi123 ceph-mon[18462]: pgmap v293: 129 pgs: 1 peering, 128 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.9 KiB/s wr, 8 op/s; 6.0 KiB/s, 0 objects/s recovering 2024-08-18T22:06:15.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.725+0000 7f5eb77fe640 1 -- 172.21.15.123:0/1073455194 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340366 (secure 0 0 0) 0x7f5eb8101e90 con 0x7f5ea00a2c10 2024-08-18T22:06:15.729 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:06:15.730 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-08-18T22:06:15.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.729+0000 7f5ec0308640 1 -- 172.21.15.123:0/1073455194 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5ea00a2c10 msgr2=0x7f5ea00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:15.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.729+0000 7f5ec0308640 1 --2- 172.21.15.123:0/1073455194 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5ea00a2c10 0x7f5ea00a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009890 tx=0x7f5eb0008040 comp rx=0 tx=0).stop 2024-08-18T22:06:15.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.729+0000 7f5ec0308640 1 -- 172.21.15.123:0/1073455194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5eb810beb0 msgr2=0x7f5eb819ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:15.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.729+0000 7f5ec0308640 1 --2- 172.21.15.123:0/1073455194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5eb810beb0 0x7f5eb819ed90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8006010 tx=0x7f5ea802f710 comp rx=0 tx=0).stop 2024-08-18T22:06:15.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.729+0000 7f5ec0308640 1 -- 172.21.15.123:0/1073455194 shutdown_connections 2024-08-18T22:06:15.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.729+0000 7f5ec0308640 1 --2- 172.21.15.123:0/1073455194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5eb810beb0 0x7f5eb819ed90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:15.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.729+0000 7f5ec0308640 1 --2- 172.21.15.123:0/1073455194 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5ea00a2c10 0x7f5ea00a50d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:15.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.729+0000 7f5ec0308640 1 --2- 172.21.15.123:0/1073455194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5eb8103430 0x7f5eb819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:15.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.729+0000 7f5ec0308640 1 --2- 172.21.15.123:0/1073455194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5eb8102b10 0x7f5eb819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:15.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.729+0000 7f5ec0308640 1 -- 172.21.15.123:0/1073455194 >> 172.21.15.123:0/1073455194 conn(0x7f5eb80fc4f0 msgr2=0x7f5eb8101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:15.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.729+0000 7f5ec0308640 1 -- 172.21.15.123:0/1073455194 shutdown_connections 2024-08-18T22:06:15.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:15.729+0000 7f5ec0308640 1 -- 172.21.15.123:0/1073455194 wait complete. 2024-08-18T22:06:15.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:15 smithi183 ceph-mon[22097]: pgmap v293: 129 pgs: 1 peering, 128 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.9 KiB/s wr, 8 op/s; 6.0 KiB/s, 0 objects/s recovering 2024-08-18T22:06:16.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:15 smithi130 ceph-mon[21698]: pgmap v293: 129 pgs: 1 peering, 128 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.9 KiB/s wr, 8 op/s; 6.0 KiB/s, 0 objects/s recovering 2024-08-18T22:06:16.525 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-08-18T22:06:15.347370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652244,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":237,"num_read_kb":225,"num_write":341,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1229945,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":420,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375676,"kb_used_data":13992,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566148,"statfs":{"total":1151940427776,"available":1151555735552,"internally_reserved":0,"allocated":14327808,"data_stored":7967262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":32795,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":67,"num_write":14,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":49209,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002114"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509743+0000","last_change":"2024-08-18T22:05:19.844674+0000","last_active":"2024-08-18T22:06:10.509743+0000","last_peered":"2024-08-18T22:06:10.509743+0000","last_clean":"2024-08-18T22:06:10.509743+0000","last_became_active":"2024-08-18T22:05:19.844381+0000","last_became_peered":"2024-08-18T22:05:19.844381+0000","last_unstale":"2024-08-18T22:06:10.509743+0000","last_undegraded":"2024-08-18T22:06:10.509743+0000","last_fullsized":"2024-08-18T22:06:10.509743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:58.783222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772174+0000","last_change":"2024-08-18T22:05:21.859013+0000","last_active":"2024-08-18T22:06:10.772174+0000","last_peered":"2024-08-18T22:06:10.772174+0000","last_clean":"2024-08-18T22:06:10.772174+0000","last_became_active":"2024-08-18T22:05:21.858709+0000","last_became_peered":"2024-08-18T22:05:21.858709+0000","last_unstale":"2024-08-18T22:06:10.772174+0000","last_undegraded":"2024-08-18T22:06:10.772174+0000","last_fullsized":"2024-08-18T22:06:10.772174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:34.272340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508245+0000","last_change":"2024-08-18T22:05:28.925735+0000","last_active":"2024-08-18T22:06:10.508245+0000","last_peered":"2024-08-18T22:06:10.508245+0000","last_clean":"2024-08-18T22:06:10.508245+0000","last_became_active":"2024-08-18T22:05:28.925324+0000","last_became_peered":"2024-08-18T22:05:28.925324+0000","last_unstale":"2024-08-18T22:06:10.508245+0000","last_undegraded":"2024-08-18T22:06:10.508245+0000","last_fullsized":"2024-08-18T22:06:10.508245+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:15:58.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772359+0000","last_change":"2024-08-18T22:05:20.290861+0000","last_active":"2024-08-18T22:06:10.772359+0000","last_peered":"2024-08-18T22:06:10.772359+0000","last_clean":"2024-08-18T22:06:10.772359+0000","last_became_active":"2024-08-18T22:05:20.290508+0000","last_became_peered":"2024-08-18T22:05:20.290508+0000","last_unstale":"2024-08-18T22:06:10.772359+0000","last_undegraded":"2024-08-18T22:06:10.772359+0000","last_fullsized":"2024-08-18T22:06:10.772359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:21.462206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509155+0000","last_change":"2024-08-18T22:05:21.863441+0000","last_active":"2024-08-18T22:06:10.509155+0000","last_peered":"2024-08-18T22:06:10.509155+0000","last_clean":"2024-08-18T22:06:10.509155+0000","last_became_active":"2024-08-18T22:05:21.863121+0000","last_became_peered":"2024-08-18T22:05:21.863121+0000","last_unstale":"2024-08-18T22:06:10.509155+0000","last_undegraded":"2024-08-18T22:06:10.509155+0000","last_fullsized":"2024-08-18T22:06:10.509155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:47.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509447+0000","last_change":"2024-08-18T22:05:28.925477+0000","last_active":"2024-08-18T22:06:10.509447+0000","last_peered":"2024-08-18T22:06:10.509447+0000","last_clean":"2024-08-18T22:06:10.509447+0000","last_became_active":"2024-08-18T22:05:28.924922+0000","last_became_peered":"2024-08-18T22:05:28.924922+0000","last_unstale":"2024-08-18T22:06:10.509447+0000","last_undegraded":"2024-08-18T22:06:10.509447+0000","last_fullsized":"2024-08-18T22:06:10.509447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:35.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514293+0000","last_change":"2024-08-18T22:05:19.847979+0000","last_active":"2024-08-18T22:06:10.514293+0000","last_peered":"2024-08-18T22:06:10.514293+0000","last_clean":"2024-08-18T22:06:10.514293+0000","last_became_active":"2024-08-18T22:05:19.847643+0000","last_became_peered":"2024-08-18T22:05:19.847643+0000","last_unstale":"2024-08-18T22:06:10.514293+0000","last_undegraded":"2024-08-18T22:06:10.514293+0000","last_fullsized":"2024-08-18T22:06:10.514293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:33.875378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506424+0000","last_change":"2024-08-18T22:05:21.860225+0000","last_active":"2024-08-18T22:06:10.506424+0000","last_peered":"2024-08-18T22:06:10.506424+0000","last_clean":"2024-08-18T22:06:10.506424+0000","last_became_active":"2024-08-18T22:05:21.859889+0000","last_became_peered":"2024-08-18T22:05:21.859889+0000","last_unstale":"2024-08-18T22:06:10.506424+0000","last_undegraded":"2024-08-18T22:06:10.506424+0000","last_fullsized":"2024-08-18T22:06:10.506424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:06:27.084401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511096+0000","last_change":"2024-08-18T22:05:28.922230+0000","last_active":"2024-08-18T22:06:10.511096+0000","last_peered":"2024-08-18T22:06:10.511096+0000","last_clean":"2024-08-18T22:06:10.511096+0000","last_became_active":"2024-08-18T22:05:28.921804+0000","last_became_peered":"2024-08-18T22:05:28.921804+0000","last_unstale":"2024-08-18T22:06:10.511096+0000","last_undegraded":"2024-08-18T22:06:10.511096+0000","last_fullsized":"2024-08-18T22:06:10.511096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:17.735645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514907+0000","last_change":"2024-08-18T22:05:19.841452+0000","last_active":"2024-08-18T22:06:10.514907+0000","last_peered":"2024-08-18T22:06:10.514907+0000","last_clean":"2024-08-18T22:06:10.514907+0000","last_became_active":"2024-08-18T22:05:19.840997+0000","last_became_peered":"2024-08-18T22:05:19.840997+0000","last_unstale":"2024-08-18T22:06:10.514907+0000","last_undegraded":"2024-08-18T22:06:10.514907+0000","last_fullsized":"2024-08-18T22:06:10.514907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:27:26.208279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"peering","last_fresh":"2024-08-18T22:05:33.130875+0000","last_change":"2024-08-18T22:06:09.511756+0000","last_active":"2024-08-18T22:06:09.511756+0000","last_peered":"2024-08-18T22:05:33.130875+0000","last_clean":"2024-08-18T22:05:33.130875+0000","last_became_active":"2024-08-18T22:05:21.856426+0000","last_became_peered":"2024-08-18T22:05:21.856426+0000","last_unstale":"2024-08-18T22:05:33.130875+0000","last_undegraded":"2024-08-18T22:05:33.130875+0000","last_fullsized":"2024-08-18T22:05:33.130875+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4,8],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509642+0000","last_change":"2024-08-18T22:05:28.924521+0000","last_active":"2024-08-18T22:06:10.509642+0000","last_peered":"2024-08-18T22:06:10.509642+0000","last_clean":"2024-08-18T22:06:10.509642+0000","last_became_active":"2024-08-18T22:05:28.924107+0000","last_became_peered":"2024-08-18T22:05:28.924107+0000","last_unstale":"2024-08-18T22:06:10.509642+0000","last_undegraded":"2024-08-18T22:06:10.509642+0000","last_fullsized":"2024-08-18T22:06:10.509642+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:37.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508303+0000","last_change":"2024-08-18T22:05:21.861696+0000","last_active":"2024-08-18T22:06:10.508303+0000","last_peered":"2024-08-18T22:06:10.508303+0000","last_clean":"2024-08-18T22:06:10.508303+0000","last_became_active":"2024-08-18T22:05:21.861220+0000","last_became_peered":"2024-08-18T22:05:21.861220+0000","last_unstale":"2024-08-18T22:06:10.508303+0000","last_undegraded":"2024-08-18T22:06:10.508303+0000","last_fullsized":"2024-08-18T22:06:10.508303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:01.098281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.520590+0000","last_change":"2024-08-18T22:06:10.520097+0000","last_active":"2024-08-18T22:06:10.520590+0000","last_peered":"2024-08-18T22:06:10.520590+0000","last_clean":"2024-08-18T22:06:10.520590+0000","last_became_active":"2024-08-18T22:06:10.513286+0000","last_became_peered":"2024-08-18T22:06:10.513286+0000","last_unstale":"2024-08-18T22:06:10.520590+0000","last_undegraded":"2024-08-18T22:06:10.520590+0000","last_fullsized":"2024-08-18T22:06:10.520590+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:08:18.861243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509973+0000","last_change":"2024-08-18T22:05:29.013139+0000","last_active":"2024-08-18T22:06:10.509973+0000","last_peered":"2024-08-18T22:06:10.509973+0000","last_clean":"2024-08-18T22:06:10.509973+0000","last_became_active":"2024-08-18T22:05:29.012322+0000","last_became_peered":"2024-08-18T22:05:29.012322+0000","last_unstale":"2024-08-18T22:06:10.509973+0000","last_undegraded":"2024-08-18T22:06:10.509973+0000","last_fullsized":"2024-08-18T22:06:10.509973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:32.348201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772162+0000","last_change":"2024-08-18T22:05:21.860410+0000","last_active":"2024-08-18T22:06:10.772162+0000","last_peered":"2024-08-18T22:06:10.772162+0000","last_clean":"2024-08-18T22:06:10.772162+0000","last_became_active":"2024-08-18T22:05:21.860173+0000","last_became_peered":"2024-08-18T22:05:21.860173+0000","last_unstale":"2024-08-18T22:06:10.772162+0000","last_undegraded":"2024-08-18T22:06:10.772162+0000","last_fullsized":"2024-08-18T22:06:10.772162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:00.879178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507956+0000","last_change":"2024-08-18T22:05:19.845785+0000","last_active":"2024-08-18T22:06:10.507956+0000","last_peered":"2024-08-18T22:06:10.507956+0000","last_clean":"2024-08-18T22:06:10.507956+0000","last_became_active":"2024-08-18T22:05:19.845414+0000","last_became_peered":"2024-08-18T22:05:19.845414+0000","last_unstale":"2024-08-18T22:06:10.507956+0000","last_undegraded":"2024-08-18T22:06:10.507956+0000","last_fullsized":"2024-08-18T22:06:10.507956+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:13.504885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.523404+0000","last_change":"2024-08-18T22:06:10.523404+0000","last_active":"2024-08-18T22:06:10.523404+0000","last_peered":"2024-08-18T22:06:10.523404+0000","last_clean":"2024-08-18T22:06:10.523404+0000","last_became_active":"2024-08-18T22:06:10.516652+0000","last_became_peered":"2024-08-18T22:06:10.516652+0000","last_unstale":"2024-08-18T22:06:10.523404+0000","last_undegraded":"2024-08-18T22:06:10.523404+0000","last_fullsized":"2024-08-18T22:06:10.523404+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:58.197636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510102+0000","last_change":"2024-08-18T22:05:21.858329+0000","last_active":"2024-08-18T22:06:10.510102+0000","last_peered":"2024-08-18T22:06:10.510102+0000","last_clean":"2024-08-18T22:06:10.510102+0000","last_became_active":"2024-08-18T22:05:21.857854+0000","last_became_peered":"2024-08-18T22:05:21.857854+0000","last_unstale":"2024-08-18T22:06:10.510102+0000","last_undegraded":"2024-08-18T22:06:10.510102+0000","last_fullsized":"2024-08-18T22:06:10.510102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:45:19.934647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772068+0000","last_change":"2024-08-18T22:05:19.843031+0000","last_active":"2024-08-18T22:06:10.772068+0000","last_peered":"2024-08-18T22:06:10.772068+0000","last_clean":"2024-08-18T22:06:10.772068+0000","last_became_active":"2024-08-18T22:05:19.842694+0000","last_became_peered":"2024-08-18T22:05:19.842694+0000","last_unstale":"2024-08-18T22:06:10.772068+0000","last_undegraded":"2024-08-18T22:06:10.772068+0000","last_fullsized":"2024-08-18T22:06:10.772068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:01.135449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509575+0000","last_change":"2024-08-18T22:05:28.920647+0000","last_active":"2024-08-18T22:06:10.509575+0000","last_peered":"2024-08-18T22:06:10.509575+0000","last_clean":"2024-08-18T22:06:10.509575+0000","last_became_active":"2024-08-18T22:05:28.920295+0000","last_became_peered":"2024-08-18T22:05:28.920295+0000","last_unstale":"2024-08-18T22:06:10.509575+0000","last_undegraded":"2024-08-18T22:06:10.509575+0000","last_fullsized":"2024-08-18T22:06:10.509575+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:41.295009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513283+0000","last_change":"2024-08-18T22:05:21.858413+0000","last_active":"2024-08-18T22:06:10.513283+0000","last_peered":"2024-08-18T22:06:10.513283+0000","last_clean":"2024-08-18T22:06:10.513283+0000","last_became_active":"2024-08-18T22:05:21.858102+0000","last_became_peered":"2024-08-18T22:05:21.858102+0000","last_unstale":"2024-08-18T22:06:10.513283+0000","last_undegraded":"2024-08-18T22:06:10.513283+0000","last_fullsized":"2024-08-18T22:06:10.513283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:24:59.432666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506163+0000","last_change":"2024-08-18T22:05:20.292085+0000","last_active":"2024-08-18T22:06:10.506163+0000","last_peered":"2024-08-18T22:06:10.506163+0000","last_clean":"2024-08-18T22:06:10.506163+0000","last_became_active":"2024-08-18T22:05:20.291606+0000","last_became_peered":"2024-08-18T22:05:20.291606+0000","last_unstale":"2024-08-18T22:06:10.506163+0000","last_undegraded":"2024-08-18T22:06:10.506163+0000","last_fullsized":"2024-08-18T22:06:10.506163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:22:46.801719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515755+0000","last_change":"2024-08-18T22:06:10.515755+0000","last_active":"2024-08-18T22:06:10.515755+0000","last_peered":"2024-08-18T22:06:10.515755+0000","last_clean":"2024-08-18T22:06:10.515755+0000","last_became_active":"2024-08-18T22:06:10.514624+0000","last_became_peered":"2024-08-18T22:06:10.514624+0000","last_unstale":"2024-08-18T22:06:10.515755+0000","last_undegraded":"2024-08-18T22:06:10.515755+0000","last_fullsized":"2024-08-18T22:06:10.515755+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:18:50.785139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508880+0000","last_change":"2024-08-18T22:05:21.855163+0000","last_active":"2024-08-18T22:06:10.508880+0000","last_peered":"2024-08-18T22:06:10.508880+0000","last_clean":"2024-08-18T22:06:10.508880+0000","last_became_active":"2024-08-18T22:05:21.854867+0000","last_became_peered":"2024-08-18T22:05:21.854867+0000","last_unstale":"2024-08-18T22:06:10.508880+0000","last_undegraded":"2024-08-18T22:06:10.508880+0000","last_fullsized":"2024-08-18T22:06:10.508880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:10.300307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510102+0000","last_change":"2024-08-18T22:05:20.082363+0000","last_active":"2024-08-18T22:06:10.510102+0000","last_peered":"2024-08-18T22:06:10.510102+0000","last_clean":"2024-08-18T22:06:10.510102+0000","last_became_active":"2024-08-18T22:05:20.081998+0000","last_became_peered":"2024-08-18T22:05:20.081998+0000","last_unstale":"2024-08-18T22:06:10.510102+0000","last_undegraded":"2024-08-18T22:06:10.510102+0000","last_fullsized":"2024-08-18T22:06:10.510102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:44.960512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508721+0000","last_change":"2024-08-18T22:05:28.924072+0000","last_active":"2024-08-18T22:06:10.508721+0000","last_peered":"2024-08-18T22:06:10.508721+0000","last_clean":"2024-08-18T22:06:10.508721+0000","last_became_active":"2024-08-18T22:05:28.923673+0000","last_became_peered":"2024-08-18T22:05:28.923673+0000","last_unstale":"2024-08-18T22:06:10.508721+0000","last_undegraded":"2024-08-18T22:06:10.508721+0000","last_fullsized":"2024-08-18T22:06:10.508721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:44.593009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772399+0000","last_change":"2024-08-18T22:05:21.851377+0000","last_active":"2024-08-18T22:06:10.772399+0000","last_peered":"2024-08-18T22:06:10.772399+0000","last_clean":"2024-08-18T22:06:10.772399+0000","last_became_active":"2024-08-18T22:05:21.851031+0000","last_became_peered":"2024-08-18T22:05:21.851031+0000","last_unstale":"2024-08-18T22:06:10.772399+0000","last_undegraded":"2024-08-18T22:06:10.772399+0000","last_fullsized":"2024-08-18T22:06:10.772399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.547244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509550+0000","last_change":"2024-08-18T22:05:19.840697+0000","last_active":"2024-08-18T22:06:10.509550+0000","last_peered":"2024-08-18T22:06:10.509550+0000","last_clean":"2024-08-18T22:06:10.509550+0000","last_became_active":"2024-08-18T22:05:19.840382+0000","last_became_peered":"2024-08-18T22:05:19.840382+0000","last_unstale":"2024-08-18T22:06:10.509550+0000","last_undegraded":"2024-08-18T22:06:10.509550+0000","last_fullsized":"2024-08-18T22:06:10.509550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:24.514428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771817+0000","last_change":"2024-08-18T22:05:29.012305+0000","last_active":"2024-08-18T22:06:10.771817+0000","last_peered":"2024-08-18T22:06:10.771817+0000","last_clean":"2024-08-18T22:06:10.771817+0000","last_became_active":"2024-08-18T22:05:29.011846+0000","last_became_peered":"2024-08-18T22:05:29.011846+0000","last_unstale":"2024-08-18T22:06:10.771817+0000","last_undegraded":"2024-08-18T22:06:10.771817+0000","last_fullsized":"2024-08-18T22:06:10.771817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:36.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506016+0000","last_change":"2024-08-18T22:05:21.856182+0000","last_active":"2024-08-18T22:06:10.506016+0000","last_peered":"2024-08-18T22:06:10.506016+0000","last_clean":"2024-08-18T22:06:10.506016+0000","last_became_active":"2024-08-18T22:05:21.855855+0000","last_became_peered":"2024-08-18T22:05:21.855855+0000","last_unstale":"2024-08-18T22:06:10.506016+0000","last_undegraded":"2024-08-18T22:06:10.506016+0000","last_fullsized":"2024-08-18T22:06:10.506016+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:00.166809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514793+0000","last_change":"2024-08-18T22:05:20.291272+0000","last_active":"2024-08-18T22:06:10.514793+0000","last_peered":"2024-08-18T22:06:10.514793+0000","last_clean":"2024-08-18T22:06:10.514793+0000","last_became_active":"2024-08-18T22:05:20.290970+0000","last_became_peered":"2024-08-18T22:05:20.290970+0000","last_unstale":"2024-08-18T22:06:10.514793+0000","last_undegraded":"2024-08-18T22:06:10.514793+0000","last_fullsized":"2024-08-18T22:06:10.514793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:29.438996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510601+0000","last_change":"2024-08-18T22:05:28.923141+0000","last_active":"2024-08-18T22:06:10.510601+0000","last_peered":"2024-08-18T22:06:10.510601+0000","last_clean":"2024-08-18T22:06:10.510601+0000","last_became_active":"2024-08-18T22:05:28.922269+0000","last_became_peered":"2024-08-18T22:05:28.922269+0000","last_unstale":"2024-08-18T22:06:10.510601+0000","last_undegraded":"2024-08-18T22:06:10.510601+0000","last_fullsized":"2024-08-18T22:06:10.510601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:58.092640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509287+0000","last_change":"2024-08-18T22:05:21.850124+0000","last_active":"2024-08-18T22:06:10.509287+0000","last_peered":"2024-08-18T22:06:10.509287+0000","last_clean":"2024-08-18T22:06:10.509287+0000","last_became_active":"2024-08-18T22:05:21.849805+0000","last_became_peered":"2024-08-18T22:05:21.849805+0000","last_unstale":"2024-08-18T22:06:10.509287+0000","last_undegraded":"2024-08-18T22:06:10.509287+0000","last_fullsized":"2024-08-18T22:06:10.509287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:53.492613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509230+0000","last_change":"2024-08-18T22:05:20.292836+0000","last_active":"2024-08-18T22:06:10.509230+0000","last_peered":"2024-08-18T22:06:10.509230+0000","last_clean":"2024-08-18T22:06:10.509230+0000","last_became_active":"2024-08-18T22:05:20.292456+0000","last_became_peered":"2024-08-18T22:05:20.292456+0000","last_unstale":"2024-08-18T22:06:10.509230+0000","last_undegraded":"2024-08-18T22:06:10.509230+0000","last_fullsized":"2024-08-18T22:06:10.509230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:19.525037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513298+0000","last_change":"2024-08-18T22:05:29.012439+0000","last_active":"2024-08-18T22:06:10.513298+0000","last_peered":"2024-08-18T22:06:10.513298+0000","last_clean":"2024-08-18T22:06:10.513298+0000","last_became_active":"2024-08-18T22:05:29.011860+0000","last_became_peered":"2024-08-18T22:05:29.011860+0000","last_unstale":"2024-08-18T22:06:10.513298+0000","last_undegraded":"2024-08-18T22:06:10.513298+0000","last_fullsized":"2024-08-18T22:06:10.513298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:03.432217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509272+0000","last_change":"2024-08-18T22:05:21.855598+0000","last_active":"2024-08-18T22:06:10.509272+0000","last_peered":"2024-08-18T22:06:10.509272+0000","last_clean":"2024-08-18T22:06:10.509272+0000","last_became_active":"2024-08-18T22:05:21.855228+0000","last_became_peered":"2024-08-18T22:05:21.855228+0000","last_unstale":"2024-08-18T22:06:10.509272+0000","last_undegraded":"2024-08-18T22:06:10.509272+0000","last_fullsized":"2024-08-18T22:06:10.509272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:33.762700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508476+0000","last_change":"2024-08-18T22:05:19.844638+0000","last_active":"2024-08-18T22:06:10.508476+0000","last_peered":"2024-08-18T22:06:10.508476+0000","last_clean":"2024-08-18T22:06:10.508476+0000","last_became_active":"2024-08-18T22:05:19.844333+0000","last_became_peered":"2024-08-18T22:05:19.844333+0000","last_unstale":"2024-08-18T22:06:10.508476+0000","last_undegraded":"2024-08-18T22:06:10.508476+0000","last_fullsized":"2024-08-18T22:06:10.508476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:26.947512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505914+0000","last_change":"2024-08-18T22:05:28.919965+0000","last_active":"2024-08-18T22:06:10.505914+0000","last_peered":"2024-08-18T22:06:10.505914+0000","last_clean":"2024-08-18T22:06:10.505914+0000","last_became_active":"2024-08-18T22:05:28.919546+0000","last_became_peered":"2024-08-18T22:05:28.919546+0000","last_unstale":"2024-08-18T22:06:10.505914+0000","last_undegraded":"2024-08-18T22:06:10.505914+0000","last_fullsized":"2024-08-18T22:06:10.505914+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:49.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.510656+0000","last_change":"2024-08-18T22:05:21.857867+0000","last_active":"2024-08-18T22:06:09.510656+0000","last_peered":"2024-08-18T22:06:09.510656+0000","last_clean":"2024-08-18T22:06:09.510656+0000","last_became_active":"2024-08-18T22:05:21.857515+0000","last_became_peered":"2024-08-18T22:05:21.857515+0000","last_unstale":"2024-08-18T22:06:09.510656+0000","last_undegraded":"2024-08-18T22:06:09.510656+0000","last_fullsized":"2024-08-18T22:06:09.510656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:51.148321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:11.479439+0000","last_change":"2024-08-18T22:05:20.290924+0000","last_active":"2024-08-18T22:06:11.479439+0000","last_peered":"2024-08-18T22:06:11.479439+0000","last_clean":"2024-08-18T22:06:11.479439+0000","last_became_active":"2024-08-18T22:05:20.290587+0000","last_became_peered":"2024-08-18T22:05:20.290587+0000","last_unstale":"2024-08-18T22:06:11.479439+0000","last_undegraded":"2024-08-18T22:06:11.479439+0000","last_fullsized":"2024-08-18T22:06:11.479439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:35.029634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505852+0000","last_change":"2024-08-18T22:05:29.012876+0000","last_active":"2024-08-18T22:06:10.505852+0000","last_peered":"2024-08-18T22:06:10.505852+0000","last_clean":"2024-08-18T22:06:10.505852+0000","last_became_active":"2024-08-18T22:05:29.011930+0000","last_became_peered":"2024-08-18T22:05:29.011930+0000","last_unstale":"2024-08-18T22:06:10.505852+0000","last_undegraded":"2024-08-18T22:06:10.505852+0000","last_fullsized":"2024-08-18T22:06:10.505852+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:22:35.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505526+0000","last_change":"2024-08-18T22:05:21.860798+0000","last_active":"2024-08-18T22:06:10.505526+0000","last_peered":"2024-08-18T22:06:10.505526+0000","last_clean":"2024-08-18T22:06:10.505526+0000","last_became_active":"2024-08-18T22:05:21.856968+0000","last_became_peered":"2024-08-18T22:05:21.856968+0000","last_unstale":"2024-08-18T22:06:10.505526+0000","last_undegraded":"2024-08-18T22:06:10.505526+0000","last_fullsized":"2024-08-18T22:06:10.505526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:54.934400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508009+0000","last_change":"2024-08-18T22:05:19.844775+0000","last_active":"2024-08-18T22:06:10.508009+0000","last_peered":"2024-08-18T22:06:10.508009+0000","last_clean":"2024-08-18T22:06:10.508009+0000","last_became_active":"2024-08-18T22:05:19.844465+0000","last_became_peered":"2024-08-18T22:05:19.844465+0000","last_unstale":"2024-08-18T22:06:10.508009+0000","last_undegraded":"2024-08-18T22:06:10.508009+0000","last_fullsized":"2024-08-18T22:06:10.508009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.042335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.511865+0000","last_change":"2024-08-18T22:05:29.013275+0000","last_active":"2024-08-18T22:06:09.511865+0000","last_peered":"2024-08-18T22:06:09.511865+0000","last_clean":"2024-08-18T22:06:09.511865+0000","last_became_active":"2024-08-18T22:05:29.012537+0000","last_became_peered":"2024-08-18T22:05:29.012537+0000","last_unstale":"2024-08-18T22:06:09.511865+0000","last_undegraded":"2024-08-18T22:06:09.511865+0000","last_fullsized":"2024-08-18T22:06:09.511865+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:15:39.775360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772046+0000","last_change":"2024-08-18T22:05:21.853358+0000","last_active":"2024-08-18T22:06:10.772046+0000","last_peered":"2024-08-18T22:06:10.772046+0000","last_clean":"2024-08-18T22:06:10.772046+0000","last_became_active":"2024-08-18T22:05:21.853071+0000","last_became_peered":"2024-08-18T22:05:21.853071+0000","last_unstale":"2024-08-18T22:06:10.772046+0000","last_undegraded":"2024-08-18T22:06:10.772046+0000","last_fullsized":"2024-08-18T22:06:10.772046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:23.755263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511287+0000","last_change":"2024-08-18T22:05:19.846922+0000","last_active":"2024-08-18T22:06:10.511287+0000","last_peered":"2024-08-18T22:06:10.511287+0000","last_clean":"2024-08-18T22:06:10.511287+0000","last_became_active":"2024-08-18T22:05:19.846619+0000","last_became_peered":"2024-08-18T22:05:19.846619+0000","last_unstale":"2024-08-18T22:06:10.511287+0000","last_undegraded":"2024-08-18T22:06:10.511287+0000","last_fullsized":"2024-08-18T22:06:10.511287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:36:16.232344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":352,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508214+0000","last_change":"2024-08-18T22:04:11.878703+0000","last_active":"2024-08-18T22:06:10.508214+0000","last_peered":"2024-08-18T22:06:10.508214+0000","last_clean":"2024-08-18T22:06:10.508214+0000","last_became_active":"2024-08-18T22:04:11.878157+0000","last_became_peered":"2024-08-18T22:04:11.878157+0000","last_unstale":"2024-08-18T22:06:10.508214+0000","last_undegraded":"2024-08-18T22:06:10.508214+0000","last_fullsized":"2024-08-18T22:06:10.508214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_clean_scrub_stamp":"2024-08-18T22:01:09.551264+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:24:07.391758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508423+0000","last_change":"2024-08-18T22:05:28.928882+0000","last_active":"2024-08-18T22:06:10.508423+0000","last_peered":"2024-08-18T22:06:10.508423+0000","last_clean":"2024-08-18T22:06:10.508423+0000","last_became_active":"2024-08-18T22:05:28.928482+0000","last_became_peered":"2024-08-18T22:05:28.928482+0000","last_unstale":"2024-08-18T22:06:10.508423+0000","last_undegraded":"2024-08-18T22:06:10.508423+0000","last_fullsized":"2024-08-18T22:06:10.508423+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:41.739482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508689+0000","last_change":"2024-08-18T22:05:21.863045+0000","last_active":"2024-08-18T22:06:10.508689+0000","last_peered":"2024-08-18T22:06:10.508689+0000","last_clean":"2024-08-18T22:06:10.508689+0000","last_became_active":"2024-08-18T22:05:21.862758+0000","last_became_peered":"2024-08-18T22:05:21.862758+0000","last_unstale":"2024-08-18T22:06:10.508689+0000","last_undegraded":"2024-08-18T22:06:10.508689+0000","last_fullsized":"2024-08-18T22:06:10.508689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:08:39.111147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509216+0000","last_change":"2024-08-18T22:05:20.291030+0000","last_active":"2024-08-18T22:06:10.509216+0000","last_peered":"2024-08-18T22:06:10.509216+0000","last_clean":"2024-08-18T22:06:10.509216+0000","last_became_active":"2024-08-18T22:05:20.290427+0000","last_became_peered":"2024-08-18T22:05:20.290427+0000","last_unstale":"2024-08-18T22:06:10.509216+0000","last_undegraded":"2024-08-18T22:06:10.509216+0000","last_fullsized":"2024-08-18T22:06:10.509216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:14:42.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506125+0000","last_change":"2024-08-18T22:05:28.923700+0000","last_active":"2024-08-18T22:06:10.506125+0000","last_peered":"2024-08-18T22:06:10.506125+0000","last_clean":"2024-08-18T22:06:10.506125+0000","last_became_active":"2024-08-18T22:05:28.923280+0000","last_became_peered":"2024-08-18T22:05:28.923280+0000","last_unstale":"2024-08-18T22:06:10.506125+0000","last_undegraded":"2024-08-18T22:06:10.506125+0000","last_fullsized":"2024-08-18T22:06:10.506125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:25:45.343542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508357+0000","last_change":"2024-08-18T22:05:21.856107+0000","last_active":"2024-08-18T22:06:10.508357+0000","last_peered":"2024-08-18T22:06:10.508357+0000","last_clean":"2024-08-18T22:06:10.508357+0000","last_became_active":"2024-08-18T22:05:21.853276+0000","last_became_peered":"2024-08-18T22:05:21.853276+0000","last_unstale":"2024-08-18T22:06:10.508357+0000","last_undegraded":"2024-08-18T22:06:10.508357+0000","last_fullsized":"2024-08-18T22:06:10.508357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:58.280375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.511618+0000","last_change":"2024-08-18T22:05:19.843445+0000","last_active":"2024-08-18T22:06:09.511618+0000","last_peered":"2024-08-18T22:06:09.511618+0000","last_clean":"2024-08-18T22:06:09.511618+0000","last_became_active":"2024-08-18T22:05:19.843000+0000","last_became_peered":"2024-08-18T22:05:19.843000+0000","last_unstale":"2024-08-18T22:06:09.511618+0000","last_undegraded":"2024-08-18T22:06:09.511618+0000","last_fullsized":"2024-08-18T22:06:09.511618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:23.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515953+0000","last_change":"2024-08-18T22:06:10.515953+0000","last_active":"2024-08-18T22:06:10.515953+0000","last_peered":"2024-08-18T22:06:10.515953+0000","last_clean":"2024-08-18T22:06:10.515953+0000","last_became_active":"2024-08-18T22:06:10.515662+0000","last_became_peered":"2024-08-18T22:06:10.515662+0000","last_unstale":"2024-08-18T22:06:10.515953+0000","last_undegraded":"2024-08-18T22:06:10.515953+0000","last_fullsized":"2024-08-18T22:06:10.515953+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:43.150180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509215+0000","last_change":"2024-08-18T22:05:21.864029+0000","last_active":"2024-08-18T22:06:10.509215+0000","last_peered":"2024-08-18T22:06:10.509215+0000","last_clean":"2024-08-18T22:06:10.509215+0000","last_became_active":"2024-08-18T22:05:21.863509+0000","last_became_peered":"2024-08-18T22:05:21.863509+0000","last_unstale":"2024-08-18T22:06:10.509215+0000","last_undegraded":"2024-08-18T22:06:10.509215+0000","last_fullsized":"2024-08-18T22:06:10.509215+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:42.879243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506010+0000","last_change":"2024-08-18T22:05:19.846514+0000","last_active":"2024-08-18T22:06:10.506010+0000","last_peered":"2024-08-18T22:06:10.506010+0000","last_clean":"2024-08-18T22:06:10.506010+0000","last_became_active":"2024-08-18T22:05:19.846190+0000","last_became_peered":"2024-08-18T22:05:19.846190+0000","last_unstale":"2024-08-18T22:06:10.506010+0000","last_undegraded":"2024-08-18T22:06:10.506010+0000","last_fullsized":"2024-08-18T22:06:10.506010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:49:00.317597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.510358+0000","last_change":"2024-08-18T22:05:28.923183+0000","last_active":"2024-08-18T22:06:09.510358+0000","last_peered":"2024-08-18T22:06:09.510358+0000","last_clean":"2024-08-18T22:06:09.510358+0000","last_became_active":"2024-08-18T22:05:28.922809+0000","last_became_peered":"2024-08-18T22:05:28.922809+0000","last_unstale":"2024-08-18T22:06:09.510358+0000","last_undegraded":"2024-08-18T22:06:09.510358+0000","last_fullsized":"2024-08-18T22:06:09.510358+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:26.416920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510283+0000","last_change":"2024-08-18T22:05:21.849075+0000","last_active":"2024-08-18T22:06:10.510283+0000","last_peered":"2024-08-18T22:06:10.510283+0000","last_clean":"2024-08-18T22:06:10.510283+0000","last_became_active":"2024-08-18T22:05:21.848759+0000","last_became_peered":"2024-08-18T22:05:21.848759+0000","last_unstale":"2024-08-18T22:06:10.510283+0000","last_undegraded":"2024-08-18T22:06:10.510283+0000","last_fullsized":"2024-08-18T22:06:10.510283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:26.531534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515145+0000","last_change":"2024-08-18T22:05:19.849210+0000","last_active":"2024-08-18T22:06:10.515145+0000","last_peered":"2024-08-18T22:06:10.515145+0000","last_clean":"2024-08-18T22:06:10.515145+0000","last_became_active":"2024-08-18T22:05:19.848829+0000","last_became_peered":"2024-08-18T22:05:19.848829+0000","last_unstale":"2024-08-18T22:06:10.515145+0000","last_undegraded":"2024-08-18T22:06:10.515145+0000","last_fullsized":"2024-08-18T22:06:10.515145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:19.321686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.510313+0000","last_change":"2024-08-18T22:05:28.924577+0000","last_active":"2024-08-18T22:06:09.510313+0000","last_peered":"2024-08-18T22:06:09.510313+0000","last_clean":"2024-08-18T22:06:09.510313+0000","last_became_active":"2024-08-18T22:05:28.924183+0000","last_became_peered":"2024-08-18T22:05:28.924183+0000","last_unstale":"2024-08-18T22:06:09.510313+0000","last_undegraded":"2024-08-18T22:06:09.510313+0000","last_fullsized":"2024-08-18T22:06:09.510313+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:22.702757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513994+0000","last_change":"2024-08-18T22:06:10.513610+0000","last_active":"2024-08-18T22:06:10.513994+0000","last_peered":"2024-08-18T22:06:10.513994+0000","last_clean":"2024-08-18T22:06:10.513994+0000","last_became_active":"2024-08-18T22:06:10.513400+0000","last_became_peered":"2024-08-18T22:06:10.513400+0000","last_unstale":"2024-08-18T22:06:10.513994+0000","last_undegraded":"2024-08-18T22:06:10.513994+0000","last_fullsized":"2024-08-18T22:06:10.513994+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:49.275223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513546+0000","last_change":"2024-08-18T22:05:20.291752+0000","last_active":"2024-08-18T22:06:10.513546+0000","last_peered":"2024-08-18T22:06:10.513546+0000","last_clean":"2024-08-18T22:06:10.513546+0000","last_became_active":"2024-08-18T22:05:20.291431+0000","last_became_peered":"2024-08-18T22:05:20.291431+0000","last_unstale":"2024-08-18T22:06:10.513546+0000","last_undegraded":"2024-08-18T22:06:10.513546+0000","last_fullsized":"2024-08-18T22:06:10.513546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:32.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506003+0000","last_change":"2024-08-18T22:05:28.924121+0000","last_active":"2024-08-18T22:06:10.506003+0000","last_peered":"2024-08-18T22:06:10.506003+0000","last_clean":"2024-08-18T22:06:10.506003+0000","last_became_active":"2024-08-18T22:05:28.923753+0000","last_became_peered":"2024-08-18T22:05:28.923753+0000","last_unstale":"2024-08-18T22:06:10.506003+0000","last_undegraded":"2024-08-18T22:06:10.506003+0000","last_fullsized":"2024-08-18T22:06:10.506003+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:57.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507828+0000","last_change":"2024-08-18T22:05:21.858366+0000","last_active":"2024-08-18T22:06:10.507828+0000","last_peered":"2024-08-18T22:06:10.507828+0000","last_clean":"2024-08-18T22:06:10.507828+0000","last_became_active":"2024-08-18T22:05:21.858021+0000","last_became_peered":"2024-08-18T22:05:21.858021+0000","last_unstale":"2024-08-18T22:06:10.507828+0000","last_undegraded":"2024-08-18T22:06:10.507828+0000","last_fullsized":"2024-08-18T22:06:10.507828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:55.662965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'4","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:12.481139+0000","last_change":"2024-08-18T22:05:19.850013+0000","last_active":"2024-08-18T22:06:12.481139+0000","last_peered":"2024-08-18T22:06:12.481139+0000","last_clean":"2024-08-18T22:06:12.481139+0000","last_became_active":"2024-08-18T22:05:19.849551+0000","last_became_peered":"2024-08-18T22:05:19.849551+0000","last_unstale":"2024-08-18T22:06:12.481139+0000","last_undegraded":"2024-08-18T22:06:12.481139+0000","last_fullsized":"2024-08-18T22:06:12.481139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:15.182999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509627+0000","last_change":"2024-08-18T22:05:28.927318+0000","last_active":"2024-08-18T22:06:10.509627+0000","last_peered":"2024-08-18T22:06:10.509627+0000","last_clean":"2024-08-18T22:06:10.509627+0000","last_became_active":"2024-08-18T22:05:28.926786+0000","last_became_peered":"2024-08-18T22:05:28.926786+0000","last_unstale":"2024-08-18T22:06:10.509627+0000","last_undegraded":"2024-08-18T22:06:10.509627+0000","last_fullsized":"2024-08-18T22:06:10.509627+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:45.798247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511821+0000","last_change":"2024-08-18T22:06:10.511821+0000","last_active":"2024-08-18T22:06:10.511821+0000","last_peered":"2024-08-18T22:06:10.511821+0000","last_clean":"2024-08-18T22:06:10.511821+0000","last_became_active":"2024-08-18T22:06:10.511135+0000","last_became_peered":"2024-08-18T22:06:10.511135+0000","last_unstale":"2024-08-18T22:06:10.511821+0000","last_undegraded":"2024-08-18T22:06:10.511821+0000","last_fullsized":"2024-08-18T22:06:10.511821+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:07.108531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.511231+0000","last_change":"2024-08-18T22:05:19.844061+0000","last_active":"2024-08-18T22:06:09.511231+0000","last_peered":"2024-08-18T22:06:09.511231+0000","last_clean":"2024-08-18T22:06:09.511231+0000","last_became_active":"2024-08-18T22:05:19.843513+0000","last_became_peered":"2024-08-18T22:05:19.843513+0000","last_unstale":"2024-08-18T22:06:09.511231+0000","last_undegraded":"2024-08-18T22:06:09.511231+0000","last_fullsized":"2024-08-18T22:06:09.511231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:53.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510069+0000","last_change":"2024-08-18T22:05:28.922986+0000","last_active":"2024-08-18T22:06:10.510069+0000","last_peered":"2024-08-18T22:06:10.510069+0000","last_clean":"2024-08-18T22:06:10.510069+0000","last_became_active":"2024-08-18T22:05:28.922322+0000","last_became_peered":"2024-08-18T22:05:28.922322+0000","last_unstale":"2024-08-18T22:06:10.510069+0000","last_undegraded":"2024-08-18T22:06:10.510069+0000","last_fullsized":"2024-08-18T22:06:10.510069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:28.168299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505649+0000","last_change":"2024-08-18T22:05:21.853389+0000","last_active":"2024-08-18T22:06:10.505649+0000","last_peered":"2024-08-18T22:06:10.505649+0000","last_clean":"2024-08-18T22:06:10.505649+0000","last_became_active":"2024-08-18T22:05:21.853095+0000","last_became_peered":"2024-08-18T22:05:21.853095+0000","last_unstale":"2024-08-18T22:06:10.505649+0000","last_undegraded":"2024-08-18T22:06:10.505649+0000","last_fullsized":"2024-08-18T22:06:10.505649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:14.126983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508891+0000","last_change":"2024-08-18T22:05:19.846788+0000","last_active":"2024-08-18T22:06:10.508891+0000","last_peered":"2024-08-18T22:06:10.508891+0000","last_clean":"2024-08-18T22:06:10.508891+0000","last_became_active":"2024-08-18T22:05:19.846248+0000","last_became_peered":"2024-08-18T22:05:19.846248+0000","last_unstale":"2024-08-18T22:06:10.508891+0000","last_undegraded":"2024-08-18T22:06:10.508891+0000","last_fullsized":"2024-08-18T22:06:10.508891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:46.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.511186+0000","last_change":"2024-08-18T22:05:28.920294+0000","last_active":"2024-08-18T22:06:09.511186+0000","last_peered":"2024-08-18T22:06:09.511186+0000","last_clean":"2024-08-18T22:06:09.511186+0000","last_became_active":"2024-08-18T22:05:28.919351+0000","last_became_peered":"2024-08-18T22:05:28.919351+0000","last_unstale":"2024-08-18T22:06:09.511186+0000","last_undegraded":"2024-08-18T22:06:09.511186+0000","last_fullsized":"2024-08-18T22:06:09.511186+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:49.425281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514189+0000","last_change":"2024-08-18T22:05:21.864529+0000","last_active":"2024-08-18T22:06:10.514189+0000","last_peered":"2024-08-18T22:06:10.514189+0000","last_clean":"2024-08-18T22:06:10.514189+0000","last_became_active":"2024-08-18T22:05:21.864062+0000","last_became_peered":"2024-08-18T22:05:21.864062+0000","last_unstale":"2024-08-18T22:06:10.514189+0000","last_undegraded":"2024-08-18T22:06:10.514189+0000","last_fullsized":"2024-08-18T22:06:10.514189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:24:49.037343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'29","reported_seq":120,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:13.522639+0000","last_change":"2024-08-18T22:06:10.522113+0000","last_active":"2024-08-18T22:06:13.522639+0000","last_peered":"2024-08-18T22:06:13.522639+0000","last_clean":"2024-08-18T22:06:13.522639+0000","last_became_active":"2024-08-18T22:06:10.514837+0000","last_became_peered":"2024-08-18T22:06:10.514837+0000","last_unstale":"2024-08-18T22:06:13.522639+0000","last_undegraded":"2024-08-18T22:06:13.522639+0000","last_fullsized":"2024-08-18T22:06:13.522639+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:46.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57252,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":67,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508344+0000","last_change":"2024-08-18T22:05:28.926357+0000","last_active":"2024-08-18T22:06:10.508344+0000","last_peered":"2024-08-18T22:06:10.508344+0000","last_clean":"2024-08-18T22:06:10.508344+0000","last_became_active":"2024-08-18T22:05:28.926016+0000","last_became_peered":"2024-08-18T22:05:28.926016+0000","last_unstale":"2024-08-18T22:06:10.508344+0000","last_undegraded":"2024-08-18T22:06:10.508344+0000","last_fullsized":"2024-08-18T22:06:10.508344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:16.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506937+0000","last_change":"2024-08-18T22:05:21.860237+0000","last_active":"2024-08-18T22:06:10.506937+0000","last_peered":"2024-08-18T22:06:10.506937+0000","last_clean":"2024-08-18T22:06:10.506937+0000","last_became_active":"2024-08-18T22:05:21.859919+0000","last_became_peered":"2024-08-18T22:05:21.859919+0000","last_unstale":"2024-08-18T22:06:10.506937+0000","last_undegraded":"2024-08-18T22:06:10.506937+0000","last_fullsized":"2024-08-18T22:06:10.506937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:21.048413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.511482+0000","last_change":"2024-08-18T22:05:20.291233+0000","last_active":"2024-08-18T22:06:09.511482+0000","last_peered":"2024-08-18T22:06:09.511482+0000","last_clean":"2024-08-18T22:06:09.511482+0000","last_became_active":"2024-08-18T22:05:20.290893+0000","last_became_peered":"2024-08-18T22:05:20.290893+0000","last_unstale":"2024-08-18T22:06:09.511482+0000","last_undegraded":"2024-08-18T22:06:09.511482+0000","last_fullsized":"2024-08-18T22:06:09.511482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:36.889561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510634+0000","last_change":"2024-08-18T22:05:28.923076+0000","last_active":"2024-08-18T22:06:10.510634+0000","last_peered":"2024-08-18T22:06:10.510634+0000","last_clean":"2024-08-18T22:06:10.510634+0000","last_became_active":"2024-08-18T22:05:28.922688+0000","last_became_peered":"2024-08-18T22:05:28.922688+0000","last_unstale":"2024-08-18T22:06:10.510634+0000","last_undegraded":"2024-08-18T22:06:10.510634+0000","last_fullsized":"2024-08-18T22:06:10.510634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:34.360540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509085+0000","last_change":"2024-08-18T22:05:21.855174+0000","last_active":"2024-08-18T22:06:10.509085+0000","last_peered":"2024-08-18T22:06:10.509085+0000","last_clean":"2024-08-18T22:06:10.509085+0000","last_became_active":"2024-08-18T22:05:21.854818+0000","last_became_peered":"2024-08-18T22:05:21.854818+0000","last_unstale":"2024-08-18T22:06:10.509085+0000","last_undegraded":"2024-08-18T22:06:10.509085+0000","last_fullsized":"2024-08-18T22:06:10.509085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:48:55.094624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508468+0000","last_change":"2024-08-18T22:05:19.847876+0000","last_active":"2024-08-18T22:06:10.508468+0000","last_peered":"2024-08-18T22:06:10.508468+0000","last_clean":"2024-08-18T22:06:10.508468+0000","last_became_active":"2024-08-18T22:05:19.847505+0000","last_became_peered":"2024-08-18T22:05:19.847505+0000","last_unstale":"2024-08-18T22:06:10.508468+0000","last_undegraded":"2024-08-18T22:06:10.508468+0000","last_fullsized":"2024-08-18T22:06:10.508468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:50:15.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508005+0000","last_change":"2024-08-18T22:05:28.921647+0000","last_active":"2024-08-18T22:06:10.508005+0000","last_peered":"2024-08-18T22:06:10.508005+0000","last_clean":"2024-08-18T22:06:10.508005+0000","last_became_active":"2024-08-18T22:05:28.921305+0000","last_became_peered":"2024-08-18T22:05:28.921305+0000","last_unstale":"2024-08-18T22:06:10.508005+0000","last_undegraded":"2024-08-18T22:06:10.508005+0000","last_fullsized":"2024-08-18T22:06:10.508005+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:29.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506841+0000","last_change":"2024-08-18T22:05:21.861151+0000","last_active":"2024-08-18T22:06:10.506841+0000","last_peered":"2024-08-18T22:06:10.506841+0000","last_clean":"2024-08-18T22:06:10.506841+0000","last_became_active":"2024-08-18T22:05:21.860834+0000","last_became_peered":"2024-08-18T22:05:21.860834+0000","last_unstale":"2024-08-18T22:06:10.506841+0000","last_undegraded":"2024-08-18T22:06:10.506841+0000","last_fullsized":"2024-08-18T22:06:10.506841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:32.890750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:12.481238+0000","last_change":"2024-08-18T22:05:19.846145+0000","last_active":"2024-08-18T22:06:12.481238+0000","last_peered":"2024-08-18T22:06:12.481238+0000","last_clean":"2024-08-18T22:06:12.481238+0000","last_became_active":"2024-08-18T22:05:19.845711+0000","last_became_peered":"2024-08-18T22:05:19.845711+0000","last_unstale":"2024-08-18T22:06:12.481238+0000","last_undegraded":"2024-08-18T22:06:12.481238+0000","last_fullsized":"2024-08-18T22:06:12.481238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:20.376131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771915+0000","last_change":"2024-08-18T22:05:28.923256+0000","last_active":"2024-08-18T22:06:10.771915+0000","last_peered":"2024-08-18T22:06:10.771915+0000","last_clean":"2024-08-18T22:06:10.771915+0000","last_became_active":"2024-08-18T22:05:28.922845+0000","last_became_peered":"2024-08-18T22:05:28.922845+0000","last_unstale":"2024-08-18T22:06:10.771915+0000","last_undegraded":"2024-08-18T22:06:10.771915+0000","last_fullsized":"2024-08-18T22:06:10.771915+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:41.930937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508677+0000","last_change":"2024-08-18T22:05:28.924743+0000","last_active":"2024-08-18T22:06:10.508677+0000","last_peered":"2024-08-18T22:06:10.508677+0000","last_clean":"2024-08-18T22:06:10.508677+0000","last_became_active":"2024-08-18T22:05:28.923674+0000","last_became_peered":"2024-08-18T22:05:28.923674+0000","last_unstale":"2024-08-18T22:06:10.508677+0000","last_undegraded":"2024-08-18T22:06:10.508677+0000","last_fullsized":"2024-08-18T22:06:10.508677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:19.834998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508496+0000","last_change":"2024-08-18T22:05:21.857194+0000","last_active":"2024-08-18T22:06:10.508496+0000","last_peered":"2024-08-18T22:06:10.508496+0000","last_clean":"2024-08-18T22:06:10.508496+0000","last_became_active":"2024-08-18T22:05:21.856916+0000","last_became_peered":"2024-08-18T22:05:21.856916+0000","last_unstale":"2024-08-18T22:06:10.508496+0000","last_undegraded":"2024-08-18T22:06:10.508496+0000","last_fullsized":"2024-08-18T22:06:10.508496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:24.759501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.510882+0000","last_change":"2024-08-18T22:05:19.844919+0000","last_active":"2024-08-18T22:06:09.510882+0000","last_peered":"2024-08-18T22:06:09.510882+0000","last_clean":"2024-08-18T22:06:09.510882+0000","last_became_active":"2024-08-18T22:05:19.844539+0000","last_became_peered":"2024-08-18T22:05:19.844539+0000","last_unstale":"2024-08-18T22:06:09.510882+0000","last_undegraded":"2024-08-18T22:06:09.510882+0000","last_fullsized":"2024-08-18T22:06:09.510882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:01.598535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510256+0000","last_change":"2024-08-18T22:05:28.923304+0000","last_active":"2024-08-18T22:06:10.510256+0000","last_peered":"2024-08-18T22:06:10.510256+0000","last_clean":"2024-08-18T22:06:10.510256+0000","last_became_active":"2024-08-18T22:05:28.922912+0000","last_became_peered":"2024-08-18T22:05:28.922912+0000","last_unstale":"2024-08-18T22:06:10.510256+0000","last_undegraded":"2024-08-18T22:06:10.510256+0000","last_fullsized":"2024-08-18T22:06:10.510256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:24:47.834354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771950+0000","last_change":"2024-08-18T22:05:21.849448+0000","last_active":"2024-08-18T22:06:10.771950+0000","last_peered":"2024-08-18T22:06:10.771950+0000","last_clean":"2024-08-18T22:06:10.771950+0000","last_became_active":"2024-08-18T22:05:21.849154+0000","last_became_peered":"2024-08-18T22:05:21.849154+0000","last_unstale":"2024-08-18T22:06:10.771950+0000","last_undegraded":"2024-08-18T22:06:10.771950+0000","last_fullsized":"2024-08-18T22:06:10.771950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:38.583121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505540+0000","last_change":"2024-08-18T22:05:19.848483+0000","last_active":"2024-08-18T22:06:10.505540+0000","last_peered":"2024-08-18T22:06:10.505540+0000","last_clean":"2024-08-18T22:06:10.505540+0000","last_became_active":"2024-08-18T22:05:19.848190+0000","last_became_peered":"2024-08-18T22:05:19.848190+0000","last_unstale":"2024-08-18T22:06:10.505540+0000","last_undegraded":"2024-08-18T22:06:10.505540+0000","last_fullsized":"2024-08-18T22:06:10.505540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:01.719565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509148+0000","last_change":"2024-08-18T22:05:19.843796+0000","last_active":"2024-08-18T22:06:10.509148+0000","last_peered":"2024-08-18T22:06:10.509148+0000","last_clean":"2024-08-18T22:06:10.509148+0000","last_became_active":"2024-08-18T22:05:19.843495+0000","last_became_peered":"2024-08-18T22:05:19.843495+0000","last_unstale":"2024-08-18T22:06:10.509148+0000","last_undegraded":"2024-08-18T22:06:10.509148+0000","last_fullsized":"2024-08-18T22:06:10.509148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:21.583561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.511229+0000","last_change":"2024-08-18T22:05:21.856370+0000","last_active":"2024-08-18T22:06:09.511229+0000","last_peered":"2024-08-18T22:06:09.511229+0000","last_clean":"2024-08-18T22:06:09.511229+0000","last_became_active":"2024-08-18T22:05:21.855954+0000","last_became_peered":"2024-08-18T22:05:21.855954+0000","last_unstale":"2024-08-18T22:06:09.511229+0000","last_undegraded":"2024-08-18T22:06:09.511229+0000","last_fullsized":"2024-08-18T22:06:09.511229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:30.828305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.516344+0000","last_change":"2024-08-18T22:06:10.516344+0000","last_active":"2024-08-18T22:06:10.516344+0000","last_peered":"2024-08-18T22:06:10.516344+0000","last_clean":"2024-08-18T22:06:10.516344+0000","last_became_active":"2024-08-18T22:06:10.515925+0000","last_became_peered":"2024-08-18T22:06:10.515925+0000","last_unstale":"2024-08-18T22:06:10.516344+0000","last_undegraded":"2024-08-18T22:06:10.516344+0000","last_fullsized":"2024-08-18T22:06:10.516344+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:41:07.585521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":53,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.511366+0000","last_change":"2024-08-18T22:05:19.846860+0000","last_active":"2024-08-18T22:06:09.511366+0000","last_peered":"2024-08-18T22:06:09.511366+0000","last_clean":"2024-08-18T22:06:09.511366+0000","last_became_active":"2024-08-18T22:05:19.846496+0000","last_became_peered":"2024-08-18T22:05:19.846496+0000","last_unstale":"2024-08-18T22:06:09.511366+0000","last_undegraded":"2024-08-18T22:06:09.511366+0000","last_fullsized":"2024-08-18T22:06:09.511366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:16.555137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513529+0000","last_change":"2024-08-18T22:05:21.849058+0000","last_active":"2024-08-18T22:06:10.513529+0000","last_peered":"2024-08-18T22:06:10.513529+0000","last_clean":"2024-08-18T22:06:10.513529+0000","last_became_active":"2024-08-18T22:05:21.848703+0000","last_became_peered":"2024-08-18T22:05:21.848703+0000","last_unstale":"2024-08-18T22:06:10.513529+0000","last_undegraded":"2024-08-18T22:06:10.513529+0000","last_fullsized":"2024-08-18T22:06:10.513529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:10.024156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508916+0000","last_change":"2024-08-18T22:05:28.922968+0000","last_active":"2024-08-18T22:06:10.508916+0000","last_peered":"2024-08-18T22:06:10.508916+0000","last_clean":"2024-08-18T22:06:10.508916+0000","last_became_active":"2024-08-18T22:05:28.922378+0000","last_became_peered":"2024-08-18T22:05:28.922378+0000","last_unstale":"2024-08-18T22:06:10.508916+0000","last_undegraded":"2024-08-18T22:06:10.508916+0000","last_fullsized":"2024-08-18T22:06:10.508916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:23:07.241028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509985+0000","last_change":"2024-08-18T22:05:21.858572+0000","last_active":"2024-08-18T22:06:10.509985+0000","last_peered":"2024-08-18T22:06:10.509985+0000","last_clean":"2024-08-18T22:06:10.509985+0000","last_became_active":"2024-08-18T22:05:21.858254+0000","last_became_peered":"2024-08-18T22:05:21.858254+0000","last_unstale":"2024-08-18T22:06:10.509985+0000","last_undegraded":"2024-08-18T22:06:10.509985+0000","last_fullsized":"2024-08-18T22:06:10.509985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:52.456087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509101+0000","last_change":"2024-08-18T22:05:21.856710+0000","last_active":"2024-08-18T22:06:10.509101+0000","last_peered":"2024-08-18T22:06:10.509101+0000","last_clean":"2024-08-18T22:06:10.509101+0000","last_became_active":"2024-08-18T22:05:21.855399+0000","last_became_peered":"2024-08-18T22:05:21.855399+0000","last_unstale":"2024-08-18T22:06:10.509101+0000","last_undegraded":"2024-08-18T22:06:10.509101+0000","last_fullsized":"2024-08-18T22:06:10.509101+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:36.039953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507843+0000","last_change":"2024-08-18T22:05:21.856085+0000","last_active":"2024-08-18T22:06:10.507843+0000","last_peered":"2024-08-18T22:06:10.507843+0000","last_clean":"2024-08-18T22:06:10.507843+0000","last_became_active":"2024-08-18T22:05:21.855263+0000","last_became_peered":"2024-08-18T22:05:21.855263+0000","last_unstale":"2024-08-18T22:06:10.507843+0000","last_undegraded":"2024-08-18T22:06:10.507843+0000","last_fullsized":"2024-08-18T22:06:10.507843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:31.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509110+0000","last_change":"2024-08-18T22:05:21.855385+0000","last_active":"2024-08-18T22:06:10.509110+0000","last_peered":"2024-08-18T22:06:10.509110+0000","last_clean":"2024-08-18T22:06:10.509110+0000","last_became_active":"2024-08-18T22:05:21.854829+0000","last_became_peered":"2024-08-18T22:05:21.854829+0000","last_unstale":"2024-08-18T22:06:10.509110+0000","last_undegraded":"2024-08-18T22:06:10.509110+0000","last_fullsized":"2024-08-18T22:06:10.509110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:59.704154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510370+0000","last_change":"2024-08-18T22:06:10.510370+0000","last_active":"2024-08-18T22:06:10.510370+0000","last_peered":"2024-08-18T22:06:10.510370+0000","last_clean":"2024-08-18T22:06:10.510370+0000","last_became_active":"2024-08-18T22:06:10.509829+0000","last_became_peered":"2024-08-18T22:06:10.509829+0000","last_unstale":"2024-08-18T22:06:10.510370+0000","last_undegraded":"2024-08-18T22:06:10.510370+0000","last_fullsized":"2024-08-18T22:06:10.510370+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:20.171834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510420+0000","last_change":"2024-08-18T22:05:21.856137+0000","last_active":"2024-08-18T22:06:10.510420+0000","last_peered":"2024-08-18T22:06:10.510420+0000","last_clean":"2024-08-18T22:06:10.510420+0000","last_became_active":"2024-08-18T22:05:21.855425+0000","last_became_peered":"2024-08-18T22:05:21.855425+0000","last_unstale":"2024-08-18T22:06:10.510420+0000","last_undegraded":"2024-08-18T22:06:10.510420+0000","last_fullsized":"2024-08-18T22:06:10.510420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:37.514710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509024+0000","last_change":"2024-08-18T22:05:21.856084+0000","last_active":"2024-08-18T22:06:10.509024+0000","last_peered":"2024-08-18T22:06:10.509024+0000","last_clean":"2024-08-18T22:06:10.509024+0000","last_became_active":"2024-08-18T22:05:21.855779+0000","last_became_peered":"2024-08-18T22:05:21.855779+0000","last_unstale":"2024-08-18T22:06:10.509024+0000","last_undegraded":"2024-08-18T22:06:10.509024+0000","last_fullsized":"2024-08-18T22:06:10.509024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:02:47.833634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772328+0000","last_change":"2024-08-18T22:05:21.856729+0000","last_active":"2024-08-18T22:06:10.772328+0000","last_peered":"2024-08-18T22:06:10.772328+0000","last_clean":"2024-08-18T22:06:10.772328+0000","last_became_active":"2024-08-18T22:05:21.856446+0000","last_became_peered":"2024-08-18T22:05:21.856446+0000","last_unstale":"2024-08-18T22:06:10.772328+0000","last_undegraded":"2024-08-18T22:06:10.772328+0000","last_fullsized":"2024-08-18T22:06:10.772328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.482225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-18T22:06:09.510552+0000","last_change":"2024-08-18T22:05:21.851772+0000","last_active":"2024-08-18T22:06:09.510552+0000","last_peered":"2024-08-18T22:06:09.510552+0000","last_clean":"2024-08-18T22:06:09.510552+0000","last_became_active":"2024-08-18T22:05:21.851417+0000","last_became_peered":"2024-08-18T22:05:21.851417+0000","last_unstale":"2024-08-18T22:06:09.510552+0000","last_undegraded":"2024-08-18T22:06:09.510552+0000","last_fullsized":"2024-08-18T22:06:09.510552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:32.509318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771984+0000","last_change":"2024-08-18T22:05:21.857887+0000","last_active":"2024-08-18T22:06:10.771984+0000","last_peered":"2024-08-18T22:06:10.771984+0000","last_clean":"2024-08-18T22:06:10.771984+0000","last_became_active":"2024-08-18T22:05:21.857585+0000","last_became_peered":"2024-08-18T22:05:21.857585+0000","last_unstale":"2024-08-18T22:06:10.771984+0000","last_undegraded":"2024-08-18T22:06:10.771984+0000","last_fullsized":"2024-08-18T22:06:10.771984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:23.299033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506488+0000","last_change":"2024-08-18T22:05:21.854626+0000","last_active":"2024-08-18T22:06:10.506488+0000","last_peered":"2024-08-18T22:06:10.506488+0000","last_clean":"2024-08-18T22:06:10.506488+0000","last_became_active":"2024-08-18T22:05:21.854290+0000","last_became_peered":"2024-08-18T22:05:21.854290+0000","last_unstale":"2024-08-18T22:06:10.506488+0000","last_undegraded":"2024-08-18T22:06:10.506488+0000","last_fullsized":"2024-08-18T22:06:10.506488+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:45:24.988669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505825+0000","last_change":"2024-08-18T22:05:21.865863+0000","last_active":"2024-08-18T22:06:10.505825+0000","last_peered":"2024-08-18T22:06:10.505825+0000","last_clean":"2024-08-18T22:06:10.505825+0000","last_became_active":"2024-08-18T22:05:21.864634+0000","last_became_peered":"2024-08-18T22:05:21.864634+0000","last_unstale":"2024-08-18T22:06:10.505825+0000","last_undegraded":"2024-08-18T22:06:10.505825+0000","last_fullsized":"2024-08-18T22:06:10.505825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:34.051147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510087+0000","last_change":"2024-08-18T22:05:21.860193+0000","last_active":"2024-08-18T22:06:10.510087+0000","last_peered":"2024-08-18T22:06:10.510087+0000","last_clean":"2024-08-18T22:06:10.510087+0000","last_became_active":"2024-08-18T22:05:21.859761+0000","last_became_peered":"2024-08-18T22:05:21.859761+0000","last_unstale":"2024-08-18T22:06:10.510087+0000","last_undegraded":"2024-08-18T22:06:10.510087+0000","last_fullsized":"2024-08-18T22:06:10.510087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:18.465913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509086+0000","last_change":"2024-08-18T22:05:21.860569+0000","last_active":"2024-08-18T22:06:10.509086+0000","last_peered":"2024-08-18T22:06:10.509086+0000","last_clean":"2024-08-18T22:06:10.509086+0000","last_became_active":"2024-08-18T22:05:21.860250+0000","last_became_peered":"2024-08-18T22:05:21.860250+0000","last_unstale":"2024-08-18T22:06:10.509086+0000","last_undegraded":"2024-08-18T22:06:10.509086+0000","last_fullsized":"2024-08-18T22:06:10.509086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:52.097840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509523+0000","last_change":"2024-08-18T22:05:21.858271+0000","last_active":"2024-08-18T22:06:10.509523+0000","last_peered":"2024-08-18T22:06:10.509523+0000","last_clean":"2024-08-18T22:06:10.509523+0000","last_became_active":"2024-08-18T22:05:21.857968+0000","last_became_peered":"2024-08-18T22:05:21.857968+0000","last_unstale":"2024-08-18T22:06:10.509523+0000","last_undegraded":"2024-08-18T22:06:10.509523+0000","last_fullsized":"2024-08-18T22:06:10.509523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:24.023136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510630+0000","last_change":"2024-08-18T22:05:21.853799+0000","last_active":"2024-08-18T22:06:10.510630+0000","last_peered":"2024-08-18T22:06:10.510630+0000","last_clean":"2024-08-18T22:06:10.510630+0000","last_became_active":"2024-08-18T22:05:21.853432+0000","last_became_peered":"2024-08-18T22:05:21.853432+0000","last_unstale":"2024-08-18T22:06:10.510630+0000","last_undegraded":"2024-08-18T22:06:10.510630+0000","last_fullsized":"2024-08-18T22:06:10.510630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:07.429169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506002+0000","last_change":"2024-08-18T22:05:21.855117+0000","last_active":"2024-08-18T22:06:10.506002+0000","last_peered":"2024-08-18T22:06:10.506002+0000","last_clean":"2024-08-18T22:06:10.506002+0000","last_became_active":"2024-08-18T22:05:21.854041+0000","last_became_peered":"2024-08-18T22:05:21.854041+0000","last_unstale":"2024-08-18T22:06:10.506002+0000","last_undegraded":"2024-08-18T22:06:10.506002+0000","last_fullsized":"2024-08-18T22:06:10.506002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:17.222658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508062+0000","last_change":"2024-08-18T22:05:21.861745+0000","last_active":"2024-08-18T22:06:10.508062+0000","last_peered":"2024-08-18T22:06:10.508062+0000","last_clean":"2024-08-18T22:06:10.508062+0000","last_became_active":"2024-08-18T22:05:21.861427+0000","last_became_peered":"2024-08-18T22:05:21.861427+0000","last_unstale":"2024-08-18T22:06:10.508062+0000","last_undegraded":"2024-08-18T22:06:10.508062+0000","last_fullsized":"2024-08-18T22:06:10.508062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:17.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508302+0000","last_change":"2024-08-18T22:05:21.860046+0000","last_active":"2024-08-18T22:06:10.508302+0000","last_peered":"2024-08-18T22:06:10.508302+0000","last_clean":"2024-08-18T22:06:10.508302+0000","last_became_active":"2024-08-18T22:05:21.859674+0000","last_became_peered":"2024-08-18T22:05:21.859674+0000","last_unstale":"2024-08-18T22:06:10.508302+0000","last_undegraded":"2024-08-18T22:06:10.508302+0000","last_fullsized":"2024-08-18T22:06:10.508302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:44.615270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505796+0000","last_change":"2024-08-18T22:05:21.847647+0000","last_active":"2024-08-18T22:06:10.505796+0000","last_peered":"2024-08-18T22:06:10.505796+0000","last_clean":"2024-08-18T22:06:10.505796+0000","last_became_active":"2024-08-18T22:05:21.847367+0000","last_became_peered":"2024-08-18T22:05:21.847367+0000","last_unstale":"2024-08-18T22:06:10.505796+0000","last_undegraded":"2024-08-18T22:06:10.505796+0000","last_fullsized":"2024-08-18T22:06:10.505796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:33.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.512325+0000","last_change":"2024-08-18T22:05:21.861326+0000","last_active":"2024-08-18T22:06:10.512325+0000","last_peered":"2024-08-18T22:06:10.512325+0000","last_clean":"2024-08-18T22:06:10.512325+0000","last_became_active":"2024-08-18T22:05:21.860968+0000","last_became_peered":"2024-08-18T22:05:21.860968+0000","last_unstale":"2024-08-18T22:06:10.512325+0000","last_undegraded":"2024-08-18T22:06:10.512325+0000","last_fullsized":"2024-08-18T22:06:10.512325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:49.150670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508590+0000","last_change":"2024-08-18T22:05:21.852618+0000","last_active":"2024-08-18T22:06:10.508590+0000","last_peered":"2024-08-18T22:06:10.508590+0000","last_clean":"2024-08-18T22:06:10.508590+0000","last_became_active":"2024-08-18T22:05:21.852318+0000","last_became_peered":"2024-08-18T22:05:21.852318+0000","last_unstale":"2024-08-18T22:06:10.508590+0000","last_undegraded":"2024-08-18T22:06:10.508590+0000","last_fullsized":"2024-08-18T22:06:10.508590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:06:49.085150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509956+0000","last_change":"2024-08-18T22:05:21.860108+0000","last_active":"2024-08-18T22:06:10.509956+0000","last_peered":"2024-08-18T22:06:10.509956+0000","last_clean":"2024-08-18T22:06:10.509956+0000","last_became_active":"2024-08-18T22:05:21.859794+0000","last_became_peered":"2024-08-18T22:05:21.859794+0000","last_unstale":"2024-08-18T22:06:10.509956+0000","last_undegraded":"2024-08-18T22:06:10.509956+0000","last_fullsized":"2024-08-18T22:06:10.509956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:01.974202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507181+0000","last_change":"2024-08-18T22:05:21.856404+0000","last_active":"2024-08-18T22:06:10.507181+0000","last_peered":"2024-08-18T22:06:10.507181+0000","last_clean":"2024-08-18T22:06:10.507181+0000","last_became_active":"2024-08-18T22:05:21.855800+0000","last_became_peered":"2024-08-18T22:05:21.855800+0000","last_unstale":"2024-08-18T22:06:10.507181+0000","last_undegraded":"2024-08-18T22:06:10.507181+0000","last_fullsized":"2024-08-18T22:06:10.507181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:09.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771944+0000","last_change":"2024-08-18T22:05:21.859891+0000","last_active":"2024-08-18T22:06:10.771944+0000","last_peered":"2024-08-18T22:06:10.771944+0000","last_clean":"2024-08-18T22:06:10.771944+0000","last_became_active":"2024-08-18T22:05:21.859407+0000","last_became_peered":"2024-08-18T22:05:21.859407+0000","last_unstale":"2024-08-18T22:06:10.771944+0000","last_undegraded":"2024-08-18T22:06:10.771944+0000","last_fullsized":"2024-08-18T22:06:10.771944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:59.285627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508099+0000","last_change":"2024-08-18T22:05:21.856428+0000","last_active":"2024-08-18T22:06:10.508099+0000","last_peered":"2024-08-18T22:06:10.508099+0000","last_clean":"2024-08-18T22:06:10.508099+0000","last_became_active":"2024-08-18T22:05:21.853374+0000","last_became_peered":"2024-08-18T22:05:21.853374+0000","last_unstale":"2024-08-18T22:06:10.508099+0000","last_undegraded":"2024-08-18T22:06:10.508099+0000","last_fullsized":"2024-08-18T22:06:10.508099+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:07.087171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509021+0000","last_change":"2024-08-18T22:05:21.852688+0000","last_active":"2024-08-18T22:06:10.509021+0000","last_peered":"2024-08-18T22:06:10.509021+0000","last_clean":"2024-08-18T22:06:10.509021+0000","last_became_active":"2024-08-18T22:05:21.851107+0000","last_became_peered":"2024-08-18T22:05:21.851107+0000","last_unstale":"2024-08-18T22:06:10.509021+0000","last_undegraded":"2024-08-18T22:06:10.509021+0000","last_fullsized":"2024-08-18T22:06:10.509021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:48.267166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513864+0000","last_change":"2024-08-18T22:05:21.850809+0000","last_active":"2024-08-18T22:06:10.513864+0000","last_peered":"2024-08-18T22:06:10.513864+0000","last_clean":"2024-08-18T22:06:10.513864+0000","last_became_active":"2024-08-18T22:05:21.850510+0000","last_became_peered":"2024-08-18T22:05:21.850510+0000","last_unstale":"2024-08-18T22:06:10.513864+0000","last_undegraded":"2024-08-18T22:06:10.513864+0000","last_fullsized":"2024-08-18T22:06:10.513864+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:39.338051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.512225+0000","last_change":"2024-08-18T22:05:21.856156+0000","last_active":"2024-08-18T22:06:10.512225+0000","last_peered":"2024-08-18T22:06:10.512225+0000","last_clean":"2024-08-18T22:06:10.512225+0000","last_became_active":"2024-08-18T22:05:21.855830+0000","last_became_peered":"2024-08-18T22:05:21.855830+0000","last_unstale":"2024-08-18T22:06:10.512225+0000","last_undegraded":"2024-08-18T22:06:10.512225+0000","last_fullsized":"2024-08-18T22:06:10.512225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:10.670405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508858+0000","last_change":"2024-08-18T22:05:21.865162+0000","last_active":"2024-08-18T22:06:10.508858+0000","last_peered":"2024-08-18T22:06:10.508858+0000","last_clean":"2024-08-18T22:06:10.508858+0000","last_became_active":"2024-08-18T22:05:21.864842+0000","last_became_peered":"2024-08-18T22:05:21.864842+0000","last_unstale":"2024-08-18T22:06:10.508858+0000","last_undegraded":"2024-08-18T22:06:10.508858+0000","last_fullsized":"2024-08-18T22:06:10.508858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:21.388638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508777+0000","last_change":"2024-08-18T22:05:21.859227+0000","last_active":"2024-08-18T22:06:10.508777+0000","last_peered":"2024-08-18T22:06:10.508777+0000","last_clean":"2024-08-18T22:06:10.508777+0000","last_became_active":"2024-08-18T22:05:21.858886+0000","last_became_peered":"2024-08-18T22:05:21.858886+0000","last_unstale":"2024-08-18T22:06:10.508777+0000","last_undegraded":"2024-08-18T22:06:10.508777+0000","last_fullsized":"2024-08-18T22:06:10.508777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:08.710772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510562+0000","last_change":"2024-08-18T22:05:21.854864+0000","last_active":"2024-08-18T22:06:10.510562+0000","last_peered":"2024-08-18T22:06:10.510562+0000","last_clean":"2024-08-18T22:06:10.510562+0000","last_became_active":"2024-08-18T22:05:21.854522+0000","last_became_peered":"2024-08-18T22:05:21.854522+0000","last_unstale":"2024-08-18T22:06:10.510562+0000","last_undegraded":"2024-08-18T22:06:10.510562+0000","last_fullsized":"2024-08-18T22:06:10.510562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:32.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61642,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":111,"num_read_kb":116,"num_write":158,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":184926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514517,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":504444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743452,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32844,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712308,"statfs":{"total":95995035648,"available":95961403392,"internally_reserved":0,"allocated":1708032,"data_stored":1153450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906976,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":504680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168613,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1036288,"data_stored":504600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397545,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1100898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561070,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":499856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790001,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1622016,"data_stored":1086732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953527,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1093632,"data_stored":562148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1011712,"data_stored":490686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":501506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":557018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":501244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":58286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:06:16.532 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-18T22:06:16.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:16 smithi123 ceph-mon[18462]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:06:16.783 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:16.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:16 smithi183 ceph-mon[22097]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:06:17.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:16 smithi130 ceph-mon[21698]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:06:17.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.275+0000 7feda2b3f640 1 -- 172.21.15.123:0/1850728164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed9c1078b0 msgr2=0x7fed9c107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:17.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.275+0000 7feda2b3f640 1 --2- 172.21.15.123:0/1850728164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed9c1078b0 0x7fed9c107c90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fed90009930 tx=0x7fed9002a420 comp rx=0 tx=0).stop 2024-08-18T22:06:17.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.275+0000 7feda2b3f640 1 -- 172.21.15.123:0/1850728164 shutdown_connections 2024-08-18T22:06:17.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.275+0000 7feda2b3f640 1 --2- 172.21.15.123:0/1850728164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed9c102250 0x7fed9c10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:17.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.275+0000 7feda2b3f640 1 --2- 172.21.15.123:0/1850728164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed9c1018b0 0x7fed9c101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:17.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.275+0000 7feda2b3f640 1 --2- 172.21.15.123:0/1850728164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed9c1078b0 0x7fed9c107c90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:17.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.275+0000 7feda2b3f640 1 -- 172.21.15.123:0/1850728164 >> 172.21.15.123:0/1850728164 conn(0x7fed9c0fd5f0 msgr2=0x7fed9c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:17.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.275+0000 7feda2b3f640 1 -- 172.21.15.123:0/1850728164 shutdown_connections 2024-08-18T22:06:17.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.275+0000 7feda2b3f640 1 -- 172.21.15.123:0/1850728164 wait complete. 2024-08-18T22:06:17.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda2b3f640 1 Processor -- start 2024-08-18T22:06:17.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda2b3f640 1 -- start start 2024-08-18T22:06:17.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda2b3f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed9c1018b0 0x7fed9c198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:17.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda2b3f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed9c102250 0x7fed9c198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:17.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda2b3f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed9c1078b0 0x7fed9c19ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda2b3f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c111cb0 con 0x7fed9c1018b0 2024-08-18T22:06:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda2b3f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c111b30 con 0x7fed9c102250 2024-08-18T22:06:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda2b3f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c111e30 con 0x7fed9c1078b0 2024-08-18T22:06:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda08db640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed9c1018b0 0x7fed9c198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda08db640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed9c1018b0 0x7fed9c198150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48804/0 (socket says 172.21.15.123:48804) 2024-08-18T22:06:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda08db640 1 -- 172.21.15.123:0/3018944095 learned_addr learned my addr 172.21.15.123:0/3018944095 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7fed9bfff640 1 --2- 172.21.15.123:0/3018944095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed9c102250 0x7fed9c198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda10dc640 1 --2- 172.21.15.123:0/3018944095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed9c1078b0 0x7fed9c19ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda08db640 1 -- 172.21.15.123:0/3018944095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed9c1078b0 msgr2=0x7fed9c19ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda08db640 1 --2- 172.21.15.123:0/3018944095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed9c1078b0 0x7fed9c19ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda08db640 1 -- 172.21.15.123:0/3018944095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed9c102250 msgr2=0x7fed9c198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda08db640 1 --2- 172.21.15.123:0/3018944095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed9c102250 0x7fed9c198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.276+0000 7feda08db640 1 -- 172.21.15.123:0/3018944095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9c19d100 con 0x7fed9c1018b0 2024-08-18T22:06:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.277+0000 7feda08db640 1 --2- 172.21.15.123:0/3018944095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed9c1018b0 0x7fed9c198150 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fed90009a50 tx=0x7fed90004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.277+0000 7fed99ffb640 1 -- 172.21.15.123:0/3018944095 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9003f030 con 0x7fed9c1018b0 2024-08-18T22:06:17.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.277+0000 7feda2b3f640 1 -- 172.21.15.123:0/3018944095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9c19d390 con 0x7fed9c1018b0 2024-08-18T22:06:17.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.277+0000 7fed99ffb640 1 -- 172.21.15.123:0/3018944095 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed90003ad0 con 0x7fed9c1018b0 2024-08-18T22:06:17.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.277+0000 7fed99ffb640 1 -- 172.21.15.123:0/3018944095 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90035070 con 0x7fed9c1018b0 2024-08-18T22:06:17.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.277+0000 7feda2b3f640 1 -- 172.21.15.123:0/3018944095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed9c1a4cd0 con 0x7fed9c1018b0 2024-08-18T22:06:17.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.278+0000 7feda2b3f640 1 -- 172.21.15.123:0/3018944095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed9c101d10 con 0x7fed9c1018b0 2024-08-18T22:06:17.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.279+0000 7fed99ffb640 1 -- 172.21.15.123:0/3018944095 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fed90042030 con 0x7fed9c1018b0 2024-08-18T22:06:17.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.279+0000 7fed99ffb640 1 --2- 172.21.15.123:0/3018944095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fed8c0a2c10 0x7fed8c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:17.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.280+0000 7fed9bfff640 1 --2- 172.21.15.123:0/3018944095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fed8c0a2c10 0x7fed8c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:17.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.280+0000 7fed99ffb640 1 -- 172.21.15.123:0/3018944095 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fed900efc60 con 0x7fed9c1018b0 2024-08-18T22:06:17.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.280+0000 7fed9bfff640 1 --2- 172.21.15.123:0/3018944095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fed8c0a2c10 0x7fed8c0a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0ffbf0 tx=0x7fed8800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:17.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.284+0000 7fed99ffb640 1 -- 172.21.15.123:0/3018944095 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fed900bc700 con 0x7fed9c1018b0 2024-08-18T22:06:17.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.447+0000 7feda2b3f640 1 -- 172.21.15.123:0/3018944095 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed9c062360 con 0x7fed8c0a2c10 2024-08-18T22:06:17.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.455+0000 7fed99ffb640 1 -- 172.21.15.123:0/3018944095 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340406 (secure 0 0 0) 0x7fed9c062360 con 0x7fed8c0a2c10 2024-08-18T22:06:17.459 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:06:17.460 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-08-18T22:06:17.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.459+0000 7feda2b3f640 1 -- 172.21.15.123:0/3018944095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fed8c0a2c10 msgr2=0x7fed8c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:17.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.459+0000 7feda2b3f640 1 --2- 172.21.15.123:0/3018944095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fed8c0a2c10 0x7fed8c0a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0ffbf0 tx=0x7fed8800a2d0 comp rx=0 tx=0).stop 2024-08-18T22:06:17.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.459+0000 7feda2b3f640 1 -- 172.21.15.123:0/3018944095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed9c1018b0 msgr2=0x7fed9c198150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:17.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.459+0000 7feda2b3f640 1 --2- 172.21.15.123:0/3018944095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed9c1018b0 0x7fed9c198150 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fed90009a50 tx=0x7fed90004270 comp rx=0 tx=0).stop 2024-08-18T22:06:17.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.459+0000 7feda2b3f640 1 -- 172.21.15.123:0/3018944095 shutdown_connections 2024-08-18T22:06:17.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.459+0000 7feda2b3f640 1 --2- 172.21.15.123:0/3018944095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed9c1078b0 0x7fed9c19ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:17.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.459+0000 7feda2b3f640 1 --2- 172.21.15.123:0/3018944095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fed8c0a2c10 0x7fed8c0a50d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:17.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.459+0000 7feda2b3f640 1 --2- 172.21.15.123:0/3018944095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed9c102250 0x7fed9c198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:17.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.459+0000 7feda2b3f640 1 --2- 172.21.15.123:0/3018944095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed9c1018b0 0x7fed9c198150 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:17.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.459+0000 7feda2b3f640 1 -- 172.21.15.123:0/3018944095 >> 172.21.15.123:0/3018944095 conn(0x7fed9c0fd5f0 msgr2=0x7fed9c0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:17.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.460+0000 7feda2b3f640 1 -- 172.21.15.123:0/3018944095 shutdown_connections 2024-08-18T22:06:17.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:17.460+0000 7feda2b3f640 1 -- 172.21.15.123:0/3018944095 wait complete. 2024-08-18T22:06:17.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:17 smithi123 ceph-mon[18462]: pgmap v294: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1.4 KiB/s wr, 5 op/s; 6.0 KiB/s, 0 objects/s recovering 2024-08-18T22:06:17.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:17 smithi123 ceph-mon[18462]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:06:17.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:17 smithi183 ceph-mon[22097]: pgmap v294: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1.4 KiB/s wr, 5 op/s; 6.0 KiB/s, 0 objects/s recovering 2024-08-18T22:06:17.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:17 smithi183 ceph-mon[22097]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:06:18.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:17 smithi130 ceph-mon[21698]: pgmap v294: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1.4 KiB/s wr, 5 op/s; 6.0 KiB/s, 0 objects/s recovering 2024-08-18T22:06:18.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:17 smithi130 ceph-mon[21698]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:06:18.279 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-08-18T22:06:17.348113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652244,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":242,"num_read_kb":225,"num_write":347,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1229945,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279,"ondisk_log_size":279,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":420,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375700,"kb_used_data":14024,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566124,"statfs":{"total":1151940427776,"available":1151555710976,"internally_reserved":0,"allocated":14360576,"data_stored":7985990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8160,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13,"num_write":13,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":49209,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002301"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509743+0000","last_change":"2024-08-18T22:05:19.844674+0000","last_active":"2024-08-18T22:06:10.509743+0000","last_peered":"2024-08-18T22:06:10.509743+0000","last_clean":"2024-08-18T22:06:10.509743+0000","last_became_active":"2024-08-18T22:05:19.844381+0000","last_became_peered":"2024-08-18T22:05:19.844381+0000","last_unstale":"2024-08-18T22:06:10.509743+0000","last_undegraded":"2024-08-18T22:06:10.509743+0000","last_fullsized":"2024-08-18T22:06:10.509743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:58.783222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772174+0000","last_change":"2024-08-18T22:05:21.859013+0000","last_active":"2024-08-18T22:06:10.772174+0000","last_peered":"2024-08-18T22:06:10.772174+0000","last_clean":"2024-08-18T22:06:10.772174+0000","last_became_active":"2024-08-18T22:05:21.858709+0000","last_became_peered":"2024-08-18T22:05:21.858709+0000","last_unstale":"2024-08-18T22:06:10.772174+0000","last_undegraded":"2024-08-18T22:06:10.772174+0000","last_fullsized":"2024-08-18T22:06:10.772174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:34.272340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508245+0000","last_change":"2024-08-18T22:05:28.925735+0000","last_active":"2024-08-18T22:06:10.508245+0000","last_peered":"2024-08-18T22:06:10.508245+0000","last_clean":"2024-08-18T22:06:10.508245+0000","last_became_active":"2024-08-18T22:05:28.925324+0000","last_became_peered":"2024-08-18T22:05:28.925324+0000","last_unstale":"2024-08-18T22:06:10.508245+0000","last_undegraded":"2024-08-18T22:06:10.508245+0000","last_fullsized":"2024-08-18T22:06:10.508245+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:15:58.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772359+0000","last_change":"2024-08-18T22:05:20.290861+0000","last_active":"2024-08-18T22:06:10.772359+0000","last_peered":"2024-08-18T22:06:10.772359+0000","last_clean":"2024-08-18T22:06:10.772359+0000","last_became_active":"2024-08-18T22:05:20.290508+0000","last_became_peered":"2024-08-18T22:05:20.290508+0000","last_unstale":"2024-08-18T22:06:10.772359+0000","last_undegraded":"2024-08-18T22:06:10.772359+0000","last_fullsized":"2024-08-18T22:06:10.772359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:21.462206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509155+0000","last_change":"2024-08-18T22:05:21.863441+0000","last_active":"2024-08-18T22:06:10.509155+0000","last_peered":"2024-08-18T22:06:10.509155+0000","last_clean":"2024-08-18T22:06:10.509155+0000","last_became_active":"2024-08-18T22:05:21.863121+0000","last_became_peered":"2024-08-18T22:05:21.863121+0000","last_unstale":"2024-08-18T22:06:10.509155+0000","last_undegraded":"2024-08-18T22:06:10.509155+0000","last_fullsized":"2024-08-18T22:06:10.509155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:47.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509447+0000","last_change":"2024-08-18T22:05:28.925477+0000","last_active":"2024-08-18T22:06:10.509447+0000","last_peered":"2024-08-18T22:06:10.509447+0000","last_clean":"2024-08-18T22:06:10.509447+0000","last_became_active":"2024-08-18T22:05:28.924922+0000","last_became_peered":"2024-08-18T22:05:28.924922+0000","last_unstale":"2024-08-18T22:06:10.509447+0000","last_undegraded":"2024-08-18T22:06:10.509447+0000","last_fullsized":"2024-08-18T22:06:10.509447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:35.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514293+0000","last_change":"2024-08-18T22:05:19.847979+0000","last_active":"2024-08-18T22:06:10.514293+0000","last_peered":"2024-08-18T22:06:10.514293+0000","last_clean":"2024-08-18T22:06:10.514293+0000","last_became_active":"2024-08-18T22:05:19.847643+0000","last_became_peered":"2024-08-18T22:05:19.847643+0000","last_unstale":"2024-08-18T22:06:10.514293+0000","last_undegraded":"2024-08-18T22:06:10.514293+0000","last_fullsized":"2024-08-18T22:06:10.514293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:33.875378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506424+0000","last_change":"2024-08-18T22:05:21.860225+0000","last_active":"2024-08-18T22:06:10.506424+0000","last_peered":"2024-08-18T22:06:10.506424+0000","last_clean":"2024-08-18T22:06:10.506424+0000","last_became_active":"2024-08-18T22:05:21.859889+0000","last_became_peered":"2024-08-18T22:05:21.859889+0000","last_unstale":"2024-08-18T22:06:10.506424+0000","last_undegraded":"2024-08-18T22:06:10.506424+0000","last_fullsized":"2024-08-18T22:06:10.506424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:06:27.084401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511096+0000","last_change":"2024-08-18T22:05:28.922230+0000","last_active":"2024-08-18T22:06:10.511096+0000","last_peered":"2024-08-18T22:06:10.511096+0000","last_clean":"2024-08-18T22:06:10.511096+0000","last_became_active":"2024-08-18T22:05:28.921804+0000","last_became_peered":"2024-08-18T22:05:28.921804+0000","last_unstale":"2024-08-18T22:06:10.511096+0000","last_undegraded":"2024-08-18T22:06:10.511096+0000","last_fullsized":"2024-08-18T22:06:10.511096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:17.735645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514907+0000","last_change":"2024-08-18T22:05:19.841452+0000","last_active":"2024-08-18T22:06:10.514907+0000","last_peered":"2024-08-18T22:06:10.514907+0000","last_clean":"2024-08-18T22:06:10.514907+0000","last_became_active":"2024-08-18T22:05:19.840997+0000","last_became_peered":"2024-08-18T22:05:19.840997+0000","last_unstale":"2024-08-18T22:06:10.514907+0000","last_undegraded":"2024-08-18T22:06:10.514907+0000","last_fullsized":"2024-08-18T22:06:10.514907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:27:26.208279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514673+0000","last_change":"2024-08-18T22:06:10.514673+0000","last_active":"2024-08-18T22:06:10.514673+0000","last_peered":"2024-08-18T22:06:10.514673+0000","last_clean":"2024-08-18T22:06:10.514673+0000","last_became_active":"2024-08-18T22:06:10.514264+0000","last_became_peered":"2024-08-18T22:06:10.514264+0000","last_unstale":"2024-08-18T22:06:10.514673+0000","last_undegraded":"2024-08-18T22:06:10.514673+0000","last_fullsized":"2024-08-18T22:06:10.514673+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:03.626895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509642+0000","last_change":"2024-08-18T22:05:28.924521+0000","last_active":"2024-08-18T22:06:10.509642+0000","last_peered":"2024-08-18T22:06:10.509642+0000","last_clean":"2024-08-18T22:06:10.509642+0000","last_became_active":"2024-08-18T22:05:28.924107+0000","last_became_peered":"2024-08-18T22:05:28.924107+0000","last_unstale":"2024-08-18T22:06:10.509642+0000","last_undegraded":"2024-08-18T22:06:10.509642+0000","last_fullsized":"2024-08-18T22:06:10.509642+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:37.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508303+0000","last_change":"2024-08-18T22:05:21.861696+0000","last_active":"2024-08-18T22:06:10.508303+0000","last_peered":"2024-08-18T22:06:10.508303+0000","last_clean":"2024-08-18T22:06:10.508303+0000","last_became_active":"2024-08-18T22:05:21.861220+0000","last_became_peered":"2024-08-18T22:05:21.861220+0000","last_unstale":"2024-08-18T22:06:10.508303+0000","last_undegraded":"2024-08-18T22:06:10.508303+0000","last_fullsized":"2024-08-18T22:06:10.508303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:01.098281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.520590+0000","last_change":"2024-08-18T22:06:10.520097+0000","last_active":"2024-08-18T22:06:10.520590+0000","last_peered":"2024-08-18T22:06:10.520590+0000","last_clean":"2024-08-18T22:06:10.520590+0000","last_became_active":"2024-08-18T22:06:10.513286+0000","last_became_peered":"2024-08-18T22:06:10.513286+0000","last_unstale":"2024-08-18T22:06:10.520590+0000","last_undegraded":"2024-08-18T22:06:10.520590+0000","last_fullsized":"2024-08-18T22:06:10.520590+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:08:18.861243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509973+0000","last_change":"2024-08-18T22:05:29.013139+0000","last_active":"2024-08-18T22:06:10.509973+0000","last_peered":"2024-08-18T22:06:10.509973+0000","last_clean":"2024-08-18T22:06:10.509973+0000","last_became_active":"2024-08-18T22:05:29.012322+0000","last_became_peered":"2024-08-18T22:05:29.012322+0000","last_unstale":"2024-08-18T22:06:10.509973+0000","last_undegraded":"2024-08-18T22:06:10.509973+0000","last_fullsized":"2024-08-18T22:06:10.509973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:32.348201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772162+0000","last_change":"2024-08-18T22:05:21.860410+0000","last_active":"2024-08-18T22:06:10.772162+0000","last_peered":"2024-08-18T22:06:10.772162+0000","last_clean":"2024-08-18T22:06:10.772162+0000","last_became_active":"2024-08-18T22:05:21.860173+0000","last_became_peered":"2024-08-18T22:05:21.860173+0000","last_unstale":"2024-08-18T22:06:10.772162+0000","last_undegraded":"2024-08-18T22:06:10.772162+0000","last_fullsized":"2024-08-18T22:06:10.772162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:00.879178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507956+0000","last_change":"2024-08-18T22:05:19.845785+0000","last_active":"2024-08-18T22:06:10.507956+0000","last_peered":"2024-08-18T22:06:10.507956+0000","last_clean":"2024-08-18T22:06:10.507956+0000","last_became_active":"2024-08-18T22:05:19.845414+0000","last_became_peered":"2024-08-18T22:05:19.845414+0000","last_unstale":"2024-08-18T22:06:10.507956+0000","last_undegraded":"2024-08-18T22:06:10.507956+0000","last_fullsized":"2024-08-18T22:06:10.507956+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:13.504885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.523404+0000","last_change":"2024-08-18T22:06:10.523404+0000","last_active":"2024-08-18T22:06:10.523404+0000","last_peered":"2024-08-18T22:06:10.523404+0000","last_clean":"2024-08-18T22:06:10.523404+0000","last_became_active":"2024-08-18T22:06:10.516652+0000","last_became_peered":"2024-08-18T22:06:10.516652+0000","last_unstale":"2024-08-18T22:06:10.523404+0000","last_undegraded":"2024-08-18T22:06:10.523404+0000","last_fullsized":"2024-08-18T22:06:10.523404+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:58.197636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510102+0000","last_change":"2024-08-18T22:05:21.858329+0000","last_active":"2024-08-18T22:06:10.510102+0000","last_peered":"2024-08-18T22:06:10.510102+0000","last_clean":"2024-08-18T22:06:10.510102+0000","last_became_active":"2024-08-18T22:05:21.857854+0000","last_became_peered":"2024-08-18T22:05:21.857854+0000","last_unstale":"2024-08-18T22:06:10.510102+0000","last_undegraded":"2024-08-18T22:06:10.510102+0000","last_fullsized":"2024-08-18T22:06:10.510102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:45:19.934647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772068+0000","last_change":"2024-08-18T22:05:19.843031+0000","last_active":"2024-08-18T22:06:10.772068+0000","last_peered":"2024-08-18T22:06:10.772068+0000","last_clean":"2024-08-18T22:06:10.772068+0000","last_became_active":"2024-08-18T22:05:19.842694+0000","last_became_peered":"2024-08-18T22:05:19.842694+0000","last_unstale":"2024-08-18T22:06:10.772068+0000","last_undegraded":"2024-08-18T22:06:10.772068+0000","last_fullsized":"2024-08-18T22:06:10.772068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:01.135449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509575+0000","last_change":"2024-08-18T22:05:28.920647+0000","last_active":"2024-08-18T22:06:10.509575+0000","last_peered":"2024-08-18T22:06:10.509575+0000","last_clean":"2024-08-18T22:06:10.509575+0000","last_became_active":"2024-08-18T22:05:28.920295+0000","last_became_peered":"2024-08-18T22:05:28.920295+0000","last_unstale":"2024-08-18T22:06:10.509575+0000","last_undegraded":"2024-08-18T22:06:10.509575+0000","last_fullsized":"2024-08-18T22:06:10.509575+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:41.295009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513283+0000","last_change":"2024-08-18T22:05:21.858413+0000","last_active":"2024-08-18T22:06:10.513283+0000","last_peered":"2024-08-18T22:06:10.513283+0000","last_clean":"2024-08-18T22:06:10.513283+0000","last_became_active":"2024-08-18T22:05:21.858102+0000","last_became_peered":"2024-08-18T22:05:21.858102+0000","last_unstale":"2024-08-18T22:06:10.513283+0000","last_undegraded":"2024-08-18T22:06:10.513283+0000","last_fullsized":"2024-08-18T22:06:10.513283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:24:59.432666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506163+0000","last_change":"2024-08-18T22:05:20.292085+0000","last_active":"2024-08-18T22:06:10.506163+0000","last_peered":"2024-08-18T22:06:10.506163+0000","last_clean":"2024-08-18T22:06:10.506163+0000","last_became_active":"2024-08-18T22:05:20.291606+0000","last_became_peered":"2024-08-18T22:05:20.291606+0000","last_unstale":"2024-08-18T22:06:10.506163+0000","last_undegraded":"2024-08-18T22:06:10.506163+0000","last_fullsized":"2024-08-18T22:06:10.506163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:22:46.801719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515755+0000","last_change":"2024-08-18T22:06:10.515755+0000","last_active":"2024-08-18T22:06:10.515755+0000","last_peered":"2024-08-18T22:06:10.515755+0000","last_clean":"2024-08-18T22:06:10.515755+0000","last_became_active":"2024-08-18T22:06:10.514624+0000","last_became_peered":"2024-08-18T22:06:10.514624+0000","last_unstale":"2024-08-18T22:06:10.515755+0000","last_undegraded":"2024-08-18T22:06:10.515755+0000","last_fullsized":"2024-08-18T22:06:10.515755+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:18:50.785139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508880+0000","last_change":"2024-08-18T22:05:21.855163+0000","last_active":"2024-08-18T22:06:10.508880+0000","last_peered":"2024-08-18T22:06:10.508880+0000","last_clean":"2024-08-18T22:06:10.508880+0000","last_became_active":"2024-08-18T22:05:21.854867+0000","last_became_peered":"2024-08-18T22:05:21.854867+0000","last_unstale":"2024-08-18T22:06:10.508880+0000","last_undegraded":"2024-08-18T22:06:10.508880+0000","last_fullsized":"2024-08-18T22:06:10.508880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:10.300307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510102+0000","last_change":"2024-08-18T22:05:20.082363+0000","last_active":"2024-08-18T22:06:10.510102+0000","last_peered":"2024-08-18T22:06:10.510102+0000","last_clean":"2024-08-18T22:06:10.510102+0000","last_became_active":"2024-08-18T22:05:20.081998+0000","last_became_peered":"2024-08-18T22:05:20.081998+0000","last_unstale":"2024-08-18T22:06:10.510102+0000","last_undegraded":"2024-08-18T22:06:10.510102+0000","last_fullsized":"2024-08-18T22:06:10.510102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:44.960512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508721+0000","last_change":"2024-08-18T22:05:28.924072+0000","last_active":"2024-08-18T22:06:10.508721+0000","last_peered":"2024-08-18T22:06:10.508721+0000","last_clean":"2024-08-18T22:06:10.508721+0000","last_became_active":"2024-08-18T22:05:28.923673+0000","last_became_peered":"2024-08-18T22:05:28.923673+0000","last_unstale":"2024-08-18T22:06:10.508721+0000","last_undegraded":"2024-08-18T22:06:10.508721+0000","last_fullsized":"2024-08-18T22:06:10.508721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:44.593009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772399+0000","last_change":"2024-08-18T22:05:21.851377+0000","last_active":"2024-08-18T22:06:10.772399+0000","last_peered":"2024-08-18T22:06:10.772399+0000","last_clean":"2024-08-18T22:06:10.772399+0000","last_became_active":"2024-08-18T22:05:21.851031+0000","last_became_peered":"2024-08-18T22:05:21.851031+0000","last_unstale":"2024-08-18T22:06:10.772399+0000","last_undegraded":"2024-08-18T22:06:10.772399+0000","last_fullsized":"2024-08-18T22:06:10.772399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.547244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'11","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:13.873627+0000","last_change":"2024-08-18T22:05:19.840697+0000","last_active":"2024-08-18T22:06:13.873627+0000","last_peered":"2024-08-18T22:06:13.873627+0000","last_clean":"2024-08-18T22:06:13.873627+0000","last_became_active":"2024-08-18T22:05:19.840382+0000","last_became_peered":"2024-08-18T22:05:19.840382+0000","last_unstale":"2024-08-18T22:06:13.873627+0000","last_undegraded":"2024-08-18T22:06:13.873627+0000","last_fullsized":"2024-08-18T22:06:13.873627+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:24.514428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771817+0000","last_change":"2024-08-18T22:05:29.012305+0000","last_active":"2024-08-18T22:06:10.771817+0000","last_peered":"2024-08-18T22:06:10.771817+0000","last_clean":"2024-08-18T22:06:10.771817+0000","last_became_active":"2024-08-18T22:05:29.011846+0000","last_became_peered":"2024-08-18T22:05:29.011846+0000","last_unstale":"2024-08-18T22:06:10.771817+0000","last_undegraded":"2024-08-18T22:06:10.771817+0000","last_fullsized":"2024-08-18T22:06:10.771817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:36.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506016+0000","last_change":"2024-08-18T22:05:21.856182+0000","last_active":"2024-08-18T22:06:10.506016+0000","last_peered":"2024-08-18T22:06:10.506016+0000","last_clean":"2024-08-18T22:06:10.506016+0000","last_became_active":"2024-08-18T22:05:21.855855+0000","last_became_peered":"2024-08-18T22:05:21.855855+0000","last_unstale":"2024-08-18T22:06:10.506016+0000","last_undegraded":"2024-08-18T22:06:10.506016+0000","last_fullsized":"2024-08-18T22:06:10.506016+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:00.166809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514793+0000","last_change":"2024-08-18T22:05:20.291272+0000","last_active":"2024-08-18T22:06:10.514793+0000","last_peered":"2024-08-18T22:06:10.514793+0000","last_clean":"2024-08-18T22:06:10.514793+0000","last_became_active":"2024-08-18T22:05:20.290970+0000","last_became_peered":"2024-08-18T22:05:20.290970+0000","last_unstale":"2024-08-18T22:06:10.514793+0000","last_undegraded":"2024-08-18T22:06:10.514793+0000","last_fullsized":"2024-08-18T22:06:10.514793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:29.438996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510601+0000","last_change":"2024-08-18T22:05:28.923141+0000","last_active":"2024-08-18T22:06:10.510601+0000","last_peered":"2024-08-18T22:06:10.510601+0000","last_clean":"2024-08-18T22:06:10.510601+0000","last_became_active":"2024-08-18T22:05:28.922269+0000","last_became_peered":"2024-08-18T22:05:28.922269+0000","last_unstale":"2024-08-18T22:06:10.510601+0000","last_undegraded":"2024-08-18T22:06:10.510601+0000","last_fullsized":"2024-08-18T22:06:10.510601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:58.092640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509287+0000","last_change":"2024-08-18T22:05:21.850124+0000","last_active":"2024-08-18T22:06:10.509287+0000","last_peered":"2024-08-18T22:06:10.509287+0000","last_clean":"2024-08-18T22:06:10.509287+0000","last_became_active":"2024-08-18T22:05:21.849805+0000","last_became_peered":"2024-08-18T22:05:21.849805+0000","last_unstale":"2024-08-18T22:06:10.509287+0000","last_undegraded":"2024-08-18T22:06:10.509287+0000","last_fullsized":"2024-08-18T22:06:10.509287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:53.492613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509230+0000","last_change":"2024-08-18T22:05:20.292836+0000","last_active":"2024-08-18T22:06:10.509230+0000","last_peered":"2024-08-18T22:06:10.509230+0000","last_clean":"2024-08-18T22:06:10.509230+0000","last_became_active":"2024-08-18T22:05:20.292456+0000","last_became_peered":"2024-08-18T22:05:20.292456+0000","last_unstale":"2024-08-18T22:06:10.509230+0000","last_undegraded":"2024-08-18T22:06:10.509230+0000","last_fullsized":"2024-08-18T22:06:10.509230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:19.525037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513298+0000","last_change":"2024-08-18T22:05:29.012439+0000","last_active":"2024-08-18T22:06:10.513298+0000","last_peered":"2024-08-18T22:06:10.513298+0000","last_clean":"2024-08-18T22:06:10.513298+0000","last_became_active":"2024-08-18T22:05:29.011860+0000","last_became_peered":"2024-08-18T22:05:29.011860+0000","last_unstale":"2024-08-18T22:06:10.513298+0000","last_undegraded":"2024-08-18T22:06:10.513298+0000","last_fullsized":"2024-08-18T22:06:10.513298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:03.432217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509272+0000","last_change":"2024-08-18T22:05:21.855598+0000","last_active":"2024-08-18T22:06:10.509272+0000","last_peered":"2024-08-18T22:06:10.509272+0000","last_clean":"2024-08-18T22:06:10.509272+0000","last_became_active":"2024-08-18T22:05:21.855228+0000","last_became_peered":"2024-08-18T22:05:21.855228+0000","last_unstale":"2024-08-18T22:06:10.509272+0000","last_undegraded":"2024-08-18T22:06:10.509272+0000","last_fullsized":"2024-08-18T22:06:10.509272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:33.762700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508476+0000","last_change":"2024-08-18T22:05:19.844638+0000","last_active":"2024-08-18T22:06:10.508476+0000","last_peered":"2024-08-18T22:06:10.508476+0000","last_clean":"2024-08-18T22:06:10.508476+0000","last_became_active":"2024-08-18T22:05:19.844333+0000","last_became_peered":"2024-08-18T22:05:19.844333+0000","last_unstale":"2024-08-18T22:06:10.508476+0000","last_undegraded":"2024-08-18T22:06:10.508476+0000","last_fullsized":"2024-08-18T22:06:10.508476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:26.947512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505914+0000","last_change":"2024-08-18T22:05:28.919965+0000","last_active":"2024-08-18T22:06:10.505914+0000","last_peered":"2024-08-18T22:06:10.505914+0000","last_clean":"2024-08-18T22:06:10.505914+0000","last_became_active":"2024-08-18T22:05:28.919546+0000","last_became_peered":"2024-08-18T22:05:28.919546+0000","last_unstale":"2024-08-18T22:06:10.505914+0000","last_undegraded":"2024-08-18T22:06:10.505914+0000","last_fullsized":"2024-08-18T22:06:10.505914+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:49.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506450+0000","last_change":"2024-08-18T22:05:21.857867+0000","last_active":"2024-08-18T22:06:10.506450+0000","last_peered":"2024-08-18T22:06:10.506450+0000","last_clean":"2024-08-18T22:06:10.506450+0000","last_became_active":"2024-08-18T22:05:21.857515+0000","last_became_peered":"2024-08-18T22:05:21.857515+0000","last_unstale":"2024-08-18T22:06:10.506450+0000","last_undegraded":"2024-08-18T22:06:10.506450+0000","last_fullsized":"2024-08-18T22:06:10.506450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:51.148321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:11.479439+0000","last_change":"2024-08-18T22:05:20.290924+0000","last_active":"2024-08-18T22:06:11.479439+0000","last_peered":"2024-08-18T22:06:11.479439+0000","last_clean":"2024-08-18T22:06:11.479439+0000","last_became_active":"2024-08-18T22:05:20.290587+0000","last_became_peered":"2024-08-18T22:05:20.290587+0000","last_unstale":"2024-08-18T22:06:11.479439+0000","last_undegraded":"2024-08-18T22:06:11.479439+0000","last_fullsized":"2024-08-18T22:06:11.479439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:35.029634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505852+0000","last_change":"2024-08-18T22:05:29.012876+0000","last_active":"2024-08-18T22:06:10.505852+0000","last_peered":"2024-08-18T22:06:10.505852+0000","last_clean":"2024-08-18T22:06:10.505852+0000","last_became_active":"2024-08-18T22:05:29.011930+0000","last_became_peered":"2024-08-18T22:05:29.011930+0000","last_unstale":"2024-08-18T22:06:10.505852+0000","last_undegraded":"2024-08-18T22:06:10.505852+0000","last_fullsized":"2024-08-18T22:06:10.505852+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:22:35.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505526+0000","last_change":"2024-08-18T22:05:21.860798+0000","last_active":"2024-08-18T22:06:10.505526+0000","last_peered":"2024-08-18T22:06:10.505526+0000","last_clean":"2024-08-18T22:06:10.505526+0000","last_became_active":"2024-08-18T22:05:21.856968+0000","last_became_peered":"2024-08-18T22:05:21.856968+0000","last_unstale":"2024-08-18T22:06:10.505526+0000","last_undegraded":"2024-08-18T22:06:10.505526+0000","last_fullsized":"2024-08-18T22:06:10.505526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:54.934400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508009+0000","last_change":"2024-08-18T22:05:19.844775+0000","last_active":"2024-08-18T22:06:10.508009+0000","last_peered":"2024-08-18T22:06:10.508009+0000","last_clean":"2024-08-18T22:06:10.508009+0000","last_became_active":"2024-08-18T22:05:19.844465+0000","last_became_peered":"2024-08-18T22:05:19.844465+0000","last_unstale":"2024-08-18T22:06:10.508009+0000","last_undegraded":"2024-08-18T22:06:10.508009+0000","last_fullsized":"2024-08-18T22:06:10.508009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.042335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507348+0000","last_change":"2024-08-18T22:05:29.013275+0000","last_active":"2024-08-18T22:06:10.507348+0000","last_peered":"2024-08-18T22:06:10.507348+0000","last_clean":"2024-08-18T22:06:10.507348+0000","last_became_active":"2024-08-18T22:05:29.012537+0000","last_became_peered":"2024-08-18T22:05:29.012537+0000","last_unstale":"2024-08-18T22:06:10.507348+0000","last_undegraded":"2024-08-18T22:06:10.507348+0000","last_fullsized":"2024-08-18T22:06:10.507348+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:15:39.775360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772046+0000","last_change":"2024-08-18T22:05:21.853358+0000","last_active":"2024-08-18T22:06:10.772046+0000","last_peered":"2024-08-18T22:06:10.772046+0000","last_clean":"2024-08-18T22:06:10.772046+0000","last_became_active":"2024-08-18T22:05:21.853071+0000","last_became_peered":"2024-08-18T22:05:21.853071+0000","last_unstale":"2024-08-18T22:06:10.772046+0000","last_undegraded":"2024-08-18T22:06:10.772046+0000","last_fullsized":"2024-08-18T22:06:10.772046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:23.755263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511287+0000","last_change":"2024-08-18T22:05:19.846922+0000","last_active":"2024-08-18T22:06:10.511287+0000","last_peered":"2024-08-18T22:06:10.511287+0000","last_clean":"2024-08-18T22:06:10.511287+0000","last_became_active":"2024-08-18T22:05:19.846619+0000","last_became_peered":"2024-08-18T22:05:19.846619+0000","last_unstale":"2024-08-18T22:06:10.511287+0000","last_undegraded":"2024-08-18T22:06:10.511287+0000","last_fullsized":"2024-08-18T22:06:10.511287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:36:16.232344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":352,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508214+0000","last_change":"2024-08-18T22:04:11.878703+0000","last_active":"2024-08-18T22:06:10.508214+0000","last_peered":"2024-08-18T22:06:10.508214+0000","last_clean":"2024-08-18T22:06:10.508214+0000","last_became_active":"2024-08-18T22:04:11.878157+0000","last_became_peered":"2024-08-18T22:04:11.878157+0000","last_unstale":"2024-08-18T22:06:10.508214+0000","last_undegraded":"2024-08-18T22:06:10.508214+0000","last_fullsized":"2024-08-18T22:06:10.508214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_clean_scrub_stamp":"2024-08-18T22:01:09.551264+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:24:07.391758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508423+0000","last_change":"2024-08-18T22:05:28.928882+0000","last_active":"2024-08-18T22:06:10.508423+0000","last_peered":"2024-08-18T22:06:10.508423+0000","last_clean":"2024-08-18T22:06:10.508423+0000","last_became_active":"2024-08-18T22:05:28.928482+0000","last_became_peered":"2024-08-18T22:05:28.928482+0000","last_unstale":"2024-08-18T22:06:10.508423+0000","last_undegraded":"2024-08-18T22:06:10.508423+0000","last_fullsized":"2024-08-18T22:06:10.508423+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:41.739482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508689+0000","last_change":"2024-08-18T22:05:21.863045+0000","last_active":"2024-08-18T22:06:10.508689+0000","last_peered":"2024-08-18T22:06:10.508689+0000","last_clean":"2024-08-18T22:06:10.508689+0000","last_became_active":"2024-08-18T22:05:21.862758+0000","last_became_peered":"2024-08-18T22:05:21.862758+0000","last_unstale":"2024-08-18T22:06:10.508689+0000","last_undegraded":"2024-08-18T22:06:10.508689+0000","last_fullsized":"2024-08-18T22:06:10.508689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:08:39.111147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509216+0000","last_change":"2024-08-18T22:05:20.291030+0000","last_active":"2024-08-18T22:06:10.509216+0000","last_peered":"2024-08-18T22:06:10.509216+0000","last_clean":"2024-08-18T22:06:10.509216+0000","last_became_active":"2024-08-18T22:05:20.290427+0000","last_became_peered":"2024-08-18T22:05:20.290427+0000","last_unstale":"2024-08-18T22:06:10.509216+0000","last_undegraded":"2024-08-18T22:06:10.509216+0000","last_fullsized":"2024-08-18T22:06:10.509216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:14:42.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506125+0000","last_change":"2024-08-18T22:05:28.923700+0000","last_active":"2024-08-18T22:06:10.506125+0000","last_peered":"2024-08-18T22:06:10.506125+0000","last_clean":"2024-08-18T22:06:10.506125+0000","last_became_active":"2024-08-18T22:05:28.923280+0000","last_became_peered":"2024-08-18T22:05:28.923280+0000","last_unstale":"2024-08-18T22:06:10.506125+0000","last_undegraded":"2024-08-18T22:06:10.506125+0000","last_fullsized":"2024-08-18T22:06:10.506125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:25:45.343542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508357+0000","last_change":"2024-08-18T22:05:21.856107+0000","last_active":"2024-08-18T22:06:10.508357+0000","last_peered":"2024-08-18T22:06:10.508357+0000","last_clean":"2024-08-18T22:06:10.508357+0000","last_became_active":"2024-08-18T22:05:21.853276+0000","last_became_peered":"2024-08-18T22:05:21.853276+0000","last_unstale":"2024-08-18T22:06:10.508357+0000","last_undegraded":"2024-08-18T22:06:10.508357+0000","last_fullsized":"2024-08-18T22:06:10.508357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:58.280375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507968+0000","last_change":"2024-08-18T22:05:19.843445+0000","last_active":"2024-08-18T22:06:10.507968+0000","last_peered":"2024-08-18T22:06:10.507968+0000","last_clean":"2024-08-18T22:06:10.507968+0000","last_became_active":"2024-08-18T22:05:19.843000+0000","last_became_peered":"2024-08-18T22:05:19.843000+0000","last_unstale":"2024-08-18T22:06:10.507968+0000","last_undegraded":"2024-08-18T22:06:10.507968+0000","last_fullsized":"2024-08-18T22:06:10.507968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:23.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515953+0000","last_change":"2024-08-18T22:06:10.515953+0000","last_active":"2024-08-18T22:06:10.515953+0000","last_peered":"2024-08-18T22:06:10.515953+0000","last_clean":"2024-08-18T22:06:10.515953+0000","last_became_active":"2024-08-18T22:06:10.515662+0000","last_became_peered":"2024-08-18T22:06:10.515662+0000","last_unstale":"2024-08-18T22:06:10.515953+0000","last_undegraded":"2024-08-18T22:06:10.515953+0000","last_fullsized":"2024-08-18T22:06:10.515953+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:43.150180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509215+0000","last_change":"2024-08-18T22:05:21.864029+0000","last_active":"2024-08-18T22:06:10.509215+0000","last_peered":"2024-08-18T22:06:10.509215+0000","last_clean":"2024-08-18T22:06:10.509215+0000","last_became_active":"2024-08-18T22:05:21.863509+0000","last_became_peered":"2024-08-18T22:05:21.863509+0000","last_unstale":"2024-08-18T22:06:10.509215+0000","last_undegraded":"2024-08-18T22:06:10.509215+0000","last_fullsized":"2024-08-18T22:06:10.509215+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:42.879243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506010+0000","last_change":"2024-08-18T22:05:19.846514+0000","last_active":"2024-08-18T22:06:10.506010+0000","last_peered":"2024-08-18T22:06:10.506010+0000","last_clean":"2024-08-18T22:06:10.506010+0000","last_became_active":"2024-08-18T22:05:19.846190+0000","last_became_peered":"2024-08-18T22:05:19.846190+0000","last_unstale":"2024-08-18T22:06:10.506010+0000","last_undegraded":"2024-08-18T22:06:10.506010+0000","last_fullsized":"2024-08-18T22:06:10.506010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:49:00.317597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506329+0000","last_change":"2024-08-18T22:05:28.923183+0000","last_active":"2024-08-18T22:06:10.506329+0000","last_peered":"2024-08-18T22:06:10.506329+0000","last_clean":"2024-08-18T22:06:10.506329+0000","last_became_active":"2024-08-18T22:05:28.922809+0000","last_became_peered":"2024-08-18T22:05:28.922809+0000","last_unstale":"2024-08-18T22:06:10.506329+0000","last_undegraded":"2024-08-18T22:06:10.506329+0000","last_fullsized":"2024-08-18T22:06:10.506329+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:26.416920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510283+0000","last_change":"2024-08-18T22:05:21.849075+0000","last_active":"2024-08-18T22:06:10.510283+0000","last_peered":"2024-08-18T22:06:10.510283+0000","last_clean":"2024-08-18T22:06:10.510283+0000","last_became_active":"2024-08-18T22:05:21.848759+0000","last_became_peered":"2024-08-18T22:05:21.848759+0000","last_unstale":"2024-08-18T22:06:10.510283+0000","last_undegraded":"2024-08-18T22:06:10.510283+0000","last_fullsized":"2024-08-18T22:06:10.510283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:26.531534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515145+0000","last_change":"2024-08-18T22:05:19.849210+0000","last_active":"2024-08-18T22:06:10.515145+0000","last_peered":"2024-08-18T22:06:10.515145+0000","last_clean":"2024-08-18T22:06:10.515145+0000","last_became_active":"2024-08-18T22:05:19.848829+0000","last_became_peered":"2024-08-18T22:05:19.848829+0000","last_unstale":"2024-08-18T22:06:10.515145+0000","last_undegraded":"2024-08-18T22:06:10.515145+0000","last_fullsized":"2024-08-18T22:06:10.515145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:19.321686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506551+0000","last_change":"2024-08-18T22:05:28.924577+0000","last_active":"2024-08-18T22:06:10.506551+0000","last_peered":"2024-08-18T22:06:10.506551+0000","last_clean":"2024-08-18T22:06:10.506551+0000","last_became_active":"2024-08-18T22:05:28.924183+0000","last_became_peered":"2024-08-18T22:05:28.924183+0000","last_unstale":"2024-08-18T22:06:10.506551+0000","last_undegraded":"2024-08-18T22:06:10.506551+0000","last_fullsized":"2024-08-18T22:06:10.506551+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:22.702757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513994+0000","last_change":"2024-08-18T22:06:10.513610+0000","last_active":"2024-08-18T22:06:10.513994+0000","last_peered":"2024-08-18T22:06:10.513994+0000","last_clean":"2024-08-18T22:06:10.513994+0000","last_became_active":"2024-08-18T22:06:10.513400+0000","last_became_peered":"2024-08-18T22:06:10.513400+0000","last_unstale":"2024-08-18T22:06:10.513994+0000","last_undegraded":"2024-08-18T22:06:10.513994+0000","last_fullsized":"2024-08-18T22:06:10.513994+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:49.275223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513546+0000","last_change":"2024-08-18T22:05:20.291752+0000","last_active":"2024-08-18T22:06:10.513546+0000","last_peered":"2024-08-18T22:06:10.513546+0000","last_clean":"2024-08-18T22:06:10.513546+0000","last_became_active":"2024-08-18T22:05:20.291431+0000","last_became_peered":"2024-08-18T22:05:20.291431+0000","last_unstale":"2024-08-18T22:06:10.513546+0000","last_undegraded":"2024-08-18T22:06:10.513546+0000","last_fullsized":"2024-08-18T22:06:10.513546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:32.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506003+0000","last_change":"2024-08-18T22:05:28.924121+0000","last_active":"2024-08-18T22:06:10.506003+0000","last_peered":"2024-08-18T22:06:10.506003+0000","last_clean":"2024-08-18T22:06:10.506003+0000","last_became_active":"2024-08-18T22:05:28.923753+0000","last_became_peered":"2024-08-18T22:05:28.923753+0000","last_unstale":"2024-08-18T22:06:10.506003+0000","last_undegraded":"2024-08-18T22:06:10.506003+0000","last_fullsized":"2024-08-18T22:06:10.506003+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:57.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507828+0000","last_change":"2024-08-18T22:05:21.858366+0000","last_active":"2024-08-18T22:06:10.507828+0000","last_peered":"2024-08-18T22:06:10.507828+0000","last_clean":"2024-08-18T22:06:10.507828+0000","last_became_active":"2024-08-18T22:05:21.858021+0000","last_became_peered":"2024-08-18T22:05:21.858021+0000","last_unstale":"2024-08-18T22:06:10.507828+0000","last_undegraded":"2024-08-18T22:06:10.507828+0000","last_fullsized":"2024-08-18T22:06:10.507828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:55.662965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'4","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:12.481139+0000","last_change":"2024-08-18T22:05:19.850013+0000","last_active":"2024-08-18T22:06:12.481139+0000","last_peered":"2024-08-18T22:06:12.481139+0000","last_clean":"2024-08-18T22:06:12.481139+0000","last_became_active":"2024-08-18T22:05:19.849551+0000","last_became_peered":"2024-08-18T22:05:19.849551+0000","last_unstale":"2024-08-18T22:06:12.481139+0000","last_undegraded":"2024-08-18T22:06:12.481139+0000","last_fullsized":"2024-08-18T22:06:12.481139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:15.182999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509627+0000","last_change":"2024-08-18T22:05:28.927318+0000","last_active":"2024-08-18T22:06:10.509627+0000","last_peered":"2024-08-18T22:06:10.509627+0000","last_clean":"2024-08-18T22:06:10.509627+0000","last_became_active":"2024-08-18T22:05:28.926786+0000","last_became_peered":"2024-08-18T22:05:28.926786+0000","last_unstale":"2024-08-18T22:06:10.509627+0000","last_undegraded":"2024-08-18T22:06:10.509627+0000","last_fullsized":"2024-08-18T22:06:10.509627+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:45.798247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511821+0000","last_change":"2024-08-18T22:06:10.511821+0000","last_active":"2024-08-18T22:06:10.511821+0000","last_peered":"2024-08-18T22:06:10.511821+0000","last_clean":"2024-08-18T22:06:10.511821+0000","last_became_active":"2024-08-18T22:06:10.511135+0000","last_became_peered":"2024-08-18T22:06:10.511135+0000","last_unstale":"2024-08-18T22:06:10.511821+0000","last_undegraded":"2024-08-18T22:06:10.511821+0000","last_fullsized":"2024-08-18T22:06:10.511821+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:07.108531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506959+0000","last_change":"2024-08-18T22:05:19.844061+0000","last_active":"2024-08-18T22:06:10.506959+0000","last_peered":"2024-08-18T22:06:10.506959+0000","last_clean":"2024-08-18T22:06:10.506959+0000","last_became_active":"2024-08-18T22:05:19.843513+0000","last_became_peered":"2024-08-18T22:05:19.843513+0000","last_unstale":"2024-08-18T22:06:10.506959+0000","last_undegraded":"2024-08-18T22:06:10.506959+0000","last_fullsized":"2024-08-18T22:06:10.506959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:53.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510069+0000","last_change":"2024-08-18T22:05:28.922986+0000","last_active":"2024-08-18T22:06:10.510069+0000","last_peered":"2024-08-18T22:06:10.510069+0000","last_clean":"2024-08-18T22:06:10.510069+0000","last_became_active":"2024-08-18T22:05:28.922322+0000","last_became_peered":"2024-08-18T22:05:28.922322+0000","last_unstale":"2024-08-18T22:06:10.510069+0000","last_undegraded":"2024-08-18T22:06:10.510069+0000","last_fullsized":"2024-08-18T22:06:10.510069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:28.168299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505649+0000","last_change":"2024-08-18T22:05:21.853389+0000","last_active":"2024-08-18T22:06:10.505649+0000","last_peered":"2024-08-18T22:06:10.505649+0000","last_clean":"2024-08-18T22:06:10.505649+0000","last_became_active":"2024-08-18T22:05:21.853095+0000","last_became_peered":"2024-08-18T22:05:21.853095+0000","last_unstale":"2024-08-18T22:06:10.505649+0000","last_undegraded":"2024-08-18T22:06:10.505649+0000","last_fullsized":"2024-08-18T22:06:10.505649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:14.126983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508891+0000","last_change":"2024-08-18T22:05:19.846788+0000","last_active":"2024-08-18T22:06:10.508891+0000","last_peered":"2024-08-18T22:06:10.508891+0000","last_clean":"2024-08-18T22:06:10.508891+0000","last_became_active":"2024-08-18T22:05:19.846248+0000","last_became_peered":"2024-08-18T22:05:19.846248+0000","last_unstale":"2024-08-18T22:06:10.508891+0000","last_undegraded":"2024-08-18T22:06:10.508891+0000","last_fullsized":"2024-08-18T22:06:10.508891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:46.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507672+0000","last_change":"2024-08-18T22:05:28.920294+0000","last_active":"2024-08-18T22:06:10.507672+0000","last_peered":"2024-08-18T22:06:10.507672+0000","last_clean":"2024-08-18T22:06:10.507672+0000","last_became_active":"2024-08-18T22:05:28.919351+0000","last_became_peered":"2024-08-18T22:05:28.919351+0000","last_unstale":"2024-08-18T22:06:10.507672+0000","last_undegraded":"2024-08-18T22:06:10.507672+0000","last_fullsized":"2024-08-18T22:06:10.507672+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:49.425281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514189+0000","last_change":"2024-08-18T22:05:21.864529+0000","last_active":"2024-08-18T22:06:10.514189+0000","last_peered":"2024-08-18T22:06:10.514189+0000","last_clean":"2024-08-18T22:06:10.514189+0000","last_became_active":"2024-08-18T22:05:21.864062+0000","last_became_peered":"2024-08-18T22:05:21.864062+0000","last_unstale":"2024-08-18T22:06:10.514189+0000","last_undegraded":"2024-08-18T22:06:10.514189+0000","last_fullsized":"2024-08-18T22:06:10.514189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:24:49.037343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'29","reported_seq":120,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:13.522639+0000","last_change":"2024-08-18T22:06:10.522113+0000","last_active":"2024-08-18T22:06:13.522639+0000","last_peered":"2024-08-18T22:06:13.522639+0000","last_clean":"2024-08-18T22:06:13.522639+0000","last_became_active":"2024-08-18T22:06:10.514837+0000","last_became_peered":"2024-08-18T22:06:10.514837+0000","last_unstale":"2024-08-18T22:06:13.522639+0000","last_undegraded":"2024-08-18T22:06:13.522639+0000","last_fullsized":"2024-08-18T22:06:13.522639+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:46.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57252,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":67,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508344+0000","last_change":"2024-08-18T22:05:28.926357+0000","last_active":"2024-08-18T22:06:10.508344+0000","last_peered":"2024-08-18T22:06:10.508344+0000","last_clean":"2024-08-18T22:06:10.508344+0000","last_became_active":"2024-08-18T22:05:28.926016+0000","last_became_peered":"2024-08-18T22:05:28.926016+0000","last_unstale":"2024-08-18T22:06:10.508344+0000","last_undegraded":"2024-08-18T22:06:10.508344+0000","last_fullsized":"2024-08-18T22:06:10.508344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:16.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506937+0000","last_change":"2024-08-18T22:05:21.860237+0000","last_active":"2024-08-18T22:06:10.506937+0000","last_peered":"2024-08-18T22:06:10.506937+0000","last_clean":"2024-08-18T22:06:10.506937+0000","last_became_active":"2024-08-18T22:05:21.859919+0000","last_became_peered":"2024-08-18T22:05:21.859919+0000","last_unstale":"2024-08-18T22:06:10.506937+0000","last_undegraded":"2024-08-18T22:06:10.506937+0000","last_fullsized":"2024-08-18T22:06:10.506937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:21.048413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507852+0000","last_change":"2024-08-18T22:05:20.291233+0000","last_active":"2024-08-18T22:06:10.507852+0000","last_peered":"2024-08-18T22:06:10.507852+0000","last_clean":"2024-08-18T22:06:10.507852+0000","last_became_active":"2024-08-18T22:05:20.290893+0000","last_became_peered":"2024-08-18T22:05:20.290893+0000","last_unstale":"2024-08-18T22:06:10.507852+0000","last_undegraded":"2024-08-18T22:06:10.507852+0000","last_fullsized":"2024-08-18T22:06:10.507852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:36.889561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510634+0000","last_change":"2024-08-18T22:05:28.923076+0000","last_active":"2024-08-18T22:06:10.510634+0000","last_peered":"2024-08-18T22:06:10.510634+0000","last_clean":"2024-08-18T22:06:10.510634+0000","last_became_active":"2024-08-18T22:05:28.922688+0000","last_became_peered":"2024-08-18T22:05:28.922688+0000","last_unstale":"2024-08-18T22:06:10.510634+0000","last_undegraded":"2024-08-18T22:06:10.510634+0000","last_fullsized":"2024-08-18T22:06:10.510634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:34.360540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509085+0000","last_change":"2024-08-18T22:05:21.855174+0000","last_active":"2024-08-18T22:06:10.509085+0000","last_peered":"2024-08-18T22:06:10.509085+0000","last_clean":"2024-08-18T22:06:10.509085+0000","last_became_active":"2024-08-18T22:05:21.854818+0000","last_became_peered":"2024-08-18T22:05:21.854818+0000","last_unstale":"2024-08-18T22:06:10.509085+0000","last_undegraded":"2024-08-18T22:06:10.509085+0000","last_fullsized":"2024-08-18T22:06:10.509085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:48:55.094624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508468+0000","last_change":"2024-08-18T22:05:19.847876+0000","last_active":"2024-08-18T22:06:10.508468+0000","last_peered":"2024-08-18T22:06:10.508468+0000","last_clean":"2024-08-18T22:06:10.508468+0000","last_became_active":"2024-08-18T22:05:19.847505+0000","last_became_peered":"2024-08-18T22:05:19.847505+0000","last_unstale":"2024-08-18T22:06:10.508468+0000","last_undegraded":"2024-08-18T22:06:10.508468+0000","last_fullsized":"2024-08-18T22:06:10.508468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:50:15.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508005+0000","last_change":"2024-08-18T22:05:28.921647+0000","last_active":"2024-08-18T22:06:10.508005+0000","last_peered":"2024-08-18T22:06:10.508005+0000","last_clean":"2024-08-18T22:06:10.508005+0000","last_became_active":"2024-08-18T22:05:28.921305+0000","last_became_peered":"2024-08-18T22:05:28.921305+0000","last_unstale":"2024-08-18T22:06:10.508005+0000","last_undegraded":"2024-08-18T22:06:10.508005+0000","last_fullsized":"2024-08-18T22:06:10.508005+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:29.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506841+0000","last_change":"2024-08-18T22:05:21.861151+0000","last_active":"2024-08-18T22:06:10.506841+0000","last_peered":"2024-08-18T22:06:10.506841+0000","last_clean":"2024-08-18T22:06:10.506841+0000","last_became_active":"2024-08-18T22:05:21.860834+0000","last_became_peered":"2024-08-18T22:05:21.860834+0000","last_unstale":"2024-08-18T22:06:10.506841+0000","last_undegraded":"2024-08-18T22:06:10.506841+0000","last_fullsized":"2024-08-18T22:06:10.506841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:32.890750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:12.481238+0000","last_change":"2024-08-18T22:05:19.846145+0000","last_active":"2024-08-18T22:06:12.481238+0000","last_peered":"2024-08-18T22:06:12.481238+0000","last_clean":"2024-08-18T22:06:12.481238+0000","last_became_active":"2024-08-18T22:05:19.845711+0000","last_became_peered":"2024-08-18T22:05:19.845711+0000","last_unstale":"2024-08-18T22:06:12.481238+0000","last_undegraded":"2024-08-18T22:06:12.481238+0000","last_fullsized":"2024-08-18T22:06:12.481238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:20.376131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771915+0000","last_change":"2024-08-18T22:05:28.923256+0000","last_active":"2024-08-18T22:06:10.771915+0000","last_peered":"2024-08-18T22:06:10.771915+0000","last_clean":"2024-08-18T22:06:10.771915+0000","last_became_active":"2024-08-18T22:05:28.922845+0000","last_became_peered":"2024-08-18T22:05:28.922845+0000","last_unstale":"2024-08-18T22:06:10.771915+0000","last_undegraded":"2024-08-18T22:06:10.771915+0000","last_fullsized":"2024-08-18T22:06:10.771915+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:41.930937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508677+0000","last_change":"2024-08-18T22:05:28.924743+0000","last_active":"2024-08-18T22:06:10.508677+0000","last_peered":"2024-08-18T22:06:10.508677+0000","last_clean":"2024-08-18T22:06:10.508677+0000","last_became_active":"2024-08-18T22:05:28.923674+0000","last_became_peered":"2024-08-18T22:05:28.923674+0000","last_unstale":"2024-08-18T22:06:10.508677+0000","last_undegraded":"2024-08-18T22:06:10.508677+0000","last_fullsized":"2024-08-18T22:06:10.508677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:19.834998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508496+0000","last_change":"2024-08-18T22:05:21.857194+0000","last_active":"2024-08-18T22:06:10.508496+0000","last_peered":"2024-08-18T22:06:10.508496+0000","last_clean":"2024-08-18T22:06:10.508496+0000","last_became_active":"2024-08-18T22:05:21.856916+0000","last_became_peered":"2024-08-18T22:05:21.856916+0000","last_unstale":"2024-08-18T22:06:10.508496+0000","last_undegraded":"2024-08-18T22:06:10.508496+0000","last_fullsized":"2024-08-18T22:06:10.508496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:24.759501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506570+0000","last_change":"2024-08-18T22:05:19.844919+0000","last_active":"2024-08-18T22:06:10.506570+0000","last_peered":"2024-08-18T22:06:10.506570+0000","last_clean":"2024-08-18T22:06:10.506570+0000","last_became_active":"2024-08-18T22:05:19.844539+0000","last_became_peered":"2024-08-18T22:05:19.844539+0000","last_unstale":"2024-08-18T22:06:10.506570+0000","last_undegraded":"2024-08-18T22:06:10.506570+0000","last_fullsized":"2024-08-18T22:06:10.506570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:01.598535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510256+0000","last_change":"2024-08-18T22:05:28.923304+0000","last_active":"2024-08-18T22:06:10.510256+0000","last_peered":"2024-08-18T22:06:10.510256+0000","last_clean":"2024-08-18T22:06:10.510256+0000","last_became_active":"2024-08-18T22:05:28.922912+0000","last_became_peered":"2024-08-18T22:05:28.922912+0000","last_unstale":"2024-08-18T22:06:10.510256+0000","last_undegraded":"2024-08-18T22:06:10.510256+0000","last_fullsized":"2024-08-18T22:06:10.510256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:24:47.834354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771950+0000","last_change":"2024-08-18T22:05:21.849448+0000","last_active":"2024-08-18T22:06:10.771950+0000","last_peered":"2024-08-18T22:06:10.771950+0000","last_clean":"2024-08-18T22:06:10.771950+0000","last_became_active":"2024-08-18T22:05:21.849154+0000","last_became_peered":"2024-08-18T22:05:21.849154+0000","last_unstale":"2024-08-18T22:06:10.771950+0000","last_undegraded":"2024-08-18T22:06:10.771950+0000","last_fullsized":"2024-08-18T22:06:10.771950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:38.583121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505540+0000","last_change":"2024-08-18T22:05:19.848483+0000","last_active":"2024-08-18T22:06:10.505540+0000","last_peered":"2024-08-18T22:06:10.505540+0000","last_clean":"2024-08-18T22:06:10.505540+0000","last_became_active":"2024-08-18T22:05:19.848190+0000","last_became_peered":"2024-08-18T22:05:19.848190+0000","last_unstale":"2024-08-18T22:06:10.505540+0000","last_undegraded":"2024-08-18T22:06:10.505540+0000","last_fullsized":"2024-08-18T22:06:10.505540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:01.719565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509148+0000","last_change":"2024-08-18T22:05:19.843796+0000","last_active":"2024-08-18T22:06:10.509148+0000","last_peered":"2024-08-18T22:06:10.509148+0000","last_clean":"2024-08-18T22:06:10.509148+0000","last_became_active":"2024-08-18T22:05:19.843495+0000","last_became_peered":"2024-08-18T22:05:19.843495+0000","last_unstale":"2024-08-18T22:06:10.509148+0000","last_undegraded":"2024-08-18T22:06:10.509148+0000","last_fullsized":"2024-08-18T22:06:10.509148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:21.583561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507269+0000","last_change":"2024-08-18T22:05:21.856370+0000","last_active":"2024-08-18T22:06:10.507269+0000","last_peered":"2024-08-18T22:06:10.507269+0000","last_clean":"2024-08-18T22:06:10.507269+0000","last_became_active":"2024-08-18T22:05:21.855954+0000","last_became_peered":"2024-08-18T22:05:21.855954+0000","last_unstale":"2024-08-18T22:06:10.507269+0000","last_undegraded":"2024-08-18T22:06:10.507269+0000","last_fullsized":"2024-08-18T22:06:10.507269+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:30.828305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.516344+0000","last_change":"2024-08-18T22:06:10.516344+0000","last_active":"2024-08-18T22:06:10.516344+0000","last_peered":"2024-08-18T22:06:10.516344+0000","last_clean":"2024-08-18T22:06:10.516344+0000","last_became_active":"2024-08-18T22:06:10.515925+0000","last_became_peered":"2024-08-18T22:06:10.515925+0000","last_unstale":"2024-08-18T22:06:10.516344+0000","last_undegraded":"2024-08-18T22:06:10.516344+0000","last_fullsized":"2024-08-18T22:06:10.516344+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:41:07.585521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:13.483157+0000","last_change":"2024-08-18T22:05:19.846860+0000","last_active":"2024-08-18T22:06:13.483157+0000","last_peered":"2024-08-18T22:06:13.483157+0000","last_clean":"2024-08-18T22:06:13.483157+0000","last_became_active":"2024-08-18T22:05:19.846496+0000","last_became_peered":"2024-08-18T22:05:19.846496+0000","last_unstale":"2024-08-18T22:06:13.483157+0000","last_undegraded":"2024-08-18T22:06:13.483157+0000","last_fullsized":"2024-08-18T22:06:13.483157+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:16.555137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513529+0000","last_change":"2024-08-18T22:05:21.849058+0000","last_active":"2024-08-18T22:06:10.513529+0000","last_peered":"2024-08-18T22:06:10.513529+0000","last_clean":"2024-08-18T22:06:10.513529+0000","last_became_active":"2024-08-18T22:05:21.848703+0000","last_became_peered":"2024-08-18T22:05:21.848703+0000","last_unstale":"2024-08-18T22:06:10.513529+0000","last_undegraded":"2024-08-18T22:06:10.513529+0000","last_fullsized":"2024-08-18T22:06:10.513529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:10.024156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508916+0000","last_change":"2024-08-18T22:05:28.922968+0000","last_active":"2024-08-18T22:06:10.508916+0000","last_peered":"2024-08-18T22:06:10.508916+0000","last_clean":"2024-08-18T22:06:10.508916+0000","last_became_active":"2024-08-18T22:05:28.922378+0000","last_became_peered":"2024-08-18T22:05:28.922378+0000","last_unstale":"2024-08-18T22:06:10.508916+0000","last_undegraded":"2024-08-18T22:06:10.508916+0000","last_fullsized":"2024-08-18T22:06:10.508916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:23:07.241028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509985+0000","last_change":"2024-08-18T22:05:21.858572+0000","last_active":"2024-08-18T22:06:10.509985+0000","last_peered":"2024-08-18T22:06:10.509985+0000","last_clean":"2024-08-18T22:06:10.509985+0000","last_became_active":"2024-08-18T22:05:21.858254+0000","last_became_peered":"2024-08-18T22:05:21.858254+0000","last_unstale":"2024-08-18T22:06:10.509985+0000","last_undegraded":"2024-08-18T22:06:10.509985+0000","last_fullsized":"2024-08-18T22:06:10.509985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:52.456087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509101+0000","last_change":"2024-08-18T22:05:21.856710+0000","last_active":"2024-08-18T22:06:10.509101+0000","last_peered":"2024-08-18T22:06:10.509101+0000","last_clean":"2024-08-18T22:06:10.509101+0000","last_became_active":"2024-08-18T22:05:21.855399+0000","last_became_peered":"2024-08-18T22:05:21.855399+0000","last_unstale":"2024-08-18T22:06:10.509101+0000","last_undegraded":"2024-08-18T22:06:10.509101+0000","last_fullsized":"2024-08-18T22:06:10.509101+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:36.039953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507843+0000","last_change":"2024-08-18T22:05:21.856085+0000","last_active":"2024-08-18T22:06:10.507843+0000","last_peered":"2024-08-18T22:06:10.507843+0000","last_clean":"2024-08-18T22:06:10.507843+0000","last_became_active":"2024-08-18T22:05:21.855263+0000","last_became_peered":"2024-08-18T22:05:21.855263+0000","last_unstale":"2024-08-18T22:06:10.507843+0000","last_undegraded":"2024-08-18T22:06:10.507843+0000","last_fullsized":"2024-08-18T22:06:10.507843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:31.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509110+0000","last_change":"2024-08-18T22:05:21.855385+0000","last_active":"2024-08-18T22:06:10.509110+0000","last_peered":"2024-08-18T22:06:10.509110+0000","last_clean":"2024-08-18T22:06:10.509110+0000","last_became_active":"2024-08-18T22:05:21.854829+0000","last_became_peered":"2024-08-18T22:05:21.854829+0000","last_unstale":"2024-08-18T22:06:10.509110+0000","last_undegraded":"2024-08-18T22:06:10.509110+0000","last_fullsized":"2024-08-18T22:06:10.509110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:59.704154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510370+0000","last_change":"2024-08-18T22:06:10.510370+0000","last_active":"2024-08-18T22:06:10.510370+0000","last_peered":"2024-08-18T22:06:10.510370+0000","last_clean":"2024-08-18T22:06:10.510370+0000","last_became_active":"2024-08-18T22:06:10.509829+0000","last_became_peered":"2024-08-18T22:06:10.509829+0000","last_unstale":"2024-08-18T22:06:10.510370+0000","last_undegraded":"2024-08-18T22:06:10.510370+0000","last_fullsized":"2024-08-18T22:06:10.510370+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:20.171834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510420+0000","last_change":"2024-08-18T22:05:21.856137+0000","last_active":"2024-08-18T22:06:10.510420+0000","last_peered":"2024-08-18T22:06:10.510420+0000","last_clean":"2024-08-18T22:06:10.510420+0000","last_became_active":"2024-08-18T22:05:21.855425+0000","last_became_peered":"2024-08-18T22:05:21.855425+0000","last_unstale":"2024-08-18T22:06:10.510420+0000","last_undegraded":"2024-08-18T22:06:10.510420+0000","last_fullsized":"2024-08-18T22:06:10.510420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:37.514710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509024+0000","last_change":"2024-08-18T22:05:21.856084+0000","last_active":"2024-08-18T22:06:10.509024+0000","last_peered":"2024-08-18T22:06:10.509024+0000","last_clean":"2024-08-18T22:06:10.509024+0000","last_became_active":"2024-08-18T22:05:21.855779+0000","last_became_peered":"2024-08-18T22:05:21.855779+0000","last_unstale":"2024-08-18T22:06:10.509024+0000","last_undegraded":"2024-08-18T22:06:10.509024+0000","last_fullsized":"2024-08-18T22:06:10.509024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:02:47.833634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772328+0000","last_change":"2024-08-18T22:05:21.856729+0000","last_active":"2024-08-18T22:06:10.772328+0000","last_peered":"2024-08-18T22:06:10.772328+0000","last_clean":"2024-08-18T22:06:10.772328+0000","last_became_active":"2024-08-18T22:05:21.856446+0000","last_became_peered":"2024-08-18T22:05:21.856446+0000","last_unstale":"2024-08-18T22:06:10.772328+0000","last_undegraded":"2024-08-18T22:06:10.772328+0000","last_fullsized":"2024-08-18T22:06:10.772328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.482225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506405+0000","last_change":"2024-08-18T22:05:21.851772+0000","last_active":"2024-08-18T22:06:10.506405+0000","last_peered":"2024-08-18T22:06:10.506405+0000","last_clean":"2024-08-18T22:06:10.506405+0000","last_became_active":"2024-08-18T22:05:21.851417+0000","last_became_peered":"2024-08-18T22:05:21.851417+0000","last_unstale":"2024-08-18T22:06:10.506405+0000","last_undegraded":"2024-08-18T22:06:10.506405+0000","last_fullsized":"2024-08-18T22:06:10.506405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:32.509318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771984+0000","last_change":"2024-08-18T22:05:21.857887+0000","last_active":"2024-08-18T22:06:10.771984+0000","last_peered":"2024-08-18T22:06:10.771984+0000","last_clean":"2024-08-18T22:06:10.771984+0000","last_became_active":"2024-08-18T22:05:21.857585+0000","last_became_peered":"2024-08-18T22:05:21.857585+0000","last_unstale":"2024-08-18T22:06:10.771984+0000","last_undegraded":"2024-08-18T22:06:10.771984+0000","last_fullsized":"2024-08-18T22:06:10.771984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:23.299033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506488+0000","last_change":"2024-08-18T22:05:21.854626+0000","last_active":"2024-08-18T22:06:10.506488+0000","last_peered":"2024-08-18T22:06:10.506488+0000","last_clean":"2024-08-18T22:06:10.506488+0000","last_became_active":"2024-08-18T22:05:21.854290+0000","last_became_peered":"2024-08-18T22:05:21.854290+0000","last_unstale":"2024-08-18T22:06:10.506488+0000","last_undegraded":"2024-08-18T22:06:10.506488+0000","last_fullsized":"2024-08-18T22:06:10.506488+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:45:24.988669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505825+0000","last_change":"2024-08-18T22:05:21.865863+0000","last_active":"2024-08-18T22:06:10.505825+0000","last_peered":"2024-08-18T22:06:10.505825+0000","last_clean":"2024-08-18T22:06:10.505825+0000","last_became_active":"2024-08-18T22:05:21.864634+0000","last_became_peered":"2024-08-18T22:05:21.864634+0000","last_unstale":"2024-08-18T22:06:10.505825+0000","last_undegraded":"2024-08-18T22:06:10.505825+0000","last_fullsized":"2024-08-18T22:06:10.505825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:34.051147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510087+0000","last_change":"2024-08-18T22:05:21.860193+0000","last_active":"2024-08-18T22:06:10.510087+0000","last_peered":"2024-08-18T22:06:10.510087+0000","last_clean":"2024-08-18T22:06:10.510087+0000","last_became_active":"2024-08-18T22:05:21.859761+0000","last_became_peered":"2024-08-18T22:05:21.859761+0000","last_unstale":"2024-08-18T22:06:10.510087+0000","last_undegraded":"2024-08-18T22:06:10.510087+0000","last_fullsized":"2024-08-18T22:06:10.510087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:18.465913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509086+0000","last_change":"2024-08-18T22:05:21.860569+0000","last_active":"2024-08-18T22:06:10.509086+0000","last_peered":"2024-08-18T22:06:10.509086+0000","last_clean":"2024-08-18T22:06:10.509086+0000","last_became_active":"2024-08-18T22:05:21.860250+0000","last_became_peered":"2024-08-18T22:05:21.860250+0000","last_unstale":"2024-08-18T22:06:10.509086+0000","last_undegraded":"2024-08-18T22:06:10.509086+0000","last_fullsized":"2024-08-18T22:06:10.509086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:52.097840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509523+0000","last_change":"2024-08-18T22:05:21.858271+0000","last_active":"2024-08-18T22:06:10.509523+0000","last_peered":"2024-08-18T22:06:10.509523+0000","last_clean":"2024-08-18T22:06:10.509523+0000","last_became_active":"2024-08-18T22:05:21.857968+0000","last_became_peered":"2024-08-18T22:05:21.857968+0000","last_unstale":"2024-08-18T22:06:10.509523+0000","last_undegraded":"2024-08-18T22:06:10.509523+0000","last_fullsized":"2024-08-18T22:06:10.509523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:24.023136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510630+0000","last_change":"2024-08-18T22:05:21.853799+0000","last_active":"2024-08-18T22:06:10.510630+0000","last_peered":"2024-08-18T22:06:10.510630+0000","last_clean":"2024-08-18T22:06:10.510630+0000","last_became_active":"2024-08-18T22:05:21.853432+0000","last_became_peered":"2024-08-18T22:05:21.853432+0000","last_unstale":"2024-08-18T22:06:10.510630+0000","last_undegraded":"2024-08-18T22:06:10.510630+0000","last_fullsized":"2024-08-18T22:06:10.510630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:07.429169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506002+0000","last_change":"2024-08-18T22:05:21.855117+0000","last_active":"2024-08-18T22:06:10.506002+0000","last_peered":"2024-08-18T22:06:10.506002+0000","last_clean":"2024-08-18T22:06:10.506002+0000","last_became_active":"2024-08-18T22:05:21.854041+0000","last_became_peered":"2024-08-18T22:05:21.854041+0000","last_unstale":"2024-08-18T22:06:10.506002+0000","last_undegraded":"2024-08-18T22:06:10.506002+0000","last_fullsized":"2024-08-18T22:06:10.506002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:17.222658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508062+0000","last_change":"2024-08-18T22:05:21.861745+0000","last_active":"2024-08-18T22:06:10.508062+0000","last_peered":"2024-08-18T22:06:10.508062+0000","last_clean":"2024-08-18T22:06:10.508062+0000","last_became_active":"2024-08-18T22:05:21.861427+0000","last_became_peered":"2024-08-18T22:05:21.861427+0000","last_unstale":"2024-08-18T22:06:10.508062+0000","last_undegraded":"2024-08-18T22:06:10.508062+0000","last_fullsized":"2024-08-18T22:06:10.508062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:17.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508302+0000","last_change":"2024-08-18T22:05:21.860046+0000","last_active":"2024-08-18T22:06:10.508302+0000","last_peered":"2024-08-18T22:06:10.508302+0000","last_clean":"2024-08-18T22:06:10.508302+0000","last_became_active":"2024-08-18T22:05:21.859674+0000","last_became_peered":"2024-08-18T22:05:21.859674+0000","last_unstale":"2024-08-18T22:06:10.508302+0000","last_undegraded":"2024-08-18T22:06:10.508302+0000","last_fullsized":"2024-08-18T22:06:10.508302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:44.615270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505796+0000","last_change":"2024-08-18T22:05:21.847647+0000","last_active":"2024-08-18T22:06:10.505796+0000","last_peered":"2024-08-18T22:06:10.505796+0000","last_clean":"2024-08-18T22:06:10.505796+0000","last_became_active":"2024-08-18T22:05:21.847367+0000","last_became_peered":"2024-08-18T22:05:21.847367+0000","last_unstale":"2024-08-18T22:06:10.505796+0000","last_undegraded":"2024-08-18T22:06:10.505796+0000","last_fullsized":"2024-08-18T22:06:10.505796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:33.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.512325+0000","last_change":"2024-08-18T22:05:21.861326+0000","last_active":"2024-08-18T22:06:10.512325+0000","last_peered":"2024-08-18T22:06:10.512325+0000","last_clean":"2024-08-18T22:06:10.512325+0000","last_became_active":"2024-08-18T22:05:21.860968+0000","last_became_peered":"2024-08-18T22:05:21.860968+0000","last_unstale":"2024-08-18T22:06:10.512325+0000","last_undegraded":"2024-08-18T22:06:10.512325+0000","last_fullsized":"2024-08-18T22:06:10.512325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:49.150670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508590+0000","last_change":"2024-08-18T22:05:21.852618+0000","last_active":"2024-08-18T22:06:10.508590+0000","last_peered":"2024-08-18T22:06:10.508590+0000","last_clean":"2024-08-18T22:06:10.508590+0000","last_became_active":"2024-08-18T22:05:21.852318+0000","last_became_peered":"2024-08-18T22:05:21.852318+0000","last_unstale":"2024-08-18T22:06:10.508590+0000","last_undegraded":"2024-08-18T22:06:10.508590+0000","last_fullsized":"2024-08-18T22:06:10.508590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:06:49.085150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509956+0000","last_change":"2024-08-18T22:05:21.860108+0000","last_active":"2024-08-18T22:06:10.509956+0000","last_peered":"2024-08-18T22:06:10.509956+0000","last_clean":"2024-08-18T22:06:10.509956+0000","last_became_active":"2024-08-18T22:05:21.859794+0000","last_became_peered":"2024-08-18T22:05:21.859794+0000","last_unstale":"2024-08-18T22:06:10.509956+0000","last_undegraded":"2024-08-18T22:06:10.509956+0000","last_fullsized":"2024-08-18T22:06:10.509956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:01.974202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507181+0000","last_change":"2024-08-18T22:05:21.856404+0000","last_active":"2024-08-18T22:06:10.507181+0000","last_peered":"2024-08-18T22:06:10.507181+0000","last_clean":"2024-08-18T22:06:10.507181+0000","last_became_active":"2024-08-18T22:05:21.855800+0000","last_became_peered":"2024-08-18T22:05:21.855800+0000","last_unstale":"2024-08-18T22:06:10.507181+0000","last_undegraded":"2024-08-18T22:06:10.507181+0000","last_fullsized":"2024-08-18T22:06:10.507181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:09.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771944+0000","last_change":"2024-08-18T22:05:21.859891+0000","last_active":"2024-08-18T22:06:10.771944+0000","last_peered":"2024-08-18T22:06:10.771944+0000","last_clean":"2024-08-18T22:06:10.771944+0000","last_became_active":"2024-08-18T22:05:21.859407+0000","last_became_peered":"2024-08-18T22:05:21.859407+0000","last_unstale":"2024-08-18T22:06:10.771944+0000","last_undegraded":"2024-08-18T22:06:10.771944+0000","last_fullsized":"2024-08-18T22:06:10.771944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:59.285627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508099+0000","last_change":"2024-08-18T22:05:21.856428+0000","last_active":"2024-08-18T22:06:10.508099+0000","last_peered":"2024-08-18T22:06:10.508099+0000","last_clean":"2024-08-18T22:06:10.508099+0000","last_became_active":"2024-08-18T22:05:21.853374+0000","last_became_peered":"2024-08-18T22:05:21.853374+0000","last_unstale":"2024-08-18T22:06:10.508099+0000","last_undegraded":"2024-08-18T22:06:10.508099+0000","last_fullsized":"2024-08-18T22:06:10.508099+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:07.087171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509021+0000","last_change":"2024-08-18T22:05:21.852688+0000","last_active":"2024-08-18T22:06:10.509021+0000","last_peered":"2024-08-18T22:06:10.509021+0000","last_clean":"2024-08-18T22:06:10.509021+0000","last_became_active":"2024-08-18T22:05:21.851107+0000","last_became_peered":"2024-08-18T22:05:21.851107+0000","last_unstale":"2024-08-18T22:06:10.509021+0000","last_undegraded":"2024-08-18T22:06:10.509021+0000","last_fullsized":"2024-08-18T22:06:10.509021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:48.267166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513864+0000","last_change":"2024-08-18T22:05:21.850809+0000","last_active":"2024-08-18T22:06:10.513864+0000","last_peered":"2024-08-18T22:06:10.513864+0000","last_clean":"2024-08-18T22:06:10.513864+0000","last_became_active":"2024-08-18T22:05:21.850510+0000","last_became_peered":"2024-08-18T22:05:21.850510+0000","last_unstale":"2024-08-18T22:06:10.513864+0000","last_undegraded":"2024-08-18T22:06:10.513864+0000","last_fullsized":"2024-08-18T22:06:10.513864+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:39.338051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.512225+0000","last_change":"2024-08-18T22:05:21.856156+0000","last_active":"2024-08-18T22:06:10.512225+0000","last_peered":"2024-08-18T22:06:10.512225+0000","last_clean":"2024-08-18T22:06:10.512225+0000","last_became_active":"2024-08-18T22:05:21.855830+0000","last_became_peered":"2024-08-18T22:05:21.855830+0000","last_unstale":"2024-08-18T22:06:10.512225+0000","last_undegraded":"2024-08-18T22:06:10.512225+0000","last_fullsized":"2024-08-18T22:06:10.512225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:10.670405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508858+0000","last_change":"2024-08-18T22:05:21.865162+0000","last_active":"2024-08-18T22:06:10.508858+0000","last_peered":"2024-08-18T22:06:10.508858+0000","last_clean":"2024-08-18T22:06:10.508858+0000","last_became_active":"2024-08-18T22:05:21.864842+0000","last_became_peered":"2024-08-18T22:05:21.864842+0000","last_unstale":"2024-08-18T22:06:10.508858+0000","last_undegraded":"2024-08-18T22:06:10.508858+0000","last_fullsized":"2024-08-18T22:06:10.508858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:21.388638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508777+0000","last_change":"2024-08-18T22:05:21.859227+0000","last_active":"2024-08-18T22:06:10.508777+0000","last_peered":"2024-08-18T22:06:10.508777+0000","last_clean":"2024-08-18T22:06:10.508777+0000","last_became_active":"2024-08-18T22:05:21.858886+0000","last_became_peered":"2024-08-18T22:05:21.858886+0000","last_unstale":"2024-08-18T22:06:10.508777+0000","last_undegraded":"2024-08-18T22:06:10.508777+0000","last_fullsized":"2024-08-18T22:06:10.508777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:08.710772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510562+0000","last_change":"2024-08-18T22:05:21.854864+0000","last_active":"2024-08-18T22:06:10.510562+0000","last_peered":"2024-08-18T22:06:10.510562+0000","last_clean":"2024-08-18T22:06:10.510562+0000","last_became_active":"2024-08-18T22:05:21.854522+0000","last_became_peered":"2024-08-18T22:05:21.854522+0000","last_unstale":"2024-08-18T22:06:10.510562+0000","last_undegraded":"2024-08-18T22:06:10.510562+0000","last_fullsized":"2024-08-18T22:06:10.510562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:32.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61642,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":164,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":184926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514518,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":504444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743452,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32844,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712308,"statfs":{"total":95995035648,"available":95961403392,"internally_reserved":0,"allocated":1708032,"data_stored":1153450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906977,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":504680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168613,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1036288,"data_stored":504600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397545,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1100898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561070,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":499856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790002,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1638400,"data_stored":1096096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953527,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1093632,"data_stored":562148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1028096,"data_stored":500050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":501506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":557018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":501244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":58286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:06:18.284 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph status --format=json 2024-08-18T22:06:18.579 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:18.825 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:18 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:06:18.832 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:18 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:06:18.915 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:18 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:06:19.792 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:19 smithi123 ceph-mon[18462]: pgmap v295: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s; 4.9 KiB/s, 0 objects/s recovering 2024-08-18T22:06:19.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.782+0000 7f21988fe640 1 -- 172.21.15.123:0/931618445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2194102c20 msgr2=0x7f219410d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:19.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.782+0000 7f21988fe640 1 --2- 172.21.15.123:0/931618445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2194102c20 0x7f219410d770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2184009900 tx=0x7f218402a480 comp rx=0 tx=0).stop 2024-08-18T22:06:19.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.782+0000 7f21988fe640 1 -- 172.21.15.123:0/931618445 shutdown_connections 2024-08-18T22:06:19.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.782+0000 7f21988fe640 1 --2- 172.21.15.123:0/931618445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2194102c20 0x7f219410d770 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:19.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.782+0000 7f21988fe640 1 --2- 172.21.15.123:0/931618445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21941022a0 0x7f21941026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:19.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.782+0000 7f21988fe640 1 --2- 172.21.15.123:0/931618445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2194100b50 0x7f2194100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:19.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.782+0000 7f21988fe640 1 -- 172.21.15.123:0/931618445 >> 172.21.15.123:0/931618445 conn(0x7f21940fc500 msgr2=0x7f21940fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:19.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.782+0000 7f21988fe640 1 -- 172.21.15.123:0/931618445 shutdown_connections 2024-08-18T22:06:19.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.782+0000 7f21988fe640 1 -- 172.21.15.123:0/931618445 wait complete. 2024-08-18T22:06:19.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f21988fe640 1 Processor -- start 2024-08-18T22:06:19.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f21988fe640 1 -- start start 2024-08-18T22:06:19.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f21988fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2194100b50 0x7f2194198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:19.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f21988fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21941022a0 0x7f21941986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:19.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f21988fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2194102c20 0x7f219419ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:19.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f21988fe640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2194110cb0 con 0x7f21941022a0 2024-08-18T22:06:19.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f21988fe640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2194110b30 con 0x7f2194102c20 2024-08-18T22:06:19.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f21988fe640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2194110e30 con 0x7f2194100b50 2024-08-18T22:06:19.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f2191d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21941022a0 0x7f21941986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f2191d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21941022a0 0x7f21941986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48814/0 (socket says 172.21.15.123:48814) 2024-08-18T22:06:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f2191d9b640 1 -- 172.21.15.123:0/1009243825 learned_addr learned my addr 172.21.15.123:0/1009243825 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f219259c640 1 --2- 172.21.15.123:0/1009243825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2194100b50 0x7f2194198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f2192d9d640 1 --2- 172.21.15.123:0/1009243825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2194102c20 0x7f219419ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f2191d9b640 1 -- 172.21.15.123:0/1009243825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2194100b50 msgr2=0x7f2194198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f2191d9b640 1 --2- 172.21.15.123:0/1009243825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2194100b50 0x7f2194198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f2191d9b640 1 -- 172.21.15.123:0/1009243825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2194102c20 msgr2=0x7f219419ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f2191d9b640 1 --2- 172.21.15.123:0/1009243825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2194102c20 0x7f219419ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f2191d9b640 1 -- 172.21.15.123:0/1009243825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219419d130 con 0x7f21941022a0 2024-08-18T22:06:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.783+0000 7f2192d9d640 1 --2- 172.21.15.123:0/1009243825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2194102c20 0x7f219419ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.784+0000 7f2191d9b640 1 --2- 172.21.15.123:0/1009243825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21941022a0 0x7f21941986c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f218800db80 tx=0x7f218800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.784+0000 7f21837fe640 1 -- 172.21.15.123:0/1009243825 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2188017070 con 0x7f21941022a0 2024-08-18T22:06:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.784+0000 7f21837fe640 1 -- 172.21.15.123:0/1009243825 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2188003b70 con 0x7f21941022a0 2024-08-18T22:06:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.784+0000 7f21988fe640 1 -- 172.21.15.123:0/1009243825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219419d420 con 0x7f21941022a0 2024-08-18T22:06:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.784+0000 7f21837fe640 1 -- 172.21.15.123:0/1009243825 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21880106c0 con 0x7f21941022a0 2024-08-18T22:06:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.784+0000 7f21988fe640 1 -- 172.21.15.123:0/1009243825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21941a4d00 con 0x7f21941022a0 2024-08-18T22:06:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.785+0000 7f21988fe640 1 -- 172.21.15.123:0/1009243825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2194100f30 con 0x7f21941022a0 2024-08-18T22:06:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.786+0000 7f21837fe640 1 -- 172.21.15.123:0/1009243825 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f2188004020 con 0x7f21941022a0 2024-08-18T22:06:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.786+0000 7f21837fe640 1 --2- 172.21.15.123:0/1009243825 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f217c0a2c10 0x7f217c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.786+0000 7f219259c640 1 --2- 172.21.15.123:0/1009243825 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f217c0a2c10 0x7f217c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.786+0000 7f21837fe640 1 -- 172.21.15.123:0/1009243825 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f21880cf3b0 con 0x7f21941022a0 2024-08-18T22:06:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.787+0000 7f219259c640 1 --2- 172.21.15.123:0/1009243825 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f217c0a2c10 0x7f217c0a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f218c00bbe0 tx=0x7f218c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:19.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:19.790+0000 7f21837fe640 1 -- 172.21.15.123:0/1009243825 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2188020070 con 0x7f21941022a0 2024-08-18T22:06:19.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:19 smithi183 ceph-mon[22097]: pgmap v295: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s; 4.9 KiB/s, 0 objects/s recovering 2024-08-18T22:06:20.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:19 smithi130 ceph-mon[21698]: pgmap v295: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s; 4.9 KiB/s, 0 objects/s recovering 2024-08-18T22:06:20.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:20.081+0000 7f21988fe640 1 -- 172.21.15.123:0/1009243825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2194109e00 con 0x7f21941022a0 2024-08-18T22:06:20.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:20.081+0000 7f21837fe640 1 -- 172.21.15.123:0/1009243825 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2513 (secure 0 0 0) 0x7f218809bdf0 con 0x7f21941022a0 2024-08-18T22:06:20.084 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:06:20.084 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":382,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":90,"num_osds":12,"num_up_osds":12,"osd_up_since":1724018670,"num_in_osds":12,"osd_in_since":1724018651,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":129}],"num_pgs":129,"num_pools":4,"num_objects":64,"data_bytes":656509,"bytes_used":384724992,"bytes_avail":1151555702784,"bytes_total":1151940427776,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":4998,"recovering_keys_per_sec":0,"num_objects_recovered":8,"num_bytes_recovered":49209,"num_keys_recovered":0,"read_bytes_sec":3432,"write_bytes_sec":1768,"read_op_per_sec":5,"write_op_per_sec":1},"fsmap":{"epoch":25,"btime":"2024-08-18T22:06:00:456703+0000","id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"e","status":"up:standby-replay","gid":24422},{"filesystem_id":1,"rank":1,"name":"h","status":"up:standby-replay","gid":24437},{"filesystem_id":1,"rank":0,"name":"f","status":"up:standby-replay","gid":24442},{"filesystem_id":1,"rank":2,"name":"c","status":"up:active","gid":24448},{"filesystem_id":1,"rank":1,"name":"b","status":"up:active","gid":24458},{"filesystem_id":1,"rank":0,"name":"i","status":"up:active","gid":24466}],"up:standby":6},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.123:8443/"}},"servicemap":{"epoch":28,"modified":"2024-08-18T22:06:11.346601+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:06:20.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:20.084+0000 7f21988fe640 1 -- 172.21.15.123:0/1009243825 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f217c0a2c10 msgr2=0x7f217c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:20.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:20.084+0000 7f21988fe640 1 --2- 172.21.15.123:0/1009243825 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f217c0a2c10 0x7f217c0a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f218c00bbe0 tx=0x7f218c00b390 comp rx=0 tx=0).stop 2024-08-18T22:06:20.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:20.084+0000 7f21988fe640 1 -- 172.21.15.123:0/1009243825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21941022a0 msgr2=0x7f21941986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:20.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:20.084+0000 7f21988fe640 1 --2- 172.21.15.123:0/1009243825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21941022a0 0x7f21941986c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f218800db80 tx=0x7f218800b630 comp rx=0 tx=0).stop 2024-08-18T22:06:20.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:20.084+0000 7f21988fe640 1 -- 172.21.15.123:0/1009243825 shutdown_connections 2024-08-18T22:06:20.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:20.084+0000 7f21988fe640 1 --2- 172.21.15.123:0/1009243825 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f217c0a2c10 0x7f217c0a50d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:20.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:20.084+0000 7f21988fe640 1 --2- 172.21.15.123:0/1009243825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2194102c20 0x7f219419ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:20.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:20.084+0000 7f21988fe640 1 --2- 172.21.15.123:0/1009243825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21941022a0 0x7f21941986c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:20.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:20.084+0000 7f21988fe640 1 --2- 172.21.15.123:0/1009243825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2194100b50 0x7f2194198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:20.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:20.084+0000 7f21988fe640 1 -- 172.21.15.123:0/1009243825 >> 172.21.15.123:0/1009243825 conn(0x7f21940fc500 msgr2=0x7f2194069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:20.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:20.084+0000 7f21988fe640 1 -- 172.21.15.123:0/1009243825 shutdown_connections 2024-08-18T22:06:20.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:20.084+0000 7f21988fe640 1 -- 172.21.15.123:0/1009243825 wait complete. 2024-08-18T22:06:20.893 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-08-18T22:06:20.893 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-18T22:06:21.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:21.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:21.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:21.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:20 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:21.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:20 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1009243825' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-08-18T22:06:21.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:20 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:21.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:20 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:21.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:20 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:21.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:20 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:21.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:20 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1009243825' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-08-18T22:06:21.156 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:21.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:20 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:21.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:20 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:21.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:20 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:21.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:20 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:21.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:20 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1009243825' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-08-18T22:06:21.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.699+0000 7fe27c5d9640 1 -- 172.21.15.123:0/323624693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe274101160 msgr2=0x7fe27410d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:21.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.699+0000 7fe27c5d9640 1 --2- 172.21.15.123:0/323624693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe274101160 0x7fe27410d690 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe26c009cd0 tx=0x7fe26c02a8e0 comp rx=0 tx=0).stop 2024-08-18T22:06:21.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.699+0000 7fe27c5d9640 1 -- 172.21.15.123:0/323624693 shutdown_connections 2024-08-18T22:06:21.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.699+0000 7fe27c5d9640 1 --2- 172.21.15.123:0/323624693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe274101160 0x7fe27410d690 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:21.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.699+0000 7fe27c5d9640 1 --2- 172.21.15.123:0/323624693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2741007c0 0x7fe274100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:21.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.699+0000 7fe27c5d9640 1 --2- 172.21.15.123:0/323624693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2741067c0 0x7fe274106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:21.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.699+0000 7fe27c5d9640 1 -- 172.21.15.123:0/323624693 >> 172.21.15.123:0/323624693 conn(0x7fe2740fc500 msgr2=0x7fe2740fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:21.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.699+0000 7fe27c5d9640 1 -- 172.21.15.123:0/323624693 shutdown_connections 2024-08-18T22:06:21.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.699+0000 7fe27c5d9640 1 -- 172.21.15.123:0/323624693 wait complete. 2024-08-18T22:06:21.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27c5d9640 1 Processor -- start 2024-08-18T22:06:21.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27c5d9640 1 -- start start 2024-08-18T22:06:21.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27c5d9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2741007c0 0x7fe274196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:21.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27c5d9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe274101160 0x7fe2741972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27c5d9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2741067c0 0x7fe274197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27c5d9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe274110bc0 con 0x7fe2741067c0 2024-08-18T22:06:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27c5d9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe274110a40 con 0x7fe2741007c0 2024-08-18T22:06:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27c5d9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe274110d40 con 0x7fe274101160 2024-08-18T22:06:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27ab76640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2741067c0 0x7fe274197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27ab76640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2741067c0 0x7fe274197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48834/0 (socket says 172.21.15.123:48834) 2024-08-18T22:06:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27ab76640 1 -- 172.21.15.123:0/4060680661 learned_addr learned my addr 172.21.15.123:0/4060680661 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27a375640 1 --2- 172.21.15.123:0/4060680661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2741007c0 0x7fe274196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe279b74640 1 --2- 172.21.15.123:0/4060680661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe274101160 0x7fe2741972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27ab76640 1 -- 172.21.15.123:0/4060680661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe274101160 msgr2=0x7fe2741972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27ab76640 1 --2- 172.21.15.123:0/4060680661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe274101160 0x7fe2741972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27ab76640 1 -- 172.21.15.123:0/4060680661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2741007c0 msgr2=0x7fe274196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.700+0000 7fe27ab76640 1 --2- 172.21.15.123:0/4060680661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2741007c0 0x7fe274196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.701+0000 7fe27ab76640 1 -- 172.21.15.123:0/4060680661 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2741a6620 con 0x7fe2741067c0 2024-08-18T22:06:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.701+0000 7fe27ab76640 1 --2- 172.21.15.123:0/4060680661 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2741067c0 0x7fe274197830 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe26c005cc0 tx=0x7fe26c032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.701+0000 7fe26b7fe640 1 -- 172.21.15.123:0/4060680661 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26c004040 con 0x7fe2741067c0 2024-08-18T22:06:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.701+0000 7fe26b7fe640 1 -- 172.21.15.123:0/4060680661 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe26c0046c0 con 0x7fe2741067c0 2024-08-18T22:06:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.701+0000 7fe27c5d9640 1 -- 172.21.15.123:0/4060680661 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2741a68b0 con 0x7fe2741067c0 2024-08-18T22:06:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.701+0000 7fe26b7fe640 1 -- 172.21.15.123:0/4060680661 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26c030e00 con 0x7fe2741067c0 2024-08-18T22:06:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.701+0000 7fe27c5d9640 1 -- 172.21.15.123:0/4060680661 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2741a6df0 con 0x7fe2741067c0 2024-08-18T22:06:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.702+0000 7fe27c5d9640 1 -- 172.21.15.123:0/4060680661 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe274100c20 con 0x7fe2741067c0 2024-08-18T22:06:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.703+0000 7fe26b7fe640 1 -- 172.21.15.123:0/4060680661 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe26c0305a0 con 0x7fe2741067c0 2024-08-18T22:06:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.704+0000 7fe26b7fe640 1 --2- 172.21.15.123:0/4060680661 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe2600a2c10 0x7fe2600a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.704+0000 7fe27a375640 1 --2- 172.21.15.123:0/4060680661 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe2600a2c10 0x7fe2600a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.704+0000 7fe26b7fe640 1 -- 172.21.15.123:0/4060680661 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fe26c02e030 con 0x7fe2741067c0 2024-08-18T22:06:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.704+0000 7fe27a375640 1 --2- 172.21.15.123:0/4060680661 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe2600a2c10 0x7fe2600a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe270009b50 tx=0x7fe270005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.709+0000 7fe26b7fe640 1 -- 172.21.15.123:0/4060680661 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe26c04b060 con 0x7fe2741067c0 2024-08-18T22:06:21.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.869+0000 7fe27c5d9640 1 -- 172.21.15.123:0/4060680661 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe274062360 con 0x7fe2600a2c10 2024-08-18T22:06:21.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.880+0000 7fe26b7fe640 1 -- 172.21.15.123:0/4060680661 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340385 (secure 0 0 0) 0x7fe274062360 con 0x7fe2600a2c10 2024-08-18T22:06:21.884 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:06:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-08-18T22:06:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.882+0000 7fe27c5d9640 1 -- 172.21.15.123:0/4060680661 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe2600a2c10 msgr2=0x7fe2600a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.882+0000 7fe27c5d9640 1 --2- 172.21.15.123:0/4060680661 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe2600a2c10 0x7fe2600a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe270009b50 tx=0x7fe270005f90 comp rx=0 tx=0).stop 2024-08-18T22:06:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.882+0000 7fe27c5d9640 1 -- 172.21.15.123:0/4060680661 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2741067c0 msgr2=0x7fe274197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.882+0000 7fe27c5d9640 1 --2- 172.21.15.123:0/4060680661 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2741067c0 0x7fe274197830 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe26c005cc0 tx=0x7fe26c032f40 comp rx=0 tx=0).stop 2024-08-18T22:06:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.882+0000 7fe27c5d9640 1 -- 172.21.15.123:0/4060680661 shutdown_connections 2024-08-18T22:06:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.882+0000 7fe27c5d9640 1 --2- 172.21.15.123:0/4060680661 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2741067c0 0x7fe274197830 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.882+0000 7fe27c5d9640 1 --2- 172.21.15.123:0/4060680661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe274101160 0x7fe2741972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.882+0000 7fe27c5d9640 1 --2- 172.21.15.123:0/4060680661 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe2600a2c10 0x7fe2600a50d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.882+0000 7fe27c5d9640 1 --2- 172.21.15.123:0/4060680661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2741007c0 0x7fe274196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:21.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.882+0000 7fe27c5d9640 1 -- 172.21.15.123:0/4060680661 >> 172.21.15.123:0/4060680661 conn(0x7fe2740fc500 msgr2=0x7fe2740fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:21.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.882+0000 7fe27c5d9640 1 -- 172.21.15.123:0/4060680661 shutdown_connections 2024-08-18T22:06:21.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:21.882+0000 7fe27c5d9640 1 -- 172.21.15.123:0/4060680661 wait complete. 2024-08-18T22:06:22.262 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:22 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:22.262 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:22 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:22.262 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:22 smithi123 ceph-mon[18462]: pgmap v296: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 4.4 KiB/s, 0 objects/s recovering 2024-08-18T22:06:22.263 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:22 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:06:22.263 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:22 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:06:22.263 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:22 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:22.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:22 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:22.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:22 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:22.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:22 smithi183 ceph-mon[22097]: pgmap v296: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 4.4 KiB/s, 0 objects/s recovering 2024-08-18T22:06:22.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:22 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:06:22.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:22 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:06:22.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:22 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:22.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:22 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:22.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:22 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:22.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:22 smithi130 ceph-mon[21698]: pgmap v296: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 4.4 KiB/s, 0 objects/s recovering 2024-08-18T22:06:22.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:22 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:06:22.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:22 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:06:22.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:22 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:06:22.687 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2024-08-18T22:06:21.349376+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656509,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":273,"num_read_kb":245,"num_write":349,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1229945,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":281,"ondisk_log_size":281,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375708,"kb_used_data":14036,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566116,"statfs":{"total":1151940427776,"available":1151555702784,"internally_reserved":0,"allocated":14372864,"data_stored":7998785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12425,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":33,"num_write":15,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":49209,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.844865"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509743+0000","last_change":"2024-08-18T22:05:19.844674+0000","last_active":"2024-08-18T22:06:10.509743+0000","last_peered":"2024-08-18T22:06:10.509743+0000","last_clean":"2024-08-18T22:06:10.509743+0000","last_became_active":"2024-08-18T22:05:19.844381+0000","last_became_peered":"2024-08-18T22:05:19.844381+0000","last_unstale":"2024-08-18T22:06:10.509743+0000","last_undegraded":"2024-08-18T22:06:10.509743+0000","last_fullsized":"2024-08-18T22:06:10.509743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:58.783222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772174+0000","last_change":"2024-08-18T22:05:21.859013+0000","last_active":"2024-08-18T22:06:10.772174+0000","last_peered":"2024-08-18T22:06:10.772174+0000","last_clean":"2024-08-18T22:06:10.772174+0000","last_became_active":"2024-08-18T22:05:21.858709+0000","last_became_peered":"2024-08-18T22:05:21.858709+0000","last_unstale":"2024-08-18T22:06:10.772174+0000","last_undegraded":"2024-08-18T22:06:10.772174+0000","last_fullsized":"2024-08-18T22:06:10.772174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:34.272340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508245+0000","last_change":"2024-08-18T22:05:28.925735+0000","last_active":"2024-08-18T22:06:10.508245+0000","last_peered":"2024-08-18T22:06:10.508245+0000","last_clean":"2024-08-18T22:06:10.508245+0000","last_became_active":"2024-08-18T22:05:28.925324+0000","last_became_peered":"2024-08-18T22:05:28.925324+0000","last_unstale":"2024-08-18T22:06:10.508245+0000","last_undegraded":"2024-08-18T22:06:10.508245+0000","last_fullsized":"2024-08-18T22:06:10.508245+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:15:58.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772359+0000","last_change":"2024-08-18T22:05:20.290861+0000","last_active":"2024-08-18T22:06:10.772359+0000","last_peered":"2024-08-18T22:06:10.772359+0000","last_clean":"2024-08-18T22:06:10.772359+0000","last_became_active":"2024-08-18T22:05:20.290508+0000","last_became_peered":"2024-08-18T22:05:20.290508+0000","last_unstale":"2024-08-18T22:06:10.772359+0000","last_undegraded":"2024-08-18T22:06:10.772359+0000","last_fullsized":"2024-08-18T22:06:10.772359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:21.462206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509155+0000","last_change":"2024-08-18T22:05:21.863441+0000","last_active":"2024-08-18T22:06:10.509155+0000","last_peered":"2024-08-18T22:06:10.509155+0000","last_clean":"2024-08-18T22:06:10.509155+0000","last_became_active":"2024-08-18T22:05:21.863121+0000","last_became_peered":"2024-08-18T22:05:21.863121+0000","last_unstale":"2024-08-18T22:06:10.509155+0000","last_undegraded":"2024-08-18T22:06:10.509155+0000","last_fullsized":"2024-08-18T22:06:10.509155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:47.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509447+0000","last_change":"2024-08-18T22:05:28.925477+0000","last_active":"2024-08-18T22:06:10.509447+0000","last_peered":"2024-08-18T22:06:10.509447+0000","last_clean":"2024-08-18T22:06:10.509447+0000","last_became_active":"2024-08-18T22:05:28.924922+0000","last_became_peered":"2024-08-18T22:05:28.924922+0000","last_unstale":"2024-08-18T22:06:10.509447+0000","last_undegraded":"2024-08-18T22:06:10.509447+0000","last_fullsized":"2024-08-18T22:06:10.509447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:35.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514293+0000","last_change":"2024-08-18T22:05:19.847979+0000","last_active":"2024-08-18T22:06:10.514293+0000","last_peered":"2024-08-18T22:06:10.514293+0000","last_clean":"2024-08-18T22:06:10.514293+0000","last_became_active":"2024-08-18T22:05:19.847643+0000","last_became_peered":"2024-08-18T22:05:19.847643+0000","last_unstale":"2024-08-18T22:06:10.514293+0000","last_undegraded":"2024-08-18T22:06:10.514293+0000","last_fullsized":"2024-08-18T22:06:10.514293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:33.875378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506424+0000","last_change":"2024-08-18T22:05:21.860225+0000","last_active":"2024-08-18T22:06:10.506424+0000","last_peered":"2024-08-18T22:06:10.506424+0000","last_clean":"2024-08-18T22:06:10.506424+0000","last_became_active":"2024-08-18T22:05:21.859889+0000","last_became_peered":"2024-08-18T22:05:21.859889+0000","last_unstale":"2024-08-18T22:06:10.506424+0000","last_undegraded":"2024-08-18T22:06:10.506424+0000","last_fullsized":"2024-08-18T22:06:10.506424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:06:27.084401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511096+0000","last_change":"2024-08-18T22:05:28.922230+0000","last_active":"2024-08-18T22:06:10.511096+0000","last_peered":"2024-08-18T22:06:10.511096+0000","last_clean":"2024-08-18T22:06:10.511096+0000","last_became_active":"2024-08-18T22:05:28.921804+0000","last_became_peered":"2024-08-18T22:05:28.921804+0000","last_unstale":"2024-08-18T22:06:10.511096+0000","last_undegraded":"2024-08-18T22:06:10.511096+0000","last_fullsized":"2024-08-18T22:06:10.511096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:17.735645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514907+0000","last_change":"2024-08-18T22:05:19.841452+0000","last_active":"2024-08-18T22:06:10.514907+0000","last_peered":"2024-08-18T22:06:10.514907+0000","last_clean":"2024-08-18T22:06:10.514907+0000","last_became_active":"2024-08-18T22:05:19.840997+0000","last_became_peered":"2024-08-18T22:05:19.840997+0000","last_unstale":"2024-08-18T22:06:10.514907+0000","last_undegraded":"2024-08-18T22:06:10.514907+0000","last_fullsized":"2024-08-18T22:06:10.514907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:27:26.208279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514673+0000","last_change":"2024-08-18T22:06:10.514673+0000","last_active":"2024-08-18T22:06:10.514673+0000","last_peered":"2024-08-18T22:06:10.514673+0000","last_clean":"2024-08-18T22:06:10.514673+0000","last_became_active":"2024-08-18T22:06:10.514264+0000","last_became_peered":"2024-08-18T22:06:10.514264+0000","last_unstale":"2024-08-18T22:06:10.514673+0000","last_undegraded":"2024-08-18T22:06:10.514673+0000","last_fullsized":"2024-08-18T22:06:10.514673+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:03.626895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509642+0000","last_change":"2024-08-18T22:05:28.924521+0000","last_active":"2024-08-18T22:06:10.509642+0000","last_peered":"2024-08-18T22:06:10.509642+0000","last_clean":"2024-08-18T22:06:10.509642+0000","last_became_active":"2024-08-18T22:05:28.924107+0000","last_became_peered":"2024-08-18T22:05:28.924107+0000","last_unstale":"2024-08-18T22:06:10.509642+0000","last_undegraded":"2024-08-18T22:06:10.509642+0000","last_fullsized":"2024-08-18T22:06:10.509642+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:37.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508303+0000","last_change":"2024-08-18T22:05:21.861696+0000","last_active":"2024-08-18T22:06:10.508303+0000","last_peered":"2024-08-18T22:06:10.508303+0000","last_clean":"2024-08-18T22:06:10.508303+0000","last_became_active":"2024-08-18T22:05:21.861220+0000","last_became_peered":"2024-08-18T22:05:21.861220+0000","last_unstale":"2024-08-18T22:06:10.508303+0000","last_undegraded":"2024-08-18T22:06:10.508303+0000","last_fullsized":"2024-08-18T22:06:10.508303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:01.098281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.520590+0000","last_change":"2024-08-18T22:06:10.520097+0000","last_active":"2024-08-18T22:06:10.520590+0000","last_peered":"2024-08-18T22:06:10.520590+0000","last_clean":"2024-08-18T22:06:10.520590+0000","last_became_active":"2024-08-18T22:06:10.513286+0000","last_became_peered":"2024-08-18T22:06:10.513286+0000","last_unstale":"2024-08-18T22:06:10.520590+0000","last_undegraded":"2024-08-18T22:06:10.520590+0000","last_fullsized":"2024-08-18T22:06:10.520590+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:08:18.861243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509973+0000","last_change":"2024-08-18T22:05:29.013139+0000","last_active":"2024-08-18T22:06:10.509973+0000","last_peered":"2024-08-18T22:06:10.509973+0000","last_clean":"2024-08-18T22:06:10.509973+0000","last_became_active":"2024-08-18T22:05:29.012322+0000","last_became_peered":"2024-08-18T22:05:29.012322+0000","last_unstale":"2024-08-18T22:06:10.509973+0000","last_undegraded":"2024-08-18T22:06:10.509973+0000","last_fullsized":"2024-08-18T22:06:10.509973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:32.348201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772162+0000","last_change":"2024-08-18T22:05:21.860410+0000","last_active":"2024-08-18T22:06:10.772162+0000","last_peered":"2024-08-18T22:06:10.772162+0000","last_clean":"2024-08-18T22:06:10.772162+0000","last_became_active":"2024-08-18T22:05:21.860173+0000","last_became_peered":"2024-08-18T22:05:21.860173+0000","last_unstale":"2024-08-18T22:06:10.772162+0000","last_undegraded":"2024-08-18T22:06:10.772162+0000","last_fullsized":"2024-08-18T22:06:10.772162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:00.879178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507956+0000","last_change":"2024-08-18T22:05:19.845785+0000","last_active":"2024-08-18T22:06:10.507956+0000","last_peered":"2024-08-18T22:06:10.507956+0000","last_clean":"2024-08-18T22:06:10.507956+0000","last_became_active":"2024-08-18T22:05:19.845414+0000","last_became_peered":"2024-08-18T22:05:19.845414+0000","last_unstale":"2024-08-18T22:06:10.507956+0000","last_undegraded":"2024-08-18T22:06:10.507956+0000","last_fullsized":"2024-08-18T22:06:10.507956+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:13.504885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.523404+0000","last_change":"2024-08-18T22:06:10.523404+0000","last_active":"2024-08-18T22:06:10.523404+0000","last_peered":"2024-08-18T22:06:10.523404+0000","last_clean":"2024-08-18T22:06:10.523404+0000","last_became_active":"2024-08-18T22:06:10.516652+0000","last_became_peered":"2024-08-18T22:06:10.516652+0000","last_unstale":"2024-08-18T22:06:10.523404+0000","last_undegraded":"2024-08-18T22:06:10.523404+0000","last_fullsized":"2024-08-18T22:06:10.523404+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:58.197636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510102+0000","last_change":"2024-08-18T22:05:21.858329+0000","last_active":"2024-08-18T22:06:10.510102+0000","last_peered":"2024-08-18T22:06:10.510102+0000","last_clean":"2024-08-18T22:06:10.510102+0000","last_became_active":"2024-08-18T22:05:21.857854+0000","last_became_peered":"2024-08-18T22:05:21.857854+0000","last_unstale":"2024-08-18T22:06:10.510102+0000","last_undegraded":"2024-08-18T22:06:10.510102+0000","last_fullsized":"2024-08-18T22:06:10.510102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:45:19.934647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772068+0000","last_change":"2024-08-18T22:05:19.843031+0000","last_active":"2024-08-18T22:06:10.772068+0000","last_peered":"2024-08-18T22:06:10.772068+0000","last_clean":"2024-08-18T22:06:10.772068+0000","last_became_active":"2024-08-18T22:05:19.842694+0000","last_became_peered":"2024-08-18T22:05:19.842694+0000","last_unstale":"2024-08-18T22:06:10.772068+0000","last_undegraded":"2024-08-18T22:06:10.772068+0000","last_fullsized":"2024-08-18T22:06:10.772068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:01.135449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509575+0000","last_change":"2024-08-18T22:05:28.920647+0000","last_active":"2024-08-18T22:06:10.509575+0000","last_peered":"2024-08-18T22:06:10.509575+0000","last_clean":"2024-08-18T22:06:10.509575+0000","last_became_active":"2024-08-18T22:05:28.920295+0000","last_became_peered":"2024-08-18T22:05:28.920295+0000","last_unstale":"2024-08-18T22:06:10.509575+0000","last_undegraded":"2024-08-18T22:06:10.509575+0000","last_fullsized":"2024-08-18T22:06:10.509575+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:41.295009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513283+0000","last_change":"2024-08-18T22:05:21.858413+0000","last_active":"2024-08-18T22:06:10.513283+0000","last_peered":"2024-08-18T22:06:10.513283+0000","last_clean":"2024-08-18T22:06:10.513283+0000","last_became_active":"2024-08-18T22:05:21.858102+0000","last_became_peered":"2024-08-18T22:05:21.858102+0000","last_unstale":"2024-08-18T22:06:10.513283+0000","last_undegraded":"2024-08-18T22:06:10.513283+0000","last_fullsized":"2024-08-18T22:06:10.513283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:24:59.432666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506163+0000","last_change":"2024-08-18T22:05:20.292085+0000","last_active":"2024-08-18T22:06:10.506163+0000","last_peered":"2024-08-18T22:06:10.506163+0000","last_clean":"2024-08-18T22:06:10.506163+0000","last_became_active":"2024-08-18T22:05:20.291606+0000","last_became_peered":"2024-08-18T22:05:20.291606+0000","last_unstale":"2024-08-18T22:06:10.506163+0000","last_undegraded":"2024-08-18T22:06:10.506163+0000","last_fullsized":"2024-08-18T22:06:10.506163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:22:46.801719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515755+0000","last_change":"2024-08-18T22:06:10.515755+0000","last_active":"2024-08-18T22:06:10.515755+0000","last_peered":"2024-08-18T22:06:10.515755+0000","last_clean":"2024-08-18T22:06:10.515755+0000","last_became_active":"2024-08-18T22:06:10.514624+0000","last_became_peered":"2024-08-18T22:06:10.514624+0000","last_unstale":"2024-08-18T22:06:10.515755+0000","last_undegraded":"2024-08-18T22:06:10.515755+0000","last_fullsized":"2024-08-18T22:06:10.515755+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:18:50.785139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508880+0000","last_change":"2024-08-18T22:05:21.855163+0000","last_active":"2024-08-18T22:06:10.508880+0000","last_peered":"2024-08-18T22:06:10.508880+0000","last_clean":"2024-08-18T22:06:10.508880+0000","last_became_active":"2024-08-18T22:05:21.854867+0000","last_became_peered":"2024-08-18T22:05:21.854867+0000","last_unstale":"2024-08-18T22:06:10.508880+0000","last_undegraded":"2024-08-18T22:06:10.508880+0000","last_fullsized":"2024-08-18T22:06:10.508880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:10.300307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510102+0000","last_change":"2024-08-18T22:05:20.082363+0000","last_active":"2024-08-18T22:06:10.510102+0000","last_peered":"2024-08-18T22:06:10.510102+0000","last_clean":"2024-08-18T22:06:10.510102+0000","last_became_active":"2024-08-18T22:05:20.081998+0000","last_became_peered":"2024-08-18T22:05:20.081998+0000","last_unstale":"2024-08-18T22:06:10.510102+0000","last_undegraded":"2024-08-18T22:06:10.510102+0000","last_fullsized":"2024-08-18T22:06:10.510102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:44.960512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508721+0000","last_change":"2024-08-18T22:05:28.924072+0000","last_active":"2024-08-18T22:06:10.508721+0000","last_peered":"2024-08-18T22:06:10.508721+0000","last_clean":"2024-08-18T22:06:10.508721+0000","last_became_active":"2024-08-18T22:05:28.923673+0000","last_became_peered":"2024-08-18T22:05:28.923673+0000","last_unstale":"2024-08-18T22:06:10.508721+0000","last_undegraded":"2024-08-18T22:06:10.508721+0000","last_fullsized":"2024-08-18T22:06:10.508721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:44.593009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772399+0000","last_change":"2024-08-18T22:05:21.851377+0000","last_active":"2024-08-18T22:06:10.772399+0000","last_peered":"2024-08-18T22:06:10.772399+0000","last_clean":"2024-08-18T22:06:10.772399+0000","last_became_active":"2024-08-18T22:05:21.851031+0000","last_became_peered":"2024-08-18T22:05:21.851031+0000","last_unstale":"2024-08-18T22:06:10.772399+0000","last_undegraded":"2024-08-18T22:06:10.772399+0000","last_fullsized":"2024-08-18T22:06:10.772399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.547244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'11","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:13.873627+0000","last_change":"2024-08-18T22:05:19.840697+0000","last_active":"2024-08-18T22:06:13.873627+0000","last_peered":"2024-08-18T22:06:13.873627+0000","last_clean":"2024-08-18T22:06:13.873627+0000","last_became_active":"2024-08-18T22:05:19.840382+0000","last_became_peered":"2024-08-18T22:05:19.840382+0000","last_unstale":"2024-08-18T22:06:13.873627+0000","last_undegraded":"2024-08-18T22:06:13.873627+0000","last_fullsized":"2024-08-18T22:06:13.873627+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:24.514428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771817+0000","last_change":"2024-08-18T22:05:29.012305+0000","last_active":"2024-08-18T22:06:10.771817+0000","last_peered":"2024-08-18T22:06:10.771817+0000","last_clean":"2024-08-18T22:06:10.771817+0000","last_became_active":"2024-08-18T22:05:29.011846+0000","last_became_peered":"2024-08-18T22:05:29.011846+0000","last_unstale":"2024-08-18T22:06:10.771817+0000","last_undegraded":"2024-08-18T22:06:10.771817+0000","last_fullsized":"2024-08-18T22:06:10.771817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:36.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506016+0000","last_change":"2024-08-18T22:05:21.856182+0000","last_active":"2024-08-18T22:06:10.506016+0000","last_peered":"2024-08-18T22:06:10.506016+0000","last_clean":"2024-08-18T22:06:10.506016+0000","last_became_active":"2024-08-18T22:05:21.855855+0000","last_became_peered":"2024-08-18T22:05:21.855855+0000","last_unstale":"2024-08-18T22:06:10.506016+0000","last_undegraded":"2024-08-18T22:06:10.506016+0000","last_fullsized":"2024-08-18T22:06:10.506016+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:00.166809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514793+0000","last_change":"2024-08-18T22:05:20.291272+0000","last_active":"2024-08-18T22:06:10.514793+0000","last_peered":"2024-08-18T22:06:10.514793+0000","last_clean":"2024-08-18T22:06:10.514793+0000","last_became_active":"2024-08-18T22:05:20.290970+0000","last_became_peered":"2024-08-18T22:05:20.290970+0000","last_unstale":"2024-08-18T22:06:10.514793+0000","last_undegraded":"2024-08-18T22:06:10.514793+0000","last_fullsized":"2024-08-18T22:06:10.514793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:29.438996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510601+0000","last_change":"2024-08-18T22:05:28.923141+0000","last_active":"2024-08-18T22:06:10.510601+0000","last_peered":"2024-08-18T22:06:10.510601+0000","last_clean":"2024-08-18T22:06:10.510601+0000","last_became_active":"2024-08-18T22:05:28.922269+0000","last_became_peered":"2024-08-18T22:05:28.922269+0000","last_unstale":"2024-08-18T22:06:10.510601+0000","last_undegraded":"2024-08-18T22:06:10.510601+0000","last_fullsized":"2024-08-18T22:06:10.510601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:58.092640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509287+0000","last_change":"2024-08-18T22:05:21.850124+0000","last_active":"2024-08-18T22:06:10.509287+0000","last_peered":"2024-08-18T22:06:10.509287+0000","last_clean":"2024-08-18T22:06:10.509287+0000","last_became_active":"2024-08-18T22:05:21.849805+0000","last_became_peered":"2024-08-18T22:05:21.849805+0000","last_unstale":"2024-08-18T22:06:10.509287+0000","last_undegraded":"2024-08-18T22:06:10.509287+0000","last_fullsized":"2024-08-18T22:06:10.509287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:53.492613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509230+0000","last_change":"2024-08-18T22:05:20.292836+0000","last_active":"2024-08-18T22:06:10.509230+0000","last_peered":"2024-08-18T22:06:10.509230+0000","last_clean":"2024-08-18T22:06:10.509230+0000","last_became_active":"2024-08-18T22:05:20.292456+0000","last_became_peered":"2024-08-18T22:05:20.292456+0000","last_unstale":"2024-08-18T22:06:10.509230+0000","last_undegraded":"2024-08-18T22:06:10.509230+0000","last_fullsized":"2024-08-18T22:06:10.509230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:19.525037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513298+0000","last_change":"2024-08-18T22:05:29.012439+0000","last_active":"2024-08-18T22:06:10.513298+0000","last_peered":"2024-08-18T22:06:10.513298+0000","last_clean":"2024-08-18T22:06:10.513298+0000","last_became_active":"2024-08-18T22:05:29.011860+0000","last_became_peered":"2024-08-18T22:05:29.011860+0000","last_unstale":"2024-08-18T22:06:10.513298+0000","last_undegraded":"2024-08-18T22:06:10.513298+0000","last_fullsized":"2024-08-18T22:06:10.513298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:03.432217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509272+0000","last_change":"2024-08-18T22:05:21.855598+0000","last_active":"2024-08-18T22:06:10.509272+0000","last_peered":"2024-08-18T22:06:10.509272+0000","last_clean":"2024-08-18T22:06:10.509272+0000","last_became_active":"2024-08-18T22:05:21.855228+0000","last_became_peered":"2024-08-18T22:05:21.855228+0000","last_unstale":"2024-08-18T22:06:10.509272+0000","last_undegraded":"2024-08-18T22:06:10.509272+0000","last_fullsized":"2024-08-18T22:06:10.509272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:33.762700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508476+0000","last_change":"2024-08-18T22:05:19.844638+0000","last_active":"2024-08-18T22:06:10.508476+0000","last_peered":"2024-08-18T22:06:10.508476+0000","last_clean":"2024-08-18T22:06:10.508476+0000","last_became_active":"2024-08-18T22:05:19.844333+0000","last_became_peered":"2024-08-18T22:05:19.844333+0000","last_unstale":"2024-08-18T22:06:10.508476+0000","last_undegraded":"2024-08-18T22:06:10.508476+0000","last_fullsized":"2024-08-18T22:06:10.508476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:26.947512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505914+0000","last_change":"2024-08-18T22:05:28.919965+0000","last_active":"2024-08-18T22:06:10.505914+0000","last_peered":"2024-08-18T22:06:10.505914+0000","last_clean":"2024-08-18T22:06:10.505914+0000","last_became_active":"2024-08-18T22:05:28.919546+0000","last_became_peered":"2024-08-18T22:05:28.919546+0000","last_unstale":"2024-08-18T22:06:10.505914+0000","last_undegraded":"2024-08-18T22:06:10.505914+0000","last_fullsized":"2024-08-18T22:06:10.505914+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:49.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506450+0000","last_change":"2024-08-18T22:05:21.857867+0000","last_active":"2024-08-18T22:06:10.506450+0000","last_peered":"2024-08-18T22:06:10.506450+0000","last_clean":"2024-08-18T22:06:10.506450+0000","last_became_active":"2024-08-18T22:05:21.857515+0000","last_became_peered":"2024-08-18T22:05:21.857515+0000","last_unstale":"2024-08-18T22:06:10.506450+0000","last_undegraded":"2024-08-18T22:06:10.506450+0000","last_fullsized":"2024-08-18T22:06:10.506450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:51.148321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:16.486067+0000","last_change":"2024-08-18T22:05:20.290924+0000","last_active":"2024-08-18T22:06:16.486067+0000","last_peered":"2024-08-18T22:06:16.486067+0000","last_clean":"2024-08-18T22:06:16.486067+0000","last_became_active":"2024-08-18T22:05:20.290587+0000","last_became_peered":"2024-08-18T22:05:20.290587+0000","last_unstale":"2024-08-18T22:06:16.486067+0000","last_undegraded":"2024-08-18T22:06:16.486067+0000","last_fullsized":"2024-08-18T22:06:16.486067+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:35.029634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505852+0000","last_change":"2024-08-18T22:05:29.012876+0000","last_active":"2024-08-18T22:06:10.505852+0000","last_peered":"2024-08-18T22:06:10.505852+0000","last_clean":"2024-08-18T22:06:10.505852+0000","last_became_active":"2024-08-18T22:05:29.011930+0000","last_became_peered":"2024-08-18T22:05:29.011930+0000","last_unstale":"2024-08-18T22:06:10.505852+0000","last_undegraded":"2024-08-18T22:06:10.505852+0000","last_fullsized":"2024-08-18T22:06:10.505852+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:22:35.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505526+0000","last_change":"2024-08-18T22:05:21.860798+0000","last_active":"2024-08-18T22:06:10.505526+0000","last_peered":"2024-08-18T22:06:10.505526+0000","last_clean":"2024-08-18T22:06:10.505526+0000","last_became_active":"2024-08-18T22:05:21.856968+0000","last_became_peered":"2024-08-18T22:05:21.856968+0000","last_unstale":"2024-08-18T22:06:10.505526+0000","last_undegraded":"2024-08-18T22:06:10.505526+0000","last_fullsized":"2024-08-18T22:06:10.505526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:54.934400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508009+0000","last_change":"2024-08-18T22:05:19.844775+0000","last_active":"2024-08-18T22:06:10.508009+0000","last_peered":"2024-08-18T22:06:10.508009+0000","last_clean":"2024-08-18T22:06:10.508009+0000","last_became_active":"2024-08-18T22:05:19.844465+0000","last_became_peered":"2024-08-18T22:05:19.844465+0000","last_unstale":"2024-08-18T22:06:10.508009+0000","last_undegraded":"2024-08-18T22:06:10.508009+0000","last_fullsized":"2024-08-18T22:06:10.508009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.042335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507348+0000","last_change":"2024-08-18T22:05:29.013275+0000","last_active":"2024-08-18T22:06:10.507348+0000","last_peered":"2024-08-18T22:06:10.507348+0000","last_clean":"2024-08-18T22:06:10.507348+0000","last_became_active":"2024-08-18T22:05:29.012537+0000","last_became_peered":"2024-08-18T22:05:29.012537+0000","last_unstale":"2024-08-18T22:06:10.507348+0000","last_undegraded":"2024-08-18T22:06:10.507348+0000","last_fullsized":"2024-08-18T22:06:10.507348+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:15:39.775360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772046+0000","last_change":"2024-08-18T22:05:21.853358+0000","last_active":"2024-08-18T22:06:10.772046+0000","last_peered":"2024-08-18T22:06:10.772046+0000","last_clean":"2024-08-18T22:06:10.772046+0000","last_became_active":"2024-08-18T22:05:21.853071+0000","last_became_peered":"2024-08-18T22:05:21.853071+0000","last_unstale":"2024-08-18T22:06:10.772046+0000","last_undegraded":"2024-08-18T22:06:10.772046+0000","last_fullsized":"2024-08-18T22:06:10.772046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:23.755263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511287+0000","last_change":"2024-08-18T22:05:19.846922+0000","last_active":"2024-08-18T22:06:10.511287+0000","last_peered":"2024-08-18T22:06:10.511287+0000","last_clean":"2024-08-18T22:06:10.511287+0000","last_became_active":"2024-08-18T22:05:19.846619+0000","last_became_peered":"2024-08-18T22:05:19.846619+0000","last_unstale":"2024-08-18T22:06:10.511287+0000","last_undegraded":"2024-08-18T22:06:10.511287+0000","last_fullsized":"2024-08-18T22:06:10.511287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:36:16.232344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":352,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508214+0000","last_change":"2024-08-18T22:04:11.878703+0000","last_active":"2024-08-18T22:06:10.508214+0000","last_peered":"2024-08-18T22:06:10.508214+0000","last_clean":"2024-08-18T22:06:10.508214+0000","last_became_active":"2024-08-18T22:04:11.878157+0000","last_became_peered":"2024-08-18T22:04:11.878157+0000","last_unstale":"2024-08-18T22:06:10.508214+0000","last_undegraded":"2024-08-18T22:06:10.508214+0000","last_fullsized":"2024-08-18T22:06:10.508214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_clean_scrub_stamp":"2024-08-18T22:01:09.551264+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:24:07.391758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508423+0000","last_change":"2024-08-18T22:05:28.928882+0000","last_active":"2024-08-18T22:06:10.508423+0000","last_peered":"2024-08-18T22:06:10.508423+0000","last_clean":"2024-08-18T22:06:10.508423+0000","last_became_active":"2024-08-18T22:05:28.928482+0000","last_became_peered":"2024-08-18T22:05:28.928482+0000","last_unstale":"2024-08-18T22:06:10.508423+0000","last_undegraded":"2024-08-18T22:06:10.508423+0000","last_fullsized":"2024-08-18T22:06:10.508423+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:41.739482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508689+0000","last_change":"2024-08-18T22:05:21.863045+0000","last_active":"2024-08-18T22:06:10.508689+0000","last_peered":"2024-08-18T22:06:10.508689+0000","last_clean":"2024-08-18T22:06:10.508689+0000","last_became_active":"2024-08-18T22:05:21.862758+0000","last_became_peered":"2024-08-18T22:05:21.862758+0000","last_unstale":"2024-08-18T22:06:10.508689+0000","last_undegraded":"2024-08-18T22:06:10.508689+0000","last_fullsized":"2024-08-18T22:06:10.508689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:08:39.111147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509216+0000","last_change":"2024-08-18T22:05:20.291030+0000","last_active":"2024-08-18T22:06:10.509216+0000","last_peered":"2024-08-18T22:06:10.509216+0000","last_clean":"2024-08-18T22:06:10.509216+0000","last_became_active":"2024-08-18T22:05:20.290427+0000","last_became_peered":"2024-08-18T22:05:20.290427+0000","last_unstale":"2024-08-18T22:06:10.509216+0000","last_undegraded":"2024-08-18T22:06:10.509216+0000","last_fullsized":"2024-08-18T22:06:10.509216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:14:42.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506125+0000","last_change":"2024-08-18T22:05:28.923700+0000","last_active":"2024-08-18T22:06:10.506125+0000","last_peered":"2024-08-18T22:06:10.506125+0000","last_clean":"2024-08-18T22:06:10.506125+0000","last_became_active":"2024-08-18T22:05:28.923280+0000","last_became_peered":"2024-08-18T22:05:28.923280+0000","last_unstale":"2024-08-18T22:06:10.506125+0000","last_undegraded":"2024-08-18T22:06:10.506125+0000","last_fullsized":"2024-08-18T22:06:10.506125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:25:45.343542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508357+0000","last_change":"2024-08-18T22:05:21.856107+0000","last_active":"2024-08-18T22:06:10.508357+0000","last_peered":"2024-08-18T22:06:10.508357+0000","last_clean":"2024-08-18T22:06:10.508357+0000","last_became_active":"2024-08-18T22:05:21.853276+0000","last_became_peered":"2024-08-18T22:05:21.853276+0000","last_unstale":"2024-08-18T22:06:10.508357+0000","last_undegraded":"2024-08-18T22:06:10.508357+0000","last_fullsized":"2024-08-18T22:06:10.508357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:58.280375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507968+0000","last_change":"2024-08-18T22:05:19.843445+0000","last_active":"2024-08-18T22:06:10.507968+0000","last_peered":"2024-08-18T22:06:10.507968+0000","last_clean":"2024-08-18T22:06:10.507968+0000","last_became_active":"2024-08-18T22:05:19.843000+0000","last_became_peered":"2024-08-18T22:05:19.843000+0000","last_unstale":"2024-08-18T22:06:10.507968+0000","last_undegraded":"2024-08-18T22:06:10.507968+0000","last_fullsized":"2024-08-18T22:06:10.507968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:23.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515953+0000","last_change":"2024-08-18T22:06:10.515953+0000","last_active":"2024-08-18T22:06:10.515953+0000","last_peered":"2024-08-18T22:06:10.515953+0000","last_clean":"2024-08-18T22:06:10.515953+0000","last_became_active":"2024-08-18T22:06:10.515662+0000","last_became_peered":"2024-08-18T22:06:10.515662+0000","last_unstale":"2024-08-18T22:06:10.515953+0000","last_undegraded":"2024-08-18T22:06:10.515953+0000","last_fullsized":"2024-08-18T22:06:10.515953+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:43.150180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509215+0000","last_change":"2024-08-18T22:05:21.864029+0000","last_active":"2024-08-18T22:06:10.509215+0000","last_peered":"2024-08-18T22:06:10.509215+0000","last_clean":"2024-08-18T22:06:10.509215+0000","last_became_active":"2024-08-18T22:05:21.863509+0000","last_became_peered":"2024-08-18T22:05:21.863509+0000","last_unstale":"2024-08-18T22:06:10.509215+0000","last_undegraded":"2024-08-18T22:06:10.509215+0000","last_fullsized":"2024-08-18T22:06:10.509215+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:42.879243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506010+0000","last_change":"2024-08-18T22:05:19.846514+0000","last_active":"2024-08-18T22:06:10.506010+0000","last_peered":"2024-08-18T22:06:10.506010+0000","last_clean":"2024-08-18T22:06:10.506010+0000","last_became_active":"2024-08-18T22:05:19.846190+0000","last_became_peered":"2024-08-18T22:05:19.846190+0000","last_unstale":"2024-08-18T22:06:10.506010+0000","last_undegraded":"2024-08-18T22:06:10.506010+0000","last_fullsized":"2024-08-18T22:06:10.506010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:49:00.317597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506329+0000","last_change":"2024-08-18T22:05:28.923183+0000","last_active":"2024-08-18T22:06:10.506329+0000","last_peered":"2024-08-18T22:06:10.506329+0000","last_clean":"2024-08-18T22:06:10.506329+0000","last_became_active":"2024-08-18T22:05:28.922809+0000","last_became_peered":"2024-08-18T22:05:28.922809+0000","last_unstale":"2024-08-18T22:06:10.506329+0000","last_undegraded":"2024-08-18T22:06:10.506329+0000","last_fullsized":"2024-08-18T22:06:10.506329+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:26.416920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510283+0000","last_change":"2024-08-18T22:05:21.849075+0000","last_active":"2024-08-18T22:06:10.510283+0000","last_peered":"2024-08-18T22:06:10.510283+0000","last_clean":"2024-08-18T22:06:10.510283+0000","last_became_active":"2024-08-18T22:05:21.848759+0000","last_became_peered":"2024-08-18T22:05:21.848759+0000","last_unstale":"2024-08-18T22:06:10.510283+0000","last_undegraded":"2024-08-18T22:06:10.510283+0000","last_fullsized":"2024-08-18T22:06:10.510283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:26.531534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515145+0000","last_change":"2024-08-18T22:05:19.849210+0000","last_active":"2024-08-18T22:06:10.515145+0000","last_peered":"2024-08-18T22:06:10.515145+0000","last_clean":"2024-08-18T22:06:10.515145+0000","last_became_active":"2024-08-18T22:05:19.848829+0000","last_became_peered":"2024-08-18T22:05:19.848829+0000","last_unstale":"2024-08-18T22:06:10.515145+0000","last_undegraded":"2024-08-18T22:06:10.515145+0000","last_fullsized":"2024-08-18T22:06:10.515145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:19.321686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506551+0000","last_change":"2024-08-18T22:05:28.924577+0000","last_active":"2024-08-18T22:06:10.506551+0000","last_peered":"2024-08-18T22:06:10.506551+0000","last_clean":"2024-08-18T22:06:10.506551+0000","last_became_active":"2024-08-18T22:05:28.924183+0000","last_became_peered":"2024-08-18T22:05:28.924183+0000","last_unstale":"2024-08-18T22:06:10.506551+0000","last_undegraded":"2024-08-18T22:06:10.506551+0000","last_fullsized":"2024-08-18T22:06:10.506551+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:22.702757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513994+0000","last_change":"2024-08-18T22:06:10.513610+0000","last_active":"2024-08-18T22:06:10.513994+0000","last_peered":"2024-08-18T22:06:10.513994+0000","last_clean":"2024-08-18T22:06:10.513994+0000","last_became_active":"2024-08-18T22:06:10.513400+0000","last_became_peered":"2024-08-18T22:06:10.513400+0000","last_unstale":"2024-08-18T22:06:10.513994+0000","last_undegraded":"2024-08-18T22:06:10.513994+0000","last_fullsized":"2024-08-18T22:06:10.513994+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:49.275223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513546+0000","last_change":"2024-08-18T22:05:20.291752+0000","last_active":"2024-08-18T22:06:10.513546+0000","last_peered":"2024-08-18T22:06:10.513546+0000","last_clean":"2024-08-18T22:06:10.513546+0000","last_became_active":"2024-08-18T22:05:20.291431+0000","last_became_peered":"2024-08-18T22:05:20.291431+0000","last_unstale":"2024-08-18T22:06:10.513546+0000","last_undegraded":"2024-08-18T22:06:10.513546+0000","last_fullsized":"2024-08-18T22:06:10.513546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:32.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506003+0000","last_change":"2024-08-18T22:05:28.924121+0000","last_active":"2024-08-18T22:06:10.506003+0000","last_peered":"2024-08-18T22:06:10.506003+0000","last_clean":"2024-08-18T22:06:10.506003+0000","last_became_active":"2024-08-18T22:05:28.923753+0000","last_became_peered":"2024-08-18T22:05:28.923753+0000","last_unstale":"2024-08-18T22:06:10.506003+0000","last_undegraded":"2024-08-18T22:06:10.506003+0000","last_fullsized":"2024-08-18T22:06:10.506003+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:57.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507828+0000","last_change":"2024-08-18T22:05:21.858366+0000","last_active":"2024-08-18T22:06:10.507828+0000","last_peered":"2024-08-18T22:06:10.507828+0000","last_clean":"2024-08-18T22:06:10.507828+0000","last_became_active":"2024-08-18T22:05:21.858021+0000","last_became_peered":"2024-08-18T22:05:21.858021+0000","last_unstale":"2024-08-18T22:06:10.507828+0000","last_undegraded":"2024-08-18T22:06:10.507828+0000","last_fullsized":"2024-08-18T22:06:10.507828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:55.662965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'4","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:17.488271+0000","last_change":"2024-08-18T22:05:19.850013+0000","last_active":"2024-08-18T22:06:17.488271+0000","last_peered":"2024-08-18T22:06:17.488271+0000","last_clean":"2024-08-18T22:06:17.488271+0000","last_became_active":"2024-08-18T22:05:19.849551+0000","last_became_peered":"2024-08-18T22:05:19.849551+0000","last_unstale":"2024-08-18T22:06:17.488271+0000","last_undegraded":"2024-08-18T22:06:17.488271+0000","last_fullsized":"2024-08-18T22:06:17.488271+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:15.182999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509627+0000","last_change":"2024-08-18T22:05:28.927318+0000","last_active":"2024-08-18T22:06:10.509627+0000","last_peered":"2024-08-18T22:06:10.509627+0000","last_clean":"2024-08-18T22:06:10.509627+0000","last_became_active":"2024-08-18T22:05:28.926786+0000","last_became_peered":"2024-08-18T22:05:28.926786+0000","last_unstale":"2024-08-18T22:06:10.509627+0000","last_undegraded":"2024-08-18T22:06:10.509627+0000","last_fullsized":"2024-08-18T22:06:10.509627+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:45.798247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511821+0000","last_change":"2024-08-18T22:06:10.511821+0000","last_active":"2024-08-18T22:06:10.511821+0000","last_peered":"2024-08-18T22:06:10.511821+0000","last_clean":"2024-08-18T22:06:10.511821+0000","last_became_active":"2024-08-18T22:06:10.511135+0000","last_became_peered":"2024-08-18T22:06:10.511135+0000","last_unstale":"2024-08-18T22:06:10.511821+0000","last_undegraded":"2024-08-18T22:06:10.511821+0000","last_fullsized":"2024-08-18T22:06:10.511821+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:07.108531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506959+0000","last_change":"2024-08-18T22:05:19.844061+0000","last_active":"2024-08-18T22:06:10.506959+0000","last_peered":"2024-08-18T22:06:10.506959+0000","last_clean":"2024-08-18T22:06:10.506959+0000","last_became_active":"2024-08-18T22:05:19.843513+0000","last_became_peered":"2024-08-18T22:05:19.843513+0000","last_unstale":"2024-08-18T22:06:10.506959+0000","last_undegraded":"2024-08-18T22:06:10.506959+0000","last_fullsized":"2024-08-18T22:06:10.506959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:53.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510069+0000","last_change":"2024-08-18T22:05:28.922986+0000","last_active":"2024-08-18T22:06:10.510069+0000","last_peered":"2024-08-18T22:06:10.510069+0000","last_clean":"2024-08-18T22:06:10.510069+0000","last_became_active":"2024-08-18T22:05:28.922322+0000","last_became_peered":"2024-08-18T22:05:28.922322+0000","last_unstale":"2024-08-18T22:06:10.510069+0000","last_undegraded":"2024-08-18T22:06:10.510069+0000","last_fullsized":"2024-08-18T22:06:10.510069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:28.168299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505649+0000","last_change":"2024-08-18T22:05:21.853389+0000","last_active":"2024-08-18T22:06:10.505649+0000","last_peered":"2024-08-18T22:06:10.505649+0000","last_clean":"2024-08-18T22:06:10.505649+0000","last_became_active":"2024-08-18T22:05:21.853095+0000","last_became_peered":"2024-08-18T22:05:21.853095+0000","last_unstale":"2024-08-18T22:06:10.505649+0000","last_undegraded":"2024-08-18T22:06:10.505649+0000","last_fullsized":"2024-08-18T22:06:10.505649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:14.126983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508891+0000","last_change":"2024-08-18T22:05:19.846788+0000","last_active":"2024-08-18T22:06:10.508891+0000","last_peered":"2024-08-18T22:06:10.508891+0000","last_clean":"2024-08-18T22:06:10.508891+0000","last_became_active":"2024-08-18T22:05:19.846248+0000","last_became_peered":"2024-08-18T22:05:19.846248+0000","last_unstale":"2024-08-18T22:06:10.508891+0000","last_undegraded":"2024-08-18T22:06:10.508891+0000","last_fullsized":"2024-08-18T22:06:10.508891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:46.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507672+0000","last_change":"2024-08-18T22:05:28.920294+0000","last_active":"2024-08-18T22:06:10.507672+0000","last_peered":"2024-08-18T22:06:10.507672+0000","last_clean":"2024-08-18T22:06:10.507672+0000","last_became_active":"2024-08-18T22:05:28.919351+0000","last_became_peered":"2024-08-18T22:05:28.919351+0000","last_unstale":"2024-08-18T22:06:10.507672+0000","last_undegraded":"2024-08-18T22:06:10.507672+0000","last_fullsized":"2024-08-18T22:06:10.507672+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:49.425281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514189+0000","last_change":"2024-08-18T22:05:21.864529+0000","last_active":"2024-08-18T22:06:10.514189+0000","last_peered":"2024-08-18T22:06:10.514189+0000","last_clean":"2024-08-18T22:06:10.514189+0000","last_became_active":"2024-08-18T22:05:21.864062+0000","last_became_peered":"2024-08-18T22:05:21.864062+0000","last_unstale":"2024-08-18T22:06:10.514189+0000","last_undegraded":"2024-08-18T22:06:10.514189+0000","last_fullsized":"2024-08-18T22:06:10.514189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:24:49.037343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'31","reported_seq":133,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:18.530275+0000","last_change":"2024-08-18T22:06:10.522113+0000","last_active":"2024-08-18T22:06:18.530275+0000","last_peered":"2024-08-18T22:06:18.530275+0000","last_clean":"2024-08-18T22:06:18.530275+0000","last_became_active":"2024-08-18T22:06:10.514837+0000","last_became_peered":"2024-08-18T22:06:10.514837+0000","last_unstale":"2024-08-18T22:06:18.530275+0000","last_undegraded":"2024-08-18T22:06:18.530275+0000","last_fullsized":"2024-08-18T22:06:18.530275+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:46.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61517,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":77,"num_write":32,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508344+0000","last_change":"2024-08-18T22:05:28.926357+0000","last_active":"2024-08-18T22:06:10.508344+0000","last_peered":"2024-08-18T22:06:10.508344+0000","last_clean":"2024-08-18T22:06:10.508344+0000","last_became_active":"2024-08-18T22:05:28.926016+0000","last_became_peered":"2024-08-18T22:05:28.926016+0000","last_unstale":"2024-08-18T22:06:10.508344+0000","last_undegraded":"2024-08-18T22:06:10.508344+0000","last_fullsized":"2024-08-18T22:06:10.508344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:16.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506937+0000","last_change":"2024-08-18T22:05:21.860237+0000","last_active":"2024-08-18T22:06:10.506937+0000","last_peered":"2024-08-18T22:06:10.506937+0000","last_clean":"2024-08-18T22:06:10.506937+0000","last_became_active":"2024-08-18T22:05:21.859919+0000","last_became_peered":"2024-08-18T22:05:21.859919+0000","last_unstale":"2024-08-18T22:06:10.506937+0000","last_undegraded":"2024-08-18T22:06:10.506937+0000","last_fullsized":"2024-08-18T22:06:10.506937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:21.048413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507852+0000","last_change":"2024-08-18T22:05:20.291233+0000","last_active":"2024-08-18T22:06:10.507852+0000","last_peered":"2024-08-18T22:06:10.507852+0000","last_clean":"2024-08-18T22:06:10.507852+0000","last_became_active":"2024-08-18T22:05:20.290893+0000","last_became_peered":"2024-08-18T22:05:20.290893+0000","last_unstale":"2024-08-18T22:06:10.507852+0000","last_undegraded":"2024-08-18T22:06:10.507852+0000","last_fullsized":"2024-08-18T22:06:10.507852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:36.889561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510634+0000","last_change":"2024-08-18T22:05:28.923076+0000","last_active":"2024-08-18T22:06:10.510634+0000","last_peered":"2024-08-18T22:06:10.510634+0000","last_clean":"2024-08-18T22:06:10.510634+0000","last_became_active":"2024-08-18T22:05:28.922688+0000","last_became_peered":"2024-08-18T22:05:28.922688+0000","last_unstale":"2024-08-18T22:06:10.510634+0000","last_undegraded":"2024-08-18T22:06:10.510634+0000","last_fullsized":"2024-08-18T22:06:10.510634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:34.360540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509085+0000","last_change":"2024-08-18T22:05:21.855174+0000","last_active":"2024-08-18T22:06:10.509085+0000","last_peered":"2024-08-18T22:06:10.509085+0000","last_clean":"2024-08-18T22:06:10.509085+0000","last_became_active":"2024-08-18T22:05:21.854818+0000","last_became_peered":"2024-08-18T22:05:21.854818+0000","last_unstale":"2024-08-18T22:06:10.509085+0000","last_undegraded":"2024-08-18T22:06:10.509085+0000","last_fullsized":"2024-08-18T22:06:10.509085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:48:55.094624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508468+0000","last_change":"2024-08-18T22:05:19.847876+0000","last_active":"2024-08-18T22:06:10.508468+0000","last_peered":"2024-08-18T22:06:10.508468+0000","last_clean":"2024-08-18T22:06:10.508468+0000","last_became_active":"2024-08-18T22:05:19.847505+0000","last_became_peered":"2024-08-18T22:05:19.847505+0000","last_unstale":"2024-08-18T22:06:10.508468+0000","last_undegraded":"2024-08-18T22:06:10.508468+0000","last_fullsized":"2024-08-18T22:06:10.508468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:50:15.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508005+0000","last_change":"2024-08-18T22:05:28.921647+0000","last_active":"2024-08-18T22:06:10.508005+0000","last_peered":"2024-08-18T22:06:10.508005+0000","last_clean":"2024-08-18T22:06:10.508005+0000","last_became_active":"2024-08-18T22:05:28.921305+0000","last_became_peered":"2024-08-18T22:05:28.921305+0000","last_unstale":"2024-08-18T22:06:10.508005+0000","last_undegraded":"2024-08-18T22:06:10.508005+0000","last_fullsized":"2024-08-18T22:06:10.508005+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:29.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506841+0000","last_change":"2024-08-18T22:05:21.861151+0000","last_active":"2024-08-18T22:06:10.506841+0000","last_peered":"2024-08-18T22:06:10.506841+0000","last_clean":"2024-08-18T22:06:10.506841+0000","last_became_active":"2024-08-18T22:05:21.860834+0000","last_became_peered":"2024-08-18T22:05:21.860834+0000","last_unstale":"2024-08-18T22:06:10.506841+0000","last_undegraded":"2024-08-18T22:06:10.506841+0000","last_fullsized":"2024-08-18T22:06:10.506841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:32.890750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:17.488308+0000","last_change":"2024-08-18T22:05:19.846145+0000","last_active":"2024-08-18T22:06:17.488308+0000","last_peered":"2024-08-18T22:06:17.488308+0000","last_clean":"2024-08-18T22:06:17.488308+0000","last_became_active":"2024-08-18T22:05:19.845711+0000","last_became_peered":"2024-08-18T22:05:19.845711+0000","last_unstale":"2024-08-18T22:06:17.488308+0000","last_undegraded":"2024-08-18T22:06:17.488308+0000","last_fullsized":"2024-08-18T22:06:17.488308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:20.376131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771915+0000","last_change":"2024-08-18T22:05:28.923256+0000","last_active":"2024-08-18T22:06:10.771915+0000","last_peered":"2024-08-18T22:06:10.771915+0000","last_clean":"2024-08-18T22:06:10.771915+0000","last_became_active":"2024-08-18T22:05:28.922845+0000","last_became_peered":"2024-08-18T22:05:28.922845+0000","last_unstale":"2024-08-18T22:06:10.771915+0000","last_undegraded":"2024-08-18T22:06:10.771915+0000","last_fullsized":"2024-08-18T22:06:10.771915+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:41.930937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508677+0000","last_change":"2024-08-18T22:05:28.924743+0000","last_active":"2024-08-18T22:06:10.508677+0000","last_peered":"2024-08-18T22:06:10.508677+0000","last_clean":"2024-08-18T22:06:10.508677+0000","last_became_active":"2024-08-18T22:05:28.923674+0000","last_became_peered":"2024-08-18T22:05:28.923674+0000","last_unstale":"2024-08-18T22:06:10.508677+0000","last_undegraded":"2024-08-18T22:06:10.508677+0000","last_fullsized":"2024-08-18T22:06:10.508677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:19.834998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508496+0000","last_change":"2024-08-18T22:05:21.857194+0000","last_active":"2024-08-18T22:06:10.508496+0000","last_peered":"2024-08-18T22:06:10.508496+0000","last_clean":"2024-08-18T22:06:10.508496+0000","last_became_active":"2024-08-18T22:05:21.856916+0000","last_became_peered":"2024-08-18T22:05:21.856916+0000","last_unstale":"2024-08-18T22:06:10.508496+0000","last_undegraded":"2024-08-18T22:06:10.508496+0000","last_fullsized":"2024-08-18T22:06:10.508496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:24.759501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506570+0000","last_change":"2024-08-18T22:05:19.844919+0000","last_active":"2024-08-18T22:06:10.506570+0000","last_peered":"2024-08-18T22:06:10.506570+0000","last_clean":"2024-08-18T22:06:10.506570+0000","last_became_active":"2024-08-18T22:05:19.844539+0000","last_became_peered":"2024-08-18T22:05:19.844539+0000","last_unstale":"2024-08-18T22:06:10.506570+0000","last_undegraded":"2024-08-18T22:06:10.506570+0000","last_fullsized":"2024-08-18T22:06:10.506570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:01.598535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510256+0000","last_change":"2024-08-18T22:05:28.923304+0000","last_active":"2024-08-18T22:06:10.510256+0000","last_peered":"2024-08-18T22:06:10.510256+0000","last_clean":"2024-08-18T22:06:10.510256+0000","last_became_active":"2024-08-18T22:05:28.922912+0000","last_became_peered":"2024-08-18T22:05:28.922912+0000","last_unstale":"2024-08-18T22:06:10.510256+0000","last_undegraded":"2024-08-18T22:06:10.510256+0000","last_fullsized":"2024-08-18T22:06:10.510256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:24:47.834354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771950+0000","last_change":"2024-08-18T22:05:21.849448+0000","last_active":"2024-08-18T22:06:10.771950+0000","last_peered":"2024-08-18T22:06:10.771950+0000","last_clean":"2024-08-18T22:06:10.771950+0000","last_became_active":"2024-08-18T22:05:21.849154+0000","last_became_peered":"2024-08-18T22:05:21.849154+0000","last_unstale":"2024-08-18T22:06:10.771950+0000","last_undegraded":"2024-08-18T22:06:10.771950+0000","last_fullsized":"2024-08-18T22:06:10.771950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:38.583121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505540+0000","last_change":"2024-08-18T22:05:19.848483+0000","last_active":"2024-08-18T22:06:10.505540+0000","last_peered":"2024-08-18T22:06:10.505540+0000","last_clean":"2024-08-18T22:06:10.505540+0000","last_became_active":"2024-08-18T22:05:19.848190+0000","last_became_peered":"2024-08-18T22:05:19.848190+0000","last_unstale":"2024-08-18T22:06:10.505540+0000","last_undegraded":"2024-08-18T22:06:10.505540+0000","last_fullsized":"2024-08-18T22:06:10.505540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:01.719565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509148+0000","last_change":"2024-08-18T22:05:19.843796+0000","last_active":"2024-08-18T22:06:10.509148+0000","last_peered":"2024-08-18T22:06:10.509148+0000","last_clean":"2024-08-18T22:06:10.509148+0000","last_became_active":"2024-08-18T22:05:19.843495+0000","last_became_peered":"2024-08-18T22:05:19.843495+0000","last_unstale":"2024-08-18T22:06:10.509148+0000","last_undegraded":"2024-08-18T22:06:10.509148+0000","last_fullsized":"2024-08-18T22:06:10.509148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:21.583561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507269+0000","last_change":"2024-08-18T22:05:21.856370+0000","last_active":"2024-08-18T22:06:10.507269+0000","last_peered":"2024-08-18T22:06:10.507269+0000","last_clean":"2024-08-18T22:06:10.507269+0000","last_became_active":"2024-08-18T22:05:21.855954+0000","last_became_peered":"2024-08-18T22:05:21.855954+0000","last_unstale":"2024-08-18T22:06:10.507269+0000","last_undegraded":"2024-08-18T22:06:10.507269+0000","last_fullsized":"2024-08-18T22:06:10.507269+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:30.828305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.516344+0000","last_change":"2024-08-18T22:06:10.516344+0000","last_active":"2024-08-18T22:06:10.516344+0000","last_peered":"2024-08-18T22:06:10.516344+0000","last_clean":"2024-08-18T22:06:10.516344+0000","last_became_active":"2024-08-18T22:06:10.515925+0000","last_became_peered":"2024-08-18T22:06:10.515925+0000","last_unstale":"2024-08-18T22:06:10.516344+0000","last_undegraded":"2024-08-18T22:06:10.516344+0000","last_fullsized":"2024-08-18T22:06:10.516344+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:41:07.585521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:18.490104+0000","last_change":"2024-08-18T22:05:19.846860+0000","last_active":"2024-08-18T22:06:18.490104+0000","last_peered":"2024-08-18T22:06:18.490104+0000","last_clean":"2024-08-18T22:06:18.490104+0000","last_became_active":"2024-08-18T22:05:19.846496+0000","last_became_peered":"2024-08-18T22:05:19.846496+0000","last_unstale":"2024-08-18T22:06:18.490104+0000","last_undegraded":"2024-08-18T22:06:18.490104+0000","last_fullsized":"2024-08-18T22:06:18.490104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:16.555137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513529+0000","last_change":"2024-08-18T22:05:21.849058+0000","last_active":"2024-08-18T22:06:10.513529+0000","last_peered":"2024-08-18T22:06:10.513529+0000","last_clean":"2024-08-18T22:06:10.513529+0000","last_became_active":"2024-08-18T22:05:21.848703+0000","last_became_peered":"2024-08-18T22:05:21.848703+0000","last_unstale":"2024-08-18T22:06:10.513529+0000","last_undegraded":"2024-08-18T22:06:10.513529+0000","last_fullsized":"2024-08-18T22:06:10.513529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:10.024156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508916+0000","last_change":"2024-08-18T22:05:28.922968+0000","last_active":"2024-08-18T22:06:10.508916+0000","last_peered":"2024-08-18T22:06:10.508916+0000","last_clean":"2024-08-18T22:06:10.508916+0000","last_became_active":"2024-08-18T22:05:28.922378+0000","last_became_peered":"2024-08-18T22:05:28.922378+0000","last_unstale":"2024-08-18T22:06:10.508916+0000","last_undegraded":"2024-08-18T22:06:10.508916+0000","last_fullsized":"2024-08-18T22:06:10.508916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:23:07.241028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509985+0000","last_change":"2024-08-18T22:05:21.858572+0000","last_active":"2024-08-18T22:06:10.509985+0000","last_peered":"2024-08-18T22:06:10.509985+0000","last_clean":"2024-08-18T22:06:10.509985+0000","last_became_active":"2024-08-18T22:05:21.858254+0000","last_became_peered":"2024-08-18T22:05:21.858254+0000","last_unstale":"2024-08-18T22:06:10.509985+0000","last_undegraded":"2024-08-18T22:06:10.509985+0000","last_fullsized":"2024-08-18T22:06:10.509985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:52.456087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509101+0000","last_change":"2024-08-18T22:05:21.856710+0000","last_active":"2024-08-18T22:06:10.509101+0000","last_peered":"2024-08-18T22:06:10.509101+0000","last_clean":"2024-08-18T22:06:10.509101+0000","last_became_active":"2024-08-18T22:05:21.855399+0000","last_became_peered":"2024-08-18T22:05:21.855399+0000","last_unstale":"2024-08-18T22:06:10.509101+0000","last_undegraded":"2024-08-18T22:06:10.509101+0000","last_fullsized":"2024-08-18T22:06:10.509101+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:36.039953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507843+0000","last_change":"2024-08-18T22:05:21.856085+0000","last_active":"2024-08-18T22:06:10.507843+0000","last_peered":"2024-08-18T22:06:10.507843+0000","last_clean":"2024-08-18T22:06:10.507843+0000","last_became_active":"2024-08-18T22:05:21.855263+0000","last_became_peered":"2024-08-18T22:05:21.855263+0000","last_unstale":"2024-08-18T22:06:10.507843+0000","last_undegraded":"2024-08-18T22:06:10.507843+0000","last_fullsized":"2024-08-18T22:06:10.507843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:31.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509110+0000","last_change":"2024-08-18T22:05:21.855385+0000","last_active":"2024-08-18T22:06:10.509110+0000","last_peered":"2024-08-18T22:06:10.509110+0000","last_clean":"2024-08-18T22:06:10.509110+0000","last_became_active":"2024-08-18T22:05:21.854829+0000","last_became_peered":"2024-08-18T22:05:21.854829+0000","last_unstale":"2024-08-18T22:06:10.509110+0000","last_undegraded":"2024-08-18T22:06:10.509110+0000","last_fullsized":"2024-08-18T22:06:10.509110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:59.704154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510370+0000","last_change":"2024-08-18T22:06:10.510370+0000","last_active":"2024-08-18T22:06:10.510370+0000","last_peered":"2024-08-18T22:06:10.510370+0000","last_clean":"2024-08-18T22:06:10.510370+0000","last_became_active":"2024-08-18T22:06:10.509829+0000","last_became_peered":"2024-08-18T22:06:10.509829+0000","last_unstale":"2024-08-18T22:06:10.510370+0000","last_undegraded":"2024-08-18T22:06:10.510370+0000","last_fullsized":"2024-08-18T22:06:10.510370+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:20.171834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510420+0000","last_change":"2024-08-18T22:05:21.856137+0000","last_active":"2024-08-18T22:06:10.510420+0000","last_peered":"2024-08-18T22:06:10.510420+0000","last_clean":"2024-08-18T22:06:10.510420+0000","last_became_active":"2024-08-18T22:05:21.855425+0000","last_became_peered":"2024-08-18T22:05:21.855425+0000","last_unstale":"2024-08-18T22:06:10.510420+0000","last_undegraded":"2024-08-18T22:06:10.510420+0000","last_fullsized":"2024-08-18T22:06:10.510420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:37.514710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509024+0000","last_change":"2024-08-18T22:05:21.856084+0000","last_active":"2024-08-18T22:06:10.509024+0000","last_peered":"2024-08-18T22:06:10.509024+0000","last_clean":"2024-08-18T22:06:10.509024+0000","last_became_active":"2024-08-18T22:05:21.855779+0000","last_became_peered":"2024-08-18T22:05:21.855779+0000","last_unstale":"2024-08-18T22:06:10.509024+0000","last_undegraded":"2024-08-18T22:06:10.509024+0000","last_fullsized":"2024-08-18T22:06:10.509024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:02:47.833634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772328+0000","last_change":"2024-08-18T22:05:21.856729+0000","last_active":"2024-08-18T22:06:10.772328+0000","last_peered":"2024-08-18T22:06:10.772328+0000","last_clean":"2024-08-18T22:06:10.772328+0000","last_became_active":"2024-08-18T22:05:21.856446+0000","last_became_peered":"2024-08-18T22:05:21.856446+0000","last_unstale":"2024-08-18T22:06:10.772328+0000","last_undegraded":"2024-08-18T22:06:10.772328+0000","last_fullsized":"2024-08-18T22:06:10.772328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.482225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506405+0000","last_change":"2024-08-18T22:05:21.851772+0000","last_active":"2024-08-18T22:06:10.506405+0000","last_peered":"2024-08-18T22:06:10.506405+0000","last_clean":"2024-08-18T22:06:10.506405+0000","last_became_active":"2024-08-18T22:05:21.851417+0000","last_became_peered":"2024-08-18T22:05:21.851417+0000","last_unstale":"2024-08-18T22:06:10.506405+0000","last_undegraded":"2024-08-18T22:06:10.506405+0000","last_fullsized":"2024-08-18T22:06:10.506405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:32.509318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771984+0000","last_change":"2024-08-18T22:05:21.857887+0000","last_active":"2024-08-18T22:06:10.771984+0000","last_peered":"2024-08-18T22:06:10.771984+0000","last_clean":"2024-08-18T22:06:10.771984+0000","last_became_active":"2024-08-18T22:05:21.857585+0000","last_became_peered":"2024-08-18T22:05:21.857585+0000","last_unstale":"2024-08-18T22:06:10.771984+0000","last_undegraded":"2024-08-18T22:06:10.771984+0000","last_fullsized":"2024-08-18T22:06:10.771984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:23.299033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506488+0000","last_change":"2024-08-18T22:05:21.854626+0000","last_active":"2024-08-18T22:06:10.506488+0000","last_peered":"2024-08-18T22:06:10.506488+0000","last_clean":"2024-08-18T22:06:10.506488+0000","last_became_active":"2024-08-18T22:05:21.854290+0000","last_became_peered":"2024-08-18T22:05:21.854290+0000","last_unstale":"2024-08-18T22:06:10.506488+0000","last_undegraded":"2024-08-18T22:06:10.506488+0000","last_fullsized":"2024-08-18T22:06:10.506488+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:45:24.988669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505825+0000","last_change":"2024-08-18T22:05:21.865863+0000","last_active":"2024-08-18T22:06:10.505825+0000","last_peered":"2024-08-18T22:06:10.505825+0000","last_clean":"2024-08-18T22:06:10.505825+0000","last_became_active":"2024-08-18T22:05:21.864634+0000","last_became_peered":"2024-08-18T22:05:21.864634+0000","last_unstale":"2024-08-18T22:06:10.505825+0000","last_undegraded":"2024-08-18T22:06:10.505825+0000","last_fullsized":"2024-08-18T22:06:10.505825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:34.051147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510087+0000","last_change":"2024-08-18T22:05:21.860193+0000","last_active":"2024-08-18T22:06:10.510087+0000","last_peered":"2024-08-18T22:06:10.510087+0000","last_clean":"2024-08-18T22:06:10.510087+0000","last_became_active":"2024-08-18T22:05:21.859761+0000","last_became_peered":"2024-08-18T22:05:21.859761+0000","last_unstale":"2024-08-18T22:06:10.510087+0000","last_undegraded":"2024-08-18T22:06:10.510087+0000","last_fullsized":"2024-08-18T22:06:10.510087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:18.465913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509086+0000","last_change":"2024-08-18T22:05:21.860569+0000","last_active":"2024-08-18T22:06:10.509086+0000","last_peered":"2024-08-18T22:06:10.509086+0000","last_clean":"2024-08-18T22:06:10.509086+0000","last_became_active":"2024-08-18T22:05:21.860250+0000","last_became_peered":"2024-08-18T22:05:21.860250+0000","last_unstale":"2024-08-18T22:06:10.509086+0000","last_undegraded":"2024-08-18T22:06:10.509086+0000","last_fullsized":"2024-08-18T22:06:10.509086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:52.097840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509523+0000","last_change":"2024-08-18T22:05:21.858271+0000","last_active":"2024-08-18T22:06:10.509523+0000","last_peered":"2024-08-18T22:06:10.509523+0000","last_clean":"2024-08-18T22:06:10.509523+0000","last_became_active":"2024-08-18T22:05:21.857968+0000","last_became_peered":"2024-08-18T22:05:21.857968+0000","last_unstale":"2024-08-18T22:06:10.509523+0000","last_undegraded":"2024-08-18T22:06:10.509523+0000","last_fullsized":"2024-08-18T22:06:10.509523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:24.023136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510630+0000","last_change":"2024-08-18T22:05:21.853799+0000","last_active":"2024-08-18T22:06:10.510630+0000","last_peered":"2024-08-18T22:06:10.510630+0000","last_clean":"2024-08-18T22:06:10.510630+0000","last_became_active":"2024-08-18T22:05:21.853432+0000","last_became_peered":"2024-08-18T22:05:21.853432+0000","last_unstale":"2024-08-18T22:06:10.510630+0000","last_undegraded":"2024-08-18T22:06:10.510630+0000","last_fullsized":"2024-08-18T22:06:10.510630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:07.429169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506002+0000","last_change":"2024-08-18T22:05:21.855117+0000","last_active":"2024-08-18T22:06:10.506002+0000","last_peered":"2024-08-18T22:06:10.506002+0000","last_clean":"2024-08-18T22:06:10.506002+0000","last_became_active":"2024-08-18T22:05:21.854041+0000","last_became_peered":"2024-08-18T22:05:21.854041+0000","last_unstale":"2024-08-18T22:06:10.506002+0000","last_undegraded":"2024-08-18T22:06:10.506002+0000","last_fullsized":"2024-08-18T22:06:10.506002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:17.222658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508062+0000","last_change":"2024-08-18T22:05:21.861745+0000","last_active":"2024-08-18T22:06:10.508062+0000","last_peered":"2024-08-18T22:06:10.508062+0000","last_clean":"2024-08-18T22:06:10.508062+0000","last_became_active":"2024-08-18T22:05:21.861427+0000","last_became_peered":"2024-08-18T22:05:21.861427+0000","last_unstale":"2024-08-18T22:06:10.508062+0000","last_undegraded":"2024-08-18T22:06:10.508062+0000","last_fullsized":"2024-08-18T22:06:10.508062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:17.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508302+0000","last_change":"2024-08-18T22:05:21.860046+0000","last_active":"2024-08-18T22:06:10.508302+0000","last_peered":"2024-08-18T22:06:10.508302+0000","last_clean":"2024-08-18T22:06:10.508302+0000","last_became_active":"2024-08-18T22:05:21.859674+0000","last_became_peered":"2024-08-18T22:05:21.859674+0000","last_unstale":"2024-08-18T22:06:10.508302+0000","last_undegraded":"2024-08-18T22:06:10.508302+0000","last_fullsized":"2024-08-18T22:06:10.508302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:44.615270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505796+0000","last_change":"2024-08-18T22:05:21.847647+0000","last_active":"2024-08-18T22:06:10.505796+0000","last_peered":"2024-08-18T22:06:10.505796+0000","last_clean":"2024-08-18T22:06:10.505796+0000","last_became_active":"2024-08-18T22:05:21.847367+0000","last_became_peered":"2024-08-18T22:05:21.847367+0000","last_unstale":"2024-08-18T22:06:10.505796+0000","last_undegraded":"2024-08-18T22:06:10.505796+0000","last_fullsized":"2024-08-18T22:06:10.505796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:33.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.512325+0000","last_change":"2024-08-18T22:05:21.861326+0000","last_active":"2024-08-18T22:06:10.512325+0000","last_peered":"2024-08-18T22:06:10.512325+0000","last_clean":"2024-08-18T22:06:10.512325+0000","last_became_active":"2024-08-18T22:05:21.860968+0000","last_became_peered":"2024-08-18T22:05:21.860968+0000","last_unstale":"2024-08-18T22:06:10.512325+0000","last_undegraded":"2024-08-18T22:06:10.512325+0000","last_fullsized":"2024-08-18T22:06:10.512325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:49.150670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508590+0000","last_change":"2024-08-18T22:05:21.852618+0000","last_active":"2024-08-18T22:06:10.508590+0000","last_peered":"2024-08-18T22:06:10.508590+0000","last_clean":"2024-08-18T22:06:10.508590+0000","last_became_active":"2024-08-18T22:05:21.852318+0000","last_became_peered":"2024-08-18T22:05:21.852318+0000","last_unstale":"2024-08-18T22:06:10.508590+0000","last_undegraded":"2024-08-18T22:06:10.508590+0000","last_fullsized":"2024-08-18T22:06:10.508590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:06:49.085150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509956+0000","last_change":"2024-08-18T22:05:21.860108+0000","last_active":"2024-08-18T22:06:10.509956+0000","last_peered":"2024-08-18T22:06:10.509956+0000","last_clean":"2024-08-18T22:06:10.509956+0000","last_became_active":"2024-08-18T22:05:21.859794+0000","last_became_peered":"2024-08-18T22:05:21.859794+0000","last_unstale":"2024-08-18T22:06:10.509956+0000","last_undegraded":"2024-08-18T22:06:10.509956+0000","last_fullsized":"2024-08-18T22:06:10.509956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:01.974202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507181+0000","last_change":"2024-08-18T22:05:21.856404+0000","last_active":"2024-08-18T22:06:10.507181+0000","last_peered":"2024-08-18T22:06:10.507181+0000","last_clean":"2024-08-18T22:06:10.507181+0000","last_became_active":"2024-08-18T22:05:21.855800+0000","last_became_peered":"2024-08-18T22:05:21.855800+0000","last_unstale":"2024-08-18T22:06:10.507181+0000","last_undegraded":"2024-08-18T22:06:10.507181+0000","last_fullsized":"2024-08-18T22:06:10.507181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:09.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771944+0000","last_change":"2024-08-18T22:05:21.859891+0000","last_active":"2024-08-18T22:06:10.771944+0000","last_peered":"2024-08-18T22:06:10.771944+0000","last_clean":"2024-08-18T22:06:10.771944+0000","last_became_active":"2024-08-18T22:05:21.859407+0000","last_became_peered":"2024-08-18T22:05:21.859407+0000","last_unstale":"2024-08-18T22:06:10.771944+0000","last_undegraded":"2024-08-18T22:06:10.771944+0000","last_fullsized":"2024-08-18T22:06:10.771944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:59.285627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508099+0000","last_change":"2024-08-18T22:05:21.856428+0000","last_active":"2024-08-18T22:06:10.508099+0000","last_peered":"2024-08-18T22:06:10.508099+0000","last_clean":"2024-08-18T22:06:10.508099+0000","last_became_active":"2024-08-18T22:05:21.853374+0000","last_became_peered":"2024-08-18T22:05:21.853374+0000","last_unstale":"2024-08-18T22:06:10.508099+0000","last_undegraded":"2024-08-18T22:06:10.508099+0000","last_fullsized":"2024-08-18T22:06:10.508099+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:07.087171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509021+0000","last_change":"2024-08-18T22:05:21.852688+0000","last_active":"2024-08-18T22:06:10.509021+0000","last_peered":"2024-08-18T22:06:10.509021+0000","last_clean":"2024-08-18T22:06:10.509021+0000","last_became_active":"2024-08-18T22:05:21.851107+0000","last_became_peered":"2024-08-18T22:05:21.851107+0000","last_unstale":"2024-08-18T22:06:10.509021+0000","last_undegraded":"2024-08-18T22:06:10.509021+0000","last_fullsized":"2024-08-18T22:06:10.509021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:48.267166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513864+0000","last_change":"2024-08-18T22:05:21.850809+0000","last_active":"2024-08-18T22:06:10.513864+0000","last_peered":"2024-08-18T22:06:10.513864+0000","last_clean":"2024-08-18T22:06:10.513864+0000","last_became_active":"2024-08-18T22:05:21.850510+0000","last_became_peered":"2024-08-18T22:05:21.850510+0000","last_unstale":"2024-08-18T22:06:10.513864+0000","last_undegraded":"2024-08-18T22:06:10.513864+0000","last_fullsized":"2024-08-18T22:06:10.513864+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:39.338051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.512225+0000","last_change":"2024-08-18T22:05:21.856156+0000","last_active":"2024-08-18T22:06:10.512225+0000","last_peered":"2024-08-18T22:06:10.512225+0000","last_clean":"2024-08-18T22:06:10.512225+0000","last_became_active":"2024-08-18T22:05:21.855830+0000","last_became_peered":"2024-08-18T22:05:21.855830+0000","last_unstale":"2024-08-18T22:06:10.512225+0000","last_undegraded":"2024-08-18T22:06:10.512225+0000","last_fullsized":"2024-08-18T22:06:10.512225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:10.670405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508858+0000","last_change":"2024-08-18T22:05:21.865162+0000","last_active":"2024-08-18T22:06:10.508858+0000","last_peered":"2024-08-18T22:06:10.508858+0000","last_clean":"2024-08-18T22:06:10.508858+0000","last_became_active":"2024-08-18T22:05:21.864842+0000","last_became_peered":"2024-08-18T22:05:21.864842+0000","last_unstale":"2024-08-18T22:06:10.508858+0000","last_undegraded":"2024-08-18T22:06:10.508858+0000","last_fullsized":"2024-08-18T22:06:10.508858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:21.388638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508777+0000","last_change":"2024-08-18T22:05:21.859227+0000","last_active":"2024-08-18T22:06:10.508777+0000","last_peered":"2024-08-18T22:06:10.508777+0000","last_clean":"2024-08-18T22:06:10.508777+0000","last_became_active":"2024-08-18T22:05:21.858886+0000","last_became_peered":"2024-08-18T22:05:21.858886+0000","last_unstale":"2024-08-18T22:06:10.508777+0000","last_undegraded":"2024-08-18T22:06:10.508777+0000","last_fullsized":"2024-08-18T22:06:10.508777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:08.710772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510562+0000","last_change":"2024-08-18T22:05:21.854864+0000","last_active":"2024-08-18T22:06:10.510562+0000","last_peered":"2024-08-18T22:06:10.510562+0000","last_clean":"2024-08-18T22:06:10.510562+0000","last_became_active":"2024-08-18T22:05:21.854522+0000","last_became_peered":"2024-08-18T22:05:21.854522+0000","last_unstale":"2024-08-18T22:06:10.510562+0000","last_undegraded":"2024-08-18T22:06:10.510562+0000","last_fullsized":"2024-08-18T22:06:10.510562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:32.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65907,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":147,"num_read_kb":136,"num_write":166,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514518,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":504444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743453,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32848,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712304,"statfs":{"total":95995035648,"available":95961399296,"internally_reserved":0,"allocated":1712128,"data_stored":1157715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906977,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":504680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168614,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":504600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397546,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1100898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561071,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":499856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790003,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1638400,"data_stored":1096096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953528,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1097728,"data_stored":566413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182460,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1028096,"data_stored":500050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":501506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1081344,"data_stored":561283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":501244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:06:23.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:23 smithi183 ceph-mon[22097]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:06:23.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:23 smithi123 ceph-mon[18462]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:06:23.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:23 smithi130 ceph-mon[21698]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:06:24.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:24 smithi183 ceph-mon[22097]: pgmap v297: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.4 KiB/s wr, 5 op/s; 4.0 KiB/s, 0 objects/s recovering 2024-08-18T22:06:24.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:24 smithi123 ceph-mon[18462]: pgmap v297: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.4 KiB/s wr, 5 op/s; 4.0 KiB/s, 0 objects/s recovering 2024-08-18T22:06:24.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:24 smithi130 ceph-mon[21698]: pgmap v297: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.4 KiB/s wr, 5 op/s; 4.0 KiB/s, 0 objects/s recovering 2024-08-18T22:06:25.694 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-18T22:06:25.957 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:26.250 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:25 smithi123 ceph-mon[18462]: pgmap v298: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 7 op/s; 4.0 KiB/s, 0 objects/s recovering 2024-08-18T22:06:26.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:25 smithi130 ceph-mon[21698]: pgmap v298: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 7 op/s; 4.0 KiB/s, 0 objects/s recovering 2024-08-18T22:06:26.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:25 smithi183 ceph-mon[22097]: pgmap v298: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 7 op/s; 4.0 KiB/s, 0 objects/s recovering 2024-08-18T22:06:26.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.435+0000 7fef082ba640 1 -- 172.21.15.123:0/569385225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef00102c20 msgr2=0x7fef0010d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:26.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.435+0000 7fef082ba640 1 --2- 172.21.15.123:0/569385225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef00102c20 0x7fef0010d770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7feef8009ca0 tx=0x7feef802a950 comp rx=0 tx=0).stop 2024-08-18T22:06:26.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.435+0000 7fef082ba640 1 -- 172.21.15.123:0/569385225 shutdown_connections 2024-08-18T22:06:26.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.435+0000 7fef082ba640 1 --2- 172.21.15.123:0/569385225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef00102c20 0x7fef0010d770 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:26.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.435+0000 7fef082ba640 1 --2- 172.21.15.123:0/569385225 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef001022a0 0x7fef001026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:26.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.435+0000 7fef082ba640 1 --2- 172.21.15.123:0/569385225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef00100b50 0x7fef00100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:26.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.435+0000 7fef082ba640 1 -- 172.21.15.123:0/569385225 >> 172.21.15.123:0/569385225 conn(0x7fef000fc500 msgr2=0x7fef000fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:26.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.435+0000 7fef082ba640 1 -- 172.21.15.123:0/569385225 shutdown_connections 2024-08-18T22:06:26.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.435+0000 7fef082ba640 1 -- 172.21.15.123:0/569385225 wait complete. 2024-08-18T22:06:26.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef082ba640 1 Processor -- start 2024-08-18T22:06:26.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef082ba640 1 -- start start 2024-08-18T22:06:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef082ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef00100b50 0x7fef00199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef082ba640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef001022a0 0x7fef001995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef082ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef00102c20 0x7fef001a4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef082ba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fef00110cd0 con 0x7fef00100b50 2024-08-18T22:06:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef082ba640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fef00110b50 con 0x7fef001022a0 2024-08-18T22:06:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef082ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fef00110e50 con 0x7fef00102c20 2024-08-18T22:06:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef06056640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef00100b50 0x7fef00199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef06056640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef00100b50 0x7fef00199080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51976/0 (socket says 172.21.15.123:51976) 2024-08-18T22:06:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef06056640 1 -- 172.21.15.123:0/1741055140 learned_addr learned my addr 172.21.15.123:0/1741055140 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef06857640 1 --2- 172.21.15.123:0/1741055140 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef00102c20 0x7fef001a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef06056640 1 -- 172.21.15.123:0/1741055140 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef00102c20 msgr2=0x7fef001a4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef06056640 1 --2- 172.21.15.123:0/1741055140 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef00102c20 0x7fef001a4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef06056640 1 -- 172.21.15.123:0/1741055140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef001022a0 msgr2=0x7fef001995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef05855640 1 --2- 172.21.15.123:0/1741055140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef001022a0 0x7fef001995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.436+0000 7fef06056640 1 --2- 172.21.15.123:0/1741055140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef001022a0 0x7fef001995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.437+0000 7fef06056640 1 -- 172.21.15.123:0/1741055140 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef001a4640 con 0x7fef00100b50 2024-08-18T22:06:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.437+0000 7fef05855640 1 --2- 172.21.15.123:0/1741055140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef001022a0 0x7fef001995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:06:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.437+0000 7fef06056640 1 --2- 172.21.15.123:0/1741055140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef00100b50 0x7fef00199080 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feefc00d950 tx=0x7feefc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.437+0000 7feef77fe640 1 -- 172.21.15.123:0/1741055140 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feefc017070 con 0x7fef00100b50 2024-08-18T22:06:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.437+0000 7feef77fe640 1 -- 172.21.15.123:0/1741055140 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feefc009c30 con 0x7fef00100b50 2024-08-18T22:06:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.437+0000 7fef082ba640 1 -- 172.21.15.123:0/1741055140 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef001a4810 con 0x7fef00100b50 2024-08-18T22:06:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.437+0000 7feef77fe640 1 -- 172.21.15.123:0/1741055140 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feefc00f6b0 con 0x7fef00100b50 2024-08-18T22:06:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.437+0000 7fef082ba640 1 -- 172.21.15.123:0/1741055140 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef001a4d20 con 0x7fef00100b50 2024-08-18T22:06:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.438+0000 7fef082ba640 1 -- 172.21.15.123:0/1741055140 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef00100f30 con 0x7fef00100b50 2024-08-18T22:06:26.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.439+0000 7feef77fe640 1 -- 172.21.15.123:0/1741055140 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7feefc0109d0 con 0x7fef00100b50 2024-08-18T22:06:26.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.440+0000 7feef77fe640 1 --2- 172.21.15.123:0/1741055140 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feeec0a2c10 0x7feeec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:26.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.440+0000 7fef05855640 1 --2- 172.21.15.123:0/1741055140 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feeec0a2c10 0x7feeec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:26.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.440+0000 7feef77fe640 1 -- 172.21.15.123:0/1741055140 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7feefc0cf270 con 0x7fef00100b50 2024-08-18T22:06:26.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.440+0000 7fef05855640 1 --2- 172.21.15.123:0/1741055140 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feeec0a2c10 0x7feeec0a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feef0006fd0 tx=0x7feef0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:26.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.444+0000 7feef77fe640 1 -- 172.21.15.123:0/1741055140 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7feefc009de0 con 0x7fef00100b50 2024-08-18T22:06:26.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.615+0000 7fef082ba640 1 -- 172.21.15.123:0/1741055140 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef00106c80 con 0x7feeec0a2c10 2024-08-18T22:06:26.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.624+0000 7feef77fe640 1 -- 172.21.15.123:0/1741055140 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340385 (secure 0 0 0) 0x7fef00106c80 con 0x7feeec0a2c10 2024-08-18T22:06:26.628 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:06:26.629 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-08-18T22:06:26.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.628+0000 7fef082ba640 1 -- 172.21.15.123:0/1741055140 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feeec0a2c10 msgr2=0x7feeec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:26.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.628+0000 7fef082ba640 1 --2- 172.21.15.123:0/1741055140 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feeec0a2c10 0x7feeec0a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feef0006fd0 tx=0x7feef0008040 comp rx=0 tx=0).stop 2024-08-18T22:06:26.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.628+0000 7fef082ba640 1 -- 172.21.15.123:0/1741055140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef00100b50 msgr2=0x7fef00199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:26.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.628+0000 7fef082ba640 1 --2- 172.21.15.123:0/1741055140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef00100b50 0x7fef00199080 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feefc00d950 tx=0x7feefc00de10 comp rx=0 tx=0).stop 2024-08-18T22:06:26.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.628+0000 7fef082ba640 1 -- 172.21.15.123:0/1741055140 shutdown_connections 2024-08-18T22:06:26.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.628+0000 7fef082ba640 1 --2- 172.21.15.123:0/1741055140 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef00102c20 0x7fef001a4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:26.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.628+0000 7fef082ba640 1 --2- 172.21.15.123:0/1741055140 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feeec0a2c10 0x7feeec0a50d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:26.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.628+0000 7fef082ba640 1 --2- 172.21.15.123:0/1741055140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef001022a0 0x7fef001995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:26.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.628+0000 7fef082ba640 1 --2- 172.21.15.123:0/1741055140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef00100b50 0x7fef00199080 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:26.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.628+0000 7fef082ba640 1 -- 172.21.15.123:0/1741055140 >> 172.21.15.123:0/1741055140 conn(0x7fef000fc500 msgr2=0x7fef00106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:26.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.628+0000 7fef082ba640 1 -- 172.21.15.123:0/1741055140 shutdown_connections 2024-08-18T22:06:26.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:26.628+0000 7fef082ba640 1 -- 172.21.15.123:0/1741055140 wait complete. 2024-08-18T22:06:27.390 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2024-08-18T22:06:25.350527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656509,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":298,"num_read_kb":260,"num_write":349,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1229945,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":281,"ondisk_log_size":281,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375708,"kb_used_data":14036,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566116,"statfs":{"total":1151940427776,"available":1151555702784,"internally_reserved":0,"allocated":14372864,"data_stored":7998785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12425,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":50,"num_write":11,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":49209,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003609"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509743+0000","last_change":"2024-08-18T22:05:19.844674+0000","last_active":"2024-08-18T22:06:10.509743+0000","last_peered":"2024-08-18T22:06:10.509743+0000","last_clean":"2024-08-18T22:06:10.509743+0000","last_became_active":"2024-08-18T22:05:19.844381+0000","last_became_peered":"2024-08-18T22:05:19.844381+0000","last_unstale":"2024-08-18T22:06:10.509743+0000","last_undegraded":"2024-08-18T22:06:10.509743+0000","last_fullsized":"2024-08-18T22:06:10.509743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:58.783222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772174+0000","last_change":"2024-08-18T22:05:21.859013+0000","last_active":"2024-08-18T22:06:10.772174+0000","last_peered":"2024-08-18T22:06:10.772174+0000","last_clean":"2024-08-18T22:06:10.772174+0000","last_became_active":"2024-08-18T22:05:21.858709+0000","last_became_peered":"2024-08-18T22:05:21.858709+0000","last_unstale":"2024-08-18T22:06:10.772174+0000","last_undegraded":"2024-08-18T22:06:10.772174+0000","last_fullsized":"2024-08-18T22:06:10.772174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:34.272340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508245+0000","last_change":"2024-08-18T22:05:28.925735+0000","last_active":"2024-08-18T22:06:10.508245+0000","last_peered":"2024-08-18T22:06:10.508245+0000","last_clean":"2024-08-18T22:06:10.508245+0000","last_became_active":"2024-08-18T22:05:28.925324+0000","last_became_peered":"2024-08-18T22:05:28.925324+0000","last_unstale":"2024-08-18T22:06:10.508245+0000","last_undegraded":"2024-08-18T22:06:10.508245+0000","last_fullsized":"2024-08-18T22:06:10.508245+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:15:58.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772359+0000","last_change":"2024-08-18T22:05:20.290861+0000","last_active":"2024-08-18T22:06:10.772359+0000","last_peered":"2024-08-18T22:06:10.772359+0000","last_clean":"2024-08-18T22:06:10.772359+0000","last_became_active":"2024-08-18T22:05:20.290508+0000","last_became_peered":"2024-08-18T22:05:20.290508+0000","last_unstale":"2024-08-18T22:06:10.772359+0000","last_undegraded":"2024-08-18T22:06:10.772359+0000","last_fullsized":"2024-08-18T22:06:10.772359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:21.462206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509155+0000","last_change":"2024-08-18T22:05:21.863441+0000","last_active":"2024-08-18T22:06:10.509155+0000","last_peered":"2024-08-18T22:06:10.509155+0000","last_clean":"2024-08-18T22:06:10.509155+0000","last_became_active":"2024-08-18T22:05:21.863121+0000","last_became_peered":"2024-08-18T22:05:21.863121+0000","last_unstale":"2024-08-18T22:06:10.509155+0000","last_undegraded":"2024-08-18T22:06:10.509155+0000","last_fullsized":"2024-08-18T22:06:10.509155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:47.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509447+0000","last_change":"2024-08-18T22:05:28.925477+0000","last_active":"2024-08-18T22:06:10.509447+0000","last_peered":"2024-08-18T22:06:10.509447+0000","last_clean":"2024-08-18T22:06:10.509447+0000","last_became_active":"2024-08-18T22:05:28.924922+0000","last_became_peered":"2024-08-18T22:05:28.924922+0000","last_unstale":"2024-08-18T22:06:10.509447+0000","last_undegraded":"2024-08-18T22:06:10.509447+0000","last_fullsized":"2024-08-18T22:06:10.509447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:35.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514293+0000","last_change":"2024-08-18T22:05:19.847979+0000","last_active":"2024-08-18T22:06:10.514293+0000","last_peered":"2024-08-18T22:06:10.514293+0000","last_clean":"2024-08-18T22:06:10.514293+0000","last_became_active":"2024-08-18T22:05:19.847643+0000","last_became_peered":"2024-08-18T22:05:19.847643+0000","last_unstale":"2024-08-18T22:06:10.514293+0000","last_undegraded":"2024-08-18T22:06:10.514293+0000","last_fullsized":"2024-08-18T22:06:10.514293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:33.875378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506424+0000","last_change":"2024-08-18T22:05:21.860225+0000","last_active":"2024-08-18T22:06:10.506424+0000","last_peered":"2024-08-18T22:06:10.506424+0000","last_clean":"2024-08-18T22:06:10.506424+0000","last_became_active":"2024-08-18T22:05:21.859889+0000","last_became_peered":"2024-08-18T22:05:21.859889+0000","last_unstale":"2024-08-18T22:06:10.506424+0000","last_undegraded":"2024-08-18T22:06:10.506424+0000","last_fullsized":"2024-08-18T22:06:10.506424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:06:27.084401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511096+0000","last_change":"2024-08-18T22:05:28.922230+0000","last_active":"2024-08-18T22:06:10.511096+0000","last_peered":"2024-08-18T22:06:10.511096+0000","last_clean":"2024-08-18T22:06:10.511096+0000","last_became_active":"2024-08-18T22:05:28.921804+0000","last_became_peered":"2024-08-18T22:05:28.921804+0000","last_unstale":"2024-08-18T22:06:10.511096+0000","last_undegraded":"2024-08-18T22:06:10.511096+0000","last_fullsized":"2024-08-18T22:06:10.511096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:17.735645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514907+0000","last_change":"2024-08-18T22:05:19.841452+0000","last_active":"2024-08-18T22:06:10.514907+0000","last_peered":"2024-08-18T22:06:10.514907+0000","last_clean":"2024-08-18T22:06:10.514907+0000","last_became_active":"2024-08-18T22:05:19.840997+0000","last_became_peered":"2024-08-18T22:05:19.840997+0000","last_unstale":"2024-08-18T22:06:10.514907+0000","last_undegraded":"2024-08-18T22:06:10.514907+0000","last_fullsized":"2024-08-18T22:06:10.514907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:27:26.208279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514673+0000","last_change":"2024-08-18T22:06:10.514673+0000","last_active":"2024-08-18T22:06:10.514673+0000","last_peered":"2024-08-18T22:06:10.514673+0000","last_clean":"2024-08-18T22:06:10.514673+0000","last_became_active":"2024-08-18T22:06:10.514264+0000","last_became_peered":"2024-08-18T22:06:10.514264+0000","last_unstale":"2024-08-18T22:06:10.514673+0000","last_undegraded":"2024-08-18T22:06:10.514673+0000","last_fullsized":"2024-08-18T22:06:10.514673+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:03.626895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509642+0000","last_change":"2024-08-18T22:05:28.924521+0000","last_active":"2024-08-18T22:06:10.509642+0000","last_peered":"2024-08-18T22:06:10.509642+0000","last_clean":"2024-08-18T22:06:10.509642+0000","last_became_active":"2024-08-18T22:05:28.924107+0000","last_became_peered":"2024-08-18T22:05:28.924107+0000","last_unstale":"2024-08-18T22:06:10.509642+0000","last_undegraded":"2024-08-18T22:06:10.509642+0000","last_fullsized":"2024-08-18T22:06:10.509642+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:37.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508303+0000","last_change":"2024-08-18T22:05:21.861696+0000","last_active":"2024-08-18T22:06:10.508303+0000","last_peered":"2024-08-18T22:06:10.508303+0000","last_clean":"2024-08-18T22:06:10.508303+0000","last_became_active":"2024-08-18T22:05:21.861220+0000","last_became_peered":"2024-08-18T22:05:21.861220+0000","last_unstale":"2024-08-18T22:06:10.508303+0000","last_undegraded":"2024-08-18T22:06:10.508303+0000","last_fullsized":"2024-08-18T22:06:10.508303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:01.098281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.520590+0000","last_change":"2024-08-18T22:06:10.520097+0000","last_active":"2024-08-18T22:06:10.520590+0000","last_peered":"2024-08-18T22:06:10.520590+0000","last_clean":"2024-08-18T22:06:10.520590+0000","last_became_active":"2024-08-18T22:06:10.513286+0000","last_became_peered":"2024-08-18T22:06:10.513286+0000","last_unstale":"2024-08-18T22:06:10.520590+0000","last_undegraded":"2024-08-18T22:06:10.520590+0000","last_fullsized":"2024-08-18T22:06:10.520590+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:08:18.861243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509973+0000","last_change":"2024-08-18T22:05:29.013139+0000","last_active":"2024-08-18T22:06:10.509973+0000","last_peered":"2024-08-18T22:06:10.509973+0000","last_clean":"2024-08-18T22:06:10.509973+0000","last_became_active":"2024-08-18T22:05:29.012322+0000","last_became_peered":"2024-08-18T22:05:29.012322+0000","last_unstale":"2024-08-18T22:06:10.509973+0000","last_undegraded":"2024-08-18T22:06:10.509973+0000","last_fullsized":"2024-08-18T22:06:10.509973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:32.348201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772162+0000","last_change":"2024-08-18T22:05:21.860410+0000","last_active":"2024-08-18T22:06:10.772162+0000","last_peered":"2024-08-18T22:06:10.772162+0000","last_clean":"2024-08-18T22:06:10.772162+0000","last_became_active":"2024-08-18T22:05:21.860173+0000","last_became_peered":"2024-08-18T22:05:21.860173+0000","last_unstale":"2024-08-18T22:06:10.772162+0000","last_undegraded":"2024-08-18T22:06:10.772162+0000","last_fullsized":"2024-08-18T22:06:10.772162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:00.879178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507956+0000","last_change":"2024-08-18T22:05:19.845785+0000","last_active":"2024-08-18T22:06:10.507956+0000","last_peered":"2024-08-18T22:06:10.507956+0000","last_clean":"2024-08-18T22:06:10.507956+0000","last_became_active":"2024-08-18T22:05:19.845414+0000","last_became_peered":"2024-08-18T22:05:19.845414+0000","last_unstale":"2024-08-18T22:06:10.507956+0000","last_undegraded":"2024-08-18T22:06:10.507956+0000","last_fullsized":"2024-08-18T22:06:10.507956+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:13.504885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.523404+0000","last_change":"2024-08-18T22:06:10.523404+0000","last_active":"2024-08-18T22:06:10.523404+0000","last_peered":"2024-08-18T22:06:10.523404+0000","last_clean":"2024-08-18T22:06:10.523404+0000","last_became_active":"2024-08-18T22:06:10.516652+0000","last_became_peered":"2024-08-18T22:06:10.516652+0000","last_unstale":"2024-08-18T22:06:10.523404+0000","last_undegraded":"2024-08-18T22:06:10.523404+0000","last_fullsized":"2024-08-18T22:06:10.523404+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:58.197636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510102+0000","last_change":"2024-08-18T22:05:21.858329+0000","last_active":"2024-08-18T22:06:10.510102+0000","last_peered":"2024-08-18T22:06:10.510102+0000","last_clean":"2024-08-18T22:06:10.510102+0000","last_became_active":"2024-08-18T22:05:21.857854+0000","last_became_peered":"2024-08-18T22:05:21.857854+0000","last_unstale":"2024-08-18T22:06:10.510102+0000","last_undegraded":"2024-08-18T22:06:10.510102+0000","last_fullsized":"2024-08-18T22:06:10.510102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:45:19.934647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772068+0000","last_change":"2024-08-18T22:05:19.843031+0000","last_active":"2024-08-18T22:06:10.772068+0000","last_peered":"2024-08-18T22:06:10.772068+0000","last_clean":"2024-08-18T22:06:10.772068+0000","last_became_active":"2024-08-18T22:05:19.842694+0000","last_became_peered":"2024-08-18T22:05:19.842694+0000","last_unstale":"2024-08-18T22:06:10.772068+0000","last_undegraded":"2024-08-18T22:06:10.772068+0000","last_fullsized":"2024-08-18T22:06:10.772068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:01.135449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509575+0000","last_change":"2024-08-18T22:05:28.920647+0000","last_active":"2024-08-18T22:06:10.509575+0000","last_peered":"2024-08-18T22:06:10.509575+0000","last_clean":"2024-08-18T22:06:10.509575+0000","last_became_active":"2024-08-18T22:05:28.920295+0000","last_became_peered":"2024-08-18T22:05:28.920295+0000","last_unstale":"2024-08-18T22:06:10.509575+0000","last_undegraded":"2024-08-18T22:06:10.509575+0000","last_fullsized":"2024-08-18T22:06:10.509575+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:41.295009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513283+0000","last_change":"2024-08-18T22:05:21.858413+0000","last_active":"2024-08-18T22:06:10.513283+0000","last_peered":"2024-08-18T22:06:10.513283+0000","last_clean":"2024-08-18T22:06:10.513283+0000","last_became_active":"2024-08-18T22:05:21.858102+0000","last_became_peered":"2024-08-18T22:05:21.858102+0000","last_unstale":"2024-08-18T22:06:10.513283+0000","last_undegraded":"2024-08-18T22:06:10.513283+0000","last_fullsized":"2024-08-18T22:06:10.513283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:24:59.432666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506163+0000","last_change":"2024-08-18T22:05:20.292085+0000","last_active":"2024-08-18T22:06:10.506163+0000","last_peered":"2024-08-18T22:06:10.506163+0000","last_clean":"2024-08-18T22:06:10.506163+0000","last_became_active":"2024-08-18T22:05:20.291606+0000","last_became_peered":"2024-08-18T22:05:20.291606+0000","last_unstale":"2024-08-18T22:06:10.506163+0000","last_undegraded":"2024-08-18T22:06:10.506163+0000","last_fullsized":"2024-08-18T22:06:10.506163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:22:46.801719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515755+0000","last_change":"2024-08-18T22:06:10.515755+0000","last_active":"2024-08-18T22:06:10.515755+0000","last_peered":"2024-08-18T22:06:10.515755+0000","last_clean":"2024-08-18T22:06:10.515755+0000","last_became_active":"2024-08-18T22:06:10.514624+0000","last_became_peered":"2024-08-18T22:06:10.514624+0000","last_unstale":"2024-08-18T22:06:10.515755+0000","last_undegraded":"2024-08-18T22:06:10.515755+0000","last_fullsized":"2024-08-18T22:06:10.515755+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:18:50.785139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508880+0000","last_change":"2024-08-18T22:05:21.855163+0000","last_active":"2024-08-18T22:06:10.508880+0000","last_peered":"2024-08-18T22:06:10.508880+0000","last_clean":"2024-08-18T22:06:10.508880+0000","last_became_active":"2024-08-18T22:05:21.854867+0000","last_became_peered":"2024-08-18T22:05:21.854867+0000","last_unstale":"2024-08-18T22:06:10.508880+0000","last_undegraded":"2024-08-18T22:06:10.508880+0000","last_fullsized":"2024-08-18T22:06:10.508880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:10.300307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510102+0000","last_change":"2024-08-18T22:05:20.082363+0000","last_active":"2024-08-18T22:06:10.510102+0000","last_peered":"2024-08-18T22:06:10.510102+0000","last_clean":"2024-08-18T22:06:10.510102+0000","last_became_active":"2024-08-18T22:05:20.081998+0000","last_became_peered":"2024-08-18T22:05:20.081998+0000","last_unstale":"2024-08-18T22:06:10.510102+0000","last_undegraded":"2024-08-18T22:06:10.510102+0000","last_fullsized":"2024-08-18T22:06:10.510102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:44.960512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508721+0000","last_change":"2024-08-18T22:05:28.924072+0000","last_active":"2024-08-18T22:06:10.508721+0000","last_peered":"2024-08-18T22:06:10.508721+0000","last_clean":"2024-08-18T22:06:10.508721+0000","last_became_active":"2024-08-18T22:05:28.923673+0000","last_became_peered":"2024-08-18T22:05:28.923673+0000","last_unstale":"2024-08-18T22:06:10.508721+0000","last_undegraded":"2024-08-18T22:06:10.508721+0000","last_fullsized":"2024-08-18T22:06:10.508721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:44.593009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772399+0000","last_change":"2024-08-18T22:05:21.851377+0000","last_active":"2024-08-18T22:06:10.772399+0000","last_peered":"2024-08-18T22:06:10.772399+0000","last_clean":"2024-08-18T22:06:10.772399+0000","last_became_active":"2024-08-18T22:05:21.851031+0000","last_became_peered":"2024-08-18T22:05:21.851031+0000","last_unstale":"2024-08-18T22:06:10.772399+0000","last_undegraded":"2024-08-18T22:06:10.772399+0000","last_fullsized":"2024-08-18T22:06:10.772399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.547244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'11","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:13.873627+0000","last_change":"2024-08-18T22:05:19.840697+0000","last_active":"2024-08-18T22:06:13.873627+0000","last_peered":"2024-08-18T22:06:13.873627+0000","last_clean":"2024-08-18T22:06:13.873627+0000","last_became_active":"2024-08-18T22:05:19.840382+0000","last_became_peered":"2024-08-18T22:05:19.840382+0000","last_unstale":"2024-08-18T22:06:13.873627+0000","last_undegraded":"2024-08-18T22:06:13.873627+0000","last_fullsized":"2024-08-18T22:06:13.873627+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:24.514428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771817+0000","last_change":"2024-08-18T22:05:29.012305+0000","last_active":"2024-08-18T22:06:10.771817+0000","last_peered":"2024-08-18T22:06:10.771817+0000","last_clean":"2024-08-18T22:06:10.771817+0000","last_became_active":"2024-08-18T22:05:29.011846+0000","last_became_peered":"2024-08-18T22:05:29.011846+0000","last_unstale":"2024-08-18T22:06:10.771817+0000","last_undegraded":"2024-08-18T22:06:10.771817+0000","last_fullsized":"2024-08-18T22:06:10.771817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:36.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506016+0000","last_change":"2024-08-18T22:05:21.856182+0000","last_active":"2024-08-18T22:06:10.506016+0000","last_peered":"2024-08-18T22:06:10.506016+0000","last_clean":"2024-08-18T22:06:10.506016+0000","last_became_active":"2024-08-18T22:05:21.855855+0000","last_became_peered":"2024-08-18T22:05:21.855855+0000","last_unstale":"2024-08-18T22:06:10.506016+0000","last_undegraded":"2024-08-18T22:06:10.506016+0000","last_fullsized":"2024-08-18T22:06:10.506016+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:00.166809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514793+0000","last_change":"2024-08-18T22:05:20.291272+0000","last_active":"2024-08-18T22:06:10.514793+0000","last_peered":"2024-08-18T22:06:10.514793+0000","last_clean":"2024-08-18T22:06:10.514793+0000","last_became_active":"2024-08-18T22:05:20.290970+0000","last_became_peered":"2024-08-18T22:05:20.290970+0000","last_unstale":"2024-08-18T22:06:10.514793+0000","last_undegraded":"2024-08-18T22:06:10.514793+0000","last_fullsized":"2024-08-18T22:06:10.514793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:29.438996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510601+0000","last_change":"2024-08-18T22:05:28.923141+0000","last_active":"2024-08-18T22:06:10.510601+0000","last_peered":"2024-08-18T22:06:10.510601+0000","last_clean":"2024-08-18T22:06:10.510601+0000","last_became_active":"2024-08-18T22:05:28.922269+0000","last_became_peered":"2024-08-18T22:05:28.922269+0000","last_unstale":"2024-08-18T22:06:10.510601+0000","last_undegraded":"2024-08-18T22:06:10.510601+0000","last_fullsized":"2024-08-18T22:06:10.510601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:58.092640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509287+0000","last_change":"2024-08-18T22:05:21.850124+0000","last_active":"2024-08-18T22:06:10.509287+0000","last_peered":"2024-08-18T22:06:10.509287+0000","last_clean":"2024-08-18T22:06:10.509287+0000","last_became_active":"2024-08-18T22:05:21.849805+0000","last_became_peered":"2024-08-18T22:05:21.849805+0000","last_unstale":"2024-08-18T22:06:10.509287+0000","last_undegraded":"2024-08-18T22:06:10.509287+0000","last_fullsized":"2024-08-18T22:06:10.509287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:53.492613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509230+0000","last_change":"2024-08-18T22:05:20.292836+0000","last_active":"2024-08-18T22:06:10.509230+0000","last_peered":"2024-08-18T22:06:10.509230+0000","last_clean":"2024-08-18T22:06:10.509230+0000","last_became_active":"2024-08-18T22:05:20.292456+0000","last_became_peered":"2024-08-18T22:05:20.292456+0000","last_unstale":"2024-08-18T22:06:10.509230+0000","last_undegraded":"2024-08-18T22:06:10.509230+0000","last_fullsized":"2024-08-18T22:06:10.509230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:19.525037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513298+0000","last_change":"2024-08-18T22:05:29.012439+0000","last_active":"2024-08-18T22:06:10.513298+0000","last_peered":"2024-08-18T22:06:10.513298+0000","last_clean":"2024-08-18T22:06:10.513298+0000","last_became_active":"2024-08-18T22:05:29.011860+0000","last_became_peered":"2024-08-18T22:05:29.011860+0000","last_unstale":"2024-08-18T22:06:10.513298+0000","last_undegraded":"2024-08-18T22:06:10.513298+0000","last_fullsized":"2024-08-18T22:06:10.513298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:03.432217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509272+0000","last_change":"2024-08-18T22:05:21.855598+0000","last_active":"2024-08-18T22:06:10.509272+0000","last_peered":"2024-08-18T22:06:10.509272+0000","last_clean":"2024-08-18T22:06:10.509272+0000","last_became_active":"2024-08-18T22:05:21.855228+0000","last_became_peered":"2024-08-18T22:05:21.855228+0000","last_unstale":"2024-08-18T22:06:10.509272+0000","last_undegraded":"2024-08-18T22:06:10.509272+0000","last_fullsized":"2024-08-18T22:06:10.509272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:33.762700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508476+0000","last_change":"2024-08-18T22:05:19.844638+0000","last_active":"2024-08-18T22:06:10.508476+0000","last_peered":"2024-08-18T22:06:10.508476+0000","last_clean":"2024-08-18T22:06:10.508476+0000","last_became_active":"2024-08-18T22:05:19.844333+0000","last_became_peered":"2024-08-18T22:05:19.844333+0000","last_unstale":"2024-08-18T22:06:10.508476+0000","last_undegraded":"2024-08-18T22:06:10.508476+0000","last_fullsized":"2024-08-18T22:06:10.508476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:26.947512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505914+0000","last_change":"2024-08-18T22:05:28.919965+0000","last_active":"2024-08-18T22:06:10.505914+0000","last_peered":"2024-08-18T22:06:10.505914+0000","last_clean":"2024-08-18T22:06:10.505914+0000","last_became_active":"2024-08-18T22:05:28.919546+0000","last_became_peered":"2024-08-18T22:05:28.919546+0000","last_unstale":"2024-08-18T22:06:10.505914+0000","last_undegraded":"2024-08-18T22:06:10.505914+0000","last_fullsized":"2024-08-18T22:06:10.505914+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:49.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506450+0000","last_change":"2024-08-18T22:05:21.857867+0000","last_active":"2024-08-18T22:06:10.506450+0000","last_peered":"2024-08-18T22:06:10.506450+0000","last_clean":"2024-08-18T22:06:10.506450+0000","last_became_active":"2024-08-18T22:05:21.857515+0000","last_became_peered":"2024-08-18T22:05:21.857515+0000","last_unstale":"2024-08-18T22:06:10.506450+0000","last_undegraded":"2024-08-18T22:06:10.506450+0000","last_fullsized":"2024-08-18T22:06:10.506450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:51.148321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:21.492789+0000","last_change":"2024-08-18T22:05:20.290924+0000","last_active":"2024-08-18T22:06:21.492789+0000","last_peered":"2024-08-18T22:06:21.492789+0000","last_clean":"2024-08-18T22:06:21.492789+0000","last_became_active":"2024-08-18T22:05:20.290587+0000","last_became_peered":"2024-08-18T22:05:20.290587+0000","last_unstale":"2024-08-18T22:06:21.492789+0000","last_undegraded":"2024-08-18T22:06:21.492789+0000","last_fullsized":"2024-08-18T22:06:21.492789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:35.029634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505852+0000","last_change":"2024-08-18T22:05:29.012876+0000","last_active":"2024-08-18T22:06:10.505852+0000","last_peered":"2024-08-18T22:06:10.505852+0000","last_clean":"2024-08-18T22:06:10.505852+0000","last_became_active":"2024-08-18T22:05:29.011930+0000","last_became_peered":"2024-08-18T22:05:29.011930+0000","last_unstale":"2024-08-18T22:06:10.505852+0000","last_undegraded":"2024-08-18T22:06:10.505852+0000","last_fullsized":"2024-08-18T22:06:10.505852+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:22:35.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505526+0000","last_change":"2024-08-18T22:05:21.860798+0000","last_active":"2024-08-18T22:06:10.505526+0000","last_peered":"2024-08-18T22:06:10.505526+0000","last_clean":"2024-08-18T22:06:10.505526+0000","last_became_active":"2024-08-18T22:05:21.856968+0000","last_became_peered":"2024-08-18T22:05:21.856968+0000","last_unstale":"2024-08-18T22:06:10.505526+0000","last_undegraded":"2024-08-18T22:06:10.505526+0000","last_fullsized":"2024-08-18T22:06:10.505526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:54.934400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508009+0000","last_change":"2024-08-18T22:05:19.844775+0000","last_active":"2024-08-18T22:06:10.508009+0000","last_peered":"2024-08-18T22:06:10.508009+0000","last_clean":"2024-08-18T22:06:10.508009+0000","last_became_active":"2024-08-18T22:05:19.844465+0000","last_became_peered":"2024-08-18T22:05:19.844465+0000","last_unstale":"2024-08-18T22:06:10.508009+0000","last_undegraded":"2024-08-18T22:06:10.508009+0000","last_fullsized":"2024-08-18T22:06:10.508009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.042335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507348+0000","last_change":"2024-08-18T22:05:29.013275+0000","last_active":"2024-08-18T22:06:10.507348+0000","last_peered":"2024-08-18T22:06:10.507348+0000","last_clean":"2024-08-18T22:06:10.507348+0000","last_became_active":"2024-08-18T22:05:29.012537+0000","last_became_peered":"2024-08-18T22:05:29.012537+0000","last_unstale":"2024-08-18T22:06:10.507348+0000","last_undegraded":"2024-08-18T22:06:10.507348+0000","last_fullsized":"2024-08-18T22:06:10.507348+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:15:39.775360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772046+0000","last_change":"2024-08-18T22:05:21.853358+0000","last_active":"2024-08-18T22:06:10.772046+0000","last_peered":"2024-08-18T22:06:10.772046+0000","last_clean":"2024-08-18T22:06:10.772046+0000","last_became_active":"2024-08-18T22:05:21.853071+0000","last_became_peered":"2024-08-18T22:05:21.853071+0000","last_unstale":"2024-08-18T22:06:10.772046+0000","last_undegraded":"2024-08-18T22:06:10.772046+0000","last_fullsized":"2024-08-18T22:06:10.772046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:23.755263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511287+0000","last_change":"2024-08-18T22:05:19.846922+0000","last_active":"2024-08-18T22:06:10.511287+0000","last_peered":"2024-08-18T22:06:10.511287+0000","last_clean":"2024-08-18T22:06:10.511287+0000","last_became_active":"2024-08-18T22:05:19.846619+0000","last_became_peered":"2024-08-18T22:05:19.846619+0000","last_unstale":"2024-08-18T22:06:10.511287+0000","last_undegraded":"2024-08-18T22:06:10.511287+0000","last_fullsized":"2024-08-18T22:06:10.511287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:36:16.232344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":352,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508214+0000","last_change":"2024-08-18T22:04:11.878703+0000","last_active":"2024-08-18T22:06:10.508214+0000","last_peered":"2024-08-18T22:06:10.508214+0000","last_clean":"2024-08-18T22:06:10.508214+0000","last_became_active":"2024-08-18T22:04:11.878157+0000","last_became_peered":"2024-08-18T22:04:11.878157+0000","last_unstale":"2024-08-18T22:06:10.508214+0000","last_undegraded":"2024-08-18T22:06:10.508214+0000","last_fullsized":"2024-08-18T22:06:10.508214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_clean_scrub_stamp":"2024-08-18T22:01:09.551264+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:24:07.391758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508423+0000","last_change":"2024-08-18T22:05:28.928882+0000","last_active":"2024-08-18T22:06:10.508423+0000","last_peered":"2024-08-18T22:06:10.508423+0000","last_clean":"2024-08-18T22:06:10.508423+0000","last_became_active":"2024-08-18T22:05:28.928482+0000","last_became_peered":"2024-08-18T22:05:28.928482+0000","last_unstale":"2024-08-18T22:06:10.508423+0000","last_undegraded":"2024-08-18T22:06:10.508423+0000","last_fullsized":"2024-08-18T22:06:10.508423+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:41.739482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508689+0000","last_change":"2024-08-18T22:05:21.863045+0000","last_active":"2024-08-18T22:06:10.508689+0000","last_peered":"2024-08-18T22:06:10.508689+0000","last_clean":"2024-08-18T22:06:10.508689+0000","last_became_active":"2024-08-18T22:05:21.862758+0000","last_became_peered":"2024-08-18T22:05:21.862758+0000","last_unstale":"2024-08-18T22:06:10.508689+0000","last_undegraded":"2024-08-18T22:06:10.508689+0000","last_fullsized":"2024-08-18T22:06:10.508689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:08:39.111147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509216+0000","last_change":"2024-08-18T22:05:20.291030+0000","last_active":"2024-08-18T22:06:10.509216+0000","last_peered":"2024-08-18T22:06:10.509216+0000","last_clean":"2024-08-18T22:06:10.509216+0000","last_became_active":"2024-08-18T22:05:20.290427+0000","last_became_peered":"2024-08-18T22:05:20.290427+0000","last_unstale":"2024-08-18T22:06:10.509216+0000","last_undegraded":"2024-08-18T22:06:10.509216+0000","last_fullsized":"2024-08-18T22:06:10.509216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:14:42.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506125+0000","last_change":"2024-08-18T22:05:28.923700+0000","last_active":"2024-08-18T22:06:10.506125+0000","last_peered":"2024-08-18T22:06:10.506125+0000","last_clean":"2024-08-18T22:06:10.506125+0000","last_became_active":"2024-08-18T22:05:28.923280+0000","last_became_peered":"2024-08-18T22:05:28.923280+0000","last_unstale":"2024-08-18T22:06:10.506125+0000","last_undegraded":"2024-08-18T22:06:10.506125+0000","last_fullsized":"2024-08-18T22:06:10.506125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:25:45.343542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508357+0000","last_change":"2024-08-18T22:05:21.856107+0000","last_active":"2024-08-18T22:06:10.508357+0000","last_peered":"2024-08-18T22:06:10.508357+0000","last_clean":"2024-08-18T22:06:10.508357+0000","last_became_active":"2024-08-18T22:05:21.853276+0000","last_became_peered":"2024-08-18T22:05:21.853276+0000","last_unstale":"2024-08-18T22:06:10.508357+0000","last_undegraded":"2024-08-18T22:06:10.508357+0000","last_fullsized":"2024-08-18T22:06:10.508357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:58.280375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507968+0000","last_change":"2024-08-18T22:05:19.843445+0000","last_active":"2024-08-18T22:06:10.507968+0000","last_peered":"2024-08-18T22:06:10.507968+0000","last_clean":"2024-08-18T22:06:10.507968+0000","last_became_active":"2024-08-18T22:05:19.843000+0000","last_became_peered":"2024-08-18T22:05:19.843000+0000","last_unstale":"2024-08-18T22:06:10.507968+0000","last_undegraded":"2024-08-18T22:06:10.507968+0000","last_fullsized":"2024-08-18T22:06:10.507968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:23.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515953+0000","last_change":"2024-08-18T22:06:10.515953+0000","last_active":"2024-08-18T22:06:10.515953+0000","last_peered":"2024-08-18T22:06:10.515953+0000","last_clean":"2024-08-18T22:06:10.515953+0000","last_became_active":"2024-08-18T22:06:10.515662+0000","last_became_peered":"2024-08-18T22:06:10.515662+0000","last_unstale":"2024-08-18T22:06:10.515953+0000","last_undegraded":"2024-08-18T22:06:10.515953+0000","last_fullsized":"2024-08-18T22:06:10.515953+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:43.150180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509215+0000","last_change":"2024-08-18T22:05:21.864029+0000","last_active":"2024-08-18T22:06:10.509215+0000","last_peered":"2024-08-18T22:06:10.509215+0000","last_clean":"2024-08-18T22:06:10.509215+0000","last_became_active":"2024-08-18T22:05:21.863509+0000","last_became_peered":"2024-08-18T22:05:21.863509+0000","last_unstale":"2024-08-18T22:06:10.509215+0000","last_undegraded":"2024-08-18T22:06:10.509215+0000","last_fullsized":"2024-08-18T22:06:10.509215+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:42.879243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506010+0000","last_change":"2024-08-18T22:05:19.846514+0000","last_active":"2024-08-18T22:06:10.506010+0000","last_peered":"2024-08-18T22:06:10.506010+0000","last_clean":"2024-08-18T22:06:10.506010+0000","last_became_active":"2024-08-18T22:05:19.846190+0000","last_became_peered":"2024-08-18T22:05:19.846190+0000","last_unstale":"2024-08-18T22:06:10.506010+0000","last_undegraded":"2024-08-18T22:06:10.506010+0000","last_fullsized":"2024-08-18T22:06:10.506010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:49:00.317597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506329+0000","last_change":"2024-08-18T22:05:28.923183+0000","last_active":"2024-08-18T22:06:10.506329+0000","last_peered":"2024-08-18T22:06:10.506329+0000","last_clean":"2024-08-18T22:06:10.506329+0000","last_became_active":"2024-08-18T22:05:28.922809+0000","last_became_peered":"2024-08-18T22:05:28.922809+0000","last_unstale":"2024-08-18T22:06:10.506329+0000","last_undegraded":"2024-08-18T22:06:10.506329+0000","last_fullsized":"2024-08-18T22:06:10.506329+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:26.416920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510283+0000","last_change":"2024-08-18T22:05:21.849075+0000","last_active":"2024-08-18T22:06:10.510283+0000","last_peered":"2024-08-18T22:06:10.510283+0000","last_clean":"2024-08-18T22:06:10.510283+0000","last_became_active":"2024-08-18T22:05:21.848759+0000","last_became_peered":"2024-08-18T22:05:21.848759+0000","last_unstale":"2024-08-18T22:06:10.510283+0000","last_undegraded":"2024-08-18T22:06:10.510283+0000","last_fullsized":"2024-08-18T22:06:10.510283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:26.531534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515145+0000","last_change":"2024-08-18T22:05:19.849210+0000","last_active":"2024-08-18T22:06:10.515145+0000","last_peered":"2024-08-18T22:06:10.515145+0000","last_clean":"2024-08-18T22:06:10.515145+0000","last_became_active":"2024-08-18T22:05:19.848829+0000","last_became_peered":"2024-08-18T22:05:19.848829+0000","last_unstale":"2024-08-18T22:06:10.515145+0000","last_undegraded":"2024-08-18T22:06:10.515145+0000","last_fullsized":"2024-08-18T22:06:10.515145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:19.321686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506551+0000","last_change":"2024-08-18T22:05:28.924577+0000","last_active":"2024-08-18T22:06:10.506551+0000","last_peered":"2024-08-18T22:06:10.506551+0000","last_clean":"2024-08-18T22:06:10.506551+0000","last_became_active":"2024-08-18T22:05:28.924183+0000","last_became_peered":"2024-08-18T22:05:28.924183+0000","last_unstale":"2024-08-18T22:06:10.506551+0000","last_undegraded":"2024-08-18T22:06:10.506551+0000","last_fullsized":"2024-08-18T22:06:10.506551+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:22.702757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513994+0000","last_change":"2024-08-18T22:06:10.513610+0000","last_active":"2024-08-18T22:06:10.513994+0000","last_peered":"2024-08-18T22:06:10.513994+0000","last_clean":"2024-08-18T22:06:10.513994+0000","last_became_active":"2024-08-18T22:06:10.513400+0000","last_became_peered":"2024-08-18T22:06:10.513400+0000","last_unstale":"2024-08-18T22:06:10.513994+0000","last_undegraded":"2024-08-18T22:06:10.513994+0000","last_fullsized":"2024-08-18T22:06:10.513994+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:49.275223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513546+0000","last_change":"2024-08-18T22:05:20.291752+0000","last_active":"2024-08-18T22:06:10.513546+0000","last_peered":"2024-08-18T22:06:10.513546+0000","last_clean":"2024-08-18T22:06:10.513546+0000","last_became_active":"2024-08-18T22:05:20.291431+0000","last_became_peered":"2024-08-18T22:05:20.291431+0000","last_unstale":"2024-08-18T22:06:10.513546+0000","last_undegraded":"2024-08-18T22:06:10.513546+0000","last_fullsized":"2024-08-18T22:06:10.513546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:32.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506003+0000","last_change":"2024-08-18T22:05:28.924121+0000","last_active":"2024-08-18T22:06:10.506003+0000","last_peered":"2024-08-18T22:06:10.506003+0000","last_clean":"2024-08-18T22:06:10.506003+0000","last_became_active":"2024-08-18T22:05:28.923753+0000","last_became_peered":"2024-08-18T22:05:28.923753+0000","last_unstale":"2024-08-18T22:06:10.506003+0000","last_undegraded":"2024-08-18T22:06:10.506003+0000","last_fullsized":"2024-08-18T22:06:10.506003+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:57.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507828+0000","last_change":"2024-08-18T22:05:21.858366+0000","last_active":"2024-08-18T22:06:10.507828+0000","last_peered":"2024-08-18T22:06:10.507828+0000","last_clean":"2024-08-18T22:06:10.507828+0000","last_became_active":"2024-08-18T22:05:21.858021+0000","last_became_peered":"2024-08-18T22:05:21.858021+0000","last_unstale":"2024-08-18T22:06:10.507828+0000","last_undegraded":"2024-08-18T22:06:10.507828+0000","last_fullsized":"2024-08-18T22:06:10.507828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:55.662965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'4","reported_seq":67,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:22.494847+0000","last_change":"2024-08-18T22:05:19.850013+0000","last_active":"2024-08-18T22:06:22.494847+0000","last_peered":"2024-08-18T22:06:22.494847+0000","last_clean":"2024-08-18T22:06:22.494847+0000","last_became_active":"2024-08-18T22:05:19.849551+0000","last_became_peered":"2024-08-18T22:05:19.849551+0000","last_unstale":"2024-08-18T22:06:22.494847+0000","last_undegraded":"2024-08-18T22:06:22.494847+0000","last_fullsized":"2024-08-18T22:06:22.494847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:15.182999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509627+0000","last_change":"2024-08-18T22:05:28.927318+0000","last_active":"2024-08-18T22:06:10.509627+0000","last_peered":"2024-08-18T22:06:10.509627+0000","last_clean":"2024-08-18T22:06:10.509627+0000","last_became_active":"2024-08-18T22:05:28.926786+0000","last_became_peered":"2024-08-18T22:05:28.926786+0000","last_unstale":"2024-08-18T22:06:10.509627+0000","last_undegraded":"2024-08-18T22:06:10.509627+0000","last_fullsized":"2024-08-18T22:06:10.509627+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:45.798247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511821+0000","last_change":"2024-08-18T22:06:10.511821+0000","last_active":"2024-08-18T22:06:10.511821+0000","last_peered":"2024-08-18T22:06:10.511821+0000","last_clean":"2024-08-18T22:06:10.511821+0000","last_became_active":"2024-08-18T22:06:10.511135+0000","last_became_peered":"2024-08-18T22:06:10.511135+0000","last_unstale":"2024-08-18T22:06:10.511821+0000","last_undegraded":"2024-08-18T22:06:10.511821+0000","last_fullsized":"2024-08-18T22:06:10.511821+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:07.108531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506959+0000","last_change":"2024-08-18T22:05:19.844061+0000","last_active":"2024-08-18T22:06:10.506959+0000","last_peered":"2024-08-18T22:06:10.506959+0000","last_clean":"2024-08-18T22:06:10.506959+0000","last_became_active":"2024-08-18T22:05:19.843513+0000","last_became_peered":"2024-08-18T22:05:19.843513+0000","last_unstale":"2024-08-18T22:06:10.506959+0000","last_undegraded":"2024-08-18T22:06:10.506959+0000","last_fullsized":"2024-08-18T22:06:10.506959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:53.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510069+0000","last_change":"2024-08-18T22:05:28.922986+0000","last_active":"2024-08-18T22:06:10.510069+0000","last_peered":"2024-08-18T22:06:10.510069+0000","last_clean":"2024-08-18T22:06:10.510069+0000","last_became_active":"2024-08-18T22:05:28.922322+0000","last_became_peered":"2024-08-18T22:05:28.922322+0000","last_unstale":"2024-08-18T22:06:10.510069+0000","last_undegraded":"2024-08-18T22:06:10.510069+0000","last_fullsized":"2024-08-18T22:06:10.510069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:28.168299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505649+0000","last_change":"2024-08-18T22:05:21.853389+0000","last_active":"2024-08-18T22:06:10.505649+0000","last_peered":"2024-08-18T22:06:10.505649+0000","last_clean":"2024-08-18T22:06:10.505649+0000","last_became_active":"2024-08-18T22:05:21.853095+0000","last_became_peered":"2024-08-18T22:05:21.853095+0000","last_unstale":"2024-08-18T22:06:10.505649+0000","last_undegraded":"2024-08-18T22:06:10.505649+0000","last_fullsized":"2024-08-18T22:06:10.505649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:14.126983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508891+0000","last_change":"2024-08-18T22:05:19.846788+0000","last_active":"2024-08-18T22:06:10.508891+0000","last_peered":"2024-08-18T22:06:10.508891+0000","last_clean":"2024-08-18T22:06:10.508891+0000","last_became_active":"2024-08-18T22:05:19.846248+0000","last_became_peered":"2024-08-18T22:05:19.846248+0000","last_unstale":"2024-08-18T22:06:10.508891+0000","last_undegraded":"2024-08-18T22:06:10.508891+0000","last_fullsized":"2024-08-18T22:06:10.508891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:46.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507672+0000","last_change":"2024-08-18T22:05:28.920294+0000","last_active":"2024-08-18T22:06:10.507672+0000","last_peered":"2024-08-18T22:06:10.507672+0000","last_clean":"2024-08-18T22:06:10.507672+0000","last_became_active":"2024-08-18T22:05:28.919351+0000","last_became_peered":"2024-08-18T22:05:28.919351+0000","last_unstale":"2024-08-18T22:06:10.507672+0000","last_undegraded":"2024-08-18T22:06:10.507672+0000","last_fullsized":"2024-08-18T22:06:10.507672+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:49.425281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514189+0000","last_change":"2024-08-18T22:05:21.864529+0000","last_active":"2024-08-18T22:06:10.514189+0000","last_peered":"2024-08-18T22:06:10.514189+0000","last_clean":"2024-08-18T22:06:10.514189+0000","last_became_active":"2024-08-18T22:05:21.864062+0000","last_became_peered":"2024-08-18T22:05:21.864062+0000","last_unstale":"2024-08-18T22:06:10.514189+0000","last_undegraded":"2024-08-18T22:06:10.514189+0000","last_fullsized":"2024-08-18T22:06:10.514189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:24:49.037343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'31","reported_seq":143,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:23.537869+0000","last_change":"2024-08-18T22:06:10.522113+0000","last_active":"2024-08-18T22:06:23.537869+0000","last_peered":"2024-08-18T22:06:23.537869+0000","last_clean":"2024-08-18T22:06:23.537869+0000","last_became_active":"2024-08-18T22:06:10.514837+0000","last_became_peered":"2024-08-18T22:06:10.514837+0000","last_unstale":"2024-08-18T22:06:23.537869+0000","last_undegraded":"2024-08-18T22:06:23.537869+0000","last_fullsized":"2024-08-18T22:06:23.537869+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:46.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61517,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":82,"num_write":32,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508344+0000","last_change":"2024-08-18T22:05:28.926357+0000","last_active":"2024-08-18T22:06:10.508344+0000","last_peered":"2024-08-18T22:06:10.508344+0000","last_clean":"2024-08-18T22:06:10.508344+0000","last_became_active":"2024-08-18T22:05:28.926016+0000","last_became_peered":"2024-08-18T22:05:28.926016+0000","last_unstale":"2024-08-18T22:06:10.508344+0000","last_undegraded":"2024-08-18T22:06:10.508344+0000","last_fullsized":"2024-08-18T22:06:10.508344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:16.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506937+0000","last_change":"2024-08-18T22:05:21.860237+0000","last_active":"2024-08-18T22:06:10.506937+0000","last_peered":"2024-08-18T22:06:10.506937+0000","last_clean":"2024-08-18T22:06:10.506937+0000","last_became_active":"2024-08-18T22:05:21.859919+0000","last_became_peered":"2024-08-18T22:05:21.859919+0000","last_unstale":"2024-08-18T22:06:10.506937+0000","last_undegraded":"2024-08-18T22:06:10.506937+0000","last_fullsized":"2024-08-18T22:06:10.506937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:21.048413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507852+0000","last_change":"2024-08-18T22:05:20.291233+0000","last_active":"2024-08-18T22:06:10.507852+0000","last_peered":"2024-08-18T22:06:10.507852+0000","last_clean":"2024-08-18T22:06:10.507852+0000","last_became_active":"2024-08-18T22:05:20.290893+0000","last_became_peered":"2024-08-18T22:05:20.290893+0000","last_unstale":"2024-08-18T22:06:10.507852+0000","last_undegraded":"2024-08-18T22:06:10.507852+0000","last_fullsized":"2024-08-18T22:06:10.507852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:36.889561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510634+0000","last_change":"2024-08-18T22:05:28.923076+0000","last_active":"2024-08-18T22:06:10.510634+0000","last_peered":"2024-08-18T22:06:10.510634+0000","last_clean":"2024-08-18T22:06:10.510634+0000","last_became_active":"2024-08-18T22:05:28.922688+0000","last_became_peered":"2024-08-18T22:05:28.922688+0000","last_unstale":"2024-08-18T22:06:10.510634+0000","last_undegraded":"2024-08-18T22:06:10.510634+0000","last_fullsized":"2024-08-18T22:06:10.510634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:34.360540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509085+0000","last_change":"2024-08-18T22:05:21.855174+0000","last_active":"2024-08-18T22:06:10.509085+0000","last_peered":"2024-08-18T22:06:10.509085+0000","last_clean":"2024-08-18T22:06:10.509085+0000","last_became_active":"2024-08-18T22:05:21.854818+0000","last_became_peered":"2024-08-18T22:05:21.854818+0000","last_unstale":"2024-08-18T22:06:10.509085+0000","last_undegraded":"2024-08-18T22:06:10.509085+0000","last_fullsized":"2024-08-18T22:06:10.509085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:48:55.094624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508468+0000","last_change":"2024-08-18T22:05:19.847876+0000","last_active":"2024-08-18T22:06:10.508468+0000","last_peered":"2024-08-18T22:06:10.508468+0000","last_clean":"2024-08-18T22:06:10.508468+0000","last_became_active":"2024-08-18T22:05:19.847505+0000","last_became_peered":"2024-08-18T22:05:19.847505+0000","last_unstale":"2024-08-18T22:06:10.508468+0000","last_undegraded":"2024-08-18T22:06:10.508468+0000","last_fullsized":"2024-08-18T22:06:10.508468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:50:15.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508005+0000","last_change":"2024-08-18T22:05:28.921647+0000","last_active":"2024-08-18T22:06:10.508005+0000","last_peered":"2024-08-18T22:06:10.508005+0000","last_clean":"2024-08-18T22:06:10.508005+0000","last_became_active":"2024-08-18T22:05:28.921305+0000","last_became_peered":"2024-08-18T22:05:28.921305+0000","last_unstale":"2024-08-18T22:06:10.508005+0000","last_undegraded":"2024-08-18T22:06:10.508005+0000","last_fullsized":"2024-08-18T22:06:10.508005+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:29.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506841+0000","last_change":"2024-08-18T22:05:21.861151+0000","last_active":"2024-08-18T22:06:10.506841+0000","last_peered":"2024-08-18T22:06:10.506841+0000","last_clean":"2024-08-18T22:06:10.506841+0000","last_became_active":"2024-08-18T22:05:21.860834+0000","last_became_peered":"2024-08-18T22:05:21.860834+0000","last_unstale":"2024-08-18T22:06:10.506841+0000","last_undegraded":"2024-08-18T22:06:10.506841+0000","last_fullsized":"2024-08-18T22:06:10.506841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:32.890750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:22.494726+0000","last_change":"2024-08-18T22:05:19.846145+0000","last_active":"2024-08-18T22:06:22.494726+0000","last_peered":"2024-08-18T22:06:22.494726+0000","last_clean":"2024-08-18T22:06:22.494726+0000","last_became_active":"2024-08-18T22:05:19.845711+0000","last_became_peered":"2024-08-18T22:05:19.845711+0000","last_unstale":"2024-08-18T22:06:22.494726+0000","last_undegraded":"2024-08-18T22:06:22.494726+0000","last_fullsized":"2024-08-18T22:06:22.494726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:20.376131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771915+0000","last_change":"2024-08-18T22:05:28.923256+0000","last_active":"2024-08-18T22:06:10.771915+0000","last_peered":"2024-08-18T22:06:10.771915+0000","last_clean":"2024-08-18T22:06:10.771915+0000","last_became_active":"2024-08-18T22:05:28.922845+0000","last_became_peered":"2024-08-18T22:05:28.922845+0000","last_unstale":"2024-08-18T22:06:10.771915+0000","last_undegraded":"2024-08-18T22:06:10.771915+0000","last_fullsized":"2024-08-18T22:06:10.771915+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:41.930937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508677+0000","last_change":"2024-08-18T22:05:28.924743+0000","last_active":"2024-08-18T22:06:10.508677+0000","last_peered":"2024-08-18T22:06:10.508677+0000","last_clean":"2024-08-18T22:06:10.508677+0000","last_became_active":"2024-08-18T22:05:28.923674+0000","last_became_peered":"2024-08-18T22:05:28.923674+0000","last_unstale":"2024-08-18T22:06:10.508677+0000","last_undegraded":"2024-08-18T22:06:10.508677+0000","last_fullsized":"2024-08-18T22:06:10.508677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:19.834998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508496+0000","last_change":"2024-08-18T22:05:21.857194+0000","last_active":"2024-08-18T22:06:10.508496+0000","last_peered":"2024-08-18T22:06:10.508496+0000","last_clean":"2024-08-18T22:06:10.508496+0000","last_became_active":"2024-08-18T22:05:21.856916+0000","last_became_peered":"2024-08-18T22:05:21.856916+0000","last_unstale":"2024-08-18T22:06:10.508496+0000","last_undegraded":"2024-08-18T22:06:10.508496+0000","last_fullsized":"2024-08-18T22:06:10.508496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:24.759501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506570+0000","last_change":"2024-08-18T22:05:19.844919+0000","last_active":"2024-08-18T22:06:10.506570+0000","last_peered":"2024-08-18T22:06:10.506570+0000","last_clean":"2024-08-18T22:06:10.506570+0000","last_became_active":"2024-08-18T22:05:19.844539+0000","last_became_peered":"2024-08-18T22:05:19.844539+0000","last_unstale":"2024-08-18T22:06:10.506570+0000","last_undegraded":"2024-08-18T22:06:10.506570+0000","last_fullsized":"2024-08-18T22:06:10.506570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:01.598535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510256+0000","last_change":"2024-08-18T22:05:28.923304+0000","last_active":"2024-08-18T22:06:10.510256+0000","last_peered":"2024-08-18T22:06:10.510256+0000","last_clean":"2024-08-18T22:06:10.510256+0000","last_became_active":"2024-08-18T22:05:28.922912+0000","last_became_peered":"2024-08-18T22:05:28.922912+0000","last_unstale":"2024-08-18T22:06:10.510256+0000","last_undegraded":"2024-08-18T22:06:10.510256+0000","last_fullsized":"2024-08-18T22:06:10.510256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:24:47.834354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771950+0000","last_change":"2024-08-18T22:05:21.849448+0000","last_active":"2024-08-18T22:06:10.771950+0000","last_peered":"2024-08-18T22:06:10.771950+0000","last_clean":"2024-08-18T22:06:10.771950+0000","last_became_active":"2024-08-18T22:05:21.849154+0000","last_became_peered":"2024-08-18T22:05:21.849154+0000","last_unstale":"2024-08-18T22:06:10.771950+0000","last_undegraded":"2024-08-18T22:06:10.771950+0000","last_fullsized":"2024-08-18T22:06:10.771950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:38.583121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505540+0000","last_change":"2024-08-18T22:05:19.848483+0000","last_active":"2024-08-18T22:06:10.505540+0000","last_peered":"2024-08-18T22:06:10.505540+0000","last_clean":"2024-08-18T22:06:10.505540+0000","last_became_active":"2024-08-18T22:05:19.848190+0000","last_became_peered":"2024-08-18T22:05:19.848190+0000","last_unstale":"2024-08-18T22:06:10.505540+0000","last_undegraded":"2024-08-18T22:06:10.505540+0000","last_fullsized":"2024-08-18T22:06:10.505540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:01.719565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509148+0000","last_change":"2024-08-18T22:05:19.843796+0000","last_active":"2024-08-18T22:06:10.509148+0000","last_peered":"2024-08-18T22:06:10.509148+0000","last_clean":"2024-08-18T22:06:10.509148+0000","last_became_active":"2024-08-18T22:05:19.843495+0000","last_became_peered":"2024-08-18T22:05:19.843495+0000","last_unstale":"2024-08-18T22:06:10.509148+0000","last_undegraded":"2024-08-18T22:06:10.509148+0000","last_fullsized":"2024-08-18T22:06:10.509148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:21.583561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507269+0000","last_change":"2024-08-18T22:05:21.856370+0000","last_active":"2024-08-18T22:06:10.507269+0000","last_peered":"2024-08-18T22:06:10.507269+0000","last_clean":"2024-08-18T22:06:10.507269+0000","last_became_active":"2024-08-18T22:05:21.855954+0000","last_became_peered":"2024-08-18T22:05:21.855954+0000","last_unstale":"2024-08-18T22:06:10.507269+0000","last_undegraded":"2024-08-18T22:06:10.507269+0000","last_fullsized":"2024-08-18T22:06:10.507269+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:30.828305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.516344+0000","last_change":"2024-08-18T22:06:10.516344+0000","last_active":"2024-08-18T22:06:10.516344+0000","last_peered":"2024-08-18T22:06:10.516344+0000","last_clean":"2024-08-18T22:06:10.516344+0000","last_became_active":"2024-08-18T22:06:10.515925+0000","last_became_peered":"2024-08-18T22:06:10.515925+0000","last_unstale":"2024-08-18T22:06:10.516344+0000","last_undegraded":"2024-08-18T22:06:10.516344+0000","last_fullsized":"2024-08-18T22:06:10.516344+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:41:07.585521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:18.490104+0000","last_change":"2024-08-18T22:05:19.846860+0000","last_active":"2024-08-18T22:06:18.490104+0000","last_peered":"2024-08-18T22:06:18.490104+0000","last_clean":"2024-08-18T22:06:18.490104+0000","last_became_active":"2024-08-18T22:05:19.846496+0000","last_became_peered":"2024-08-18T22:05:19.846496+0000","last_unstale":"2024-08-18T22:06:18.490104+0000","last_undegraded":"2024-08-18T22:06:18.490104+0000","last_fullsized":"2024-08-18T22:06:18.490104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:16.555137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513529+0000","last_change":"2024-08-18T22:05:21.849058+0000","last_active":"2024-08-18T22:06:10.513529+0000","last_peered":"2024-08-18T22:06:10.513529+0000","last_clean":"2024-08-18T22:06:10.513529+0000","last_became_active":"2024-08-18T22:05:21.848703+0000","last_became_peered":"2024-08-18T22:05:21.848703+0000","last_unstale":"2024-08-18T22:06:10.513529+0000","last_undegraded":"2024-08-18T22:06:10.513529+0000","last_fullsized":"2024-08-18T22:06:10.513529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:10.024156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508916+0000","last_change":"2024-08-18T22:05:28.922968+0000","last_active":"2024-08-18T22:06:10.508916+0000","last_peered":"2024-08-18T22:06:10.508916+0000","last_clean":"2024-08-18T22:06:10.508916+0000","last_became_active":"2024-08-18T22:05:28.922378+0000","last_became_peered":"2024-08-18T22:05:28.922378+0000","last_unstale":"2024-08-18T22:06:10.508916+0000","last_undegraded":"2024-08-18T22:06:10.508916+0000","last_fullsized":"2024-08-18T22:06:10.508916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:23:07.241028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509985+0000","last_change":"2024-08-18T22:05:21.858572+0000","last_active":"2024-08-18T22:06:10.509985+0000","last_peered":"2024-08-18T22:06:10.509985+0000","last_clean":"2024-08-18T22:06:10.509985+0000","last_became_active":"2024-08-18T22:05:21.858254+0000","last_became_peered":"2024-08-18T22:05:21.858254+0000","last_unstale":"2024-08-18T22:06:10.509985+0000","last_undegraded":"2024-08-18T22:06:10.509985+0000","last_fullsized":"2024-08-18T22:06:10.509985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:52.456087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509101+0000","last_change":"2024-08-18T22:05:21.856710+0000","last_active":"2024-08-18T22:06:10.509101+0000","last_peered":"2024-08-18T22:06:10.509101+0000","last_clean":"2024-08-18T22:06:10.509101+0000","last_became_active":"2024-08-18T22:05:21.855399+0000","last_became_peered":"2024-08-18T22:05:21.855399+0000","last_unstale":"2024-08-18T22:06:10.509101+0000","last_undegraded":"2024-08-18T22:06:10.509101+0000","last_fullsized":"2024-08-18T22:06:10.509101+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:36.039953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507843+0000","last_change":"2024-08-18T22:05:21.856085+0000","last_active":"2024-08-18T22:06:10.507843+0000","last_peered":"2024-08-18T22:06:10.507843+0000","last_clean":"2024-08-18T22:06:10.507843+0000","last_became_active":"2024-08-18T22:05:21.855263+0000","last_became_peered":"2024-08-18T22:05:21.855263+0000","last_unstale":"2024-08-18T22:06:10.507843+0000","last_undegraded":"2024-08-18T22:06:10.507843+0000","last_fullsized":"2024-08-18T22:06:10.507843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:31.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509110+0000","last_change":"2024-08-18T22:05:21.855385+0000","last_active":"2024-08-18T22:06:10.509110+0000","last_peered":"2024-08-18T22:06:10.509110+0000","last_clean":"2024-08-18T22:06:10.509110+0000","last_became_active":"2024-08-18T22:05:21.854829+0000","last_became_peered":"2024-08-18T22:05:21.854829+0000","last_unstale":"2024-08-18T22:06:10.509110+0000","last_undegraded":"2024-08-18T22:06:10.509110+0000","last_fullsized":"2024-08-18T22:06:10.509110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:59.704154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510370+0000","last_change":"2024-08-18T22:06:10.510370+0000","last_active":"2024-08-18T22:06:10.510370+0000","last_peered":"2024-08-18T22:06:10.510370+0000","last_clean":"2024-08-18T22:06:10.510370+0000","last_became_active":"2024-08-18T22:06:10.509829+0000","last_became_peered":"2024-08-18T22:06:10.509829+0000","last_unstale":"2024-08-18T22:06:10.510370+0000","last_undegraded":"2024-08-18T22:06:10.510370+0000","last_fullsized":"2024-08-18T22:06:10.510370+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:20.171834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510420+0000","last_change":"2024-08-18T22:05:21.856137+0000","last_active":"2024-08-18T22:06:10.510420+0000","last_peered":"2024-08-18T22:06:10.510420+0000","last_clean":"2024-08-18T22:06:10.510420+0000","last_became_active":"2024-08-18T22:05:21.855425+0000","last_became_peered":"2024-08-18T22:05:21.855425+0000","last_unstale":"2024-08-18T22:06:10.510420+0000","last_undegraded":"2024-08-18T22:06:10.510420+0000","last_fullsized":"2024-08-18T22:06:10.510420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:37.514710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509024+0000","last_change":"2024-08-18T22:05:21.856084+0000","last_active":"2024-08-18T22:06:10.509024+0000","last_peered":"2024-08-18T22:06:10.509024+0000","last_clean":"2024-08-18T22:06:10.509024+0000","last_became_active":"2024-08-18T22:05:21.855779+0000","last_became_peered":"2024-08-18T22:05:21.855779+0000","last_unstale":"2024-08-18T22:06:10.509024+0000","last_undegraded":"2024-08-18T22:06:10.509024+0000","last_fullsized":"2024-08-18T22:06:10.509024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:02:47.833634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772328+0000","last_change":"2024-08-18T22:05:21.856729+0000","last_active":"2024-08-18T22:06:10.772328+0000","last_peered":"2024-08-18T22:06:10.772328+0000","last_clean":"2024-08-18T22:06:10.772328+0000","last_became_active":"2024-08-18T22:05:21.856446+0000","last_became_peered":"2024-08-18T22:05:21.856446+0000","last_unstale":"2024-08-18T22:06:10.772328+0000","last_undegraded":"2024-08-18T22:06:10.772328+0000","last_fullsized":"2024-08-18T22:06:10.772328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.482225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506405+0000","last_change":"2024-08-18T22:05:21.851772+0000","last_active":"2024-08-18T22:06:10.506405+0000","last_peered":"2024-08-18T22:06:10.506405+0000","last_clean":"2024-08-18T22:06:10.506405+0000","last_became_active":"2024-08-18T22:05:21.851417+0000","last_became_peered":"2024-08-18T22:05:21.851417+0000","last_unstale":"2024-08-18T22:06:10.506405+0000","last_undegraded":"2024-08-18T22:06:10.506405+0000","last_fullsized":"2024-08-18T22:06:10.506405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:32.509318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771984+0000","last_change":"2024-08-18T22:05:21.857887+0000","last_active":"2024-08-18T22:06:10.771984+0000","last_peered":"2024-08-18T22:06:10.771984+0000","last_clean":"2024-08-18T22:06:10.771984+0000","last_became_active":"2024-08-18T22:05:21.857585+0000","last_became_peered":"2024-08-18T22:05:21.857585+0000","last_unstale":"2024-08-18T22:06:10.771984+0000","last_undegraded":"2024-08-18T22:06:10.771984+0000","last_fullsized":"2024-08-18T22:06:10.771984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:23.299033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506488+0000","last_change":"2024-08-18T22:05:21.854626+0000","last_active":"2024-08-18T22:06:10.506488+0000","last_peered":"2024-08-18T22:06:10.506488+0000","last_clean":"2024-08-18T22:06:10.506488+0000","last_became_active":"2024-08-18T22:05:21.854290+0000","last_became_peered":"2024-08-18T22:05:21.854290+0000","last_unstale":"2024-08-18T22:06:10.506488+0000","last_undegraded":"2024-08-18T22:06:10.506488+0000","last_fullsized":"2024-08-18T22:06:10.506488+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:45:24.988669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505825+0000","last_change":"2024-08-18T22:05:21.865863+0000","last_active":"2024-08-18T22:06:10.505825+0000","last_peered":"2024-08-18T22:06:10.505825+0000","last_clean":"2024-08-18T22:06:10.505825+0000","last_became_active":"2024-08-18T22:05:21.864634+0000","last_became_peered":"2024-08-18T22:05:21.864634+0000","last_unstale":"2024-08-18T22:06:10.505825+0000","last_undegraded":"2024-08-18T22:06:10.505825+0000","last_fullsized":"2024-08-18T22:06:10.505825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:34.051147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510087+0000","last_change":"2024-08-18T22:05:21.860193+0000","last_active":"2024-08-18T22:06:10.510087+0000","last_peered":"2024-08-18T22:06:10.510087+0000","last_clean":"2024-08-18T22:06:10.510087+0000","last_became_active":"2024-08-18T22:05:21.859761+0000","last_became_peered":"2024-08-18T22:05:21.859761+0000","last_unstale":"2024-08-18T22:06:10.510087+0000","last_undegraded":"2024-08-18T22:06:10.510087+0000","last_fullsized":"2024-08-18T22:06:10.510087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:18.465913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509086+0000","last_change":"2024-08-18T22:05:21.860569+0000","last_active":"2024-08-18T22:06:10.509086+0000","last_peered":"2024-08-18T22:06:10.509086+0000","last_clean":"2024-08-18T22:06:10.509086+0000","last_became_active":"2024-08-18T22:05:21.860250+0000","last_became_peered":"2024-08-18T22:05:21.860250+0000","last_unstale":"2024-08-18T22:06:10.509086+0000","last_undegraded":"2024-08-18T22:06:10.509086+0000","last_fullsized":"2024-08-18T22:06:10.509086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:52.097840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509523+0000","last_change":"2024-08-18T22:05:21.858271+0000","last_active":"2024-08-18T22:06:10.509523+0000","last_peered":"2024-08-18T22:06:10.509523+0000","last_clean":"2024-08-18T22:06:10.509523+0000","last_became_active":"2024-08-18T22:05:21.857968+0000","last_became_peered":"2024-08-18T22:05:21.857968+0000","last_unstale":"2024-08-18T22:06:10.509523+0000","last_undegraded":"2024-08-18T22:06:10.509523+0000","last_fullsized":"2024-08-18T22:06:10.509523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:24.023136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510630+0000","last_change":"2024-08-18T22:05:21.853799+0000","last_active":"2024-08-18T22:06:10.510630+0000","last_peered":"2024-08-18T22:06:10.510630+0000","last_clean":"2024-08-18T22:06:10.510630+0000","last_became_active":"2024-08-18T22:05:21.853432+0000","last_became_peered":"2024-08-18T22:05:21.853432+0000","last_unstale":"2024-08-18T22:06:10.510630+0000","last_undegraded":"2024-08-18T22:06:10.510630+0000","last_fullsized":"2024-08-18T22:06:10.510630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:07.429169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506002+0000","last_change":"2024-08-18T22:05:21.855117+0000","last_active":"2024-08-18T22:06:10.506002+0000","last_peered":"2024-08-18T22:06:10.506002+0000","last_clean":"2024-08-18T22:06:10.506002+0000","last_became_active":"2024-08-18T22:05:21.854041+0000","last_became_peered":"2024-08-18T22:05:21.854041+0000","last_unstale":"2024-08-18T22:06:10.506002+0000","last_undegraded":"2024-08-18T22:06:10.506002+0000","last_fullsized":"2024-08-18T22:06:10.506002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:17.222658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508062+0000","last_change":"2024-08-18T22:05:21.861745+0000","last_active":"2024-08-18T22:06:10.508062+0000","last_peered":"2024-08-18T22:06:10.508062+0000","last_clean":"2024-08-18T22:06:10.508062+0000","last_became_active":"2024-08-18T22:05:21.861427+0000","last_became_peered":"2024-08-18T22:05:21.861427+0000","last_unstale":"2024-08-18T22:06:10.508062+0000","last_undegraded":"2024-08-18T22:06:10.508062+0000","last_fullsized":"2024-08-18T22:06:10.508062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:17.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508302+0000","last_change":"2024-08-18T22:05:21.860046+0000","last_active":"2024-08-18T22:06:10.508302+0000","last_peered":"2024-08-18T22:06:10.508302+0000","last_clean":"2024-08-18T22:06:10.508302+0000","last_became_active":"2024-08-18T22:05:21.859674+0000","last_became_peered":"2024-08-18T22:05:21.859674+0000","last_unstale":"2024-08-18T22:06:10.508302+0000","last_undegraded":"2024-08-18T22:06:10.508302+0000","last_fullsized":"2024-08-18T22:06:10.508302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:44.615270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505796+0000","last_change":"2024-08-18T22:05:21.847647+0000","last_active":"2024-08-18T22:06:10.505796+0000","last_peered":"2024-08-18T22:06:10.505796+0000","last_clean":"2024-08-18T22:06:10.505796+0000","last_became_active":"2024-08-18T22:05:21.847367+0000","last_became_peered":"2024-08-18T22:05:21.847367+0000","last_unstale":"2024-08-18T22:06:10.505796+0000","last_undegraded":"2024-08-18T22:06:10.505796+0000","last_fullsized":"2024-08-18T22:06:10.505796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:33.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.512325+0000","last_change":"2024-08-18T22:05:21.861326+0000","last_active":"2024-08-18T22:06:10.512325+0000","last_peered":"2024-08-18T22:06:10.512325+0000","last_clean":"2024-08-18T22:06:10.512325+0000","last_became_active":"2024-08-18T22:05:21.860968+0000","last_became_peered":"2024-08-18T22:05:21.860968+0000","last_unstale":"2024-08-18T22:06:10.512325+0000","last_undegraded":"2024-08-18T22:06:10.512325+0000","last_fullsized":"2024-08-18T22:06:10.512325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:49.150670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508590+0000","last_change":"2024-08-18T22:05:21.852618+0000","last_active":"2024-08-18T22:06:10.508590+0000","last_peered":"2024-08-18T22:06:10.508590+0000","last_clean":"2024-08-18T22:06:10.508590+0000","last_became_active":"2024-08-18T22:05:21.852318+0000","last_became_peered":"2024-08-18T22:05:21.852318+0000","last_unstale":"2024-08-18T22:06:10.508590+0000","last_undegraded":"2024-08-18T22:06:10.508590+0000","last_fullsized":"2024-08-18T22:06:10.508590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:06:49.085150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509956+0000","last_change":"2024-08-18T22:05:21.860108+0000","last_active":"2024-08-18T22:06:10.509956+0000","last_peered":"2024-08-18T22:06:10.509956+0000","last_clean":"2024-08-18T22:06:10.509956+0000","last_became_active":"2024-08-18T22:05:21.859794+0000","last_became_peered":"2024-08-18T22:05:21.859794+0000","last_unstale":"2024-08-18T22:06:10.509956+0000","last_undegraded":"2024-08-18T22:06:10.509956+0000","last_fullsized":"2024-08-18T22:06:10.509956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:01.974202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507181+0000","last_change":"2024-08-18T22:05:21.856404+0000","last_active":"2024-08-18T22:06:10.507181+0000","last_peered":"2024-08-18T22:06:10.507181+0000","last_clean":"2024-08-18T22:06:10.507181+0000","last_became_active":"2024-08-18T22:05:21.855800+0000","last_became_peered":"2024-08-18T22:05:21.855800+0000","last_unstale":"2024-08-18T22:06:10.507181+0000","last_undegraded":"2024-08-18T22:06:10.507181+0000","last_fullsized":"2024-08-18T22:06:10.507181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:09.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771944+0000","last_change":"2024-08-18T22:05:21.859891+0000","last_active":"2024-08-18T22:06:10.771944+0000","last_peered":"2024-08-18T22:06:10.771944+0000","last_clean":"2024-08-18T22:06:10.771944+0000","last_became_active":"2024-08-18T22:05:21.859407+0000","last_became_peered":"2024-08-18T22:05:21.859407+0000","last_unstale":"2024-08-18T22:06:10.771944+0000","last_undegraded":"2024-08-18T22:06:10.771944+0000","last_fullsized":"2024-08-18T22:06:10.771944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:59.285627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508099+0000","last_change":"2024-08-18T22:05:21.856428+0000","last_active":"2024-08-18T22:06:10.508099+0000","last_peered":"2024-08-18T22:06:10.508099+0000","last_clean":"2024-08-18T22:06:10.508099+0000","last_became_active":"2024-08-18T22:05:21.853374+0000","last_became_peered":"2024-08-18T22:05:21.853374+0000","last_unstale":"2024-08-18T22:06:10.508099+0000","last_undegraded":"2024-08-18T22:06:10.508099+0000","last_fullsized":"2024-08-18T22:06:10.508099+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:07.087171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509021+0000","last_change":"2024-08-18T22:05:21.852688+0000","last_active":"2024-08-18T22:06:10.509021+0000","last_peered":"2024-08-18T22:06:10.509021+0000","last_clean":"2024-08-18T22:06:10.509021+0000","last_became_active":"2024-08-18T22:05:21.851107+0000","last_became_peered":"2024-08-18T22:05:21.851107+0000","last_unstale":"2024-08-18T22:06:10.509021+0000","last_undegraded":"2024-08-18T22:06:10.509021+0000","last_fullsized":"2024-08-18T22:06:10.509021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:48.267166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513864+0000","last_change":"2024-08-18T22:05:21.850809+0000","last_active":"2024-08-18T22:06:10.513864+0000","last_peered":"2024-08-18T22:06:10.513864+0000","last_clean":"2024-08-18T22:06:10.513864+0000","last_became_active":"2024-08-18T22:05:21.850510+0000","last_became_peered":"2024-08-18T22:05:21.850510+0000","last_unstale":"2024-08-18T22:06:10.513864+0000","last_undegraded":"2024-08-18T22:06:10.513864+0000","last_fullsized":"2024-08-18T22:06:10.513864+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:39.338051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.512225+0000","last_change":"2024-08-18T22:05:21.856156+0000","last_active":"2024-08-18T22:06:10.512225+0000","last_peered":"2024-08-18T22:06:10.512225+0000","last_clean":"2024-08-18T22:06:10.512225+0000","last_became_active":"2024-08-18T22:05:21.855830+0000","last_became_peered":"2024-08-18T22:05:21.855830+0000","last_unstale":"2024-08-18T22:06:10.512225+0000","last_undegraded":"2024-08-18T22:06:10.512225+0000","last_fullsized":"2024-08-18T22:06:10.512225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:10.670405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508858+0000","last_change":"2024-08-18T22:05:21.865162+0000","last_active":"2024-08-18T22:06:10.508858+0000","last_peered":"2024-08-18T22:06:10.508858+0000","last_clean":"2024-08-18T22:06:10.508858+0000","last_became_active":"2024-08-18T22:05:21.864842+0000","last_became_peered":"2024-08-18T22:05:21.864842+0000","last_unstale":"2024-08-18T22:06:10.508858+0000","last_undegraded":"2024-08-18T22:06:10.508858+0000","last_fullsized":"2024-08-18T22:06:10.508858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:21.388638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508777+0000","last_change":"2024-08-18T22:05:21.859227+0000","last_active":"2024-08-18T22:06:10.508777+0000","last_peered":"2024-08-18T22:06:10.508777+0000","last_clean":"2024-08-18T22:06:10.508777+0000","last_became_active":"2024-08-18T22:05:21.858886+0000","last_became_peered":"2024-08-18T22:05:21.858886+0000","last_unstale":"2024-08-18T22:06:10.508777+0000","last_undegraded":"2024-08-18T22:06:10.508777+0000","last_fullsized":"2024-08-18T22:06:10.508777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:08.710772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510562+0000","last_change":"2024-08-18T22:05:21.854864+0000","last_active":"2024-08-18T22:06:10.510562+0000","last_peered":"2024-08-18T22:06:10.510562+0000","last_clean":"2024-08-18T22:06:10.510562+0000","last_became_active":"2024-08-18T22:05:21.854522+0000","last_became_peered":"2024-08-18T22:05:21.854522+0000","last_unstale":"2024-08-18T22:06:10.510562+0000","last_undegraded":"2024-08-18T22:06:10.510562+0000","last_fullsized":"2024-08-18T22:06:10.510562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:32.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65907,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":172,"num_read_kb":151,"num_write":166,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514519,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":504444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743454,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32848,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712304,"statfs":{"total":95995035648,"available":95961399296,"internally_reserved":0,"allocated":1712128,"data_stored":1157715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906978,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":504680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168615,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":504600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397547,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1100898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561072,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":499856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790003,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1638400,"data_stored":1096096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953529,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1097728,"data_stored":566413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182460,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1028096,"data_stored":500050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":501506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1081344,"data_stored":561283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":501244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:06:27.395 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-18T22:06:27.396 INFO:tasks.cephadm:Setting up client nodes... 2024-08-18T22:06:27.396 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-18T22:06:27.650 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:28.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.161+0000 7f8afe4e5640 1 -- 172.21.15.123:0/3159741712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8af81023c0 msgr2=0x7f8af8108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:28.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.161+0000 7f8afe4e5640 1 --2- 172.21.15.123:0/3159741712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8af81023c0 0x7f8af8108c50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009ca0 tx=0x7f8af002a8c0 comp rx=0 tx=0).stop 2024-08-18T22:06:28.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.161+0000 7f8afe4e5640 1 -- 172.21.15.123:0/3159741712 shutdown_connections 2024-08-18T22:06:28.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.161+0000 7f8afe4e5640 1 --2- 172.21.15.123:0/3159741712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8af81023c0 0x7f8af8108c50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:28.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.161+0000 7f8afe4e5640 1 --2- 172.21.15.123:0/3159741712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8af8101a00 0x7f8af8101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:28.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.161+0000 7f8afe4e5640 1 --2- 172.21.15.123:0/3159741712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8af8100800 0x7f8af8100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:28.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.161+0000 7f8afe4e5640 1 -- 172.21.15.123:0/3159741712 >> 172.21.15.123:0/3159741712 conn(0x7f8af80fbfb0 msgr2=0x7f8af80fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:28.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.161+0000 7f8afe4e5640 1 -- 172.21.15.123:0/3159741712 shutdown_connections 2024-08-18T22:06:28.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.161+0000 7f8afe4e5640 1 -- 172.21.15.123:0/3159741712 wait complete. 2024-08-18T22:06:28.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.162+0000 7f8afe4e5640 1 Processor -- start 2024-08-18T22:06:28.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.162+0000 7f8afe4e5640 1 -- start start 2024-08-18T22:06:28.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.162+0000 7f8afe4e5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8af8100800 0x7f8af8104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:28.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.162+0000 7f8afe4e5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8af8101a00 0x7f8af8102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:28.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.162+0000 7f8afe4e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8af81023c0 0x7f8af8103320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:28.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.162+0000 7f8afe4e5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8af810c4e0 con 0x7f8af8101a00 2024-08-18T22:06:28.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.162+0000 7f8afe4e5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8af810c360 con 0x7f8af81023c0 2024-08-18T22:06:28.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.162+0000 7f8afe4e5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8af810c660 con 0x7f8af8100800 2024-08-18T22:06:28.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.162+0000 7f8af77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8af8101a00 0x7f8af8102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:28.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.162+0000 7f8af77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8af8101a00 0x7f8af8102de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51998/0 (socket says 172.21.15.123:51998) 2024-08-18T22:06:28.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.162+0000 7f8af77fe640 1 -- 172.21.15.123:0/2704027087 learned_addr learned my addr 172.21.15.123:0/2704027087 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:28.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.163+0000 7f8afca82640 1 --2- 172.21.15.123:0/2704027087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8af81023c0 0x7f8af8103320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:28.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.163+0000 7f8af7fff640 1 --2- 172.21.15.123:0/2704027087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8af8100800 0x7f8af8104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:28.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.163+0000 7f8af77fe640 1 -- 172.21.15.123:0/2704027087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8af8100800 msgr2=0x7f8af8104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:28.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.163+0000 7f8af77fe640 1 --2- 172.21.15.123:0/2704027087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8af8100800 0x7f8af8104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:28.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.163+0000 7f8af77fe640 1 -- 172.21.15.123:0/2704027087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8af81023c0 msgr2=0x7f8af8103320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:28.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.163+0000 7f8af77fe640 1 --2- 172.21.15.123:0/2704027087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8af81023c0 0x7f8af8103320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:28.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.163+0000 7f8af77fe640 1 -- 172.21.15.123:0/2704027087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af8103be0 con 0x7f8af8101a00 2024-08-18T22:06:28.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.163+0000 7f8af7fff640 1 --2- 172.21.15.123:0/2704027087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8af8100800 0x7f8af8104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:28.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.163+0000 7f8af77fe640 1 --2- 172.21.15.123:0/2704027087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8af8101a00 0x7f8af8102de0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00b4a0 tx=0x7f8aec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:28.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.163+0000 7f8af57fa640 1 -- 172.21.15.123:0/2704027087 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec014070 con 0x7f8af8101a00 2024-08-18T22:06:28.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.163+0000 7f8afe4e5640 1 -- 172.21.15.123:0/2704027087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af81a1d50 con 0x7f8af8101a00 2024-08-18T22:06:28.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.163+0000 7f8af57fa640 1 -- 172.21.15.123:0/2704027087 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8aec010af0 con 0x7f8af8101a00 2024-08-18T22:06:28.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.163+0000 7f8af57fa640 1 -- 172.21.15.123:0/2704027087 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec017d10 con 0x7f8af8101a00 2024-08-18T22:06:28.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.163+0000 7f8afe4e5640 1 -- 172.21.15.123:0/2704027087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af81a2280 con 0x7f8af8101a00 2024-08-18T22:06:28.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.164+0000 7f8afe4e5640 1 -- 172.21.15.123:0/2704027087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af81a2510 con 0x7f8af8101a00 2024-08-18T22:06:28.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.165+0000 7f8af57fa640 1 -- 172.21.15.123:0/2704027087 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f8aec017070 con 0x7f8af8101a00 2024-08-18T22:06:28.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.166+0000 7f8af57fa640 1 --2- 172.21.15.123:0/2704027087 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8ae00a2c10 0x7f8ae00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:28.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.166+0000 7f8af7fff640 1 --2- 172.21.15.123:0/2704027087 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8ae00a2c10 0x7f8ae00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:28.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.166+0000 7f8af57fa640 1 -- 172.21.15.123:0/2704027087 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f8aec0ce780 con 0x7f8af8101a00 2024-08-18T22:06:28.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.167+0000 7f8af7fff640 1 --2- 172.21.15.123:0/2704027087 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8ae00a2c10 0x7f8ae00a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8af8101860 tx=0x7f8ae800a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:28.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.171+0000 7f8af57fa640 1 -- 172.21.15.123:0/2704027087 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f8aec09b330 con 0x7f8af8101a00 2024-08-18T22:06:28.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.402+0000 7f8afe4e5640 1 -- 172.21.15.123:0/2704027087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f8af81a2820 con 0x7f8af8101a00 2024-08-18T22:06:28.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.404+0000 7f8af57fa640 1 -- 172.21.15.123:0/2704027087 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f8aec09ac30 con 0x7f8af8101a00 2024-08-18T22:06:28.405 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-08-18T22:06:28.405 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBkcMJm3tUMGBAApaFFCUWW/i7RKPolwlYqnA== 2024-08-18T22:06:28.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.407+0000 7f8afe4e5640 1 -- 172.21.15.123:0/2704027087 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8ae00a2c10 msgr2=0x7f8ae00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:28.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.407+0000 7f8afe4e5640 1 --2- 172.21.15.123:0/2704027087 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8ae00a2c10 0x7f8ae00a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8af8101860 tx=0x7f8ae800a5e0 comp rx=0 tx=0).stop 2024-08-18T22:06:28.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.407+0000 7f8afe4e5640 1 -- 172.21.15.123:0/2704027087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8af8101a00 msgr2=0x7f8af8102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:28.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.407+0000 7f8afe4e5640 1 --2- 172.21.15.123:0/2704027087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8af8101a00 0x7f8af8102de0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00b4a0 tx=0x7f8aec00b960 comp rx=0 tx=0).stop 2024-08-18T22:06:28.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.407+0000 7f8afe4e5640 1 -- 172.21.15.123:0/2704027087 shutdown_connections 2024-08-18T22:06:28.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.407+0000 7f8afe4e5640 1 --2- 172.21.15.123:0/2704027087 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8ae00a2c10 0x7f8ae00a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:28.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.407+0000 7f8afe4e5640 1 --2- 172.21.15.123:0/2704027087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8af81023c0 0x7f8af8103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:28.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.407+0000 7f8afe4e5640 1 --2- 172.21.15.123:0/2704027087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8af8101a00 0x7f8af8102de0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:28.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.407+0000 7f8afe4e5640 1 --2- 172.21.15.123:0/2704027087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8af8100800 0x7f8af8104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:28.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.407+0000 7f8afe4e5640 1 -- 172.21.15.123:0/2704027087 >> 172.21.15.123:0/2704027087 conn(0x7f8af80fbfb0 msgr2=0x7f8af80fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:28.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.407+0000 7f8afe4e5640 1 -- 172.21.15.123:0/2704027087 shutdown_connections 2024-08-18T22:06:28.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:28.407+0000 7f8afe4e5640 1 -- 172.21.15.123:0/2704027087 wait complete. 2024-08-18T22:06:28.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:28 smithi123 ceph-mon[18462]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:06:28.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:28 smithi123 ceph-mon[18462]: pgmap v299: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-18T22:06:28.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:28 smithi130 ceph-mon[21698]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:06:28.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:28 smithi130 ceph-mon[21698]: pgmap v299: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-18T22:06:28.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:28 smithi183 ceph-mon[22097]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:06:28.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:28 smithi183 ceph-mon[22097]: pgmap v299: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-18T22:06:29.055 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T22:06:29.055 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-18T22:06:29.055 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-18T22:06:29.092 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-18T22:06:29.093 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-18T22:06:29.093 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph mgr dump --format=json 2024-08-18T22:06:29.378 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:29.667 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:29 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2704027087' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-18T22:06:29.668 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:29 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2704027087' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-18T22:06:29.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:29 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2704027087' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-18T22:06:29.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:29 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2704027087' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-18T22:06:29.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.853+0000 7f25b11a7640 1 -- 172.21.15.123:0/4170449602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25ac1022a0 msgr2=0x7f25ac1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:29.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.853+0000 7f25b11a7640 1 --2- 172.21.15.123:0/4170449602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25ac1022a0 0x7f25ac1026e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2594009900 tx=0x7f259402a480 comp rx=0 tx=0).stop 2024-08-18T22:06:29.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.853+0000 7f25b11a7640 1 -- 172.21.15.123:0/4170449602 shutdown_connections 2024-08-18T22:06:29.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.853+0000 7f25b11a7640 1 --2- 172.21.15.123:0/4170449602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25ac102c20 0x7f25ac10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:29.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.853+0000 7f25b11a7640 1 --2- 172.21.15.123:0/4170449602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25ac1022a0 0x7f25ac1026e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:29.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.853+0000 7f25b11a7640 1 --2- 172.21.15.123:0/4170449602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25ac100b50 0x7f25ac100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:29.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.853+0000 7f25b11a7640 1 -- 172.21.15.123:0/4170449602 >> 172.21.15.123:0/4170449602 conn(0x7f25ac0fc500 msgr2=0x7f25ac0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:29.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.853+0000 7f25b11a7640 1 -- 172.21.15.123:0/4170449602 shutdown_connections 2024-08-18T22:06:29.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.853+0000 7f25b11a7640 1 -- 172.21.15.123:0/4170449602 wait complete. 2024-08-18T22:06:29.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.854+0000 7f25b11a7640 1 Processor -- start 2024-08-18T22:06:29.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.854+0000 7f25b11a7640 1 -- start start 2024-08-18T22:06:29.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.854+0000 7f25b11a7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25ac100b50 0x7f25ac1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:29.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.854+0000 7f25b11a7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25ac1022a0 0x7f25ac1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:29.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.854+0000 7f25b11a7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25ac102c20 0x7f25ac19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:29.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.854+0000 7f25b11a7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac110d50 con 0x7f25ac102c20 2024-08-18T22:06:29.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.854+0000 7f25b11a7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac110bd0 con 0x7f25ac1022a0 2024-08-18T22:06:29.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.854+0000 7f25b11a7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac110ed0 con 0x7f25ac100b50 2024-08-18T22:06:29.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25ab59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25ac102c20 0x7f25ac19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:29.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25ab59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25ac102c20 0x7f25ac19cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52020/0 (socket says 172.21.15.123:52020) 2024-08-18T22:06:29.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25ab59e640 1 -- 172.21.15.123:0/2421659199 learned_addr learned my addr 172.21.15.123:0/2421659199 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:29.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25aad9d640 1 --2- 172.21.15.123:0/2421659199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25ac100b50 0x7f25ac1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:29.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25a259c640 1 --2- 172.21.15.123:0/2421659199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25ac1022a0 0x7f25ac1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:29.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25ab59e640 1 -- 172.21.15.123:0/2421659199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25ac100b50 msgr2=0x7f25ac1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:29.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25ab59e640 1 --2- 172.21.15.123:0/2421659199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25ac100b50 0x7f25ac1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:29.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25ab59e640 1 -- 172.21.15.123:0/2421659199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25ac1022a0 msgr2=0x7f25ac1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:29.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25ab59e640 1 --2- 172.21.15.123:0/2421659199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25ac1022a0 0x7f25ac1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:29.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25ab59e640 1 -- 172.21.15.123:0/2421659199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ac19d350 con 0x7f25ac102c20 2024-08-18T22:06:29.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25a259c640 1 --2- 172.21.15.123:0/2421659199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25ac1022a0 0x7f25ac1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:29.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25ab59e640 1 --2- 172.21.15.123:0/2421659199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25ac102c20 0x7f25ac19cc70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f25a400b970 tx=0x7f25a400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:29.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25a8d99640 1 -- 172.21.15.123:0/2421659199 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a4019070 con 0x7f25ac102c20 2024-08-18T22:06:29.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25a8d99640 1 -- 172.21.15.123:0/2421659199 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25a4014440 con 0x7f25ac102c20 2024-08-18T22:06:29.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25a8d99640 1 -- 172.21.15.123:0/2421659199 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a40075d0 con 0x7f25ac102c20 2024-08-18T22:06:29.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25b11a7640 1 -- 172.21.15.123:0/2421659199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25ac19d640 con 0x7f25ac102c20 2024-08-18T22:06:29.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.855+0000 7f25b11a7640 1 -- 172.21.15.123:0/2421659199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25ac1a4f20 con 0x7f25ac102c20 2024-08-18T22:06:29.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.857+0000 7f25b11a7640 1 -- 172.21.15.123:0/2421659199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25ac100fb0 con 0x7f25ac102c20 2024-08-18T22:06:29.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.858+0000 7f25a8d99640 1 -- 172.21.15.123:0/2421659199 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f25a401c070 con 0x7f25ac102c20 2024-08-18T22:06:29.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.858+0000 7f25a8d99640 1 --2- 172.21.15.123:0/2421659199 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f25980a2c10 0x7f25980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:29.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.859+0000 7f25aad9d640 1 --2- 172.21.15.123:0/2421659199 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f25980a2c10 0x7f25980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:29.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.859+0000 7f25a8d99640 1 -- 172.21.15.123:0/2421659199 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f25a40cea10 con 0x7f25ac102c20 2024-08-18T22:06:29.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.859+0000 7f25aad9d640 1 --2- 172.21.15.123:0/2421659199 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f25980a2c10 0x7f25980a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f259c009990 tx=0x7f259c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:29.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:29.863+0000 7f25a8d99640 1 -- 172.21.15.123:0/2421659199 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f25a409b5c0 con 0x7f25ac102c20 2024-08-18T22:06:29.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:29 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2704027087' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-18T22:06:29.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:29 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2704027087' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-18T22:06:30.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:30.076+0000 7f25b11a7640 1 -- 172.21.15.123:0/2421659199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f25ac109dd0 con 0x7f25ac102c20 2024-08-18T22:06:30.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:30.080+0000 7f25a8d99640 1 -- 172.21.15.123:0/2421659199 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263204 (secure 0 0 0) 0x7f25a409aec0 con 0x7f25ac102c20 2024-08-18T22:06:30.084 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:06:30.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:30.083+0000 7f25b11a7640 1 -- 172.21.15.123:0/2421659199 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f25980a2c10 msgr2=0x7f25980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:30.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:30.083+0000 7f25b11a7640 1 --2- 172.21.15.123:0/2421659199 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f25980a2c10 0x7f25980a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f259c009990 tx=0x7f259c009110 comp rx=0 tx=0).stop 2024-08-18T22:06:30.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:30.083+0000 7f25b11a7640 1 -- 172.21.15.123:0/2421659199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25ac102c20 msgr2=0x7f25ac19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:30.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:30.083+0000 7f25b11a7640 1 --2- 172.21.15.123:0/2421659199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25ac102c20 0x7f25ac19cc70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f25a400b970 tx=0x7f25a400bd70 comp rx=0 tx=0).stop 2024-08-18T22:06:30.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:30.083+0000 7f25b11a7640 1 -- 172.21.15.123:0/2421659199 shutdown_connections 2024-08-18T22:06:30.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:30.083+0000 7f25b11a7640 1 --2- 172.21.15.123:0/2421659199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25ac102c20 0x7f25ac19cc70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:30.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:30.083+0000 7f25b11a7640 1 --2- 172.21.15.123:0/2421659199 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f25980a2c10 0x7f25980a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:30.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:30.083+0000 7f25b11a7640 1 --2- 172.21.15.123:0/2421659199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25ac1022a0 0x7f25ac1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:30.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:30.083+0000 7f25b11a7640 1 --2- 172.21.15.123:0/2421659199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25ac100b50 0x7f25ac1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:30.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:30.083+0000 7f25b11a7640 1 -- 172.21.15.123:0/2421659199 >> 172.21.15.123:0/2421659199 conn(0x7f25ac0fc500 msgr2=0x7f25ac069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:30.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:30.083+0000 7f25b11a7640 1 -- 172.21.15.123:0/2421659199 shutdown_connections 2024-08-18T22:06:30.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:30.083+0000 7f25b11a7640 1 -- 172.21.15.123:0/2421659199 wait complete. 2024-08-18T22:06:30.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:30 smithi123 ceph-mon[18462]: pgmap v300: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-18T22:06:30.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:30 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2421659199' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-18T22:06:30.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:30 smithi130 ceph-mon[21698]: pgmap v300: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-18T22:06:30.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:30 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2421659199' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-18T22:06:30.893 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":22123895},{"type":"v1","addr":"172.21.15.123:6801","nonce":22123895}]},"active_addr":"172.21.15.123:6801/22123895","active_change":"2024-08-18T21:59:09.243407+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.123:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":3856807507}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":4058654125}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":2778415458}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":1665323376}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":3982700373}]}]} 2024-08-18T22:06:30.898 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-18T22:06:30.898 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-18T22:06:30.898 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:06:30.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:30 smithi183 ceph-mon[22097]: pgmap v300: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-18T22:06:30.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:30 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2421659199' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-18T22:06:31.147 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:31.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.671+0000 7fafbeac6640 1 -- 172.21.15.123:0/3789096880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb81018c0 msgr2=0x7fafb8101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:31.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.671+0000 7fafbeac6640 1 --2- 172.21.15.123:0/3789096880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb81018c0 0x7fafb8101d20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009930 tx=0x7fafa402a420 comp rx=0 tx=0).stop 2024-08-18T22:06:31.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.671+0000 7fafbeac6640 1 -- 172.21.15.123:0/3789096880 shutdown_connections 2024-08-18T22:06:31.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.671+0000 7fafbeac6640 1 --2- 172.21.15.123:0/3789096880 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafb8102260 0x7fafb810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:31.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.671+0000 7fafbeac6640 1 --2- 172.21.15.123:0/3789096880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb81018c0 0x7fafb8101d20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:31.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.671+0000 7fafbeac6640 1 --2- 172.21.15.123:0/3789096880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafb81078c0 0x7fafb8107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:31.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.671+0000 7fafbeac6640 1 -- 172.21.15.123:0/3789096880 >> 172.21.15.123:0/3789096880 conn(0x7fafb80fd5e0 msgr2=0x7fafb80ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:31.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.671+0000 7fafbeac6640 1 -- 172.21.15.123:0/3789096880 shutdown_connections 2024-08-18T22:06:31.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.671+0000 7fafbeac6640 1 -- 172.21.15.123:0/3789096880 wait complete. 2024-08-18T22:06:31.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafbeac6640 1 Processor -- start 2024-08-18T22:06:31.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafbeac6640 1 -- start start 2024-08-18T22:06:31.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafbeac6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafb81018c0 0x7fafb8198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:31.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafbeac6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb8102260 0x7fafb81985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:31.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafbeac6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafb81078c0 0x7fafb819c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:31.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafbeac6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fafb8111cc0 con 0x7fafb8102260 2024-08-18T22:06:31.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafbeac6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fafb8111b40 con 0x7fafb81078c0 2024-08-18T22:06:31.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafbeac6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fafb8111e40 con 0x7fafb81018c0 2024-08-18T22:06:31.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafb7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb8102260 0x7fafb81985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:31.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafb7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb8102260 0x7fafb81985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52042/0 (socket says 172.21.15.123:52042) 2024-08-18T22:06:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafb7fff640 1 -- 172.21.15.123:0/611049157 learned_addr learned my addr 172.21.15.123:0/611049157 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafbd063640 1 --2- 172.21.15.123:0/611049157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafb81078c0 0x7fafb819c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafbc862640 1 --2- 172.21.15.123:0/611049157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafb81018c0 0x7fafb8198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafb7fff640 1 -- 172.21.15.123:0/611049157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafb81018c0 msgr2=0x7fafb8198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafb7fff640 1 --2- 172.21.15.123:0/611049157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafb81018c0 0x7fafb8198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafb7fff640 1 -- 172.21.15.123:0/611049157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafb81078c0 msgr2=0x7fafb819c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafb7fff640 1 --2- 172.21.15.123:0/611049157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafb81078c0 0x7fafb819c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafb7fff640 1 -- 172.21.15.123:0/611049157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb819d030 con 0x7fafb8102260 2024-08-18T22:06:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.672+0000 7fafbc862640 1 --2- 172.21.15.123:0/611049157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafb81018c0 0x7fafb8198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:06:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.673+0000 7fafb7fff640 1 --2- 172.21.15.123:0/611049157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb8102260 0x7fafb81985c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009a50 tx=0x7fafa4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.673+0000 7fafb5ffb640 1 -- 172.21.15.123:0/611049157 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa403f030 con 0x7fafb8102260 2024-08-18T22:06:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.673+0000 7fafb5ffb640 1 -- 172.21.15.123:0/611049157 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafa4003ce0 con 0x7fafb8102260 2024-08-18T22:06:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.673+0000 7fafbeac6640 1 -- 172.21.15.123:0/611049157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb819d2c0 con 0x7fafb8102260 2024-08-18T22:06:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.673+0000 7fafb5ffb640 1 -- 172.21.15.123:0/611049157 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4035070 con 0x7fafb8102260 2024-08-18T22:06:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.673+0000 7fafbeac6640 1 -- 172.21.15.123:0/611049157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb81a4c00 con 0x7fafb8102260 2024-08-18T22:06:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.674+0000 7fafbeac6640 1 -- 172.21.15.123:0/611049157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb8103000 con 0x7fafb8102260 2024-08-18T22:06:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.675+0000 7fafb5ffb640 1 -- 172.21.15.123:0/611049157 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fafa4042030 con 0x7fafb8102260 2024-08-18T22:06:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.676+0000 7fafb5ffb640 1 --2- 172.21.15.123:0/611049157 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fafa80a2c10 0x7fafa80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.676+0000 7fafbc862640 1 --2- 172.21.15.123:0/611049157 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fafa80a2c10 0x7fafa80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.676+0000 7fafb5ffb640 1 -- 172.21.15.123:0/611049157 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fafa40efff0 con 0x7fafb8102260 2024-08-18T22:06:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.677+0000 7fafbc862640 1 --2- 172.21.15.123:0/611049157 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fafa80a2c10 0x7fafa80a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fafac00baa0 tx=0x7fafac005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.680+0000 7fafb5ffb640 1 -- 172.21.15.123:0/611049157 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fafa40bca70 con 0x7fafb8102260 2024-08-18T22:06:31.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.848+0000 7fafbeac6640 1 -- 172.21.15.123:0/611049157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fafb81a4e00 con 0x7fafb8102260 2024-08-18T22:06:31.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.849+0000 7fafb5ffb640 1 -- 172.21.15.123:0/611049157 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24715 (secure 0 0 0) 0x7fafa40bc370 con 0x7fafb8102260 2024-08-18T22:06:31.850 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:06:31.851 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":90,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:06:10.502014+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:05:18.077632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:05:20.808463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:05:27.136662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:06:31.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.851+0000 7fafbeac6640 1 -- 172.21.15.123:0/611049157 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fafa80a2c10 msgr2=0x7fafa80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:31.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.851+0000 7fafbeac6640 1 --2- 172.21.15.123:0/611049157 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fafa80a2c10 0x7fafa80a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fafac00baa0 tx=0x7fafac005d20 comp rx=0 tx=0).stop 2024-08-18T22:06:31.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.851+0000 7fafbeac6640 1 -- 172.21.15.123:0/611049157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb8102260 msgr2=0x7fafb81985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:31.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.851+0000 7fafbeac6640 1 --2- 172.21.15.123:0/611049157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb8102260 0x7fafb81985c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009a50 tx=0x7fafa4004270 comp rx=0 tx=0).stop 2024-08-18T22:06:31.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.852+0000 7fafbeac6640 1 -- 172.21.15.123:0/611049157 shutdown_connections 2024-08-18T22:06:31.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.852+0000 7fafbeac6640 1 --2- 172.21.15.123:0/611049157 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fafa80a2c10 0x7fafa80a50d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:31.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.852+0000 7fafbeac6640 1 --2- 172.21.15.123:0/611049157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafb81078c0 0x7fafb819c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:31.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.852+0000 7fafbeac6640 1 --2- 172.21.15.123:0/611049157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb8102260 0x7fafb81985c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:31.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.852+0000 7fafbeac6640 1 --2- 172.21.15.123:0/611049157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafb81018c0 0x7fafb8198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:31.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.852+0000 7fafbeac6640 1 -- 172.21.15.123:0/611049157 >> 172.21.15.123:0/611049157 conn(0x7fafb80fd5e0 msgr2=0x7fafb80fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:31.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.852+0000 7fafbeac6640 1 -- 172.21.15.123:0/611049157 shutdown_connections 2024-08-18T22:06:31.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:31.852+0000 7fafbeac6640 1 -- 172.21.15.123:0/611049157 wait complete. 2024-08-18T22:06:32.543 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-18T22:06:32.544 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:06:32.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:32 smithi123 ceph-mon[18462]: pgmap v301: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:06:32.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:32 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/611049157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:06:32.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:32 smithi130 ceph-mon[21698]: pgmap v301: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:06:32.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:32 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/611049157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:06:32.794 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:32.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:32 smithi183 ceph-mon[22097]: pgmap v301: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:06:32.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:32 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/611049157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:06:33.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 -- 172.21.15.123:0/2412141393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19ac1022a0 msgr2=0x7f19ac1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:33.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 --2- 172.21.15.123:0/2412141393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19ac1022a0 0x7f19ac1026e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f199c009900 tx=0x7f199c02a480 comp rx=0 tx=0).stop 2024-08-18T22:06:33.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 -- 172.21.15.123:0/2412141393 shutdown_connections 2024-08-18T22:06:33.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 --2- 172.21.15.123:0/2412141393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19ac102c20 0x7f19ac10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:33.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 --2- 172.21.15.123:0/2412141393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19ac1022a0 0x7f19ac1026e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:33.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 --2- 172.21.15.123:0/2412141393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19ac100b50 0x7f19ac100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:33.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 -- 172.21.15.123:0/2412141393 >> 172.21.15.123:0/2412141393 conn(0x7f19ac0fc500 msgr2=0x7f19ac0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:33.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 -- 172.21.15.123:0/2412141393 shutdown_connections 2024-08-18T22:06:33.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 -- 172.21.15.123:0/2412141393 wait complete. 2024-08-18T22:06:33.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 Processor -- start 2024-08-18T22:06:33.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 -- start start 2024-08-18T22:06:33.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19ac100b50 0x7f19ac199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:33.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19ac1022a0 0x7f19ac199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:33.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19ac102c20 0x7f19ac1a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac110cb0 con 0x7f19ac100b50 2024-08-18T22:06:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac110b30 con 0x7f19ac1022a0 2024-08-18T22:06:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.274+0000 7f19b43c2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac110e30 con 0x7f19ac102c20 2024-08-18T22:06:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19b215e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19ac100b50 0x7f19ac199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19b215e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19ac100b50 0x7f19ac199020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50506/0 (socket says 172.21.15.123:50506) 2024-08-18T22:06:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19b215e640 1 -- 172.21.15.123:0/2035013720 learned_addr learned my addr 172.21.15.123:0/2035013720 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19b195d640 1 --2- 172.21.15.123:0/2035013720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19ac1022a0 0x7f19ac199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19b295f640 1 --2- 172.21.15.123:0/2035013720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19ac102c20 0x7f19ac1a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19b215e640 1 -- 172.21.15.123:0/2035013720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19ac102c20 msgr2=0x7f19ac1a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19b215e640 1 --2- 172.21.15.123:0/2035013720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19ac102c20 0x7f19ac1a40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19b215e640 1 -- 172.21.15.123:0/2035013720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19ac1022a0 msgr2=0x7f19ac199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19b215e640 1 --2- 172.21.15.123:0/2035013720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19ac1022a0 0x7f19ac199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19b215e640 1 -- 172.21.15.123:0/2035013720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ac1a45e0 con 0x7f19ac100b50 2024-08-18T22:06:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19b215e640 1 --2- 172.21.15.123:0/2035013720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19ac100b50 0x7f19ac199020 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f19a800d950 tx=0x7f19a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19a37fe640 1 -- 172.21.15.123:0/2035013720 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a8017070 con 0x7f19ac100b50 2024-08-18T22:06:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19b43c2640 1 -- 172.21.15.123:0/2035013720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ac1a47b0 con 0x7f19ac100b50 2024-08-18T22:06:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19a37fe640 1 -- 172.21.15.123:0/2035013720 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19a8009c30 con 0x7f19ac100b50 2024-08-18T22:06:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19a37fe640 1 -- 172.21.15.123:0/2035013720 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a800f6b0 con 0x7f19ac100b50 2024-08-18T22:06:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.275+0000 7f19b43c2640 1 -- 172.21.15.123:0/2035013720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ac1a4c70 con 0x7f19ac100b50 2024-08-18T22:06:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.276+0000 7f19b43c2640 1 -- 172.21.15.123:0/2035013720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ac100f30 con 0x7f19ac100b50 2024-08-18T22:06:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.277+0000 7f19a37fe640 1 -- 172.21.15.123:0/2035013720 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f19a80109d0 con 0x7f19ac100b50 2024-08-18T22:06:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.278+0000 7f19a37fe640 1 --2- 172.21.15.123:0/2035013720 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f19980a2c10 0x7f19980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.278+0000 7f19b195d640 1 --2- 172.21.15.123:0/2035013720 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f19980a2c10 0x7f19980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.278+0000 7f19a37fe640 1 -- 172.21.15.123:0/2035013720 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f19a80cf0c0 con 0x7f19ac100b50 2024-08-18T22:06:33.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.279+0000 7f19b195d640 1 --2- 172.21.15.123:0/2035013720 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f19980a2c10 0x7f19980a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f199c009230 tx=0x7f199c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:33.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.281+0000 7f19a37fe640 1 -- 172.21.15.123:0/2035013720 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f19a8009de0 con 0x7f19ac100b50 2024-08-18T22:06:33.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.451+0000 7f19b43c2640 1 -- 172.21.15.123:0/2035013720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19ac1a4ed0 con 0x7f19ac100b50 2024-08-18T22:06:33.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.452+0000 7f19a37fe640 1 -- 172.21.15.123:0/2035013720 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24715 (secure 0 0 0) 0x7f19a809b510 con 0x7f19ac100b50 2024-08-18T22:06:33.454 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:06:33.455 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":90,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:06:10.502014+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:05:18.077632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:05:20.808463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:05:27.136662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:06:33.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.455+0000 7f19b43c2640 1 -- 172.21.15.123:0/2035013720 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f19980a2c10 msgr2=0x7f19980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:33.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.455+0000 7f19b43c2640 1 --2- 172.21.15.123:0/2035013720 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f19980a2c10 0x7f19980a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f199c009230 tx=0x7f199c0058d0 comp rx=0 tx=0).stop 2024-08-18T22:06:33.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.455+0000 7f19b43c2640 1 -- 172.21.15.123:0/2035013720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19ac100b50 msgr2=0x7f19ac199020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:33.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.455+0000 7f19b43c2640 1 --2- 172.21.15.123:0/2035013720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19ac100b50 0x7f19ac199020 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f19a800d950 tx=0x7f19a800de10 comp rx=0 tx=0).stop 2024-08-18T22:06:33.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.455+0000 7f19b43c2640 1 -- 172.21.15.123:0/2035013720 shutdown_connections 2024-08-18T22:06:33.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.455+0000 7f19b43c2640 1 --2- 172.21.15.123:0/2035013720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19ac102c20 0x7f19ac1a40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:33.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.455+0000 7f19b43c2640 1 --2- 172.21.15.123:0/2035013720 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f19980a2c10 0x7f19980a50d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:33.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.455+0000 7f19b43c2640 1 --2- 172.21.15.123:0/2035013720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19ac1022a0 0x7f19ac199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:33.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.455+0000 7f19b43c2640 1 --2- 172.21.15.123:0/2035013720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19ac100b50 0x7f19ac199020 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:33.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.455+0000 7f19b43c2640 1 -- 172.21.15.123:0/2035013720 >> 172.21.15.123:0/2035013720 conn(0x7f19ac0fc500 msgr2=0x7f19ac0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:33.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.455+0000 7f19b43c2640 1 -- 172.21.15.123:0/2035013720 shutdown_connections 2024-08-18T22:06:33.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:33.455+0000 7f19b43c2640 1 -- 172.21.15.123:0/2035013720 wait complete. 2024-08-18T22:06:34.118 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-18T22:06:34.119 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-18T22:06:34.120 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-18T22:06:34.120 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-18T22:06:34.120 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-18T22:06:34.121 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-18T22:06:34.121 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-08-18T22:06:34.121 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-08-18T22:06:34.122 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-08-18T22:06:34.122 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-08-18T22:06:34.123 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-08-18T22:06:34.123 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-08-18T22:06:34.427 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:34 smithi123 ceph-mon[18462]: pgmap v302: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:06:34.427 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:34 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2035013720' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:06:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:34 smithi130 ceph-mon[21698]: pgmap v302: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:06:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:34 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2035013720' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:06:34.781 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:34.783 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:34.785 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:34.786 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:34.786 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:34.830 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:34.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:34 smithi183 ceph-mon[22097]: pgmap v302: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:06:34.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:34 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2035013720' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:06:35.104 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:35.105 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:35.109 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:35.110 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:36.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.217+0000 7fac0c834640 1 -- 172.21.15.123:0/1988178104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac081078b0 msgr2=0x7fac08107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:36.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.217+0000 7fac0c834640 1 --2- 172.21.15.123:0/1988178104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac081078b0 0x7fac08107c90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009930 tx=0x7fabf802a420 comp rx=0 tx=0).stop 2024-08-18T22:06:36.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.217+0000 7fac0c834640 1 -- 172.21.15.123:0/1988178104 shutdown_connections 2024-08-18T22:06:36.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.217+0000 7fac0c834640 1 --2- 172.21.15.123:0/1988178104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac08102250 0x7fac0810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:36.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.217+0000 7fac0c834640 1 --2- 172.21.15.123:0/1988178104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac081018b0 0x7fac08101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:36.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.217+0000 7fac0c834640 1 --2- 172.21.15.123:0/1988178104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac081078b0 0x7fac08107c90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:36.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.217+0000 7fac0c834640 1 -- 172.21.15.123:0/1988178104 >> 172.21.15.123:0/1988178104 conn(0x7fac080fd5f0 msgr2=0x7fac080ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:36.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.217+0000 7fac0c834640 1 -- 172.21.15.123:0/1988178104 shutdown_connections 2024-08-18T22:06:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.217+0000 7fac0c834640 1 -- 172.21.15.123:0/1988178104 wait complete. 2024-08-18T22:06:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac0c834640 1 Processor -- start 2024-08-18T22:06:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac0c834640 1 -- start start 2024-08-18T22:06:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac0c834640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac081018b0 0x7fac08198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac0c834640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac08102250 0x7fac081986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac0c834640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac081078b0 0x7fac0819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac0c834640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fac08111c70 con 0x7fac08102250 2024-08-18T22:06:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac0c834640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac08111af0 con 0x7fac081078b0 2024-08-18T22:06:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac0c834640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fac08111df0 con 0x7fac081018b0 2024-08-18T22:06:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac05d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac08102250 0x7fac081986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac05d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac08102250 0x7fac081986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50514/0 (socket says 172.21.15.123:50514) 2024-08-18T22:06:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac05d9b640 1 -- 172.21.15.123:0/1621008810 learned_addr learned my addr 172.21.15.123:0/1621008810 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac06d9d640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac081078b0 0x7fac0819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac0659c640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac081018b0 0x7fac08198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac05d9b640 1 -- 172.21.15.123:0/1621008810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac081018b0 msgr2=0x7fac08198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac05d9b640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac081018b0 0x7fac08198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac05d9b640 1 -- 172.21.15.123:0/1621008810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac081078b0 msgr2=0x7fac0819ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac05d9b640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac081078b0 0x7fac0819ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac05d9b640 1 -- 172.21.15.123:0/1621008810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0819d120 con 0x7fac08102250 2024-08-18T22:06:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac06d9d640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac081078b0 0x7fac0819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.218+0000 7fac0659c640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac081018b0 0x7fac08198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:06:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.219+0000 7fac05d9b640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac08102250 0x7fac081986b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fabf000c920 tx=0x7fabf000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.219+0000 7fabff7fe640 1 -- 172.21.15.123:0/1621008810 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf0007c70 con 0x7fac08102250 2024-08-18T22:06:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.219+0000 7fabff7fe640 1 -- 172.21.15.123:0/1621008810 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabf0007e10 con 0x7fac08102250 2024-08-18T22:06:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.219+0000 7fac0c834640 1 -- 172.21.15.123:0/1621008810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0819d410 con 0x7fac08102250 2024-08-18T22:06:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.219+0000 7fabff7fe640 1 -- 172.21.15.123:0/1621008810 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf0018890 con 0x7fac08102250 2024-08-18T22:06:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.219+0000 7fac0c834640 1 -- 172.21.15.123:0/1621008810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac081a4cf0 con 0x7fac08102250 2024-08-18T22:06:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.220+0000 7fac0c834640 1 -- 172.21.15.123:0/1621008810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac080626b0 con 0x7fac08102250 2024-08-18T22:06:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.221+0000 7fabff7fe640 1 -- 172.21.15.123:0/1621008810 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fabf0018a30 con 0x7fac08102250 2024-08-18T22:06:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.221+0000 7fabff7fe640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fabf40a2c10 0x7fabf40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.222+0000 7fac0659c640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fabf40a2c10 0x7fabf40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.222+0000 7fabff7fe640 1 -- 172.21.15.123:0/1621008810 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fabf00cfb70 con 0x7fac08102250 2024-08-18T22:06:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.222+0000 7fabff7fe640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015] conn(0x7fabf40adde0 0x7fabf40b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.222+0000 7fabff7fe640 1 -- 172.21.15.123:0/1621008810 --> [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fabf40b0950 con 0x7fabf40adde0 2024-08-18T22:06:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.222+0000 7fabff7fe640 1 -- 172.21.15.123:0/1621008810 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fabf00cffc0 con 0x7fac08102250 2024-08-18T22:06:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.222+0000 7fac0659c640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fabf40a2c10 0x7fabf40a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fabf8000c00 tx=0x7fabf8032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.222+0000 7fac06d9d640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015] conn(0x7fabf40adde0 0x7fabf40b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.223+0000 7fac06d9d640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015] conn(0x7fabf40adde0 0x7fabf40b0280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.223+0000 7fabff7fe640 1 -- 172.21.15.123:0/1621008810 <== osd.5 v2:172.21.15.183:6808/2372027015 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fabf40b0950 con 0x7fabf40adde0 2024-08-18T22:06:36.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.237+0000 7fac0c834640 1 -- 172.21.15.123:0/1621008810 --> [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fac08062b30 con 0x7fabf40adde0 2024-08-18T22:06:36.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.237+0000 7fabff7fe640 1 -- 172.21.15.123:0/1621008810 <== osd.5 v2:172.21.15.183:6808/2372027015 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fac08062b30 con 0x7fabf40adde0 2024-08-18T22:06:36.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.238+0000 7fac0c834640 1 -- 172.21.15.123:0/1621008810 >> [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015] conn(0x7fabf40adde0 msgr2=0x7fabf40b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:36.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.238+0000 7fac0c834640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015] conn(0x7fabf40adde0 0x7fabf40b0280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:36.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.238+0000 7fac0c834640 1 -- 172.21.15.123:0/1621008810 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fabf40a2c10 msgr2=0x7fabf40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:36.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.238+0000 7fac0c834640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fabf40a2c10 0x7fabf40a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fabf8000c00 tx=0x7fabf8032c70 comp rx=0 tx=0).stop 2024-08-18T22:06:36.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.238+0000 7fac0c834640 1 -- 172.21.15.123:0/1621008810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac08102250 msgr2=0x7fac081986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:36.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.238+0000 7fac0c834640 1 --2- 172.21.15.123:0/1621008810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac08102250 0x7fac081986b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fabf000c920 tx=0x7fabf000cde0 comp rx=0 tx=0).stop 2024-08-18T22:06:36.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.238+0000 7fac06d9d640 1 -- 172.21.15.123:0/1621008810 reap_dead start 2024-08-18T22:06:36.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.238+0000 7fac0c834640 1 -- 172.21.15.123:0/1621008810 shutdown_connections 2024-08-18T22:06:36.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.238+0000 7fac0c834640 1 -- 172.21.15.123:0/1621008810 >> 172.21.15.123:0/1621008810 conn(0x7fac080fd5f0 msgr2=0x7fac080fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:36.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.238+0000 7fac0c834640 1 -- 172.21.15.123:0/1621008810 shutdown_connections 2024-08-18T22:06:36.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.238+0000 7fac0c834640 1 -- 172.21.15.123:0/1621008810 wait complete. 2024-08-18T22:06:36.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.426+0000 7ff9d6da2640 1 -- 172.21.15.123:0/303547174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9d01020a0 msgr2=0x7ff9d010e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:36.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.426+0000 7ff9d6da2640 1 --2- 172.21.15.123:0/303547174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9d01020a0 0x7ff9d010e5d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009cd0 tx=0x7ff9c802a8e0 comp rx=0 tx=0).stop 2024-08-18T22:06:36.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.426+0000 7ff9d6da2640 1 -- 172.21.15.123:0/303547174 shutdown_connections 2024-08-18T22:06:36.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.426+0000 7ff9d6da2640 1 --2- 172.21.15.123:0/303547174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9d01020a0 0x7ff9d010e5d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:36.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.426+0000 7ff9d6da2640 1 --2- 172.21.15.123:0/303547174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9d0101700 0x7ff9d0101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:36.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.426+0000 7ff9d6da2640 1 --2- 172.21.15.123:0/303547174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9d0107700 0x7ff9d0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:36.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.426+0000 7ff9d6da2640 1 -- 172.21.15.123:0/303547174 >> 172.21.15.123:0/303547174 conn(0x7ff9d00fd440 msgr2=0x7ff9d00ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:36.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.426+0000 7ff9d6da2640 1 -- 172.21.15.123:0/303547174 shutdown_connections 2024-08-18T22:06:36.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.426+0000 7ff9d6da2640 1 -- 172.21.15.123:0/303547174 wait complete. 2024-08-18T22:06:36.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.426+0000 7ff9d6da2640 1 Processor -- start 2024-08-18T22:06:36.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.426+0000 7ff9d6da2640 1 -- start start 2024-08-18T22:06:36.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d6da2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9d0101700 0x7ff9d0198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:36.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d6da2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9d01020a0 0x7ff9d0198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:36.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d6da2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9d0107700 0x7ff9d019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:36.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d6da2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d0111bf0 con 0x7ff9d01020a0 2024-08-18T22:06:36.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d6da2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d0111a70 con 0x7ff9d0107700 2024-08-18T22:06:36.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d6da2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d0111d70 con 0x7ff9d0101700 2024-08-18T22:06:36.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d559f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9d01020a0 0x7ff9d0198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:36.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d559f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9d01020a0 0x7ff9d0198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50526/0 (socket says 172.21.15.123:50526) 2024-08-18T22:06:36.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d559f640 1 -- 172.21.15.123:0/834925804 learned_addr learned my addr 172.21.15.123:0/834925804 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:36.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d5da0640 1 --2- 172.21.15.123:0/834925804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9d0101700 0x7ff9d0198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:36.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d65a1640 1 --2- 172.21.15.123:0/834925804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9d0107700 0x7ff9d019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:36.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d559f640 1 -- 172.21.15.123:0/834925804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9d0101700 msgr2=0x7ff9d0198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:36.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d559f640 1 --2- 172.21.15.123:0/834925804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9d0101700 0x7ff9d0198110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:36.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d559f640 1 -- 172.21.15.123:0/834925804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9d0107700 msgr2=0x7ff9d019c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:36.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d559f640 1 --2- 172.21.15.123:0/834925804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9d0107700 0x7ff9d019c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:36.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d559f640 1 -- 172.21.15.123:0/834925804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d019d0c0 con 0x7ff9d01020a0 2024-08-18T22:06:36.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.427+0000 7ff9d559f640 1 --2- 172.21.15.123:0/834925804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9d01020a0 0x7ff9d0198650 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000b4a0 tx=0x7ff9c000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:36.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.428+0000 7ff9c6ffd640 1 -- 172.21.15.123:0/834925804 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0015020 con 0x7ff9d01020a0 2024-08-18T22:06:36.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.429+0000 7ff9c6ffd640 1 -- 172.21.15.123:0/834925804 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9c0011d10 con 0x7ff9d01020a0 2024-08-18T22:06:36.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.429+0000 7ff9d6da2640 1 -- 172.21.15.123:0/834925804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d019d3b0 con 0x7ff9d01020a0 2024-08-18T22:06:36.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.429+0000 7ff9c6ffd640 1 -- 172.21.15.123:0/834925804 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c000f2e0 con 0x7ff9d01020a0 2024-08-18T22:06:36.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.429+0000 7ff9d6da2640 1 -- 172.21.15.123:0/834925804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d01a4c90 con 0x7ff9d01020a0 2024-08-18T22:06:36.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.429+0000 7ff9d6da2640 1 -- 172.21.15.123:0/834925804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9d00626b0 con 0x7ff9d01020a0 2024-08-18T22:06:36.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.431+0000 7ff9c6ffd640 1 -- 172.21.15.123:0/834925804 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff9c0018020 con 0x7ff9d01020a0 2024-08-18T22:06:36.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.431+0000 7ff9c6ffd640 1 --2- 172.21.15.123:0/834925804 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9bc0a2c90 0x7ff9bc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:36.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.431+0000 7ff9d5da0640 1 --2- 172.21.15.123:0/834925804 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9bc0a2c90 0x7ff9bc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:36.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.431+0000 7ff9c6ffd640 1 -- 172.21.15.123:0/834925804 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7ff9c00cf1c0 con 0x7ff9d01020a0 2024-08-18T22:06:36.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.431+0000 7ff9c6ffd640 1 --2- 172.21.15.123:0/834925804 >> [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973] conn(0x7ff9bc0ade60 0x7ff9bc0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:36.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.432+0000 7ff9c6ffd640 1 -- 172.21.15.123:0/834925804 --> [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9c0004450 con 0x7ff9bc0ade60 2024-08-18T22:06:36.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.432+0000 7ff9c6ffd640 1 -- 172.21.15.123:0/834925804 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7ff9c00cf610 con 0x7ff9d01020a0 2024-08-18T22:06:36.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.432+0000 7ff9d65a1640 1 --2- 172.21.15.123:0/834925804 >> [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973] conn(0x7ff9bc0ade60 0x7ff9bc0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:36.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.432+0000 7ff9d5da0640 1 --2- 172.21.15.123:0/834925804 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9bc0a2c90 0x7ff9bc0a5150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009990 tx=0x7ff9cc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:36.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.432+0000 7ff9d65a1640 1 --2- 172.21.15.123:0/834925804 >> [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973] conn(0x7ff9bc0ade60 0x7ff9bc0b0300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:36.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.433+0000 7ff9c6ffd640 1 -- 172.21.15.123:0/834925804 <== osd.6 v2:172.21.15.123:6818/1703847973 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9c0004450 con 0x7ff9bc0ade60 2024-08-18T22:06:36.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.446+0000 7ff9d6da2640 1 -- 172.21.15.123:0/834925804 --> [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff9d0062ab0 con 0x7ff9bc0ade60 2024-08-18T22:06:36.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.446+0000 7ff9c6ffd640 1 -- 172.21.15.123:0/834925804 <== osd.6 v2:172.21.15.123:6818/1703847973 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff9d0062ab0 con 0x7ff9bc0ade60 2024-08-18T22:06:36.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.447+0000 7ff9d6da2640 1 -- 172.21.15.123:0/834925804 >> [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973] conn(0x7ff9bc0ade60 msgr2=0x7ff9bc0b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:36.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.447+0000 7ff9d6da2640 1 --2- 172.21.15.123:0/834925804 >> [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973] conn(0x7ff9bc0ade60 0x7ff9bc0b0300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:36.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.447+0000 7ff9d6da2640 1 -- 172.21.15.123:0/834925804 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9bc0a2c90 msgr2=0x7ff9bc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:36.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.447+0000 7ff9d6da2640 1 --2- 172.21.15.123:0/834925804 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9bc0a2c90 0x7ff9bc0a5150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009990 tx=0x7ff9cc009110 comp rx=0 tx=0).stop 2024-08-18T22:06:36.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.447+0000 7ff9d6da2640 1 -- 172.21.15.123:0/834925804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9d01020a0 msgr2=0x7ff9d0198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:36.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.447+0000 7ff9d6da2640 1 --2- 172.21.15.123:0/834925804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9d01020a0 0x7ff9d0198650 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000b4a0 tx=0x7ff9c000b8a0 comp rx=0 tx=0).stop 2024-08-18T22:06:36.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.447+0000 7ff9d65a1640 1 -- 172.21.15.123:0/834925804 reap_dead start 2024-08-18T22:06:36.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.447+0000 7ff9d6da2640 1 -- 172.21.15.123:0/834925804 shutdown_connections 2024-08-18T22:06:36.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.447+0000 7ff9d6da2640 1 -- 172.21.15.123:0/834925804 >> 172.21.15.123:0/834925804 conn(0x7ff9d00fd440 msgr2=0x7ff9d00fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:36.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.447+0000 7ff9d6da2640 1 -- 172.21.15.123:0/834925804 shutdown_connections 2024-08-18T22:06:36.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:36.447+0000 7ff9d6da2640 1 -- 172.21.15.123:0/834925804 wait complete. 2024-08-18T22:06:36.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:36 smithi123 ceph-mon[18462]: pgmap v303: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:06:36.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:36 smithi130 ceph-mon[21698]: pgmap v303: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:06:36.912 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:36 smithi183 ceph-mon[22097]: pgmap v303: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:06:37.293 INFO:teuthology.orchestra.run.smithi123.stdout:158913790007 2024-08-18T22:06:37.294 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-18T22:06:37.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.502+0000 7f549d20a640 1 -- 172.21.15.123:0/1541304026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5498103410 msgr2=0x7f54981078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:37.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.502+0000 7f549d20a640 1 --2- 172.21.15.123:0/1541304026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5498103410 0x7f54981078c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f548c009930 tx=0x7f548c02a420 comp rx=0 tx=0).stop 2024-08-18T22:06:37.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.502+0000 7f549d20a640 1 -- 172.21.15.123:0/1541304026 shutdown_connections 2024-08-18T22:06:37.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.502+0000 7f549d20a640 1 --2- 172.21.15.123:0/1541304026 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5498107fd0 0x7f549810e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:37.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.502+0000 7f549d20a640 1 --2- 172.21.15.123:0/1541304026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5498103410 0x7f54981078c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:37.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.503+0000 7f549d20a640 1 --2- 172.21.15.123:0/1541304026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5498102a60 0x7f5498102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:37.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.503+0000 7f549d20a640 1 -- 172.21.15.123:0/1541304026 >> 172.21.15.123:0/1541304026 conn(0x7f54980fc500 msgr2=0x7f54980fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:37.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.503+0000 7f549d20a640 1 -- 172.21.15.123:0/1541304026 shutdown_connections 2024-08-18T22:06:37.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.503+0000 7f549d20a640 1 -- 172.21.15.123:0/1541304026 wait complete. 2024-08-18T22:06:37.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.503+0000 7f549d20a640 1 Processor -- start 2024-08-18T22:06:37.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.503+0000 7f549d20a640 1 -- start start 2024-08-18T22:06:37.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549d20a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5498102a60 0x7f54981983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549d20a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5498103410 0x7f54981988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549d20a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5498107fd0 0x7f549819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549d20a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5498111df0 con 0x7f5498107fd0 2024-08-18T22:06:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549d20a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5498111c70 con 0x7f5498102a60 2024-08-18T22:06:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549d20a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5498111f70 con 0x7f5498103410 2024-08-18T22:06:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5498107fd0 0x7f549819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5498107fd0 0x7f549819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50554/0 (socket says 172.21.15.123:50554) 2024-08-18T22:06:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549759e640 1 -- 172.21.15.123:0/3457832319 learned_addr learned my addr 172.21.15.123:0/3457832319 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f5496d9d640 1 --2- 172.21.15.123:0/3457832319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5498102a60 0x7f54981983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549659c640 1 --2- 172.21.15.123:0/3457832319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5498103410 0x7f54981988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549759e640 1 -- 172.21.15.123:0/3457832319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5498103410 msgr2=0x7f54981988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549759e640 1 --2- 172.21.15.123:0/3457832319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5498103410 0x7f54981988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:37.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549759e640 1 -- 172.21.15.123:0/3457832319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5498102a60 msgr2=0x7f54981983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:37.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549759e640 1 --2- 172.21.15.123:0/3457832319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5498102a60 0x7f54981983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:37.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549759e640 1 -- 172.21.15.123:0/3457832319 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549819d360 con 0x7f5498107fd0 2024-08-18T22:06:37.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f5496d9d640 1 --2- 172.21.15.123:0/3457832319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5498102a60 0x7f54981983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:06:37.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.504+0000 7f549759e640 1 --2- 172.21.15.123:0/3457832319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5498107fd0 0x7f549819cc80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f549000cad0 tx=0x7f549000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:37.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.505+0000 7f547ffff640 1 -- 172.21.15.123:0/3457832319 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549000ad60 con 0x7f5498107fd0 2024-08-18T22:06:37.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.505+0000 7f549d20a640 1 -- 172.21.15.123:0/3457832319 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f549819d650 con 0x7f5498107fd0 2024-08-18T22:06:37.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.505+0000 7f547ffff640 1 -- 172.21.15.123:0/3457832319 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5490005020 con 0x7f5498107fd0 2024-08-18T22:06:37.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.505+0000 7f547ffff640 1 -- 172.21.15.123:0/3457832319 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549000f6b0 con 0x7f5498107fd0 2024-08-18T22:06:37.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.505+0000 7f549d20a640 1 -- 172.21.15.123:0/3457832319 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54981a4f30 con 0x7f5498107fd0 2024-08-18T22:06:37.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.505+0000 7f549d20a640 1 -- 172.21.15.123:0/3457832319 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54980626b0 con 0x7f5498107fd0 2024-08-18T22:06:37.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.507+0000 7f547ffff640 1 -- 172.21.15.123:0/3457832319 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5490005560 con 0x7f5498107fd0 2024-08-18T22:06:37.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.507+0000 7f547ffff640 1 --2- 172.21.15.123:0/3457832319 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54800a2c10 0x7f54800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:37.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.507+0000 7f5496d9d640 1 --2- 172.21.15.123:0/3457832319 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54800a2c10 0x7f54800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:37.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.508+0000 7f547ffff640 1 -- 172.21.15.123:0/3457832319 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f54900cf950 con 0x7f5498107fd0 2024-08-18T22:06:37.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.508+0000 7f547ffff640 1 --2- 172.21.15.123:0/3457832319 >> [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577] conn(0x7f54800adde0 0x7f54800b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:37.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.508+0000 7f547ffff640 1 -- 172.21.15.123:0/3457832319 --> [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f549001fe70 con 0x7f54800adde0 2024-08-18T22:06:37.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.508+0000 7f547ffff640 1 -- 172.21.15.123:0/3457832319 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f54900cfda0 con 0x7f5498107fd0 2024-08-18T22:06:37.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.508+0000 7f549659c640 1 --2- 172.21.15.123:0/3457832319 >> [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577] conn(0x7f54800adde0 0x7f54800b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:37.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.508+0000 7f5496d9d640 1 --2- 172.21.15.123:0/3457832319 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54800a2c10 0x7f54800a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5488009d60 tx=0x7f5488009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:37.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.508+0000 7f549659c640 1 --2- 172.21.15.123:0/3457832319 >> [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577] conn(0x7f54800adde0 0x7f54800b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:37.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.509+0000 7f547ffff640 1 -- 172.21.15.123:0/3457832319 <== osd.3 v2:172.21.15.123:6810/969520577 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f549001fe70 con 0x7f54800adde0 2024-08-18T22:06:37.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.523+0000 7f549d20a640 1 -- 172.21.15.123:0/3457832319 --> [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5498062b30 con 0x7f54800adde0 2024-08-18T22:06:37.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.524+0000 7f547ffff640 1 -- 172.21.15.123:0/3457832319 <== osd.3 v2:172.21.15.123:6810/969520577 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5498062b30 con 0x7f54800adde0 2024-08-18T22:06:37.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.524+0000 7f549d20a640 1 -- 172.21.15.123:0/3457832319 >> [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577] conn(0x7f54800adde0 msgr2=0x7f54800b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:37.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.524+0000 7f549d20a640 1 --2- 172.21.15.123:0/3457832319 >> [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577] conn(0x7f54800adde0 0x7f54800b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:37.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.524+0000 7f549d20a640 1 -- 172.21.15.123:0/3457832319 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54800a2c10 msgr2=0x7f54800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:37.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.524+0000 7f549d20a640 1 --2- 172.21.15.123:0/3457832319 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54800a2c10 0x7f54800a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5488009d60 tx=0x7f5488009110 comp rx=0 tx=0).stop 2024-08-18T22:06:37.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.524+0000 7f549d20a640 1 -- 172.21.15.123:0/3457832319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5498107fd0 msgr2=0x7f549819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:37.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.524+0000 7f549d20a640 1 --2- 172.21.15.123:0/3457832319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5498107fd0 0x7f549819cc80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f549000cad0 tx=0x7f549000ced0 comp rx=0 tx=0).stop 2024-08-18T22:06:37.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.524+0000 7f549759e640 1 -- 172.21.15.123:0/3457832319 reap_dead start 2024-08-18T22:06:37.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.524+0000 7f549d20a640 1 -- 172.21.15.123:0/3457832319 shutdown_connections 2024-08-18T22:06:37.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.524+0000 7f549d20a640 1 -- 172.21.15.123:0/3457832319 >> 172.21.15.123:0/3457832319 conn(0x7f54980fc500 msgr2=0x7f5498105b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:37.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.524+0000 7f549d20a640 1 -- 172.21.15.123:0/3457832319 shutdown_connections 2024-08-18T22:06:37.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:37.525+0000 7f549d20a640 1 -- 172.21.15.123:0/3457832319 wait complete. 2024-08-18T22:06:38.449 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:38 smithi123 ceph-mon[18462]: pgmap v304: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-18T22:06:38.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.527+0000 7fe1f5558640 1 -- 172.21.15.123:0/1350001785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f0102c20 msgr2=0x7fe1f010d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:38.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.527+0000 7fe1f5558640 1 --2- 172.21.15.123:0/1350001785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f0102c20 0x7fe1f010d770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009900 tx=0x7fe1e802a480 comp rx=0 tx=0).stop 2024-08-18T22:06:38.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.527+0000 7fe1f5558640 1 -- 172.21.15.123:0/1350001785 shutdown_connections 2024-08-18T22:06:38.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.527+0000 7fe1f5558640 1 --2- 172.21.15.123:0/1350001785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f0102c20 0x7fe1f010d770 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:38.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.527+0000 7fe1f5558640 1 --2- 172.21.15.123:0/1350001785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1f01022a0 0x7fe1f01026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:38.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.527+0000 7fe1f5558640 1 --2- 172.21.15.123:0/1350001785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1f0100b50 0x7fe1f0100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:38.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.527+0000 7fe1f5558640 1 -- 172.21.15.123:0/1350001785 >> 172.21.15.123:0/1350001785 conn(0x7fe1f00fc500 msgr2=0x7fe1f00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:38.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.527+0000 7fe1f5558640 1 -- 172.21.15.123:0/1350001785 shutdown_connections 2024-08-18T22:06:38.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.527+0000 7fe1f5558640 1 -- 172.21.15.123:0/1350001785 wait complete. 2024-08-18T22:06:38.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.528+0000 7fe1f5558640 1 Processor -- start 2024-08-18T22:06:38.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.528+0000 7fe1f5558640 1 -- start start 2024-08-18T22:06:38.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.528+0000 7fe1f5558640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1f0100b50 0x7fe1f0197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:38.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.528+0000 7fe1f5558640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1f01022a0 0x7fe1f01975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:38.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.528+0000 7fe1f5558640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f0102c20 0x7fe1f019b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:38.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.528+0000 7fe1f5558640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f0110cd0 con 0x7fe1f0102c20 2024-08-18T22:06:38.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.528+0000 7fe1f5558640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f0110b50 con 0x7fe1f0100b50 2024-08-18T22:06:38.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.528+0000 7fe1f5558640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f0110e50 con 0x7fe1f01022a0 2024-08-18T22:06:38.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.528+0000 7fe1ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f0102c20 0x7fe1f019b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:38.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.528+0000 7fe1ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f0102c20 0x7fe1f019b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50568/0 (socket says 172.21.15.123:50568) 2024-08-18T22:06:38.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.529+0000 7fe1ef7fe640 1 -- 172.21.15.123:0/922468181 learned_addr learned my addr 172.21.15.123:0/922468181 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:38.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.529+0000 7fe1ee7fc640 1 --2- 172.21.15.123:0/922468181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1f01022a0 0x7fe1f01975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:38.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.529+0000 7fe1eeffd640 1 --2- 172.21.15.123:0/922468181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1f0100b50 0x7fe1f0197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:38.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.529+0000 7fe1ef7fe640 1 -- 172.21.15.123:0/922468181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1f01022a0 msgr2=0x7fe1f01975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:38.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.529+0000 7fe1ef7fe640 1 --2- 172.21.15.123:0/922468181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1f01022a0 0x7fe1f01975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:38.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.529+0000 7fe1ef7fe640 1 -- 172.21.15.123:0/922468181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1f0100b50 msgr2=0x7fe1f0197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:38.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.529+0000 7fe1ef7fe640 1 --2- 172.21.15.123:0/922468181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1f0100b50 0x7fe1f0197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:38.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.529+0000 7fe1ef7fe640 1 -- 172.21.15.123:0/922468181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f019c010 con 0x7fe1f0102c20 2024-08-18T22:06:38.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.529+0000 7fe1eeffd640 1 --2- 172.21.15.123:0/922468181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1f0100b50 0x7fe1f0197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:06:38.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.529+0000 7fe1ef7fe640 1 --2- 172.21.15.123:0/922468181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f0102c20 0x7fe1f019b930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8005ab0 tx=0x7fe1e8003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:38.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.529+0000 7fe1e7fff640 1 -- 172.21.15.123:0/922468181 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e803f070 con 0x7fe1f0102c20 2024-08-18T22:06:38.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.529+0000 7fe1e7fff640 1 -- 172.21.15.123:0/922468181 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1e8031e30 con 0x7fe1f0102c20 2024-08-18T22:06:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.529+0000 7fe1f5558640 1 -- 172.21.15.123:0/922468181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f019c2a0 con 0x7fe1f0102c20 2024-08-18T22:06:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.529+0000 7fe1e7fff640 1 -- 172.21.15.123:0/922468181 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8035030 con 0x7fe1f0102c20 2024-08-18T22:06:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.529+0000 7fe1f5558640 1 -- 172.21.15.123:0/922468181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f01a3be0 con 0x7fe1f0102c20 2024-08-18T22:06:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.530+0000 7fe1f5558640 1 -- 172.21.15.123:0/922468181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe1f0106f90 con 0x7fe1f0102c20 2024-08-18T22:06:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.531+0000 7fe1e7fff640 1 -- 172.21.15.123:0/922468181 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe1e8042070 con 0x7fe1f0102c20 2024-08-18T22:06:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.532+0000 7fe1e7fff640 1 --2- 172.21.15.123:0/922468181 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe1dc0a2c10 0x7fe1dc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.532+0000 7fe1eeffd640 1 --2- 172.21.15.123:0/922468181 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe1dc0a2c10 0x7fe1dc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.532+0000 7fe1e7fff640 1 -- 172.21.15.123:0/922468181 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fe1e80f05d0 con 0x7fe1f0102c20 2024-08-18T22:06:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.532+0000 7fe1e7fff640 1 --2- 172.21.15.123:0/922468181 >> [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663] conn(0x7fe1dc0adde0 0x7fe1dc0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.532+0000 7fe1e7fff640 1 -- 172.21.15.123:0/922468181 --> [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1e8038e90 con 0x7fe1dc0adde0 2024-08-18T22:06:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.532+0000 7fe1e7fff640 1 -- 172.21.15.123:0/922468181 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fe1e80f0a20 con 0x7fe1f0102c20 2024-08-18T22:06:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.532+0000 7fe1ee7fc640 1 --2- 172.21.15.123:0/922468181 >> [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663] conn(0x7fe1dc0adde0 0x7fe1dc0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.532+0000 7fe1eeffd640 1 --2- 172.21.15.123:0/922468181 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe1dc0a2c10 0x7fe1dc0a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0008e00 tx=0x7fe1e0008350 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:38.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.533+0000 7fe1ee7fc640 1 --2- 172.21.15.123:0/922468181 >> [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663] conn(0x7fe1dc0adde0 0x7fe1dc0b0280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:38.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.533+0000 7fe1e7fff640 1 -- 172.21.15.123:0/922468181 <== osd.9 v2:172.21.15.123:6826/2915312663 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe1e8038e90 con 0x7fe1dc0adde0 2024-08-18T22:06:38.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.546+0000 7fe1f5558640 1 -- 172.21.15.123:0/922468181 --> [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe1f0101ee0 con 0x7fe1dc0adde0 2024-08-18T22:06:38.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.547+0000 7fe1e7fff640 1 -- 172.21.15.123:0/922468181 <== osd.9 v2:172.21.15.123:6826/2915312663 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe1f0101ee0 con 0x7fe1dc0adde0 2024-08-18T22:06:38.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.547+0000 7fe1f5558640 1 -- 172.21.15.123:0/922468181 >> [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663] conn(0x7fe1dc0adde0 msgr2=0x7fe1dc0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:38.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.547+0000 7fe1f5558640 1 --2- 172.21.15.123:0/922468181 >> [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663] conn(0x7fe1dc0adde0 0x7fe1dc0b0280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:38.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.547+0000 7fe1f5558640 1 -- 172.21.15.123:0/922468181 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe1dc0a2c10 msgr2=0x7fe1dc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:38.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.547+0000 7fe1f5558640 1 --2- 172.21.15.123:0/922468181 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe1dc0a2c10 0x7fe1dc0a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0008e00 tx=0x7fe1e0008350 comp rx=0 tx=0).stop 2024-08-18T22:06:38.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.547+0000 7fe1f5558640 1 -- 172.21.15.123:0/922468181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f0102c20 msgr2=0x7fe1f019b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:38.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.547+0000 7fe1f5558640 1 --2- 172.21.15.123:0/922468181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f0102c20 0x7fe1f019b930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8005ab0 tx=0x7fe1e8003c30 comp rx=0 tx=0).stop 2024-08-18T22:06:38.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.547+0000 7fe1ef7fe640 1 -- 172.21.15.123:0/922468181 reap_dead start 2024-08-18T22:06:38.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.547+0000 7fe1f5558640 1 -- 172.21.15.123:0/922468181 shutdown_connections 2024-08-18T22:06:38.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.547+0000 7fe1f5558640 1 -- 172.21.15.123:0/922468181 >> 172.21.15.123:0/922468181 conn(0x7fe1f00fc500 msgr2=0x7fe1f0106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:38.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.547+0000 7fe1f5558640 1 -- 172.21.15.123:0/922468181 shutdown_connections 2024-08-18T22:06:38.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:38.547+0000 7fe1f5558640 1 -- 172.21.15.123:0/922468181 wait complete. 2024-08-18T22:06:38.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:38 smithi130 ceph-mon[21698]: pgmap v304: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-18T22:06:38.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:38 smithi183 ceph-mon[22097]: pgmap v304: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-18T22:06:39.394 INFO:teuthology.orchestra.run.smithi123.stdout:107374182464 2024-08-18T22:06:39.394 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-18T22:06:39.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.590+0000 7f036ff4d640 1 -- 172.21.15.123:0/2333681924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03681022a0 msgr2=0x7f03681026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:39.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.590+0000 7f036ff4d640 1 --2- 172.21.15.123:0/2333681924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03681022a0 0x7f03681026e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0358009900 tx=0x7f035802a480 comp rx=0 tx=0).stop 2024-08-18T22:06:39.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.590+0000 7f036ff4d640 1 -- 172.21.15.123:0/2333681924 shutdown_connections 2024-08-18T22:06:39.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.590+0000 7f036ff4d640 1 --2- 172.21.15.123:0/2333681924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0368102c20 0x7f036810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:39.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.590+0000 7f036ff4d640 1 --2- 172.21.15.123:0/2333681924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03681022a0 0x7f03681026e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:39.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.590+0000 7f036ff4d640 1 --2- 172.21.15.123:0/2333681924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0368100b50 0x7f0368100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:39.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.591+0000 7f036ff4d640 1 -- 172.21.15.123:0/2333681924 >> 172.21.15.123:0/2333681924 conn(0x7f03680fc500 msgr2=0x7f03680fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:39.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.591+0000 7f036ff4d640 1 -- 172.21.15.123:0/2333681924 shutdown_connections 2024-08-18T22:06:39.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.591+0000 7f036ff4d640 1 -- 172.21.15.123:0/2333681924 wait complete. 2024-08-18T22:06:39.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.591+0000 7f036ff4d640 1 Processor -- start 2024-08-18T22:06:39.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.591+0000 7f036ff4d640 1 -- start start 2024-08-18T22:06:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.591+0000 7f036ff4d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0368100b50 0x7f036810bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.591+0000 7f036ff4d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03681022a0 0x7f036810c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.591+0000 7f036ff4d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0368102c20 0x7f03681aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.591+0000 7f036ff4d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f036810f500 con 0x7f03681022a0 2024-08-18T22:06:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.591+0000 7f036ff4d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f036810f380 con 0x7f0368102c20 2024-08-18T22:06:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.591+0000 7f036ff4d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f036810f680 con 0x7f0368100b50 2024-08-18T22:06:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f036d4e8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03681022a0 0x7f036810c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f036d4e8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03681022a0 0x7f036810c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50592/0 (socket says 172.21.15.123:50592) 2024-08-18T22:06:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f036d4e8640 1 -- 172.21.15.123:0/3282840694 learned_addr learned my addr 172.21.15.123:0/3282840694 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f036dce9640 1 --2- 172.21.15.123:0/3282840694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0368100b50 0x7f036810bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f036e4ea640 1 --2- 172.21.15.123:0/3282840694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0368102c20 0x7f03681aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f036d4e8640 1 -- 172.21.15.123:0/3282840694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0368100b50 msgr2=0x7f036810bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f036d4e8640 1 --2- 172.21.15.123:0/3282840694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0368100b50 0x7f036810bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:39.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f036d4e8640 1 -- 172.21.15.123:0/3282840694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0368102c20 msgr2=0x7f03681aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:39.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f036d4e8640 1 --2- 172.21.15.123:0/3282840694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0368102c20 0x7f03681aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:39.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f036d4e8640 1 -- 172.21.15.123:0/3282840694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03681aa930 con 0x7f03681022a0 2024-08-18T22:06:39.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f036dce9640 1 --2- 172.21.15.123:0/3282840694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0368100b50 0x7f036810bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:39.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f036d4e8640 1 --2- 172.21.15.123:0/3282840694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03681022a0 0x7f036810c220 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0358009850 tx=0x7f03580309c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:39.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f035effd640 1 -- 172.21.15.123:0/3282840694 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035803f070 con 0x7f03681022a0 2024-08-18T22:06:39.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f036ff4d640 1 -- 172.21.15.123:0/3282840694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03681aab60 con 0x7f03681022a0 2024-08-18T22:06:39.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f035effd640 1 -- 172.21.15.123:0/3282840694 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0358032e20 con 0x7f03681022a0 2024-08-18T22:06:39.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f035effd640 1 -- 172.21.15.123:0/3282840694 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358035030 con 0x7f03681022a0 2024-08-18T22:06:39.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.592+0000 7f036ff4d640 1 -- 172.21.15.123:0/3282840694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03681ab010 con 0x7f03681022a0 2024-08-18T22:06:39.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.593+0000 7f036ff4d640 1 -- 172.21.15.123:0/3282840694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f03680fe2d0 con 0x7f03681022a0 2024-08-18T22:06:39.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.594+0000 7f035effd640 1 -- 172.21.15.123:0/3282840694 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0358042070 con 0x7f03681022a0 2024-08-18T22:06:39.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.595+0000 7f035effd640 1 --2- 172.21.15.123:0/3282840694 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f03540a2c00 0x7f03540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:39.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.595+0000 7f036dce9640 1 --2- 172.21.15.123:0/3282840694 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f03540a2c00 0x7f03540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:39.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.595+0000 7f035effd640 1 -- 172.21.15.123:0/3282840694 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f03580f0330 con 0x7f03681022a0 2024-08-18T22:06:39.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.595+0000 7f035effd640 1 --2- 172.21.15.123:0/3282840694 >> [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173] conn(0x7f03540addd0 0x7f03540b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:39.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.595+0000 7f035effd640 1 -- 172.21.15.123:0/3282840694 --> [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0358001d30 con 0x7f03540addd0 2024-08-18T22:06:39.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.595+0000 7f035effd640 1 -- 172.21.15.123:0/3282840694 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f03580f0810 con 0x7f03681022a0 2024-08-18T22:06:39.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.595+0000 7f036dce9640 1 --2- 172.21.15.123:0/3282840694 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f03540a2c00 0x7f03540a50c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f036400abe0 tx=0x7f036400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:39.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.595+0000 7f036e4ea640 1 --2- 172.21.15.123:0/3282840694 >> [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173] conn(0x7f03540addd0 0x7f03540b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:39.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.596+0000 7f036e4ea640 1 --2- 172.21.15.123:0/3282840694 >> [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173] conn(0x7f03540addd0 0x7f03540b0270 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:39.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.597+0000 7f035effd640 1 -- 172.21.15.123:0/3282840694 <== osd.2 v2:172.21.15.183:6800/2507871173 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0358001d30 con 0x7f03540addd0 2024-08-18T22:06:39.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.610+0000 7f036ff4d640 1 -- 172.21.15.123:0/3282840694 --> [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0368101ee0 con 0x7f03540addd0 2024-08-18T22:06:39.611 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:39.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.611+0000 7f035effd640 1 -- 172.21.15.123:0/3282840694 <== osd.2 v2:172.21.15.183:6800/2507871173 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0368101ee0 con 0x7f03540addd0 2024-08-18T22:06:39.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.611+0000 7f036ff4d640 1 -- 172.21.15.123:0/3282840694 >> [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173] conn(0x7f03540addd0 msgr2=0x7f03540b0270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:39.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.611+0000 7f036ff4d640 1 --2- 172.21.15.123:0/3282840694 >> [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173] conn(0x7f03540addd0 0x7f03540b0270 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:39.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.611+0000 7f036ff4d640 1 -- 172.21.15.123:0/3282840694 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f03540a2c00 msgr2=0x7f03540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:39.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.611+0000 7f036ff4d640 1 --2- 172.21.15.123:0/3282840694 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f03540a2c00 0x7f03540a50c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f036400abe0 tx=0x7f036400a5c0 comp rx=0 tx=0).stop 2024-08-18T22:06:39.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.611+0000 7f036ff4d640 1 -- 172.21.15.123:0/3282840694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03681022a0 msgr2=0x7f036810c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:39.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.611+0000 7f036ff4d640 1 --2- 172.21.15.123:0/3282840694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03681022a0 0x7f036810c220 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0358009850 tx=0x7f03580309c0 comp rx=0 tx=0).stop 2024-08-18T22:06:39.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.611+0000 7f036e4ea640 1 -- 172.21.15.123:0/3282840694 reap_dead start 2024-08-18T22:06:39.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.611+0000 7f036ff4d640 1 -- 172.21.15.123:0/3282840694 shutdown_connections 2024-08-18T22:06:39.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.611+0000 7f036ff4d640 1 -- 172.21.15.123:0/3282840694 >> 172.21.15.123:0/3282840694 conn(0x7f03680fc500 msgr2=0x7f03680fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:39.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.612+0000 7f036ff4d640 1 -- 172.21.15.123:0/3282840694 shutdown_connections 2024-08-18T22:06:39.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.612+0000 7f036ff4d640 1 -- 172.21.15.123:0/3282840694 wait complete. 2024-08-18T22:06:39.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.896+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/504564020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c08102a70 msgr2=0x7f4c08102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:39.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.896+0000 7f4c0f8fe640 1 --2- 172.21.15.123:0/504564020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c08102a70 0x7f4c08102e50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009900 tx=0x7f4bf802a480 comp rx=0 tx=0).stop 2024-08-18T22:06:39.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.896+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/504564020 shutdown_connections 2024-08-18T22:06:39.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.896+0000 7f4c0f8fe640 1 --2- 172.21.15.123:0/504564020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c0810bea0 0x7f4c0810e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:39.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.896+0000 7f4c0f8fe640 1 --2- 172.21.15.123:0/504564020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c08103390 0x7f4c0810b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:39.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.896+0000 7f4c0f8fe640 1 --2- 172.21.15.123:0/504564020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c08102a70 0x7f4c08102e50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:39.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.896+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/504564020 >> 172.21.15.123:0/504564020 conn(0x7f4c080fc4d0 msgr2=0x7f4c080fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:39.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.896+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/504564020 shutdown_connections 2024-08-18T22:06:39.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.896+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/504564020 wait complete. 2024-08-18T22:06:39.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0f8fe640 1 Processor -- start 2024-08-18T22:06:39.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0f8fe640 1 -- start start 2024-08-18T22:06:39.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0f8fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c08102a70 0x7f4c081982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0f8fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c08103390 0x7f4c08198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0f8fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c0810bea0 0x7f4c0819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0f8fe640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08111d60 con 0x7f4c08103390 2024-08-18T22:06:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0f8fe640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08111be0 con 0x7f4c08102a70 2024-08-18T22:06:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0f8fe640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08111ee0 con 0x7f4c0810bea0 2024-08-18T22:06:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0ce99640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c08103390 0x7f4c08198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0ce99640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c08103390 0x7f4c08198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50596/0 (socket says 172.21.15.123:50596) 2024-08-18T22:06:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0ce99640 1 -- 172.21.15.123:0/2361530417 learned_addr learned my addr 172.21.15.123:0/2361530417 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0de9b640 1 --2- 172.21.15.123:0/2361530417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c0810bea0 0x7f4c0819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0d69a640 1 --2- 172.21.15.123:0/2361530417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c08102a70 0x7f4c081982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0ce99640 1 -- 172.21.15.123:0/2361530417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c0810bea0 msgr2=0x7f4c0819cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0ce99640 1 --2- 172.21.15.123:0/2361530417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c0810bea0 0x7f4c0819cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0ce99640 1 -- 172.21.15.123:0/2361530417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c08102a70 msgr2=0x7f4c081982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0ce99640 1 --2- 172.21.15.123:0/2361530417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c08102a70 0x7f4c081982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.897+0000 7f4c0ce99640 1 -- 172.21.15.123:0/2361530417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0819d280 con 0x7f4c08103390 2024-08-18T22:06:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.898+0000 7f4c0d69a640 1 --2- 172.21.15.123:0/2361530417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c08102a70 0x7f4c081982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:06:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.898+0000 7f4c0ce99640 1 --2- 172.21.15.123:0/2361530417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c08103390 0x7f4c08198810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400b3f0 tx=0x7f4c0400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.898+0000 7f4bfe7fc640 1 -- 172.21.15.123:0/2361530417 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04015020 con 0x7f4c08103390 2024-08-18T22:06:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.898+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/2361530417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c0819d570 con 0x7f4c08103390 2024-08-18T22:06:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.898+0000 7f4bfe7fc640 1 -- 172.21.15.123:0/2361530417 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c04011d10 con 0x7f4c08103390 2024-08-18T22:06:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.898+0000 7f4bfe7fc640 1 -- 172.21.15.123:0/2361530417 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0400f2e0 con 0x7f4c08103390 2024-08-18T22:06:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.898+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/2361530417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c081a4e50 con 0x7f4c08103390 2024-08-18T22:06:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.899+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/2361530417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4c08062630 con 0x7f4c08103390 2024-08-18T22:06:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.900+0000 7f4bfe7fc640 1 -- 172.21.15.123:0/2361530417 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f4c04018020 con 0x7f4c08103390 2024-08-18T22:06:39.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.900+0000 7f4bfe7fc640 1 --2- 172.21.15.123:0/2361530417 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4bf40a2c10 0x7f4bf40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:39.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.901+0000 7f4c0d69a640 1 --2- 172.21.15.123:0/2361530417 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4bf40a2c10 0x7f4bf40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:39.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.901+0000 7f4bfe7fc640 1 -- 172.21.15.123:0/2361530417 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f4c040cf3b0 con 0x7f4c08103390 2024-08-18T22:06:39.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.901+0000 7f4bfe7fc640 1 --2- 172.21.15.123:0/2361530417 >> [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210] conn(0x7f4bf40adde0 0x7f4bf40b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:39.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.901+0000 7f4bfe7fc640 1 -- 172.21.15.123:0/2361530417 --> [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c04004450 con 0x7f4bf40adde0 2024-08-18T22:06:39.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.901+0000 7f4bfe7fc640 1 -- 172.21.15.123:0/2361530417 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f4c040cf800 con 0x7f4c08103390 2024-08-18T22:06:39.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.901+0000 7f4c0d69a640 1 --2- 172.21.15.123:0/2361530417 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4bf40a2c10 0x7f4bf40a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8000c00 tx=0x7f4bf8032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:39.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.901+0000 7f4c0de9b640 1 --2- 172.21.15.123:0/2361530417 >> [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210] conn(0x7f4bf40adde0 0x7f4bf40b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:39.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.902+0000 7f4c0de9b640 1 --2- 172.21.15.123:0/2361530417 >> [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210] conn(0x7f4bf40adde0 0x7f4bf40b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:39.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.902+0000 7f4bfe7fc640 1 -- 172.21.15.123:0/2361530417 <== osd.1 v2:172.21.15.130:6800/328938210 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c04004450 con 0x7f4bf40adde0 2024-08-18T22:06:39.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.916+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/2361530417 --> [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4c08062ab0 con 0x7f4bf40adde0 2024-08-18T22:06:39.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.917+0000 7f4bfe7fc640 1 -- 172.21.15.123:0/2361530417 <== osd.1 v2:172.21.15.130:6800/328938210 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4c08062ab0 con 0x7f4bf40adde0 2024-08-18T22:06:39.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.917+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/2361530417 >> [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210] conn(0x7f4bf40adde0 msgr2=0x7f4bf40b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:39.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.917+0000 7f4c0f8fe640 1 --2- 172.21.15.123:0/2361530417 >> [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210] conn(0x7f4bf40adde0 0x7f4bf40b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:39.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.917+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/2361530417 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4bf40a2c10 msgr2=0x7f4bf40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:39.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.917+0000 7f4c0f8fe640 1 --2- 172.21.15.123:0/2361530417 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4bf40a2c10 0x7f4bf40a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8000c00 tx=0x7f4bf8032d50 comp rx=0 tx=0).stop 2024-08-18T22:06:39.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.917+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/2361530417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c08103390 msgr2=0x7f4c08198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:39.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.917+0000 7f4c0f8fe640 1 --2- 172.21.15.123:0/2361530417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c08103390 0x7f4c08198810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400b3f0 tx=0x7f4c0400b8b0 comp rx=0 tx=0).stop 2024-08-18T22:06:39.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.917+0000 7f4c0de9b640 1 -- 172.21.15.123:0/2361530417 reap_dead start 2024-08-18T22:06:39.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.917+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/2361530417 shutdown_connections 2024-08-18T22:06:39.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.917+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/2361530417 >> 172.21.15.123:0/2361530417 conn(0x7f4c080fc4d0 msgr2=0x7f4c080fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:39.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.917+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/2361530417 shutdown_connections 2024-08-18T22:06:39.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:39.917+0000 7f4c0f8fe640 1 -- 172.21.15.123:0/2361530417 wait complete. 2024-08-18T22:06:40.399 INFO:teuthology.orchestra.run.smithi123.stdout:188978561075 2024-08-18T22:06:40.399 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-08-18T22:06:40.623 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:40 smithi123 ceph-mon[18462]: pgmap v305: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:06:40.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:40 smithi130 ceph-mon[21698]: pgmap v305: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:06:40.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:40 smithi183 ceph-mon[22097]: pgmap v305: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:06:41.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.836+0000 7fef595e8640 1 -- 172.21.15.123:0/2079963995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef541022a0 msgr2=0x7fef541026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:41.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.836+0000 7fef595e8640 1 --2- 172.21.15.123:0/2079963995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef541022a0 0x7fef541026e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fef48009900 tx=0x7fef4802a480 comp rx=0 tx=0).stop 2024-08-18T22:06:41.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.836+0000 7fef595e8640 1 -- 172.21.15.123:0/2079963995 shutdown_connections 2024-08-18T22:06:41.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.836+0000 7fef595e8640 1 --2- 172.21.15.123:0/2079963995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef54102c20 0x7fef5410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:41.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.836+0000 7fef595e8640 1 --2- 172.21.15.123:0/2079963995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef541022a0 0x7fef541026e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:41.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.836+0000 7fef595e8640 1 --2- 172.21.15.123:0/2079963995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef54100b50 0x7fef54100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:41.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.836+0000 7fef595e8640 1 -- 172.21.15.123:0/2079963995 >> 172.21.15.123:0/2079963995 conn(0x7fef540fc500 msgr2=0x7fef540fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:41.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.836+0000 7fef595e8640 1 -- 172.21.15.123:0/2079963995 shutdown_connections 2024-08-18T22:06:41.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.836+0000 7fef595e8640 1 -- 172.21.15.123:0/2079963995 wait complete. 2024-08-18T22:06:41.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.837+0000 7fef595e8640 1 Processor -- start 2024-08-18T22:06:41.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.837+0000 7fef595e8640 1 -- start start 2024-08-18T22:06:41.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.837+0000 7fef595e8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef54100b50 0x7fef54197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:41.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.837+0000 7fef595e8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef541022a0 0x7fef541977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:41.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.837+0000 7fef595e8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef54102c20 0x7fef5419bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:41.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.837+0000 7fef595e8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fef54110d50 con 0x7fef541022a0 2024-08-18T22:06:41.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.837+0000 7fef595e8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fef54110bd0 con 0x7fef54102c20 2024-08-18T22:06:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.837+0000 7fef595e8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fef54110ed0 con 0x7fef54100b50 2024-08-18T22:06:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.837+0000 7fef527fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef541022a0 0x7fef541977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.837+0000 7fef527fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef541022a0 0x7fef541977b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50604/0 (socket says 172.21.15.123:50604) 2024-08-18T22:06:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.837+0000 7fef527fc640 1 -- 172.21.15.123:0/37729077 learned_addr learned my addr 172.21.15.123:0/37729077 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.837+0000 7fef52ffd640 1 --2- 172.21.15.123:0/37729077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef54100b50 0x7fef54197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.838+0000 7fef527fc640 1 -- 172.21.15.123:0/37729077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef54100b50 msgr2=0x7fef54197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.838+0000 7fef527fc640 1 --2- 172.21.15.123:0/37729077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef54100b50 0x7fef54197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:41.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.838+0000 7fef537fe640 1 --2- 172.21.15.123:0/37729077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef54102c20 0x7fef5419bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:41.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.838+0000 7fef527fc640 1 -- 172.21.15.123:0/37729077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef54102c20 msgr2=0x7fef5419bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:41.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.838+0000 7fef527fc640 1 --2- 172.21.15.123:0/37729077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef54102c20 0x7fef5419bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:41.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.838+0000 7fef527fc640 1 -- 172.21.15.123:0/37729077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5419c220 con 0x7fef541022a0 2024-08-18T22:06:41.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.838+0000 7fef527fc640 1 --2- 172.21.15.123:0/37729077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef541022a0 0x7fef541977b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fef48006010 tx=0x7fef48003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:41.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.838+0000 7fef3bfff640 1 -- 172.21.15.123:0/37729077 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4803f070 con 0x7fef541022a0 2024-08-18T22:06:41.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.838+0000 7fef3bfff640 1 -- 172.21.15.123:0/37729077 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef48031e30 con 0x7fef541022a0 2024-08-18T22:06:41.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.838+0000 7fef3bfff640 1 -- 172.21.15.123:0/37729077 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48035030 con 0x7fef541022a0 2024-08-18T22:06:41.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.838+0000 7fef595e8640 1 -- 172.21.15.123:0/37729077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef5419c4b0 con 0x7fef541022a0 2024-08-18T22:06:41.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.838+0000 7fef595e8640 1 -- 172.21.15.123:0/37729077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef541a3df0 con 0x7fef541022a0 2024-08-18T22:06:41.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.839+0000 7fef595e8640 1 -- 172.21.15.123:0/37729077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef540626b0 con 0x7fef541022a0 2024-08-18T22:06:41.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.840+0000 7fef3bfff640 1 -- 172.21.15.123:0/37729077 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fef48042070 con 0x7fef541022a0 2024-08-18T22:06:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.841+0000 7fef3bfff640 1 --2- 172.21.15.123:0/37729077 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fef3c0a2c10 0x7fef3c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.841+0000 7fef52ffd640 1 --2- 172.21.15.123:0/37729077 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fef3c0a2c10 0x7fef3c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.841+0000 7fef3bfff640 1 -- 172.21.15.123:0/37729077 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fef480eff90 con 0x7fef541022a0 2024-08-18T22:06:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.841+0000 7fef3bfff640 1 --2- 172.21.15.123:0/37729077 >> [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957] conn(0x7fef3c0adde0 0x7fef3c0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.841+0000 7fef3bfff640 1 -- 172.21.15.123:0/37729077 --> [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef4802fec0 con 0x7fef3c0adde0 2024-08-18T22:06:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.841+0000 7fef3bfff640 1 -- 172.21.15.123:0/37729077 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fef480f25b0 con 0x7fef541022a0 2024-08-18T22:06:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.841+0000 7fef52ffd640 1 --2- 172.21.15.123:0/37729077 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fef3c0a2c10 0x7fef3c0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fef44009890 tx=0x7fef44008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.841+0000 7fef537fe640 1 --2- 172.21.15.123:0/37729077 >> [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957] conn(0x7fef3c0adde0 0x7fef3c0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.842+0000 7fef537fe640 1 --2- 172.21.15.123:0/37729077 >> [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957] conn(0x7fef3c0adde0 0x7fef3c0b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.843+0000 7fef3bfff640 1 -- 172.21.15.123:0/37729077 <== osd.7 v2:172.21.15.130:6816/1750872957 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fef4802fec0 con 0x7fef3c0adde0 2024-08-18T22:06:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.856+0000 7fef595e8640 1 -- 172.21.15.123:0/37729077 --> [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fef54062b30 con 0x7fef3c0adde0 2024-08-18T22:06:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.857+0000 7fef3bfff640 1 -- 172.21.15.123:0/37729077 <== osd.7 v2:172.21.15.130:6816/1750872957 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fef54062b30 con 0x7fef3c0adde0 2024-08-18T22:06:41.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.857+0000 7fef595e8640 1 -- 172.21.15.123:0/37729077 >> [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957] conn(0x7fef3c0adde0 msgr2=0x7fef3c0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:41.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.857+0000 7fef595e8640 1 --2- 172.21.15.123:0/37729077 >> [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957] conn(0x7fef3c0adde0 0x7fef3c0b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:41.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.857+0000 7fef595e8640 1 -- 172.21.15.123:0/37729077 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fef3c0a2c10 msgr2=0x7fef3c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:41.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.857+0000 7fef595e8640 1 --2- 172.21.15.123:0/37729077 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fef3c0a2c10 0x7fef3c0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fef44009890 tx=0x7fef44008040 comp rx=0 tx=0).stop 2024-08-18T22:06:41.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.857+0000 7fef595e8640 1 -- 172.21.15.123:0/37729077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef541022a0 msgr2=0x7fef541977b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:41.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.857+0000 7fef595e8640 1 --2- 172.21.15.123:0/37729077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef541022a0 0x7fef541977b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fef48006010 tx=0x7fef48003c80 comp rx=0 tx=0).stop 2024-08-18T22:06:41.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.857+0000 7fef537fe640 1 -- 172.21.15.123:0/37729077 reap_dead start 2024-08-18T22:06:41.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.857+0000 7fef595e8640 1 -- 172.21.15.123:0/37729077 shutdown_connections 2024-08-18T22:06:41.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.857+0000 7fef595e8640 1 -- 172.21.15.123:0/37729077 >> 172.21.15.123:0/37729077 conn(0x7fef540fc500 msgr2=0x7fef540fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:41.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.857+0000 7fef595e8640 1 -- 172.21.15.123:0/37729077 shutdown_connections 2024-08-18T22:06:41.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:40.857+0000 7fef595e8640 1 -- 172.21.15.123:0/37729077 wait complete. 2024-08-18T22:06:41.760 INFO:teuthology.orchestra.run.smithi123.stdout:210453397551 2024-08-18T22:06:41.760 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-08-18T22:06:42.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.138+0000 7f1dac8e9640 1 -- 172.21.15.123:0/1187265553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da8102c20 msgr2=0x7f1da810d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:42.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.138+0000 7f1dac8e9640 1 --2- 172.21.15.123:0/1187265553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da8102c20 0x7f1da810d770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009ca0 tx=0x7f1da002a950 comp rx=0 tx=0).stop 2024-08-18T22:06:42.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.138+0000 7f1dac8e9640 1 -- 172.21.15.123:0/1187265553 shutdown_connections 2024-08-18T22:06:42.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.138+0000 7f1dac8e9640 1 --2- 172.21.15.123:0/1187265553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da8102c20 0x7f1da810d770 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:42.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.138+0000 7f1dac8e9640 1 --2- 172.21.15.123:0/1187265553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1da81022a0 0x7f1da81026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:42.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.138+0000 7f1dac8e9640 1 --2- 172.21.15.123:0/1187265553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da8100b50 0x7f1da8100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:42.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.138+0000 7f1dac8e9640 1 -- 172.21.15.123:0/1187265553 >> 172.21.15.123:0/1187265553 conn(0x7f1da80fc500 msgr2=0x7f1da80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:42.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.138+0000 7f1dac8e9640 1 -- 172.21.15.123:0/1187265553 shutdown_connections 2024-08-18T22:06:42.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.138+0000 7f1dac8e9640 1 -- 172.21.15.123:0/1187265553 wait complete. 2024-08-18T22:06:42.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.139+0000 7f1dac8e9640 1 Processor -- start 2024-08-18T22:06:42.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.139+0000 7f1dac8e9640 1 -- start start 2024-08-18T22:06:42.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.139+0000 7f1dac8e9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da8100b50 0x7f1da8198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:42.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.139+0000 7f1dac8e9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da81022a0 0x7f1da8198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:42.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.139+0000 7f1dac8e9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1da8102c20 0x7f1da819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:42.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.139+0000 7f1dac8e9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1da8111e50 con 0x7f1da81022a0 2024-08-18T22:06:42.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.139+0000 7f1dac8e9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1da8111cd0 con 0x7f1da8100b50 2024-08-18T22:06:42.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.139+0000 7f1dac8e9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1da8111fd0 con 0x7f1da8102c20 2024-08-18T22:06:42.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.139+0000 7f1d9ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da81022a0 0x7f1da8198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:42.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.139+0000 7f1d9ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da81022a0 0x7f1da8198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50620/0 (socket says 172.21.15.123:50620) 2024-08-18T22:06:42.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.139+0000 7f1d9ffff640 1 -- 172.21.15.123:0/2945380059 learned_addr learned my addr 172.21.15.123:0/2945380059 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:42.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.139+0000 7f1da6d9d640 1 --2- 172.21.15.123:0/2945380059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1da8102c20 0x7f1da819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:42.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.139+0000 7f1da659c640 1 --2- 172.21.15.123:0/2945380059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da8100b50 0x7f1da8198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:42.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.140+0000 7f1d9ffff640 1 -- 172.21.15.123:0/2945380059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1da8102c20 msgr2=0x7f1da819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:42.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.140+0000 7f1d9ffff640 1 --2- 172.21.15.123:0/2945380059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1da8102c20 0x7f1da819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:42.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.140+0000 7f1d9ffff640 1 -- 172.21.15.123:0/2945380059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da8100b50 msgr2=0x7f1da8198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:42.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.140+0000 7f1d9ffff640 1 --2- 172.21.15.123:0/2945380059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da8100b50 0x7f1da8198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:42.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.140+0000 7f1d9ffff640 1 -- 172.21.15.123:0/2945380059 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da819d2c0 con 0x7f1da81022a0 2024-08-18T22:06:42.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.140+0000 7f1d9ffff640 1 --2- 172.21.15.123:0/2945380059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da81022a0 0x7f1da8198850 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000b4a0 tx=0x7f1d9000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:42.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.140+0000 7f1d9f7fe640 1 -- 172.21.15.123:0/2945380059 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d90014070 con 0x7f1da81022a0 2024-08-18T22:06:42.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.140+0000 7f1d9f7fe640 1 -- 172.21.15.123:0/2945380059 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d90010af0 con 0x7f1da81022a0 2024-08-18T22:06:42.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.140+0000 7f1dac8e9640 1 -- 172.21.15.123:0/2945380059 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da819d5b0 con 0x7f1da81022a0 2024-08-18T22:06:42.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.140+0000 7f1d9f7fe640 1 -- 172.21.15.123:0/2945380059 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d90017d10 con 0x7f1da81022a0 2024-08-18T22:06:42.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.140+0000 7f1dac8e9640 1 -- 172.21.15.123:0/2945380059 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da81a4e90 con 0x7f1da81022a0 2024-08-18T22:06:42.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.141+0000 7f1dac8e9640 1 -- 172.21.15.123:0/2945380059 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1da8062670 con 0x7f1da81022a0 2024-08-18T22:06:42.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.142+0000 7f1d9f7fe640 1 -- 172.21.15.123:0/2945380059 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f1d90017070 con 0x7f1da81022a0 2024-08-18T22:06:42.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.143+0000 7f1d9f7fe640 1 --2- 172.21.15.123:0/2945380059 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d940a2c10 0x7f1d940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:42.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.143+0000 7f1da659c640 1 --2- 172.21.15.123:0/2945380059 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d940a2c10 0x7f1d940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:42.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.143+0000 7f1d9f7fe640 1 -- 172.21.15.123:0/2945380059 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f1d900cebc0 con 0x7f1da81022a0 2024-08-18T22:06:42.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.143+0000 7f1d9f7fe640 1 --2- 172.21.15.123:0/2945380059 >> [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725] conn(0x7f1d940adde0 0x7f1d940b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:42.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.143+0000 7f1d9f7fe640 1 -- 172.21.15.123:0/2945380059 --> [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d940b0950 con 0x7f1d940adde0 2024-08-18T22:06:42.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.143+0000 7f1d9f7fe640 1 -- 172.21.15.123:0/2945380059 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f1d900cf010 con 0x7f1da81022a0 2024-08-18T22:06:42.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.143+0000 7f1da6d9d640 1 --2- 172.21.15.123:0/2945380059 >> [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725] conn(0x7f1d940adde0 0x7f1d940b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:42.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.143+0000 7f1da659c640 1 --2- 172.21.15.123:0/2945380059 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d940a2c10 0x7f1d940a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009890 tx=0x7f1d98008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:42.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.144+0000 7f1da6d9d640 1 --2- 172.21.15.123:0/2945380059 >> [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725] conn(0x7f1d940adde0 0x7f1d940b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:42.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.144+0000 7f1d9f7fe640 1 -- 172.21.15.123:0/2945380059 <== osd.0 v2:172.21.15.123:6802/2904363725 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1d940b0950 con 0x7f1d940adde0 2024-08-18T22:06:42.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.158+0000 7f1dac8e9640 1 -- 172.21.15.123:0/2945380059 --> [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1da8062af0 con 0x7f1d940adde0 2024-08-18T22:06:42.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.158+0000 7f1d9f7fe640 1 -- 172.21.15.123:0/2945380059 <== osd.0 v2:172.21.15.123:6802/2904363725 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1da8062af0 con 0x7f1d940adde0 2024-08-18T22:06:42.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.158+0000 7f1dac8e9640 1 -- 172.21.15.123:0/2945380059 >> [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725] conn(0x7f1d940adde0 msgr2=0x7f1d940b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:42.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.158+0000 7f1dac8e9640 1 --2- 172.21.15.123:0/2945380059 >> [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725] conn(0x7f1d940adde0 0x7f1d940b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:42.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.159+0000 7f1dac8e9640 1 -- 172.21.15.123:0/2945380059 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d940a2c10 msgr2=0x7f1d940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:42.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.159+0000 7f1dac8e9640 1 --2- 172.21.15.123:0/2945380059 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d940a2c10 0x7f1d940a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009890 tx=0x7f1d98008040 comp rx=0 tx=0).stop 2024-08-18T22:06:42.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.159+0000 7f1dac8e9640 1 -- 172.21.15.123:0/2945380059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da81022a0 msgr2=0x7f1da8198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:42.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.159+0000 7f1dac8e9640 1 --2- 172.21.15.123:0/2945380059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da81022a0 0x7f1da8198850 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000b4a0 tx=0x7f1d9000b960 comp rx=0 tx=0).stop 2024-08-18T22:06:42.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.159+0000 7f1da6d9d640 1 -- 172.21.15.123:0/2945380059 reap_dead start 2024-08-18T22:06:42.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.159+0000 7f1dac8e9640 1 -- 172.21.15.123:0/2945380059 shutdown_connections 2024-08-18T22:06:42.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.159+0000 7f1dac8e9640 1 -- 172.21.15.123:0/2945380059 >> 172.21.15.123:0/2945380059 conn(0x7f1da80fc500 msgr2=0x7f1da80fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:42.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.159+0000 7f1dac8e9640 1 -- 172.21.15.123:0/2945380059 shutdown_connections 2024-08-18T22:06:42.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:42.159+0000 7f1dac8e9640 1 -- 172.21.15.123:0/2945380059 wait complete. 2024-08-18T22:06:42.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:42 smithi123 ceph-mon[18462]: pgmap v306: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:06:42.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:42 smithi130 ceph-mon[21698]: pgmap v306: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:06:42.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:42 smithi183 ceph-mon[22097]: pgmap v306: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:06:42.954 INFO:teuthology.orchestra.run.smithi123.stdout:274877906982 2024-08-18T22:06:42.954 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-08-18T22:06:43.715 INFO:teuthology.orchestra.run.smithi123.stdout:77309411396 2024-08-18T22:06:43.715 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-18T22:06:43.824 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:43.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.368+0000 7fd71fd7d640 1 -- 172.21.15.123:0/1898519070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd718102250 msgr2=0x7fd71810e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:43.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.368+0000 7fd71fd7d640 1 --2- 172.21.15.123:0/1898519070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd718102250 0x7fd71810e780 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd710009cd0 tx=0x7fd71002a8e0 comp rx=0 tx=0).stop 2024-08-18T22:06:43.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.368+0000 7fd71fd7d640 1 -- 172.21.15.123:0/1898519070 shutdown_connections 2024-08-18T22:06:43.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.368+0000 7fd71fd7d640 1 --2- 172.21.15.123:0/1898519070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd718102250 0x7fd71810e780 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:43.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.368+0000 7fd71fd7d640 1 --2- 172.21.15.123:0/1898519070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7181018b0 0x7fd718101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:43.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.368+0000 7fd71fd7d640 1 --2- 172.21.15.123:0/1898519070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7181078b0 0x7fd718107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:43.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.368+0000 7fd71fd7d640 1 -- 172.21.15.123:0/1898519070 >> 172.21.15.123:0/1898519070 conn(0x7fd7180fd5f0 msgr2=0x7fd7180ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:43.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.368+0000 7fd71fd7d640 1 -- 172.21.15.123:0/1898519070 shutdown_connections 2024-08-18T22:06:43.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.368+0000 7fd71fd7d640 1 -- 172.21.15.123:0/1898519070 wait complete. 2024-08-18T22:06:43.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71fd7d640 1 Processor -- start 2024-08-18T22:06:43.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71fd7d640 1 -- start start 2024-08-18T22:06:43.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71fd7d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7181018b0 0x7fd7181982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:43.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71fd7d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd718102250 0x7fd718198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:43.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71fd7d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7181078b0 0x7fd71819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:43.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71fd7d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd718111d50 con 0x7fd7181018b0 2024-08-18T22:06:43.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71fd7d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd718111bd0 con 0x7fd718102250 2024-08-18T22:06:43.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71fd7d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd718111ed0 con 0x7fd7181078b0 2024-08-18T22:06:43.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71db19640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7181018b0 0x7fd7181982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:43.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71db19640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7181018b0 0x7fd7181982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42488/0 (socket says 172.21.15.123:42488) 2024-08-18T22:06:43.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71db19640 1 -- 172.21.15.123:0/149366501 learned_addr learned my addr 172.21.15.123:0/149366501 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:43.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71e31a640 1 --2- 172.21.15.123:0/149366501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7181078b0 0x7fd71819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:43.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71db19640 1 -- 172.21.15.123:0/149366501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7181078b0 msgr2=0x7fd71819cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71db19640 1 --2- 172.21.15.123:0/149366501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7181078b0 0x7fd71819cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71d318640 1 --2- 172.21.15.123:0/149366501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd718102250 0x7fd718198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71db19640 1 -- 172.21.15.123:0/149366501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd718102250 msgr2=0x7fd718198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71db19640 1 --2- 172.21.15.123:0/149366501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd718102250 0x7fd718198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71db19640 1 -- 172.21.15.123:0/149366501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71819d280 con 0x7fd7181018b0 2024-08-18T22:06:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71d318640 1 --2- 172.21.15.123:0/149366501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd718102250 0x7fd718198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:06:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.369+0000 7fd71db19640 1 --2- 172.21.15.123:0/149366501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7181018b0 0x7fd7181982d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd71400b4a0 tx=0x7fd71400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.370+0000 7fd70affd640 1 -- 172.21.15.123:0/149366501 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd714014070 con 0x7fd7181018b0 2024-08-18T22:06:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.370+0000 7fd70affd640 1 -- 172.21.15.123:0/149366501 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd714010af0 con 0x7fd7181018b0 2024-08-18T22:06:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.370+0000 7fd71fd7d640 1 -- 172.21.15.123:0/149366501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd71819d570 con 0x7fd7181018b0 2024-08-18T22:06:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.370+0000 7fd70affd640 1 -- 172.21.15.123:0/149366501 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd714017d10 con 0x7fd7181018b0 2024-08-18T22:06:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.370+0000 7fd71fd7d640 1 -- 172.21.15.123:0/149366501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7181a4e50 con 0x7fd7181018b0 2024-08-18T22:06:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.371+0000 7fd71fd7d640 1 -- 172.21.15.123:0/149366501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd718062670 con 0x7fd7181018b0 2024-08-18T22:06:43.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.372+0000 7fd70affd640 1 -- 172.21.15.123:0/149366501 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd714017070 con 0x7fd7181018b0 2024-08-18T22:06:43.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.372+0000 7fd70affd640 1 --2- 172.21.15.123:0/149366501 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd7040a2c10 0x7fd7040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:43.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.373+0000 7fd71d318640 1 --2- 172.21.15.123:0/149366501 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd7040a2c10 0x7fd7040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:43.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.373+0000 7fd70affd640 1 -- 172.21.15.123:0/149366501 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fd7140cec70 con 0x7fd7181018b0 2024-08-18T22:06:43.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.373+0000 7fd70affd640 1 --2- 172.21.15.123:0/149366501 >> [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086] conn(0x7fd7040adde0 0x7fd7040b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:43.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.373+0000 7fd70affd640 1 -- 172.21.15.123:0/149366501 --> [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7040b0950 con 0x7fd7040adde0 2024-08-18T22:06:43.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.373+0000 7fd70affd640 1 -- 172.21.15.123:0/149366501 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fd7140cf0c0 con 0x7fd7181018b0 2024-08-18T22:06:43.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.373+0000 7fd71d318640 1 --2- 172.21.15.123:0/149366501 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd7040a2c10 0x7fd7040a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd70c006fd0 tx=0x7fd70c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:43.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.373+0000 7fd71e31a640 1 --2- 172.21.15.123:0/149366501 >> [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086] conn(0x7fd7040adde0 0x7fd7040b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:43.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.373+0000 7fd71e31a640 1 --2- 172.21.15.123:0/149366501 >> [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086] conn(0x7fd7040adde0 0x7fd7040b0280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:43.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.374+0000 7fd70affd640 1 -- 172.21.15.123:0/149366501 <== osd.10 v2:172.21.15.130:6824/2924260086 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd7040b0950 con 0x7fd7040adde0 2024-08-18T22:06:43.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.388+0000 7fd71fd7d640 1 -- 172.21.15.123:0/149366501 --> [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd718062af0 con 0x7fd7040adde0 2024-08-18T22:06:43.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.389+0000 7fd70affd640 1 -- 172.21.15.123:0/149366501 <== osd.10 v2:172.21.15.130:6824/2924260086 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd718062af0 con 0x7fd7040adde0 2024-08-18T22:06:43.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.389+0000 7fd71fd7d640 1 -- 172.21.15.123:0/149366501 >> [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086] conn(0x7fd7040adde0 msgr2=0x7fd7040b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:43.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.389+0000 7fd71fd7d640 1 --2- 172.21.15.123:0/149366501 >> [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086] conn(0x7fd7040adde0 0x7fd7040b0280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:43.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.389+0000 7fd71fd7d640 1 -- 172.21.15.123:0/149366501 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd7040a2c10 msgr2=0x7fd7040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:43.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.389+0000 7fd71fd7d640 1 --2- 172.21.15.123:0/149366501 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd7040a2c10 0x7fd7040a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd70c006fd0 tx=0x7fd70c008040 comp rx=0 tx=0).stop 2024-08-18T22:06:43.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.389+0000 7fd71fd7d640 1 -- 172.21.15.123:0/149366501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7181018b0 msgr2=0x7fd7181982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:43.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.389+0000 7fd71fd7d640 1 --2- 172.21.15.123:0/149366501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7181018b0 0x7fd7181982d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd71400b4a0 tx=0x7fd71400b960 comp rx=0 tx=0).stop 2024-08-18T22:06:43.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.389+0000 7fd71e31a640 1 -- 172.21.15.123:0/149366501 reap_dead start 2024-08-18T22:06:43.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.389+0000 7fd71fd7d640 1 -- 172.21.15.123:0/149366501 shutdown_connections 2024-08-18T22:06:43.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.389+0000 7fd71fd7d640 1 -- 172.21.15.123:0/149366501 >> 172.21.15.123:0/149366501 conn(0x7fd7180fd5f0 msgr2=0x7fd7180fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:43.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.390+0000 7fd71fd7d640 1 -- 172.21.15.123:0/149366501 shutdown_connections 2024-08-18T22:06:43.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:43.390+0000 7fd71fd7d640 1 -- 172.21.15.123:0/149366501 wait complete. 2024-08-18T22:06:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.483+0000 7f1cadda0640 1 -- 172.21.15.123:0/2636244256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ca8101910 msgr2=0x7f1ca810d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.483+0000 7f1cadda0640 1 --2- 172.21.15.123:0/2636244256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ca8101910 0x7f1ca810d640 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009ca0 tx=0x7f1ca002a8c0 comp rx=0 tx=0).stop 2024-08-18T22:06:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.483+0000 7f1cadda0640 1 -- 172.21.15.123:0/2636244256 shutdown_connections 2024-08-18T22:06:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.483+0000 7f1cadda0640 1 --2- 172.21.15.123:0/2636244256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ca8101910 0x7f1ca810d640 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.483+0000 7f1cadda0640 1 --2- 172.21.15.123:0/2636244256 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ca8100f70 0x7f1ca81013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.483+0000 7f1cadda0640 1 --2- 172.21.15.123:0/2636244256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ca81057a0 0x7f1ca8105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.483+0000 7f1cadda0640 1 -- 172.21.15.123:0/2636244256 >> 172.21.15.123:0/2636244256 conn(0x7f1ca8076f40 msgr2=0x7f1ca80fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.483+0000 7f1cadda0640 1 -- 172.21.15.123:0/2636244256 shutdown_connections 2024-08-18T22:06:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.483+0000 7f1cadda0640 1 -- 172.21.15.123:0/2636244256 wait complete. 2024-08-18T22:06:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.484+0000 7f1cadda0640 1 Processor -- start 2024-08-18T22:06:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.484+0000 7f1cadda0640 1 -- start start 2024-08-18T22:06:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.484+0000 7f1cadda0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ca8100f70 0x7f1ca81980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.484+0000 7f1cadda0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ca8101910 0x7f1ca8198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.484+0000 7f1cadda0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ca81057a0 0x7f1ca819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.484+0000 7f1cadda0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca8110be0 con 0x7f1ca8100f70 2024-08-18T22:06:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.484+0000 7f1cadda0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca8110a60 con 0x7f1ca81057a0 2024-08-18T22:06:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.484+0000 7f1cadda0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca8110d60 con 0x7f1ca8101910 2024-08-18T22:06:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.484+0000 7f1ca77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ca8100f70 0x7f1ca81980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.484+0000 7f1ca77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ca8100f70 0x7f1ca81980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42508/0 (socket says 172.21.15.123:42508) 2024-08-18T22:06:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.484+0000 7f1ca77fe640 1 -- 172.21.15.123:0/182851873 learned_addr learned my addr 172.21.15.123:0/182851873 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.485+0000 7f1ca7fff640 1 --2- 172.21.15.123:0/182851873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ca81057a0 0x7f1ca819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.485+0000 7f1ca6ffd640 1 --2- 172.21.15.123:0/182851873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ca8101910 0x7f1ca8198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.485+0000 7f1ca77fe640 1 -- 172.21.15.123:0/182851873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ca8101910 msgr2=0x7f1ca8198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.485+0000 7f1ca77fe640 1 --2- 172.21.15.123:0/182851873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ca8101910 0x7f1ca8198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.485+0000 7f1ca77fe640 1 -- 172.21.15.123:0/182851873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ca81057a0 msgr2=0x7f1ca819c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.485+0000 7f1ca77fe640 1 --2- 172.21.15.123:0/182851873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ca81057a0 0x7f1ca819c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.485+0000 7f1ca77fe640 1 -- 172.21.15.123:0/182851873 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca819d090 con 0x7f1ca8100f70 2024-08-18T22:06:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.485+0000 7f1ca7fff640 1 --2- 172.21.15.123:0/182851873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ca81057a0 0x7f1ca819c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.485+0000 7f1ca77fe640 1 --2- 172.21.15.123:0/182851873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ca8100f70 0x7f1ca81980e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800d950 tx=0x7f1c9800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.485+0000 7f1ca4ff9640 1 -- 172.21.15.123:0/182851873 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98017030 con 0x7f1ca8100f70 2024-08-18T22:06:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.485+0000 7f1ca4ff9640 1 -- 172.21.15.123:0/182851873 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c98004020 con 0x7f1ca8100f70 2024-08-18T22:06:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.485+0000 7f1cadda0640 1 -- 172.21.15.123:0/182851873 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca819d380 con 0x7f1ca8100f70 2024-08-18T22:06:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.485+0000 7f1ca4ff9640 1 -- 172.21.15.123:0/182851873 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c980047a0 con 0x7f1ca8100f70 2024-08-18T22:06:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.485+0000 7f1cadda0640 1 -- 172.21.15.123:0/182851873 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca81a4c60 con 0x7f1ca8100f70 2024-08-18T22:06:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.486+0000 7f1cadda0640 1 -- 172.21.15.123:0/182851873 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ca8103720 con 0x7f1ca8100f70 2024-08-18T22:06:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.487+0000 7f1ca4ff9640 1 -- 172.21.15.123:0/182851873 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f1c980041d0 con 0x7f1ca8100f70 2024-08-18T22:06:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.488+0000 7f1ca4ff9640 1 --2- 172.21.15.123:0/182851873 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1c900a2c10 0x7f1c900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.488+0000 7f1ca6ffd640 1 --2- 172.21.15.123:0/182851873 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1c900a2c10 0x7f1c900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.488+0000 7f1ca4ff9640 1 -- 172.21.15.123:0/182851873 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f1c980cf680 con 0x7f1ca8100f70 2024-08-18T22:06:44.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.488+0000 7f1ca4ff9640 1 --2- 172.21.15.123:0/182851873 >> [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383] conn(0x7f1c900addd0 0x7f1c900b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:44.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.488+0000 7f1ca4ff9640 1 -- 172.21.15.123:0/182851873 --> [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c900b0940 con 0x7f1c900addd0 2024-08-18T22:06:44.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.488+0000 7f1ca4ff9640 1 -- 172.21.15.123:0/182851873 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f1c980cfad0 con 0x7f1ca8100f70 2024-08-18T22:06:44.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.488+0000 7f1ca6ffd640 1 --2- 172.21.15.123:0/182851873 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1c900a2c10 0x7f1c900a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c005fd0 tx=0x7f1c9c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:44.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.489+0000 7f1ca7fff640 1 --2- 172.21.15.123:0/182851873 >> [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383] conn(0x7f1c900addd0 0x7f1c900b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:44.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.489+0000 7f1ca7fff640 1 --2- 172.21.15.123:0/182851873 >> [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383] conn(0x7f1c900addd0 0x7f1c900b0270 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:44.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.490+0000 7f1ca4ff9640 1 -- 172.21.15.123:0/182851873 <== osd.4 v2:172.21.15.130:6808/3632746383 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c900b0940 con 0x7f1c900addd0 2024-08-18T22:06:44.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.503+0000 7f1cadda0640 1 -- 172.21.15.123:0/182851873 --> [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1ca8101f80 con 0x7f1c900addd0 2024-08-18T22:06:44.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.504+0000 7f1ca4ff9640 1 -- 172.21.15.123:0/182851873 <== osd.4 v2:172.21.15.130:6808/3632746383 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1ca8101f80 con 0x7f1c900addd0 2024-08-18T22:06:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.504+0000 7f1cadda0640 1 -- 172.21.15.123:0/182851873 >> [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383] conn(0x7f1c900addd0 msgr2=0x7f1c900b0270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.504+0000 7f1cadda0640 1 --2- 172.21.15.123:0/182851873 >> [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383] conn(0x7f1c900addd0 0x7f1c900b0270 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.504+0000 7f1cadda0640 1 -- 172.21.15.123:0/182851873 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1c900a2c10 msgr2=0x7f1c900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.504+0000 7f1cadda0640 1 --2- 172.21.15.123:0/182851873 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1c900a2c10 0x7f1c900a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c005fd0 tx=0x7f1c9c005850 comp rx=0 tx=0).stop 2024-08-18T22:06:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.504+0000 7f1cadda0640 1 -- 172.21.15.123:0/182851873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ca8100f70 msgr2=0x7f1ca81980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.504+0000 7f1cadda0640 1 --2- 172.21.15.123:0/182851873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ca8100f70 0x7f1ca81980e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800d950 tx=0x7f1c9800de10 comp rx=0 tx=0).stop 2024-08-18T22:06:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.504+0000 7f1ca7fff640 1 -- 172.21.15.123:0/182851873 reap_dead start 2024-08-18T22:06:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.505+0000 7f1cadda0640 1 -- 172.21.15.123:0/182851873 shutdown_connections 2024-08-18T22:06:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.505+0000 7f1cadda0640 1 -- 172.21.15.123:0/182851873 >> 172.21.15.123:0/182851873 conn(0x7f1ca8076f40 msgr2=0x7f1ca80fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.505+0000 7f1cadda0640 1 -- 172.21.15.123:0/182851873 shutdown_connections 2024-08-18T22:06:44.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:44.505+0000 7f1cadda0640 1 -- 172.21.15.123:0/182851873 wait complete. 2024-08-18T22:06:44.624 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:44 smithi123 ceph-mon[18462]: pgmap v307: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:06:44.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:44 smithi130 ceph-mon[21698]: pgmap v307: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:06:44.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:44 smithi183 ceph-mon[22097]: pgmap v307: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:06:44.995 INFO:teuthology.orchestra.run.smithi123.stdout:55834574922 2024-08-18T22:06:44.995 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-18T22:06:45.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.542+0000 7f8fb06e8640 1 -- 172.21.15.123:0/743209409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fa8102b00 msgr2=0x7f8fa8102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:45.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.542+0000 7f8fb06e8640 1 --2- 172.21.15.123:0/743209409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fa8102b00 0x7f8fa8102ee0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009930 tx=0x7f8fa402a420 comp rx=0 tx=0).stop 2024-08-18T22:06:45.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.542+0000 7f8fb06e8640 1 -- 172.21.15.123:0/743209409 shutdown_connections 2024-08-18T22:06:45.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.542+0000 7f8fb06e8640 1 --2- 172.21.15.123:0/743209409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fa8108030 0x7f8fa810e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:45.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.542+0000 7f8fb06e8640 1 --2- 172.21.15.123:0/743209409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fa81034b0 0x7f8fa81078f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:45.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.542+0000 7f8fb06e8640 1 --2- 172.21.15.123:0/743209409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fa8102b00 0x7f8fa8102ee0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:45.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.542+0000 7f8fb06e8640 1 -- 172.21.15.123:0/743209409 >> 172.21.15.123:0/743209409 conn(0x7f8fa80fc500 msgr2=0x7f8fa80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:45.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.542+0000 7f8fb06e8640 1 -- 172.21.15.123:0/743209409 shutdown_connections 2024-08-18T22:06:45.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.542+0000 7f8fb06e8640 1 -- 172.21.15.123:0/743209409 wait complete. 2024-08-18T22:06:45.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.543+0000 7f8fb06e8640 1 Processor -- start 2024-08-18T22:06:45.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.543+0000 7f8fb06e8640 1 -- start start 2024-08-18T22:06:45.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.543+0000 7f8fb06e8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fa8102b00 0x7f8fa8198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:45.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.543+0000 7f8fb06e8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fa81034b0 0x7f8fa81987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:45.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.543+0000 7f8fb06e8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fa8108030 0x7f8fa819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:45.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.543+0000 7f8fb06e8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa8111e00 con 0x7f8fa8108030 2024-08-18T22:06:45.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.543+0000 7f8fb06e8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa8111c80 con 0x7f8fa81034b0 2024-08-18T22:06:45.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.543+0000 7f8fb06e8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa8111f80 con 0x7f8fa8102b00 2024-08-18T22:06:45.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.543+0000 7f8faec85640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fa8108030 0x7f8fa819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:45.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.543+0000 7f8faec85640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fa8108030 0x7f8fa819cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42526/0 (socket says 172.21.15.123:42526) 2024-08-18T22:06:45.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.543+0000 7f8faec85640 1 -- 172.21.15.123:0/1361862597 learned_addr learned my addr 172.21.15.123:0/1361862597 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:45.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.543+0000 7f8fae484640 1 --2- 172.21.15.123:0/1361862597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fa8102b00 0x7f8fa8198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.543+0000 7f8fadc83640 1 --2- 172.21.15.123:0/1361862597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fa81034b0 0x7f8fa81987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.544+0000 7f8faec85640 1 -- 172.21.15.123:0/1361862597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fa8102b00 msgr2=0x7f8fa8198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.544+0000 7f8faec85640 1 --2- 172.21.15.123:0/1361862597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fa8102b00 0x7f8fa8198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.544+0000 7f8faec85640 1 -- 172.21.15.123:0/1361862597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fa81034b0 msgr2=0x7f8fa81987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.544+0000 7f8faec85640 1 --2- 172.21.15.123:0/1361862597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fa81034b0 0x7f8fa81987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.544+0000 7f8faec85640 1 -- 172.21.15.123:0/1361862597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa819d240 con 0x7f8fa8108030 2024-08-18T22:06:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.544+0000 7f8fadc83640 1 --2- 172.21.15.123:0/1361862597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fa81034b0 0x7f8fa81987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:06:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.544+0000 7f8faec85640 1 --2- 172.21.15.123:0/1361862597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fa8108030 0x7f8fa819cb60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000cad0 tx=0x7f8fa000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.544+0000 7f8f9f7fe640 1 -- 172.21.15.123:0/1361862597 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000ae20 con 0x7f8fa8108030 2024-08-18T22:06:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.544+0000 7f8f9f7fe640 1 -- 172.21.15.123:0/1361862597 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fa0005020 con 0x7f8fa8108030 2024-08-18T22:06:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.544+0000 7f8f9f7fe640 1 -- 172.21.15.123:0/1361862597 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000f6f0 con 0x7f8fa8108030 2024-08-18T22:06:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.544+0000 7f8fb06e8640 1 -- 172.21.15.123:0/1361862597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa819d530 con 0x7f8fa8108030 2024-08-18T22:06:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.544+0000 7f8fb06e8640 1 -- 172.21.15.123:0/1361862597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa81a4e10 con 0x7f8fa8108030 2024-08-18T22:06:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.545+0000 7f8fb06e8640 1 -- 172.21.15.123:0/1361862597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8fa80626b0 con 0x7f8fa8108030 2024-08-18T22:06:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.546+0000 7f8f9f7fe640 1 -- 172.21.15.123:0/1361862597 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f8fa00051d0 con 0x7f8fa8108030 2024-08-18T22:06:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.547+0000 7f8f9f7fe640 1 --2- 172.21.15.123:0/1361862597 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f940a2c10 0x7f8f940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.547+0000 7f8fae484640 1 --2- 172.21.15.123:0/1361862597 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f940a2c10 0x7f8f940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.547+0000 7f8f9f7fe640 1 -- 172.21.15.123:0/1361862597 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f8fa00cf920 con 0x7f8fa8108030 2024-08-18T22:06:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.547+0000 7f8f9f7fe640 1 --2- 172.21.15.123:0/1361862597 >> [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724] conn(0x7f8f940adde0 0x7f8f940b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.547+0000 7f8f9f7fe640 1 -- 172.21.15.123:0/1361862597 --> [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f940b0950 con 0x7f8f940adde0 2024-08-18T22:06:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.547+0000 7f8f9f7fe640 1 -- 172.21.15.123:0/1361862597 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f8fa00cfd70 con 0x7f8fa8108030 2024-08-18T22:06:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.547+0000 7f8fadc83640 1 --2- 172.21.15.123:0/1361862597 >> [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724] conn(0x7f8f940adde0 0x7f8f940b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.547+0000 7f8fae484640 1 --2- 172.21.15.123:0/1361862597 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f940a2c10 0x7f8f940a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009900 tx=0x7f8fa40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.548+0000 7f8fadc83640 1 --2- 172.21.15.123:0/1361862597 >> [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724] conn(0x7f8f940adde0 0x7f8f940b0280 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.549+0000 7f8f9f7fe640 1 -- 172.21.15.123:0/1361862597 <== osd.11 v2:172.21.15.183:6824/739766724 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f940b0950 con 0x7f8f940adde0 2024-08-18T22:06:45.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.562+0000 7f8fb06e8640 1 -- 172.21.15.123:0/1361862597 --> [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8fa8062ab0 con 0x7f8f940adde0 2024-08-18T22:06:45.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.563+0000 7f8f9f7fe640 1 -- 172.21.15.123:0/1361862597 <== osd.11 v2:172.21.15.183:6824/739766724 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8fa8062ab0 con 0x7f8f940adde0 2024-08-18T22:06:45.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.563+0000 7f8fb06e8640 1 -- 172.21.15.123:0/1361862597 >> [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724] conn(0x7f8f940adde0 msgr2=0x7f8f940b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:45.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.563+0000 7f8fb06e8640 1 --2- 172.21.15.123:0/1361862597 >> [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724] conn(0x7f8f940adde0 0x7f8f940b0280 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:45.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.563+0000 7f8fb06e8640 1 -- 172.21.15.123:0/1361862597 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f940a2c10 msgr2=0x7f8f940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:45.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.563+0000 7f8fb06e8640 1 --2- 172.21.15.123:0/1361862597 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f940a2c10 0x7f8f940a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009900 tx=0x7f8fa40058d0 comp rx=0 tx=0).stop 2024-08-18T22:06:45.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.563+0000 7f8fb06e8640 1 -- 172.21.15.123:0/1361862597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fa8108030 msgr2=0x7f8fa819cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:45.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.563+0000 7f8fb06e8640 1 --2- 172.21.15.123:0/1361862597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fa8108030 0x7f8fa819cb60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000cad0 tx=0x7f8fa000cf90 comp rx=0 tx=0).stop 2024-08-18T22:06:45.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.563+0000 7f8faec85640 1 -- 172.21.15.123:0/1361862597 reap_dead start 2024-08-18T22:06:45.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.563+0000 7f8fb06e8640 1 -- 172.21.15.123:0/1361862597 shutdown_connections 2024-08-18T22:06:45.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.563+0000 7f8fb06e8640 1 -- 172.21.15.123:0/1361862597 >> 172.21.15.123:0/1361862597 conn(0x7f8fa80fc500 msgr2=0x7f8fa8105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:45.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.563+0000 7f8fb06e8640 1 -- 172.21.15.123:0/1361862597 shutdown_connections 2024-08-18T22:06:45.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:45.563+0000 7f8fb06e8640 1 -- 172.21.15.123:0/1361862597 wait complete. 2024-08-18T22:06:46.245 INFO:teuthology.orchestra.run.smithi123.stdout:326417514524 2024-08-18T22:06:46.245 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-08-18T22:06:46.698 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:46 smithi123 ceph-mon[18462]: pgmap v308: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:06:46.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:46 smithi130 ceph-mon[21698]: pgmap v308: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:06:46.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:46 smithi183 ceph-mon[22097]: pgmap v308: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:06:47.053 INFO:teuthology.orchestra.run.smithi123.stdout:137438953534 2024-08-18T22:06:47.053 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-18T22:06:47.520 INFO:teuthology.orchestra.run.smithi123.stdout:34359738446 2024-08-18T22:06:47.520 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-18T22:06:47.951 INFO:teuthology.orchestra.run.smithi123.stdout:296352743458 2024-08-18T22:06:47.952 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-08-18T22:06:48.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.312+0000 7f0029718640 1 -- 172.21.15.123:0/125303716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0024100b50 msgr2=0x7f0024100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:48.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.312+0000 7f0029718640 1 --2- 172.21.15.123:0/125303716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0024100b50 0x7f0024100f30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0014009900 tx=0x7f001402a480 comp rx=0 tx=0).stop 2024-08-18T22:06:48.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.312+0000 7f0029718640 1 -- 172.21.15.123:0/125303716 shutdown_connections 2024-08-18T22:06:48.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.312+0000 7f0029718640 1 --2- 172.21.15.123:0/125303716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0024102c20 0x7f002410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:48.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.312+0000 7f0029718640 1 --2- 172.21.15.123:0/125303716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00241022a0 0x7f00241026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:48.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.312+0000 7f0029718640 1 --2- 172.21.15.123:0/125303716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0024100b50 0x7f0024100f30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:48.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.312+0000 7f0029718640 1 -- 172.21.15.123:0/125303716 >> 172.21.15.123:0/125303716 conn(0x7f00240fc500 msgr2=0x7f00240fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:48.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.312+0000 7f0029718640 1 -- 172.21.15.123:0/125303716 shutdown_connections 2024-08-18T22:06:48.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.312+0000 7f0029718640 1 -- 172.21.15.123:0/125303716 wait complete. 2024-08-18T22:06:48.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.312+0000 7f0029718640 1 Processor -- start 2024-08-18T22:06:48.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f0029718640 1 -- start start 2024-08-18T22:06:48.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f0029718640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0024100b50 0x7f00241990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:48.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f0029718640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00241022a0 0x7f0024199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:48.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f0029718640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0024102c20 0x7f00241a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:48.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f0029718640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0024110cd0 con 0x7f0024102c20 2024-08-18T22:06:48.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f0029718640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0024110b50 con 0x7f0024100b50 2024-08-18T22:06:48.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f0029718640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0024110e50 con 0x7f00241022a0 2024-08-18T22:06:48.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f00237fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0024102c20 0x7f00241a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:48.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f00237fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0024102c20 0x7f00241a4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42540/0 (socket says 172.21.15.123:42540) 2024-08-18T22:06:48.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f00237fe640 1 -- 172.21.15.123:0/406313145 learned_addr learned my addr 172.21.15.123:0/406313145 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:48.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f0022ffd640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0024100b50 0x7f00241990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:48.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f00227fc640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00241022a0 0x7f0024199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:48.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f00237fe640 1 -- 172.21.15.123:0/406313145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00241022a0 msgr2=0x7f0024199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:48.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f00237fe640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00241022a0 0x7f0024199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:48.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f00237fe640 1 -- 172.21.15.123:0/406313145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0024100b50 msgr2=0x7f00241990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:48.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f00237fe640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0024100b50 0x7f00241990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:48.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f00237fe640 1 -- 172.21.15.123:0/406313145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00241a4680 con 0x7f0024102c20 2024-08-18T22:06:48.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f0022ffd640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0024100b50 0x7f00241990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:48.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.313+0000 7f00227fc640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00241022a0 0x7f0024199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:48.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.314+0000 7f00237fe640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0024102c20 0x7f00241a4140 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f001c00b970 tx=0x7f001c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:48.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.314+0000 7f000bfff640 1 -- 172.21.15.123:0/406313145 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c019070 con 0x7f0024102c20 2024-08-18T22:06:48.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.314+0000 7f0029718640 1 -- 172.21.15.123:0/406313145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00241a4850 con 0x7f0024102c20 2024-08-18T22:06:48.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.314+0000 7f000bfff640 1 -- 172.21.15.123:0/406313145 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f001c00cb40 con 0x7f0024102c20 2024-08-18T22:06:48.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.314+0000 7f000bfff640 1 -- 172.21.15.123:0/406313145 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c007650 con 0x7f0024102c20 2024-08-18T22:06:48.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.314+0000 7f0029718640 1 -- 172.21.15.123:0/406313145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00241a4d60 con 0x7f0024102c20 2024-08-18T22:06:48.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.315+0000 7f0029718640 1 -- 172.21.15.123:0/406313145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00240626b0 con 0x7f0024102c20 2024-08-18T22:06:48.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.316+0000 7f000bfff640 1 -- 172.21.15.123:0/406313145 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f001c01c070 con 0x7f0024102c20 2024-08-18T22:06:48.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.316+0000 7f000bfff640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f000c0a2c10 0x7f000c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:48.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.317+0000 7f0022ffd640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f000c0a2c10 0x7f000c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:48.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.317+0000 7f000bfff640 1 -- 172.21.15.123:0/406313145 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f001c0cf2c0 con 0x7f0024102c20 2024-08-18T22:06:48.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.317+0000 7f000bfff640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594] conn(0x7f000c0adde0 0x7f000c0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:48.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.317+0000 7f000bfff640 1 -- 172.21.15.123:0/406313145 --> [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f001c0047d0 con 0x7f000c0adde0 2024-08-18T22:06:48.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.317+0000 7f000bfff640 1 -- 172.21.15.123:0/406313145 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f001c0cf710 con 0x7f0024102c20 2024-08-18T22:06:48.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.317+0000 7f0022ffd640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f000c0a2c10 0x7f000c0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0014005ab0 tx=0x7f0014005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:48.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.317+0000 7f00227fc640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594] conn(0x7f000c0adde0 0x7f000c0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:48.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.317+0000 7f00227fc640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594] conn(0x7f000c0adde0 0x7f000c0b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:48.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.318+0000 7f000bfff640 1 -- 172.21.15.123:0/406313145 <== osd.8 v2:172.21.15.183:6816/1180542594 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f001c0047d0 con 0x7f000c0adde0 2024-08-18T22:06:48.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.333+0000 7f0029718640 1 -- 172.21.15.123:0/406313145 --> [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0024062b30 con 0x7f000c0adde0 2024-08-18T22:06:48.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.336+0000 7f000bfff640 1 -- 172.21.15.123:0/406313145 <== osd.8 v2:172.21.15.183:6816/1180542594 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0024062b30 con 0x7f000c0adde0 2024-08-18T22:06:48.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.338+0000 7f0029718640 1 -- 172.21.15.123:0/406313145 >> [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594] conn(0x7f000c0adde0 msgr2=0x7f000c0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:48.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.338+0000 7f0029718640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594] conn(0x7f000c0adde0 0x7f000c0b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:48.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.339+0000 7f0029718640 1 -- 172.21.15.123:0/406313145 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f000c0a2c10 msgr2=0x7f000c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:48.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.339+0000 7f0029718640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f000c0a2c10 0x7f000c0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0014005ab0 tx=0x7f0014005a20 comp rx=0 tx=0).stop 2024-08-18T22:06:48.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.340+0000 7f0029718640 1 -- 172.21.15.123:0/406313145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0024102c20 msgr2=0x7f00241a4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:48.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.340+0000 7f0029718640 1 --2- 172.21.15.123:0/406313145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0024102c20 0x7f00241a4140 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f001c00b970 tx=0x7f001c00be30 comp rx=0 tx=0).stop 2024-08-18T22:06:48.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.340+0000 7f00237fe640 1 -- 172.21.15.123:0/406313145 reap_dead start 2024-08-18T22:06:48.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.341+0000 7f0029718640 1 -- 172.21.15.123:0/406313145 shutdown_connections 2024-08-18T22:06:48.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.341+0000 7f0029718640 1 -- 172.21.15.123:0/406313145 >> 172.21.15.123:0/406313145 conn(0x7f00240fc500 msgr2=0x7f00240fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:48.347 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:48.347 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:48.347 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:48.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.346+0000 7f0029718640 1 -- 172.21.15.123:0/406313145 shutdown_connections 2024-08-18T22:06:48.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:48.349+0000 7f0029718640 1 -- 172.21.15.123:0/406313145 wait complete. 2024-08-18T22:06:48.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:48 smithi123 ceph-mon[18462]: pgmap v309: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:06:48.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:48 smithi130 ceph-mon[21698]: pgmap v309: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:06:48.861 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:48.861 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:48.862 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:48.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:48 smithi183 ceph-mon[22097]: pgmap v309: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:06:49.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.398+0000 7ff8e63b2640 1 -- 172.21.15.123:0/2287237542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8e01022a0 msgr2=0x7ff8e01026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.398+0000 7ff8e63b2640 1 --2- 172.21.15.123:0/2287237542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8e01022a0 0x7ff8e01026e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009900 tx=0x7ff8d402a480 comp rx=0 tx=0).stop 2024-08-18T22:06:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.398+0000 7ff8e63b2640 1 -- 172.21.15.123:0/2287237542 shutdown_connections 2024-08-18T22:06:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.398+0000 7ff8e63b2640 1 --2- 172.21.15.123:0/2287237542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8e0102c20 0x7ff8e010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.398+0000 7ff8e63b2640 1 --2- 172.21.15.123:0/2287237542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8e01022a0 0x7ff8e01026e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.398+0000 7ff8e63b2640 1 --2- 172.21.15.123:0/2287237542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8e0100b50 0x7ff8e0100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.398+0000 7ff8e63b2640 1 -- 172.21.15.123:0/2287237542 >> 172.21.15.123:0/2287237542 conn(0x7ff8e00fc500 msgr2=0x7ff8e00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.398+0000 7ff8e63b2640 1 -- 172.21.15.123:0/2287237542 shutdown_connections 2024-08-18T22:06:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.398+0000 7ff8e63b2640 1 -- 172.21.15.123:0/2287237542 wait complete. 2024-08-18T22:06:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8e63b2640 1 Processor -- start 2024-08-18T22:06:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8e63b2640 1 -- start start 2024-08-18T22:06:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8e63b2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8e0100b50 0x7ff8e01990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:49.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8e63b2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8e01022a0 0x7ff8e0199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:49.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8e63b2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8e0102c20 0x7ff8e01a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:49.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8e63b2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e0110cb0 con 0x7ff8e01022a0 2024-08-18T22:06:49.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8e63b2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e0110b30 con 0x7ff8e0100b50 2024-08-18T22:06:49.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8e63b2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e0110e30 con 0x7ff8e0102c20 2024-08-18T22:06:49.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8df7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8e01022a0 0x7ff8e0199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:49.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8df7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8e01022a0 0x7ff8e0199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42554/0 (socket says 172.21.15.123:42554) 2024-08-18T22:06:49.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8df7fe640 1 -- 172.21.15.123:0/1224599524 learned_addr learned my addr 172.21.15.123:0/1224599524 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:49.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8dffff640 1 --2- 172.21.15.123:0/1224599524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8e0100b50 0x7ff8e01990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:49.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8e494f640 1 --2- 172.21.15.123:0/1224599524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8e0102c20 0x7ff8e01a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:49.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8df7fe640 1 -- 172.21.15.123:0/1224599524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8e0102c20 msgr2=0x7ff8e01a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:49.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8df7fe640 1 --2- 172.21.15.123:0/1224599524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8e0102c20 0x7ff8e01a4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8df7fe640 1 -- 172.21.15.123:0/1224599524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8e0100b50 msgr2=0x7ff8e01990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:49.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8df7fe640 1 --2- 172.21.15.123:0/1224599524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8e0100b50 0x7ff8e01990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8df7fe640 1 -- 172.21.15.123:0/1224599524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e01a4680 con 0x7ff8e01022a0 2024-08-18T22:06:49.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.399+0000 7ff8dffff640 1 --2- 172.21.15.123:0/1224599524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8e0100b50 0x7ff8e01990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:49.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.400+0000 7ff8df7fe640 1 --2- 172.21.15.123:0/1224599524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8e01022a0 0x7ff8e0199600 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4006010 tx=0x7ff8d4003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:49.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.400+0000 7ff8dd7fa640 1 -- 172.21.15.123:0/1224599524 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d403f070 con 0x7ff8e01022a0 2024-08-18T22:06:49.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.400+0000 7ff8e63b2640 1 -- 172.21.15.123:0/1224599524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e01a4850 con 0x7ff8e01022a0 2024-08-18T22:06:49.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.400+0000 7ff8dd7fa640 1 -- 172.21.15.123:0/1224599524 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8d4031e30 con 0x7ff8e01022a0 2024-08-18T22:06:49.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.400+0000 7ff8dd7fa640 1 -- 172.21.15.123:0/1224599524 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4035030 con 0x7ff8e01022a0 2024-08-18T22:06:49.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.400+0000 7ff8e63b2640 1 -- 172.21.15.123:0/1224599524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e01a4d00 con 0x7ff8e01022a0 2024-08-18T22:06:49.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.402+0000 7ff8e63b2640 1 -- 172.21.15.123:0/1224599524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e0100f30 con 0x7ff8e01022a0 2024-08-18T22:06:49.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.402+0000 7ff8dd7fa640 1 -- 172.21.15.123:0/1224599524 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff8d4042070 con 0x7ff8e01022a0 2024-08-18T22:06:49.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.403+0000 7ff8dd7fa640 1 --2- 172.21.15.123:0/1224599524 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff8c80a2c10 0x7ff8c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:49.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.403+0000 7ff8dffff640 1 --2- 172.21.15.123:0/1224599524 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff8c80a2c10 0x7ff8c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:49.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.403+0000 7ff8dd7fa640 1 -- 172.21.15.123:0/1224599524 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7ff8d40eff30 con 0x7ff8e01022a0 2024-08-18T22:06:49.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.403+0000 7ff8dffff640 1 --2- 172.21.15.123:0/1224599524 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff8c80a2c10 0x7ff8c80a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0005fd0 tx=0x7ff8d0005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:49.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.407+0000 7ff8dd7fa640 1 -- 172.21.15.123:0/1224599524 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff8d40bc9d0 con 0x7ff8e01022a0 2024-08-18T22:06:49.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.296+0000 7f88df70a640 1 -- 172.21.15.123:0/3204981399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88d81052e0 msgr2=0x7f88d810ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:49.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.296+0000 7f88df70a640 1 --2- 172.21.15.123:0/3204981399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88d81052e0 0x7f88d810ce60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f88d000aa10 tx=0x7f88d002b720 comp rx=0 tx=0).stop 2024-08-18T22:06:49.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.296+0000 7f88df70a640 1 -- 172.21.15.123:0/3204981399 shutdown_connections 2024-08-18T22:06:49.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.296+0000 7f88df70a640 1 --2- 172.21.15.123:0/3204981399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88d81052e0 0x7f88d810ce60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.296+0000 7f88df70a640 1 --2- 172.21.15.123:0/3204981399 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88d8100b60 0x7f88d8104bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.296+0000 7f88df70a640 1 --2- 172.21.15.123:0/3204981399 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88d81001b0 0x7f88d8100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.296+0000 7f88df70a640 1 -- 172.21.15.123:0/3204981399 >> 172.21.15.123:0/3204981399 conn(0x7f88d8076f40 msgr2=0x7f88d80fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:49.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.296+0000 7f88df70a640 1 -- 172.21.15.123:0/3204981399 shutdown_connections 2024-08-18T22:06:49.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.296+0000 7f88df70a640 1 -- 172.21.15.123:0/3204981399 wait complete. 2024-08-18T22:06:49.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.296+0000 7f88df70a640 1 Processor -- start 2024-08-18T22:06:49.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.296+0000 7f88df70a640 1 -- start start 2024-08-18T22:06:49.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88df70a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88d81001b0 0x7f88d8195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:49.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88df70a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88d8100b60 0x7f88d81964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:49.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88df70a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88d81052e0 0x7f88d819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:49.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88df70a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f88d810fac0 con 0x7f88d81001b0 2024-08-18T22:06:49.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88df70a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f88d810f940 con 0x7f88d81052e0 2024-08-18T22:06:49.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88df70a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f88d810fc40 con 0x7f88d8100b60 2024-08-18T22:06:49.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88dd4a6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88d81001b0 0x7f88d8195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88dd4a6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88d81001b0 0x7f88d8195f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42548/0 (socket says 172.21.15.123:42548) 2024-08-18T22:06:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88dd4a6640 1 -- 172.21.15.123:0/3335513433 learned_addr learned my addr 172.21.15.123:0/3335513433 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88ddca7640 1 --2- 172.21.15.123:0/3335513433 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88d81052e0 0x7f88d819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88dd4a6640 1 -- 172.21.15.123:0/3335513433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88d8100b60 msgr2=0x7f88d81964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88dd4a6640 1 --2- 172.21.15.123:0/3335513433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88d8100b60 0x7f88d81964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88dd4a6640 1 -- 172.21.15.123:0/3335513433 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88d81052e0 msgr2=0x7f88d819a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88dd4a6640 1 --2- 172.21.15.123:0/3335513433 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88d81052e0 0x7f88d819a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88dd4a6640 1 -- 172.21.15.123:0/3335513433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d819af30 con 0x7f88d81001b0 2024-08-18T22:06:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88ddca7640 1 --2- 172.21.15.123:0/3335513433 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88d81052e0 0x7f88d819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88dd4a6640 1 --2- 172.21.15.123:0/3335513433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88d81001b0 0x7f88d8195f80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f88c800db80 tx=0x7f88c800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88d67fc640 1 -- 172.21.15.123:0/3335513433 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8017070 con 0x7f88d81001b0 2024-08-18T22:06:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88d67fc640 1 -- 172.21.15.123:0/3335513433 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88c8003b70 con 0x7f88d81001b0 2024-08-18T22:06:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88df70a640 1 -- 172.21.15.123:0/3335513433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d819b220 con 0x7f88d81001b0 2024-08-18T22:06:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88d67fc640 1 -- 172.21.15.123:0/3335513433 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c80106c0 con 0x7f88d81001b0 2024-08-18T22:06:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.297+0000 7f88df70a640 1 -- 172.21.15.123:0/3335513433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d81a2b00 con 0x7f88d81001b0 2024-08-18T22:06:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.298+0000 7f88df70a640 1 -- 172.21.15.123:0/3335513433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d8100590 con 0x7f88d81001b0 2024-08-18T22:06:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.299+0000 7f88d67fc640 1 -- 172.21.15.123:0/3335513433 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f88c8004020 con 0x7f88d81001b0 2024-08-18T22:06:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.300+0000 7f88d67fc640 1 --2- 172.21.15.123:0/3335513433 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f88c00a2c10 0x7f88c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.300+0000 7f88dcca5640 1 --2- 172.21.15.123:0/3335513433 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f88c00a2c10 0x7f88c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.300+0000 7f88d67fc640 1 -- 172.21.15.123:0/3335513433 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f88c80cf390 con 0x7f88d81001b0 2024-08-18T22:06:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.301+0000 7f88dcca5640 1 --2- 172.21.15.123:0/3335513433 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f88c00a2c10 0x7f88c00a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f88d8102a50 tx=0x7f88cc005b60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.304+0000 7f88d67fc640 1 -- 172.21.15.123:0/3335513433 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f88c8020070 con 0x7f88d81001b0 2024-08-18T22:06:49.562 INFO:teuthology.orchestra.run.smithi123.stdout:188978561078 2024-08-18T22:06:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.497+0000 7f88df70a640 1 -- 172.21.15.123:0/3335513433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f88d81972e0 con 0x7f88d81001b0 2024-08-18T22:06:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.498+0000 7f88d67fc640 1 -- 172.21.15.123:0/3335513433 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f88c809be30 con 0x7f88d81001b0 2024-08-18T22:06:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.499+0000 7f88df70a640 1 -- 172.21.15.123:0/3335513433 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f88c00a2c10 msgr2=0x7f88c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.499+0000 7f88df70a640 1 --2- 172.21.15.123:0/3335513433 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f88c00a2c10 0x7f88c00a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f88d8102a50 tx=0x7f88cc005b60 comp rx=0 tx=0).stop 2024-08-18T22:06:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.499+0000 7f88df70a640 1 -- 172.21.15.123:0/3335513433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88d81001b0 msgr2=0x7f88d8195f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.499+0000 7f88df70a640 1 --2- 172.21.15.123:0/3335513433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88d81001b0 0x7f88d8195f80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f88c800db80 tx=0x7f88c800b630 comp rx=0 tx=0).stop 2024-08-18T22:06:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.500+0000 7f88df70a640 1 -- 172.21.15.123:0/3335513433 shutdown_connections 2024-08-18T22:06:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.500+0000 7f88df70a640 1 --2- 172.21.15.123:0/3335513433 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f88c00a2c10 0x7f88c00a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.500+0000 7f88df70a640 1 --2- 172.21.15.123:0/3335513433 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88d81052e0 0x7f88d819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.500+0000 7f88df70a640 1 --2- 172.21.15.123:0/3335513433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88d8100b60 0x7f88d81964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.500+0000 7f88df70a640 1 --2- 172.21.15.123:0/3335513433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88d81001b0 0x7f88d8195f80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.500+0000 7f88df70a640 1 -- 172.21.15.123:0/3335513433 >> 172.21.15.123:0/3335513433 conn(0x7f88d8076f40 msgr2=0x7f88d8103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.500+0000 7f88df70a640 1 -- 172.21.15.123:0/3335513433 shutdown_connections 2024-08-18T22:06:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.500+0000 7f88df70a640 1 -- 172.21.15.123:0/3335513433 wait complete. 2024-08-18T22:06:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.589+0000 7ff8e63b2640 1 -- 172.21.15.123:0/1224599524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff8e0108dc0 con 0x7ff8e01022a0 2024-08-18T22:06:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.590+0000 7ff8dd7fa640 1 -- 172.21.15.123:0/1224599524 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff8d40bc2d0 con 0x7ff8e01022a0 2024-08-18T22:06:49.591 INFO:teuthology.orchestra.run.smithi123.stdout:210453397552 2024-08-18T22:06:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.591+0000 7ff8e63b2640 1 -- 172.21.15.123:0/1224599524 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff8c80a2c10 msgr2=0x7ff8c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.591+0000 7ff8e63b2640 1 --2- 172.21.15.123:0/1224599524 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff8c80a2c10 0x7ff8c80a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0005fd0 tx=0x7ff8d0005ea0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.592+0000 7ff8e63b2640 1 -- 172.21.15.123:0/1224599524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8e01022a0 msgr2=0x7ff8e0199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.592+0000 7ff8e63b2640 1 --2- 172.21.15.123:0/1224599524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8e01022a0 0x7ff8e0199600 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4006010 tx=0x7ff8d4003c80 comp rx=0 tx=0).stop 2024-08-18T22:06:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.592+0000 7ff8e63b2640 1 -- 172.21.15.123:0/1224599524 shutdown_connections 2024-08-18T22:06:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.592+0000 7ff8e63b2640 1 --2- 172.21.15.123:0/1224599524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8e0102c20 0x7ff8e01a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.592+0000 7ff8e63b2640 1 --2- 172.21.15.123:0/1224599524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8e01022a0 0x7ff8e0199600 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.592+0000 7ff8e63b2640 1 --2- 172.21.15.123:0/1224599524 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff8c80a2c10 0x7ff8c80a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.592+0000 7ff8e63b2640 1 --2- 172.21.15.123:0/1224599524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8e0100b50 0x7ff8e01990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.592+0000 7ff8e63b2640 1 -- 172.21.15.123:0/1224599524 >> 172.21.15.123:0/1224599524 conn(0x7ff8e00fc500 msgr2=0x7ff8e0105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.592+0000 7ff8e63b2640 1 -- 172.21.15.123:0/1224599524 shutdown_connections 2024-08-18T22:06:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:49.592+0000 7ff8e63b2640 1 -- 172.21.15.123:0/1224599524 wait complete. 2024-08-18T22:06:49.841 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:50.711 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:50 smithi183 ceph-mon[22097]: pgmap v310: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-08-18T22:06:50.711 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:50 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3335513433' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-08-18T22:06:50.711 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:50 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1224599524' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-08-18T22:06:50.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:50 smithi123 ceph-mon[18462]: pgmap v310: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-08-18T22:06:50.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:50 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3335513433' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-08-18T22:06:50.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:50 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1224599524' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-08-18T22:06:50.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:50 smithi130 ceph-mon[21698]: pgmap v310: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-08-18T22:06:50.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:50 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3335513433' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-08-18T22:06:50.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:50 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1224599524' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-08-18T22:06:51.017 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397551 got 210453397552 for osd.7 2024-08-18T22:06:51.017 DEBUG:teuthology.parallel:result is None 2024-08-18T22:06:51.695 INFO:teuthology.orchestra.run.smithi123.stdout:240518168621 2024-08-18T22:06:51.695 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-08-18T22:06:52.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.100+0000 7f3f653d2640 1 -- 172.21.15.123:0/2590902769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f60102250 msgr2=0x7f3f6010e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:52.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.100+0000 7f3f653d2640 1 --2- 172.21.15.123:0/2590902769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f60102250 0x7f3f6010e780 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009cd0 tx=0x7f3f5802a8e0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.100+0000 7f3f653d2640 1 -- 172.21.15.123:0/2590902769 shutdown_connections 2024-08-18T22:06:52.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.100+0000 7f3f653d2640 1 --2- 172.21.15.123:0/2590902769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f60102250 0x7f3f6010e780 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.100+0000 7f3f653d2640 1 --2- 172.21.15.123:0/2590902769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f601018b0 0x7f3f60101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.100+0000 7f3f653d2640 1 --2- 172.21.15.123:0/2590902769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f601078b0 0x7f3f60107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.100+0000 7f3f653d2640 1 -- 172.21.15.123:0/2590902769 >> 172.21.15.123:0/2590902769 conn(0x7f3f600fd5f0 msgr2=0x7f3f600ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:52.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.100+0000 7f3f653d2640 1 -- 172.21.15.123:0/2590902769 shutdown_connections 2024-08-18T22:06:52.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.100+0000 7f3f653d2640 1 -- 172.21.15.123:0/2590902769 wait complete. 2024-08-18T22:06:52.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f653d2640 1 Processor -- start 2024-08-18T22:06:52.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f653d2640 1 -- start start 2024-08-18T22:06:52.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f653d2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f601018b0 0x7f3f60198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f653d2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f60102250 0x7f3f601986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f653d2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f601078b0 0x7f3f6019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f653d2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3f60111cb0 con 0x7f3f60102250 2024-08-18T22:06:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f653d2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3f60111b30 con 0x7f3f601078b0 2024-08-18T22:06:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f653d2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3f60111e30 con 0x7f3f601018b0 2024-08-18T22:06:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f57fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f60102250 0x7f3f601986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f57fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f60102250 0x7f3f601986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42612/0 (socket says 172.21.15.123:42612) 2024-08-18T22:06:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f57fff640 1 -- 172.21.15.123:0/2126428710 learned_addr learned my addr 172.21.15.123:0/2126428710 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f5f7fe640 1 --2- 172.21.15.123:0/2126428710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f601078b0 0x7f3f6019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f5effd640 1 --2- 172.21.15.123:0/2126428710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f601018b0 0x7f3f60198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f57fff640 1 -- 172.21.15.123:0/2126428710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f601018b0 msgr2=0x7f3f60198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f57fff640 1 --2- 172.21.15.123:0/2126428710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f601018b0 0x7f3f60198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f57fff640 1 -- 172.21.15.123:0/2126428710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f601078b0 msgr2=0x7f3f6019ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f57fff640 1 --2- 172.21.15.123:0/2126428710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f601078b0 0x7f3f6019ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f57fff640 1 -- 172.21.15.123:0/2126428710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6019d120 con 0x7f3f60102250 2024-08-18T22:06:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f5f7fe640 1 --2- 172.21.15.123:0/2126428710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f601078b0 0x7f3f6019ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:06:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.101+0000 7f3f57fff640 1 --2- 172.21.15.123:0/2126428710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f60102250 0x7f3f601986b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800c890 tx=0x7f3f4800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.102+0000 7f3f5cff9640 1 -- 172.21.15.123:0/2126428710 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48004220 con 0x7f3f60102250 2024-08-18T22:06:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.102+0000 7f3f653d2640 1 -- 172.21.15.123:0/2126428710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6019d410 con 0x7f3f60102250 2024-08-18T22:06:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.102+0000 7f3f5cff9640 1 -- 172.21.15.123:0/2126428710 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f480043c0 con 0x7f3f60102250 2024-08-18T22:06:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.102+0000 7f3f5cff9640 1 -- 172.21.15.123:0/2126428710 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48004a00 con 0x7f3f60102250 2024-08-18T22:06:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.102+0000 7f3f653d2640 1 -- 172.21.15.123:0/2126428710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f601a4cf0 con 0x7f3f60102250 2024-08-18T22:06:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.103+0000 7f3f653d2640 1 -- 172.21.15.123:0/2126428710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f60101d10 con 0x7f3f60102250 2024-08-18T22:06:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.105+0000 7f3f5cff9640 1 -- 172.21.15.123:0/2126428710 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f3f480079b0 con 0x7f3f60102250 2024-08-18T22:06:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.105+0000 7f3f5cff9640 1 --2- 172.21.15.123:0/2126428710 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3f4c0a2c10 0x7f3f4c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.105+0000 7f3f5effd640 1 --2- 172.21.15.123:0/2126428710 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3f4c0a2c10 0x7f3f4c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.105+0000 7f3f5cff9640 1 -- 172.21.15.123:0/2126428710 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f3f480cf6c0 con 0x7f3f60102250 2024-08-18T22:06:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.106+0000 7f3f5effd640 1 --2- 172.21.15.123:0/2126428710 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3f4c0a2c10 0x7f3f4c0a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3f50005fd0 tx=0x7f3f5000b510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.108+0000 7f3f5cff9640 1 -- 172.21.15.123:0/2126428710 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3f48014030 con 0x7f3f60102250 2024-08-18T22:06:52.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.990+0000 7f58e5357640 1 -- 172.21.15.123:0/290897527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e0102250 msgr2=0x7f58e010e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:52.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.990+0000 7f58e5357640 1 --2- 172.21.15.123:0/290897527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e0102250 0x7f58e010e780 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009cd0 tx=0x7f58d802a8e0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.990+0000 7f58e5357640 1 -- 172.21.15.123:0/290897527 shutdown_connections 2024-08-18T22:06:52.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.990+0000 7f58e5357640 1 --2- 172.21.15.123:0/290897527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e0102250 0x7f58e010e780 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.990+0000 7f58e5357640 1 --2- 172.21.15.123:0/290897527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58e01018b0 0x7f58e0101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.990+0000 7f58e5357640 1 --2- 172.21.15.123:0/290897527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58e01078b0 0x7f58e0107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.990+0000 7f58e5357640 1 -- 172.21.15.123:0/290897527 >> 172.21.15.123:0/290897527 conn(0x7f58e00fd5f0 msgr2=0x7f58e00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:52.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.990+0000 7f58e5357640 1 -- 172.21.15.123:0/290897527 shutdown_connections 2024-08-18T22:06:52.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.990+0000 7f58e5357640 1 -- 172.21.15.123:0/290897527 wait complete. 2024-08-18T22:06:52.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.991+0000 7f58e5357640 1 Processor -- start 2024-08-18T22:06:52.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.991+0000 7f58e5357640 1 -- start start 2024-08-18T22:06:52.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.991+0000 7f58e5357640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58e01018b0 0x7f58e0198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:52.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.991+0000 7f58e5357640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58e0102250 0x7f58e01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:52.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.991+0000 7f58e5357640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e01078b0 0x7f58e019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:52.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.991+0000 7f58e5357640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0111cb0 con 0x7f58e01078b0 2024-08-18T22:06:52.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.991+0000 7f58e5357640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0111b30 con 0x7f58e01018b0 2024-08-18T22:06:52.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.991+0000 7f58e5357640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0111e30 con 0x7f58e0102250 2024-08-18T22:06:52.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.991+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e01078b0 0x7f58e019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:52.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.991+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e01078b0 0x7f58e019c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42580/0 (socket says 172.21.15.123:42580) 2024-08-18T22:06:52.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.991+0000 7f58df7fe640 1 -- 172.21.15.123:0/1844619866 learned_addr learned my addr 172.21.15.123:0/1844619866 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:52.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.991+0000 7f58de7fc640 1 --2- 172.21.15.123:0/1844619866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58e0102250 0x7f58e01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:52.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.991+0000 7f58deffd640 1 --2- 172.21.15.123:0/1844619866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58e01018b0 0x7f58e0198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:52.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.992+0000 7f58df7fe640 1 -- 172.21.15.123:0/1844619866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58e0102250 msgr2=0x7f58e01985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:52.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.992+0000 7f58df7fe640 1 --2- 172.21.15.123:0/1844619866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58e0102250 0x7f58e01985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.992+0000 7f58df7fe640 1 -- 172.21.15.123:0/1844619866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58e01018b0 msgr2=0x7f58e0198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:52.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.992+0000 7f58df7fe640 1 --2- 172.21.15.123:0/1844619866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58e01018b0 0x7f58e0198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.992+0000 7f58df7fe640 1 -- 172.21.15.123:0/1844619866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e019d020 con 0x7f58e01078b0 2024-08-18T22:06:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.992+0000 7f58deffd640 1 --2- 172.21.15.123:0/1844619866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58e01018b0 0x7f58e0198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:06:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.992+0000 7f58df7fe640 1 --2- 172.21.15.123:0/1844619866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e01078b0 0x7f58e019c940 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f58d8006010 tx=0x7f58d8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.992+0000 7f58c7fff640 1 -- 172.21.15.123:0/1844619866 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d8004450 con 0x7f58e01078b0 2024-08-18T22:06:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.992+0000 7f58c7fff640 1 -- 172.21.15.123:0/1844619866 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58d8003e10 con 0x7f58e01078b0 2024-08-18T22:06:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.992+0000 7f58e5357640 1 -- 172.21.15.123:0/1844619866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e019d2b0 con 0x7f58e01078b0 2024-08-18T22:06:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.992+0000 7f58c7fff640 1 -- 172.21.15.123:0/1844619866 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d80466e0 con 0x7f58e01078b0 2024-08-18T22:06:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.992+0000 7f58e5357640 1 -- 172.21.15.123:0/1844619866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e01a4bf0 con 0x7f58e01078b0 2024-08-18T22:06:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.993+0000 7f58e5357640 1 -- 172.21.15.123:0/1844619866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e0101d10 con 0x7f58e01078b0 2024-08-18T22:06:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.994+0000 7f58c7fff640 1 -- 172.21.15.123:0/1844619866 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f58d80305a0 con 0x7f58e01078b0 2024-08-18T22:06:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.995+0000 7f58c7fff640 1 --2- 172.21.15.123:0/1844619866 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58c80a2c10 0x7f58c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.995+0000 7f58deffd640 1 --2- 172.21.15.123:0/1844619866 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58c80a2c10 0x7f58c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.995+0000 7f58c7fff640 1 -- 172.21.15.123:0/1844619866 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f58d802e030 con 0x7f58e01078b0 2024-08-18T22:06:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.995+0000 7f58deffd640 1 --2- 172.21.15.123:0/1844619866 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58c80a2c10 0x7f58c80a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f58d000baa0 tx=0x7f58d0005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:52.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:51.999+0000 7f58c7fff640 1 -- 172.21.15.123:0/1844619866 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f58d804b060 con 0x7f58e01078b0 2024-08-18T22:06:52.242 INFO:teuthology.orchestra.run.smithi123.stdout:274877906984 2024-08-18T22:06:52.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.177+0000 7f58e5357640 1 -- 172.21.15.123:0/1844619866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f58e01a4e20 con 0x7f58e01078b0 2024-08-18T22:06:52.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.177+0000 7f58c7fff640 1 -- 172.21.15.123:0/1844619866 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f58d8039380 con 0x7f58e01078b0 2024-08-18T22:06:52.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.179+0000 7f58e5357640 1 -- 172.21.15.123:0/1844619866 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58c80a2c10 msgr2=0x7f58c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:52.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.179+0000 7f58e5357640 1 --2- 172.21.15.123:0/1844619866 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58c80a2c10 0x7f58c80a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f58d000baa0 tx=0x7f58d0005d20 comp rx=0 tx=0).stop 2024-08-18T22:06:52.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.179+0000 7f58e5357640 1 -- 172.21.15.123:0/1844619866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e01078b0 msgr2=0x7f58e019c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:52.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.179+0000 7f58e5357640 1 --2- 172.21.15.123:0/1844619866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e01078b0 0x7f58e019c940 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f58d8006010 tx=0x7f58d8003c20 comp rx=0 tx=0).stop 2024-08-18T22:06:52.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.179+0000 7f58e5357640 1 -- 172.21.15.123:0/1844619866 shutdown_connections 2024-08-18T22:06:52.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.179+0000 7f58e5357640 1 --2- 172.21.15.123:0/1844619866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e01078b0 0x7f58e019c940 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.179+0000 7f58e5357640 1 --2- 172.21.15.123:0/1844619866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58e0102250 0x7f58e01985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.179+0000 7f58e5357640 1 --2- 172.21.15.123:0/1844619866 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58c80a2c10 0x7f58c80a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.179+0000 7f58e5357640 1 --2- 172.21.15.123:0/1844619866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58e01018b0 0x7f58e0198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.179+0000 7f58e5357640 1 -- 172.21.15.123:0/1844619866 >> 172.21.15.123:0/1844619866 conn(0x7f58e00fd5f0 msgr2=0x7f58e00fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:52.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.179+0000 7f58e5357640 1 -- 172.21.15.123:0/1844619866 shutdown_connections 2024-08-18T22:06:52.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.180+0000 7f58e5357640 1 -- 172.21.15.123:0/1844619866 wait complete. 2024-08-18T22:06:52.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.285+0000 7f3f653d2640 1 -- 172.21.15.123:0/2126428710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3f601994d0 con 0x7f3f60102250 2024-08-18T22:06:52.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.285+0000 7f3f5cff9640 1 -- 172.21.15.123:0/2126428710 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3f601994d0 con 0x7f3f60102250 2024-08-18T22:06:52.286 INFO:teuthology.orchestra.run.smithi123.stdout:55834574924 2024-08-18T22:06:52.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.287+0000 7f3f653d2640 1 -- 172.21.15.123:0/2126428710 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3f4c0a2c10 msgr2=0x7f3f4c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:52.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.287+0000 7f3f653d2640 1 --2- 172.21.15.123:0/2126428710 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3f4c0a2c10 0x7f3f4c0a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3f50005fd0 tx=0x7f3f5000b510 comp rx=0 tx=0).stop 2024-08-18T22:06:52.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.287+0000 7f3f653d2640 1 -- 172.21.15.123:0/2126428710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f60102250 msgr2=0x7f3f601986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:52.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.287+0000 7f3f653d2640 1 --2- 172.21.15.123:0/2126428710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f60102250 0x7f3f601986b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800c890 tx=0x7f3f4800cd50 comp rx=0 tx=0).stop 2024-08-18T22:06:52.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.287+0000 7f3f653d2640 1 -- 172.21.15.123:0/2126428710 shutdown_connections 2024-08-18T22:06:52.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.287+0000 7f3f653d2640 1 --2- 172.21.15.123:0/2126428710 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3f4c0a2c10 0x7f3f4c0a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.287+0000 7f3f653d2640 1 --2- 172.21.15.123:0/2126428710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f601078b0 0x7f3f6019ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.287+0000 7f3f653d2640 1 --2- 172.21.15.123:0/2126428710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f60102250 0x7f3f601986b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.287+0000 7f3f653d2640 1 --2- 172.21.15.123:0/2126428710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f601018b0 0x7f3f60198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.287+0000 7f3f653d2640 1 -- 172.21.15.123:0/2126428710 >> 172.21.15.123:0/2126428710 conn(0x7f3f600fd5f0 msgr2=0x7f3f600fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:52.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.287+0000 7f3f653d2640 1 -- 172.21.15.123:0/2126428710 shutdown_connections 2024-08-18T22:06:52.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.287+0000 7f3f653d2640 1 -- 172.21.15.123:0/2126428710 wait complete. 2024-08-18T22:06:52.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:52 smithi123 ceph-mon[18462]: pgmap v311: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:06:52.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:52 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1844619866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-08-18T22:06:52.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:52 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2126428710' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-18T22:06:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:52 smithi130 ceph-mon[21698]: pgmap v311: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:06:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:52 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1844619866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-08-18T22:06:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:52 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2126428710' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-18T22:06:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.873+0000 7fc4d386b640 1 -- 172.21.15.123:0/239675463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4cc1067b0 msgr2=0x7fc4cc106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.873+0000 7fc4d386b640 1 --2- 172.21.15.123:0/239675463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4cc1067b0 0x7fc4cc106b90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009930 tx=0x7fc4c802a420 comp rx=0 tx=0).stop 2024-08-18T22:06:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.873+0000 7fc4d386b640 1 -- 172.21.15.123:0/239675463 shutdown_connections 2024-08-18T22:06:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.873+0000 7fc4d386b640 1 --2- 172.21.15.123:0/239675463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4cc101150 0x7fc4cc10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.873+0000 7fc4d386b640 1 --2- 172.21.15.123:0/239675463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4cc1007b0 0x7fc4cc100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.873+0000 7fc4d386b640 1 --2- 172.21.15.123:0/239675463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4cc1067b0 0x7fc4cc106b90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.873+0000 7fc4d386b640 1 -- 172.21.15.123:0/239675463 >> 172.21.15.123:0/239675463 conn(0x7fc4cc0fc4d0 msgr2=0x7fc4cc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.873+0000 7fc4d386b640 1 -- 172.21.15.123:0/239675463 shutdown_connections 2024-08-18T22:06:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.873+0000 7fc4d386b640 1 -- 172.21.15.123:0/239675463 wait complete. 2024-08-18T22:06:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.874+0000 7fc4d386b640 1 Processor -- start 2024-08-18T22:06:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.874+0000 7fc4d386b640 1 -- start start 2024-08-18T22:06:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.874+0000 7fc4d386b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4cc1007b0 0x7fc4cc1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.874+0000 7fc4d386b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4cc101150 0x7fc4cc197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.874+0000 7fc4d386b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4cc1067b0 0x7fc4cc19ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.874+0000 7fc4d386b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc110c50 con 0x7fc4cc1067b0 2024-08-18T22:06:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.874+0000 7fc4d386b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc110ad0 con 0x7fc4cc1007b0 2024-08-18T22:06:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.874+0000 7fc4d386b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc110dd0 con 0x7fc4cc101150 2024-08-18T22:06:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4d1e08640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4cc1067b0 0x7fc4cc19ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4d1e08640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4cc1067b0 0x7fc4cc19ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59628/0 (socket says 172.21.15.123:59628) 2024-08-18T22:06:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4d1e08640 1 -- 172.21.15.123:0/1903326662 learned_addr learned my addr 172.21.15.123:0/1903326662 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4d1607640 1 --2- 172.21.15.123:0/1903326662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4cc1007b0 0x7fc4cc1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4d0e06640 1 --2- 172.21.15.123:0/1903326662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4cc101150 0x7fc4cc197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4d1e08640 1 -- 172.21.15.123:0/1903326662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4cc101150 msgr2=0x7fc4cc197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4d1e08640 1 --2- 172.21.15.123:0/1903326662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4cc101150 0x7fc4cc197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4d1e08640 1 -- 172.21.15.123:0/1903326662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4cc1007b0 msgr2=0x7fc4cc1971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4d1e08640 1 --2- 172.21.15.123:0/1903326662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4cc1007b0 0x7fc4cc1971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4d1e08640 1 -- 172.21.15.123:0/1903326662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4cc19c170 con 0x7fc4cc1067b0 2024-08-18T22:06:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4d1e08640 1 --2- 172.21.15.123:0/1903326662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4cc1067b0 0x7fc4cc19ba90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400b970 tx=0x7fc4c400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4c27fc640 1 -- 172.21.15.123:0/1903326662 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4019070 con 0x7fc4cc1067b0 2024-08-18T22:06:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4d386b640 1 -- 172.21.15.123:0/1903326662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4cc19c460 con 0x7fc4cc1067b0 2024-08-18T22:06:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4c27fc640 1 -- 172.21.15.123:0/1903326662 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4c400cb40 con 0x7fc4cc1067b0 2024-08-18T22:06:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4c27fc640 1 -- 172.21.15.123:0/1903326662 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4007650 con 0x7fc4cc1067b0 2024-08-18T22:06:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.875+0000 7fc4d386b640 1 -- 172.21.15.123:0/1903326662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4cc1a3d40 con 0x7fc4cc1067b0 2024-08-18T22:06:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.877+0000 7fc4d386b640 1 -- 172.21.15.123:0/1903326662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4cc100c90 con 0x7fc4cc1067b0 2024-08-18T22:06:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.878+0000 7fc4c27fc640 1 -- 172.21.15.123:0/1903326662 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc4c401c070 con 0x7fc4cc1067b0 2024-08-18T22:06:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.879+0000 7fc4c27fc640 1 --2- 172.21.15.123:0/1903326662 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc4b80a2c10 0x7fc4b80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.879+0000 7fc4d1607640 1 --2- 172.21.15.123:0/1903326662 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc4b80a2c10 0x7fc4b80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.879+0000 7fc4c27fc640 1 -- 172.21.15.123:0/1903326662 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fc4c40cef20 con 0x7fc4cc1067b0 2024-08-18T22:06:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.879+0000 7fc4d1607640 1 --2- 172.21.15.123:0/1903326662 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc4b80a2c10 0x7fc4b80a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80096c0 tx=0x7fc4c8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:52.882+0000 7fc4c27fc640 1 -- 172.21.15.123:0/1903326662 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fc4c409bad0 con 0x7fc4cc1067b0 2024-08-18T22:06:52.908 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:52 smithi183 ceph-mon[22097]: pgmap v311: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:06:52.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:52 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1844619866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-08-18T22:06:52.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:52 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2126428710' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-18T22:06:53.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:53.054+0000 7fc4d386b640 1 -- 172.21.15.123:0/1903326662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fc4cc108790 con 0x7fc4cc1067b0 2024-08-18T22:06:53.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:53.054+0000 7fc4c27fc640 1 -- 172.21.15.123:0/1903326662 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc4c409b3d0 con 0x7fc4cc1067b0 2024-08-18T22:06:53.055 INFO:teuthology.orchestra.run.smithi123.stdout:326417514525 2024-08-18T22:06:53.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:53.056+0000 7fc4d386b640 1 -- 172.21.15.123:0/1903326662 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc4b80a2c10 msgr2=0x7fc4b80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:53.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:53.056+0000 7fc4d386b640 1 --2- 172.21.15.123:0/1903326662 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc4b80a2c10 0x7fc4b80a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80096c0 tx=0x7fc4c8000bc0 comp rx=0 tx=0).stop 2024-08-18T22:06:53.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:53.056+0000 7fc4d386b640 1 -- 172.21.15.123:0/1903326662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4cc1067b0 msgr2=0x7fc4cc19ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:53.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:53.056+0000 7fc4d386b640 1 --2- 172.21.15.123:0/1903326662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4cc1067b0 0x7fc4cc19ba90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400b970 tx=0x7fc4c400be30 comp rx=0 tx=0).stop 2024-08-18T22:06:53.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:53.056+0000 7fc4d386b640 1 -- 172.21.15.123:0/1903326662 shutdown_connections 2024-08-18T22:06:53.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:53.056+0000 7fc4d386b640 1 --2- 172.21.15.123:0/1903326662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4cc1067b0 0x7fc4cc19ba90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:53.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:53.056+0000 7fc4d386b640 1 --2- 172.21.15.123:0/1903326662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4cc101150 0x7fc4cc197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:53.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:53.056+0000 7fc4d386b640 1 --2- 172.21.15.123:0/1903326662 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc4b80a2c10 0x7fc4b80a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:53.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:53.056+0000 7fc4d386b640 1 --2- 172.21.15.123:0/1903326662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4cc1007b0 0x7fc4cc1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:53.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:53.056+0000 7fc4d386b640 1 -- 172.21.15.123:0/1903326662 >> 172.21.15.123:0/1903326662 conn(0x7fc4cc0fc4d0 msgr2=0x7fc4cc0fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:53.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:53.056+0000 7fc4d386b640 1 -- 172.21.15.123:0/1903326662 shutdown_connections 2024-08-18T22:06:53.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:53.056+0000 7fc4d386b640 1 -- 172.21.15.123:0/1903326662 wait complete. 2024-08-18T22:06:53.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:53 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1903326662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-08-18T22:06:53.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:53 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1903326662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-08-18T22:06:53.807 INFO:tasks.cephadm.ceph_manager.ceph:need seq 326417514524 got 326417514525 for osd.11 2024-08-18T22:06:53.807 DEBUG:teuthology.parallel:result is None 2024-08-18T22:06:53.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:53 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1903326662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-08-18T22:06:54.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.074+0000 7fbf6972d640 1 -- 172.21.15.123:0/2014051468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf64100b50 msgr2=0x7fbf64100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.074+0000 7fbf6972d640 1 --2- 172.21.15.123:0/2014051468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf64100b50 0x7fbf64100f30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009ca0 tx=0x7fbf5402a950 comp rx=0 tx=0).stop 2024-08-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.074+0000 7fbf6972d640 1 -- 172.21.15.123:0/2014051468 shutdown_connections 2024-08-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.074+0000 7fbf6972d640 1 --2- 172.21.15.123:0/2014051468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf64102c20 0x7fbf6410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.074+0000 7fbf6972d640 1 --2- 172.21.15.123:0/2014051468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf641022a0 0x7fbf641026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.074+0000 7fbf6972d640 1 --2- 172.21.15.123:0/2014051468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf64100b50 0x7fbf64100f30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.074+0000 7fbf6972d640 1 -- 172.21.15.123:0/2014051468 >> 172.21.15.123:0/2014051468 conn(0x7fbf640fc500 msgr2=0x7fbf640fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.075+0000 7fbf6972d640 1 -- 172.21.15.123:0/2014051468 shutdown_connections 2024-08-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.075+0000 7fbf6972d640 1 -- 172.21.15.123:0/2014051468 wait complete. 2024-08-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.075+0000 7fbf6972d640 1 Processor -- start 2024-08-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf6972d640 1 -- start start 2024-08-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf6972d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf64100b50 0x7fbf64197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf6972d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf641022a0 0x7fbf64197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:54.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf6972d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf64102c20 0x7fbf6419bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:54.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf6972d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbf64110cd0 con 0x7fbf64100b50 2024-08-18T22:06:54.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf6972d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbf64110b50 con 0x7fbf641022a0 2024-08-18T22:06:54.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf6972d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbf64110e50 con 0x7fbf64102c20 2024-08-18T22:06:54.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf62ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf64100b50 0x7fbf64197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:54.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf62ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf64100b50 0x7fbf64197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59648/0 (socket says 172.21.15.123:59648) 2024-08-18T22:06:54.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf62ffd640 1 -- 172.21.15.123:0/2423872712 learned_addr learned my addr 172.21.15.123:0/2423872712 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:54.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf627fc640 1 --2- 172.21.15.123:0/2423872712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf641022a0 0x7fbf64197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:54.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf637fe640 1 --2- 172.21.15.123:0/2423872712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf64102c20 0x7fbf6419bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:54.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf62ffd640 1 -- 172.21.15.123:0/2423872712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf64102c20 msgr2=0x7fbf6419bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:54.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf62ffd640 1 --2- 172.21.15.123:0/2423872712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf64102c20 0x7fbf6419bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:54.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf62ffd640 1 -- 172.21.15.123:0/2423872712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf641022a0 msgr2=0x7fbf64197770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:54.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf62ffd640 1 --2- 172.21.15.123:0/2423872712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf641022a0 0x7fbf64197770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf62ffd640 1 -- 172.21.15.123:0/2423872712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6419c1e0 con 0x7fbf64100b50 2024-08-18T22:06:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.076+0000 7fbf637fe640 1 --2- 172.21.15.123:0/2423872712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf64102c20 0x7fbf6419bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:06:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.077+0000 7fbf62ffd640 1 --2- 172.21.15.123:0/2423872712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf64100b50 0x7fbf64197230 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbf54005cc0 tx=0x7fbf5402f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.077+0000 7fbf5bfff640 1 -- 172.21.15.123:0/2423872712 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54034040 con 0x7fbf64100b50 2024-08-18T22:06:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.077+0000 7fbf5bfff640 1 -- 172.21.15.123:0/2423872712 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf54030920 con 0x7fbf64100b50 2024-08-18T22:06:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.077+0000 7fbf6972d640 1 -- 172.21.15.123:0/2423872712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf6419c470 con 0x7fbf64100b50 2024-08-18T22:06:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.077+0000 7fbf5bfff640 1 -- 172.21.15.123:0/2423872712 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54045480 con 0x7fbf64100b50 2024-08-18T22:06:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.077+0000 7fbf6972d640 1 -- 172.21.15.123:0/2423872712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf641a3db0 con 0x7fbf64100b50 2024-08-18T22:06:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.078+0000 7fbf6972d640 1 -- 172.21.15.123:0/2423872712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf64101ee0 con 0x7fbf64100b50 2024-08-18T22:06:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.079+0000 7fbf5bfff640 1 -- 172.21.15.123:0/2423872712 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fbf54037020 con 0x7fbf64100b50 2024-08-18T22:06:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.079+0000 7fbf5bfff640 1 --2- 172.21.15.123:0/2423872712 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbf500a2c10 0x7fbf500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.080+0000 7fbf627fc640 1 --2- 172.21.15.123:0/2423872712 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbf500a2c10 0x7fbf500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.080+0000 7fbf5bfff640 1 -- 172.21.15.123:0/2423872712 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fbf540f0890 con 0x7fbf64100b50 2024-08-18T22:06:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.080+0000 7fbf627fc640 1 --2- 172.21.15.123:0/2423872712 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbf500a2c10 0x7fbf500a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbf640ffb80 tx=0x7fbf4c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.083+0000 7fbf5bfff640 1 -- 172.21.15.123:0/2423872712 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbf54080df0 con 0x7fbf64100b50 2024-08-18T22:06:54.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.256+0000 7fbf6972d640 1 -- 172.21.15.123:0/2423872712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbf64108dc0 con 0x7fbf64100b50 2024-08-18T22:06:54.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.256+0000 7fbf5bfff640 1 -- 172.21.15.123:0/2423872712 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbf540bd440 con 0x7fbf64100b50 2024-08-18T22:06:54.257 INFO:teuthology.orchestra.run.smithi123.stdout:158913790010 2024-08-18T22:06:54.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.258+0000 7fbf6972d640 1 -- 172.21.15.123:0/2423872712 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbf500a2c10 msgr2=0x7fbf500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:54.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.258+0000 7fbf6972d640 1 --2- 172.21.15.123:0/2423872712 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbf500a2c10 0x7fbf500a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbf640ffb80 tx=0x7fbf4c009110 comp rx=0 tx=0).stop 2024-08-18T22:06:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.258+0000 7fbf6972d640 1 -- 172.21.15.123:0/2423872712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf64100b50 msgr2=0x7fbf64197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.258+0000 7fbf6972d640 1 --2- 172.21.15.123:0/2423872712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf64100b50 0x7fbf64197230 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbf54005cc0 tx=0x7fbf5402f6c0 comp rx=0 tx=0).stop 2024-08-18T22:06:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.258+0000 7fbf6972d640 1 -- 172.21.15.123:0/2423872712 shutdown_connections 2024-08-18T22:06:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.258+0000 7fbf6972d640 1 --2- 172.21.15.123:0/2423872712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf64102c20 0x7fbf6419bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.258+0000 7fbf6972d640 1 --2- 172.21.15.123:0/2423872712 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbf500a2c10 0x7fbf500a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.258+0000 7fbf6972d640 1 --2- 172.21.15.123:0/2423872712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf641022a0 0x7fbf64197770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.258+0000 7fbf6972d640 1 --2- 172.21.15.123:0/2423872712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf64100b50 0x7fbf64197230 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.258+0000 7fbf6972d640 1 -- 172.21.15.123:0/2423872712 >> 172.21.15.123:0/2423872712 conn(0x7fbf640fc500 msgr2=0x7fbf640fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.258+0000 7fbf6972d640 1 -- 172.21.15.123:0/2423872712 shutdown_connections 2024-08-18T22:06:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:54.258+0000 7fbf6972d640 1 -- 172.21.15.123:0/2423872712 wait complete. 2024-08-18T22:06:54.684 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:54 smithi123 ceph-mon[18462]: pgmap v312: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:06:54.684 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:54 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2423872712' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-18T22:06:54.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:54 smithi130 ceph-mon[21698]: pgmap v312: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:06:54.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:54 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2423872712' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-18T22:06:54.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:54 smithi183 ceph-mon[22097]: pgmap v312: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:06:54.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:54 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2423872712' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-18T22:06:55.030 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790007 got 158913790010 for osd.5 2024-08-18T22:06:55.030 DEBUG:teuthology.parallel:result is None 2024-08-18T22:06:55.440 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:55.460 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574922 got 55834574924 for osd.1 2024-08-18T22:06:55.460 DEBUG:teuthology.parallel:result is None 2024-08-18T22:06:55.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.648+0000 7fc7aef0b640 1 -- 172.21.15.123:0/2848530186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7a81007b0 msgr2=0x7fc7a8100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:55.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.648+0000 7fc7aef0b640 1 --2- 172.21.15.123:0/2848530186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7a81007b0 0x7fc7a8100c10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc794009930 tx=0x7fc79402a420 comp rx=0 tx=0).stop 2024-08-18T22:06:55.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.648+0000 7fc7aef0b640 1 -- 172.21.15.123:0/2848530186 shutdown_connections 2024-08-18T22:06:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.648+0000 7fc7aef0b640 1 --2- 172.21.15.123:0/2848530186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7a8101150 0x7fc7a810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.648+0000 7fc7aef0b640 1 --2- 172.21.15.123:0/2848530186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7a81007b0 0x7fc7a8100c10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.648+0000 7fc7aef0b640 1 --2- 172.21.15.123:0/2848530186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7a81067b0 0x7fc7a8106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.648+0000 7fc7aef0b640 1 -- 172.21.15.123:0/2848530186 >> 172.21.15.123:0/2848530186 conn(0x7fc7a80fc4d0 msgr2=0x7fc7a80fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.648+0000 7fc7aef0b640 1 -- 172.21.15.123:0/2848530186 shutdown_connections 2024-08-18T22:06:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.649+0000 7fc7aef0b640 1 -- 172.21.15.123:0/2848530186 wait complete. 2024-08-18T22:06:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.649+0000 7fc7aef0b640 1 Processor -- start 2024-08-18T22:06:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.649+0000 7fc7aef0b640 1 -- start start 2024-08-18T22:06:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.649+0000 7fc7aef0b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7a81007b0 0x7fc7a81982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.649+0000 7fc7aef0b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7a8101150 0x7fc7a8198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.649+0000 7fc7aef0b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7a81067b0 0x7fc7a819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.649+0000 7fc7aef0b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a8110ca0 con 0x7fc7a81007b0 2024-08-18T22:06:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.649+0000 7fc7aef0b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a8110b20 con 0x7fc7a8101150 2024-08-18T22:06:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.649+0000 7fc7aef0b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a8110e20 con 0x7fc7a81067b0 2024-08-18T22:06:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.649+0000 7fc7acca7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7a81007b0 0x7fc7a81982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.649+0000 7fc7acca7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7a81007b0 0x7fc7a81982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59676/0 (socket says 172.21.15.123:59676) 2024-08-18T22:06:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.649+0000 7fc7acca7640 1 -- 172.21.15.123:0/1424102458 learned_addr learned my addr 172.21.15.123:0/1424102458 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.649+0000 7fc7a7fff640 1 --2- 172.21.15.123:0/1424102458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7a8101150 0x7fc7a8198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.650+0000 7fc7ad4a8640 1 --2- 172.21.15.123:0/1424102458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7a81067b0 0x7fc7a819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.650+0000 7fc7acca7640 1 -- 172.21.15.123:0/1424102458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7a81067b0 msgr2=0x7fc7a819cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.650+0000 7fc7acca7640 1 --2- 172.21.15.123:0/1424102458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7a81067b0 0x7fc7a819cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.650+0000 7fc7acca7640 1 -- 172.21.15.123:0/1424102458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7a8101150 msgr2=0x7fc7a8198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.650+0000 7fc7acca7640 1 --2- 172.21.15.123:0/1424102458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7a8101150 0x7fc7a8198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.650+0000 7fc7acca7640 1 -- 172.21.15.123:0/1424102458 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a819d270 con 0x7fc7a81007b0 2024-08-18T22:06:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.650+0000 7fc7acca7640 1 --2- 172.21.15.123:0/1424102458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7a81007b0 0x7fc7a81982c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00b4a0 tx=0x7fc79c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.650+0000 7fc7a5ffb640 1 -- 172.21.15.123:0/1424102458 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c014070 con 0x7fc7a81007b0 2024-08-18T22:06:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.650+0000 7fc7a5ffb640 1 -- 172.21.15.123:0/1424102458 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc79c010af0 con 0x7fc7a81007b0 2024-08-18T22:06:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.650+0000 7fc7aef0b640 1 -- 172.21.15.123:0/1424102458 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a819d560 con 0x7fc7a81007b0 2024-08-18T22:06:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.650+0000 7fc7a5ffb640 1 -- 172.21.15.123:0/1424102458 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c017d10 con 0x7fc7a81007b0 2024-08-18T22:06:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.650+0000 7fc7aef0b640 1 -- 172.21.15.123:0/1424102458 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a81a4e40 con 0x7fc7a81007b0 2024-08-18T22:06:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.651+0000 7fc7aef0b640 1 -- 172.21.15.123:0/1424102458 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a8100c90 con 0x7fc7a81007b0 2024-08-18T22:06:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.652+0000 7fc7a5ffb640 1 -- 172.21.15.123:0/1424102458 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc79c017070 con 0x7fc7a81007b0 2024-08-18T22:06:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.653+0000 7fc7a5ffb640 1 --2- 172.21.15.123:0/1424102458 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc7980a2c10 0x7fc7980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.653+0000 7fc7a7fff640 1 --2- 172.21.15.123:0/1424102458 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc7980a2c10 0x7fc7980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.653+0000 7fc7a5ffb640 1 -- 172.21.15.123:0/1424102458 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fc79c0ce7f0 con 0x7fc7a81007b0 2024-08-18T22:06:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.654+0000 7fc7a7fff640 1 --2- 172.21.15.123:0/1424102458 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc7980a2c10 0x7fc7980a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc794006010 tx=0x7fc794000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.657+0000 7fc7a5ffb640 1 -- 172.21.15.123:0/1424102458 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fc79c09b3a0 con 0x7fc7a81007b0 2024-08-18T22:06:55.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.830+0000 7fc7aef0b640 1 -- 172.21.15.123:0/1424102458 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc7a81097c0 con 0x7fc7a81007b0 2024-08-18T22:06:55.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.831+0000 7fc7a5ffb640 1 -- 172.21.15.123:0/1424102458 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc79c09aca0 con 0x7fc7a81007b0 2024-08-18T22:06:55.832 INFO:teuthology.orchestra.run.smithi123.stdout:34359738449 2024-08-18T22:06:55.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.833+0000 7fc7aef0b640 1 -- 172.21.15.123:0/1424102458 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc7980a2c10 msgr2=0x7fc7980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:55.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.833+0000 7fc7aef0b640 1 --2- 172.21.15.123:0/1424102458 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc7980a2c10 0x7fc7980a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc794006010 tx=0x7fc794000bc0 comp rx=0 tx=0).stop 2024-08-18T22:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.833+0000 7fc7aef0b640 1 -- 172.21.15.123:0/1424102458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7a81007b0 msgr2=0x7fc7a81982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.833+0000 7fc7aef0b640 1 --2- 172.21.15.123:0/1424102458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7a81007b0 0x7fc7a81982c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00b4a0 tx=0x7fc79c00b960 comp rx=0 tx=0).stop 2024-08-18T22:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.833+0000 7fc7aef0b640 1 -- 172.21.15.123:0/1424102458 shutdown_connections 2024-08-18T22:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.833+0000 7fc7aef0b640 1 --2- 172.21.15.123:0/1424102458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7a81067b0 0x7fc7a819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.833+0000 7fc7aef0b640 1 --2- 172.21.15.123:0/1424102458 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc7980a2c10 0x7fc7980a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.833+0000 7fc7aef0b640 1 --2- 172.21.15.123:0/1424102458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7a8101150 0x7fc7a8198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.833+0000 7fc7aef0b640 1 --2- 172.21.15.123:0/1424102458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7a81007b0 0x7fc7a81982c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.833+0000 7fc7aef0b640 1 -- 172.21.15.123:0/1424102458 >> 172.21.15.123:0/1424102458 conn(0x7fc7a80fc4d0 msgr2=0x7fc7a806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.833+0000 7fc7aef0b640 1 -- 172.21.15.123:0/1424102458 shutdown_connections 2024-08-18T22:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:55.833+0000 7fc7aef0b640 1 -- 172.21.15.123:0/1424102458 wait complete. 2024-08-18T22:06:56.154 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906982 got 274877906984 for osd.9 2024-08-18T22:06:56.154 DEBUG:teuthology.parallel:result is None 2024-08-18T22:06:56.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:56 smithi123 ceph-mon[18462]: pgmap v313: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:06:56.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:56 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1424102458' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-18T22:06:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:56 smithi130 ceph-mon[21698]: pgmap v313: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:06:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:56 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1424102458' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-18T22:06:56.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:56 smithi183 ceph-mon[22097]: pgmap v313: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:06:56.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:56 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1424102458' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-18T22:06:57.244 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561075 got 188978561078 for osd.6 2024-08-18T22:06:57.244 DEBUG:teuthology.parallel:result is None 2024-08-18T22:06:57.269 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738449 for osd.0 2024-08-18T22:06:57.269 DEBUG:teuthology.parallel:result is None 2024-08-18T22:06:57.315 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:57.316 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:57.316 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:58.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.023+0000 7fe49ccba640 1 -- 172.21.15.123:0/713887774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe498100b50 msgr2=0x7fe498100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:58.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.023+0000 7fe49ccba640 1 --2- 172.21.15.123:0/713887774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe498100b50 0x7fe498100f30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe488009900 tx=0x7fe48802a480 comp rx=0 tx=0).stop 2024-08-18T22:06:58.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.023+0000 7fe49ccba640 1 -- 172.21.15.123:0/713887774 shutdown_connections 2024-08-18T22:06:58.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.023+0000 7fe49ccba640 1 --2- 172.21.15.123:0/713887774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe498102c20 0x7fe49810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:58.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.023+0000 7fe49ccba640 1 --2- 172.21.15.123:0/713887774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4981022a0 0x7fe4981026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:58.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.023+0000 7fe49ccba640 1 --2- 172.21.15.123:0/713887774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe498100b50 0x7fe498100f30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:58.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.023+0000 7fe49ccba640 1 -- 172.21.15.123:0/713887774 >> 172.21.15.123:0/713887774 conn(0x7fe4980fc500 msgr2=0x7fe4980fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:58.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.023+0000 7fe49ccba640 1 -- 172.21.15.123:0/713887774 shutdown_connections 2024-08-18T22:06:58.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.023+0000 7fe49ccba640 1 -- 172.21.15.123:0/713887774 wait complete. 2024-08-18T22:06:58.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe49ccba640 1 Processor -- start 2024-08-18T22:06:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe49ccba640 1 -- start start 2024-08-18T22:06:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe49ccba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe498100b50 0x7fe4980fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe49ccba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4981022a0 0x7fe4980fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe49ccba640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe498102c20 0x7fe4980fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe49ccba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe498110cd0 con 0x7fe4981022a0 2024-08-18T22:06:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe49ccba640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe498110b50 con 0x7fe498102c20 2024-08-18T22:06:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe49ccba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe498110e50 con 0x7fe498100b50 2024-08-18T22:06:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe48ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4981022a0 0x7fe4980fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe48ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4981022a0 0x7fe4980fcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59702/0 (socket says 172.21.15.123:59702) 2024-08-18T22:06:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe48ffff640 1 -- 172.21.15.123:0/1420551582 learned_addr learned my addr 172.21.15.123:0/1420551582 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe49659c640 1 --2- 172.21.15.123:0/1420551582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe498100b50 0x7fe4980fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe496d9d640 1 --2- 172.21.15.123:0/1420551582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe498102c20 0x7fe4980fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe48ffff640 1 -- 172.21.15.123:0/1420551582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe498100b50 msgr2=0x7fe4980fc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe48ffff640 1 --2- 172.21.15.123:0/1420551582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe498100b50 0x7fe4980fc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe48ffff640 1 -- 172.21.15.123:0/1420551582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe498102c20 msgr2=0x7fe4980fd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.024+0000 7fe48ffff640 1 --2- 172.21.15.123:0/1420551582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe498102c20 0x7fe4980fd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.025+0000 7fe48ffff640 1 -- 172.21.15.123:0/1420551582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4981a6700 con 0x7fe4981022a0 2024-08-18T22:06:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.025+0000 7fe48ffff640 1 --2- 172.21.15.123:0/1420551582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4981022a0 0x7fe4980fcef0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe48000b4a0 tx=0x7fe48000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.025+0000 7fe48f7fe640 1 -- 172.21.15.123:0/1420551582 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe480014070 con 0x7fe4981022a0 2024-08-18T22:06:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.025+0000 7fe49ccba640 1 -- 172.21.15.123:0/1420551582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4981a69f0 con 0x7fe4981022a0 2024-08-18T22:06:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.025+0000 7fe48f7fe640 1 -- 172.21.15.123:0/1420551582 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe480010af0 con 0x7fe4981022a0 2024-08-18T22:06:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.025+0000 7fe48f7fe640 1 -- 172.21.15.123:0/1420551582 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe480017d10 con 0x7fe4981022a0 2024-08-18T22:06:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.025+0000 7fe49ccba640 1 -- 172.21.15.123:0/1420551582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4981a6ee0 con 0x7fe4981022a0 2024-08-18T22:06:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.026+0000 7fe49ccba640 1 -- 172.21.15.123:0/1420551582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe498100f30 con 0x7fe4981022a0 2024-08-18T22:06:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.028+0000 7fe48f7fe640 1 -- 172.21.15.123:0/1420551582 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe480017070 con 0x7fe4981022a0 2024-08-18T22:06:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.029+0000 7fe48f7fe640 1 --2- 172.21.15.123:0/1420551582 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe4840a2c10 0x7fe4840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.029+0000 7fe49659c640 1 --2- 172.21.15.123:0/1420551582 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe4840a2c10 0x7fe4840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.029+0000 7fe48f7fe640 1 -- 172.21.15.123:0/1420551582 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fe4800ce8d0 con 0x7fe4981022a0 2024-08-18T22:06:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.029+0000 7fe49659c640 1 --2- 172.21.15.123:0/1420551582 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe4840a2c10 0x7fe4840a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe488005ab0 tx=0x7fe488005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.037+0000 7fe48f7fe640 1 -- 172.21.15.123:0/1420551582 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe48009b480 con 0x7fe4981022a0 2024-08-18T22:06:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.216+0000 7fe49ccba640 1 -- 172.21.15.123:0/1420551582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe498109dd0 con 0x7fe4981022a0 2024-08-18T22:06:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.217+0000 7fe48f7fe640 1 -- 172.21.15.123:0/1420551582 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe48009ad80 con 0x7fe4981022a0 2024-08-18T22:06:58.218 INFO:teuthology.orchestra.run.smithi123.stdout:77309411399 2024-08-18T22:06:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.219+0000 7fe49ccba640 1 -- 172.21.15.123:0/1420551582 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe4840a2c10 msgr2=0x7fe4840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.219+0000 7fe49ccba640 1 --2- 172.21.15.123:0/1420551582 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe4840a2c10 0x7fe4840a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe488005ab0 tx=0x7fe488005a20 comp rx=0 tx=0).stop 2024-08-18T22:06:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.219+0000 7fe49ccba640 1 -- 172.21.15.123:0/1420551582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4981022a0 msgr2=0x7fe4980fcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.219+0000 7fe49ccba640 1 --2- 172.21.15.123:0/1420551582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4981022a0 0x7fe4980fcef0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe48000b4a0 tx=0x7fe48000b960 comp rx=0 tx=0).stop 2024-08-18T22:06:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.219+0000 7fe49ccba640 1 -- 172.21.15.123:0/1420551582 shutdown_connections 2024-08-18T22:06:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.219+0000 7fe49ccba640 1 --2- 172.21.15.123:0/1420551582 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe4840a2c10 0x7fe4840a50d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.219+0000 7fe49ccba640 1 --2- 172.21.15.123:0/1420551582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe498102c20 0x7fe4980fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.219+0000 7fe49ccba640 1 --2- 172.21.15.123:0/1420551582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4981022a0 0x7fe4980fcef0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.219+0000 7fe49ccba640 1 --2- 172.21.15.123:0/1420551582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe498100b50 0x7fe4980fc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.219+0000 7fe49ccba640 1 -- 172.21.15.123:0/1420551582 >> 172.21.15.123:0/1420551582 conn(0x7fe4980fc500 msgr2=0x7fe498069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.219+0000 7fe49ccba640 1 -- 172.21.15.123:0/1420551582 shutdown_connections 2024-08-18T22:06:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.219+0000 7fe49ccba640 1 -- 172.21.15.123:0/1420551582 wait complete. 2024-08-18T22:06:58.632 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:58 smithi123 ceph-mon[18462]: pgmap v314: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:06:58.632 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:58 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1420551582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-18T22:06:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:58 smithi130 ceph-mon[21698]: pgmap v314: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:06:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:58 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1420551582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-18T22:06:58.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:58 smithi183 ceph-mon[22097]: pgmap v314: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:06:58.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:58 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1420551582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-18T22:06:59.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.046+0000 7f9ff50d4640 1 -- 172.21.15.123:0/1873873739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff01078b0 msgr2=0x7f9ff0107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:59.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.046+0000 7f9ff50d4640 1 --2- 172.21.15.123:0/1873873739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff01078b0 0x7f9ff0107c90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009930 tx=0x7f9fe402a420 comp rx=0 tx=0).stop 2024-08-18T22:06:59.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.046+0000 7f9ff50d4640 1 -- 172.21.15.123:0/1873873739 shutdown_connections 2024-08-18T22:06:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.046+0000 7f9ff50d4640 1 --2- 172.21.15.123:0/1873873739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ff0102250 0x7f9ff010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.046+0000 7f9ff50d4640 1 --2- 172.21.15.123:0/1873873739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ff01018b0 0x7f9ff0101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.046+0000 7f9ff50d4640 1 --2- 172.21.15.123:0/1873873739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff01078b0 0x7f9ff0107c90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.046+0000 7f9ff50d4640 1 -- 172.21.15.123:0/1873873739 >> 172.21.15.123:0/1873873739 conn(0x7f9ff00fd5f0 msgr2=0x7f9ff00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.046+0000 7f9ff50d4640 1 -- 172.21.15.123:0/1873873739 shutdown_connections 2024-08-18T22:06:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.046+0000 7f9ff50d4640 1 -- 172.21.15.123:0/1873873739 wait complete. 2024-08-18T22:06:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.047+0000 7f9ff50d4640 1 Processor -- start 2024-08-18T22:06:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.047+0000 7f9ff50d4640 1 -- start start 2024-08-18T22:06:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.047+0000 7f9ff50d4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ff01018b0 0x7f9ff0198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.047+0000 7f9ff50d4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff0102250 0x7f9ff0198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.047+0000 7f9ff50d4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ff01078b0 0x7f9ff019cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.047+0000 7f9ff50d4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff0111cb0 con 0x7f9ff0102250 2024-08-18T22:06:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.047+0000 7f9ff50d4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff0111b30 con 0x7f9ff01078b0 2024-08-18T22:06:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.047+0000 7f9ff50d4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff0111e30 con 0x7f9ff01018b0 2024-08-18T22:06:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.047+0000 7f9fee59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff0102250 0x7f9ff0198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.047+0000 7f9fee59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff0102250 0x7f9ff0198770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59728/0 (socket says 172.21.15.123:59728) 2024-08-18T22:06:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.047+0000 7f9fee59c640 1 -- 172.21.15.123:0/2143721384 learned_addr learned my addr 172.21.15.123:0/2143721384 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.047+0000 7f9feed9d640 1 --2- 172.21.15.123:0/2143721384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ff01018b0 0x7f9ff0198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.047+0000 7f9fef59e640 1 --2- 172.21.15.123:0/2143721384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ff01078b0 0x7f9ff019cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.048+0000 7f9fee59c640 1 -- 172.21.15.123:0/2143721384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ff01018b0 msgr2=0x7f9ff0198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.048+0000 7f9fee59c640 1 --2- 172.21.15.123:0/2143721384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ff01018b0 0x7f9ff0198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.048+0000 7f9fee59c640 1 -- 172.21.15.123:0/2143721384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ff01078b0 msgr2=0x7f9ff019cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.048+0000 7f9fee59c640 1 --2- 172.21.15.123:0/2143721384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ff01078b0 0x7f9ff019cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.048+0000 7f9fee59c640 1 -- 172.21.15.123:0/2143721384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff019d1e0 con 0x7f9ff0102250 2024-08-18T22:06:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.048+0000 7f9fee59c640 1 --2- 172.21.15.123:0/2143721384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff0102250 0x7f9ff0198770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000c970 tx=0x7f9fe000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.048+0000 7f9fd7fff640 1 -- 172.21.15.123:0/2143721384 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0007bb0 con 0x7f9ff0102250 2024-08-18T22:06:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.048+0000 7f9fd7fff640 1 -- 172.21.15.123:0/2143721384 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe0007d50 con 0x7f9ff0102250 2024-08-18T22:06:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.048+0000 7f9ff50d4640 1 -- 172.21.15.123:0/2143721384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff019d4d0 con 0x7f9ff0102250 2024-08-18T22:06:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.048+0000 7f9fd7fff640 1 -- 172.21.15.123:0/2143721384 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000f450 con 0x7f9ff0102250 2024-08-18T22:06:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.048+0000 7f9ff50d4640 1 -- 172.21.15.123:0/2143721384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff01a4db0 con 0x7f9ff0102250 2024-08-18T22:06:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.049+0000 7f9ff50d4640 1 -- 172.21.15.123:0/2143721384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff0101d10 con 0x7f9ff0102250 2024-08-18T22:06:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.050+0000 7f9fd7fff640 1 -- 172.21.15.123:0/2143721384 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f9fe0004fe0 con 0x7f9ff0102250 2024-08-18T22:06:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.051+0000 7f9fd7fff640 1 --2- 172.21.15.123:0/2143721384 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9fd80a2c10 0x7f9fd80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.051+0000 7f9feed9d640 1 --2- 172.21.15.123:0/2143721384 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9fd80a2c10 0x7f9fd80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.051+0000 7f9fd7fff640 1 -- 172.21.15.123:0/2143721384 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f9fe00cf650 con 0x7f9ff0102250 2024-08-18T22:06:59.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.051+0000 7f9feed9d640 1 --2- 172.21.15.123:0/2143721384 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9fd80a2c10 0x7f9fd80a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009900 tx=0x7f9fe40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:59.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.054+0000 7f9fd7fff640 1 -- 172.21.15.123:0/2143721384 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9fe0014030 con 0x7f9ff0102250 2024-08-18T22:06:59.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.711+0000 7f7b5386e640 1 -- 172.21.15.123:0/1713325522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c1007b0 msgr2=0x7f7b4c100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:59.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.711+0000 7f7b5386e640 1 --2- 172.21.15.123:0/1713325522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c1007b0 0x7f7b4c100c10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009930 tx=0x7f7b4802a420 comp rx=0 tx=0).stop 2024-08-18T22:06:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.711+0000 7f7b5386e640 1 -- 172.21.15.123:0/1713325522 shutdown_connections 2024-08-18T22:06:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.711+0000 7f7b5386e640 1 --2- 172.21.15.123:0/1713325522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b4c101150 0x7f7b4c10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.711+0000 7f7b5386e640 1 --2- 172.21.15.123:0/1713325522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c1007b0 0x7f7b4c100c10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.711+0000 7f7b5386e640 1 --2- 172.21.15.123:0/1713325522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b4c1067b0 0x7f7b4c106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.711+0000 7f7b5386e640 1 -- 172.21.15.123:0/1713325522 >> 172.21.15.123:0/1713325522 conn(0x7f7b4c0fc4d0 msgr2=0x7f7b4c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.711+0000 7f7b5386e640 1 -- 172.21.15.123:0/1713325522 shutdown_connections 2024-08-18T22:06:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.711+0000 7f7b5386e640 1 -- 172.21.15.123:0/1713325522 wait complete. 2024-08-18T22:06:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.711+0000 7f7b5386e640 1 Processor -- start 2024-08-18T22:06:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.711+0000 7f7b5386e640 1 -- start start 2024-08-18T22:06:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b5386e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b4c1007b0 0x7f7b4c1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b5386e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b4c101150 0x7f7b4c198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b5386e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c1067b0 0x7f7b4c19ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b5386e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c111cd0 con 0x7f7b4c1067b0 2024-08-18T22:06:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b5386e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c111b50 con 0x7f7b4c1007b0 2024-08-18T22:06:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b5386e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c111e50 con 0x7f7b4c101150 2024-08-18T22:06:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b51e0b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c1067b0 0x7f7b4c19ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b51e0b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c1067b0 0x7f7b4c19ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59716/0 (socket says 172.21.15.123:59716) 2024-08-18T22:06:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b51e0b640 1 -- 172.21.15.123:0/2896520844 learned_addr learned my addr 172.21.15.123:0/2896520844 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b5160a640 1 --2- 172.21.15.123:0/2896520844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b4c1007b0 0x7f7b4c1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b50e09640 1 --2- 172.21.15.123:0/2896520844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b4c101150 0x7f7b4c198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b51e0b640 1 -- 172.21.15.123:0/2896520844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b4c101150 msgr2=0x7f7b4c198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b51e0b640 1 --2- 172.21.15.123:0/2896520844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b4c101150 0x7f7b4c198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b51e0b640 1 -- 172.21.15.123:0/2896520844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b4c1007b0 msgr2=0x7f7b4c1981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b51e0b640 1 --2- 172.21.15.123:0/2896520844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b4c1007b0 0x7f7b4c1981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b51e0b640 1 -- 172.21.15.123:0/2896520844 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4c19d170 con 0x7f7b4c1067b0 2024-08-18T22:06:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b51e0b640 1 --2- 172.21.15.123:0/2896520844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c1067b0 0x7f7b4c19ca90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400b970 tx=0x7f7b4400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b427fc640 1 -- 172.21.15.123:0/2896520844 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44019070 con 0x7f7b4c1067b0 2024-08-18T22:06:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b427fc640 1 -- 172.21.15.123:0/2896520844 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b4400cb40 con 0x7f7b4c1067b0 2024-08-18T22:06:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b5386e640 1 -- 172.21.15.123:0/2896520844 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4c19d460 con 0x7f7b4c1067b0 2024-08-18T22:06:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.712+0000 7f7b427fc640 1 -- 172.21.15.123:0/2896520844 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44007650 con 0x7f7b4c1067b0 2024-08-18T22:06:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.713+0000 7f7b5386e640 1 -- 172.21.15.123:0/2896520844 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b4c1a4d40 con 0x7f7b4c1067b0 2024-08-18T22:06:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.714+0000 7f7b5386e640 1 -- 172.21.15.123:0/2896520844 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b4c100c10 con 0x7f7b4c1067b0 2024-08-18T22:06:59.172 INFO:teuthology.orchestra.run.smithi123.stdout:296352743461 2024-08-18T22:06:59.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.715+0000 7f7b427fc640 1 -- 172.21.15.123:0/2896520844 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7b4401c070 con 0x7f7b4c1067b0 2024-08-18T22:06:59.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.716+0000 7f7b427fc640 1 --2- 172.21.15.123:0/2896520844 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7b380a2c10 0x7f7b380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:59.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.716+0000 7f7b5160a640 1 --2- 172.21.15.123:0/2896520844 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7b380a2c10 0x7f7b380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:59.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.716+0000 7f7b427fc640 1 -- 172.21.15.123:0/2896520844 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f7b440cef20 con 0x7f7b4c1067b0 2024-08-18T22:06:59.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.716+0000 7f7b5160a640 1 --2- 172.21.15.123:0/2896520844 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7b380a2c10 0x7f7b380a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0058c0 tx=0x7f7b3c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:59.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.719+0000 7f7b427fc640 1 -- 172.21.15.123:0/2896520844 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7b4409b420 con 0x7f7b4c1067b0 2024-08-18T22:06:59.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.902+0000 7f7b5386e640 1 -- 172.21.15.123:0/2896520844 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f7b4c108da0 con 0x7f7b4c1067b0 2024-08-18T22:06:59.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.902+0000 7f7b427fc640 1 -- 172.21.15.123:0/2896520844 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f7b4409f720 con 0x7f7b4c1067b0 2024-08-18T22:06:59.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.904+0000 7f7b5386e640 1 -- 172.21.15.123:0/2896520844 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7b380a2c10 msgr2=0x7f7b380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:59.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.904+0000 7f7b5386e640 1 --2- 172.21.15.123:0/2896520844 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7b380a2c10 0x7f7b380a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0058c0 tx=0x7f7b3c00a2d0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.904+0000 7f7b5386e640 1 -- 172.21.15.123:0/2896520844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c1067b0 msgr2=0x7f7b4c19ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:59.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.904+0000 7f7b5386e640 1 --2- 172.21.15.123:0/2896520844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c1067b0 0x7f7b4c19ca90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400b970 tx=0x7f7b4400be30 comp rx=0 tx=0).stop 2024-08-18T22:06:59.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.905+0000 7f7b5386e640 1 -- 172.21.15.123:0/2896520844 shutdown_connections 2024-08-18T22:06:59.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.905+0000 7f7b5386e640 1 --2- 172.21.15.123:0/2896520844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b4c1067b0 0x7f7b4c19ca90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.905+0000 7f7b5386e640 1 --2- 172.21.15.123:0/2896520844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b4c101150 0x7f7b4c198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.905+0000 7f7b5386e640 1 --2- 172.21.15.123:0/2896520844 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7b380a2c10 0x7f7b380a50d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.905+0000 7f7b5386e640 1 --2- 172.21.15.123:0/2896520844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b4c1007b0 0x7f7b4c1981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.905+0000 7f7b5386e640 1 -- 172.21.15.123:0/2896520844 >> 172.21.15.123:0/2896520844 conn(0x7f7b4c0fc4d0 msgr2=0x7f7b4c0fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:59.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.905+0000 7f7b5386e640 1 -- 172.21.15.123:0/2896520844 shutdown_connections 2024-08-18T22:06:59.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:58.905+0000 7f7b5386e640 1 -- 172.21.15.123:0/2896520844 wait complete. 2024-08-18T22:06:59.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.225+0000 7f9ff50d4640 1 -- 172.21.15.123:0/2143721384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9ff0199590 con 0x7f9ff0102250 2024-08-18T22:06:59.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.225+0000 7f9fd7fff640 1 -- 172.21.15.123:0/2143721384 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9ff0199590 con 0x7f9ff0102250 2024-08-18T22:06:59.226 INFO:teuthology.orchestra.run.smithi123.stdout:107374182468 2024-08-18T22:06:59.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.227+0000 7f9ff50d4640 1 -- 172.21.15.123:0/2143721384 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9fd80a2c10 msgr2=0x7f9fd80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:59.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.227+0000 7f9ff50d4640 1 --2- 172.21.15.123:0/2143721384 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9fd80a2c10 0x7f9fd80a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009900 tx=0x7f9fe40058d0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.227+0000 7f9ff50d4640 1 -- 172.21.15.123:0/2143721384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff0102250 msgr2=0x7f9ff0198770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:59.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.227+0000 7f9ff50d4640 1 --2- 172.21.15.123:0/2143721384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff0102250 0x7f9ff0198770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000c970 tx=0x7f9fe000ce30 comp rx=0 tx=0).stop 2024-08-18T22:06:59.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.227+0000 7f9ff50d4640 1 -- 172.21.15.123:0/2143721384 shutdown_connections 2024-08-18T22:06:59.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.227+0000 7f9ff50d4640 1 --2- 172.21.15.123:0/2143721384 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9fd80a2c10 0x7f9fd80a50d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.227+0000 7f9ff50d4640 1 --2- 172.21.15.123:0/2143721384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ff01078b0 0x7f9ff019cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.227+0000 7f9ff50d4640 1 --2- 172.21.15.123:0/2143721384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff0102250 0x7f9ff0198770 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.227+0000 7f9ff50d4640 1 --2- 172.21.15.123:0/2143721384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ff01018b0 0x7f9ff0198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.227+0000 7f9ff50d4640 1 -- 172.21.15.123:0/2143721384 >> 172.21.15.123:0/2143721384 conn(0x7f9ff00fd5f0 msgr2=0x7f9ff00fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:59.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.227+0000 7f9ff50d4640 1 -- 172.21.15.123:0/2143721384 shutdown_connections 2024-08-18T22:06:59.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.227+0000 7f9ff50d4640 1 -- 172.21.15.123:0/2143721384 wait complete. 2024-08-18T22:06:59.626 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:06:59.724 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:59 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2896520844' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-08-18T22:06:59.724 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:06:59 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2143721384' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-18T22:06:59.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:59 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2896520844' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-08-18T22:06:59.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:06:59 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2143721384' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-18T22:06:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.803+0000 7f8011029640 1 -- 172.21.15.123:0/3507566721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c101150 msgr2=0x7f800c10d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.803+0000 7f8011029640 1 --2- 172.21.15.123:0/3507566721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c101150 0x7f800c10d680 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8004009cd0 tx=0x7f800402a8e0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.803+0000 7f8011029640 1 -- 172.21.15.123:0/3507566721 shutdown_connections 2024-08-18T22:06:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.803+0000 7f8011029640 1 --2- 172.21.15.123:0/3507566721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c101150 0x7f800c10d680 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.803+0000 7f8011029640 1 --2- 172.21.15.123:0/3507566721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c1007b0 0x7f800c100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.803+0000 7f8011029640 1 --2- 172.21.15.123:0/3507566721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f800c1067b0 0x7f800c106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.803+0000 7f8011029640 1 -- 172.21.15.123:0/3507566721 >> 172.21.15.123:0/3507566721 conn(0x7f800c0fc4d0 msgr2=0x7f800c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.803+0000 7f8011029640 1 -- 172.21.15.123:0/3507566721 shutdown_connections 2024-08-18T22:06:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.803+0000 7f8011029640 1 -- 172.21.15.123:0/3507566721 wait complete. 2024-08-18T22:06:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f8011029640 1 Processor -- start 2024-08-18T22:06:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f8011029640 1 -- start start 2024-08-18T22:06:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f8011029640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f800c1007b0 0x7f800c199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f8011029640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c101150 0x7f800c199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f8011029640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c1067b0 0x7f800c1a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f8011029640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f800c110bd0 con 0x7f800c1067b0 2024-08-18T22:06:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f8011029640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f800c110a50 con 0x7f800c1007b0 2024-08-18T22:06:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f8011029640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f800c110d50 con 0x7f800c101150 2024-08-18T22:06:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f800b59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c1067b0 0x7f800c1a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f800b59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c1067b0 0x7f800c1a40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59748/0 (socket says 172.21.15.123:59748) 2024-08-18T22:06:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f800b59e640 1 -- 172.21.15.123:0/1132345793 learned_addr learned my addr 172.21.15.123:0/1132345793 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:06:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f800ad9d640 1 --2- 172.21.15.123:0/1132345793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f800c1007b0 0x7f800c199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f800a59c640 1 --2- 172.21.15.123:0/1132345793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c101150 0x7f800c199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f800b59e640 1 -- 172.21.15.123:0/1132345793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c101150 msgr2=0x7f800c199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f800b59e640 1 --2- 172.21.15.123:0/1132345793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c101150 0x7f800c199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f800b59e640 1 -- 172.21.15.123:0/1132345793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f800c1007b0 msgr2=0x7f800c199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:59.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f800b59e640 1 --2- 172.21.15.123:0/1132345793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f800c1007b0 0x7f800c199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.804+0000 7f800b59e640 1 -- 172.21.15.123:0/1132345793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800c1a45e0 con 0x7f800c1067b0 2024-08-18T22:06:59.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.805+0000 7f800b59e640 1 --2- 172.21.15.123:0/1132345793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c1067b0 0x7f800c1a40a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8004005cc0 tx=0x7f8004003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:59.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.805+0000 7f7ff3fff640 1 -- 172.21.15.123:0/1132345793 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8004004040 con 0x7f800c1067b0 2024-08-18T22:06:59.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.805+0000 7f8011029640 1 -- 172.21.15.123:0/1132345793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800c1a47b0 con 0x7f800c1067b0 2024-08-18T22:06:59.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.805+0000 7f7ff3fff640 1 -- 172.21.15.123:0/1132345793 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80040046c0 con 0x7f800c1067b0 2024-08-18T22:06:59.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.805+0000 7f7ff3fff640 1 -- 172.21.15.123:0/1132345793 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8004030e70 con 0x7f800c1067b0 2024-08-18T22:06:59.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.805+0000 7f8011029640 1 -- 172.21.15.123:0/1132345793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f800c1a4c90 con 0x7f800c1067b0 2024-08-18T22:06:59.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.806+0000 7f8011029640 1 -- 172.21.15.123:0/1132345793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f800c100c10 con 0x7f800c1067b0 2024-08-18T22:06:59.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.807+0000 7f7ff3fff640 1 -- 172.21.15.123:0/1132345793 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f80040305a0 con 0x7f800c1067b0 2024-08-18T22:06:59.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.808+0000 7f7ff3fff640 1 --2- 172.21.15.123:0/1132345793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7ff40a2c10 0x7f7ff40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:06:59.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.808+0000 7f800ad9d640 1 --2- 172.21.15.123:0/1132345793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7ff40a2c10 0x7f7ff40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:06:59.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.808+0000 7f7ff3fff640 1 -- 172.21.15.123:0/1132345793 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f800402e030 con 0x7f800c1067b0 2024-08-18T22:06:59.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.809+0000 7f800ad9d640 1 --2- 172.21.15.123:0/1132345793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7ff40a2c10 0x7f7ff40a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00bbe0 tx=0x7f7ffc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:06:59.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.812+0000 7f7ff3fff640 1 -- 172.21.15.123:0/1132345793 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f80040098b0 con 0x7f800c1067b0 2024-08-18T22:06:59.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:59 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2896520844' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-08-18T22:06:59.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:06:59 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2143721384' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-18T22:06:59.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.985+0000 7f8011029640 1 -- 172.21.15.123:0/1132345793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f800c108d40 con 0x7f800c1067b0 2024-08-18T22:06:59.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.986+0000 7f7ff3fff640 1 -- 172.21.15.123:0/1132345793 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f80040bd040 con 0x7f800c1067b0 2024-08-18T22:06:59.987 INFO:teuthology.orchestra.run.smithi123.stdout:137438953537 2024-08-18T22:06:59.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.987+0000 7f8011029640 1 -- 172.21.15.123:0/1132345793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7ff40a2c10 msgr2=0x7f7ff40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.987+0000 7f8011029640 1 --2- 172.21.15.123:0/1132345793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7ff40a2c10 0x7f7ff40a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00bbe0 tx=0x7f7ffc00b390 comp rx=0 tx=0).stop 2024-08-18T22:06:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.988+0000 7f8011029640 1 -- 172.21.15.123:0/1132345793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c1067b0 msgr2=0x7f800c1a40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:06:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.988+0000 7f8011029640 1 --2- 172.21.15.123:0/1132345793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c1067b0 0x7f800c1a40a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8004005cc0 tx=0x7f8004003970 comp rx=0 tx=0).stop 2024-08-18T22:06:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.988+0000 7f8011029640 1 -- 172.21.15.123:0/1132345793 shutdown_connections 2024-08-18T22:06:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.988+0000 7f8011029640 1 --2- 172.21.15.123:0/1132345793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f800c1067b0 0x7f800c1a40a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.988+0000 7f8011029640 1 --2- 172.21.15.123:0/1132345793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f800c101150 0x7f800c199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.988+0000 7f8011029640 1 --2- 172.21.15.123:0/1132345793 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7ff40a2c10 0x7f7ff40a50d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.988+0000 7f8011029640 1 --2- 172.21.15.123:0/1132345793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f800c1007b0 0x7f800c199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:06:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.988+0000 7f8011029640 1 -- 172.21.15.123:0/1132345793 >> 172.21.15.123:0/1132345793 conn(0x7f800c0fc4d0 msgr2=0x7f800c0fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:06:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.988+0000 7f8011029640 1 -- 172.21.15.123:0/1132345793 shutdown_connections 2024-08-18T22:06:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:06:59.988+0000 7f8011029640 1 -- 172.21.15.123:0/1132345793 wait complete. 2024-08-18T22:07:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.477+0000 7fba75c93640 1 -- 172.21.15.123:0/3688905787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba70101150 msgr2=0x7fba7010d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.477+0000 7fba75c93640 1 --2- 172.21.15.123:0/3688905787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba70101150 0x7fba7010d680 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fba68009cd0 tx=0x7fba6802a8e0 comp rx=0 tx=0).stop 2024-08-18T22:07:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.477+0000 7fba75c93640 1 -- 172.21.15.123:0/3688905787 shutdown_connections 2024-08-18T22:07:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.477+0000 7fba75c93640 1 --2- 172.21.15.123:0/3688905787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba70101150 0x7fba7010d680 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.477+0000 7fba75c93640 1 --2- 172.21.15.123:0/3688905787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba701007b0 0x7fba70100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.477+0000 7fba75c93640 1 --2- 172.21.15.123:0/3688905787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba701067b0 0x7fba70106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.477+0000 7fba75c93640 1 -- 172.21.15.123:0/3688905787 >> 172.21.15.123:0/3688905787 conn(0x7fba700fc4d0 msgr2=0x7fba700fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.477+0000 7fba75c93640 1 -- 172.21.15.123:0/3688905787 shutdown_connections 2024-08-18T22:07:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.477+0000 7fba75c93640 1 -- 172.21.15.123:0/3688905787 wait complete. 2024-08-18T22:07:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.478+0000 7fba75c93640 1 Processor -- start 2024-08-18T22:07:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.478+0000 7fba75c93640 1 -- start start 2024-08-18T22:07:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.478+0000 7fba75c93640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba701007b0 0x7fba70197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.478+0000 7fba75c93640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba70101150 0x7fba701975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.478+0000 7fba75c93640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba701067b0 0x7fba7019b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.478+0000 7fba75c93640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fba70110bb0 con 0x7fba701067b0 2024-08-18T22:07:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.478+0000 7fba75c93640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fba70110a30 con 0x7fba70101150 2024-08-18T22:07:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.478+0000 7fba75c93640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fba70110d30 con 0x7fba701007b0 2024-08-18T22:07:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.478+0000 7fba6ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba701067b0 0x7fba7019b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.478+0000 7fba6ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba701067b0 0x7fba7019b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59758/0 (socket says 172.21.15.123:59758) 2024-08-18T22:07:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.478+0000 7fba6ffff640 1 -- 172.21.15.123:0/1430210690 learned_addr learned my addr 172.21.15.123:0/1430210690 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.478+0000 7fba6f7fe640 1 --2- 172.21.15.123:0/1430210690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba701007b0 0x7fba70197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.479+0000 7fba6effd640 1 --2- 172.21.15.123:0/1430210690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba70101150 0x7fba701975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.479+0000 7fba6ffff640 1 -- 172.21.15.123:0/1430210690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba701007b0 msgr2=0x7fba70197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.479+0000 7fba6ffff640 1 --2- 172.21.15.123:0/1430210690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba701007b0 0x7fba70197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.479+0000 7fba6ffff640 1 -- 172.21.15.123:0/1430210690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba70101150 msgr2=0x7fba701975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.479+0000 7fba6ffff640 1 --2- 172.21.15.123:0/1430210690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba70101150 0x7fba701975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.479+0000 7fba6ffff640 1 -- 172.21.15.123:0/1430210690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7019c040 con 0x7fba701067b0 2024-08-18T22:07:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.479+0000 7fba6ffff640 1 --2- 172.21.15.123:0/1430210690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba701067b0 0x7fba7019b960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fba68005cc0 tx=0x7fba68003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.479+0000 7fba6cff9640 1 -- 172.21.15.123:0/1430210690 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba68004040 con 0x7fba701067b0 2024-08-18T22:07:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.479+0000 7fba6cff9640 1 -- 172.21.15.123:0/1430210690 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba680046c0 con 0x7fba701067b0 2024-08-18T22:07:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.479+0000 7fba6cff9640 1 -- 172.21.15.123:0/1430210690 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba68046480 con 0x7fba701067b0 2024-08-18T22:07:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.479+0000 7fba75c93640 1 -- 172.21.15.123:0/1430210690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba7019c2d0 con 0x7fba701067b0 2024-08-18T22:07:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.479+0000 7fba75c93640 1 -- 172.21.15.123:0/1430210690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba701a3c10 con 0x7fba701067b0 2024-08-18T22:07:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.480+0000 7fba75c93640 1 -- 172.21.15.123:0/1430210690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba70100c10 con 0x7fba701067b0 2024-08-18T22:07:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.482+0000 7fba6cff9640 1 -- 172.21.15.123:0/1430210690 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fba680305a0 con 0x7fba701067b0 2024-08-18T22:07:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.482+0000 7fba6cff9640 1 --2- 172.21.15.123:0/1430210690 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fba580a2c10 0x7fba580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.483+0000 7fba6f7fe640 1 --2- 172.21.15.123:0/1430210690 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fba580a2c10 0x7fba580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.483+0000 7fba6cff9640 1 -- 172.21.15.123:0/1430210690 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fba6802e030 con 0x7fba701067b0 2024-08-18T22:07:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.483+0000 7fba6f7fe640 1 --2- 172.21.15.123:0/1430210690 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fba580a2c10 0x7fba580a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fba6000bb60 tx=0x7fba6000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.486+0000 7fba6cff9640 1 -- 172.21.15.123:0/1430210690 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fba6804b060 con 0x7fba701067b0 2024-08-18T22:07:00.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.656+0000 7fba75c93640 1 -- 172.21.15.123:0/1430210690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fba70108d40 con 0x7fba701067b0 2024-08-18T22:07:00.657 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:00 smithi123 ceph-mon[18462]: pgmap v315: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:00.657 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:00 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1132345793' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-18T22:07:00.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.656+0000 7fba6cff9640 1 -- 172.21.15.123:0/1430210690 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fba680bd8c0 con 0x7fba701067b0 2024-08-18T22:07:00.658 INFO:teuthology.orchestra.run.smithi123.stdout:240518168623 2024-08-18T22:07:00.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.658+0000 7fba75c93640 1 -- 172.21.15.123:0/1430210690 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fba580a2c10 msgr2=0x7fba580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:00.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.658+0000 7fba75c93640 1 --2- 172.21.15.123:0/1430210690 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fba580a2c10 0x7fba580a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fba6000bb60 tx=0x7fba6000b390 comp rx=0 tx=0).stop 2024-08-18T22:07:00.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.658+0000 7fba75c93640 1 -- 172.21.15.123:0/1430210690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba701067b0 msgr2=0x7fba7019b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:00.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.658+0000 7fba75c93640 1 --2- 172.21.15.123:0/1430210690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba701067b0 0x7fba7019b960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fba68005cc0 tx=0x7fba68003970 comp rx=0 tx=0).stop 2024-08-18T22:07:00.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.658+0000 7fba75c93640 1 -- 172.21.15.123:0/1430210690 shutdown_connections 2024-08-18T22:07:00.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.658+0000 7fba75c93640 1 --2- 172.21.15.123:0/1430210690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba701067b0 0x7fba7019b960 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:00.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.658+0000 7fba75c93640 1 --2- 172.21.15.123:0/1430210690 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fba580a2c10 0x7fba580a50d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:00.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.658+0000 7fba75c93640 1 --2- 172.21.15.123:0/1430210690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba70101150 0x7fba701975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:00.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.658+0000 7fba75c93640 1 --2- 172.21.15.123:0/1430210690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba701007b0 0x7fba70197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:00.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.658+0000 7fba75c93640 1 -- 172.21.15.123:0/1430210690 >> 172.21.15.123:0/1430210690 conn(0x7fba700fc4d0 msgr2=0x7fba700fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:00.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.659+0000 7fba75c93640 1 -- 172.21.15.123:0/1430210690 shutdown_connections 2024-08-18T22:07:00.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:00.659+0000 7fba75c93640 1 -- 172.21.15.123:0/1430210690 wait complete. 2024-08-18T22:07:00.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:00 smithi130 ceph-mon[21698]: pgmap v315: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:00.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:00 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1132345793' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-18T22:07:00.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:00 smithi183 ceph-mon[22097]: pgmap v315: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:00.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:00 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1132345793' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-18T22:07:01.045 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953534 got 137438953537 for osd.4 2024-08-18T22:07:01.045 DEBUG:teuthology.parallel:result is None 2024-08-18T22:07:01.542 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411396 got 77309411399 for osd.2 2024-08-18T22:07:01.542 DEBUG:teuthology.parallel:result is None 2024-08-18T22:07:01.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:01 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1430210690' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-08-18T22:07:01.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:01 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1430210690' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-08-18T22:07:01.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:01 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1430210690' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-08-18T22:07:01.964 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182464 got 107374182468 for osd.3 2024-08-18T22:07:01.964 DEBUG:teuthology.parallel:result is None 2024-08-18T22:07:02.637 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:02 smithi123 ceph-mon[18462]: pgmap v316: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:02.671 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168621 got 240518168623 for osd.8 2024-08-18T22:07:02.671 DEBUG:teuthology.parallel:result is None 2024-08-18T22:07:02.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:02 smithi130 ceph-mon[21698]: pgmap v316: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:02.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:02 smithi183 ceph-mon[22097]: pgmap v316: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:03.148 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743458 got 296352743461 for osd.10 2024-08-18T22:07:03.149 DEBUG:teuthology.parallel:result is None 2024-08-18T22:07:03.149 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-18T22:07:03.149 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-18T22:07:03.406 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:03.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.897+0000 7fae63955640 1 -- 172.21.15.123:0/2303964045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c1007b0 msgr2=0x7fae5c100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:03.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.897+0000 7fae63955640 1 --2- 172.21.15.123:0/2303964045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c1007b0 0x7fae5c100c10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fae50009cd0 tx=0x7fae5002a8e0 comp rx=0 tx=0).stop 2024-08-18T22:07:03.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.897+0000 7fae63955640 1 -- 172.21.15.123:0/2303964045 shutdown_connections 2024-08-18T22:07:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.897+0000 7fae63955640 1 --2- 172.21.15.123:0/2303964045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae5c101150 0x7fae5c10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.897+0000 7fae63955640 1 --2- 172.21.15.123:0/2303964045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c1007b0 0x7fae5c100c10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.897+0000 7fae63955640 1 --2- 172.21.15.123:0/2303964045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c1067b0 0x7fae5c106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.897+0000 7fae63955640 1 -- 172.21.15.123:0/2303964045 >> 172.21.15.123:0/2303964045 conn(0x7fae5c0fc4d0 msgr2=0x7fae5c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.897+0000 7fae63955640 1 -- 172.21.15.123:0/2303964045 shutdown_connections 2024-08-18T22:07:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.897+0000 7fae63955640 1 -- 172.21.15.123:0/2303964045 wait complete. 2024-08-18T22:07:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae63955640 1 Processor -- start 2024-08-18T22:07:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae63955640 1 -- start start 2024-08-18T22:07:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae63955640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c1007b0 0x7fae5c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae63955640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c101150 0x7fae5c1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae63955640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae5c1067b0 0x7fae5c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae63955640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c110c50 con 0x7fae5c101150 2024-08-18T22:07:03.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae63955640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c110ad0 con 0x7fae5c1067b0 2024-08-18T22:07:03.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae63955640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c110dd0 con 0x7fae5c1007b0 2024-08-18T22:07:03.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae60ef0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c101150 0x7fae5c1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:03.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae60ef0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c101150 0x7fae5c1988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40422/0 (socket says 172.21.15.123:40422) 2024-08-18T22:07:03.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae60ef0640 1 -- 172.21.15.123:0/2655016694 learned_addr learned my addr 172.21.15.123:0/2655016694 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:03.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae616f1640 1 --2- 172.21.15.123:0/2655016694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c1007b0 0x7fae5c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:03.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae61ef2640 1 --2- 172.21.15.123:0/2655016694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae5c1067b0 0x7fae5c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:03.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae60ef0640 1 -- 172.21.15.123:0/2655016694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c1007b0 msgr2=0x7fae5c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:03.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae60ef0640 1 --2- 172.21.15.123:0/2655016694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c1007b0 0x7fae5c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:03.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae60ef0640 1 -- 172.21.15.123:0/2655016694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae5c1067b0 msgr2=0x7fae5c19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:03.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae60ef0640 1 --2- 172.21.15.123:0/2655016694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae5c1067b0 0x7fae5c19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:03.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.898+0000 7fae60ef0640 1 -- 172.21.15.123:0/2655016694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5c19d330 con 0x7fae5c101150 2024-08-18T22:07:03.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.899+0000 7fae61ef2640 1 --2- 172.21.15.123:0/2655016694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae5c1067b0 0x7fae5c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:07:03.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.899+0000 7fae60ef0640 1 --2- 172.21.15.123:0/2655016694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c101150 0x7fae5c1988c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fae5002ae00 tx=0x7fae50003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:03.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.899+0000 7fae5a7fc640 1 -- 172.21.15.123:0/2655016694 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae50004240 con 0x7fae5c101150 2024-08-18T22:07:03.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.899+0000 7fae5a7fc640 1 -- 172.21.15.123:0/2655016694 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae500305a0 con 0x7fae5c101150 2024-08-18T22:07:03.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.899+0000 7fae63955640 1 -- 172.21.15.123:0/2655016694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae5c19d5c0 con 0x7fae5c101150 2024-08-18T22:07:03.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.899+0000 7fae5a7fc640 1 -- 172.21.15.123:0/2655016694 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5003a660 con 0x7fae5c101150 2024-08-18T22:07:03.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.899+0000 7fae63955640 1 -- 172.21.15.123:0/2655016694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae5c1a4f00 con 0x7fae5c101150 2024-08-18T22:07:03.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.900+0000 7fae63955640 1 -- 172.21.15.123:0/2655016694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae5c100c90 con 0x7fae5c101150 2024-08-18T22:07:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.901+0000 7fae5a7fc640 1 -- 172.21.15.123:0/2655016694 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fae50030ac0 con 0x7fae5c101150 2024-08-18T22:07:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.902+0000 7fae5a7fc640 1 --2- 172.21.15.123:0/2655016694 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fae440a2c90 0x7fae440a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.902+0000 7fae616f1640 1 --2- 172.21.15.123:0/2655016694 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fae440a2c90 0x7fae440a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.902+0000 7fae5a7fc640 1 -- 172.21.15.123:0/2655016694 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fae5002e030 con 0x7fae5c101150 2024-08-18T22:07:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.903+0000 7fae616f1640 1 --2- 172.21.15.123:0/2655016694 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fae440a2c90 0x7fae440a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fae54009990 tx=0x7fae54009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:03.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:03.906+0000 7fae5a7fc640 1 -- 172.21.15.123:0/2655016694 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fae500098b0 con 0x7fae5c101150 2024-08-18T22:07:04.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:04.069+0000 7fae63955640 1 -- 172.21.15.123:0/2655016694 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fae5c062360 con 0x7fae440a2c90 2024-08-18T22:07:04.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:04.077+0000 7fae5a7fc640 1 -- 172.21.15.123:0/2655016694 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340379 (secure 0 0 0) 0x7fae5c062360 con 0x7fae440a2c90 2024-08-18T22:07:04.082 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:04.084 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-08-18T22:07:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:04.081+0000 7fae63955640 1 -- 172.21.15.123:0/2655016694 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fae440a2c90 msgr2=0x7fae440a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:04.081+0000 7fae63955640 1 --2- 172.21.15.123:0/2655016694 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fae440a2c90 0x7fae440a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fae54009990 tx=0x7fae54009110 comp rx=0 tx=0).stop 2024-08-18T22:07:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:04.081+0000 7fae63955640 1 -- 172.21.15.123:0/2655016694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c101150 msgr2=0x7fae5c1988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:04.081+0000 7fae63955640 1 --2- 172.21.15.123:0/2655016694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c101150 0x7fae5c1988c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fae5002ae00 tx=0x7fae50003ba0 comp rx=0 tx=0).stop 2024-08-18T22:07:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:04.081+0000 7fae63955640 1 -- 172.21.15.123:0/2655016694 shutdown_connections 2024-08-18T22:07:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:04.081+0000 7fae63955640 1 --2- 172.21.15.123:0/2655016694 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fae440a2c90 0x7fae440a5150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:04.081+0000 7fae63955640 1 --2- 172.21.15.123:0/2655016694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae5c1067b0 0x7fae5c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:04.081+0000 7fae63955640 1 --2- 172.21.15.123:0/2655016694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c101150 0x7fae5c1988c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:04.081+0000 7fae63955640 1 --2- 172.21.15.123:0/2655016694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c1007b0 0x7fae5c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:04.081+0000 7fae63955640 1 -- 172.21.15.123:0/2655016694 >> 172.21.15.123:0/2655016694 conn(0x7fae5c0fc4d0 msgr2=0x7fae5c06a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:04.081+0000 7fae63955640 1 -- 172.21.15.123:0/2655016694 shutdown_connections 2024-08-18T22:07:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:04.081+0000 7fae63955640 1 -- 172.21.15.123:0/2655016694 wait complete. 2024-08-18T22:07:04.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:04 smithi123 ceph-mon[18462]: pgmap v317: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:07:04.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:04 smithi130 ceph-mon[21698]: pgmap v317: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:07:04.828 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-08-18T22:07:03.360947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656509,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":513,"num_read_kb":365,"num_write":349,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1229945,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":281,"ondisk_log_size":281,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375708,"kb_used_data":14036,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566116,"statfs":{"total":1151940427776,"available":1151555702784,"internally_reserved":0,"allocated":14372864,"data_stored":7998785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003532"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509743+0000","last_change":"2024-08-18T22:05:19.844674+0000","last_active":"2024-08-18T22:06:10.509743+0000","last_peered":"2024-08-18T22:06:10.509743+0000","last_clean":"2024-08-18T22:06:10.509743+0000","last_became_active":"2024-08-18T22:05:19.844381+0000","last_became_peered":"2024-08-18T22:05:19.844381+0000","last_unstale":"2024-08-18T22:06:10.509743+0000","last_undegraded":"2024-08-18T22:06:10.509743+0000","last_fullsized":"2024-08-18T22:06:10.509743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:58.783222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772174+0000","last_change":"2024-08-18T22:05:21.859013+0000","last_active":"2024-08-18T22:06:10.772174+0000","last_peered":"2024-08-18T22:06:10.772174+0000","last_clean":"2024-08-18T22:06:10.772174+0000","last_became_active":"2024-08-18T22:05:21.858709+0000","last_became_peered":"2024-08-18T22:05:21.858709+0000","last_unstale":"2024-08-18T22:06:10.772174+0000","last_undegraded":"2024-08-18T22:06:10.772174+0000","last_fullsized":"2024-08-18T22:06:10.772174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:34.272340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508245+0000","last_change":"2024-08-18T22:05:28.925735+0000","last_active":"2024-08-18T22:06:10.508245+0000","last_peered":"2024-08-18T22:06:10.508245+0000","last_clean":"2024-08-18T22:06:10.508245+0000","last_became_active":"2024-08-18T22:05:28.925324+0000","last_became_peered":"2024-08-18T22:05:28.925324+0000","last_unstale":"2024-08-18T22:06:10.508245+0000","last_undegraded":"2024-08-18T22:06:10.508245+0000","last_fullsized":"2024-08-18T22:06:10.508245+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:15:58.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772359+0000","last_change":"2024-08-18T22:05:20.290861+0000","last_active":"2024-08-18T22:06:10.772359+0000","last_peered":"2024-08-18T22:06:10.772359+0000","last_clean":"2024-08-18T22:06:10.772359+0000","last_became_active":"2024-08-18T22:05:20.290508+0000","last_became_peered":"2024-08-18T22:05:20.290508+0000","last_unstale":"2024-08-18T22:06:10.772359+0000","last_undegraded":"2024-08-18T22:06:10.772359+0000","last_fullsized":"2024-08-18T22:06:10.772359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:21.462206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509155+0000","last_change":"2024-08-18T22:05:21.863441+0000","last_active":"2024-08-18T22:06:10.509155+0000","last_peered":"2024-08-18T22:06:10.509155+0000","last_clean":"2024-08-18T22:06:10.509155+0000","last_became_active":"2024-08-18T22:05:21.863121+0000","last_became_peered":"2024-08-18T22:05:21.863121+0000","last_unstale":"2024-08-18T22:06:10.509155+0000","last_undegraded":"2024-08-18T22:06:10.509155+0000","last_fullsized":"2024-08-18T22:06:10.509155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:47.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509447+0000","last_change":"2024-08-18T22:05:28.925477+0000","last_active":"2024-08-18T22:06:10.509447+0000","last_peered":"2024-08-18T22:06:10.509447+0000","last_clean":"2024-08-18T22:06:10.509447+0000","last_became_active":"2024-08-18T22:05:28.924922+0000","last_became_peered":"2024-08-18T22:05:28.924922+0000","last_unstale":"2024-08-18T22:06:10.509447+0000","last_undegraded":"2024-08-18T22:06:10.509447+0000","last_fullsized":"2024-08-18T22:06:10.509447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:35.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514293+0000","last_change":"2024-08-18T22:05:19.847979+0000","last_active":"2024-08-18T22:06:10.514293+0000","last_peered":"2024-08-18T22:06:10.514293+0000","last_clean":"2024-08-18T22:06:10.514293+0000","last_became_active":"2024-08-18T22:05:19.847643+0000","last_became_peered":"2024-08-18T22:05:19.847643+0000","last_unstale":"2024-08-18T22:06:10.514293+0000","last_undegraded":"2024-08-18T22:06:10.514293+0000","last_fullsized":"2024-08-18T22:06:10.514293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:33.875378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506424+0000","last_change":"2024-08-18T22:05:21.860225+0000","last_active":"2024-08-18T22:06:10.506424+0000","last_peered":"2024-08-18T22:06:10.506424+0000","last_clean":"2024-08-18T22:06:10.506424+0000","last_became_active":"2024-08-18T22:05:21.859889+0000","last_became_peered":"2024-08-18T22:05:21.859889+0000","last_unstale":"2024-08-18T22:06:10.506424+0000","last_undegraded":"2024-08-18T22:06:10.506424+0000","last_fullsized":"2024-08-18T22:06:10.506424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:06:27.084401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511096+0000","last_change":"2024-08-18T22:05:28.922230+0000","last_active":"2024-08-18T22:06:10.511096+0000","last_peered":"2024-08-18T22:06:10.511096+0000","last_clean":"2024-08-18T22:06:10.511096+0000","last_became_active":"2024-08-18T22:05:28.921804+0000","last_became_peered":"2024-08-18T22:05:28.921804+0000","last_unstale":"2024-08-18T22:06:10.511096+0000","last_undegraded":"2024-08-18T22:06:10.511096+0000","last_fullsized":"2024-08-18T22:06:10.511096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:17.735645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514907+0000","last_change":"2024-08-18T22:05:19.841452+0000","last_active":"2024-08-18T22:06:10.514907+0000","last_peered":"2024-08-18T22:06:10.514907+0000","last_clean":"2024-08-18T22:06:10.514907+0000","last_became_active":"2024-08-18T22:05:19.840997+0000","last_became_peered":"2024-08-18T22:05:19.840997+0000","last_unstale":"2024-08-18T22:06:10.514907+0000","last_undegraded":"2024-08-18T22:06:10.514907+0000","last_fullsized":"2024-08-18T22:06:10.514907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:27:26.208279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514673+0000","last_change":"2024-08-18T22:06:10.514673+0000","last_active":"2024-08-18T22:06:10.514673+0000","last_peered":"2024-08-18T22:06:10.514673+0000","last_clean":"2024-08-18T22:06:10.514673+0000","last_became_active":"2024-08-18T22:06:10.514264+0000","last_became_peered":"2024-08-18T22:06:10.514264+0000","last_unstale":"2024-08-18T22:06:10.514673+0000","last_undegraded":"2024-08-18T22:06:10.514673+0000","last_fullsized":"2024-08-18T22:06:10.514673+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:03.626895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509642+0000","last_change":"2024-08-18T22:05:28.924521+0000","last_active":"2024-08-18T22:06:10.509642+0000","last_peered":"2024-08-18T22:06:10.509642+0000","last_clean":"2024-08-18T22:06:10.509642+0000","last_became_active":"2024-08-18T22:05:28.924107+0000","last_became_peered":"2024-08-18T22:05:28.924107+0000","last_unstale":"2024-08-18T22:06:10.509642+0000","last_undegraded":"2024-08-18T22:06:10.509642+0000","last_fullsized":"2024-08-18T22:06:10.509642+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:37.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508303+0000","last_change":"2024-08-18T22:05:21.861696+0000","last_active":"2024-08-18T22:06:10.508303+0000","last_peered":"2024-08-18T22:06:10.508303+0000","last_clean":"2024-08-18T22:06:10.508303+0000","last_became_active":"2024-08-18T22:05:21.861220+0000","last_became_peered":"2024-08-18T22:05:21.861220+0000","last_unstale":"2024-08-18T22:06:10.508303+0000","last_undegraded":"2024-08-18T22:06:10.508303+0000","last_fullsized":"2024-08-18T22:06:10.508303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:01.098281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.520590+0000","last_change":"2024-08-18T22:06:10.520097+0000","last_active":"2024-08-18T22:06:10.520590+0000","last_peered":"2024-08-18T22:06:10.520590+0000","last_clean":"2024-08-18T22:06:10.520590+0000","last_became_active":"2024-08-18T22:06:10.513286+0000","last_became_peered":"2024-08-18T22:06:10.513286+0000","last_unstale":"2024-08-18T22:06:10.520590+0000","last_undegraded":"2024-08-18T22:06:10.520590+0000","last_fullsized":"2024-08-18T22:06:10.520590+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:08:18.861243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509973+0000","last_change":"2024-08-18T22:05:29.013139+0000","last_active":"2024-08-18T22:06:10.509973+0000","last_peered":"2024-08-18T22:06:10.509973+0000","last_clean":"2024-08-18T22:06:10.509973+0000","last_became_active":"2024-08-18T22:05:29.012322+0000","last_became_peered":"2024-08-18T22:05:29.012322+0000","last_unstale":"2024-08-18T22:06:10.509973+0000","last_undegraded":"2024-08-18T22:06:10.509973+0000","last_fullsized":"2024-08-18T22:06:10.509973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:32.348201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772162+0000","last_change":"2024-08-18T22:05:21.860410+0000","last_active":"2024-08-18T22:06:10.772162+0000","last_peered":"2024-08-18T22:06:10.772162+0000","last_clean":"2024-08-18T22:06:10.772162+0000","last_became_active":"2024-08-18T22:05:21.860173+0000","last_became_peered":"2024-08-18T22:05:21.860173+0000","last_unstale":"2024-08-18T22:06:10.772162+0000","last_undegraded":"2024-08-18T22:06:10.772162+0000","last_fullsized":"2024-08-18T22:06:10.772162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:00.879178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507956+0000","last_change":"2024-08-18T22:05:19.845785+0000","last_active":"2024-08-18T22:06:10.507956+0000","last_peered":"2024-08-18T22:06:10.507956+0000","last_clean":"2024-08-18T22:06:10.507956+0000","last_became_active":"2024-08-18T22:05:19.845414+0000","last_became_peered":"2024-08-18T22:05:19.845414+0000","last_unstale":"2024-08-18T22:06:10.507956+0000","last_undegraded":"2024-08-18T22:06:10.507956+0000","last_fullsized":"2024-08-18T22:06:10.507956+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:13.504885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.523404+0000","last_change":"2024-08-18T22:06:10.523404+0000","last_active":"2024-08-18T22:06:10.523404+0000","last_peered":"2024-08-18T22:06:10.523404+0000","last_clean":"2024-08-18T22:06:10.523404+0000","last_became_active":"2024-08-18T22:06:10.516652+0000","last_became_peered":"2024-08-18T22:06:10.516652+0000","last_unstale":"2024-08-18T22:06:10.523404+0000","last_undegraded":"2024-08-18T22:06:10.523404+0000","last_fullsized":"2024-08-18T22:06:10.523404+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:58.197636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510102+0000","last_change":"2024-08-18T22:05:21.858329+0000","last_active":"2024-08-18T22:06:10.510102+0000","last_peered":"2024-08-18T22:06:10.510102+0000","last_clean":"2024-08-18T22:06:10.510102+0000","last_became_active":"2024-08-18T22:05:21.857854+0000","last_became_peered":"2024-08-18T22:05:21.857854+0000","last_unstale":"2024-08-18T22:06:10.510102+0000","last_undegraded":"2024-08-18T22:06:10.510102+0000","last_fullsized":"2024-08-18T22:06:10.510102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:45:19.934647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772068+0000","last_change":"2024-08-18T22:05:19.843031+0000","last_active":"2024-08-18T22:06:10.772068+0000","last_peered":"2024-08-18T22:06:10.772068+0000","last_clean":"2024-08-18T22:06:10.772068+0000","last_became_active":"2024-08-18T22:05:19.842694+0000","last_became_peered":"2024-08-18T22:05:19.842694+0000","last_unstale":"2024-08-18T22:06:10.772068+0000","last_undegraded":"2024-08-18T22:06:10.772068+0000","last_fullsized":"2024-08-18T22:06:10.772068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:01.135449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509575+0000","last_change":"2024-08-18T22:05:28.920647+0000","last_active":"2024-08-18T22:06:10.509575+0000","last_peered":"2024-08-18T22:06:10.509575+0000","last_clean":"2024-08-18T22:06:10.509575+0000","last_became_active":"2024-08-18T22:05:28.920295+0000","last_became_peered":"2024-08-18T22:05:28.920295+0000","last_unstale":"2024-08-18T22:06:10.509575+0000","last_undegraded":"2024-08-18T22:06:10.509575+0000","last_fullsized":"2024-08-18T22:06:10.509575+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:41.295009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513283+0000","last_change":"2024-08-18T22:05:21.858413+0000","last_active":"2024-08-18T22:06:10.513283+0000","last_peered":"2024-08-18T22:06:10.513283+0000","last_clean":"2024-08-18T22:06:10.513283+0000","last_became_active":"2024-08-18T22:05:21.858102+0000","last_became_peered":"2024-08-18T22:05:21.858102+0000","last_unstale":"2024-08-18T22:06:10.513283+0000","last_undegraded":"2024-08-18T22:06:10.513283+0000","last_fullsized":"2024-08-18T22:06:10.513283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:24:59.432666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506163+0000","last_change":"2024-08-18T22:05:20.292085+0000","last_active":"2024-08-18T22:06:10.506163+0000","last_peered":"2024-08-18T22:06:10.506163+0000","last_clean":"2024-08-18T22:06:10.506163+0000","last_became_active":"2024-08-18T22:05:20.291606+0000","last_became_peered":"2024-08-18T22:05:20.291606+0000","last_unstale":"2024-08-18T22:06:10.506163+0000","last_undegraded":"2024-08-18T22:06:10.506163+0000","last_fullsized":"2024-08-18T22:06:10.506163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:22:46.801719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515755+0000","last_change":"2024-08-18T22:06:10.515755+0000","last_active":"2024-08-18T22:06:10.515755+0000","last_peered":"2024-08-18T22:06:10.515755+0000","last_clean":"2024-08-18T22:06:10.515755+0000","last_became_active":"2024-08-18T22:06:10.514624+0000","last_became_peered":"2024-08-18T22:06:10.514624+0000","last_unstale":"2024-08-18T22:06:10.515755+0000","last_undegraded":"2024-08-18T22:06:10.515755+0000","last_fullsized":"2024-08-18T22:06:10.515755+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:18:50.785139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508880+0000","last_change":"2024-08-18T22:05:21.855163+0000","last_active":"2024-08-18T22:06:10.508880+0000","last_peered":"2024-08-18T22:06:10.508880+0000","last_clean":"2024-08-18T22:06:10.508880+0000","last_became_active":"2024-08-18T22:05:21.854867+0000","last_became_peered":"2024-08-18T22:05:21.854867+0000","last_unstale":"2024-08-18T22:06:10.508880+0000","last_undegraded":"2024-08-18T22:06:10.508880+0000","last_fullsized":"2024-08-18T22:06:10.508880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:10.300307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510102+0000","last_change":"2024-08-18T22:05:20.082363+0000","last_active":"2024-08-18T22:06:10.510102+0000","last_peered":"2024-08-18T22:06:10.510102+0000","last_clean":"2024-08-18T22:06:10.510102+0000","last_became_active":"2024-08-18T22:05:20.081998+0000","last_became_peered":"2024-08-18T22:05:20.081998+0000","last_unstale":"2024-08-18T22:06:10.510102+0000","last_undegraded":"2024-08-18T22:06:10.510102+0000","last_fullsized":"2024-08-18T22:06:10.510102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:44.960512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508721+0000","last_change":"2024-08-18T22:05:28.924072+0000","last_active":"2024-08-18T22:06:10.508721+0000","last_peered":"2024-08-18T22:06:10.508721+0000","last_clean":"2024-08-18T22:06:10.508721+0000","last_became_active":"2024-08-18T22:05:28.923673+0000","last_became_peered":"2024-08-18T22:05:28.923673+0000","last_unstale":"2024-08-18T22:06:10.508721+0000","last_undegraded":"2024-08-18T22:06:10.508721+0000","last_fullsized":"2024-08-18T22:06:10.508721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:44.593009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772399+0000","last_change":"2024-08-18T22:05:21.851377+0000","last_active":"2024-08-18T22:06:10.772399+0000","last_peered":"2024-08-18T22:06:10.772399+0000","last_clean":"2024-08-18T22:06:10.772399+0000","last_became_active":"2024-08-18T22:05:21.851031+0000","last_became_peered":"2024-08-18T22:05:21.851031+0000","last_unstale":"2024-08-18T22:06:10.772399+0000","last_undegraded":"2024-08-18T22:06:10.772399+0000","last_fullsized":"2024-08-18T22:06:10.772399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.547244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'11","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:13.873627+0000","last_change":"2024-08-18T22:05:19.840697+0000","last_active":"2024-08-18T22:06:13.873627+0000","last_peered":"2024-08-18T22:06:13.873627+0000","last_clean":"2024-08-18T22:06:13.873627+0000","last_became_active":"2024-08-18T22:05:19.840382+0000","last_became_peered":"2024-08-18T22:05:19.840382+0000","last_unstale":"2024-08-18T22:06:13.873627+0000","last_undegraded":"2024-08-18T22:06:13.873627+0000","last_fullsized":"2024-08-18T22:06:13.873627+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:24.514428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771817+0000","last_change":"2024-08-18T22:05:29.012305+0000","last_active":"2024-08-18T22:06:10.771817+0000","last_peered":"2024-08-18T22:06:10.771817+0000","last_clean":"2024-08-18T22:06:10.771817+0000","last_became_active":"2024-08-18T22:05:29.011846+0000","last_became_peered":"2024-08-18T22:05:29.011846+0000","last_unstale":"2024-08-18T22:06:10.771817+0000","last_undegraded":"2024-08-18T22:06:10.771817+0000","last_fullsized":"2024-08-18T22:06:10.771817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:36.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506016+0000","last_change":"2024-08-18T22:05:21.856182+0000","last_active":"2024-08-18T22:06:10.506016+0000","last_peered":"2024-08-18T22:06:10.506016+0000","last_clean":"2024-08-18T22:06:10.506016+0000","last_became_active":"2024-08-18T22:05:21.855855+0000","last_became_peered":"2024-08-18T22:05:21.855855+0000","last_unstale":"2024-08-18T22:06:10.506016+0000","last_undegraded":"2024-08-18T22:06:10.506016+0000","last_fullsized":"2024-08-18T22:06:10.506016+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:00.166809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514793+0000","last_change":"2024-08-18T22:05:20.291272+0000","last_active":"2024-08-18T22:06:10.514793+0000","last_peered":"2024-08-18T22:06:10.514793+0000","last_clean":"2024-08-18T22:06:10.514793+0000","last_became_active":"2024-08-18T22:05:20.290970+0000","last_became_peered":"2024-08-18T22:05:20.290970+0000","last_unstale":"2024-08-18T22:06:10.514793+0000","last_undegraded":"2024-08-18T22:06:10.514793+0000","last_fullsized":"2024-08-18T22:06:10.514793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:29.438996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510601+0000","last_change":"2024-08-18T22:05:28.923141+0000","last_active":"2024-08-18T22:06:10.510601+0000","last_peered":"2024-08-18T22:06:10.510601+0000","last_clean":"2024-08-18T22:06:10.510601+0000","last_became_active":"2024-08-18T22:05:28.922269+0000","last_became_peered":"2024-08-18T22:05:28.922269+0000","last_unstale":"2024-08-18T22:06:10.510601+0000","last_undegraded":"2024-08-18T22:06:10.510601+0000","last_fullsized":"2024-08-18T22:06:10.510601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:58.092640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509287+0000","last_change":"2024-08-18T22:05:21.850124+0000","last_active":"2024-08-18T22:06:10.509287+0000","last_peered":"2024-08-18T22:06:10.509287+0000","last_clean":"2024-08-18T22:06:10.509287+0000","last_became_active":"2024-08-18T22:05:21.849805+0000","last_became_peered":"2024-08-18T22:05:21.849805+0000","last_unstale":"2024-08-18T22:06:10.509287+0000","last_undegraded":"2024-08-18T22:06:10.509287+0000","last_fullsized":"2024-08-18T22:06:10.509287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:53.492613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509230+0000","last_change":"2024-08-18T22:05:20.292836+0000","last_active":"2024-08-18T22:06:10.509230+0000","last_peered":"2024-08-18T22:06:10.509230+0000","last_clean":"2024-08-18T22:06:10.509230+0000","last_became_active":"2024-08-18T22:05:20.292456+0000","last_became_peered":"2024-08-18T22:05:20.292456+0000","last_unstale":"2024-08-18T22:06:10.509230+0000","last_undegraded":"2024-08-18T22:06:10.509230+0000","last_fullsized":"2024-08-18T22:06:10.509230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:19.525037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513298+0000","last_change":"2024-08-18T22:05:29.012439+0000","last_active":"2024-08-18T22:06:10.513298+0000","last_peered":"2024-08-18T22:06:10.513298+0000","last_clean":"2024-08-18T22:06:10.513298+0000","last_became_active":"2024-08-18T22:05:29.011860+0000","last_became_peered":"2024-08-18T22:05:29.011860+0000","last_unstale":"2024-08-18T22:06:10.513298+0000","last_undegraded":"2024-08-18T22:06:10.513298+0000","last_fullsized":"2024-08-18T22:06:10.513298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:03.432217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509272+0000","last_change":"2024-08-18T22:05:21.855598+0000","last_active":"2024-08-18T22:06:10.509272+0000","last_peered":"2024-08-18T22:06:10.509272+0000","last_clean":"2024-08-18T22:06:10.509272+0000","last_became_active":"2024-08-18T22:05:21.855228+0000","last_became_peered":"2024-08-18T22:05:21.855228+0000","last_unstale":"2024-08-18T22:06:10.509272+0000","last_undegraded":"2024-08-18T22:06:10.509272+0000","last_fullsized":"2024-08-18T22:06:10.509272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:33.762700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508476+0000","last_change":"2024-08-18T22:05:19.844638+0000","last_active":"2024-08-18T22:06:10.508476+0000","last_peered":"2024-08-18T22:06:10.508476+0000","last_clean":"2024-08-18T22:06:10.508476+0000","last_became_active":"2024-08-18T22:05:19.844333+0000","last_became_peered":"2024-08-18T22:05:19.844333+0000","last_unstale":"2024-08-18T22:06:10.508476+0000","last_undegraded":"2024-08-18T22:06:10.508476+0000","last_fullsized":"2024-08-18T22:06:10.508476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:26.947512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505914+0000","last_change":"2024-08-18T22:05:28.919965+0000","last_active":"2024-08-18T22:06:10.505914+0000","last_peered":"2024-08-18T22:06:10.505914+0000","last_clean":"2024-08-18T22:06:10.505914+0000","last_became_active":"2024-08-18T22:05:28.919546+0000","last_became_peered":"2024-08-18T22:05:28.919546+0000","last_unstale":"2024-08-18T22:06:10.505914+0000","last_undegraded":"2024-08-18T22:06:10.505914+0000","last_fullsized":"2024-08-18T22:06:10.505914+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:49.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506450+0000","last_change":"2024-08-18T22:05:21.857867+0000","last_active":"2024-08-18T22:06:10.506450+0000","last_peered":"2024-08-18T22:06:10.506450+0000","last_clean":"2024-08-18T22:06:10.506450+0000","last_became_active":"2024-08-18T22:05:21.857515+0000","last_became_peered":"2024-08-18T22:05:21.857515+0000","last_unstale":"2024-08-18T22:06:10.506450+0000","last_undegraded":"2024-08-18T22:06:10.506450+0000","last_fullsized":"2024-08-18T22:06:10.506450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:51.148321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:56.542845+0000","last_change":"2024-08-18T22:05:20.290924+0000","last_active":"2024-08-18T22:06:56.542845+0000","last_peered":"2024-08-18T22:06:56.542845+0000","last_clean":"2024-08-18T22:06:56.542845+0000","last_became_active":"2024-08-18T22:05:20.290587+0000","last_became_peered":"2024-08-18T22:05:20.290587+0000","last_unstale":"2024-08-18T22:06:56.542845+0000","last_undegraded":"2024-08-18T22:06:56.542845+0000","last_fullsized":"2024-08-18T22:06:56.542845+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:35.029634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505852+0000","last_change":"2024-08-18T22:05:29.012876+0000","last_active":"2024-08-18T22:06:10.505852+0000","last_peered":"2024-08-18T22:06:10.505852+0000","last_clean":"2024-08-18T22:06:10.505852+0000","last_became_active":"2024-08-18T22:05:29.011930+0000","last_became_peered":"2024-08-18T22:05:29.011930+0000","last_unstale":"2024-08-18T22:06:10.505852+0000","last_undegraded":"2024-08-18T22:06:10.505852+0000","last_fullsized":"2024-08-18T22:06:10.505852+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:22:35.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505526+0000","last_change":"2024-08-18T22:05:21.860798+0000","last_active":"2024-08-18T22:06:10.505526+0000","last_peered":"2024-08-18T22:06:10.505526+0000","last_clean":"2024-08-18T22:06:10.505526+0000","last_became_active":"2024-08-18T22:05:21.856968+0000","last_became_peered":"2024-08-18T22:05:21.856968+0000","last_unstale":"2024-08-18T22:06:10.505526+0000","last_undegraded":"2024-08-18T22:06:10.505526+0000","last_fullsized":"2024-08-18T22:06:10.505526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:54.934400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508009+0000","last_change":"2024-08-18T22:05:19.844775+0000","last_active":"2024-08-18T22:06:10.508009+0000","last_peered":"2024-08-18T22:06:10.508009+0000","last_clean":"2024-08-18T22:06:10.508009+0000","last_became_active":"2024-08-18T22:05:19.844465+0000","last_became_peered":"2024-08-18T22:05:19.844465+0000","last_unstale":"2024-08-18T22:06:10.508009+0000","last_undegraded":"2024-08-18T22:06:10.508009+0000","last_fullsized":"2024-08-18T22:06:10.508009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.042335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507348+0000","last_change":"2024-08-18T22:05:29.013275+0000","last_active":"2024-08-18T22:06:10.507348+0000","last_peered":"2024-08-18T22:06:10.507348+0000","last_clean":"2024-08-18T22:06:10.507348+0000","last_became_active":"2024-08-18T22:05:29.012537+0000","last_became_peered":"2024-08-18T22:05:29.012537+0000","last_unstale":"2024-08-18T22:06:10.507348+0000","last_undegraded":"2024-08-18T22:06:10.507348+0000","last_fullsized":"2024-08-18T22:06:10.507348+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:15:39.775360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772046+0000","last_change":"2024-08-18T22:05:21.853358+0000","last_active":"2024-08-18T22:06:10.772046+0000","last_peered":"2024-08-18T22:06:10.772046+0000","last_clean":"2024-08-18T22:06:10.772046+0000","last_became_active":"2024-08-18T22:05:21.853071+0000","last_became_peered":"2024-08-18T22:05:21.853071+0000","last_unstale":"2024-08-18T22:06:10.772046+0000","last_undegraded":"2024-08-18T22:06:10.772046+0000","last_fullsized":"2024-08-18T22:06:10.772046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:23.755263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511287+0000","last_change":"2024-08-18T22:05:19.846922+0000","last_active":"2024-08-18T22:06:10.511287+0000","last_peered":"2024-08-18T22:06:10.511287+0000","last_clean":"2024-08-18T22:06:10.511287+0000","last_became_active":"2024-08-18T22:05:19.846619+0000","last_became_peered":"2024-08-18T22:05:19.846619+0000","last_unstale":"2024-08-18T22:06:10.511287+0000","last_undegraded":"2024-08-18T22:06:10.511287+0000","last_fullsized":"2024-08-18T22:06:10.511287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:36:16.232344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":352,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508214+0000","last_change":"2024-08-18T22:04:11.878703+0000","last_active":"2024-08-18T22:06:10.508214+0000","last_peered":"2024-08-18T22:06:10.508214+0000","last_clean":"2024-08-18T22:06:10.508214+0000","last_became_active":"2024-08-18T22:04:11.878157+0000","last_became_peered":"2024-08-18T22:04:11.878157+0000","last_unstale":"2024-08-18T22:06:10.508214+0000","last_undegraded":"2024-08-18T22:06:10.508214+0000","last_fullsized":"2024-08-18T22:06:10.508214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_clean_scrub_stamp":"2024-08-18T22:01:09.551264+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:24:07.391758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508423+0000","last_change":"2024-08-18T22:05:28.928882+0000","last_active":"2024-08-18T22:06:10.508423+0000","last_peered":"2024-08-18T22:06:10.508423+0000","last_clean":"2024-08-18T22:06:10.508423+0000","last_became_active":"2024-08-18T22:05:28.928482+0000","last_became_peered":"2024-08-18T22:05:28.928482+0000","last_unstale":"2024-08-18T22:06:10.508423+0000","last_undegraded":"2024-08-18T22:06:10.508423+0000","last_fullsized":"2024-08-18T22:06:10.508423+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:41.739482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508689+0000","last_change":"2024-08-18T22:05:21.863045+0000","last_active":"2024-08-18T22:06:10.508689+0000","last_peered":"2024-08-18T22:06:10.508689+0000","last_clean":"2024-08-18T22:06:10.508689+0000","last_became_active":"2024-08-18T22:05:21.862758+0000","last_became_peered":"2024-08-18T22:05:21.862758+0000","last_unstale":"2024-08-18T22:06:10.508689+0000","last_undegraded":"2024-08-18T22:06:10.508689+0000","last_fullsized":"2024-08-18T22:06:10.508689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:08:39.111147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509216+0000","last_change":"2024-08-18T22:05:20.291030+0000","last_active":"2024-08-18T22:06:10.509216+0000","last_peered":"2024-08-18T22:06:10.509216+0000","last_clean":"2024-08-18T22:06:10.509216+0000","last_became_active":"2024-08-18T22:05:20.290427+0000","last_became_peered":"2024-08-18T22:05:20.290427+0000","last_unstale":"2024-08-18T22:06:10.509216+0000","last_undegraded":"2024-08-18T22:06:10.509216+0000","last_fullsized":"2024-08-18T22:06:10.509216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:14:42.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506125+0000","last_change":"2024-08-18T22:05:28.923700+0000","last_active":"2024-08-18T22:06:10.506125+0000","last_peered":"2024-08-18T22:06:10.506125+0000","last_clean":"2024-08-18T22:06:10.506125+0000","last_became_active":"2024-08-18T22:05:28.923280+0000","last_became_peered":"2024-08-18T22:05:28.923280+0000","last_unstale":"2024-08-18T22:06:10.506125+0000","last_undegraded":"2024-08-18T22:06:10.506125+0000","last_fullsized":"2024-08-18T22:06:10.506125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:25:45.343542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508357+0000","last_change":"2024-08-18T22:05:21.856107+0000","last_active":"2024-08-18T22:06:10.508357+0000","last_peered":"2024-08-18T22:06:10.508357+0000","last_clean":"2024-08-18T22:06:10.508357+0000","last_became_active":"2024-08-18T22:05:21.853276+0000","last_became_peered":"2024-08-18T22:05:21.853276+0000","last_unstale":"2024-08-18T22:06:10.508357+0000","last_undegraded":"2024-08-18T22:06:10.508357+0000","last_fullsized":"2024-08-18T22:06:10.508357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:58.280375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507968+0000","last_change":"2024-08-18T22:05:19.843445+0000","last_active":"2024-08-18T22:06:10.507968+0000","last_peered":"2024-08-18T22:06:10.507968+0000","last_clean":"2024-08-18T22:06:10.507968+0000","last_became_active":"2024-08-18T22:05:19.843000+0000","last_became_peered":"2024-08-18T22:05:19.843000+0000","last_unstale":"2024-08-18T22:06:10.507968+0000","last_undegraded":"2024-08-18T22:06:10.507968+0000","last_fullsized":"2024-08-18T22:06:10.507968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:23.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515953+0000","last_change":"2024-08-18T22:06:10.515953+0000","last_active":"2024-08-18T22:06:10.515953+0000","last_peered":"2024-08-18T22:06:10.515953+0000","last_clean":"2024-08-18T22:06:10.515953+0000","last_became_active":"2024-08-18T22:06:10.515662+0000","last_became_peered":"2024-08-18T22:06:10.515662+0000","last_unstale":"2024-08-18T22:06:10.515953+0000","last_undegraded":"2024-08-18T22:06:10.515953+0000","last_fullsized":"2024-08-18T22:06:10.515953+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:43.150180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509215+0000","last_change":"2024-08-18T22:05:21.864029+0000","last_active":"2024-08-18T22:06:10.509215+0000","last_peered":"2024-08-18T22:06:10.509215+0000","last_clean":"2024-08-18T22:06:10.509215+0000","last_became_active":"2024-08-18T22:05:21.863509+0000","last_became_peered":"2024-08-18T22:05:21.863509+0000","last_unstale":"2024-08-18T22:06:10.509215+0000","last_undegraded":"2024-08-18T22:06:10.509215+0000","last_fullsized":"2024-08-18T22:06:10.509215+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:42.879243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506010+0000","last_change":"2024-08-18T22:05:19.846514+0000","last_active":"2024-08-18T22:06:10.506010+0000","last_peered":"2024-08-18T22:06:10.506010+0000","last_clean":"2024-08-18T22:06:10.506010+0000","last_became_active":"2024-08-18T22:05:19.846190+0000","last_became_peered":"2024-08-18T22:05:19.846190+0000","last_unstale":"2024-08-18T22:06:10.506010+0000","last_undegraded":"2024-08-18T22:06:10.506010+0000","last_fullsized":"2024-08-18T22:06:10.506010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:49:00.317597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506329+0000","last_change":"2024-08-18T22:05:28.923183+0000","last_active":"2024-08-18T22:06:10.506329+0000","last_peered":"2024-08-18T22:06:10.506329+0000","last_clean":"2024-08-18T22:06:10.506329+0000","last_became_active":"2024-08-18T22:05:28.922809+0000","last_became_peered":"2024-08-18T22:05:28.922809+0000","last_unstale":"2024-08-18T22:06:10.506329+0000","last_undegraded":"2024-08-18T22:06:10.506329+0000","last_fullsized":"2024-08-18T22:06:10.506329+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:26.416920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510283+0000","last_change":"2024-08-18T22:05:21.849075+0000","last_active":"2024-08-18T22:06:10.510283+0000","last_peered":"2024-08-18T22:06:10.510283+0000","last_clean":"2024-08-18T22:06:10.510283+0000","last_became_active":"2024-08-18T22:05:21.848759+0000","last_became_peered":"2024-08-18T22:05:21.848759+0000","last_unstale":"2024-08-18T22:06:10.510283+0000","last_undegraded":"2024-08-18T22:06:10.510283+0000","last_fullsized":"2024-08-18T22:06:10.510283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:26.531534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515145+0000","last_change":"2024-08-18T22:05:19.849210+0000","last_active":"2024-08-18T22:06:10.515145+0000","last_peered":"2024-08-18T22:06:10.515145+0000","last_clean":"2024-08-18T22:06:10.515145+0000","last_became_active":"2024-08-18T22:05:19.848829+0000","last_became_peered":"2024-08-18T22:05:19.848829+0000","last_unstale":"2024-08-18T22:06:10.515145+0000","last_undegraded":"2024-08-18T22:06:10.515145+0000","last_fullsized":"2024-08-18T22:06:10.515145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:19.321686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506551+0000","last_change":"2024-08-18T22:05:28.924577+0000","last_active":"2024-08-18T22:06:10.506551+0000","last_peered":"2024-08-18T22:06:10.506551+0000","last_clean":"2024-08-18T22:06:10.506551+0000","last_became_active":"2024-08-18T22:05:28.924183+0000","last_became_peered":"2024-08-18T22:05:28.924183+0000","last_unstale":"2024-08-18T22:06:10.506551+0000","last_undegraded":"2024-08-18T22:06:10.506551+0000","last_fullsized":"2024-08-18T22:06:10.506551+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:22.702757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513994+0000","last_change":"2024-08-18T22:06:10.513610+0000","last_active":"2024-08-18T22:06:10.513994+0000","last_peered":"2024-08-18T22:06:10.513994+0000","last_clean":"2024-08-18T22:06:10.513994+0000","last_became_active":"2024-08-18T22:06:10.513400+0000","last_became_peered":"2024-08-18T22:06:10.513400+0000","last_unstale":"2024-08-18T22:06:10.513994+0000","last_undegraded":"2024-08-18T22:06:10.513994+0000","last_fullsized":"2024-08-18T22:06:10.513994+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:49.275223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513546+0000","last_change":"2024-08-18T22:05:20.291752+0000","last_active":"2024-08-18T22:06:10.513546+0000","last_peered":"2024-08-18T22:06:10.513546+0000","last_clean":"2024-08-18T22:06:10.513546+0000","last_became_active":"2024-08-18T22:05:20.291431+0000","last_became_peered":"2024-08-18T22:05:20.291431+0000","last_unstale":"2024-08-18T22:06:10.513546+0000","last_undegraded":"2024-08-18T22:06:10.513546+0000","last_fullsized":"2024-08-18T22:06:10.513546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:32.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506003+0000","last_change":"2024-08-18T22:05:28.924121+0000","last_active":"2024-08-18T22:06:10.506003+0000","last_peered":"2024-08-18T22:06:10.506003+0000","last_clean":"2024-08-18T22:06:10.506003+0000","last_became_active":"2024-08-18T22:05:28.923753+0000","last_became_peered":"2024-08-18T22:05:28.923753+0000","last_unstale":"2024-08-18T22:06:10.506003+0000","last_undegraded":"2024-08-18T22:06:10.506003+0000","last_fullsized":"2024-08-18T22:06:10.506003+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:57.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507828+0000","last_change":"2024-08-18T22:05:21.858366+0000","last_active":"2024-08-18T22:06:10.507828+0000","last_peered":"2024-08-18T22:06:10.507828+0000","last_clean":"2024-08-18T22:06:10.507828+0000","last_became_active":"2024-08-18T22:05:21.858021+0000","last_became_peered":"2024-08-18T22:05:21.858021+0000","last_unstale":"2024-08-18T22:06:10.507828+0000","last_undegraded":"2024-08-18T22:06:10.507828+0000","last_fullsized":"2024-08-18T22:06:10.507828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:55.662965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'4","reported_seq":102,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:57.544762+0000","last_change":"2024-08-18T22:05:19.850013+0000","last_active":"2024-08-18T22:06:57.544762+0000","last_peered":"2024-08-18T22:06:57.544762+0000","last_clean":"2024-08-18T22:06:57.544762+0000","last_became_active":"2024-08-18T22:05:19.849551+0000","last_became_peered":"2024-08-18T22:05:19.849551+0000","last_unstale":"2024-08-18T22:06:57.544762+0000","last_undegraded":"2024-08-18T22:06:57.544762+0000","last_fullsized":"2024-08-18T22:06:57.544762+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:15.182999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509627+0000","last_change":"2024-08-18T22:05:28.927318+0000","last_active":"2024-08-18T22:06:10.509627+0000","last_peered":"2024-08-18T22:06:10.509627+0000","last_clean":"2024-08-18T22:06:10.509627+0000","last_became_active":"2024-08-18T22:05:28.926786+0000","last_became_peered":"2024-08-18T22:05:28.926786+0000","last_unstale":"2024-08-18T22:06:10.509627+0000","last_undegraded":"2024-08-18T22:06:10.509627+0000","last_fullsized":"2024-08-18T22:06:10.509627+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:45.798247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511821+0000","last_change":"2024-08-18T22:06:10.511821+0000","last_active":"2024-08-18T22:06:10.511821+0000","last_peered":"2024-08-18T22:06:10.511821+0000","last_clean":"2024-08-18T22:06:10.511821+0000","last_became_active":"2024-08-18T22:06:10.511135+0000","last_became_peered":"2024-08-18T22:06:10.511135+0000","last_unstale":"2024-08-18T22:06:10.511821+0000","last_undegraded":"2024-08-18T22:06:10.511821+0000","last_fullsized":"2024-08-18T22:06:10.511821+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:07.108531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506959+0000","last_change":"2024-08-18T22:05:19.844061+0000","last_active":"2024-08-18T22:06:10.506959+0000","last_peered":"2024-08-18T22:06:10.506959+0000","last_clean":"2024-08-18T22:06:10.506959+0000","last_became_active":"2024-08-18T22:05:19.843513+0000","last_became_peered":"2024-08-18T22:05:19.843513+0000","last_unstale":"2024-08-18T22:06:10.506959+0000","last_undegraded":"2024-08-18T22:06:10.506959+0000","last_fullsized":"2024-08-18T22:06:10.506959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:53.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510069+0000","last_change":"2024-08-18T22:05:28.922986+0000","last_active":"2024-08-18T22:06:10.510069+0000","last_peered":"2024-08-18T22:06:10.510069+0000","last_clean":"2024-08-18T22:06:10.510069+0000","last_became_active":"2024-08-18T22:05:28.922322+0000","last_became_peered":"2024-08-18T22:05:28.922322+0000","last_unstale":"2024-08-18T22:06:10.510069+0000","last_undegraded":"2024-08-18T22:06:10.510069+0000","last_fullsized":"2024-08-18T22:06:10.510069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:28.168299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505649+0000","last_change":"2024-08-18T22:05:21.853389+0000","last_active":"2024-08-18T22:06:10.505649+0000","last_peered":"2024-08-18T22:06:10.505649+0000","last_clean":"2024-08-18T22:06:10.505649+0000","last_became_active":"2024-08-18T22:05:21.853095+0000","last_became_peered":"2024-08-18T22:05:21.853095+0000","last_unstale":"2024-08-18T22:06:10.505649+0000","last_undegraded":"2024-08-18T22:06:10.505649+0000","last_fullsized":"2024-08-18T22:06:10.505649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:14.126983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508891+0000","last_change":"2024-08-18T22:05:19.846788+0000","last_active":"2024-08-18T22:06:10.508891+0000","last_peered":"2024-08-18T22:06:10.508891+0000","last_clean":"2024-08-18T22:06:10.508891+0000","last_became_active":"2024-08-18T22:05:19.846248+0000","last_became_peered":"2024-08-18T22:05:19.846248+0000","last_unstale":"2024-08-18T22:06:10.508891+0000","last_undegraded":"2024-08-18T22:06:10.508891+0000","last_fullsized":"2024-08-18T22:06:10.508891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:46.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507672+0000","last_change":"2024-08-18T22:05:28.920294+0000","last_active":"2024-08-18T22:06:10.507672+0000","last_peered":"2024-08-18T22:06:10.507672+0000","last_clean":"2024-08-18T22:06:10.507672+0000","last_became_active":"2024-08-18T22:05:28.919351+0000","last_became_peered":"2024-08-18T22:05:28.919351+0000","last_unstale":"2024-08-18T22:06:10.507672+0000","last_undegraded":"2024-08-18T22:06:10.507672+0000","last_fullsized":"2024-08-18T22:06:10.507672+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:49.425281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514189+0000","last_change":"2024-08-18T22:05:21.864529+0000","last_active":"2024-08-18T22:06:10.514189+0000","last_peered":"2024-08-18T22:06:10.514189+0000","last_clean":"2024-08-18T22:06:10.514189+0000","last_became_active":"2024-08-18T22:05:21.864062+0000","last_became_peered":"2024-08-18T22:05:21.864062+0000","last_unstale":"2024-08-18T22:06:10.514189+0000","last_undegraded":"2024-08-18T22:06:10.514189+0000","last_fullsized":"2024-08-18T22:06:10.514189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:24:49.037343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'31","reported_seq":213,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:58.595125+0000","last_change":"2024-08-18T22:06:10.522113+0000","last_active":"2024-08-18T22:06:58.595125+0000","last_peered":"2024-08-18T22:06:58.595125+0000","last_clean":"2024-08-18T22:06:58.595125+0000","last_became_active":"2024-08-18T22:06:10.514837+0000","last_became_peered":"2024-08-18T22:06:10.514837+0000","last_unstale":"2024-08-18T22:06:58.595125+0000","last_undegraded":"2024-08-18T22:06:58.595125+0000","last_fullsized":"2024-08-18T22:06:58.595125+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:46.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61517,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":117,"num_write":32,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508344+0000","last_change":"2024-08-18T22:05:28.926357+0000","last_active":"2024-08-18T22:06:10.508344+0000","last_peered":"2024-08-18T22:06:10.508344+0000","last_clean":"2024-08-18T22:06:10.508344+0000","last_became_active":"2024-08-18T22:05:28.926016+0000","last_became_peered":"2024-08-18T22:05:28.926016+0000","last_unstale":"2024-08-18T22:06:10.508344+0000","last_undegraded":"2024-08-18T22:06:10.508344+0000","last_fullsized":"2024-08-18T22:06:10.508344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:16.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506937+0000","last_change":"2024-08-18T22:05:21.860237+0000","last_active":"2024-08-18T22:06:10.506937+0000","last_peered":"2024-08-18T22:06:10.506937+0000","last_clean":"2024-08-18T22:06:10.506937+0000","last_became_active":"2024-08-18T22:05:21.859919+0000","last_became_peered":"2024-08-18T22:05:21.859919+0000","last_unstale":"2024-08-18T22:06:10.506937+0000","last_undegraded":"2024-08-18T22:06:10.506937+0000","last_fullsized":"2024-08-18T22:06:10.506937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:21.048413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507852+0000","last_change":"2024-08-18T22:05:20.291233+0000","last_active":"2024-08-18T22:06:10.507852+0000","last_peered":"2024-08-18T22:06:10.507852+0000","last_clean":"2024-08-18T22:06:10.507852+0000","last_became_active":"2024-08-18T22:05:20.290893+0000","last_became_peered":"2024-08-18T22:05:20.290893+0000","last_unstale":"2024-08-18T22:06:10.507852+0000","last_undegraded":"2024-08-18T22:06:10.507852+0000","last_fullsized":"2024-08-18T22:06:10.507852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:36.889561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510634+0000","last_change":"2024-08-18T22:05:28.923076+0000","last_active":"2024-08-18T22:06:10.510634+0000","last_peered":"2024-08-18T22:06:10.510634+0000","last_clean":"2024-08-18T22:06:10.510634+0000","last_became_active":"2024-08-18T22:05:28.922688+0000","last_became_peered":"2024-08-18T22:05:28.922688+0000","last_unstale":"2024-08-18T22:06:10.510634+0000","last_undegraded":"2024-08-18T22:06:10.510634+0000","last_fullsized":"2024-08-18T22:06:10.510634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:34.360540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509085+0000","last_change":"2024-08-18T22:05:21.855174+0000","last_active":"2024-08-18T22:06:10.509085+0000","last_peered":"2024-08-18T22:06:10.509085+0000","last_clean":"2024-08-18T22:06:10.509085+0000","last_became_active":"2024-08-18T22:05:21.854818+0000","last_became_peered":"2024-08-18T22:05:21.854818+0000","last_unstale":"2024-08-18T22:06:10.509085+0000","last_undegraded":"2024-08-18T22:06:10.509085+0000","last_fullsized":"2024-08-18T22:06:10.509085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:48:55.094624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508468+0000","last_change":"2024-08-18T22:05:19.847876+0000","last_active":"2024-08-18T22:06:10.508468+0000","last_peered":"2024-08-18T22:06:10.508468+0000","last_clean":"2024-08-18T22:06:10.508468+0000","last_became_active":"2024-08-18T22:05:19.847505+0000","last_became_peered":"2024-08-18T22:05:19.847505+0000","last_unstale":"2024-08-18T22:06:10.508468+0000","last_undegraded":"2024-08-18T22:06:10.508468+0000","last_fullsized":"2024-08-18T22:06:10.508468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:50:15.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508005+0000","last_change":"2024-08-18T22:05:28.921647+0000","last_active":"2024-08-18T22:06:10.508005+0000","last_peered":"2024-08-18T22:06:10.508005+0000","last_clean":"2024-08-18T22:06:10.508005+0000","last_became_active":"2024-08-18T22:05:28.921305+0000","last_became_peered":"2024-08-18T22:05:28.921305+0000","last_unstale":"2024-08-18T22:06:10.508005+0000","last_undegraded":"2024-08-18T22:06:10.508005+0000","last_fullsized":"2024-08-18T22:06:10.508005+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:29.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506841+0000","last_change":"2024-08-18T22:05:21.861151+0000","last_active":"2024-08-18T22:06:10.506841+0000","last_peered":"2024-08-18T22:06:10.506841+0000","last_clean":"2024-08-18T22:06:10.506841+0000","last_became_active":"2024-08-18T22:05:21.860834+0000","last_became_peered":"2024-08-18T22:05:21.860834+0000","last_unstale":"2024-08-18T22:06:10.506841+0000","last_undegraded":"2024-08-18T22:06:10.506841+0000","last_fullsized":"2024-08-18T22:06:10.506841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:32.890750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:57.544500+0000","last_change":"2024-08-18T22:05:19.846145+0000","last_active":"2024-08-18T22:06:57.544500+0000","last_peered":"2024-08-18T22:06:57.544500+0000","last_clean":"2024-08-18T22:06:57.544500+0000","last_became_active":"2024-08-18T22:05:19.845711+0000","last_became_peered":"2024-08-18T22:05:19.845711+0000","last_unstale":"2024-08-18T22:06:57.544500+0000","last_undegraded":"2024-08-18T22:06:57.544500+0000","last_fullsized":"2024-08-18T22:06:57.544500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:20.376131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771915+0000","last_change":"2024-08-18T22:05:28.923256+0000","last_active":"2024-08-18T22:06:10.771915+0000","last_peered":"2024-08-18T22:06:10.771915+0000","last_clean":"2024-08-18T22:06:10.771915+0000","last_became_active":"2024-08-18T22:05:28.922845+0000","last_became_peered":"2024-08-18T22:05:28.922845+0000","last_unstale":"2024-08-18T22:06:10.771915+0000","last_undegraded":"2024-08-18T22:06:10.771915+0000","last_fullsized":"2024-08-18T22:06:10.771915+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:41.930937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508677+0000","last_change":"2024-08-18T22:05:28.924743+0000","last_active":"2024-08-18T22:06:10.508677+0000","last_peered":"2024-08-18T22:06:10.508677+0000","last_clean":"2024-08-18T22:06:10.508677+0000","last_became_active":"2024-08-18T22:05:28.923674+0000","last_became_peered":"2024-08-18T22:05:28.923674+0000","last_unstale":"2024-08-18T22:06:10.508677+0000","last_undegraded":"2024-08-18T22:06:10.508677+0000","last_fullsized":"2024-08-18T22:06:10.508677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:19.834998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508496+0000","last_change":"2024-08-18T22:05:21.857194+0000","last_active":"2024-08-18T22:06:10.508496+0000","last_peered":"2024-08-18T22:06:10.508496+0000","last_clean":"2024-08-18T22:06:10.508496+0000","last_became_active":"2024-08-18T22:05:21.856916+0000","last_became_peered":"2024-08-18T22:05:21.856916+0000","last_unstale":"2024-08-18T22:06:10.508496+0000","last_undegraded":"2024-08-18T22:06:10.508496+0000","last_fullsized":"2024-08-18T22:06:10.508496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:24.759501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506570+0000","last_change":"2024-08-18T22:05:19.844919+0000","last_active":"2024-08-18T22:06:10.506570+0000","last_peered":"2024-08-18T22:06:10.506570+0000","last_clean":"2024-08-18T22:06:10.506570+0000","last_became_active":"2024-08-18T22:05:19.844539+0000","last_became_peered":"2024-08-18T22:05:19.844539+0000","last_unstale":"2024-08-18T22:06:10.506570+0000","last_undegraded":"2024-08-18T22:06:10.506570+0000","last_fullsized":"2024-08-18T22:06:10.506570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:01.598535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510256+0000","last_change":"2024-08-18T22:05:28.923304+0000","last_active":"2024-08-18T22:06:10.510256+0000","last_peered":"2024-08-18T22:06:10.510256+0000","last_clean":"2024-08-18T22:06:10.510256+0000","last_became_active":"2024-08-18T22:05:28.922912+0000","last_became_peered":"2024-08-18T22:05:28.922912+0000","last_unstale":"2024-08-18T22:06:10.510256+0000","last_undegraded":"2024-08-18T22:06:10.510256+0000","last_fullsized":"2024-08-18T22:06:10.510256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:24:47.834354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771950+0000","last_change":"2024-08-18T22:05:21.849448+0000","last_active":"2024-08-18T22:06:10.771950+0000","last_peered":"2024-08-18T22:06:10.771950+0000","last_clean":"2024-08-18T22:06:10.771950+0000","last_became_active":"2024-08-18T22:05:21.849154+0000","last_became_peered":"2024-08-18T22:05:21.849154+0000","last_unstale":"2024-08-18T22:06:10.771950+0000","last_undegraded":"2024-08-18T22:06:10.771950+0000","last_fullsized":"2024-08-18T22:06:10.771950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:38.583121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505540+0000","last_change":"2024-08-18T22:05:19.848483+0000","last_active":"2024-08-18T22:06:10.505540+0000","last_peered":"2024-08-18T22:06:10.505540+0000","last_clean":"2024-08-18T22:06:10.505540+0000","last_became_active":"2024-08-18T22:05:19.848190+0000","last_became_peered":"2024-08-18T22:05:19.848190+0000","last_unstale":"2024-08-18T22:06:10.505540+0000","last_undegraded":"2024-08-18T22:06:10.505540+0000","last_fullsized":"2024-08-18T22:06:10.505540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:01.719565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509148+0000","last_change":"2024-08-18T22:05:19.843796+0000","last_active":"2024-08-18T22:06:10.509148+0000","last_peered":"2024-08-18T22:06:10.509148+0000","last_clean":"2024-08-18T22:06:10.509148+0000","last_became_active":"2024-08-18T22:05:19.843495+0000","last_became_peered":"2024-08-18T22:05:19.843495+0000","last_unstale":"2024-08-18T22:06:10.509148+0000","last_undegraded":"2024-08-18T22:06:10.509148+0000","last_fullsized":"2024-08-18T22:06:10.509148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:21.583561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507269+0000","last_change":"2024-08-18T22:05:21.856370+0000","last_active":"2024-08-18T22:06:10.507269+0000","last_peered":"2024-08-18T22:06:10.507269+0000","last_clean":"2024-08-18T22:06:10.507269+0000","last_became_active":"2024-08-18T22:05:21.855954+0000","last_became_peered":"2024-08-18T22:05:21.855954+0000","last_unstale":"2024-08-18T22:06:10.507269+0000","last_undegraded":"2024-08-18T22:06:10.507269+0000","last_fullsized":"2024-08-18T22:06:10.507269+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:30.828305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.516344+0000","last_change":"2024-08-18T22:06:10.516344+0000","last_active":"2024-08-18T22:06:10.516344+0000","last_peered":"2024-08-18T22:06:10.516344+0000","last_clean":"2024-08-18T22:06:10.516344+0000","last_became_active":"2024-08-18T22:06:10.515925+0000","last_became_peered":"2024-08-18T22:06:10.515925+0000","last_unstale":"2024-08-18T22:06:10.516344+0000","last_undegraded":"2024-08-18T22:06:10.516344+0000","last_fullsized":"2024-08-18T22:06:10.516344+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:41:07.585521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:58.546856+0000","last_change":"2024-08-18T22:05:19.846860+0000","last_active":"2024-08-18T22:06:58.546856+0000","last_peered":"2024-08-18T22:06:58.546856+0000","last_clean":"2024-08-18T22:06:58.546856+0000","last_became_active":"2024-08-18T22:05:19.846496+0000","last_became_peered":"2024-08-18T22:05:19.846496+0000","last_unstale":"2024-08-18T22:06:58.546856+0000","last_undegraded":"2024-08-18T22:06:58.546856+0000","last_fullsized":"2024-08-18T22:06:58.546856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:16.555137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513529+0000","last_change":"2024-08-18T22:05:21.849058+0000","last_active":"2024-08-18T22:06:10.513529+0000","last_peered":"2024-08-18T22:06:10.513529+0000","last_clean":"2024-08-18T22:06:10.513529+0000","last_became_active":"2024-08-18T22:05:21.848703+0000","last_became_peered":"2024-08-18T22:05:21.848703+0000","last_unstale":"2024-08-18T22:06:10.513529+0000","last_undegraded":"2024-08-18T22:06:10.513529+0000","last_fullsized":"2024-08-18T22:06:10.513529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:10.024156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508916+0000","last_change":"2024-08-18T22:05:28.922968+0000","last_active":"2024-08-18T22:06:10.508916+0000","last_peered":"2024-08-18T22:06:10.508916+0000","last_clean":"2024-08-18T22:06:10.508916+0000","last_became_active":"2024-08-18T22:05:28.922378+0000","last_became_peered":"2024-08-18T22:05:28.922378+0000","last_unstale":"2024-08-18T22:06:10.508916+0000","last_undegraded":"2024-08-18T22:06:10.508916+0000","last_fullsized":"2024-08-18T22:06:10.508916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:23:07.241028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509985+0000","last_change":"2024-08-18T22:05:21.858572+0000","last_active":"2024-08-18T22:06:10.509985+0000","last_peered":"2024-08-18T22:06:10.509985+0000","last_clean":"2024-08-18T22:06:10.509985+0000","last_became_active":"2024-08-18T22:05:21.858254+0000","last_became_peered":"2024-08-18T22:05:21.858254+0000","last_unstale":"2024-08-18T22:06:10.509985+0000","last_undegraded":"2024-08-18T22:06:10.509985+0000","last_fullsized":"2024-08-18T22:06:10.509985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:52.456087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509101+0000","last_change":"2024-08-18T22:05:21.856710+0000","last_active":"2024-08-18T22:06:10.509101+0000","last_peered":"2024-08-18T22:06:10.509101+0000","last_clean":"2024-08-18T22:06:10.509101+0000","last_became_active":"2024-08-18T22:05:21.855399+0000","last_became_peered":"2024-08-18T22:05:21.855399+0000","last_unstale":"2024-08-18T22:06:10.509101+0000","last_undegraded":"2024-08-18T22:06:10.509101+0000","last_fullsized":"2024-08-18T22:06:10.509101+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:36.039953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507843+0000","last_change":"2024-08-18T22:05:21.856085+0000","last_active":"2024-08-18T22:06:10.507843+0000","last_peered":"2024-08-18T22:06:10.507843+0000","last_clean":"2024-08-18T22:06:10.507843+0000","last_became_active":"2024-08-18T22:05:21.855263+0000","last_became_peered":"2024-08-18T22:05:21.855263+0000","last_unstale":"2024-08-18T22:06:10.507843+0000","last_undegraded":"2024-08-18T22:06:10.507843+0000","last_fullsized":"2024-08-18T22:06:10.507843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:31.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509110+0000","last_change":"2024-08-18T22:05:21.855385+0000","last_active":"2024-08-18T22:06:10.509110+0000","last_peered":"2024-08-18T22:06:10.509110+0000","last_clean":"2024-08-18T22:06:10.509110+0000","last_became_active":"2024-08-18T22:05:21.854829+0000","last_became_peered":"2024-08-18T22:05:21.854829+0000","last_unstale":"2024-08-18T22:06:10.509110+0000","last_undegraded":"2024-08-18T22:06:10.509110+0000","last_fullsized":"2024-08-18T22:06:10.509110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:59.704154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510370+0000","last_change":"2024-08-18T22:06:10.510370+0000","last_active":"2024-08-18T22:06:10.510370+0000","last_peered":"2024-08-18T22:06:10.510370+0000","last_clean":"2024-08-18T22:06:10.510370+0000","last_became_active":"2024-08-18T22:06:10.509829+0000","last_became_peered":"2024-08-18T22:06:10.509829+0000","last_unstale":"2024-08-18T22:06:10.510370+0000","last_undegraded":"2024-08-18T22:06:10.510370+0000","last_fullsized":"2024-08-18T22:06:10.510370+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:20.171834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510420+0000","last_change":"2024-08-18T22:05:21.856137+0000","last_active":"2024-08-18T22:06:10.510420+0000","last_peered":"2024-08-18T22:06:10.510420+0000","last_clean":"2024-08-18T22:06:10.510420+0000","last_became_active":"2024-08-18T22:05:21.855425+0000","last_became_peered":"2024-08-18T22:05:21.855425+0000","last_unstale":"2024-08-18T22:06:10.510420+0000","last_undegraded":"2024-08-18T22:06:10.510420+0000","last_fullsized":"2024-08-18T22:06:10.510420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:37.514710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509024+0000","last_change":"2024-08-18T22:05:21.856084+0000","last_active":"2024-08-18T22:06:10.509024+0000","last_peered":"2024-08-18T22:06:10.509024+0000","last_clean":"2024-08-18T22:06:10.509024+0000","last_became_active":"2024-08-18T22:05:21.855779+0000","last_became_peered":"2024-08-18T22:05:21.855779+0000","last_unstale":"2024-08-18T22:06:10.509024+0000","last_undegraded":"2024-08-18T22:06:10.509024+0000","last_fullsized":"2024-08-18T22:06:10.509024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:02:47.833634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772328+0000","last_change":"2024-08-18T22:05:21.856729+0000","last_active":"2024-08-18T22:06:10.772328+0000","last_peered":"2024-08-18T22:06:10.772328+0000","last_clean":"2024-08-18T22:06:10.772328+0000","last_became_active":"2024-08-18T22:05:21.856446+0000","last_became_peered":"2024-08-18T22:05:21.856446+0000","last_unstale":"2024-08-18T22:06:10.772328+0000","last_undegraded":"2024-08-18T22:06:10.772328+0000","last_fullsized":"2024-08-18T22:06:10.772328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.482225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506405+0000","last_change":"2024-08-18T22:05:21.851772+0000","last_active":"2024-08-18T22:06:10.506405+0000","last_peered":"2024-08-18T22:06:10.506405+0000","last_clean":"2024-08-18T22:06:10.506405+0000","last_became_active":"2024-08-18T22:05:21.851417+0000","last_became_peered":"2024-08-18T22:05:21.851417+0000","last_unstale":"2024-08-18T22:06:10.506405+0000","last_undegraded":"2024-08-18T22:06:10.506405+0000","last_fullsized":"2024-08-18T22:06:10.506405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:32.509318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771984+0000","last_change":"2024-08-18T22:05:21.857887+0000","last_active":"2024-08-18T22:06:10.771984+0000","last_peered":"2024-08-18T22:06:10.771984+0000","last_clean":"2024-08-18T22:06:10.771984+0000","last_became_active":"2024-08-18T22:05:21.857585+0000","last_became_peered":"2024-08-18T22:05:21.857585+0000","last_unstale":"2024-08-18T22:06:10.771984+0000","last_undegraded":"2024-08-18T22:06:10.771984+0000","last_fullsized":"2024-08-18T22:06:10.771984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:23.299033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506488+0000","last_change":"2024-08-18T22:05:21.854626+0000","last_active":"2024-08-18T22:06:10.506488+0000","last_peered":"2024-08-18T22:06:10.506488+0000","last_clean":"2024-08-18T22:06:10.506488+0000","last_became_active":"2024-08-18T22:05:21.854290+0000","last_became_peered":"2024-08-18T22:05:21.854290+0000","last_unstale":"2024-08-18T22:06:10.506488+0000","last_undegraded":"2024-08-18T22:06:10.506488+0000","last_fullsized":"2024-08-18T22:06:10.506488+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:45:24.988669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505825+0000","last_change":"2024-08-18T22:05:21.865863+0000","last_active":"2024-08-18T22:06:10.505825+0000","last_peered":"2024-08-18T22:06:10.505825+0000","last_clean":"2024-08-18T22:06:10.505825+0000","last_became_active":"2024-08-18T22:05:21.864634+0000","last_became_peered":"2024-08-18T22:05:21.864634+0000","last_unstale":"2024-08-18T22:06:10.505825+0000","last_undegraded":"2024-08-18T22:06:10.505825+0000","last_fullsized":"2024-08-18T22:06:10.505825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:34.051147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510087+0000","last_change":"2024-08-18T22:05:21.860193+0000","last_active":"2024-08-18T22:06:10.510087+0000","last_peered":"2024-08-18T22:06:10.510087+0000","last_clean":"2024-08-18T22:06:10.510087+0000","last_became_active":"2024-08-18T22:05:21.859761+0000","last_became_peered":"2024-08-18T22:05:21.859761+0000","last_unstale":"2024-08-18T22:06:10.510087+0000","last_undegraded":"2024-08-18T22:06:10.510087+0000","last_fullsized":"2024-08-18T22:06:10.510087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:18.465913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509086+0000","last_change":"2024-08-18T22:05:21.860569+0000","last_active":"2024-08-18T22:06:10.509086+0000","last_peered":"2024-08-18T22:06:10.509086+0000","last_clean":"2024-08-18T22:06:10.509086+0000","last_became_active":"2024-08-18T22:05:21.860250+0000","last_became_peered":"2024-08-18T22:05:21.860250+0000","last_unstale":"2024-08-18T22:06:10.509086+0000","last_undegraded":"2024-08-18T22:06:10.509086+0000","last_fullsized":"2024-08-18T22:06:10.509086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:52.097840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509523+0000","last_change":"2024-08-18T22:05:21.858271+0000","last_active":"2024-08-18T22:06:10.509523+0000","last_peered":"2024-08-18T22:06:10.509523+0000","last_clean":"2024-08-18T22:06:10.509523+0000","last_became_active":"2024-08-18T22:05:21.857968+0000","last_became_peered":"2024-08-18T22:05:21.857968+0000","last_unstale":"2024-08-18T22:06:10.509523+0000","last_undegraded":"2024-08-18T22:06:10.509523+0000","last_fullsized":"2024-08-18T22:06:10.509523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:24.023136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510630+0000","last_change":"2024-08-18T22:05:21.853799+0000","last_active":"2024-08-18T22:06:10.510630+0000","last_peered":"2024-08-18T22:06:10.510630+0000","last_clean":"2024-08-18T22:06:10.510630+0000","last_became_active":"2024-08-18T22:05:21.853432+0000","last_became_peered":"2024-08-18T22:05:21.853432+0000","last_unstale":"2024-08-18T22:06:10.510630+0000","last_undegraded":"2024-08-18T22:06:10.510630+0000","last_fullsized":"2024-08-18T22:06:10.510630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:07.429169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506002+0000","last_change":"2024-08-18T22:05:21.855117+0000","last_active":"2024-08-18T22:06:10.506002+0000","last_peered":"2024-08-18T22:06:10.506002+0000","last_clean":"2024-08-18T22:06:10.506002+0000","last_became_active":"2024-08-18T22:05:21.854041+0000","last_became_peered":"2024-08-18T22:05:21.854041+0000","last_unstale":"2024-08-18T22:06:10.506002+0000","last_undegraded":"2024-08-18T22:06:10.506002+0000","last_fullsized":"2024-08-18T22:06:10.506002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:17.222658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508062+0000","last_change":"2024-08-18T22:05:21.861745+0000","last_active":"2024-08-18T22:06:10.508062+0000","last_peered":"2024-08-18T22:06:10.508062+0000","last_clean":"2024-08-18T22:06:10.508062+0000","last_became_active":"2024-08-18T22:05:21.861427+0000","last_became_peered":"2024-08-18T22:05:21.861427+0000","last_unstale":"2024-08-18T22:06:10.508062+0000","last_undegraded":"2024-08-18T22:06:10.508062+0000","last_fullsized":"2024-08-18T22:06:10.508062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:17.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508302+0000","last_change":"2024-08-18T22:05:21.860046+0000","last_active":"2024-08-18T22:06:10.508302+0000","last_peered":"2024-08-18T22:06:10.508302+0000","last_clean":"2024-08-18T22:06:10.508302+0000","last_became_active":"2024-08-18T22:05:21.859674+0000","last_became_peered":"2024-08-18T22:05:21.859674+0000","last_unstale":"2024-08-18T22:06:10.508302+0000","last_undegraded":"2024-08-18T22:06:10.508302+0000","last_fullsized":"2024-08-18T22:06:10.508302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:44.615270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505796+0000","last_change":"2024-08-18T22:05:21.847647+0000","last_active":"2024-08-18T22:06:10.505796+0000","last_peered":"2024-08-18T22:06:10.505796+0000","last_clean":"2024-08-18T22:06:10.505796+0000","last_became_active":"2024-08-18T22:05:21.847367+0000","last_became_peered":"2024-08-18T22:05:21.847367+0000","last_unstale":"2024-08-18T22:06:10.505796+0000","last_undegraded":"2024-08-18T22:06:10.505796+0000","last_fullsized":"2024-08-18T22:06:10.505796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:33.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.512325+0000","last_change":"2024-08-18T22:05:21.861326+0000","last_active":"2024-08-18T22:06:10.512325+0000","last_peered":"2024-08-18T22:06:10.512325+0000","last_clean":"2024-08-18T22:06:10.512325+0000","last_became_active":"2024-08-18T22:05:21.860968+0000","last_became_peered":"2024-08-18T22:05:21.860968+0000","last_unstale":"2024-08-18T22:06:10.512325+0000","last_undegraded":"2024-08-18T22:06:10.512325+0000","last_fullsized":"2024-08-18T22:06:10.512325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:49.150670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508590+0000","last_change":"2024-08-18T22:05:21.852618+0000","last_active":"2024-08-18T22:06:10.508590+0000","last_peered":"2024-08-18T22:06:10.508590+0000","last_clean":"2024-08-18T22:06:10.508590+0000","last_became_active":"2024-08-18T22:05:21.852318+0000","last_became_peered":"2024-08-18T22:05:21.852318+0000","last_unstale":"2024-08-18T22:06:10.508590+0000","last_undegraded":"2024-08-18T22:06:10.508590+0000","last_fullsized":"2024-08-18T22:06:10.508590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:06:49.085150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509956+0000","last_change":"2024-08-18T22:05:21.860108+0000","last_active":"2024-08-18T22:06:10.509956+0000","last_peered":"2024-08-18T22:06:10.509956+0000","last_clean":"2024-08-18T22:06:10.509956+0000","last_became_active":"2024-08-18T22:05:21.859794+0000","last_became_peered":"2024-08-18T22:05:21.859794+0000","last_unstale":"2024-08-18T22:06:10.509956+0000","last_undegraded":"2024-08-18T22:06:10.509956+0000","last_fullsized":"2024-08-18T22:06:10.509956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:01.974202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507181+0000","last_change":"2024-08-18T22:05:21.856404+0000","last_active":"2024-08-18T22:06:10.507181+0000","last_peered":"2024-08-18T22:06:10.507181+0000","last_clean":"2024-08-18T22:06:10.507181+0000","last_became_active":"2024-08-18T22:05:21.855800+0000","last_became_peered":"2024-08-18T22:05:21.855800+0000","last_unstale":"2024-08-18T22:06:10.507181+0000","last_undegraded":"2024-08-18T22:06:10.507181+0000","last_fullsized":"2024-08-18T22:06:10.507181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:09.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771944+0000","last_change":"2024-08-18T22:05:21.859891+0000","last_active":"2024-08-18T22:06:10.771944+0000","last_peered":"2024-08-18T22:06:10.771944+0000","last_clean":"2024-08-18T22:06:10.771944+0000","last_became_active":"2024-08-18T22:05:21.859407+0000","last_became_peered":"2024-08-18T22:05:21.859407+0000","last_unstale":"2024-08-18T22:06:10.771944+0000","last_undegraded":"2024-08-18T22:06:10.771944+0000","last_fullsized":"2024-08-18T22:06:10.771944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:59.285627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508099+0000","last_change":"2024-08-18T22:05:21.856428+0000","last_active":"2024-08-18T22:06:10.508099+0000","last_peered":"2024-08-18T22:06:10.508099+0000","last_clean":"2024-08-18T22:06:10.508099+0000","last_became_active":"2024-08-18T22:05:21.853374+0000","last_became_peered":"2024-08-18T22:05:21.853374+0000","last_unstale":"2024-08-18T22:06:10.508099+0000","last_undegraded":"2024-08-18T22:06:10.508099+0000","last_fullsized":"2024-08-18T22:06:10.508099+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:07.087171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509021+0000","last_change":"2024-08-18T22:05:21.852688+0000","last_active":"2024-08-18T22:06:10.509021+0000","last_peered":"2024-08-18T22:06:10.509021+0000","last_clean":"2024-08-18T22:06:10.509021+0000","last_became_active":"2024-08-18T22:05:21.851107+0000","last_became_peered":"2024-08-18T22:05:21.851107+0000","last_unstale":"2024-08-18T22:06:10.509021+0000","last_undegraded":"2024-08-18T22:06:10.509021+0000","last_fullsized":"2024-08-18T22:06:10.509021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:48.267166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513864+0000","last_change":"2024-08-18T22:05:21.850809+0000","last_active":"2024-08-18T22:06:10.513864+0000","last_peered":"2024-08-18T22:06:10.513864+0000","last_clean":"2024-08-18T22:06:10.513864+0000","last_became_active":"2024-08-18T22:05:21.850510+0000","last_became_peered":"2024-08-18T22:05:21.850510+0000","last_unstale":"2024-08-18T22:06:10.513864+0000","last_undegraded":"2024-08-18T22:06:10.513864+0000","last_fullsized":"2024-08-18T22:06:10.513864+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:39.338051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.512225+0000","last_change":"2024-08-18T22:05:21.856156+0000","last_active":"2024-08-18T22:06:10.512225+0000","last_peered":"2024-08-18T22:06:10.512225+0000","last_clean":"2024-08-18T22:06:10.512225+0000","last_became_active":"2024-08-18T22:05:21.855830+0000","last_became_peered":"2024-08-18T22:05:21.855830+0000","last_unstale":"2024-08-18T22:06:10.512225+0000","last_undegraded":"2024-08-18T22:06:10.512225+0000","last_fullsized":"2024-08-18T22:06:10.512225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:10.670405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508858+0000","last_change":"2024-08-18T22:05:21.865162+0000","last_active":"2024-08-18T22:06:10.508858+0000","last_peered":"2024-08-18T22:06:10.508858+0000","last_clean":"2024-08-18T22:06:10.508858+0000","last_became_active":"2024-08-18T22:05:21.864842+0000","last_became_peered":"2024-08-18T22:05:21.864842+0000","last_unstale":"2024-08-18T22:06:10.508858+0000","last_undegraded":"2024-08-18T22:06:10.508858+0000","last_fullsized":"2024-08-18T22:06:10.508858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:21.388638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508777+0000","last_change":"2024-08-18T22:05:21.859227+0000","last_active":"2024-08-18T22:06:10.508777+0000","last_peered":"2024-08-18T22:06:10.508777+0000","last_clean":"2024-08-18T22:06:10.508777+0000","last_became_active":"2024-08-18T22:05:21.858886+0000","last_became_peered":"2024-08-18T22:05:21.858886+0000","last_unstale":"2024-08-18T22:06:10.508777+0000","last_undegraded":"2024-08-18T22:06:10.508777+0000","last_fullsized":"2024-08-18T22:06:10.508777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:08.710772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510562+0000","last_change":"2024-08-18T22:05:21.854864+0000","last_active":"2024-08-18T22:06:10.510562+0000","last_peered":"2024-08-18T22:06:10.510562+0000","last_clean":"2024-08-18T22:06:10.510562+0000","last_became_active":"2024-08-18T22:05:21.854522+0000","last_became_peered":"2024-08-18T22:05:21.854522+0000","last_unstale":"2024-08-18T22:06:10.510562+0000","last_undegraded":"2024-08-18T22:06:10.510562+0000","last_fullsized":"2024-08-18T22:06:10.510562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:32.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65907,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":387,"num_read_kb":256,"num_write":166,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514528,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":504444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743462,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32848,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712304,"statfs":{"total":95995035648,"available":95961399296,"internally_reserved":0,"allocated":1712128,"data_stored":1157715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906987,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":504680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168624,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":504600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397555,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1100898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561080,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":499856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790012,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1638400,"data_stored":1096096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953537,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1097728,"data_stored":566413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182469,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1028096,"data_stored":500050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":501506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1081344,"data_stored":561283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":501244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:07:04.834 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-18T22:07:04.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:04 smithi183 ceph-mon[22097]: pgmap v317: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:07:05.088 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:05.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.574+0000 7f9f26276640 1 -- 172.21.15.123:0/3786468611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20100b50 msgr2=0x7f9f20100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:05.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.574+0000 7f9f26276640 1 --2- 172.21.15.123:0/3786468611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20100b50 0x7f9f20100f30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009900 tx=0x7f9f1002a480 comp rx=0 tx=0).stop 2024-08-18T22:07:05.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.574+0000 7f9f26276640 1 -- 172.21.15.123:0/3786468611 shutdown_connections 2024-08-18T22:07:05.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.574+0000 7f9f26276640 1 --2- 172.21.15.123:0/3786468611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f20102c20 0x7f9f2010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:05.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.574+0000 7f9f26276640 1 --2- 172.21.15.123:0/3786468611 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f201022a0 0x7f9f201026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.574+0000 7f9f26276640 1 --2- 172.21.15.123:0/3786468611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20100b50 0x7f9f20100f30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.574+0000 7f9f26276640 1 -- 172.21.15.123:0/3786468611 >> 172.21.15.123:0/3786468611 conn(0x7f9f200fc500 msgr2=0x7f9f200fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.574+0000 7f9f26276640 1 -- 172.21.15.123:0/3786468611 shutdown_connections 2024-08-18T22:07:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.574+0000 7f9f26276640 1 -- 172.21.15.123:0/3786468611 wait complete. 2024-08-18T22:07:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.574+0000 7f9f26276640 1 Processor -- start 2024-08-18T22:07:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.574+0000 7f9f26276640 1 -- start start 2024-08-18T22:07:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f26276640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f20100b50 0x7f9f2019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f26276640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f201022a0 0x7f9f2019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f26276640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20102c20 0x7f9f2019ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f26276640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9f20110cd0 con 0x7f9f20102c20 2024-08-18T22:07:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f26276640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9f20110b50 con 0x7f9f201022a0 2024-08-18T22:07:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f26276640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9f20110e50 con 0x7f9f20100b50 2024-08-18T22:07:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f24813640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20102c20 0x7f9f2019ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f24813640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20102c20 0x7f9f2019ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40454/0 (socket says 172.21.15.123:40454) 2024-08-18T22:07:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f24813640 1 -- 172.21.15.123:0/1040190393 learned_addr learned my addr 172.21.15.123:0/1040190393 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f17fff640 1 --2- 172.21.15.123:0/1040190393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f201022a0 0x7f9f2019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f1ffff640 1 --2- 172.21.15.123:0/1040190393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f20100b50 0x7f9f2019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f24813640 1 -- 172.21.15.123:0/1040190393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f20100b50 msgr2=0x7f9f2019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f24813640 1 --2- 172.21.15.123:0/1040190393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f20100b50 0x7f9f2019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f24813640 1 -- 172.21.15.123:0/1040190393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f201022a0 msgr2=0x7f9f2019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f24813640 1 --2- 172.21.15.123:0/1040190393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f201022a0 0x7f9f2019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f24813640 1 -- 172.21.15.123:0/1040190393 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2019f3f0 con 0x7f9f20102c20 2024-08-18T22:07:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f24813640 1 --2- 172.21.15.123:0/1040190393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20102c20 0x7f9f2019ed10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800cad0 tx=0x7f9f1800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f1dffb640 1 -- 172.21.15.123:0/1040190393 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1800ad60 con 0x7f9f20102c20 2024-08-18T22:07:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.575+0000 7f9f1dffb640 1 -- 172.21.15.123:0/1040190393 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f18005020 con 0x7f9f20102c20 2024-08-18T22:07:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.576+0000 7f9f1dffb640 1 -- 172.21.15.123:0/1040190393 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1800f6b0 con 0x7f9f20102c20 2024-08-18T22:07:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.576+0000 7f9f26276640 1 -- 172.21.15.123:0/1040190393 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2019f6e0 con 0x7f9f20102c20 2024-08-18T22:07:05.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.576+0000 7f9f26276640 1 -- 172.21.15.123:0/1040190393 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f201a6fc0 con 0x7f9f20102c20 2024-08-18T22:07:05.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.577+0000 7f9f26276640 1 -- 172.21.15.123:0/1040190393 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f20100f30 con 0x7f9f20102c20 2024-08-18T22:07:05.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.578+0000 7f9f1dffb640 1 -- 172.21.15.123:0/1040190393 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f9f18005560 con 0x7f9f20102c20 2024-08-18T22:07:05.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.578+0000 7f9f1dffb640 1 --2- 172.21.15.123:0/1040190393 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9f0c0a2c10 0x7f9f0c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:05.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.579+0000 7f9f1ffff640 1 --2- 172.21.15.123:0/1040190393 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9f0c0a2c10 0x7f9f0c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:05.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.579+0000 7f9f1dffb640 1 -- 172.21.15.123:0/1040190393 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f9f180cf950 con 0x7f9f20102c20 2024-08-18T22:07:05.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.579+0000 7f9f1ffff640 1 --2- 172.21.15.123:0/1040190393 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9f0c0a2c10 0x7f9f0c0a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9f10000c00 tx=0x7f9f100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:05.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.582+0000 7f9f1dffb640 1 -- 172.21.15.123:0/1040190393 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9f18014030 con 0x7f9f20102c20 2024-08-18T22:07:05.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.745+0000 7f9f26276640 1 -- 172.21.15.123:0/1040190393 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f2010cad0 con 0x7f9f0c0a2c10 2024-08-18T22:07:05.747 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:05 smithi123 ceph-mon[18462]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:05.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.753+0000 7f9f1dffb640 1 -- 172.21.15.123:0/1040190393 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340381 (secure 0 0 0) 0x7f9f2010cad0 con 0x7f9f0c0a2c10 2024-08-18T22:07:05.758 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:05.759 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-08-18T22:07:05.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.756+0000 7f9f26276640 1 -- 172.21.15.123:0/1040190393 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9f0c0a2c10 msgr2=0x7f9f0c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:05.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.756+0000 7f9f26276640 1 --2- 172.21.15.123:0/1040190393 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9f0c0a2c10 0x7f9f0c0a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9f10000c00 tx=0x7f9f100058d0 comp rx=0 tx=0).stop 2024-08-18T22:07:05.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.756+0000 7f9f26276640 1 -- 172.21.15.123:0/1040190393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20102c20 msgr2=0x7f9f2019ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:05.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.756+0000 7f9f26276640 1 --2- 172.21.15.123:0/1040190393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20102c20 0x7f9f2019ed10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800cad0 tx=0x7f9f1800ced0 comp rx=0 tx=0).stop 2024-08-18T22:07:05.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.756+0000 7f9f26276640 1 -- 172.21.15.123:0/1040190393 shutdown_connections 2024-08-18T22:07:05.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.756+0000 7f9f26276640 1 --2- 172.21.15.123:0/1040190393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20102c20 0x7f9f2019ed10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:05.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.756+0000 7f9f26276640 1 --2- 172.21.15.123:0/1040190393 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9f0c0a2c10 0x7f9f0c0a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:05.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.756+0000 7f9f26276640 1 --2- 172.21.15.123:0/1040190393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f201022a0 0x7f9f2019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:05.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.756+0000 7f9f26276640 1 --2- 172.21.15.123:0/1040190393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f20100b50 0x7f9f2019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:05.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.756+0000 7f9f26276640 1 -- 172.21.15.123:0/1040190393 >> 172.21.15.123:0/1040190393 conn(0x7f9f200fc500 msgr2=0x7f9f2006a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:05.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.756+0000 7f9f26276640 1 -- 172.21.15.123:0/1040190393 shutdown_connections 2024-08-18T22:07:05.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:05.756+0000 7f9f26276640 1 -- 172.21.15.123:0/1040190393 wait complete. 2024-08-18T22:07:05.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:05 smithi130 ceph-mon[21698]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:05.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:05 smithi183 ceph-mon[22097]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:06.631 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-08-18T22:07:05.361482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656509,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":538,"num_read_kb":380,"num_write":349,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1229945,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":281,"ondisk_log_size":281,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375708,"kb_used_data":14036,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566116,"statfs":{"total":1151940427776,"available":1151555702784,"internally_reserved":0,"allocated":14372864,"data_stored":7998785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003367"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509743+0000","last_change":"2024-08-18T22:05:19.844674+0000","last_active":"2024-08-18T22:06:10.509743+0000","last_peered":"2024-08-18T22:06:10.509743+0000","last_clean":"2024-08-18T22:06:10.509743+0000","last_became_active":"2024-08-18T22:05:19.844381+0000","last_became_peered":"2024-08-18T22:05:19.844381+0000","last_unstale":"2024-08-18T22:06:10.509743+0000","last_undegraded":"2024-08-18T22:06:10.509743+0000","last_fullsized":"2024-08-18T22:06:10.509743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:58.783222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772174+0000","last_change":"2024-08-18T22:05:21.859013+0000","last_active":"2024-08-18T22:06:10.772174+0000","last_peered":"2024-08-18T22:06:10.772174+0000","last_clean":"2024-08-18T22:06:10.772174+0000","last_became_active":"2024-08-18T22:05:21.858709+0000","last_became_peered":"2024-08-18T22:05:21.858709+0000","last_unstale":"2024-08-18T22:06:10.772174+0000","last_undegraded":"2024-08-18T22:06:10.772174+0000","last_fullsized":"2024-08-18T22:06:10.772174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:34.272340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508245+0000","last_change":"2024-08-18T22:05:28.925735+0000","last_active":"2024-08-18T22:06:10.508245+0000","last_peered":"2024-08-18T22:06:10.508245+0000","last_clean":"2024-08-18T22:06:10.508245+0000","last_became_active":"2024-08-18T22:05:28.925324+0000","last_became_peered":"2024-08-18T22:05:28.925324+0000","last_unstale":"2024-08-18T22:06:10.508245+0000","last_undegraded":"2024-08-18T22:06:10.508245+0000","last_fullsized":"2024-08-18T22:06:10.508245+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:15:58.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772359+0000","last_change":"2024-08-18T22:05:20.290861+0000","last_active":"2024-08-18T22:06:10.772359+0000","last_peered":"2024-08-18T22:06:10.772359+0000","last_clean":"2024-08-18T22:06:10.772359+0000","last_became_active":"2024-08-18T22:05:20.290508+0000","last_became_peered":"2024-08-18T22:05:20.290508+0000","last_unstale":"2024-08-18T22:06:10.772359+0000","last_undegraded":"2024-08-18T22:06:10.772359+0000","last_fullsized":"2024-08-18T22:06:10.772359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:21.462206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509155+0000","last_change":"2024-08-18T22:05:21.863441+0000","last_active":"2024-08-18T22:06:10.509155+0000","last_peered":"2024-08-18T22:06:10.509155+0000","last_clean":"2024-08-18T22:06:10.509155+0000","last_became_active":"2024-08-18T22:05:21.863121+0000","last_became_peered":"2024-08-18T22:05:21.863121+0000","last_unstale":"2024-08-18T22:06:10.509155+0000","last_undegraded":"2024-08-18T22:06:10.509155+0000","last_fullsized":"2024-08-18T22:06:10.509155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:47.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509447+0000","last_change":"2024-08-18T22:05:28.925477+0000","last_active":"2024-08-18T22:06:10.509447+0000","last_peered":"2024-08-18T22:06:10.509447+0000","last_clean":"2024-08-18T22:06:10.509447+0000","last_became_active":"2024-08-18T22:05:28.924922+0000","last_became_peered":"2024-08-18T22:05:28.924922+0000","last_unstale":"2024-08-18T22:06:10.509447+0000","last_undegraded":"2024-08-18T22:06:10.509447+0000","last_fullsized":"2024-08-18T22:06:10.509447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:35.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514293+0000","last_change":"2024-08-18T22:05:19.847979+0000","last_active":"2024-08-18T22:06:10.514293+0000","last_peered":"2024-08-18T22:06:10.514293+0000","last_clean":"2024-08-18T22:06:10.514293+0000","last_became_active":"2024-08-18T22:05:19.847643+0000","last_became_peered":"2024-08-18T22:05:19.847643+0000","last_unstale":"2024-08-18T22:06:10.514293+0000","last_undegraded":"2024-08-18T22:06:10.514293+0000","last_fullsized":"2024-08-18T22:06:10.514293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:33.875378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506424+0000","last_change":"2024-08-18T22:05:21.860225+0000","last_active":"2024-08-18T22:06:10.506424+0000","last_peered":"2024-08-18T22:06:10.506424+0000","last_clean":"2024-08-18T22:06:10.506424+0000","last_became_active":"2024-08-18T22:05:21.859889+0000","last_became_peered":"2024-08-18T22:05:21.859889+0000","last_unstale":"2024-08-18T22:06:10.506424+0000","last_undegraded":"2024-08-18T22:06:10.506424+0000","last_fullsized":"2024-08-18T22:06:10.506424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:06:27.084401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511096+0000","last_change":"2024-08-18T22:05:28.922230+0000","last_active":"2024-08-18T22:06:10.511096+0000","last_peered":"2024-08-18T22:06:10.511096+0000","last_clean":"2024-08-18T22:06:10.511096+0000","last_became_active":"2024-08-18T22:05:28.921804+0000","last_became_peered":"2024-08-18T22:05:28.921804+0000","last_unstale":"2024-08-18T22:06:10.511096+0000","last_undegraded":"2024-08-18T22:06:10.511096+0000","last_fullsized":"2024-08-18T22:06:10.511096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:17.735645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514907+0000","last_change":"2024-08-18T22:05:19.841452+0000","last_active":"2024-08-18T22:06:10.514907+0000","last_peered":"2024-08-18T22:06:10.514907+0000","last_clean":"2024-08-18T22:06:10.514907+0000","last_became_active":"2024-08-18T22:05:19.840997+0000","last_became_peered":"2024-08-18T22:05:19.840997+0000","last_unstale":"2024-08-18T22:06:10.514907+0000","last_undegraded":"2024-08-18T22:06:10.514907+0000","last_fullsized":"2024-08-18T22:06:10.514907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:27:26.208279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514673+0000","last_change":"2024-08-18T22:06:10.514673+0000","last_active":"2024-08-18T22:06:10.514673+0000","last_peered":"2024-08-18T22:06:10.514673+0000","last_clean":"2024-08-18T22:06:10.514673+0000","last_became_active":"2024-08-18T22:06:10.514264+0000","last_became_peered":"2024-08-18T22:06:10.514264+0000","last_unstale":"2024-08-18T22:06:10.514673+0000","last_undegraded":"2024-08-18T22:06:10.514673+0000","last_fullsized":"2024-08-18T22:06:10.514673+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:03.626895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509642+0000","last_change":"2024-08-18T22:05:28.924521+0000","last_active":"2024-08-18T22:06:10.509642+0000","last_peered":"2024-08-18T22:06:10.509642+0000","last_clean":"2024-08-18T22:06:10.509642+0000","last_became_active":"2024-08-18T22:05:28.924107+0000","last_became_peered":"2024-08-18T22:05:28.924107+0000","last_unstale":"2024-08-18T22:06:10.509642+0000","last_undegraded":"2024-08-18T22:06:10.509642+0000","last_fullsized":"2024-08-18T22:06:10.509642+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:37.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508303+0000","last_change":"2024-08-18T22:05:21.861696+0000","last_active":"2024-08-18T22:06:10.508303+0000","last_peered":"2024-08-18T22:06:10.508303+0000","last_clean":"2024-08-18T22:06:10.508303+0000","last_became_active":"2024-08-18T22:05:21.861220+0000","last_became_peered":"2024-08-18T22:05:21.861220+0000","last_unstale":"2024-08-18T22:06:10.508303+0000","last_undegraded":"2024-08-18T22:06:10.508303+0000","last_fullsized":"2024-08-18T22:06:10.508303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:01.098281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.520590+0000","last_change":"2024-08-18T22:06:10.520097+0000","last_active":"2024-08-18T22:06:10.520590+0000","last_peered":"2024-08-18T22:06:10.520590+0000","last_clean":"2024-08-18T22:06:10.520590+0000","last_became_active":"2024-08-18T22:06:10.513286+0000","last_became_peered":"2024-08-18T22:06:10.513286+0000","last_unstale":"2024-08-18T22:06:10.520590+0000","last_undegraded":"2024-08-18T22:06:10.520590+0000","last_fullsized":"2024-08-18T22:06:10.520590+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:08:18.861243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509973+0000","last_change":"2024-08-18T22:05:29.013139+0000","last_active":"2024-08-18T22:06:10.509973+0000","last_peered":"2024-08-18T22:06:10.509973+0000","last_clean":"2024-08-18T22:06:10.509973+0000","last_became_active":"2024-08-18T22:05:29.012322+0000","last_became_peered":"2024-08-18T22:05:29.012322+0000","last_unstale":"2024-08-18T22:06:10.509973+0000","last_undegraded":"2024-08-18T22:06:10.509973+0000","last_fullsized":"2024-08-18T22:06:10.509973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:32.348201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772162+0000","last_change":"2024-08-18T22:05:21.860410+0000","last_active":"2024-08-18T22:06:10.772162+0000","last_peered":"2024-08-18T22:06:10.772162+0000","last_clean":"2024-08-18T22:06:10.772162+0000","last_became_active":"2024-08-18T22:05:21.860173+0000","last_became_peered":"2024-08-18T22:05:21.860173+0000","last_unstale":"2024-08-18T22:06:10.772162+0000","last_undegraded":"2024-08-18T22:06:10.772162+0000","last_fullsized":"2024-08-18T22:06:10.772162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:00.879178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507956+0000","last_change":"2024-08-18T22:05:19.845785+0000","last_active":"2024-08-18T22:06:10.507956+0000","last_peered":"2024-08-18T22:06:10.507956+0000","last_clean":"2024-08-18T22:06:10.507956+0000","last_became_active":"2024-08-18T22:05:19.845414+0000","last_became_peered":"2024-08-18T22:05:19.845414+0000","last_unstale":"2024-08-18T22:06:10.507956+0000","last_undegraded":"2024-08-18T22:06:10.507956+0000","last_fullsized":"2024-08-18T22:06:10.507956+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:13.504885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.523404+0000","last_change":"2024-08-18T22:06:10.523404+0000","last_active":"2024-08-18T22:06:10.523404+0000","last_peered":"2024-08-18T22:06:10.523404+0000","last_clean":"2024-08-18T22:06:10.523404+0000","last_became_active":"2024-08-18T22:06:10.516652+0000","last_became_peered":"2024-08-18T22:06:10.516652+0000","last_unstale":"2024-08-18T22:06:10.523404+0000","last_undegraded":"2024-08-18T22:06:10.523404+0000","last_fullsized":"2024-08-18T22:06:10.523404+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:58.197636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510102+0000","last_change":"2024-08-18T22:05:21.858329+0000","last_active":"2024-08-18T22:06:10.510102+0000","last_peered":"2024-08-18T22:06:10.510102+0000","last_clean":"2024-08-18T22:06:10.510102+0000","last_became_active":"2024-08-18T22:05:21.857854+0000","last_became_peered":"2024-08-18T22:05:21.857854+0000","last_unstale":"2024-08-18T22:06:10.510102+0000","last_undegraded":"2024-08-18T22:06:10.510102+0000","last_fullsized":"2024-08-18T22:06:10.510102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:45:19.934647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772068+0000","last_change":"2024-08-18T22:05:19.843031+0000","last_active":"2024-08-18T22:06:10.772068+0000","last_peered":"2024-08-18T22:06:10.772068+0000","last_clean":"2024-08-18T22:06:10.772068+0000","last_became_active":"2024-08-18T22:05:19.842694+0000","last_became_peered":"2024-08-18T22:05:19.842694+0000","last_unstale":"2024-08-18T22:06:10.772068+0000","last_undegraded":"2024-08-18T22:06:10.772068+0000","last_fullsized":"2024-08-18T22:06:10.772068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:01.135449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509575+0000","last_change":"2024-08-18T22:05:28.920647+0000","last_active":"2024-08-18T22:06:10.509575+0000","last_peered":"2024-08-18T22:06:10.509575+0000","last_clean":"2024-08-18T22:06:10.509575+0000","last_became_active":"2024-08-18T22:05:28.920295+0000","last_became_peered":"2024-08-18T22:05:28.920295+0000","last_unstale":"2024-08-18T22:06:10.509575+0000","last_undegraded":"2024-08-18T22:06:10.509575+0000","last_fullsized":"2024-08-18T22:06:10.509575+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:41.295009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513283+0000","last_change":"2024-08-18T22:05:21.858413+0000","last_active":"2024-08-18T22:06:10.513283+0000","last_peered":"2024-08-18T22:06:10.513283+0000","last_clean":"2024-08-18T22:06:10.513283+0000","last_became_active":"2024-08-18T22:05:21.858102+0000","last_became_peered":"2024-08-18T22:05:21.858102+0000","last_unstale":"2024-08-18T22:06:10.513283+0000","last_undegraded":"2024-08-18T22:06:10.513283+0000","last_fullsized":"2024-08-18T22:06:10.513283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:24:59.432666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506163+0000","last_change":"2024-08-18T22:05:20.292085+0000","last_active":"2024-08-18T22:06:10.506163+0000","last_peered":"2024-08-18T22:06:10.506163+0000","last_clean":"2024-08-18T22:06:10.506163+0000","last_became_active":"2024-08-18T22:05:20.291606+0000","last_became_peered":"2024-08-18T22:05:20.291606+0000","last_unstale":"2024-08-18T22:06:10.506163+0000","last_undegraded":"2024-08-18T22:06:10.506163+0000","last_fullsized":"2024-08-18T22:06:10.506163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:22:46.801719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515755+0000","last_change":"2024-08-18T22:06:10.515755+0000","last_active":"2024-08-18T22:06:10.515755+0000","last_peered":"2024-08-18T22:06:10.515755+0000","last_clean":"2024-08-18T22:06:10.515755+0000","last_became_active":"2024-08-18T22:06:10.514624+0000","last_became_peered":"2024-08-18T22:06:10.514624+0000","last_unstale":"2024-08-18T22:06:10.515755+0000","last_undegraded":"2024-08-18T22:06:10.515755+0000","last_fullsized":"2024-08-18T22:06:10.515755+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:18:50.785139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508880+0000","last_change":"2024-08-18T22:05:21.855163+0000","last_active":"2024-08-18T22:06:10.508880+0000","last_peered":"2024-08-18T22:06:10.508880+0000","last_clean":"2024-08-18T22:06:10.508880+0000","last_became_active":"2024-08-18T22:05:21.854867+0000","last_became_peered":"2024-08-18T22:05:21.854867+0000","last_unstale":"2024-08-18T22:06:10.508880+0000","last_undegraded":"2024-08-18T22:06:10.508880+0000","last_fullsized":"2024-08-18T22:06:10.508880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:10.300307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510102+0000","last_change":"2024-08-18T22:05:20.082363+0000","last_active":"2024-08-18T22:06:10.510102+0000","last_peered":"2024-08-18T22:06:10.510102+0000","last_clean":"2024-08-18T22:06:10.510102+0000","last_became_active":"2024-08-18T22:05:20.081998+0000","last_became_peered":"2024-08-18T22:05:20.081998+0000","last_unstale":"2024-08-18T22:06:10.510102+0000","last_undegraded":"2024-08-18T22:06:10.510102+0000","last_fullsized":"2024-08-18T22:06:10.510102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:44.960512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508721+0000","last_change":"2024-08-18T22:05:28.924072+0000","last_active":"2024-08-18T22:06:10.508721+0000","last_peered":"2024-08-18T22:06:10.508721+0000","last_clean":"2024-08-18T22:06:10.508721+0000","last_became_active":"2024-08-18T22:05:28.923673+0000","last_became_peered":"2024-08-18T22:05:28.923673+0000","last_unstale":"2024-08-18T22:06:10.508721+0000","last_undegraded":"2024-08-18T22:06:10.508721+0000","last_fullsized":"2024-08-18T22:06:10.508721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:44.593009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772399+0000","last_change":"2024-08-18T22:05:21.851377+0000","last_active":"2024-08-18T22:06:10.772399+0000","last_peered":"2024-08-18T22:06:10.772399+0000","last_clean":"2024-08-18T22:06:10.772399+0000","last_became_active":"2024-08-18T22:05:21.851031+0000","last_became_peered":"2024-08-18T22:05:21.851031+0000","last_unstale":"2024-08-18T22:06:10.772399+0000","last_undegraded":"2024-08-18T22:06:10.772399+0000","last_fullsized":"2024-08-18T22:06:10.772399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.547244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'11","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:13.873627+0000","last_change":"2024-08-18T22:05:19.840697+0000","last_active":"2024-08-18T22:06:13.873627+0000","last_peered":"2024-08-18T22:06:13.873627+0000","last_clean":"2024-08-18T22:06:13.873627+0000","last_became_active":"2024-08-18T22:05:19.840382+0000","last_became_peered":"2024-08-18T22:05:19.840382+0000","last_unstale":"2024-08-18T22:06:13.873627+0000","last_undegraded":"2024-08-18T22:06:13.873627+0000","last_fullsized":"2024-08-18T22:06:13.873627+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:24.514428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771817+0000","last_change":"2024-08-18T22:05:29.012305+0000","last_active":"2024-08-18T22:06:10.771817+0000","last_peered":"2024-08-18T22:06:10.771817+0000","last_clean":"2024-08-18T22:06:10.771817+0000","last_became_active":"2024-08-18T22:05:29.011846+0000","last_became_peered":"2024-08-18T22:05:29.011846+0000","last_unstale":"2024-08-18T22:06:10.771817+0000","last_undegraded":"2024-08-18T22:06:10.771817+0000","last_fullsized":"2024-08-18T22:06:10.771817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:36.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506016+0000","last_change":"2024-08-18T22:05:21.856182+0000","last_active":"2024-08-18T22:06:10.506016+0000","last_peered":"2024-08-18T22:06:10.506016+0000","last_clean":"2024-08-18T22:06:10.506016+0000","last_became_active":"2024-08-18T22:05:21.855855+0000","last_became_peered":"2024-08-18T22:05:21.855855+0000","last_unstale":"2024-08-18T22:06:10.506016+0000","last_undegraded":"2024-08-18T22:06:10.506016+0000","last_fullsized":"2024-08-18T22:06:10.506016+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:00.166809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514793+0000","last_change":"2024-08-18T22:05:20.291272+0000","last_active":"2024-08-18T22:06:10.514793+0000","last_peered":"2024-08-18T22:06:10.514793+0000","last_clean":"2024-08-18T22:06:10.514793+0000","last_became_active":"2024-08-18T22:05:20.290970+0000","last_became_peered":"2024-08-18T22:05:20.290970+0000","last_unstale":"2024-08-18T22:06:10.514793+0000","last_undegraded":"2024-08-18T22:06:10.514793+0000","last_fullsized":"2024-08-18T22:06:10.514793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:29.438996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510601+0000","last_change":"2024-08-18T22:05:28.923141+0000","last_active":"2024-08-18T22:06:10.510601+0000","last_peered":"2024-08-18T22:06:10.510601+0000","last_clean":"2024-08-18T22:06:10.510601+0000","last_became_active":"2024-08-18T22:05:28.922269+0000","last_became_peered":"2024-08-18T22:05:28.922269+0000","last_unstale":"2024-08-18T22:06:10.510601+0000","last_undegraded":"2024-08-18T22:06:10.510601+0000","last_fullsized":"2024-08-18T22:06:10.510601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:58.092640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509287+0000","last_change":"2024-08-18T22:05:21.850124+0000","last_active":"2024-08-18T22:06:10.509287+0000","last_peered":"2024-08-18T22:06:10.509287+0000","last_clean":"2024-08-18T22:06:10.509287+0000","last_became_active":"2024-08-18T22:05:21.849805+0000","last_became_peered":"2024-08-18T22:05:21.849805+0000","last_unstale":"2024-08-18T22:06:10.509287+0000","last_undegraded":"2024-08-18T22:06:10.509287+0000","last_fullsized":"2024-08-18T22:06:10.509287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:53.492613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509230+0000","last_change":"2024-08-18T22:05:20.292836+0000","last_active":"2024-08-18T22:06:10.509230+0000","last_peered":"2024-08-18T22:06:10.509230+0000","last_clean":"2024-08-18T22:06:10.509230+0000","last_became_active":"2024-08-18T22:05:20.292456+0000","last_became_peered":"2024-08-18T22:05:20.292456+0000","last_unstale":"2024-08-18T22:06:10.509230+0000","last_undegraded":"2024-08-18T22:06:10.509230+0000","last_fullsized":"2024-08-18T22:06:10.509230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:19.525037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513298+0000","last_change":"2024-08-18T22:05:29.012439+0000","last_active":"2024-08-18T22:06:10.513298+0000","last_peered":"2024-08-18T22:06:10.513298+0000","last_clean":"2024-08-18T22:06:10.513298+0000","last_became_active":"2024-08-18T22:05:29.011860+0000","last_became_peered":"2024-08-18T22:05:29.011860+0000","last_unstale":"2024-08-18T22:06:10.513298+0000","last_undegraded":"2024-08-18T22:06:10.513298+0000","last_fullsized":"2024-08-18T22:06:10.513298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:03.432217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509272+0000","last_change":"2024-08-18T22:05:21.855598+0000","last_active":"2024-08-18T22:06:10.509272+0000","last_peered":"2024-08-18T22:06:10.509272+0000","last_clean":"2024-08-18T22:06:10.509272+0000","last_became_active":"2024-08-18T22:05:21.855228+0000","last_became_peered":"2024-08-18T22:05:21.855228+0000","last_unstale":"2024-08-18T22:06:10.509272+0000","last_undegraded":"2024-08-18T22:06:10.509272+0000","last_fullsized":"2024-08-18T22:06:10.509272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:33.762700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508476+0000","last_change":"2024-08-18T22:05:19.844638+0000","last_active":"2024-08-18T22:06:10.508476+0000","last_peered":"2024-08-18T22:06:10.508476+0000","last_clean":"2024-08-18T22:06:10.508476+0000","last_became_active":"2024-08-18T22:05:19.844333+0000","last_became_peered":"2024-08-18T22:05:19.844333+0000","last_unstale":"2024-08-18T22:06:10.508476+0000","last_undegraded":"2024-08-18T22:06:10.508476+0000","last_fullsized":"2024-08-18T22:06:10.508476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:26.947512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505914+0000","last_change":"2024-08-18T22:05:28.919965+0000","last_active":"2024-08-18T22:06:10.505914+0000","last_peered":"2024-08-18T22:06:10.505914+0000","last_clean":"2024-08-18T22:06:10.505914+0000","last_became_active":"2024-08-18T22:05:28.919546+0000","last_became_peered":"2024-08-18T22:05:28.919546+0000","last_unstale":"2024-08-18T22:06:10.505914+0000","last_undegraded":"2024-08-18T22:06:10.505914+0000","last_fullsized":"2024-08-18T22:06:10.505914+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:49.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506450+0000","last_change":"2024-08-18T22:05:21.857867+0000","last_active":"2024-08-18T22:06:10.506450+0000","last_peered":"2024-08-18T22:06:10.506450+0000","last_clean":"2024-08-18T22:06:10.506450+0000","last_became_active":"2024-08-18T22:05:21.857515+0000","last_became_peered":"2024-08-18T22:05:21.857515+0000","last_unstale":"2024-08-18T22:06:10.506450+0000","last_undegraded":"2024-08-18T22:06:10.506450+0000","last_fullsized":"2024-08-18T22:06:10.506450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:51.148321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":103,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:07:01.550259+0000","last_change":"2024-08-18T22:05:20.290924+0000","last_active":"2024-08-18T22:07:01.550259+0000","last_peered":"2024-08-18T22:07:01.550259+0000","last_clean":"2024-08-18T22:07:01.550259+0000","last_became_active":"2024-08-18T22:05:20.290587+0000","last_became_peered":"2024-08-18T22:05:20.290587+0000","last_unstale":"2024-08-18T22:07:01.550259+0000","last_undegraded":"2024-08-18T22:07:01.550259+0000","last_fullsized":"2024-08-18T22:07:01.550259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:35.029634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505852+0000","last_change":"2024-08-18T22:05:29.012876+0000","last_active":"2024-08-18T22:06:10.505852+0000","last_peered":"2024-08-18T22:06:10.505852+0000","last_clean":"2024-08-18T22:06:10.505852+0000","last_became_active":"2024-08-18T22:05:29.011930+0000","last_became_peered":"2024-08-18T22:05:29.011930+0000","last_unstale":"2024-08-18T22:06:10.505852+0000","last_undegraded":"2024-08-18T22:06:10.505852+0000","last_fullsized":"2024-08-18T22:06:10.505852+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:22:35.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505526+0000","last_change":"2024-08-18T22:05:21.860798+0000","last_active":"2024-08-18T22:06:10.505526+0000","last_peered":"2024-08-18T22:06:10.505526+0000","last_clean":"2024-08-18T22:06:10.505526+0000","last_became_active":"2024-08-18T22:05:21.856968+0000","last_became_peered":"2024-08-18T22:05:21.856968+0000","last_unstale":"2024-08-18T22:06:10.505526+0000","last_undegraded":"2024-08-18T22:06:10.505526+0000","last_fullsized":"2024-08-18T22:06:10.505526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:54.934400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508009+0000","last_change":"2024-08-18T22:05:19.844775+0000","last_active":"2024-08-18T22:06:10.508009+0000","last_peered":"2024-08-18T22:06:10.508009+0000","last_clean":"2024-08-18T22:06:10.508009+0000","last_became_active":"2024-08-18T22:05:19.844465+0000","last_became_peered":"2024-08-18T22:05:19.844465+0000","last_unstale":"2024-08-18T22:06:10.508009+0000","last_undegraded":"2024-08-18T22:06:10.508009+0000","last_fullsized":"2024-08-18T22:06:10.508009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.042335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507348+0000","last_change":"2024-08-18T22:05:29.013275+0000","last_active":"2024-08-18T22:06:10.507348+0000","last_peered":"2024-08-18T22:06:10.507348+0000","last_clean":"2024-08-18T22:06:10.507348+0000","last_became_active":"2024-08-18T22:05:29.012537+0000","last_became_peered":"2024-08-18T22:05:29.012537+0000","last_unstale":"2024-08-18T22:06:10.507348+0000","last_undegraded":"2024-08-18T22:06:10.507348+0000","last_fullsized":"2024-08-18T22:06:10.507348+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:15:39.775360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772046+0000","last_change":"2024-08-18T22:05:21.853358+0000","last_active":"2024-08-18T22:06:10.772046+0000","last_peered":"2024-08-18T22:06:10.772046+0000","last_clean":"2024-08-18T22:06:10.772046+0000","last_became_active":"2024-08-18T22:05:21.853071+0000","last_became_peered":"2024-08-18T22:05:21.853071+0000","last_unstale":"2024-08-18T22:06:10.772046+0000","last_undegraded":"2024-08-18T22:06:10.772046+0000","last_fullsized":"2024-08-18T22:06:10.772046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:23.755263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511287+0000","last_change":"2024-08-18T22:05:19.846922+0000","last_active":"2024-08-18T22:06:10.511287+0000","last_peered":"2024-08-18T22:06:10.511287+0000","last_clean":"2024-08-18T22:06:10.511287+0000","last_became_active":"2024-08-18T22:05:19.846619+0000","last_became_peered":"2024-08-18T22:05:19.846619+0000","last_unstale":"2024-08-18T22:06:10.511287+0000","last_undegraded":"2024-08-18T22:06:10.511287+0000","last_fullsized":"2024-08-18T22:06:10.511287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:36:16.232344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":353,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508258+0000","last_change":"2024-08-18T22:04:11.878703+0000","last_active":"2024-08-18T22:06:10.508258+0000","last_peered":"2024-08-18T22:06:10.508258+0000","last_clean":"2024-08-18T22:06:10.508258+0000","last_became_active":"2024-08-18T22:04:11.878157+0000","last_became_peered":"2024-08-18T22:04:11.878157+0000","last_unstale":"2024-08-18T22:06:10.508258+0000","last_undegraded":"2024-08-18T22:06:10.508258+0000","last_fullsized":"2024-08-18T22:06:10.508258+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_clean_scrub_stamp":"2024-08-18T22:01:09.551264+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:24:07.391758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508423+0000","last_change":"2024-08-18T22:05:28.928882+0000","last_active":"2024-08-18T22:06:10.508423+0000","last_peered":"2024-08-18T22:06:10.508423+0000","last_clean":"2024-08-18T22:06:10.508423+0000","last_became_active":"2024-08-18T22:05:28.928482+0000","last_became_peered":"2024-08-18T22:05:28.928482+0000","last_unstale":"2024-08-18T22:06:10.508423+0000","last_undegraded":"2024-08-18T22:06:10.508423+0000","last_fullsized":"2024-08-18T22:06:10.508423+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:41.739482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508689+0000","last_change":"2024-08-18T22:05:21.863045+0000","last_active":"2024-08-18T22:06:10.508689+0000","last_peered":"2024-08-18T22:06:10.508689+0000","last_clean":"2024-08-18T22:06:10.508689+0000","last_became_active":"2024-08-18T22:05:21.862758+0000","last_became_peered":"2024-08-18T22:05:21.862758+0000","last_unstale":"2024-08-18T22:06:10.508689+0000","last_undegraded":"2024-08-18T22:06:10.508689+0000","last_fullsized":"2024-08-18T22:06:10.508689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:08:39.111147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509216+0000","last_change":"2024-08-18T22:05:20.291030+0000","last_active":"2024-08-18T22:06:10.509216+0000","last_peered":"2024-08-18T22:06:10.509216+0000","last_clean":"2024-08-18T22:06:10.509216+0000","last_became_active":"2024-08-18T22:05:20.290427+0000","last_became_peered":"2024-08-18T22:05:20.290427+0000","last_unstale":"2024-08-18T22:06:10.509216+0000","last_undegraded":"2024-08-18T22:06:10.509216+0000","last_fullsized":"2024-08-18T22:06:10.509216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:14:42.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506125+0000","last_change":"2024-08-18T22:05:28.923700+0000","last_active":"2024-08-18T22:06:10.506125+0000","last_peered":"2024-08-18T22:06:10.506125+0000","last_clean":"2024-08-18T22:06:10.506125+0000","last_became_active":"2024-08-18T22:05:28.923280+0000","last_became_peered":"2024-08-18T22:05:28.923280+0000","last_unstale":"2024-08-18T22:06:10.506125+0000","last_undegraded":"2024-08-18T22:06:10.506125+0000","last_fullsized":"2024-08-18T22:06:10.506125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:25:45.343542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508357+0000","last_change":"2024-08-18T22:05:21.856107+0000","last_active":"2024-08-18T22:06:10.508357+0000","last_peered":"2024-08-18T22:06:10.508357+0000","last_clean":"2024-08-18T22:06:10.508357+0000","last_became_active":"2024-08-18T22:05:21.853276+0000","last_became_peered":"2024-08-18T22:05:21.853276+0000","last_unstale":"2024-08-18T22:06:10.508357+0000","last_undegraded":"2024-08-18T22:06:10.508357+0000","last_fullsized":"2024-08-18T22:06:10.508357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:58.280375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507968+0000","last_change":"2024-08-18T22:05:19.843445+0000","last_active":"2024-08-18T22:06:10.507968+0000","last_peered":"2024-08-18T22:06:10.507968+0000","last_clean":"2024-08-18T22:06:10.507968+0000","last_became_active":"2024-08-18T22:05:19.843000+0000","last_became_peered":"2024-08-18T22:05:19.843000+0000","last_unstale":"2024-08-18T22:06:10.507968+0000","last_undegraded":"2024-08-18T22:06:10.507968+0000","last_fullsized":"2024-08-18T22:06:10.507968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:23.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515953+0000","last_change":"2024-08-18T22:06:10.515953+0000","last_active":"2024-08-18T22:06:10.515953+0000","last_peered":"2024-08-18T22:06:10.515953+0000","last_clean":"2024-08-18T22:06:10.515953+0000","last_became_active":"2024-08-18T22:06:10.515662+0000","last_became_peered":"2024-08-18T22:06:10.515662+0000","last_unstale":"2024-08-18T22:06:10.515953+0000","last_undegraded":"2024-08-18T22:06:10.515953+0000","last_fullsized":"2024-08-18T22:06:10.515953+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:43.150180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509215+0000","last_change":"2024-08-18T22:05:21.864029+0000","last_active":"2024-08-18T22:06:10.509215+0000","last_peered":"2024-08-18T22:06:10.509215+0000","last_clean":"2024-08-18T22:06:10.509215+0000","last_became_active":"2024-08-18T22:05:21.863509+0000","last_became_peered":"2024-08-18T22:05:21.863509+0000","last_unstale":"2024-08-18T22:06:10.509215+0000","last_undegraded":"2024-08-18T22:06:10.509215+0000","last_fullsized":"2024-08-18T22:06:10.509215+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:42.879243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506010+0000","last_change":"2024-08-18T22:05:19.846514+0000","last_active":"2024-08-18T22:06:10.506010+0000","last_peered":"2024-08-18T22:06:10.506010+0000","last_clean":"2024-08-18T22:06:10.506010+0000","last_became_active":"2024-08-18T22:05:19.846190+0000","last_became_peered":"2024-08-18T22:05:19.846190+0000","last_unstale":"2024-08-18T22:06:10.506010+0000","last_undegraded":"2024-08-18T22:06:10.506010+0000","last_fullsized":"2024-08-18T22:06:10.506010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:49:00.317597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506329+0000","last_change":"2024-08-18T22:05:28.923183+0000","last_active":"2024-08-18T22:06:10.506329+0000","last_peered":"2024-08-18T22:06:10.506329+0000","last_clean":"2024-08-18T22:06:10.506329+0000","last_became_active":"2024-08-18T22:05:28.922809+0000","last_became_peered":"2024-08-18T22:05:28.922809+0000","last_unstale":"2024-08-18T22:06:10.506329+0000","last_undegraded":"2024-08-18T22:06:10.506329+0000","last_fullsized":"2024-08-18T22:06:10.506329+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:26.416920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510283+0000","last_change":"2024-08-18T22:05:21.849075+0000","last_active":"2024-08-18T22:06:10.510283+0000","last_peered":"2024-08-18T22:06:10.510283+0000","last_clean":"2024-08-18T22:06:10.510283+0000","last_became_active":"2024-08-18T22:05:21.848759+0000","last_became_peered":"2024-08-18T22:05:21.848759+0000","last_unstale":"2024-08-18T22:06:10.510283+0000","last_undegraded":"2024-08-18T22:06:10.510283+0000","last_fullsized":"2024-08-18T22:06:10.510283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:26.531534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.515145+0000","last_change":"2024-08-18T22:05:19.849210+0000","last_active":"2024-08-18T22:06:10.515145+0000","last_peered":"2024-08-18T22:06:10.515145+0000","last_clean":"2024-08-18T22:06:10.515145+0000","last_became_active":"2024-08-18T22:05:19.848829+0000","last_became_peered":"2024-08-18T22:05:19.848829+0000","last_unstale":"2024-08-18T22:06:10.515145+0000","last_undegraded":"2024-08-18T22:06:10.515145+0000","last_fullsized":"2024-08-18T22:06:10.515145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:19.321686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506551+0000","last_change":"2024-08-18T22:05:28.924577+0000","last_active":"2024-08-18T22:06:10.506551+0000","last_peered":"2024-08-18T22:06:10.506551+0000","last_clean":"2024-08-18T22:06:10.506551+0000","last_became_active":"2024-08-18T22:05:28.924183+0000","last_became_peered":"2024-08-18T22:05:28.924183+0000","last_unstale":"2024-08-18T22:06:10.506551+0000","last_undegraded":"2024-08-18T22:06:10.506551+0000","last_fullsized":"2024-08-18T22:06:10.506551+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:22.702757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513994+0000","last_change":"2024-08-18T22:06:10.513610+0000","last_active":"2024-08-18T22:06:10.513994+0000","last_peered":"2024-08-18T22:06:10.513994+0000","last_clean":"2024-08-18T22:06:10.513994+0000","last_became_active":"2024-08-18T22:06:10.513400+0000","last_became_peered":"2024-08-18T22:06:10.513400+0000","last_unstale":"2024-08-18T22:06:10.513994+0000","last_undegraded":"2024-08-18T22:06:10.513994+0000","last_fullsized":"2024-08-18T22:06:10.513994+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:49.275223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513546+0000","last_change":"2024-08-18T22:05:20.291752+0000","last_active":"2024-08-18T22:06:10.513546+0000","last_peered":"2024-08-18T22:06:10.513546+0000","last_clean":"2024-08-18T22:06:10.513546+0000","last_became_active":"2024-08-18T22:05:20.291431+0000","last_became_peered":"2024-08-18T22:05:20.291431+0000","last_unstale":"2024-08-18T22:06:10.513546+0000","last_undegraded":"2024-08-18T22:06:10.513546+0000","last_fullsized":"2024-08-18T22:06:10.513546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:32.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506003+0000","last_change":"2024-08-18T22:05:28.924121+0000","last_active":"2024-08-18T22:06:10.506003+0000","last_peered":"2024-08-18T22:06:10.506003+0000","last_clean":"2024-08-18T22:06:10.506003+0000","last_became_active":"2024-08-18T22:05:28.923753+0000","last_became_peered":"2024-08-18T22:05:28.923753+0000","last_unstale":"2024-08-18T22:06:10.506003+0000","last_undegraded":"2024-08-18T22:06:10.506003+0000","last_fullsized":"2024-08-18T22:06:10.506003+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:57.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507828+0000","last_change":"2024-08-18T22:05:21.858366+0000","last_active":"2024-08-18T22:06:10.507828+0000","last_peered":"2024-08-18T22:06:10.507828+0000","last_clean":"2024-08-18T22:06:10.507828+0000","last_became_active":"2024-08-18T22:05:21.858021+0000","last_became_peered":"2024-08-18T22:05:21.858021+0000","last_unstale":"2024-08-18T22:06:10.507828+0000","last_undegraded":"2024-08-18T22:06:10.507828+0000","last_fullsized":"2024-08-18T22:06:10.507828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:55.662965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'4","reported_seq":107,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:07:02.552464+0000","last_change":"2024-08-18T22:05:19.850013+0000","last_active":"2024-08-18T22:07:02.552464+0000","last_peered":"2024-08-18T22:07:02.552464+0000","last_clean":"2024-08-18T22:07:02.552464+0000","last_became_active":"2024-08-18T22:05:19.849551+0000","last_became_peered":"2024-08-18T22:05:19.849551+0000","last_unstale":"2024-08-18T22:07:02.552464+0000","last_undegraded":"2024-08-18T22:07:02.552464+0000","last_fullsized":"2024-08-18T22:07:02.552464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:15.182999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509627+0000","last_change":"2024-08-18T22:05:28.927318+0000","last_active":"2024-08-18T22:06:10.509627+0000","last_peered":"2024-08-18T22:06:10.509627+0000","last_clean":"2024-08-18T22:06:10.509627+0000","last_became_active":"2024-08-18T22:05:28.926786+0000","last_became_peered":"2024-08-18T22:05:28.926786+0000","last_unstale":"2024-08-18T22:06:10.509627+0000","last_undegraded":"2024-08-18T22:06:10.509627+0000","last_fullsized":"2024-08-18T22:06:10.509627+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:45.798247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.511821+0000","last_change":"2024-08-18T22:06:10.511821+0000","last_active":"2024-08-18T22:06:10.511821+0000","last_peered":"2024-08-18T22:06:10.511821+0000","last_clean":"2024-08-18T22:06:10.511821+0000","last_became_active":"2024-08-18T22:06:10.511135+0000","last_became_peered":"2024-08-18T22:06:10.511135+0000","last_unstale":"2024-08-18T22:06:10.511821+0000","last_undegraded":"2024-08-18T22:06:10.511821+0000","last_fullsized":"2024-08-18T22:06:10.511821+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:07.108531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506959+0000","last_change":"2024-08-18T22:05:19.844061+0000","last_active":"2024-08-18T22:06:10.506959+0000","last_peered":"2024-08-18T22:06:10.506959+0000","last_clean":"2024-08-18T22:06:10.506959+0000","last_became_active":"2024-08-18T22:05:19.843513+0000","last_became_peered":"2024-08-18T22:05:19.843513+0000","last_unstale":"2024-08-18T22:06:10.506959+0000","last_undegraded":"2024-08-18T22:06:10.506959+0000","last_fullsized":"2024-08-18T22:06:10.506959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:53.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510069+0000","last_change":"2024-08-18T22:05:28.922986+0000","last_active":"2024-08-18T22:06:10.510069+0000","last_peered":"2024-08-18T22:06:10.510069+0000","last_clean":"2024-08-18T22:06:10.510069+0000","last_became_active":"2024-08-18T22:05:28.922322+0000","last_became_peered":"2024-08-18T22:05:28.922322+0000","last_unstale":"2024-08-18T22:06:10.510069+0000","last_undegraded":"2024-08-18T22:06:10.510069+0000","last_fullsized":"2024-08-18T22:06:10.510069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:28.168299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505649+0000","last_change":"2024-08-18T22:05:21.853389+0000","last_active":"2024-08-18T22:06:10.505649+0000","last_peered":"2024-08-18T22:06:10.505649+0000","last_clean":"2024-08-18T22:06:10.505649+0000","last_became_active":"2024-08-18T22:05:21.853095+0000","last_became_peered":"2024-08-18T22:05:21.853095+0000","last_unstale":"2024-08-18T22:06:10.505649+0000","last_undegraded":"2024-08-18T22:06:10.505649+0000","last_fullsized":"2024-08-18T22:06:10.505649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:14.126983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508891+0000","last_change":"2024-08-18T22:05:19.846788+0000","last_active":"2024-08-18T22:06:10.508891+0000","last_peered":"2024-08-18T22:06:10.508891+0000","last_clean":"2024-08-18T22:06:10.508891+0000","last_became_active":"2024-08-18T22:05:19.846248+0000","last_became_peered":"2024-08-18T22:05:19.846248+0000","last_unstale":"2024-08-18T22:06:10.508891+0000","last_undegraded":"2024-08-18T22:06:10.508891+0000","last_fullsized":"2024-08-18T22:06:10.508891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:46.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507672+0000","last_change":"2024-08-18T22:05:28.920294+0000","last_active":"2024-08-18T22:06:10.507672+0000","last_peered":"2024-08-18T22:06:10.507672+0000","last_clean":"2024-08-18T22:06:10.507672+0000","last_became_active":"2024-08-18T22:05:28.919351+0000","last_became_peered":"2024-08-18T22:05:28.919351+0000","last_unstale":"2024-08-18T22:06:10.507672+0000","last_undegraded":"2024-08-18T22:06:10.507672+0000","last_fullsized":"2024-08-18T22:06:10.507672+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:49.425281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.514189+0000","last_change":"2024-08-18T22:05:21.864529+0000","last_active":"2024-08-18T22:06:10.514189+0000","last_peered":"2024-08-18T22:06:10.514189+0000","last_clean":"2024-08-18T22:06:10.514189+0000","last_became_active":"2024-08-18T22:05:21.864062+0000","last_became_peered":"2024-08-18T22:05:21.864062+0000","last_unstale":"2024-08-18T22:06:10.514189+0000","last_undegraded":"2024-08-18T22:06:10.514189+0000","last_fullsized":"2024-08-18T22:06:10.514189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:24:49.037343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'31","reported_seq":223,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:07:03.603110+0000","last_change":"2024-08-18T22:06:10.522113+0000","last_active":"2024-08-18T22:07:03.603110+0000","last_peered":"2024-08-18T22:07:03.603110+0000","last_clean":"2024-08-18T22:07:03.603110+0000","last_became_active":"2024-08-18T22:06:10.514837+0000","last_became_peered":"2024-08-18T22:06:10.514837+0000","last_unstale":"2024-08-18T22:07:03.603110+0000","last_undegraded":"2024-08-18T22:07:03.603110+0000","last_fullsized":"2024-08-18T22:07:03.603110+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:46.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61517,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":122,"num_write":32,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508344+0000","last_change":"2024-08-18T22:05:28.926357+0000","last_active":"2024-08-18T22:06:10.508344+0000","last_peered":"2024-08-18T22:06:10.508344+0000","last_clean":"2024-08-18T22:06:10.508344+0000","last_became_active":"2024-08-18T22:05:28.926016+0000","last_became_peered":"2024-08-18T22:05:28.926016+0000","last_unstale":"2024-08-18T22:06:10.508344+0000","last_undegraded":"2024-08-18T22:06:10.508344+0000","last_fullsized":"2024-08-18T22:06:10.508344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:16.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506937+0000","last_change":"2024-08-18T22:05:21.860237+0000","last_active":"2024-08-18T22:06:10.506937+0000","last_peered":"2024-08-18T22:06:10.506937+0000","last_clean":"2024-08-18T22:06:10.506937+0000","last_became_active":"2024-08-18T22:05:21.859919+0000","last_became_peered":"2024-08-18T22:05:21.859919+0000","last_unstale":"2024-08-18T22:06:10.506937+0000","last_undegraded":"2024-08-18T22:06:10.506937+0000","last_fullsized":"2024-08-18T22:06:10.506937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:21.048413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507852+0000","last_change":"2024-08-18T22:05:20.291233+0000","last_active":"2024-08-18T22:06:10.507852+0000","last_peered":"2024-08-18T22:06:10.507852+0000","last_clean":"2024-08-18T22:06:10.507852+0000","last_became_active":"2024-08-18T22:05:20.290893+0000","last_became_peered":"2024-08-18T22:05:20.290893+0000","last_unstale":"2024-08-18T22:06:10.507852+0000","last_undegraded":"2024-08-18T22:06:10.507852+0000","last_fullsized":"2024-08-18T22:06:10.507852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:36.889561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510634+0000","last_change":"2024-08-18T22:05:28.923076+0000","last_active":"2024-08-18T22:06:10.510634+0000","last_peered":"2024-08-18T22:06:10.510634+0000","last_clean":"2024-08-18T22:06:10.510634+0000","last_became_active":"2024-08-18T22:05:28.922688+0000","last_became_peered":"2024-08-18T22:05:28.922688+0000","last_unstale":"2024-08-18T22:06:10.510634+0000","last_undegraded":"2024-08-18T22:06:10.510634+0000","last_fullsized":"2024-08-18T22:06:10.510634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:34.360540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509085+0000","last_change":"2024-08-18T22:05:21.855174+0000","last_active":"2024-08-18T22:06:10.509085+0000","last_peered":"2024-08-18T22:06:10.509085+0000","last_clean":"2024-08-18T22:06:10.509085+0000","last_became_active":"2024-08-18T22:05:21.854818+0000","last_became_peered":"2024-08-18T22:05:21.854818+0000","last_unstale":"2024-08-18T22:06:10.509085+0000","last_undegraded":"2024-08-18T22:06:10.509085+0000","last_fullsized":"2024-08-18T22:06:10.509085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:48:55.094624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508468+0000","last_change":"2024-08-18T22:05:19.847876+0000","last_active":"2024-08-18T22:06:10.508468+0000","last_peered":"2024-08-18T22:06:10.508468+0000","last_clean":"2024-08-18T22:06:10.508468+0000","last_became_active":"2024-08-18T22:05:19.847505+0000","last_became_peered":"2024-08-18T22:05:19.847505+0000","last_unstale":"2024-08-18T22:06:10.508468+0000","last_undegraded":"2024-08-18T22:06:10.508468+0000","last_fullsized":"2024-08-18T22:06:10.508468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:50:15.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508005+0000","last_change":"2024-08-18T22:05:28.921647+0000","last_active":"2024-08-18T22:06:10.508005+0000","last_peered":"2024-08-18T22:06:10.508005+0000","last_clean":"2024-08-18T22:06:10.508005+0000","last_became_active":"2024-08-18T22:05:28.921305+0000","last_became_peered":"2024-08-18T22:05:28.921305+0000","last_unstale":"2024-08-18T22:06:10.508005+0000","last_undegraded":"2024-08-18T22:06:10.508005+0000","last_fullsized":"2024-08-18T22:06:10.508005+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:29.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506841+0000","last_change":"2024-08-18T22:05:21.861151+0000","last_active":"2024-08-18T22:06:10.506841+0000","last_peered":"2024-08-18T22:06:10.506841+0000","last_clean":"2024-08-18T22:06:10.506841+0000","last_became_active":"2024-08-18T22:05:21.860834+0000","last_became_peered":"2024-08-18T22:05:21.860834+0000","last_unstale":"2024-08-18T22:06:10.506841+0000","last_undegraded":"2024-08-18T22:06:10.506841+0000","last_fullsized":"2024-08-18T22:06:10.506841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:32.890750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":103,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:07:02.552264+0000","last_change":"2024-08-18T22:05:19.846145+0000","last_active":"2024-08-18T22:07:02.552264+0000","last_peered":"2024-08-18T22:07:02.552264+0000","last_clean":"2024-08-18T22:07:02.552264+0000","last_became_active":"2024-08-18T22:05:19.845711+0000","last_became_peered":"2024-08-18T22:05:19.845711+0000","last_unstale":"2024-08-18T22:07:02.552264+0000","last_undegraded":"2024-08-18T22:07:02.552264+0000","last_fullsized":"2024-08-18T22:07:02.552264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:20.376131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771915+0000","last_change":"2024-08-18T22:05:28.923256+0000","last_active":"2024-08-18T22:06:10.771915+0000","last_peered":"2024-08-18T22:06:10.771915+0000","last_clean":"2024-08-18T22:06:10.771915+0000","last_became_active":"2024-08-18T22:05:28.922845+0000","last_became_peered":"2024-08-18T22:05:28.922845+0000","last_unstale":"2024-08-18T22:06:10.771915+0000","last_undegraded":"2024-08-18T22:06:10.771915+0000","last_fullsized":"2024-08-18T22:06:10.771915+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:41.930937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508677+0000","last_change":"2024-08-18T22:05:28.924743+0000","last_active":"2024-08-18T22:06:10.508677+0000","last_peered":"2024-08-18T22:06:10.508677+0000","last_clean":"2024-08-18T22:06:10.508677+0000","last_became_active":"2024-08-18T22:05:28.923674+0000","last_became_peered":"2024-08-18T22:05:28.923674+0000","last_unstale":"2024-08-18T22:06:10.508677+0000","last_undegraded":"2024-08-18T22:06:10.508677+0000","last_fullsized":"2024-08-18T22:06:10.508677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:19.834998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508496+0000","last_change":"2024-08-18T22:05:21.857194+0000","last_active":"2024-08-18T22:06:10.508496+0000","last_peered":"2024-08-18T22:06:10.508496+0000","last_clean":"2024-08-18T22:06:10.508496+0000","last_became_active":"2024-08-18T22:05:21.856916+0000","last_became_peered":"2024-08-18T22:05:21.856916+0000","last_unstale":"2024-08-18T22:06:10.508496+0000","last_undegraded":"2024-08-18T22:06:10.508496+0000","last_fullsized":"2024-08-18T22:06:10.508496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:24.759501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506570+0000","last_change":"2024-08-18T22:05:19.844919+0000","last_active":"2024-08-18T22:06:10.506570+0000","last_peered":"2024-08-18T22:06:10.506570+0000","last_clean":"2024-08-18T22:06:10.506570+0000","last_became_active":"2024-08-18T22:05:19.844539+0000","last_became_peered":"2024-08-18T22:05:19.844539+0000","last_unstale":"2024-08-18T22:06:10.506570+0000","last_undegraded":"2024-08-18T22:06:10.506570+0000","last_fullsized":"2024-08-18T22:06:10.506570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:01.598535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510256+0000","last_change":"2024-08-18T22:05:28.923304+0000","last_active":"2024-08-18T22:06:10.510256+0000","last_peered":"2024-08-18T22:06:10.510256+0000","last_clean":"2024-08-18T22:06:10.510256+0000","last_became_active":"2024-08-18T22:05:28.922912+0000","last_became_peered":"2024-08-18T22:05:28.922912+0000","last_unstale":"2024-08-18T22:06:10.510256+0000","last_undegraded":"2024-08-18T22:06:10.510256+0000","last_fullsized":"2024-08-18T22:06:10.510256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:24:47.834354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771950+0000","last_change":"2024-08-18T22:05:21.849448+0000","last_active":"2024-08-18T22:06:10.771950+0000","last_peered":"2024-08-18T22:06:10.771950+0000","last_clean":"2024-08-18T22:06:10.771950+0000","last_became_active":"2024-08-18T22:05:21.849154+0000","last_became_peered":"2024-08-18T22:05:21.849154+0000","last_unstale":"2024-08-18T22:06:10.771950+0000","last_undegraded":"2024-08-18T22:06:10.771950+0000","last_fullsized":"2024-08-18T22:06:10.771950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:38.583121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505540+0000","last_change":"2024-08-18T22:05:19.848483+0000","last_active":"2024-08-18T22:06:10.505540+0000","last_peered":"2024-08-18T22:06:10.505540+0000","last_clean":"2024-08-18T22:06:10.505540+0000","last_became_active":"2024-08-18T22:05:19.848190+0000","last_became_peered":"2024-08-18T22:05:19.848190+0000","last_unstale":"2024-08-18T22:06:10.505540+0000","last_undegraded":"2024-08-18T22:06:10.505540+0000","last_fullsized":"2024-08-18T22:06:10.505540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:01.719565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509148+0000","last_change":"2024-08-18T22:05:19.843796+0000","last_active":"2024-08-18T22:06:10.509148+0000","last_peered":"2024-08-18T22:06:10.509148+0000","last_clean":"2024-08-18T22:06:10.509148+0000","last_became_active":"2024-08-18T22:05:19.843495+0000","last_became_peered":"2024-08-18T22:05:19.843495+0000","last_unstale":"2024-08-18T22:06:10.509148+0000","last_undegraded":"2024-08-18T22:06:10.509148+0000","last_fullsized":"2024-08-18T22:06:10.509148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:21.583561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507269+0000","last_change":"2024-08-18T22:05:21.856370+0000","last_active":"2024-08-18T22:06:10.507269+0000","last_peered":"2024-08-18T22:06:10.507269+0000","last_clean":"2024-08-18T22:06:10.507269+0000","last_became_active":"2024-08-18T22:05:21.855954+0000","last_became_peered":"2024-08-18T22:05:21.855954+0000","last_unstale":"2024-08-18T22:06:10.507269+0000","last_undegraded":"2024-08-18T22:06:10.507269+0000","last_fullsized":"2024-08-18T22:06:10.507269+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:30.828305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.516344+0000","last_change":"2024-08-18T22:06:10.516344+0000","last_active":"2024-08-18T22:06:10.516344+0000","last_peered":"2024-08-18T22:06:10.516344+0000","last_clean":"2024-08-18T22:06:10.516344+0000","last_became_active":"2024-08-18T22:06:10.515925+0000","last_became_peered":"2024-08-18T22:06:10.515925+0000","last_unstale":"2024-08-18T22:06:10.516344+0000","last_undegraded":"2024-08-18T22:06:10.516344+0000","last_fullsized":"2024-08-18T22:06:10.516344+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:41:07.585521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:58.546856+0000","last_change":"2024-08-18T22:05:19.846860+0000","last_active":"2024-08-18T22:06:58.546856+0000","last_peered":"2024-08-18T22:06:58.546856+0000","last_clean":"2024-08-18T22:06:58.546856+0000","last_became_active":"2024-08-18T22:05:19.846496+0000","last_became_peered":"2024-08-18T22:05:19.846496+0000","last_unstale":"2024-08-18T22:06:58.546856+0000","last_undegraded":"2024-08-18T22:06:58.546856+0000","last_fullsized":"2024-08-18T22:06:58.546856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:16.555137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513529+0000","last_change":"2024-08-18T22:05:21.849058+0000","last_active":"2024-08-18T22:06:10.513529+0000","last_peered":"2024-08-18T22:06:10.513529+0000","last_clean":"2024-08-18T22:06:10.513529+0000","last_became_active":"2024-08-18T22:05:21.848703+0000","last_became_peered":"2024-08-18T22:05:21.848703+0000","last_unstale":"2024-08-18T22:06:10.513529+0000","last_undegraded":"2024-08-18T22:06:10.513529+0000","last_fullsized":"2024-08-18T22:06:10.513529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:10.024156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508916+0000","last_change":"2024-08-18T22:05:28.922968+0000","last_active":"2024-08-18T22:06:10.508916+0000","last_peered":"2024-08-18T22:06:10.508916+0000","last_clean":"2024-08-18T22:06:10.508916+0000","last_became_active":"2024-08-18T22:05:28.922378+0000","last_became_peered":"2024-08-18T22:05:28.922378+0000","last_unstale":"2024-08-18T22:06:10.508916+0000","last_undegraded":"2024-08-18T22:06:10.508916+0000","last_fullsized":"2024-08-18T22:06:10.508916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:23:07.241028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509985+0000","last_change":"2024-08-18T22:05:21.858572+0000","last_active":"2024-08-18T22:06:10.509985+0000","last_peered":"2024-08-18T22:06:10.509985+0000","last_clean":"2024-08-18T22:06:10.509985+0000","last_became_active":"2024-08-18T22:05:21.858254+0000","last_became_peered":"2024-08-18T22:05:21.858254+0000","last_unstale":"2024-08-18T22:06:10.509985+0000","last_undegraded":"2024-08-18T22:06:10.509985+0000","last_fullsized":"2024-08-18T22:06:10.509985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:52.456087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509101+0000","last_change":"2024-08-18T22:05:21.856710+0000","last_active":"2024-08-18T22:06:10.509101+0000","last_peered":"2024-08-18T22:06:10.509101+0000","last_clean":"2024-08-18T22:06:10.509101+0000","last_became_active":"2024-08-18T22:05:21.855399+0000","last_became_peered":"2024-08-18T22:05:21.855399+0000","last_unstale":"2024-08-18T22:06:10.509101+0000","last_undegraded":"2024-08-18T22:06:10.509101+0000","last_fullsized":"2024-08-18T22:06:10.509101+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:36.039953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507843+0000","last_change":"2024-08-18T22:05:21.856085+0000","last_active":"2024-08-18T22:06:10.507843+0000","last_peered":"2024-08-18T22:06:10.507843+0000","last_clean":"2024-08-18T22:06:10.507843+0000","last_became_active":"2024-08-18T22:05:21.855263+0000","last_became_peered":"2024-08-18T22:05:21.855263+0000","last_unstale":"2024-08-18T22:06:10.507843+0000","last_undegraded":"2024-08-18T22:06:10.507843+0000","last_fullsized":"2024-08-18T22:06:10.507843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:31.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509110+0000","last_change":"2024-08-18T22:05:21.855385+0000","last_active":"2024-08-18T22:06:10.509110+0000","last_peered":"2024-08-18T22:06:10.509110+0000","last_clean":"2024-08-18T22:06:10.509110+0000","last_became_active":"2024-08-18T22:05:21.854829+0000","last_became_peered":"2024-08-18T22:05:21.854829+0000","last_unstale":"2024-08-18T22:06:10.509110+0000","last_undegraded":"2024-08-18T22:06:10.509110+0000","last_fullsized":"2024-08-18T22:06:10.509110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:59.704154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510370+0000","last_change":"2024-08-18T22:06:10.510370+0000","last_active":"2024-08-18T22:06:10.510370+0000","last_peered":"2024-08-18T22:06:10.510370+0000","last_clean":"2024-08-18T22:06:10.510370+0000","last_became_active":"2024-08-18T22:06:10.509829+0000","last_became_peered":"2024-08-18T22:06:10.509829+0000","last_unstale":"2024-08-18T22:06:10.510370+0000","last_undegraded":"2024-08-18T22:06:10.510370+0000","last_fullsized":"2024-08-18T22:06:10.510370+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:20.171834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510420+0000","last_change":"2024-08-18T22:05:21.856137+0000","last_active":"2024-08-18T22:06:10.510420+0000","last_peered":"2024-08-18T22:06:10.510420+0000","last_clean":"2024-08-18T22:06:10.510420+0000","last_became_active":"2024-08-18T22:05:21.855425+0000","last_became_peered":"2024-08-18T22:05:21.855425+0000","last_unstale":"2024-08-18T22:06:10.510420+0000","last_undegraded":"2024-08-18T22:06:10.510420+0000","last_fullsized":"2024-08-18T22:06:10.510420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:37.514710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509024+0000","last_change":"2024-08-18T22:05:21.856084+0000","last_active":"2024-08-18T22:06:10.509024+0000","last_peered":"2024-08-18T22:06:10.509024+0000","last_clean":"2024-08-18T22:06:10.509024+0000","last_became_active":"2024-08-18T22:05:21.855779+0000","last_became_peered":"2024-08-18T22:05:21.855779+0000","last_unstale":"2024-08-18T22:06:10.509024+0000","last_undegraded":"2024-08-18T22:06:10.509024+0000","last_fullsized":"2024-08-18T22:06:10.509024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:02:47.833634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.772328+0000","last_change":"2024-08-18T22:05:21.856729+0000","last_active":"2024-08-18T22:06:10.772328+0000","last_peered":"2024-08-18T22:06:10.772328+0000","last_clean":"2024-08-18T22:06:10.772328+0000","last_became_active":"2024-08-18T22:05:21.856446+0000","last_became_peered":"2024-08-18T22:05:21.856446+0000","last_unstale":"2024-08-18T22:06:10.772328+0000","last_undegraded":"2024-08-18T22:06:10.772328+0000","last_fullsized":"2024-08-18T22:06:10.772328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.482225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506405+0000","last_change":"2024-08-18T22:05:21.851772+0000","last_active":"2024-08-18T22:06:10.506405+0000","last_peered":"2024-08-18T22:06:10.506405+0000","last_clean":"2024-08-18T22:06:10.506405+0000","last_became_active":"2024-08-18T22:05:21.851417+0000","last_became_peered":"2024-08-18T22:05:21.851417+0000","last_unstale":"2024-08-18T22:06:10.506405+0000","last_undegraded":"2024-08-18T22:06:10.506405+0000","last_fullsized":"2024-08-18T22:06:10.506405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:32.509318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771984+0000","last_change":"2024-08-18T22:05:21.857887+0000","last_active":"2024-08-18T22:06:10.771984+0000","last_peered":"2024-08-18T22:06:10.771984+0000","last_clean":"2024-08-18T22:06:10.771984+0000","last_became_active":"2024-08-18T22:05:21.857585+0000","last_became_peered":"2024-08-18T22:05:21.857585+0000","last_unstale":"2024-08-18T22:06:10.771984+0000","last_undegraded":"2024-08-18T22:06:10.771984+0000","last_fullsized":"2024-08-18T22:06:10.771984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:23.299033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506488+0000","last_change":"2024-08-18T22:05:21.854626+0000","last_active":"2024-08-18T22:06:10.506488+0000","last_peered":"2024-08-18T22:06:10.506488+0000","last_clean":"2024-08-18T22:06:10.506488+0000","last_became_active":"2024-08-18T22:05:21.854290+0000","last_became_peered":"2024-08-18T22:05:21.854290+0000","last_unstale":"2024-08-18T22:06:10.506488+0000","last_undegraded":"2024-08-18T22:06:10.506488+0000","last_fullsized":"2024-08-18T22:06:10.506488+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:45:24.988669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505825+0000","last_change":"2024-08-18T22:05:21.865863+0000","last_active":"2024-08-18T22:06:10.505825+0000","last_peered":"2024-08-18T22:06:10.505825+0000","last_clean":"2024-08-18T22:06:10.505825+0000","last_became_active":"2024-08-18T22:05:21.864634+0000","last_became_peered":"2024-08-18T22:05:21.864634+0000","last_unstale":"2024-08-18T22:06:10.505825+0000","last_undegraded":"2024-08-18T22:06:10.505825+0000","last_fullsized":"2024-08-18T22:06:10.505825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:34.051147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510087+0000","last_change":"2024-08-18T22:05:21.860193+0000","last_active":"2024-08-18T22:06:10.510087+0000","last_peered":"2024-08-18T22:06:10.510087+0000","last_clean":"2024-08-18T22:06:10.510087+0000","last_became_active":"2024-08-18T22:05:21.859761+0000","last_became_peered":"2024-08-18T22:05:21.859761+0000","last_unstale":"2024-08-18T22:06:10.510087+0000","last_undegraded":"2024-08-18T22:06:10.510087+0000","last_fullsized":"2024-08-18T22:06:10.510087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:18.465913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509086+0000","last_change":"2024-08-18T22:05:21.860569+0000","last_active":"2024-08-18T22:06:10.509086+0000","last_peered":"2024-08-18T22:06:10.509086+0000","last_clean":"2024-08-18T22:06:10.509086+0000","last_became_active":"2024-08-18T22:05:21.860250+0000","last_became_peered":"2024-08-18T22:05:21.860250+0000","last_unstale":"2024-08-18T22:06:10.509086+0000","last_undegraded":"2024-08-18T22:06:10.509086+0000","last_fullsized":"2024-08-18T22:06:10.509086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:52.097840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509523+0000","last_change":"2024-08-18T22:05:21.858271+0000","last_active":"2024-08-18T22:06:10.509523+0000","last_peered":"2024-08-18T22:06:10.509523+0000","last_clean":"2024-08-18T22:06:10.509523+0000","last_became_active":"2024-08-18T22:05:21.857968+0000","last_became_peered":"2024-08-18T22:05:21.857968+0000","last_unstale":"2024-08-18T22:06:10.509523+0000","last_undegraded":"2024-08-18T22:06:10.509523+0000","last_fullsized":"2024-08-18T22:06:10.509523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:24.023136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510630+0000","last_change":"2024-08-18T22:05:21.853799+0000","last_active":"2024-08-18T22:06:10.510630+0000","last_peered":"2024-08-18T22:06:10.510630+0000","last_clean":"2024-08-18T22:06:10.510630+0000","last_became_active":"2024-08-18T22:05:21.853432+0000","last_became_peered":"2024-08-18T22:05:21.853432+0000","last_unstale":"2024-08-18T22:06:10.510630+0000","last_undegraded":"2024-08-18T22:06:10.510630+0000","last_fullsized":"2024-08-18T22:06:10.510630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:07.429169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.506002+0000","last_change":"2024-08-18T22:05:21.855117+0000","last_active":"2024-08-18T22:06:10.506002+0000","last_peered":"2024-08-18T22:06:10.506002+0000","last_clean":"2024-08-18T22:06:10.506002+0000","last_became_active":"2024-08-18T22:05:21.854041+0000","last_became_peered":"2024-08-18T22:05:21.854041+0000","last_unstale":"2024-08-18T22:06:10.506002+0000","last_undegraded":"2024-08-18T22:06:10.506002+0000","last_fullsized":"2024-08-18T22:06:10.506002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:17.222658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508062+0000","last_change":"2024-08-18T22:05:21.861745+0000","last_active":"2024-08-18T22:06:10.508062+0000","last_peered":"2024-08-18T22:06:10.508062+0000","last_clean":"2024-08-18T22:06:10.508062+0000","last_became_active":"2024-08-18T22:05:21.861427+0000","last_became_peered":"2024-08-18T22:05:21.861427+0000","last_unstale":"2024-08-18T22:06:10.508062+0000","last_undegraded":"2024-08-18T22:06:10.508062+0000","last_fullsized":"2024-08-18T22:06:10.508062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:17.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508302+0000","last_change":"2024-08-18T22:05:21.860046+0000","last_active":"2024-08-18T22:06:10.508302+0000","last_peered":"2024-08-18T22:06:10.508302+0000","last_clean":"2024-08-18T22:06:10.508302+0000","last_became_active":"2024-08-18T22:05:21.859674+0000","last_became_peered":"2024-08-18T22:05:21.859674+0000","last_unstale":"2024-08-18T22:06:10.508302+0000","last_undegraded":"2024-08-18T22:06:10.508302+0000","last_fullsized":"2024-08-18T22:06:10.508302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:44.615270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.505796+0000","last_change":"2024-08-18T22:05:21.847647+0000","last_active":"2024-08-18T22:06:10.505796+0000","last_peered":"2024-08-18T22:06:10.505796+0000","last_clean":"2024-08-18T22:06:10.505796+0000","last_became_active":"2024-08-18T22:05:21.847367+0000","last_became_peered":"2024-08-18T22:05:21.847367+0000","last_unstale":"2024-08-18T22:06:10.505796+0000","last_undegraded":"2024-08-18T22:06:10.505796+0000","last_fullsized":"2024-08-18T22:06:10.505796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:33.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.512325+0000","last_change":"2024-08-18T22:05:21.861326+0000","last_active":"2024-08-18T22:06:10.512325+0000","last_peered":"2024-08-18T22:06:10.512325+0000","last_clean":"2024-08-18T22:06:10.512325+0000","last_became_active":"2024-08-18T22:05:21.860968+0000","last_became_peered":"2024-08-18T22:05:21.860968+0000","last_unstale":"2024-08-18T22:06:10.512325+0000","last_undegraded":"2024-08-18T22:06:10.512325+0000","last_fullsized":"2024-08-18T22:06:10.512325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:49.150670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508590+0000","last_change":"2024-08-18T22:05:21.852618+0000","last_active":"2024-08-18T22:06:10.508590+0000","last_peered":"2024-08-18T22:06:10.508590+0000","last_clean":"2024-08-18T22:06:10.508590+0000","last_became_active":"2024-08-18T22:05:21.852318+0000","last_became_peered":"2024-08-18T22:05:21.852318+0000","last_unstale":"2024-08-18T22:06:10.508590+0000","last_undegraded":"2024-08-18T22:06:10.508590+0000","last_fullsized":"2024-08-18T22:06:10.508590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:06:49.085150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509956+0000","last_change":"2024-08-18T22:05:21.860108+0000","last_active":"2024-08-18T22:06:10.509956+0000","last_peered":"2024-08-18T22:06:10.509956+0000","last_clean":"2024-08-18T22:06:10.509956+0000","last_became_active":"2024-08-18T22:05:21.859794+0000","last_became_peered":"2024-08-18T22:05:21.859794+0000","last_unstale":"2024-08-18T22:06:10.509956+0000","last_undegraded":"2024-08-18T22:06:10.509956+0000","last_fullsized":"2024-08-18T22:06:10.509956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:01.974202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.507181+0000","last_change":"2024-08-18T22:05:21.856404+0000","last_active":"2024-08-18T22:06:10.507181+0000","last_peered":"2024-08-18T22:06:10.507181+0000","last_clean":"2024-08-18T22:06:10.507181+0000","last_became_active":"2024-08-18T22:05:21.855800+0000","last_became_peered":"2024-08-18T22:05:21.855800+0000","last_unstale":"2024-08-18T22:06:10.507181+0000","last_undegraded":"2024-08-18T22:06:10.507181+0000","last_fullsized":"2024-08-18T22:06:10.507181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:09.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.771944+0000","last_change":"2024-08-18T22:05:21.859891+0000","last_active":"2024-08-18T22:06:10.771944+0000","last_peered":"2024-08-18T22:06:10.771944+0000","last_clean":"2024-08-18T22:06:10.771944+0000","last_became_active":"2024-08-18T22:05:21.859407+0000","last_became_peered":"2024-08-18T22:05:21.859407+0000","last_unstale":"2024-08-18T22:06:10.771944+0000","last_undegraded":"2024-08-18T22:06:10.771944+0000","last_fullsized":"2024-08-18T22:06:10.771944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:59.285627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508099+0000","last_change":"2024-08-18T22:05:21.856428+0000","last_active":"2024-08-18T22:06:10.508099+0000","last_peered":"2024-08-18T22:06:10.508099+0000","last_clean":"2024-08-18T22:06:10.508099+0000","last_became_active":"2024-08-18T22:05:21.853374+0000","last_became_peered":"2024-08-18T22:05:21.853374+0000","last_unstale":"2024-08-18T22:06:10.508099+0000","last_undegraded":"2024-08-18T22:06:10.508099+0000","last_fullsized":"2024-08-18T22:06:10.508099+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:07.087171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.509021+0000","last_change":"2024-08-18T22:05:21.852688+0000","last_active":"2024-08-18T22:06:10.509021+0000","last_peered":"2024-08-18T22:06:10.509021+0000","last_clean":"2024-08-18T22:06:10.509021+0000","last_became_active":"2024-08-18T22:05:21.851107+0000","last_became_peered":"2024-08-18T22:05:21.851107+0000","last_unstale":"2024-08-18T22:06:10.509021+0000","last_undegraded":"2024-08-18T22:06:10.509021+0000","last_fullsized":"2024-08-18T22:06:10.509021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:48.267166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.513864+0000","last_change":"2024-08-18T22:05:21.850809+0000","last_active":"2024-08-18T22:06:10.513864+0000","last_peered":"2024-08-18T22:06:10.513864+0000","last_clean":"2024-08-18T22:06:10.513864+0000","last_became_active":"2024-08-18T22:05:21.850510+0000","last_became_peered":"2024-08-18T22:05:21.850510+0000","last_unstale":"2024-08-18T22:06:10.513864+0000","last_undegraded":"2024-08-18T22:06:10.513864+0000","last_fullsized":"2024-08-18T22:06:10.513864+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:39.338051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.512225+0000","last_change":"2024-08-18T22:05:21.856156+0000","last_active":"2024-08-18T22:06:10.512225+0000","last_peered":"2024-08-18T22:06:10.512225+0000","last_clean":"2024-08-18T22:06:10.512225+0000","last_became_active":"2024-08-18T22:05:21.855830+0000","last_became_peered":"2024-08-18T22:05:21.855830+0000","last_unstale":"2024-08-18T22:06:10.512225+0000","last_undegraded":"2024-08-18T22:06:10.512225+0000","last_fullsized":"2024-08-18T22:06:10.512225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:10.670405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508858+0000","last_change":"2024-08-18T22:05:21.865162+0000","last_active":"2024-08-18T22:06:10.508858+0000","last_peered":"2024-08-18T22:06:10.508858+0000","last_clean":"2024-08-18T22:06:10.508858+0000","last_became_active":"2024-08-18T22:05:21.864842+0000","last_became_peered":"2024-08-18T22:05:21.864842+0000","last_unstale":"2024-08-18T22:06:10.508858+0000","last_undegraded":"2024-08-18T22:06:10.508858+0000","last_fullsized":"2024-08-18T22:06:10.508858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:21.388638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.508777+0000","last_change":"2024-08-18T22:05:21.859227+0000","last_active":"2024-08-18T22:06:10.508777+0000","last_peered":"2024-08-18T22:06:10.508777+0000","last_clean":"2024-08-18T22:06:10.508777+0000","last_became_active":"2024-08-18T22:05:21.858886+0000","last_became_peered":"2024-08-18T22:05:21.858886+0000","last_unstale":"2024-08-18T22:06:10.508777+0000","last_undegraded":"2024-08-18T22:06:10.508777+0000","last_fullsized":"2024-08-18T22:06:10.508777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:08.710772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-18T22:06:10.510562+0000","last_change":"2024-08-18T22:05:21.854864+0000","last_active":"2024-08-18T22:06:10.510562+0000","last_peered":"2024-08-18T22:06:10.510562+0000","last_clean":"2024-08-18T22:06:10.510562+0000","last_became_active":"2024-08-18T22:05:21.854522+0000","last_became_peered":"2024-08-18T22:05:21.854522+0000","last_unstale":"2024-08-18T22:06:10.510562+0000","last_undegraded":"2024-08-18T22:06:10.510562+0000","last_fullsized":"2024-08-18T22:06:10.510562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:32.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65907,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":412,"num_read_kb":271,"num_write":166,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514528,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":504444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743463,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32848,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712304,"statfs":{"total":95995035648,"available":95961399296,"internally_reserved":0,"allocated":1712128,"data_stored":1157715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906987,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":504680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168624,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":504600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397556,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1100898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561081,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":499856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790012,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1638400,"data_stored":1096096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953538,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1097728,"data_stored":566413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182469,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1028096,"data_stored":500050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":501506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1081344,"data_stored":561283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":501244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:07:06.701 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-18T22:07:06.701 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-18T22:07:06.701 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-18T22:07:06.701 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph health --format=json 2024-08-18T22:07:06.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:06 smithi123 ceph-mon[18462]: pgmap v318: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:06.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:06 smithi130 ceph-mon[21698]: pgmap v318: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:06.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:06 smithi183 ceph-mon[22097]: pgmap v318: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:06.952 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:07.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.424+0000 7f6175007640 1 -- 172.21.15.123:0/154901663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61701022a0 msgr2=0x7f61701026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:07.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.424+0000 7f6175007640 1 --2- 172.21.15.123:0/154901663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61701022a0 0x7f61701026e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6158009900 tx=0x7f615802a480 comp rx=0 tx=0).stop 2024-08-18T22:07:07.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.424+0000 7f6175007640 1 -- 172.21.15.123:0/154901663 shutdown_connections 2024-08-18T22:07:07.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.424+0000 7f6175007640 1 --2- 172.21.15.123:0/154901663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6170102c20 0x7f617010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:07.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.424+0000 7f6175007640 1 --2- 172.21.15.123:0/154901663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61701022a0 0x7f61701026e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:07.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.424+0000 7f6175007640 1 --2- 172.21.15.123:0/154901663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6170100b50 0x7f6170100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:07.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.424+0000 7f6175007640 1 -- 172.21.15.123:0/154901663 >> 172.21.15.123:0/154901663 conn(0x7f61700fc500 msgr2=0x7f61700fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:07.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.424+0000 7f6175007640 1 -- 172.21.15.123:0/154901663 shutdown_connections 2024-08-18T22:07:07.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.424+0000 7f6175007640 1 -- 172.21.15.123:0/154901663 wait complete. 2024-08-18T22:07:07.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.425+0000 7f6175007640 1 Processor -- start 2024-08-18T22:07:07.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f6175007640 1 -- start start 2024-08-18T22:07:07.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f6175007640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6170100b50 0x7f6170198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:07.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f6175007640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61701022a0 0x7f61701988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:07.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f6175007640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6170102c20 0x7f617019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:07.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f6175007640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6170111e50 con 0x7f6170100b50 2024-08-18T22:07:07.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f6175007640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6170111cd0 con 0x7f6170102c20 2024-08-18T22:07:07.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f6175007640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6170111fd0 con 0x7f61701022a0 2024-08-18T22:07:07.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f616ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6170100b50 0x7f6170198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:07.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f616ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6170100b50 0x7f6170198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40458/0 (socket says 172.21.15.123:40458) 2024-08-18T22:07:07.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f616ed9d640 1 -- 172.21.15.123:0/957841111 learned_addr learned my addr 172.21.15.123:0/957841111 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:07.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f616f59e640 1 --2- 172.21.15.123:0/957841111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6170102c20 0x7f617019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:07.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f616659c640 1 --2- 172.21.15.123:0/957841111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61701022a0 0x7f61701988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:07.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f616ed9d640 1 -- 172.21.15.123:0/957841111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61701022a0 msgr2=0x7f61701988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:07.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f616ed9d640 1 --2- 172.21.15.123:0/957841111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61701022a0 0x7f61701988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:07.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f616ed9d640 1 -- 172.21.15.123:0/957841111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6170102c20 msgr2=0x7f617019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:07.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f616ed9d640 1 --2- 172.21.15.123:0/957841111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6170102c20 0x7f617019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:07.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f616ed9d640 1 -- 172.21.15.123:0/957841111 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f617019d320 con 0x7f6170100b50 2024-08-18T22:07:07.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.426+0000 7f616ed9d640 1 --2- 172.21.15.123:0/957841111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6170100b50 0x7f6170198370 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f616000b4a0 tx=0x7f616000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:07.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.427+0000 7f616cd99640 1 -- 172.21.15.123:0/957841111 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160014070 con 0x7f6170100b50 2024-08-18T22:07:07.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.427+0000 7f6175007640 1 -- 172.21.15.123:0/957841111 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f617019d610 con 0x7f6170100b50 2024-08-18T22:07:07.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.427+0000 7f616cd99640 1 -- 172.21.15.123:0/957841111 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6160010af0 con 0x7f6170100b50 2024-08-18T22:07:07.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.427+0000 7f616cd99640 1 -- 172.21.15.123:0/957841111 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160017d10 con 0x7f6170100b50 2024-08-18T22:07:07.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.427+0000 7f6175007640 1 -- 172.21.15.123:0/957841111 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61701a4ef0 con 0x7f6170100b50 2024-08-18T22:07:07.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.428+0000 7f6175007640 1 -- 172.21.15.123:0/957841111 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6170100fb0 con 0x7f6170100b50 2024-08-18T22:07:07.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.429+0000 7f616cd99640 1 -- 172.21.15.123:0/957841111 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6160017070 con 0x7f6170100b50 2024-08-18T22:07:07.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.429+0000 7f616cd99640 1 --2- 172.21.15.123:0/957841111 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f615c0a2c90 0x7f615c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:07.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.430+0000 7f616659c640 1 --2- 172.21.15.123:0/957841111 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f615c0a2c90 0x7f615c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:07.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.430+0000 7f616cd99640 1 -- 172.21.15.123:0/957841111 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f61600ce850 con 0x7f6170100b50 2024-08-18T22:07:07.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.430+0000 7f616659c640 1 --2- 172.21.15.123:0/957841111 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f615c0a2c90 0x7f615c0a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f61580096c0 tx=0x7f6158000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:07.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.434+0000 7f616cd99640 1 -- 172.21.15.123:0/957841111 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f616009b3a0 con 0x7f6170100b50 2024-08-18T22:07:07.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.638+0000 7f6175007640 1 -- 172.21.15.123:0/957841111 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6170108dc0 con 0x7f6170100b50 2024-08-18T22:07:07.640 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:07 smithi123 ceph-mon[18462]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:07.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.639+0000 7f616cd99640 1 -- 172.21.15.123:0/957841111 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f616009aca0 con 0x7f6170100b50 2024-08-18T22:07:07.641 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:07.641 INFO:teuthology.orchestra.run.smithi123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-18T22:07:07.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.641+0000 7f6175007640 1 -- 172.21.15.123:0/957841111 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f615c0a2c90 msgr2=0x7f615c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:07.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.641+0000 7f6175007640 1 --2- 172.21.15.123:0/957841111 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f615c0a2c90 0x7f615c0a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f61580096c0 tx=0x7f6158000bc0 comp rx=0 tx=0).stop 2024-08-18T22:07:07.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.641+0000 7f6175007640 1 -- 172.21.15.123:0/957841111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6170100b50 msgr2=0x7f6170198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:07.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.641+0000 7f6175007640 1 --2- 172.21.15.123:0/957841111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6170100b50 0x7f6170198370 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f616000b4a0 tx=0x7f616000b960 comp rx=0 tx=0).stop 2024-08-18T22:07:07.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.641+0000 7f6175007640 1 -- 172.21.15.123:0/957841111 shutdown_connections 2024-08-18T22:07:07.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.641+0000 7f6175007640 1 --2- 172.21.15.123:0/957841111 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f615c0a2c90 0x7f615c0a5150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:07.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.641+0000 7f6175007640 1 --2- 172.21.15.123:0/957841111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6170102c20 0x7f617019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:07.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.641+0000 7f6175007640 1 --2- 172.21.15.123:0/957841111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61701022a0 0x7f61701988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:07.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.641+0000 7f6175007640 1 --2- 172.21.15.123:0/957841111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6170100b50 0x7f6170198370 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:07.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.641+0000 7f6175007640 1 -- 172.21.15.123:0/957841111 >> 172.21.15.123:0/957841111 conn(0x7f61700fc500 msgr2=0x7f61700fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:07.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.641+0000 7f6175007640 1 -- 172.21.15.123:0/957841111 shutdown_connections 2024-08-18T22:07:07.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:07.641+0000 7f6175007640 1 -- 172.21.15.123:0/957841111 wait complete. 2024-08-18T22:07:07.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:07 smithi130 ceph-mon[21698]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:07.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:07 smithi183 ceph-mon[22097]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:08.330 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-18T22:07:08.331 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:07:08.579 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:08.702 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:08 smithi123 ceph-mon[18462]: pgmap v319: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:08.702 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:08 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/957841111' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-18T22:07:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:08 smithi130 ceph-mon[21698]: pgmap v319: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:08 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/957841111' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-18T22:07:08.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:08 smithi183 ceph-mon[22097]: pgmap v319: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:08.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:08 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/957841111' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-18T22:07:09.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.075+0000 7f2a1f725640 1 -- 172.21.15.123:0/336783416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a18101150 msgr2=0x7f2a1810d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:09.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.075+0000 7f2a1f725640 1 --2- 172.21.15.123:0/336783416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a18101150 0x7f2a1810d680 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2a10009cd0 tx=0x7f2a1002a8e0 comp rx=0 tx=0).stop 2024-08-18T22:07:09.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.075+0000 7f2a1f725640 1 -- 172.21.15.123:0/336783416 shutdown_connections 2024-08-18T22:07:09.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.075+0000 7f2a1f725640 1 --2- 172.21.15.123:0/336783416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a18101150 0x7f2a1810d680 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:09.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.075+0000 7f2a1f725640 1 --2- 172.21.15.123:0/336783416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a181007b0 0x7f2a18100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:09.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.075+0000 7f2a1f725640 1 --2- 172.21.15.123:0/336783416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a181067b0 0x7f2a18106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:09.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.075+0000 7f2a1f725640 1 -- 172.21.15.123:0/336783416 >> 172.21.15.123:0/336783416 conn(0x7f2a180fc4d0 msgr2=0x7f2a180fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:09.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.075+0000 7f2a1f725640 1 -- 172.21.15.123:0/336783416 shutdown_connections 2024-08-18T22:07:09.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.075+0000 7f2a1f725640 1 -- 172.21.15.123:0/336783416 wait complete. 2024-08-18T22:07:09.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.076+0000 7f2a1f725640 1 Processor -- start 2024-08-18T22:07:09.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.076+0000 7f2a1f725640 1 -- start start 2024-08-18T22:07:09.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.076+0000 7f2a1f725640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a181007b0 0x7f2a18198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:09.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.076+0000 7f2a1f725640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a18101150 0x7f2a181986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:09.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.076+0000 7f2a1f725640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a181067b0 0x7f2a1819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:09.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.076+0000 7f2a1f725640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2a18111cd0 con 0x7f2a181067b0 2024-08-18T22:07:09.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.076+0000 7f2a1f725640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2a18111b50 con 0x7f2a181007b0 2024-08-18T22:07:09.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.076+0000 7f2a1f725640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2a18111e50 con 0x7f2a18101150 2024-08-18T22:07:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.076+0000 7f2a1dcc2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a181067b0 0x7f2a1819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.076+0000 7f2a1dcc2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a181067b0 0x7f2a1819ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40480/0 (socket says 172.21.15.123:40480) 2024-08-18T22:07:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.076+0000 7f2a1dcc2640 1 -- 172.21.15.123:0/3469874266 learned_addr learned my addr 172.21.15.123:0/3469874266 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.076+0000 7f2a1ccc0640 1 --2- 172.21.15.123:0/3469874266 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a18101150 0x7f2a181986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.076+0000 7f2a1d4c1640 1 --2- 172.21.15.123:0/3469874266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a181007b0 0x7f2a18198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.077+0000 7f2a1dcc2640 1 -- 172.21.15.123:0/3469874266 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a18101150 msgr2=0x7f2a181986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.077+0000 7f2a1dcc2640 1 --2- 172.21.15.123:0/3469874266 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a18101150 0x7f2a181986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.077+0000 7f2a1dcc2640 1 -- 172.21.15.123:0/3469874266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a181007b0 msgr2=0x7f2a18198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.077+0000 7f2a1dcc2640 1 --2- 172.21.15.123:0/3469874266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a181007b0 0x7f2a18198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.077+0000 7f2a1dcc2640 1 -- 172.21.15.123:0/3469874266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1819d120 con 0x7f2a181067b0 2024-08-18T22:07:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.077+0000 7f2a1dcc2640 1 --2- 172.21.15.123:0/3469874266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a181067b0 0x7f2a1819ca40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2a10006010 tx=0x7f2a10003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.077+0000 7f2a0e7fc640 1 -- 172.21.15.123:0/3469874266 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10004450 con 0x7f2a181067b0 2024-08-18T22:07:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.077+0000 7f2a1f725640 1 -- 172.21.15.123:0/3469874266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a1819d3b0 con 0x7f2a181067b0 2024-08-18T22:07:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.077+0000 7f2a0e7fc640 1 -- 172.21.15.123:0/3469874266 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a10003e10 con 0x7f2a181067b0 2024-08-18T22:07:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.077+0000 7f2a0e7fc640 1 -- 172.21.15.123:0/3469874266 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a100466e0 con 0x7f2a181067b0 2024-08-18T22:07:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.077+0000 7f2a1f725640 1 -- 172.21.15.123:0/3469874266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a181a4cf0 con 0x7f2a181067b0 2024-08-18T22:07:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.078+0000 7f2a1f725640 1 -- 172.21.15.123:0/3469874266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a18100c10 con 0x7f2a181067b0 2024-08-18T22:07:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.079+0000 7f2a0e7fc640 1 -- 172.21.15.123:0/3469874266 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f2a100305a0 con 0x7f2a181067b0 2024-08-18T22:07:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.080+0000 7f2a0e7fc640 1 --2- 172.21.15.123:0/3469874266 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2a040a2c10 0x7f2a040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.080+0000 7f2a0e7fc640 1 -- 172.21.15.123:0/3469874266 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f2a1002e030 con 0x7f2a181067b0 2024-08-18T22:07:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.080+0000 7f2a1d4c1640 1 --2- 172.21.15.123:0/3469874266 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2a040a2c10 0x7f2a040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.080+0000 7f2a1d4c1640 1 --2- 172.21.15.123:0/3469874266 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2a040a2c10 0x7f2a040a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2a140058c0 tx=0x7f2a1400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:09.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.083+0000 7f2a0e7fc640 1 -- 172.21.15.123:0/3469874266 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2a1004b060 con 0x7f2a181067b0 2024-08-18T22:07:09.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.285+0000 7f2a1f725640 1 -- 172.21.15.123:0/3469874266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a181994d0 con 0x7f2a181067b0 2024-08-18T22:07:09.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.286+0000 7f2a0e7fc640 1 -- 172.21.15.123:0/3469874266 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11918 (secure 0 0 0) 0x7f2a181994d0 con 0x7f2a181067b0 2024-08-18T22:07:09.287 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:09.287 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":25,"btime":"2024-08-18T22:06:00:456703+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:06:00.091798+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24448,24458,24466]},"id":1}]} 2024-08-18T22:07:09.288 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 25 2024-08-18T22:07:09.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.288+0000 7f2a1f725640 1 -- 172.21.15.123:0/3469874266 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2a040a2c10 msgr2=0x7f2a040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:09.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.288+0000 7f2a1f725640 1 --2- 172.21.15.123:0/3469874266 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2a040a2c10 0x7f2a040a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2a140058c0 tx=0x7f2a1400a2d0 comp rx=0 tx=0).stop 2024-08-18T22:07:09.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.288+0000 7f2a1f725640 1 -- 172.21.15.123:0/3469874266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a181067b0 msgr2=0x7f2a1819ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:09.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.288+0000 7f2a1f725640 1 --2- 172.21.15.123:0/3469874266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a181067b0 0x7f2a1819ca40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2a10006010 tx=0x7f2a10003c20 comp rx=0 tx=0).stop 2024-08-18T22:07:09.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.288+0000 7f2a1f725640 1 -- 172.21.15.123:0/3469874266 shutdown_connections 2024-08-18T22:07:09.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.288+0000 7f2a1f725640 1 --2- 172.21.15.123:0/3469874266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a181067b0 0x7f2a1819ca40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:09.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.288+0000 7f2a1f725640 1 --2- 172.21.15.123:0/3469874266 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a18101150 0x7f2a181986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:09.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.288+0000 7f2a1f725640 1 --2- 172.21.15.123:0/3469874266 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2a040a2c10 0x7f2a040a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:09.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.288+0000 7f2a1f725640 1 --2- 172.21.15.123:0/3469874266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a181007b0 0x7f2a18198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:09.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.288+0000 7f2a1f725640 1 -- 172.21.15.123:0/3469874266 >> 172.21.15.123:0/3469874266 conn(0x7f2a180fc4d0 msgr2=0x7f2a180fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:09.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.288+0000 7f2a1f725640 1 -- 172.21.15.123:0/3469874266 shutdown_connections 2024-08-18T22:07:09.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:09.288+0000 7f2a1f725640 1 -- 172.21.15.123:0/3469874266 wait complete. 2024-08-18T22:07:09.743 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:09 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3469874266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:09.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:09 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3469874266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:09 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3469874266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:09.954 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:07:10.203 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:10.581 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:10 smithi123 ceph-mon[18462]: pgmap v320: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:10.581 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:10 smithi123 ceph-mon[18462]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-08-18T22:07:10.582 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-08-18T22:07:10.582 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:10 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-08-18T22:07:10.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.660+0000 7f499de35640 1 -- 172.21.15.123:0/804109681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49981067b0 msgr2=0x7f4998106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:10.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.660+0000 7f499de35640 1 --2- 172.21.15.123:0/804109681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49981067b0 0x7f4998106b90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4988009930 tx=0x7f498802a420 comp rx=0 tx=0).stop 2024-08-18T22:07:10.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.660+0000 7f499de35640 1 -- 172.21.15.123:0/804109681 shutdown_connections 2024-08-18T22:07:10.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.660+0000 7f499de35640 1 --2- 172.21.15.123:0/804109681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4998101150 0x7f499810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:10.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.660+0000 7f499de35640 1 --2- 172.21.15.123:0/804109681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49981007b0 0x7f4998100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:10.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.660+0000 7f499de35640 1 --2- 172.21.15.123:0/804109681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49981067b0 0x7f4998106b90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:10.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.660+0000 7f499de35640 1 -- 172.21.15.123:0/804109681 >> 172.21.15.123:0/804109681 conn(0x7f49980fc4d0 msgr2=0x7f49980fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:10.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.660+0000 7f499de35640 1 -- 172.21.15.123:0/804109681 shutdown_connections 2024-08-18T22:07:10.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.660+0000 7f499de35640 1 -- 172.21.15.123:0/804109681 wait complete. 2024-08-18T22:07:10.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f499de35640 1 Processor -- start 2024-08-18T22:07:10.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f499de35640 1 -- start start 2024-08-18T22:07:10.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f499de35640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49981007b0 0x7f4998197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:10.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f499de35640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4998101150 0x7f4998197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:10.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f499de35640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49981067b0 0x7f499819baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:10.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f499de35640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4998110c50 con 0x7f49981007b0 2024-08-18T22:07:10.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f499de35640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4998110ad0 con 0x7f4998101150 2024-08-18T22:07:10.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f499de35640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4998110dd0 con 0x7f49981067b0 2024-08-18T22:07:10.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f49977fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49981007b0 0x7f4998197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:10.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f49977fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49981007b0 0x7f4998197220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40496/0 (socket says 172.21.15.123:40496) 2024-08-18T22:07:10.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f49977fe640 1 -- 172.21.15.123:0/77518076 learned_addr learned my addr 172.21.15.123:0/77518076 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:10.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f498ffff640 1 --2- 172.21.15.123:0/77518076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4998101150 0x7f4998197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:10.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f49977fe640 1 -- 172.21.15.123:0/77518076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49981067b0 msgr2=0x7f499819baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:10.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f49977fe640 1 --2- 172.21.15.123:0/77518076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49981067b0 0x7f499819baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:10.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f49977fe640 1 -- 172.21.15.123:0/77518076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4998101150 msgr2=0x7f4998197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:10.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f49977fe640 1 --2- 172.21.15.123:0/77518076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4998101150 0x7f4998197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:10.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f49977fe640 1 -- 172.21.15.123:0/77518076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499819c1d0 con 0x7f49981007b0 2024-08-18T22:07:10.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.661+0000 7f49977fe640 1 --2- 172.21.15.123:0/77518076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49981007b0 0x7f4998197220 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4988009a50 tx=0x7f4988004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:10.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.662+0000 7f49957fa640 1 -- 172.21.15.123:0/77518076 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498803f030 con 0x7f49981007b0 2024-08-18T22:07:10.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.662+0000 7f49957fa640 1 -- 172.21.15.123:0/77518076 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4988003ce0 con 0x7f49981007b0 2024-08-18T22:07:10.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.662+0000 7f499de35640 1 -- 172.21.15.123:0/77518076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499819c460 con 0x7f49981007b0 2024-08-18T22:07:10.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.662+0000 7f49957fa640 1 -- 172.21.15.123:0/77518076 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988035070 con 0x7f49981007b0 2024-08-18T22:07:10.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.662+0000 7f499de35640 1 -- 172.21.15.123:0/77518076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49981a3da0 con 0x7f49981007b0 2024-08-18T22:07:10.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.663+0000 7f499de35640 1 -- 172.21.15.123:0/77518076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4998101ef0 con 0x7f49981007b0 2024-08-18T22:07:10.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.664+0000 7f49957fa640 1 -- 172.21.15.123:0/77518076 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f4988042030 con 0x7f49981007b0 2024-08-18T22:07:10.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.665+0000 7f49957fa640 1 --2- 172.21.15.123:0/77518076 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f49840a2b80 0x7f49840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:10.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.665+0000 7f498ffff640 1 --2- 172.21.15.123:0/77518076 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f49840a2b80 0x7f49840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:10.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.665+0000 7f49957fa640 1 -- 172.21.15.123:0/77518076 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f49880efa20 con 0x7f49981007b0 2024-08-18T22:07:10.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.665+0000 7f498ffff640 1 --2- 172.21.15.123:0/77518076 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f49840a2b80 0x7f49840a5040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f49980feb20 tx=0x7f4980008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:10.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.669+0000 7f49957fa640 1 -- 172.21.15.123:0/77518076 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f49880bc5f0 con 0x7f49981007b0 2024-08-18T22:07:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:10 smithi130 ceph-mon[21698]: pgmap v320: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:10 smithi130 ceph-mon[21698]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-08-18T22:07:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-08-18T22:07:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:10 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-08-18T22:07:10.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.870+0000 7f499de35640 1 -- 172.21.15.123:0/77518076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4998108d80 con 0x7f49981007b0 2024-08-18T22:07:10.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.871+0000 7f49957fa640 1 -- 172.21.15.123:0/77518076 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11918 (secure 0 0 0) 0x7f49880bbef0 con 0x7f49981007b0 2024-08-18T22:07:10.872 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:10.872 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":25,"btime":"2024-08-18T22:06:00:456703+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:06:00.091798+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24448,24458,24466]},"id":1}]} 2024-08-18T22:07:10.872 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 25 2024-08-18T22:07:10.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.873+0000 7f499de35640 1 -- 172.21.15.123:0/77518076 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f49840a2b80 msgr2=0x7f49840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:10.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.873+0000 7f499de35640 1 --2- 172.21.15.123:0/77518076 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f49840a2b80 0x7f49840a5040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f49980feb20 tx=0x7f4980008040 comp rx=0 tx=0).stop 2024-08-18T22:07:10.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.873+0000 7f499de35640 1 -- 172.21.15.123:0/77518076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49981007b0 msgr2=0x7f4998197220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.873+0000 7f499de35640 1 --2- 172.21.15.123:0/77518076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49981007b0 0x7f4998197220 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4988009a50 tx=0x7f4988004270 comp rx=0 tx=0).stop 2024-08-18T22:07:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.873+0000 7f499de35640 1 -- 172.21.15.123:0/77518076 shutdown_connections 2024-08-18T22:07:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.873+0000 7f499de35640 1 --2- 172.21.15.123:0/77518076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49981067b0 0x7f499819baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.873+0000 7f499de35640 1 --2- 172.21.15.123:0/77518076 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f49840a2b80 0x7f49840a5040 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.873+0000 7f499de35640 1 --2- 172.21.15.123:0/77518076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4998101150 0x7f4998197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.873+0000 7f499de35640 1 --2- 172.21.15.123:0/77518076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49981007b0 0x7f4998197220 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.873+0000 7f499de35640 1 -- 172.21.15.123:0/77518076 >> 172.21.15.123:0/77518076 conn(0x7f49980fc4d0 msgr2=0x7f49980fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.873+0000 7f499de35640 1 -- 172.21.15.123:0/77518076 shutdown_connections 2024-08-18T22:07:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:10.873+0000 7f499de35640 1 -- 172.21.15.123:0/77518076 wait complete. 2024-08-18T22:07:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:10 smithi183 ceph-mon[22097]: pgmap v320: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:10 smithi183 ceph-mon[22097]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-08-18T22:07:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-08-18T22:07:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:10 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-08-18T22:07:11.575 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:07:11.826 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:11 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-08-18T22:07:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:11 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-08-18T22:07:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:11 smithi183 ceph-mon[22097]: osdmap e91: 12 total, 12 up, 12 in 2024-08-18T22:07:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:11 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/77518076' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:11.949 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:11 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-08-18T22:07:11.949 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:11 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-08-18T22:07:11.949 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:11 smithi123 ceph-mon[18462]: osdmap e91: 12 total, 12 up, 12 in 2024-08-18T22:07:11.949 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:11 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/77518076' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:12.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:11 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-08-18T22:07:12.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:11 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-08-18T22:07:12.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:11 smithi130 ceph-mon[21698]: osdmap e91: 12 total, 12 up, 12 in 2024-08-18T22:07:12.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:11 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/77518076' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:12.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.319+0000 7fcf1590f640 1 -- 172.21.15.123:0/2094965093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf101007b0 msgr2=0x7fcf10100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:12.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.319+0000 7fcf1590f640 1 --2- 172.21.15.123:0/2094965093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf101007b0 0x7fcf10100c10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009930 tx=0x7fcef802a420 comp rx=0 tx=0).stop 2024-08-18T22:07:12.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.319+0000 7fcf1590f640 1 -- 172.21.15.123:0/2094965093 shutdown_connections 2024-08-18T22:07:12.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.319+0000 7fcf1590f640 1 --2- 172.21.15.123:0/2094965093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf10101150 0x7fcf1010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:12.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.319+0000 7fcf1590f640 1 --2- 172.21.15.123:0/2094965093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf101007b0 0x7fcf10100c10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:12.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.319+0000 7fcf1590f640 1 --2- 172.21.15.123:0/2094965093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf101067b0 0x7fcf10106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:12.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.319+0000 7fcf1590f640 1 -- 172.21.15.123:0/2094965093 >> 172.21.15.123:0/2094965093 conn(0x7fcf100fc4d0 msgr2=0x7fcf100fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:12.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.319+0000 7fcf1590f640 1 -- 172.21.15.123:0/2094965093 shutdown_connections 2024-08-18T22:07:12.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.319+0000 7fcf1590f640 1 -- 172.21.15.123:0/2094965093 wait complete. 2024-08-18T22:07:12.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.319+0000 7fcf1590f640 1 Processor -- start 2024-08-18T22:07:12.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf1590f640 1 -- start start 2024-08-18T22:07:12.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf1590f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf101007b0 0x7fcf100fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf1590f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf10101150 0x7fcf100fd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf1590f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf101067b0 0x7fcf100fd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf1590f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcf10110c50 con 0x7fcf10101150 2024-08-18T22:07:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf1590f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcf10110ad0 con 0x7fcf101067b0 2024-08-18T22:07:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf1590f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcf10110dd0 con 0x7fcf101007b0 2024-08-18T22:07:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf0e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf10101150 0x7fcf100fd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf0e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf10101150 0x7fcf100fd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40510/0 (socket says 172.21.15.123:40510) 2024-08-18T22:07:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf0e7fc640 1 -- 172.21.15.123:0/1132925463 learned_addr learned my addr 172.21.15.123:0/1132925463 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf0f7fe640 1 --2- 172.21.15.123:0/1132925463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf101067b0 0x7fcf100fd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf0e7fc640 1 -- 172.21.15.123:0/1132925463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf101007b0 msgr2=0x7fcf100fcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf0effd640 1 --2- 172.21.15.123:0/1132925463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf101007b0 0x7fcf100fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf0e7fc640 1 --2- 172.21.15.123:0/1132925463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf101007b0 0x7fcf100fcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf0e7fc640 1 -- 172.21.15.123:0/1132925463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf101067b0 msgr2=0x7fcf100fd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf0e7fc640 1 --2- 172.21.15.123:0/1132925463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf101067b0 0x7fcf100fd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf0e7fc640 1 -- 172.21.15.123:0/1132925463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf101a67c0 con 0x7fcf10101150 2024-08-18T22:07:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf0f7fe640 1 --2- 172.21.15.123:0/1132925463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf101067b0 0x7fcf100fd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:07:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.320+0000 7fcf0e7fc640 1 --2- 172.21.15.123:0/1132925463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf10101150 0x7fcf100fd040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009a50 tx=0x7fcef8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.321+0000 7fcf1490d640 1 -- 172.21.15.123:0/1132925463 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef803f030 con 0x7fcf10101150 2024-08-18T22:07:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.321+0000 7fcf1490d640 1 -- 172.21.15.123:0/1132925463 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcef8003ce0 con 0x7fcf10101150 2024-08-18T22:07:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.321+0000 7fcf1590f640 1 -- 172.21.15.123:0/1132925463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf101a6a50 con 0x7fcf10101150 2024-08-18T22:07:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.321+0000 7fcf1490d640 1 -- 172.21.15.123:0/1132925463 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef8035070 con 0x7fcf10101150 2024-08-18T22:07:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.321+0000 7fcf1590f640 1 -- 172.21.15.123:0/1132925463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf101a6f30 con 0x7fcf10101150 2024-08-18T22:07:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.322+0000 7fcf1590f640 1 -- 172.21.15.123:0/1132925463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf10100c90 con 0x7fcf10101150 2024-08-18T22:07:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.323+0000 7fcf1490d640 1 -- 172.21.15.123:0/1132925463 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fcef8042030 con 0x7fcf10101150 2024-08-18T22:07:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.324+0000 7fcf1490d640 1 --2- 172.21.15.123:0/1132925463 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcefc0a2b80 0x7fcefc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.324+0000 7fcf0effd640 1 --2- 172.21.15.123:0/1132925463 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcefc0a2b80 0x7fcefc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.324+0000 7fcf1490d640 1 -- 172.21.15.123:0/1132925463 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fcef80efa40 con 0x7fcf10101150 2024-08-18T22:07:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.324+0000 7fcf0effd640 1 --2- 172.21.15.123:0/1132925463 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcefc0a2b80 0x7fcefc0a5040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcf08007dc0 tx=0x7fcf080072f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.328+0000 7fcf1490d640 1 -- 172.21.15.123:0/1132925463 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcef80bc610 con 0x7fcf10101150 2024-08-18T22:07:12.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.495+0000 7fcf1590f640 1 -- 172.21.15.123:0/1132925463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf10109d50 con 0x7fcf10101150 2024-08-18T22:07:12.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.496+0000 7fcf1490d640 1 -- 172.21.15.123:0/1132925463 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24810 (secure 0 0 0) 0x7fcef80bbf10 con 0x7fcf10101150 2024-08-18T22:07:12.497 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:12.498 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":92,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:07:11.513362+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:05:18.077632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:05:20.808463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:05:27.136662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:07:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.498+0000 7fcf1590f640 1 -- 172.21.15.123:0/1132925463 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcefc0a2b80 msgr2=0x7fcefc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.498+0000 7fcf1590f640 1 --2- 172.21.15.123:0/1132925463 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcefc0a2b80 0x7fcefc0a5040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcf08007dc0 tx=0x7fcf080072f0 comp rx=0 tx=0).stop 2024-08-18T22:07:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.498+0000 7fcf1590f640 1 -- 172.21.15.123:0/1132925463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf10101150 msgr2=0x7fcf100fd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.498+0000 7fcf1590f640 1 --2- 172.21.15.123:0/1132925463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf10101150 0x7fcf100fd040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009a50 tx=0x7fcef8004270 comp rx=0 tx=0).stop 2024-08-18T22:07:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.498+0000 7fcf1590f640 1 -- 172.21.15.123:0/1132925463 shutdown_connections 2024-08-18T22:07:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.498+0000 7fcf1590f640 1 --2- 172.21.15.123:0/1132925463 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcefc0a2b80 0x7fcefc0a5040 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.498+0000 7fcf1590f640 1 --2- 172.21.15.123:0/1132925463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf101067b0 0x7fcf100fd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.498+0000 7fcf1590f640 1 --2- 172.21.15.123:0/1132925463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf10101150 0x7fcf100fd040 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.498+0000 7fcf1590f640 1 --2- 172.21.15.123:0/1132925463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf101007b0 0x7fcf100fcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.498+0000 7fcf1590f640 1 -- 172.21.15.123:0/1132925463 >> 172.21.15.123:0/1132925463 conn(0x7fcf100fc4d0 msgr2=0x7fcf1006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.499+0000 7fcf1590f640 1 -- 172.21.15.123:0/1132925463 shutdown_connections 2024-08-18T22:07:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:12.499+0000 7fcf1590f640 1 -- 172.21.15.123:0/1132925463 wait complete. 2024-08-18T22:07:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:12 smithi123 ceph-mon[18462]: pgmap v322: 129 pgs: 129 active+clean; 641 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-08-18T22:07:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:12 smithi123 ceph-mon[18462]: osdmap e92: 12 total, 12 up, 12 in 2024-08-18T22:07:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:12 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1132925463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:07:12.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:12 smithi183 ceph-mon[22097]: pgmap v322: 129 pgs: 129 active+clean; 641 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-08-18T22:07:12.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:12 smithi183 ceph-mon[22097]: osdmap e92: 12 total, 12 up, 12 in 2024-08-18T22:07:12.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:12 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1132925463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:07:13.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:12 smithi130 ceph-mon[21698]: pgmap v322: 129 pgs: 129 active+clean; 641 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-08-18T22:07:13.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:12 smithi130 ceph-mon[21698]: osdmap e92: 12 total, 12 up, 12 in 2024-08-18T22:07:13.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:12 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1132925463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:07:13.207 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:07:13.456 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:13.865 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:13 smithi123 ceph-mon[18462]: pgmap v324: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:13.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:13 smithi183 ceph-mon[22097]: pgmap v324: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:13.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.946+0000 7f9361240640 1 -- 172.21.15.123:0/3172916190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f935c100be0 msgr2=0x7f935c1064d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:13.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.946+0000 7f9361240640 1 --2- 172.21.15.123:0/3172916190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f935c100be0 0x7f935c1064d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9350009900 tx=0x7f935002a410 comp rx=0 tx=0).stop 2024-08-18T22:07:13.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.946+0000 7f9361240640 1 -- 172.21.15.123:0/3172916190 shutdown_connections 2024-08-18T22:07:13.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.946+0000 7f9361240640 1 --2- 172.21.15.123:0/3172916190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f935c106c00 0x7f935c10e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:13.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.946+0000 7f9361240640 1 --2- 172.21.15.123:0/3172916190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f935c100be0 0x7f935c1064d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:13.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.946+0000 7f9361240640 1 --2- 172.21.15.123:0/3172916190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f935c100230 0x7f935c100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:13.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.946+0000 7f9361240640 1 -- 172.21.15.123:0/3172916190 >> 172.21.15.123:0/3172916190 conn(0x7f935c0fc2f0 msgr2=0x7f935c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:13.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.946+0000 7f9361240640 1 -- 172.21.15.123:0/3172916190 shutdown_connections 2024-08-18T22:07:13.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.946+0000 7f9361240640 1 -- 172.21.15.123:0/3172916190 wait complete. 2024-08-18T22:07:13.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.947+0000 7f9361240640 1 Processor -- start 2024-08-18T22:07:13.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.947+0000 7f9361240640 1 -- start start 2024-08-18T22:07:13.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f9361240640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f935c100230 0x7f935c198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:13.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f9361240640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f935c100be0 0x7f935c1986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:13.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f9361240640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f935c106c00 0x7f935c19ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:13.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f9361240640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f935c111cb0 con 0x7f935c100be0 2024-08-18T22:07:13.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f9361240640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f935c111b30 con 0x7f935c100230 2024-08-18T22:07:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f9361240640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f935c111e30 con 0x7f935c106c00 2024-08-18T22:07:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f935a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f935c100be0 0x7f935c1986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f935a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f935c100be0 0x7f935c1986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56016/0 (socket says 172.21.15.123:56016) 2024-08-18T22:07:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f935a59c640 1 -- 172.21.15.123:0/3192737051 learned_addr learned my addr 172.21.15.123:0/3192737051 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f935ad9d640 1 --2- 172.21.15.123:0/3192737051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f935c100230 0x7f935c198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f935a59c640 1 -- 172.21.15.123:0/3192737051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f935c106c00 msgr2=0x7f935c19ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f935b59e640 1 --2- 172.21.15.123:0/3192737051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f935c106c00 0x7f935c19ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f935a59c640 1 --2- 172.21.15.123:0/3192737051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f935c106c00 0x7f935c19ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f935a59c640 1 -- 172.21.15.123:0/3192737051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f935c100230 msgr2=0x7f935c198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f935a59c640 1 --2- 172.21.15.123:0/3192737051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f935c100230 0x7f935c198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f935a59c640 1 -- 172.21.15.123:0/3192737051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935c19d140 con 0x7f935c100be0 2024-08-18T22:07:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f935a59c640 1 --2- 172.21.15.123:0/3192737051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f935c100be0 0x7f935c1986d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9350005ab0 tx=0x7f93500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f9343fff640 1 -- 172.21.15.123:0/3192737051 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935003f030 con 0x7f935c100be0 2024-08-18T22:07:13.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f9361240640 1 -- 172.21.15.123:0/3192737051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935c19d3d0 con 0x7f935c100be0 2024-08-18T22:07:13.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f9343fff640 1 -- 172.21.15.123:0/3192737051 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9350003ce0 con 0x7f935c100be0 2024-08-18T22:07:13.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.948+0000 7f9343fff640 1 -- 172.21.15.123:0/3192737051 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350035070 con 0x7f935c100be0 2024-08-18T22:07:13.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.949+0000 7f9361240640 1 -- 172.21.15.123:0/3192737051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f935c1a4d10 con 0x7f935c100be0 2024-08-18T22:07:13.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.949+0000 7f9361240640 1 -- 172.21.15.123:0/3192737051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f935c100610 con 0x7f935c100be0 2024-08-18T22:07:13.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.951+0000 7f9343fff640 1 -- 172.21.15.123:0/3192737051 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f9350042030 con 0x7f935c100be0 2024-08-18T22:07:13.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.951+0000 7f9343fff640 1 --2- 172.21.15.123:0/3192737051 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f93440a2b80 0x7f93440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:13.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.951+0000 7f935ad9d640 1 --2- 172.21.15.123:0/3192737051 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f93440a2b80 0x7f93440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:13.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.951+0000 7f9343fff640 1 -- 172.21.15.123:0/3192737051 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f93500eff10 con 0x7f935c100be0 2024-08-18T22:07:13.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.952+0000 7f935ad9d640 1 --2- 172.21.15.123:0/3192737051 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f93440a2b80 0x7f93440a5040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f934c0058c0 tx=0x7f934c00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:13.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:13.954+0000 7f9343fff640 1 -- 172.21.15.123:0/3192737051 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f93500bcae0 con 0x7f935c100be0 2024-08-18T22:07:14.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:13 smithi130 ceph-mon[21698]: pgmap v324: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:14.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:14.154+0000 7f9361240640 1 -- 172.21.15.123:0/3192737051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f935c1994f0 con 0x7f935c100be0 2024-08-18T22:07:14.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:14.155+0000 7f9343fff640 1 -- 172.21.15.123:0/3192737051 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11918 (secure 0 0 0) 0x7f935c1994f0 con 0x7f935c100be0 2024-08-18T22:07:14.156 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:14.156 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":25,"btime":"2024-08-18T22:06:00:456703+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:06:00.091798+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24448,24458,24466]},"id":1}]} 2024-08-18T22:07:14.156 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 25 2024-08-18T22:07:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:14.157+0000 7f9361240640 1 -- 172.21.15.123:0/3192737051 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f93440a2b80 msgr2=0x7f93440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:14.157+0000 7f9361240640 1 --2- 172.21.15.123:0/3192737051 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f93440a2b80 0x7f93440a5040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f934c0058c0 tx=0x7f934c00a250 comp rx=0 tx=0).stop 2024-08-18T22:07:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:14.157+0000 7f9361240640 1 -- 172.21.15.123:0/3192737051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f935c100be0 msgr2=0x7f935c1986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:14.157+0000 7f9361240640 1 --2- 172.21.15.123:0/3192737051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f935c100be0 0x7f935c1986d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9350005ab0 tx=0x7f93500042f0 comp rx=0 tx=0).stop 2024-08-18T22:07:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:14.157+0000 7f9361240640 1 -- 172.21.15.123:0/3192737051 shutdown_connections 2024-08-18T22:07:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:14.157+0000 7f9361240640 1 --2- 172.21.15.123:0/3192737051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f935c106c00 0x7f935c19ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:14.157+0000 7f9361240640 1 --2- 172.21.15.123:0/3192737051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f935c100be0 0x7f935c1986d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:14.157+0000 7f9361240640 1 --2- 172.21.15.123:0/3192737051 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f93440a2b80 0x7f93440a5040 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:14.157+0000 7f9361240640 1 --2- 172.21.15.123:0/3192737051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f935c100230 0x7f935c198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:14.157+0000 7f9361240640 1 -- 172.21.15.123:0/3192737051 >> 172.21.15.123:0/3192737051 conn(0x7f935c0fc2f0 msgr2=0x7f935c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:14.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:14.157+0000 7f9361240640 1 -- 172.21.15.123:0/3192737051 shutdown_connections 2024-08-18T22:07:14.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:14.157+0000 7f9361240640 1 -- 172.21.15.123:0/3192737051 wait complete. 2024-08-18T22:07:14.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:14 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3192737051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:14.971 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:14 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3192737051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:15.003 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-18T22:05:22.597053+0000', 'modified': '2024-08-18T22:06:00.091798+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24466, 'mds_1': 24458, 'mds_2': 24448}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24422': {'gid': 24422, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6835/579024659', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6834', 'nonce': 579024659}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 579024659}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6837/29028326', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6836', 'nonce': 29028326}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 29028326}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.183:6835/1138667446', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6834', 'nonce': 1138667446}, {'type': 'v1', 'addr': '172.21.15.183:6835', 'nonce': 1138667446}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.183:6837/1468802140', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6836', 'nonce': 1468802140}, {'type': 'v1', 'addr': '172.21.15.183:6837', 'nonce': 1468802140}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'b', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.130:6839/991946562', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6838', 'nonce': 991946562}, {'type': 'v1', 'addr': '172.21.15.130:6839', 'nonce': 991946562}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.183:6839/1902275683', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6838', 'nonce': 1902275683}, {'type': 'v1', 'addr': '172.21.15.183:6839', 'nonce': 1902275683}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24466, 'qdb_cluster': [24448, 24458, 24466]} 2024-08-18T22:07:15.004 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-18T22:07:15.004 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.c status 2024-08-18T22:07:15.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:14 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3192737051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:15.255 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:15.657 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:15 smithi123 ceph-mon[18462]: pgmap v325: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 895 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:15.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.737+0000 7fb37f80c640 1 -- 172.21.15.123:0/3454583082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb378100b50 msgr2=0x7fb378100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:15.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.737+0000 7fb37f80c640 1 --2- 172.21.15.123:0/3454583082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb378100b50 0x7fb378100f30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009900 tx=0x7fb36c02a480 comp rx=0 tx=0).stop 2024-08-18T22:07:15.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.737+0000 7fb37f80c640 1 -- 172.21.15.123:0/3454583082 shutdown_connections 2024-08-18T22:07:15.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.737+0000 7fb37f80c640 1 --2- 172.21.15.123:0/3454583082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb378102c20 0x7fb37810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.737+0000 7fb37f80c640 1 --2- 172.21.15.123:0/3454583082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3781022a0 0x7fb3781026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.737+0000 7fb37f80c640 1 --2- 172.21.15.123:0/3454583082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb378100b50 0x7fb378100f30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.737+0000 7fb37f80c640 1 -- 172.21.15.123:0/3454583082 >> 172.21.15.123:0/3454583082 conn(0x7fb3780fc500 msgr2=0x7fb3780fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:15.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.737+0000 7fb37f80c640 1 -- 172.21.15.123:0/3454583082 shutdown_connections 2024-08-18T22:07:15.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.737+0000 7fb37f80c640 1 -- 172.21.15.123:0/3454583082 wait complete. 2024-08-18T22:07:15.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.737+0000 7fb37f80c640 1 Processor -- start 2024-08-18T22:07:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.737+0000 7fb37f80c640 1 -- start start 2024-08-18T22:07:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.737+0000 7fb37f80c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb378100b50 0x7fb378198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.737+0000 7fb37f80c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3781022a0 0x7fb378198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.737+0000 7fb37f80c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb378102c20 0x7fb37819cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37f80c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb378110cd0 con 0x7fb3781022a0 2024-08-18T22:07:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37f80c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb378110b50 con 0x7fb378100b50 2024-08-18T22:07:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37f80c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb378110e50 con 0x7fb378102c20 2024-08-18T22:07:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37cda7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3781022a0 0x7fb378198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37cda7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3781022a0 0x7fb378198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56028/0 (socket says 172.21.15.123:56028) 2024-08-18T22:07:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37cda7640 1 -- 172.21.15.123:0/3509924031 learned_addr learned my addr 172.21.15.123:0/3509924031 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37dda9640 1 --2- 172.21.15.123:0/3509924031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb378102c20 0x7fb37819cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37d5a8640 1 --2- 172.21.15.123:0/3509924031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb378100b50 0x7fb378198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:15.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37cda7640 1 -- 172.21.15.123:0/3509924031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb378102c20 msgr2=0x7fb37819cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37cda7640 1 --2- 172.21.15.123:0/3509924031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb378102c20 0x7fb37819cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37cda7640 1 -- 172.21.15.123:0/3509924031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb378100b50 msgr2=0x7fb378198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37cda7640 1 --2- 172.21.15.123:0/3509924031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb378100b50 0x7fb378198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37cda7640 1 -- 172.21.15.123:0/3509924031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37819d1c0 con 0x7fb3781022a0 2024-08-18T22:07:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37cda7640 1 --2- 172.21.15.123:0/3509924031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3781022a0 0x7fb378198750 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb37400b4a0 tx=0x7fb37400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb36a7fc640 1 -- 172.21.15.123:0/3509924031 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374014070 con 0x7fb3781022a0 2024-08-18T22:07:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb36a7fc640 1 -- 172.21.15.123:0/3509924031 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb374010af0 con 0x7fb3781022a0 2024-08-18T22:07:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37f80c640 1 -- 172.21.15.123:0/3509924031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb37819d4b0 con 0x7fb3781022a0 2024-08-18T22:07:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb36a7fc640 1 -- 172.21.15.123:0/3509924031 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374017d10 con 0x7fb3781022a0 2024-08-18T22:07:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.738+0000 7fb37f80c640 1 -- 172.21.15.123:0/3509924031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3781a4d90 con 0x7fb3781022a0 2024-08-18T22:07:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.740+0000 7fb36a7fc640 1 -- 172.21.15.123:0/3509924031 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fb374017070 con 0x7fb3781022a0 2024-08-18T22:07:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.741+0000 7fb381c0a740 1 Processor -- start 2024-08-18T22:07:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.741+0000 7fb381c0a740 1 -- start start 2024-08-18T22:07:15.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.741+0000 7fb381c0a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db57510 0x55705db578f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.741+0000 7fb381c0a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57e30 0x55705db666e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.741+0000 7fb36a7fc640 1 --2- 172.21.15.123:0/3509924031 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb3640a2c00 0x7fb3640a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.741+0000 7fb381c0a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db66c20 0x55705db69010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.741+0000 7fb381c0a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55705dabc710 con 0x55705db57e30 2024-08-18T22:07:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.741+0000 7fb381c0a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55705da54770 con 0x55705db57510 2024-08-18T22:07:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.741+0000 7fb381c0a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55705dab86d0 con 0x55705db66c20 2024-08-18T22:07:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.741+0000 7fb37d5a8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57e30 0x55705db666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb37d5a8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57e30 0x55705db666e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56030/0 (socket says 172.21.15.123:56030) 2024-08-18T22:07:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb37d5a8640 1 -- 172.21.15.123:0/237053666 learned_addr learned my addr 172.21.15.123:0/237053666 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb37cda7640 1 --2- 172.21.15.123:0/3509924031 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb3640a2c00 0x7fb3640a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb37dda9640 1 --2- 172.21.15.123:0/237053666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db57510 0x55705db578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb36a7fc640 1 -- 172.21.15.123:0/3509924031 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fb3740ce610 con 0x7fb3781022a0 2024-08-18T22:07:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb37dda9640 1 --2- 172.21.15.123:0/237053666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db66c20 0x55705db69010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb37d5a8640 1 -- 172.21.15.123:0/237053666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db66c20 msgr2=0x55705db69010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb37d5a8640 1 --2- 172.21.15.123:0/237053666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db66c20 0x55705db69010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb37d5a8640 1 -- 172.21.15.123:0/237053666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db57510 msgr2=0x55705db578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb37d5a8640 1 --2- 172.21.15.123:0/237053666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db57510 0x55705db578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb37d5a8640 1 -- 172.21.15.123:0/237053666 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55705da5b3e0 con 0x55705db57e30 2024-08-18T22:07:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb37cda7640 1 --2- 172.21.15.123:0/3509924031 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb3640a2c00 0x7fb3640a50c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb374096ff0 tx=0x7fb374090070 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb37d5a8640 1 --2- 172.21.15.123:0/237053666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57e30 0x55705db666e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009900 tx=0x7fb36c004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5574db6981d465 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb3637fe640 1 -- 172.21.15.123:0/237053666 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c035030 con 0x55705db57e30 2024-08-18T22:07:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb3637fe640 1 -- 172.21.15.123:0/237053666 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb36c040070 con 0x55705db57e30 2024-08-18T22:07:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.742+0000 7fb3637fe640 1 -- 172.21.15.123:0/237053666 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c031b20 con 0x55705db57e30 2024-08-18T22:07:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.743+0000 7fb381c0a740 1 -- 172.21.15.123:0/237053666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57e30 msgr2=0x55705db666e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.743+0000 7fb381c0a740 1 --2- 172.21.15.123:0/237053666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57e30 0x55705db666e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009900 tx=0x7fb36c004200 comp rx=0 tx=0).stop 2024-08-18T22:07:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.743+0000 7fb381c0a740 1 -- 172.21.15.123:0/237053666 shutdown_connections 2024-08-18T22:07:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.743+0000 7fb381c0a740 1 --2- 172.21.15.123:0/237053666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db66c20 0x55705db69010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.743+0000 7fb381c0a740 1 --2- 172.21.15.123:0/237053666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57e30 0x55705db666e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.743+0000 7fb381c0a740 1 --2- 172.21.15.123:0/237053666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db57510 0x55705db578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.743+0000 7fb381c0a740 1 -- 172.21.15.123:0/237053666 >> 172.21.15.123:0/237053666 conn(0x55705db53bc0 msgr2=0x55705db53fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.743+0000 7fb381c0a740 1 -- 172.21.15.123:0/237053666 shutdown_connections 2024-08-18T22:07:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.743+0000 7fb381c0a740 1 -- 172.21.15.123:0/237053666 wait complete. 2024-08-18T22:07:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.743+0000 7fb381c0a740 1 -- start start 2024-08-18T22:07:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb381c0a740 1 Processor -- start 2024-08-18T22:07:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb381c0a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57510 0x55705db63b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb381c0a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db57e30 0x55705db640a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb381c0a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db66c20 0x55705db645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb381c0a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55705db697f0 con 0x55705db57510 2024-08-18T22:07:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb381c0a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55705da77970 con 0x55705db66c20 2024-08-18T22:07:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb381c0a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55705db69970 con 0x55705db57e30 2024-08-18T22:07:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb381c0a740 10 client.0 _ll_register_callbacks cb 0x55705d7cb7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb37dda9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57510 0x55705db63b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb37dda9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57510 0x55705db63b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56044/0 (socket says 172.21.15.123:56044) 2024-08-18T22:07:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb37dda9640 1 -- 172.21.15.123:0/4205507273 learned_addr learned my addr 172.21.15.123:0/4205507273 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb37dda9640 1 -- 172.21.15.123:0/4205507273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db57e30 msgr2=0x55705db640a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb37d5a8640 1 --2- 172.21.15.123:0/4205507273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db57e30 0x55705db640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb37dda9640 1 --2- 172.21.15.123:0/4205507273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db57e30 0x55705db640a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb37dda9640 1 -- 172.21.15.123:0/4205507273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db66c20 msgr2=0x55705db645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb37dda9640 1 --2- 172.21.15.123:0/4205507273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db66c20 0x55705db645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.744+0000 7fb37dda9640 1 -- 172.21.15.123:0/4205507273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55705d82e2b0 con 0x55705db57510 2024-08-18T22:07:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb37dda9640 1 --2- 172.21.15.123:0/4205507273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57510 0x55705db63b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb370014460 tx=0x7fb370012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1f34c797091265 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb360ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb360ff9640 1 -- 172.21.15.123:0/4205507273 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb370004d20 con 0x55705db57510 2024-08-18T22:07:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb360ff9640 1 -- 172.21.15.123:0/4205507273 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fb370003970 con 0x55705db57510 2024-08-18T22:07:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb381c0a740 1 -- 172.21.15.123:0/4205507273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb36c040070 con 0x55705db57510 2024-08-18T22:07:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb360ff9640 1 -- 172.21.15.123:0/4205507273 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb370025050 con 0x55705db57510 2024-08-18T22:07:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb381c0a740 10 client.15060 fetch_fsmap learned FSMap version 25 2024-08-18T22:07:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb381c0a740 1 -- 172.21.15.123:0/4205507273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55705db754f0 con 0x55705db57510 2024-08-18T22:07:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb360ff9640 1 -- 172.21.15.123:0/4205507273 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb36c040070 con 0x55705db57510 2024-08-18T22:07:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb360ff9640 1 -- 172.21.15.123:0/4205507273 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb37000f6b0 con 0x55705db57510 2024-08-18T22:07:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb381c0a740 10 client.15060 fetch_fsmap finished waiting for FSMap version 25 2024-08-18T22:07:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb381c0a740 10 client.15060 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:07:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb381c0a740 20 client.15060 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb381c0a740 1 --2- 172.21.15.123:0/4205507273 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55705db77bc0 0x55705db79030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb381c0a740 4 client.15060 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:07:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.745+0000 7fb381c0a740 1 -- 172.21.15.123:0/4205507273 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55705dac9c80 con 0x55705db77bc0 2024-08-18T22:07:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.746+0000 7fb37d5a8640 1 --2- 172.21.15.123:0/4205507273 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55705db77bc0 0x55705db79030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.746+0000 7fb360ff9640 10 client.15060 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:07:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.746+0000 7fb37d5a8640 1 --2- 172.21.15.123:0/4205507273 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55705db77bc0 0x55705db79030 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=28c71258a7ef4435 server_cookie=447c8172023c0dcd in_seq=0 out_seq=0 2024-08-18T22:07:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.747+0000 7fb360ff9640 1 -- 172.21.15.123:0/4205507273 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55705dac9c80 con 0x55705db77bc0 2024-08-18T22:07:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.747+0000 7fb360ff9640 10 client.15060 handle_command_reply: tid=0 2024-08-18T22:07:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.747+0000 7fb381c0a740 1 client.15060 shutdown 2024-08-18T22:07:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.747+0000 7fb381c0a740 1 -- 172.21.15.123:0/4205507273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57510 msgr2=0x55705db63b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.747+0000 7fb381c0a740 1 --2- 172.21.15.123:0/4205507273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57510 0x55705db63b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb370014460 tx=0x7fb370012820 comp rx=0 tx=0).stop 2024-08-18T22:07:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.747+0000 7fb381c0a740 1 -- 172.21.15.123:0/4205507273 shutdown_connections 2024-08-18T22:07:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.747+0000 7fb381c0a740 1 --2- 172.21.15.123:0/4205507273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db66c20 0x55705db645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.747+0000 7fb381c0a740 1 --2- 172.21.15.123:0/4205507273 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55705db77bc0 0x55705db79030 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.747+0000 7fb381c0a740 1 --2- 172.21.15.123:0/4205507273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db57e30 0x55705db640a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.747+0000 7fb381c0a740 1 --2- 172.21.15.123:0/4205507273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57510 0x55705db63b60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.747+0000 7fb360ff9640 0 client.15060 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:07:15.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.747+0000 7fb381c0a740 1 -- 172.21.15.123:0/4205507273 >> 172.21.15.123:0/4205507273 conn(0x55705db53bc0 msgr2=0x55705db59920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:15.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.747+0000 7fb381c0a740 1 -- 172.21.15.123:0/4205507273 shutdown_connections 2024-08-18T22:07:15.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.747+0000 7fb381c0a740 1 -- 172.21.15.123:0/4205507273 wait complete. 2024-08-18T22:07:15.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.747+0000 7fb381c0a740 20 client.15060 trim_cache size 0 max 16384 2024-08-18T22:07:15.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb381c0a740 1 Processor -- start 2024-08-18T22:07:15.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb381c0a740 1 -- start start 2024-08-18T22:07:15.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb381c0a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57510 0x55705db662c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb381c0a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db57e30 0x55705db79030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb381c0a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db66c20 0x55705db60dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb381c0a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55705db77370 con 0x55705db57510 2024-08-18T22:07:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb381c0a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55705db77a40 con 0x55705db57e30 2024-08-18T22:07:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb381c0a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55705db78110 con 0x55705db66c20 2024-08-18T22:07:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb37dda9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57510 0x55705db662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb37dda9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57510 0x55705db662c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56056/0 (socket says 172.21.15.123:56056) 2024-08-18T22:07:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb37dda9640 1 -- 172.21.15.123:0/3740711643 learned_addr learned my addr 172.21.15.123:0/3740711643 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb37dda9640 1 -- 172.21.15.123:0/3740711643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db66c20 msgr2=0x55705db60dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb37dda9640 1 --2- 172.21.15.123:0/3740711643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db66c20 0x55705db60dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb37dda9640 1 -- 172.21.15.123:0/3740711643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db57e30 msgr2=0x55705db79030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:15.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb37dda9640 1 --2- 172.21.15.123:0/3740711643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db57e30 0x55705db79030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb37dda9640 1 -- 172.21.15.123:0/3740711643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55705db4f130 con 0x55705db57510 2024-08-18T22:07:15.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.765+0000 7fb37dda9640 1 --2- 172.21.15.123:0/3740711643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57510 0x55705db662c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb370007880 tx=0x7fb3700072a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487b6f8b9dc3f1c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:15.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.766+0000 7fb362ffd640 1 -- 172.21.15.123:0/3740711643 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37000f680 con 0x55705db57510 2024-08-18T22:07:15.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.766+0000 7fb362ffd640 1 -- 172.21.15.123:0/3740711643 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb37002d030 con 0x55705db57510 2024-08-18T22:07:15.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.766+0000 7fb362ffd640 1 -- 172.21.15.123:0/3740711643 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb370004530 con 0x55705db57510 2024-08-18T22:07:15.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.766+0000 7fb381c0a740 1 -- 172.21.15.123:0/3740711643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57510 msgr2=0x55705db662c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:15.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.766+0000 7fb381c0a740 1 --2- 172.21.15.123:0/3740711643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57510 0x55705db662c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb370007880 tx=0x7fb3700072a0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.766+0000 7fb381c0a740 1 -- 172.21.15.123:0/3740711643 shutdown_connections 2024-08-18T22:07:15.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.766+0000 7fb381c0a740 1 --2- 172.21.15.123:0/3740711643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db66c20 0x55705db60dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.766+0000 7fb381c0a740 1 --2- 172.21.15.123:0/3740711643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db57e30 0x55705db79030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.766+0000 7fb381c0a740 1 --2- 172.21.15.123:0/3740711643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57510 0x55705db662c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.766+0000 7fb381c0a740 1 -- 172.21.15.123:0/3740711643 >> 172.21.15.123:0/3740711643 conn(0x55705db53bc0 msgr2=0x55705db62430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:15.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.766+0000 7fb381c0a740 1 -- 172.21.15.123:0/3740711643 shutdown_connections 2024-08-18T22:07:15.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.766+0000 7fb381c0a740 1 -- 172.21.15.123:0/3740711643 wait complete. 2024-08-18T22:07:15.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.767+0000 7fb381c0a740 1 -- start start 2024-08-18T22:07:15.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.767+0000 7fb381c0a740 1 Processor -- start 2024-08-18T22:07:15.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.767+0000 7fb381c0a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db57510 0x55705db81970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.767+0000 7fb381c0a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57e30 0x55705db7aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.767+0000 7fb381c0a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db66c20 0x55705db7b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.767+0000 7fb381c0a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55705db78eb0 con 0x55705db57e30 2024-08-18T22:07:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.767+0000 7fb381c0a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55705db787e0 con 0x55705db66c20 2024-08-18T22:07:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.767+0000 7fb381c0a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55705db79580 con 0x55705db57510 2024-08-18T22:07:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.767+0000 7fb381c0a740 10 client.0 _ll_register_callbacks cb 0x7fb370014980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.767+0000 7fb37d5a8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57e30 0x55705db7aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.767+0000 7fb37d5a8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57e30 0x55705db7aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56066/0 (socket says 172.21.15.123:56066) 2024-08-18T22:07:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.767+0000 7fb37d5a8640 1 -- 172.21.15.123:0/4157675599 learned_addr learned my addr 172.21.15.123:0/4157675599 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.767+0000 7fb37dda9640 1 --2- 172.21.15.123:0/4157675599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db57510 0x55705db81970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.767+0000 7fb37dda9640 1 --2- 172.21.15.123:0/4157675599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db66c20 0x55705db7b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb37d5a8640 1 -- 172.21.15.123:0/4157675599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db57510 msgr2=0x55705db81970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb37d5a8640 1 --2- 172.21.15.123:0/4157675599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db57510 0x55705db81970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb37d5a8640 1 -- 172.21.15.123:0/4157675599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db66c20 msgr2=0x55705db7b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb37d5a8640 1 --2- 172.21.15.123:0/4157675599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db66c20 0x55705db7b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb37d5a8640 1 -- 172.21.15.123:0/4157675599 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55705db58aa0 con 0x55705db57e30 2024-08-18T22:07:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb37dda9640 1 --2- 172.21.15.123:0/4157675599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db57510 0x55705db81970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb37d5a8640 1 --2- 172.21.15.123:0/4157675599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57e30 0x55705db7aca0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009900 tx=0x7fb36c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22d47f20cea557f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb360ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb360ff9640 1 -- 172.21.15.123:0/4157675599 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c035040 con 0x55705db57e30 2024-08-18T22:07:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb381c0a740 1 -- 172.21.15.123:0/4157675599 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb37002d030 con 0x55705db57e30 2024-08-18T22:07:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb360ff9640 1 -- 172.21.15.123:0/4157675599 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fb36c031c30 con 0x55705db57e30 2024-08-18T22:07:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb360ff9640 1 -- 172.21.15.123:0/4157675599 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb36c005850 con 0x55705db57e30 2024-08-18T22:07:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb381c0a740 10 client.15066 fetch_fsmap learned FSMap version 25 2024-08-18T22:07:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb381c0a740 1 -- 172.21.15.123:0/4157675599 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55705db80280 con 0x55705db57e30 2024-08-18T22:07:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb360ff9640 1 -- 172.21.15.123:0/4157675599 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb37002d030 con 0x55705db57e30 2024-08-18T22:07:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb360ff9640 1 -- 172.21.15.123:0/4157675599 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb36c050480 con 0x55705db57e30 2024-08-18T22:07:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb381c0a740 10 client.15066 fetch_fsmap finished waiting for FSMap version 25 2024-08-18T22:07:15.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb381c0a740 10 client.15066 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:07:15.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.768+0000 7fb381c0a740 20 client.15066 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:15.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.769+0000 7fb381c0a740 1 --2- 172.21.15.123:0/4157675599 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55705dbe6880 0x55705dbe5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:15.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.769+0000 7fb381c0a740 4 client.15066 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:07:15.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.769+0000 7fb381c0a740 1 -- 172.21.15.123:0/4157675599 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "status"}) -- 0x55705dac4190 con 0x55705dbe6880 2024-08-18T22:07:15.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.769+0000 7fb37dda9640 1 --2- 172.21.15.123:0/4157675599 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55705dbe6880 0x55705dbe5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:15.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.769+0000 7fb37dda9640 1 --2- 172.21.15.123:0/4157675599 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55705dbe6880 0x55705dbe5590 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=647fb6f3678aea92 server_cookie=f22f52e0391aa0f4 in_seq=0 out_seq=0 2024-08-18T22:07:15.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.769+0000 7fb360ff9640 10 client.15066 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:07:15.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.769+0000 7fb360ff9640 1 -- 172.21.15.123:0/4157675599 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55705dac4190 con 0x55705dbe6880 2024-08-18T22:07:15.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.769+0000 7fb360ff9640 10 client.15066 handle_command_reply: tid=0 2024-08-18T22:07:15.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.769+0000 7fb381c0a740 1 client.15066 shutdown 2024-08-18T22:07:15.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.769+0000 7fb381c0a740 1 -- 172.21.15.123:0/4157675599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57e30 msgr2=0x55705db7aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:15.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.769+0000 7fb381c0a740 1 --2- 172.21.15.123:0/4157675599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57e30 0x55705db7aca0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009900 tx=0x7fb36c005fd0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb381c0a740 1 -- 172.21.15.123:0/4157675599 shutdown_connections 2024-08-18T22:07:15.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb381c0a740 1 --2- 172.21.15.123:0/4157675599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55705db66c20 0x55705db7b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb381c0a740 1 --2- 172.21.15.123:0/4157675599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55705db57e30 0x55705db7aca0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb381c0a740 1 --2- 172.21.15.123:0/4157675599 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55705dbe6880 0x55705dbe5590 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb381c0a740 1 --2- 172.21.15.123:0/4157675599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55705db57510 0x55705db81970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb360ff9640 0 client.15066 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:07:15.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb381c0a740 1 -- 172.21.15.123:0/4157675599 >> 172.21.15.123:0/4157675599 conn(0x55705db53bc0 msgr2=0x55705db52520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:15.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb381c0a740 1 -- 172.21.15.123:0/4157675599 shutdown_connections 2024-08-18T22:07:15.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb381c0a740 1 -- 172.21.15.123:0/4157675599 wait complete. 2024-08-18T22:07:15.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb381c0a740 20 client.15066 trim_cache size 0 max 16384 2024-08-18T22:07:15.777 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:07:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "dfa1db70-5dac-11ef-bccf-c7b262605968", 2024-08-18T22:07:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 2, 2024-08-18T22:07:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24448, 2024-08-18T22:07:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-08-18T22:07:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-08-18T22:07:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-08-18T22:07:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 78.323402971999997, 2024-08-18T22:07:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 25, 2024-08-18T22:07:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 92, 2024-08-18T22:07:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 88, 2024-08-18T22:07:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 138.42990382900001 2024-08-18T22:07:15.777 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:07:15.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb37f80c640 1 -- 172.21.15.123:0/3509924031 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb3640a2c00 msgr2=0x7fb3640a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:15.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb37f80c640 1 --2- 172.21.15.123:0/3509924031 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb3640a2c00 0x7fb3640a50c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb374096ff0 tx=0x7fb374090070 comp rx=0 tx=0).stop 2024-08-18T22:07:15.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb37f80c640 1 -- 172.21.15.123:0/3509924031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3781022a0 msgr2=0x7fb378198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:15.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb37f80c640 1 --2- 172.21.15.123:0/3509924031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3781022a0 0x7fb378198750 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb37400b4a0 tx=0x7fb37400b960 comp rx=0 tx=0).stop 2024-08-18T22:07:15.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb37f80c640 1 -- 172.21.15.123:0/3509924031 shutdown_connections 2024-08-18T22:07:15.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb37f80c640 1 --2- 172.21.15.123:0/3509924031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb378102c20 0x7fb37819cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb37f80c640 1 --2- 172.21.15.123:0/3509924031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3781022a0 0x7fb378198750 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb37f80c640 1 --2- 172.21.15.123:0/3509924031 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb3640a2c00 0x7fb3640a50c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb37f80c640 1 --2- 172.21.15.123:0/3509924031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb378100b50 0x7fb378198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:15.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb37f80c640 1 -- 172.21.15.123:0/3509924031 >> 172.21.15.123:0/3509924031 conn(0x7fb3780fc500 msgr2=0x7fb378069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:15.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.770+0000 7fb37f80c640 1 -- 172.21.15.123:0/3509924031 shutdown_connections 2024-08-18T22:07:15.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:15.771+0000 7fb37f80c640 1 -- 172.21.15.123:0/3509924031 wait complete. 2024-08-18T22:07:15.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:15 smithi183 ceph-mon[22097]: pgmap v325: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 895 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:16.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:15 smithi130 ceph-mon[21698]: pgmap v325: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 895 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:16.465 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.b status 2024-08-18T22:07:16.712 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:17.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.204+0000 7fb4c2df1640 1 -- 172.21.15.123:0/3288756536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4bc103410 msgr2=0x7fb4bc1078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:17.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.204+0000 7fb4c2df1640 1 --2- 172.21.15.123:0/3288756536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4bc103410 0x7fb4bc1078c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4009930 tx=0x7fb4a402a420 comp rx=0 tx=0).stop 2024-08-18T22:07:17.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.204+0000 7fb4c2df1640 1 -- 172.21.15.123:0/3288756536 shutdown_connections 2024-08-18T22:07:17.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.204+0000 7fb4c2df1640 1 --2- 172.21.15.123:0/3288756536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4bc107fd0 0x7fb4bc10e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.204+0000 7fb4c2df1640 1 --2- 172.21.15.123:0/3288756536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4bc103410 0x7fb4bc1078c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.204+0000 7fb4c2df1640 1 --2- 172.21.15.123:0/3288756536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4bc102a60 0x7fb4bc102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.204+0000 7fb4c2df1640 1 -- 172.21.15.123:0/3288756536 >> 172.21.15.123:0/3288756536 conn(0x7fb4bc0fc500 msgr2=0x7fb4bc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:17.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.204+0000 7fb4c2df1640 1 -- 172.21.15.123:0/3288756536 shutdown_connections 2024-08-18T22:07:17.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.204+0000 7fb4c2df1640 1 -- 172.21.15.123:0/3288756536 wait complete. 2024-08-18T22:07:17.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.204+0000 7fb4c2df1640 1 Processor -- start 2024-08-18T22:07:17.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.204+0000 7fb4c2df1640 1 -- start start 2024-08-18T22:07:17.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c2df1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4bc102a60 0x7fb4bc1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c2df1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4bc103410 0x7fb4bc1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c2df1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4bc107fd0 0x7fb4bc19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c2df1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc111da0 con 0x7fb4bc107fd0 2024-08-18T22:07:17.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c2df1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc111c20 con 0x7fb4bc102a60 2024-08-18T22:07:17.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c2df1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc111f20 con 0x7fb4bc103410 2024-08-18T22:07:17.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c138e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4bc107fd0 0x7fb4bc19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c138e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4bc107fd0 0x7fb4bc19cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56080/0 (socket says 172.21.15.123:56080) 2024-08-18T22:07:17.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c138e640 1 -- 172.21.15.123:0/3637070332 learned_addr learned my addr 172.21.15.123:0/3637070332 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:17.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c0b8d640 1 --2- 172.21.15.123:0/3637070332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4bc102a60 0x7fb4bc1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4bbfff640 1 --2- 172.21.15.123:0/3637070332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4bc103410 0x7fb4bc1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c138e640 1 -- 172.21.15.123:0/3637070332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4bc103410 msgr2=0x7fb4bc1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:17.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c138e640 1 --2- 172.21.15.123:0/3637070332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4bc103410 0x7fb4bc1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c138e640 1 -- 172.21.15.123:0/3637070332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4bc102a60 msgr2=0x7fb4bc1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:17.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c138e640 1 --2- 172.21.15.123:0/3637070332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4bc102a60 0x7fb4bc1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c138e640 1 -- 172.21.15.123:0/3637070332 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4bc19d350 con 0x7fb4bc107fd0 2024-08-18T22:07:17.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4c138e640 1 --2- 172.21.15.123:0/3637070332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4bc107fd0 0x7fb4bc19cc70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400eaa0 tx=0x7fb4b400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:17.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.205+0000 7fb4b9ffb640 1 -- 172.21.15.123:0/3637070332 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400cdb0 con 0x7fb4bc107fd0 2024-08-18T22:07:17.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.206+0000 7fb4b9ffb640 1 -- 172.21.15.123:0/3637070332 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4b4005020 con 0x7fb4bc107fd0 2024-08-18T22:07:17.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.206+0000 7fb4c2df1640 1 -- 172.21.15.123:0/3637070332 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4bc19d640 con 0x7fb4bc107fd0 2024-08-18T22:07:17.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.206+0000 7fb4b9ffb640 1 -- 172.21.15.123:0/3637070332 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b40116b0 con 0x7fb4bc107fd0 2024-08-18T22:07:17.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.206+0000 7fb4c2df1640 1 -- 172.21.15.123:0/3637070332 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4bc1a4f20 con 0x7fb4bc107fd0 2024-08-18T22:07:17.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.208+0000 7fb4b9ffb640 1 -- 172.21.15.123:0/3637070332 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fb4b4005560 con 0x7fb4bc107fd0 2024-08-18T22:07:17.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.208+0000 7fb4c51ef740 1 Processor -- start 2024-08-18T22:07:17.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4b9ffb640 1 --2- 172.21.15.123:0/3637070332 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb4a80a2c00 0x7fb4a80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c51ef740 1 -- start start 2024-08-18T22:07:17.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4b9ffb640 1 -- 172.21.15.123:0/3637070332 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fb4b40cf4b0 con 0x7fb4bc107fd0 2024-08-18T22:07:17.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4bbfff640 1 --2- 172.21.15.123:0/3637070332 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb4a80a2c00 0x7fb4a80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c51ef740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9768630 0x560bb9768a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c51ef740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9768f50 0x560bb97732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c51ef740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9773810 0x560bb9775c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c51ef740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x560bb96cd710 con 0x560bb9773810 2024-08-18T22:07:17.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c51ef740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560bb9665770 con 0x560bb9768630 2024-08-18T22:07:17.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c51ef740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560bb96c96d0 con 0x560bb9768f50 2024-08-18T22:07:17.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c138e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9773810 0x560bb9775c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c138e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9773810 0x560bb9775c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56094/0 (socket says 172.21.15.123:56094) 2024-08-18T22:07:17.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c138e640 1 -- 172.21.15.123:0/3130786877 learned_addr learned my addr 172.21.15.123:0/3130786877 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:17.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c0b8d640 1 --2- 172.21.15.123:0/3130786877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9768630 0x560bb9768a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4bbfff640 1 --2- 172.21.15.123:0/3130786877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9768f50 0x560bb97732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c138e640 1 -- 172.21.15.123:0/3130786877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9768f50 msgr2=0x560bb97732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:17.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c138e640 1 --2- 172.21.15.123:0/3130786877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9768f50 0x560bb97732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c138e640 1 -- 172.21.15.123:0/3130786877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9768630 msgr2=0x560bb9768a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:17.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c138e640 1 --2- 172.21.15.123:0/3130786877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9768630 0x560bb9768a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c138e640 1 -- 172.21.15.123:0/3130786877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bb966c3e0 con 0x560bb9773810 2024-08-18T22:07:17.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4bbfff640 1 --2- 172.21.15.123:0/3637070332 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb4a80a2c00 0x7fb4a80a50c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4005940 tx=0x7fb4a4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:17.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.209+0000 7fb4c138e640 1 --2- 172.21.15.123:0/3130786877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9773810 0x560bb9775c00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4005910 tx=0x7fb4b409fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f7925db178d2a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:17.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.210+0000 7fb4b2ffd640 1 -- 172.21.15.123:0/3130786877 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b401f040 con 0x560bb9773810 2024-08-18T22:07:17.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.210+0000 7fb4b2ffd640 1 -- 172.21.15.123:0/3130786877 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4b40cf050 con 0x560bb9773810 2024-08-18T22:07:17.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.210+0000 7fb4b2ffd640 1 -- 172.21.15.123:0/3130786877 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b40a4160 con 0x560bb9773810 2024-08-18T22:07:17.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.210+0000 7fb4c51ef740 1 -- 172.21.15.123:0/3130786877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9773810 msgr2=0x560bb9775c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:17.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.210+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/3130786877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9773810 0x560bb9775c00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4005910 tx=0x7fb4b409fdf0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.210+0000 7fb4c51ef740 1 -- 172.21.15.123:0/3130786877 shutdown_connections 2024-08-18T22:07:17.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.210+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/3130786877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9773810 0x560bb9775c00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.210+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/3130786877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9768f50 0x560bb97732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.210+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/3130786877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9768630 0x560bb9768a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.210+0000 7fb4c51ef740 1 -- 172.21.15.123:0/3130786877 >> 172.21.15.123:0/3130786877 conn(0x560bb9764bc0 msgr2=0x560bb9764fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:17.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.210+0000 7fb4c51ef740 1 -- 172.21.15.123:0/3130786877 shutdown_connections 2024-08-18T22:07:17.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.210+0000 7fb4c51ef740 1 -- 172.21.15.123:0/3130786877 wait complete. 2024-08-18T22:07:17.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.211+0000 7fb4c51ef740 1 -- start start 2024-08-18T22:07:17.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.211+0000 7fb4c51ef740 1 Processor -- start 2024-08-18T22:07:17.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.211+0000 7fb4c51ef740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9768630 0x560bb97706c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.211+0000 7fb4c51ef740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768f50 0x560bb9770c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.211+0000 7fb4c51ef740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9773810 0x560bb9771140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.211+0000 7fb4c51ef740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x560bb97763e0 con 0x560bb9768f50 2024-08-18T22:07:17.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.211+0000 7fb4c51ef740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560bb9688970 con 0x560bb9773810 2024-08-18T22:07:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.211+0000 7fb4c51ef740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560bb9776560 con 0x560bb9768630 2024-08-18T22:07:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.211+0000 7fb4c51ef740 10 client.0 _ll_register_callbacks cb 0x560bb93dc7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.211+0000 7fb4bbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768f50 0x560bb9770c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.211+0000 7fb4bbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768f50 0x560bb9770c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56108/0 (socket says 172.21.15.123:56108) 2024-08-18T22:07:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.211+0000 7fb4bbfff640 1 -- 172.21.15.123:0/1257323835 learned_addr learned my addr 172.21.15.123:0/1257323835 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.211+0000 7fb4c0b8d640 1 --2- 172.21.15.123:0/1257323835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9768630 0x560bb97706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.211+0000 7fb4c138e640 1 --2- 172.21.15.123:0/1257323835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9773810 0x560bb9771140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb4bbfff640 1 -- 172.21.15.123:0/1257323835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9768630 msgr2=0x560bb97706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb4bbfff640 1 --2- 172.21.15.123:0/1257323835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9768630 0x560bb97706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb4bbfff640 1 -- 172.21.15.123:0/1257323835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9773810 msgr2=0x560bb9771140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb4bbfff640 1 --2- 172.21.15.123:0/1257323835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9773810 0x560bb9771140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb4bbfff640 1 -- 172.21.15.123:0/1257323835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bb943f2b0 con 0x560bb9768f50 2024-08-18T22:07:17.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb4bbfff640 1 --2- 172.21.15.123:0/1257323835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768f50 0x560bb9770c00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4033000 tx=0x7fb4a402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3394f54f22970e0b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:17.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb49bfff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:17.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb49bfff640 1 -- 172.21.15.123:0/1257323835 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4035040 con 0x560bb9768f50 2024-08-18T22:07:17.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb49bfff640 1 -- 172.21.15.123:0/1257323835 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fb4a4005240 con 0x560bb9768f50 2024-08-18T22:07:17.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb4c51ef740 1 -- 172.21.15.123:0/1257323835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4b40cf050 con 0x560bb9768f50 2024-08-18T22:07:17.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb49bfff640 1 -- 172.21.15.123:0/1257323835 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb4a4059050 con 0x560bb9768f50 2024-08-18T22:07:17.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb4c51ef740 10 client.15078 fetch_fsmap learned FSMap version 25 2024-08-18T22:07:17.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb4c51ef740 1 -- 172.21.15.123:0/1257323835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560bb9781fb0 con 0x560bb9768f50 2024-08-18T22:07:17.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb49bfff640 1 -- 172.21.15.123:0/1257323835 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4b40cf050 con 0x560bb9768f50 2024-08-18T22:07:17.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb49bfff640 1 -- 172.21.15.123:0/1257323835 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb4a4003680 con 0x560bb9768f50 2024-08-18T22:07:17.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.212+0000 7fb4c51ef740 10 client.15078 fetch_fsmap finished waiting for FSMap version 25 2024-08-18T22:07:17.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.213+0000 7fb4c51ef740 10 client.15078 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-18T22:07:17.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.213+0000 7fb4c51ef740 20 client.15078 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:17.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.213+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/1257323835 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x560bb9784650 0x560bb9785ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.213+0000 7fb4c51ef740 4 client.15078 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:07:17.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.213+0000 7fb4c51ef740 1 -- 172.21.15.123:0/1257323835 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bb96dac80 con 0x560bb9784650 2024-08-18T22:07:17.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.213+0000 7fb4c0b8d640 1 --2- 172.21.15.123:0/1257323835 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x560bb9784650 0x560bb9785ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.213+0000 7fb4c0b8d640 1 --2- 172.21.15.123:0/1257323835 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x560bb9784650 0x560bb9785ac0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f3b4f5640be4e706 server_cookie=9a3470e1e8eeb10c in_seq=0 out_seq=0 2024-08-18T22:07:17.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.213+0000 7fb49bfff640 10 client.15078 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:07:17.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.214+0000 7fb49bfff640 1 -- 172.21.15.123:0/1257323835 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560bb96dac80 con 0x560bb9784650 2024-08-18T22:07:17.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.214+0000 7fb49bfff640 10 client.15078 handle_command_reply: tid=0 2024-08-18T22:07:17.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.214+0000 7fb4c51ef740 1 client.15078 shutdown 2024-08-18T22:07:17.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.214+0000 7fb4c51ef740 1 -- 172.21.15.123:0/1257323835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768f50 msgr2=0x560bb9770c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:17.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.214+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/1257323835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768f50 0x560bb9770c00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4033000 tx=0x7fb4a402a420 comp rx=0 tx=0).stop 2024-08-18T22:07:17.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.214+0000 7fb4c51ef740 1 -- 172.21.15.123:0/1257323835 shutdown_connections 2024-08-18T22:07:17.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.214+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/1257323835 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x560bb9784650 0x560bb9785ac0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.214+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/1257323835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9773810 0x560bb9771140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.214+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/1257323835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768f50 0x560bb9770c00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.214+0000 7fb49bfff640 0 client.15078 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:07:17.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.214+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/1257323835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9768630 0x560bb97706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.214+0000 7fb4c51ef740 1 -- 172.21.15.123:0/1257323835 >> 172.21.15.123:0/1257323835 conn(0x560bb9764bc0 msgr2=0x560bb9763d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:17.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.214+0000 7fb4c51ef740 1 -- 172.21.15.123:0/1257323835 shutdown_connections 2024-08-18T22:07:17.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.214+0000 7fb4c51ef740 1 -- 172.21.15.123:0/1257323835 wait complete. 2024-08-18T22:07:17.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.214+0000 7fb4c51ef740 20 client.15078 trim_cache size 0 max 16384 2024-08-18T22:07:17.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.232+0000 7fb4c51ef740 1 Processor -- start 2024-08-18T22:07:17.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.232+0000 7fb4c51ef740 1 -- start start 2024-08-18T22:07:17.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.232+0000 7fb4c51ef740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9768630 0x560bb976ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.232+0000 7fb4c51ef740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768f50 0x560bb976f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.232+0000 7fb4c51ef740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9773810 0x560bb976d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.232+0000 7fb4c51ef740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x560bb9783e00 con 0x560bb9768f50 2024-08-18T22:07:17.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.232+0000 7fb4c51ef740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560bb97844d0 con 0x560bb9768630 2024-08-18T22:07:17.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.232+0000 7fb4c51ef740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560bb9784ba0 con 0x560bb9773810 2024-08-18T22:07:17.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.233+0000 7fb4bbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768f50 0x560bb976f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.233+0000 7fb4bbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768f50 0x560bb976f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56116/0 (socket says 172.21.15.123:56116) 2024-08-18T22:07:17.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.233+0000 7fb4bbfff640 1 -- 172.21.15.123:0/1868730146 learned_addr learned my addr 172.21.15.123:0/1868730146 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:17.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.233+0000 7fb4c0b8d640 1 --2- 172.21.15.123:0/1868730146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9768630 0x560bb976ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.233+0000 7fb4bbfff640 1 -- 172.21.15.123:0/1868730146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9773810 msgr2=0x560bb976d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:17.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.233+0000 7fb4bbfff640 1 --2- 172.21.15.123:0/1868730146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9773810 0x560bb976d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.233+0000 7fb4bbfff640 1 -- 172.21.15.123:0/1868730146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9768630 msgr2=0x560bb976ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:17.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.233+0000 7fb4bbfff640 1 --2- 172.21.15.123:0/1868730146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9768630 0x560bb976ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.233+0000 7fb4bbfff640 1 -- 172.21.15.123:0/1868730146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bb9760130 con 0x560bb9768f50 2024-08-18T22:07:17.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.233+0000 7fb4bbfff640 1 --2- 172.21.15.123:0/1868730146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768f50 0x560bb976f6a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4003c60 tx=0x7fb4a40058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dff96b4f6019656 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:17.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.233+0000 7fb4b27fc640 1 -- 172.21.15.123:0/1868730146 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4003ce0 con 0x560bb9768f50 2024-08-18T22:07:17.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.233+0000 7fb4b27fc640 1 -- 172.21.15.123:0/1868730146 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4a4056070 con 0x560bb9768f50 2024-08-18T22:07:17.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.233+0000 7fb4b27fc640 1 -- 172.21.15.123:0/1868730146 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a403dcb0 con 0x560bb9768f50 2024-08-18T22:07:17.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.234+0000 7fb4c51ef740 1 -- 172.21.15.123:0/1868730146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768f50 msgr2=0x560bb976f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:17.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.234+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/1868730146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768f50 0x560bb976f6a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4003c60 tx=0x7fb4a40058d0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.234+0000 7fb4c51ef740 1 -- 172.21.15.123:0/1868730146 shutdown_connections 2024-08-18T22:07:17.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.234+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/1868730146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9773810 0x560bb976d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.234+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/1868730146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768f50 0x560bb976f6a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.234+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/1868730146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9768630 0x560bb976ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.234+0000 7fb4c51ef740 1 -- 172.21.15.123:0/1868730146 >> 172.21.15.123:0/1868730146 conn(0x560bb9764bc0 msgr2=0x560bb976ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.234+0000 7fb4c51ef740 1 -- 172.21.15.123:0/1868730146 shutdown_connections 2024-08-18T22:07:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.234+0000 7fb4c51ef740 1 -- 172.21.15.123:0/1868730146 wait complete. 2024-08-18T22:07:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.234+0000 7fb4c51ef740 1 -- start start 2024-08-18T22:07:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.234+0000 7fb4c51ef740 1 Processor -- start 2024-08-18T22:07:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c51ef740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768630 0x560bb976d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c51ef740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9768f50 0x560bb976dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c51ef740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9773810 0x560bb976e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c51ef740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x560bb9785940 con 0x560bb9768630 2024-08-18T22:07:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c51ef740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560bb9785270 con 0x560bb9768f50 2024-08-18T22:07:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c51ef740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560bb9786010 con 0x560bb9773810 2024-08-18T22:07:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c51ef740 10 client.0 _ll_register_callbacks cb 0x7fb4a4009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c0b8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768630 0x560bb976d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c0b8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768630 0x560bb976d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56118/0 (socket says 172.21.15.123:56118) 2024-08-18T22:07:17.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c0b8d640 1 -- 172.21.15.123:0/2380318445 learned_addr learned my addr 172.21.15.123:0/2380318445 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c138e640 1 --2- 172.21.15.123:0/2380318445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9773810 0x560bb976e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4bbfff640 1 --2- 172.21.15.123:0/2380318445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9768f50 0x560bb976dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c0b8d640 1 -- 172.21.15.123:0/2380318445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9773810 msgr2=0x560bb976e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c0b8d640 1 --2- 172.21.15.123:0/2380318445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9773810 0x560bb976e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c0b8d640 1 -- 172.21.15.123:0/2380318445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9768f50 msgr2=0x560bb976dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c0b8d640 1 --2- 172.21.15.123:0/2380318445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9768f50 0x560bb976dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c0b8d640 1 -- 172.21.15.123:0/2380318445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bb978c270 con 0x560bb9768630 2024-08-18T22:07:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c138e640 1 --2- 172.21.15.123:0/2380318445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9773810 0x560bb976e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c0b8d640 1 --2- 172.21.15.123:0/2380318445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768630 0x560bb976d720 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac000c00 tx=0x7fb4ac011960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be31341e27e77c99 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb49bfff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb49bfff640 1 -- 172.21.15.123:0/2380318445 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac005220 con 0x560bb9768630 2024-08-18T22:07:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb49bfff640 1 -- 172.21.15.123:0/2380318445 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fb4ac0053c0 con 0x560bb9768630 2024-08-18T22:07:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.235+0000 7fb4c51ef740 1 -- 172.21.15.123:0/2380318445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4a4056070 con 0x560bb9768630 2024-08-18T22:07:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.236+0000 7fb49bfff640 1 -- 172.21.15.123:0/2380318445 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb4ac0055c0 con 0x560bb9768630 2024-08-18T22:07:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.236+0000 7fb4c51ef740 10 client.15084 fetch_fsmap learned FSMap version 25 2024-08-18T22:07:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.236+0000 7fb4c51ef740 1 -- 172.21.15.123:0/2380318445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560bb97ef010 con 0x560bb9768630 2024-08-18T22:07:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.236+0000 7fb49bfff640 1 -- 172.21.15.123:0/2380318445 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4a4056070 con 0x560bb9768630 2024-08-18T22:07:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.236+0000 7fb49bfff640 1 -- 172.21.15.123:0/2380318445 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb4ac025400 con 0x560bb9768630 2024-08-18T22:07:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.236+0000 7fb4c51ef740 10 client.15084 fetch_fsmap finished waiting for FSMap version 25 2024-08-18T22:07:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.236+0000 7fb4c51ef740 10 client.15084 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-18T22:07:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.236+0000 7fb4c51ef740 20 client.15084 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.236+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/2380318445 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x560bb97f3c70 0x560bb97f2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.236+0000 7fb4c51ef740 4 client.15084 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:07:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.236+0000 7fb4c51ef740 1 -- 172.21.15.123:0/2380318445 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "status"}) -- 0x560bb96d5190 con 0x560bb97f3c70 2024-08-18T22:07:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.236+0000 7fb4bbfff640 1 --2- 172.21.15.123:0/2380318445 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x560bb97f3c70 0x560bb97f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb4bbfff640 1 --2- 172.21.15.123:0/2380318445 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x560bb97f3c70 0x560bb97f2980 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8ac1487c83f9035c server_cookie=6ae1006888414d95 in_seq=0 out_seq=0 2024-08-18T22:07:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb49bfff640 10 client.15084 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:07:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb49bfff640 1 -- 172.21.15.123:0/2380318445 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560bb96d5190 con 0x560bb97f3c70 2024-08-18T22:07:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb49bfff640 10 client.15084 handle_command_reply: tid=0 2024-08-18T22:07:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb4c51ef740 1 client.15084 shutdown 2024-08-18T22:07:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb4c51ef740 1 -- 172.21.15.123:0/2380318445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768630 msgr2=0x560bb976d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/2380318445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768630 0x560bb976d720 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac000c00 tx=0x7fb4ac011960 comp rx=0 tx=0).stop 2024-08-18T22:07:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb4c51ef740 1 -- 172.21.15.123:0/2380318445 shutdown_connections 2024-08-18T22:07:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/2380318445 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x560bb97f3c70 0x560bb97f2980 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/2380318445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560bb9773810 0x560bb976e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/2380318445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560bb9768f50 0x560bb976dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb4c51ef740 1 --2- 172.21.15.123:0/2380318445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560bb9768630 0x560bb976d720 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb49bfff640 0 client.15084 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:07:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb4c51ef740 1 -- 172.21.15.123:0/2380318445 >> 172.21.15.123:0/2380318445 conn(0x560bb9764bc0 msgr2=0x560bb976f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb4c51ef740 1 -- 172.21.15.123:0/2380318445 shutdown_connections 2024-08-18T22:07:17.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb4c51ef740 1 -- 172.21.15.123:0/2380318445 wait complete. 2024-08-18T22:07:17.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.237+0000 7fb4c51ef740 20 client.15084 trim_cache size 0 max 16384 2024-08-18T22:07:17.246 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:07:17.246 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "dfa1db70-5dac-11ef-bccf-c7b262605968", 2024-08-18T22:07:17.246 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 1, 2024-08-18T22:07:17.246 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24458, 2024-08-18T22:07:17.246 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-08-18T22:07:17.246 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-08-18T22:07:17.247 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-08-18T22:07:17.247 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 80.799671603999997, 2024-08-18T22:07:17.247 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 25, 2024-08-18T22:07:17.247 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 92, 2024-08-18T22:07:17.247 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 88, 2024-08-18T22:07:17.247 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 125.58921685200001 2024-08-18T22:07:17.247 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:07:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.238+0000 7fb4c2df1640 1 -- 172.21.15.123:0/3637070332 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb4a80a2c00 msgr2=0x7fb4a80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.238+0000 7fb4c2df1640 1 --2- 172.21.15.123:0/3637070332 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb4a80a2c00 0x7fb4a80a50c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4005940 tx=0x7fb4a4000bc0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.238+0000 7fb4c2df1640 1 -- 172.21.15.123:0/3637070332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4bc107fd0 msgr2=0x7fb4bc19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.238+0000 7fb4c2df1640 1 --2- 172.21.15.123:0/3637070332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4bc107fd0 0x7fb4bc19cc70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400eaa0 tx=0x7fb4b400ef60 comp rx=0 tx=0).stop 2024-08-18T22:07:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.238+0000 7fb4c2df1640 1 -- 172.21.15.123:0/3637070332 shutdown_connections 2024-08-18T22:07:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.238+0000 7fb4c2df1640 1 --2- 172.21.15.123:0/3637070332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4bc107fd0 0x7fb4bc19cc70 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.238+0000 7fb4c2df1640 1 --2- 172.21.15.123:0/3637070332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4bc103410 0x7fb4bc1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.238+0000 7fb4c2df1640 1 --2- 172.21.15.123:0/3637070332 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb4a80a2c00 0x7fb4a80a50c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.238+0000 7fb4c2df1640 1 --2- 172.21.15.123:0/3637070332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4bc102a60 0x7fb4bc1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.238+0000 7fb4c2df1640 1 -- 172.21.15.123:0/3637070332 >> 172.21.15.123:0/3637070332 conn(0x7fb4bc0fc500 msgr2=0x7fb4bc1060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:17.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.238+0000 7fb4c2df1640 1 -- 172.21.15.123:0/3637070332 shutdown_connections 2024-08-18T22:07:17.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:17.238+0000 7fb4c2df1640 1 -- 172.21.15.123:0/3637070332 wait complete. 2024-08-18T22:07:18.109 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.i status 2024-08-18T22:07:18.360 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:18.717 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:18 smithi130 ceph-mon[21698]: pgmap v326: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 895 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:18.718 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:18 smithi123 ceph-mon[18462]: pgmap v326: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 895 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:18.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.797+0000 7f649d40b640 1 -- 172.21.15.123:0/3763227116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6498100b50 msgr2=0x7f6498100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:18.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.797+0000 7f649d40b640 1 --2- 172.21.15.123:0/3763227116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6498100b50 0x7f6498100f30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6488009900 tx=0x7f648802a480 comp rx=0 tx=0).stop 2024-08-18T22:07:18.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.797+0000 7f649d40b640 1 -- 172.21.15.123:0/3763227116 shutdown_connections 2024-08-18T22:07:18.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.797+0000 7f649d40b640 1 --2- 172.21.15.123:0/3763227116 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6498102c20 0x7f649810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.797+0000 7f649d40b640 1 --2- 172.21.15.123:0/3763227116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64981022a0 0x7f64981026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.797+0000 7f649d40b640 1 --2- 172.21.15.123:0/3763227116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6498100b50 0x7f6498100f30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.797+0000 7f649d40b640 1 -- 172.21.15.123:0/3763227116 >> 172.21.15.123:0/3763227116 conn(0x7f64980fc500 msgr2=0x7f64980fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:18.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.797+0000 7f649d40b640 1 -- 172.21.15.123:0/3763227116 shutdown_connections 2024-08-18T22:07:18.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.797+0000 7f649d40b640 1 -- 172.21.15.123:0/3763227116 wait complete. 2024-08-18T22:07:18.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f649d40b640 1 Processor -- start 2024-08-18T22:07:18.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f649d40b640 1 -- start start 2024-08-18T22:07:18.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f649d40b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6498100b50 0x7f6498198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f649d40b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64981022a0 0x7f6498198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f649d40b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6498102c20 0x7f649819cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f649d40b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6498110cb0 con 0x7f6498100b50 2024-08-18T22:07:18.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f649d40b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6498110b30 con 0x7f6498102c20 2024-08-18T22:07:18.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f649d40b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6498110e30 con 0x7f64981022a0 2024-08-18T22:07:18.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f6496ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6498100b50 0x7f6498198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f6496ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6498100b50 0x7f6498198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56144/0 (socket says 172.21.15.123:56144) 2024-08-18T22:07:18.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f6496ffd640 1 -- 172.21.15.123:0/4176069177 learned_addr learned my addr 172.21.15.123:0/4176069177 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:18.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f64977fe640 1 --2- 172.21.15.123:0/4176069177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6498102c20 0x7f649819cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f648e7fc640 1 --2- 172.21.15.123:0/4176069177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64981022a0 0x7f6498198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f6496ffd640 1 -- 172.21.15.123:0/4176069177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64981022a0 msgr2=0x7f6498198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:18.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f6496ffd640 1 --2- 172.21.15.123:0/4176069177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64981022a0 0x7f6498198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f6496ffd640 1 -- 172.21.15.123:0/4176069177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6498102c20 msgr2=0x7f649819cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:18.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f6496ffd640 1 --2- 172.21.15.123:0/4176069177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6498102c20 0x7f649819cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f6496ffd640 1 -- 172.21.15.123:0/4176069177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649819d1e0 con 0x7f6498100b50 2024-08-18T22:07:18.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.798+0000 7f64977fe640 1 --2- 172.21.15.123:0/4176069177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6498102c20 0x7f649819cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:18.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.799+0000 7f6496ffd640 1 --2- 172.21.15.123:0/4176069177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6498100b50 0x7f6498198230 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6488006010 tx=0x7f6488003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:18.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.799+0000 7f6494ff9640 1 -- 172.21.15.123:0/4176069177 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648803f070 con 0x7f6498100b50 2024-08-18T22:07:18.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.799+0000 7f6494ff9640 1 -- 172.21.15.123:0/4176069177 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6488031c30 con 0x7f6498100b50 2024-08-18T22:07:18.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.799+0000 7f649d40b640 1 -- 172.21.15.123:0/4176069177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649819d470 con 0x7f6498100b50 2024-08-18T22:07:18.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.799+0000 7f6494ff9640 1 -- 172.21.15.123:0/4176069177 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6488035030 con 0x7f6498100b50 2024-08-18T22:07:18.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.799+0000 7f649d40b640 1 -- 172.21.15.123:0/4176069177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64981a4db0 con 0x7f6498100b50 2024-08-18T22:07:18.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.801+0000 7f6494ff9640 1 -- 172.21.15.123:0/4176069177 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f6488042070 con 0x7f6498100b50 2024-08-18T22:07:18.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.801+0000 7f649f809740 1 Processor -- start 2024-08-18T22:07:18.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.801+0000 7f649f809740 1 -- start start 2024-08-18T22:07:18.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f6494ff9640 1 --2- 172.21.15.123:0/4176069177 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f64840a2b80 0x7f64840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f649f809740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ac3510 0x55bcb5ac38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f649f809740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3e30 0x55bcb5ad26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f649f809740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ad2c20 0x55bcb5ad5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f649f809740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bcb5a28710 con 0x55bcb5ac3e30 2024-08-18T22:07:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f649f809740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bcb59c0770 con 0x55bcb5ad2c20 2024-08-18T22:07:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f649f809740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bcb5a246d0 con 0x55bcb5ac3510 2024-08-18T22:07:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f648e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3e30 0x55bcb5ad26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f64977fe640 1 --2- 172.21.15.123:0/4176069177 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f64840a2b80 0x7f64840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f648e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3e30 0x55bcb5ad26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56154/0 (socket says 172.21.15.123:56154) 2024-08-18T22:07:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f648e7fc640 1 -- 172.21.15.123:0/2007300797 learned_addr learned my addr 172.21.15.123:0/2007300797 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f6494ff9640 1 -- 172.21.15.123:0/4176069177 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f64880efce0 con 0x7f6498100b50 2024-08-18T22:07:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f6496ffd640 1 --2- 172.21.15.123:0/2007300797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ac3510 0x55bcb5ac38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f64977fe640 1 --2- 172.21.15.123:0/2007300797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ad2c20 0x55bcb5ad5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f648e7fc640 1 -- 172.21.15.123:0/2007300797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ac3510 msgr2=0x55bcb5ac38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:18.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f648e7fc640 1 --2- 172.21.15.123:0/2007300797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ac3510 0x55bcb5ac38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f648e7fc640 1 -- 172.21.15.123:0/2007300797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ad2c20 msgr2=0x55bcb5ad5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f648e7fc640 1 --2- 172.21.15.123:0/2007300797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ad2c20 0x55bcb5ad5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.802+0000 7f648e7fc640 1 -- 172.21.15.123:0/2007300797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcb59c73e0 con 0x55bcb5ac3e30 2024-08-18T22:07:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.803+0000 7f64977fe640 1 --2- 172.21.15.123:0/4176069177 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f64840a2b80 0x7f64840a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6490005fd0 tx=0x7f6490014b70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.803+0000 7f648e7fc640 1 --2- 172.21.15.123:0/2007300797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3e30 0x55bcb5ad26e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f648000bc80 tx=0x7f648000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c224484eb427a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.803+0000 7f648d7fa640 1 -- 172.21.15.123:0/2007300797 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480015070 con 0x55bcb5ac3e30 2024-08-18T22:07:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.803+0000 7f648d7fa640 1 -- 172.21.15.123:0/2007300797 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6480011920 con 0x55bcb5ac3e30 2024-08-18T22:07:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.803+0000 7f648d7fa640 1 -- 172.21.15.123:0/2007300797 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64800107f0 con 0x55bcb5ac3e30 2024-08-18T22:07:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.803+0000 7f649f809740 1 -- 172.21.15.123:0/2007300797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3e30 msgr2=0x55bcb5ad26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.803+0000 7f649f809740 1 --2- 172.21.15.123:0/2007300797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3e30 0x55bcb5ad26e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f648000bc80 tx=0x7f648000f730 comp rx=0 tx=0).stop 2024-08-18T22:07:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 1 -- 172.21.15.123:0/2007300797 shutdown_connections 2024-08-18T22:07:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 1 --2- 172.21.15.123:0/2007300797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ad2c20 0x55bcb5ad5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 1 --2- 172.21.15.123:0/2007300797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3e30 0x55bcb5ad26e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 1 --2- 172.21.15.123:0/2007300797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ac3510 0x55bcb5ac38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 1 -- 172.21.15.123:0/2007300797 >> 172.21.15.123:0/2007300797 conn(0x55bcb5abfbc0 msgr2=0x55bcb5abffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:18.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 1 -- 172.21.15.123:0/2007300797 shutdown_connections 2024-08-18T22:07:18.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 1 -- 172.21.15.123:0/2007300797 wait complete. 2024-08-18T22:07:18.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 1 -- start start 2024-08-18T22:07:18.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 1 Processor -- start 2024-08-18T22:07:18.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3510 0x55bcb5acfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ac3e30 0x55bcb5ad00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ad2c20 0x55bcb5ad05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bcb5ad57f0 con 0x55bcb5ad2c20 2024-08-18T22:07:18.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bcb59e3970 con 0x55bcb5ac3510 2024-08-18T22:07:18.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bcb5ad5970 con 0x55bcb5ac3e30 2024-08-18T22:07:18.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f649f809740 10 client.0 _ll_register_callbacks cb 0x55bcb57377b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:18.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f64977fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ad2c20 0x55bcb5ad05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f64977fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ad2c20 0x55bcb5ad05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56170/0 (socket says 172.21.15.123:56170) 2024-08-18T22:07:18.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f64977fe640 1 -- 172.21.15.123:0/2068611936 learned_addr learned my addr 172.21.15.123:0/2068611936 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:18.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.804+0000 7f6496ffd640 1 --2- 172.21.15.123:0/2068611936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3510 0x55bcb5acfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f648e7fc640 1 --2- 172.21.15.123:0/2068611936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ac3e30 0x55bcb5ad00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f64977fe640 1 -- 172.21.15.123:0/2068611936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ac3e30 msgr2=0x55bcb5ad00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:18.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f64977fe640 1 --2- 172.21.15.123:0/2068611936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ac3e30 0x55bcb5ad00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f64977fe640 1 -- 172.21.15.123:0/2068611936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3510 msgr2=0x55bcb5acfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:18.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f64977fe640 1 --2- 172.21.15.123:0/2068611936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3510 0x55bcb5acfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f64977fe640 1 -- 172.21.15.123:0/2068611936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcb579a2b0 con 0x55bcb5ad2c20 2024-08-18T22:07:18.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f6496ffd640 1 --2- 172.21.15.123:0/2068611936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3510 0x55bcb5acfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:18.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f64977fe640 1 --2- 172.21.15.123:0/2068611936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ad2c20 0x55bcb5ad05f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6490012f40 tx=0x7f649001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c6edc56d308865 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:18.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f647e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:18.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f647e7fc640 1 -- 172.21.15.123:0/2068611936 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490026070 con 0x55bcb5ad2c20 2024-08-18T22:07:18.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f647e7fc640 1 -- 172.21.15.123:0/2068611936 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f6490020820 con 0x55bcb5ad2c20 2024-08-18T22:07:18.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f649f809740 1 -- 172.21.15.123:0/2068611936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6480011920 con 0x55bcb5ad2c20 2024-08-18T22:07:18.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f647e7fc640 1 -- 172.21.15.123:0/2068611936 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6490032050 con 0x55bcb5ad2c20 2024-08-18T22:07:18.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f649f809740 10 client.15096 fetch_fsmap learned FSMap version 25 2024-08-18T22:07:18.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f649f809740 1 -- 172.21.15.123:0/2068611936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bcb5ae1490 con 0x55bcb5ad2c20 2024-08-18T22:07:18.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f647e7fc640 1 -- 172.21.15.123:0/2068611936 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6480011920 con 0x55bcb5ad2c20 2024-08-18T22:07:18.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f647e7fc640 1 -- 172.21.15.123:0/2068611936 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f649001f9e0 con 0x55bcb5ad2c20 2024-08-18T22:07:18.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f649f809740 10 client.15096 fetch_fsmap finished waiting for FSMap version 25 2024-08-18T22:07:18.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f649f809740 10 client.15096 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-18T22:07:18.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f649f809740 20 client.15096 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:18.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f649f809740 1 --2- 172.21.15.123:0/2068611936 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bcb5ae3b80 0x55bcb5ae4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f649f809740 4 client.15096 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:07:18.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.805+0000 7f649f809740 1 -- 172.21.15.123:0/2068611936 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcb5a35c80 con 0x55bcb5ae3b80 2024-08-18T22:07:18.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.806+0000 7f6496ffd640 1 --2- 172.21.15.123:0/2068611936 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bcb5ae3b80 0x55bcb5ae4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.806+0000 7f647e7fc640 10 client.15096 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:18.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.806+0000 7f6496ffd640 1 --2- 172.21.15.123:0/2068611936 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bcb5ae3b80 0x55bcb5ae4ff0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69ee774525f87dd9 server_cookie=f1cf45e9f6b4bdd0 in_seq=0 out_seq=0 2024-08-18T22:07:18.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.807+0000 7f647e7fc640 1 -- 172.21.15.123:0/2068611936 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bcb5a35c80 con 0x55bcb5ae3b80 2024-08-18T22:07:18.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.807+0000 7f647e7fc640 10 client.15096 handle_command_reply: tid=0 2024-08-18T22:07:18.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.807+0000 7f649f809740 1 client.15096 shutdown 2024-08-18T22:07:18.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.807+0000 7f649f809740 1 -- 172.21.15.123:0/2068611936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ad2c20 msgr2=0x55bcb5ad05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:18.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.807+0000 7f649f809740 1 --2- 172.21.15.123:0/2068611936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ad2c20 0x55bcb5ad05f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6490012f40 tx=0x7f649001a000 comp rx=0 tx=0).stop 2024-08-18T22:07:18.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.807+0000 7f649f809740 1 -- 172.21.15.123:0/2068611936 shutdown_connections 2024-08-18T22:07:18.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.807+0000 7f649f809740 1 --2- 172.21.15.123:0/2068611936 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bcb5ae3b80 0x55bcb5ae4ff0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.807+0000 7f649f809740 1 --2- 172.21.15.123:0/2068611936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ad2c20 0x55bcb5ad05f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.807+0000 7f647e7fc640 0 client.15096 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:18.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.807+0000 7f649f809740 1 --2- 172.21.15.123:0/2068611936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ac3e30 0x55bcb5ad00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.807+0000 7f649f809740 1 --2- 172.21.15.123:0/2068611936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3510 0x55bcb5acfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.807+0000 7f649f809740 1 -- 172.21.15.123:0/2068611936 >> 172.21.15.123:0/2068611936 conn(0x55bcb5abfbc0 msgr2=0x55bcb5ac5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:18.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.807+0000 7f649f809740 1 -- 172.21.15.123:0/2068611936 shutdown_connections 2024-08-18T22:07:18.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.807+0000 7f649f809740 1 -- 172.21.15.123:0/2068611936 wait complete. 2024-08-18T22:07:18.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.807+0000 7f649f809740 20 client.15096 trim_cache size 0 max 16384 2024-08-18T22:07:18.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.825+0000 7f649f809740 1 Processor -- start 2024-08-18T22:07:18.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.825+0000 7f649f809740 1 -- start start 2024-08-18T22:07:18.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.825+0000 7f649f809740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3510 0x55bcb5ad22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.825+0000 7f649f809740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3e30 0x55bcb5acaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.825+0000 7f649f809740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ad2c20 0x55bcb5accdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.825+0000 7f649f809740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bcb5ae3330 con 0x55bcb5ac3510 2024-08-18T22:07:18.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.825+0000 7f649f809740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bcb5ae3a00 con 0x55bcb5ac3e30 2024-08-18T22:07:18.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.825+0000 7f649f809740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bcb5ae40d0 con 0x55bcb5ad2c20 2024-08-18T22:07:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.825+0000 7f6496ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3510 0x55bcb5ad22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.825+0000 7f6496ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3510 0x55bcb5ad22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56184/0 (socket says 172.21.15.123:56184) 2024-08-18T22:07:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.825+0000 7f6496ffd640 1 -- 172.21.15.123:0/4051358498 learned_addr learned my addr 172.21.15.123:0/4051358498 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.825+0000 7f648e7fc640 1 --2- 172.21.15.123:0/4051358498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3e30 0x55bcb5acaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.825+0000 7f64977fe640 1 --2- 172.21.15.123:0/4051358498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ad2c20 0x55bcb5accdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.826+0000 7f64977fe640 1 -- 172.21.15.123:0/4051358498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3e30 msgr2=0x55bcb5acaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.826+0000 7f64977fe640 1 --2- 172.21.15.123:0/4051358498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3e30 0x55bcb5acaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.826+0000 7f64977fe640 1 -- 172.21.15.123:0/4051358498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3510 msgr2=0x55bcb5ad22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.826+0000 7f64977fe640 1 --2- 172.21.15.123:0/4051358498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3510 0x55bcb5ad22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.826+0000 7f64977fe640 1 -- 172.21.15.123:0/4051358498 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcb5abf660 con 0x55bcb5ad2c20 2024-08-18T22:07:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.826+0000 7f648e7fc640 1 --2- 172.21.15.123:0/4051358498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3e30 0x55bcb5acaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:07:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.826+0000 7f64977fe640 1 --2- 172.21.15.123:0/4051358498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ad2c20 0x55bcb5accdf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f649001fdb0 tx=0x7f6490010e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac268f737e95b25 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.826+0000 7f648cff9640 1 -- 172.21.15.123:0/4051358498 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490026050 con 0x55bcb5ad2c20 2024-08-18T22:07:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.826+0000 7f648cff9640 1 -- 172.21.15.123:0/4051358498 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6490042070 con 0x55bcb5ad2c20 2024-08-18T22:07:18.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.826+0000 7f648cff9640 1 -- 172.21.15.123:0/4051358498 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649001ffa0 con 0x55bcb5ad2c20 2024-08-18T22:07:18.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.827+0000 7f649f809740 1 -- 172.21.15.123:0/4051358498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ad2c20 msgr2=0x55bcb5accdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:18.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.827+0000 7f649f809740 1 --2- 172.21.15.123:0/4051358498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ad2c20 0x55bcb5accdf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f649001fdb0 tx=0x7f6490010e50 comp rx=0 tx=0).stop 2024-08-18T22:07:18.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.827+0000 7f649f809740 1 -- 172.21.15.123:0/4051358498 shutdown_connections 2024-08-18T22:07:18.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.827+0000 7f649f809740 1 --2- 172.21.15.123:0/4051358498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ad2c20 0x55bcb5accdf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.827+0000 7f649f809740 1 --2- 172.21.15.123:0/4051358498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3e30 0x55bcb5acaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.827+0000 7f649f809740 1 --2- 172.21.15.123:0/4051358498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3510 0x55bcb5ad22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.827+0000 7f649f809740 1 -- 172.21.15.123:0/4051358498 >> 172.21.15.123:0/4051358498 conn(0x55bcb5abfbc0 msgr2=0x55bcb5ace440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:18.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.827+0000 7f649f809740 1 -- 172.21.15.123:0/4051358498 shutdown_connections 2024-08-18T22:07:18.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.827+0000 7f649f809740 1 -- 172.21.15.123:0/4051358498 wait complete. 2024-08-18T22:07:18.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.827+0000 7f649f809740 1 -- start start 2024-08-18T22:07:18.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f649f809740 1 Processor -- start 2024-08-18T22:07:18.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f649f809740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3510 0x55bcb5ac9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f649f809740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3e30 0x55bcb5aed240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f649f809740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ad2c20 0x55bcb5aed780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f649f809740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bcb5ae4e70 con 0x55bcb5ac3510 2024-08-18T22:07:18.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f649f809740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bcb5ae47a0 con 0x55bcb5ac3e30 2024-08-18T22:07:18.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f649f809740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bcb5ae5540 con 0x55bcb5ad2c20 2024-08-18T22:07:18.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f649f809740 10 client.0 _ll_register_callbacks cb 0x7f6490009d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:18.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f6496ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3510 0x55bcb5ac9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f6496ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3510 0x55bcb5ac9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56188/0 (socket says 172.21.15.123:56188) 2024-08-18T22:07:18.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f6496ffd640 1 -- 172.21.15.123:0/1926759556 learned_addr learned my addr 172.21.15.123:0/1926759556 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:18.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f64977fe640 1 --2- 172.21.15.123:0/1926759556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ad2c20 0x55bcb5aed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f648e7fc640 1 --2- 172.21.15.123:0/1926759556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3e30 0x55bcb5aed240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f6496ffd640 1 -- 172.21.15.123:0/1926759556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ad2c20 msgr2=0x55bcb5aed780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f6496ffd640 1 --2- 172.21.15.123:0/1926759556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ad2c20 0x55bcb5aed780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f6496ffd640 1 -- 172.21.15.123:0/1926759556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3e30 msgr2=0x55bcb5aed240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f6496ffd640 1 --2- 172.21.15.123:0/1926759556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3e30 0x55bcb5aed240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f6496ffd640 1 -- 172.21.15.123:0/1926759556 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcb5abb130 con 0x55bcb5ac3510 2024-08-18T22:07:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f6496ffd640 1 --2- 172.21.15.123:0/1926759556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3510 0x55bcb5ac9ca0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f64880ed4a0 tx=0x7f64880bc970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ae435ea6db38de server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.828+0000 7f647e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.829+0000 7f647e7fc640 1 -- 172.21.15.123:0/1926759556 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6488049040 con 0x55bcb5ac3510 2024-08-18T22:07:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.829+0000 7f647e7fc640 1 -- 172.21.15.123:0/1926759556 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f64880ba250 con 0x55bcb5ac3510 2024-08-18T22:07:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.829+0000 7f649f809740 1 -- 172.21.15.123:0/1926759556 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6490042070 con 0x55bcb5ac3510 2024-08-18T22:07:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.829+0000 7f647e7fc640 1 -- 172.21.15.123:0/1926759556 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f64880c28d0 con 0x55bcb5ac3510 2024-08-18T22:07:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.829+0000 7f649f809740 10 client.15102 fetch_fsmap learned FSMap version 25 2024-08-18T22:07:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.829+0000 7f649f809740 1 -- 172.21.15.123:0/1926759556 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bcb5acd730 con 0x55bcb5ac3510 2024-08-18T22:07:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.829+0000 7f647e7fc640 1 -- 172.21.15.123:0/1926759556 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6490042070 con 0x55bcb5ac3510 2024-08-18T22:07:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.829+0000 7f647e7fc640 1 -- 172.21.15.123:0/1926759556 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f64880b8820 con 0x55bcb5ac3510 2024-08-18T22:07:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.829+0000 7f649f809740 10 client.15102 fetch_fsmap finished waiting for FSMap version 25 2024-08-18T22:07:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.829+0000 7f649f809740 10 client.15102 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-18T22:07:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.829+0000 7f649f809740 20 client.15102 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.829+0000 7f649f809740 1 --2- 172.21.15.123:0/1926759556 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bcb5ae3b80 0x55bcb5b4d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.829+0000 7f649f809740 4 client.15102 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:07:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.829+0000 7f649f809740 1 -- 172.21.15.123:0/1926759556 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "status"}) -- 0x55bcb5a30190 con 0x55bcb5ae3b80 2024-08-18T22:07:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.829+0000 7f648e7fc640 1 --2- 172.21.15.123:0/1926759556 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bcb5ae3b80 0x55bcb5b4d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f648e7fc640 1 --2- 172.21.15.123:0/1926759556 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bcb5ae3b80 0x55bcb5b4d750 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b828625ee605d68d server_cookie=c09a23508ca3bcd2 in_seq=0 out_seq=0 2024-08-18T22:07:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f647e7fc640 10 client.15102 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f647e7fc640 1 -- 172.21.15.123:0/1926759556 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55bcb5a30190 con 0x55bcb5ae3b80 2024-08-18T22:07:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f647e7fc640 10 client.15102 handle_command_reply: tid=0 2024-08-18T22:07:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f649f809740 1 client.15102 shutdown 2024-08-18T22:07:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f649f809740 1 -- 172.21.15.123:0/1926759556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3510 msgr2=0x55bcb5ac9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f649f809740 1 --2- 172.21.15.123:0/1926759556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3510 0x55bcb5ac9ca0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f64880ed4a0 tx=0x7f64880bc970 comp rx=0 tx=0).stop 2024-08-18T22:07:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f649f809740 1 -- 172.21.15.123:0/1926759556 shutdown_connections 2024-08-18T22:07:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f649f809740 1 --2- 172.21.15.123:0/1926759556 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bcb5ae3b80 0x55bcb5b4d750 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f649f809740 1 --2- 172.21.15.123:0/1926759556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcb5ad2c20 0x55bcb5aed780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f649f809740 1 --2- 172.21.15.123:0/1926759556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bcb5ac3e30 0x55bcb5aed240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f649f809740 1 --2- 172.21.15.123:0/1926759556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bcb5ac3510 0x55bcb5ac9ca0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f649f809740 1 -- 172.21.15.123:0/1926759556 >> 172.21.15.123:0/1926759556 conn(0x55bcb5abfbc0 msgr2=0x55bcb5addc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f647e7fc640 0 client.15102 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f649f809740 1 -- 172.21.15.123:0/1926759556 shutdown_connections 2024-08-18T22:07:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.830+0000 7f649f809740 1 -- 172.21.15.123:0/1926759556 wait complete. 2024-08-18T22:07:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.831+0000 7f649f809740 20 client.15102 trim_cache size 0 max 16384 2024-08-18T22:07:18.848 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:07:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "dfa1db70-5dac-11ef-bccf-c7b262605968", 2024-08-18T22:07:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-08-18T22:07:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24466, 2024-08-18T22:07:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-08-18T22:07:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-08-18T22:07:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-08-18T22:07:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 115.969473741, 2024-08-18T22:07:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 25, 2024-08-18T22:07:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 92, 2024-08-18T22:07:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 88, 2024-08-18T22:07:18.849 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 136.193141234 2024-08-18T22:07:18.849 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:07:18.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.831+0000 7f649d40b640 1 -- 172.21.15.123:0/4176069177 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f64840a2b80 msgr2=0x7f64840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:18.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.831+0000 7f649d40b640 1 --2- 172.21.15.123:0/4176069177 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f64840a2b80 0x7f64840a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6490005fd0 tx=0x7f6490014b70 comp rx=0 tx=0).stop 2024-08-18T22:07:18.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.831+0000 7f649d40b640 1 -- 172.21.15.123:0/4176069177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6498100b50 msgr2=0x7f6498198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:18.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.831+0000 7f649d40b640 1 --2- 172.21.15.123:0/4176069177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6498100b50 0x7f6498198230 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6488006010 tx=0x7f6488003c10 comp rx=0 tx=0).stop 2024-08-18T22:07:18.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.831+0000 7f649d40b640 1 -- 172.21.15.123:0/4176069177 shutdown_connections 2024-08-18T22:07:18.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.831+0000 7f649d40b640 1 --2- 172.21.15.123:0/4176069177 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f64840a2b80 0x7f64840a5040 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.831+0000 7f649d40b640 1 --2- 172.21.15.123:0/4176069177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6498102c20 0x7f649819cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.831+0000 7f649d40b640 1 --2- 172.21.15.123:0/4176069177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64981022a0 0x7f6498198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.831+0000 7f649d40b640 1 --2- 172.21.15.123:0/4176069177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6498100b50 0x7f6498198230 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:18.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.831+0000 7f649d40b640 1 -- 172.21.15.123:0/4176069177 >> 172.21.15.123:0/4176069177 conn(0x7f64980fc500 msgr2=0x7f6498105bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:18.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.831+0000 7f649d40b640 1 -- 172.21.15.123:0/4176069177 shutdown_connections 2024-08-18T22:07:18.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:18.831+0000 7f649d40b640 1 -- 172.21.15.123:0/4176069177 wait complete. 2024-08-18T22:07:18.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:18 smithi183 ceph-mon[22097]: pgmap v326: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 895 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:19.501 INFO:tasks.cephadm:Setup complete, yielding 2024-08-18T22:07:19.501 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-18T22:07:19.515 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi123.front.sepia.ceph.com 2024-08-18T22:07:19.515 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- bash -c 'ceph orch status' 2024-08-18T22:07:19.763 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:20.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.222+0000 7f8e079f3640 1 -- 172.21.15.123:0/1878173932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e001034f0 msgr2=0x7f8e00109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:20.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.222+0000 7f8e079f3640 1 --2- 172.21.15.123:0/1878173932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e001034f0 0x7f8e00109d80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009ca0 tx=0x7f8df802a8c0 comp rx=0 tx=0).stop 2024-08-18T22:07:20.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.222+0000 7f8e079f3640 1 -- 172.21.15.123:0/1878173932 shutdown_connections 2024-08-18T22:07:20.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.222+0000 7f8e079f3640 1 --2- 172.21.15.123:0/1878173932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e001034f0 0x7f8e00109d80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:20.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.222+0000 7f8e079f3640 1 --2- 172.21.15.123:0/1878173932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e00102b30 0x7f8e00102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.222+0000 7f8e079f3640 1 --2- 172.21.15.123:0/1878173932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e00101930 0x7f8e00101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.222+0000 7f8e079f3640 1 -- 172.21.15.123:0/1878173932 >> 172.21.15.123:0/1878173932 conn(0x7f8e000fd0c0 msgr2=0x7f8e000ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.222+0000 7f8e079f3640 1 -- 172.21.15.123:0/1878173932 shutdown_connections 2024-08-18T22:07:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.222+0000 7f8e079f3640 1 -- 172.21.15.123:0/1878173932 wait complete. 2024-08-18T22:07:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.222+0000 7f8e079f3640 1 Processor -- start 2024-08-18T22:07:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.222+0000 7f8e079f3640 1 -- start start 2024-08-18T22:07:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e079f3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e00101930 0x7f8e00197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e079f3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e00102b30 0x7f8e00198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e079f3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e001034f0 0x7f8e0019f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e079f3640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0010d590 con 0x7f8e001034f0 2024-08-18T22:07:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e079f3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0010d410 con 0x7f8e00101930 2024-08-18T22:07:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e079f3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0010d710 con 0x7f8e00102b30 2024-08-18T22:07:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e05f90640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e001034f0 0x7f8e0019f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e05f90640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e001034f0 0x7f8e0019f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56210/0 (socket says 172.21.15.123:56210) 2024-08-18T22:07:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e05f90640 1 -- 172.21.15.123:0/3780336728 learned_addr learned my addr 172.21.15.123:0/3780336728 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e04f8e640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e00102b30 0x7f8e00198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e0578f640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e00101930 0x7f8e00197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e05f90640 1 -- 172.21.15.123:0/3780336728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e00102b30 msgr2=0x7f8e00198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e05f90640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e00102b30 0x7f8e00198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e05f90640 1 -- 172.21.15.123:0/3780336728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e00101930 msgr2=0x7f8e00197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e05f90640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e00101930 0x7f8e00197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e05f90640 1 -- 172.21.15.123:0/3780336728 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0019f730 con 0x7f8e001034f0 2024-08-18T22:07:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e0578f640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e00101930 0x7f8e00197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e04f8e640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e00102b30 0x7f8e00198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e05f90640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e001034f0 0x7f8e0019f0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8df8005e30 tx=0x7f8df8031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8df67fc640 1 -- 172.21.15.123:0/3780336728 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8003c30 con 0x7f8e001034f0 2024-08-18T22:07:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8df67fc640 1 -- 172.21.15.123:0/3780336728 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8df8003dd0 con 0x7f8e001034f0 2024-08-18T22:07:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e079f3640 1 -- 172.21.15.123:0/3780336728 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e0019f9c0 con 0x7f8e001034f0 2024-08-18T22:07:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8df67fc640 1 -- 172.21.15.123:0/3780336728 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df802fde0 con 0x7f8e001034f0 2024-08-18T22:07:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.223+0000 7f8e079f3640 1 -- 172.21.15.123:0/3780336728 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e0019ff00 con 0x7f8e001034f0 2024-08-18T22:07:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.224+0000 7f8e079f3640 1 -- 172.21.15.123:0/3780336728 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e00108c60 con 0x7f8e001034f0 2024-08-18T22:07:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.225+0000 7f8df67fc640 1 -- 172.21.15.123:0/3780336728 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f8df8004050 con 0x7f8e001034f0 2024-08-18T22:07:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.226+0000 7f8df67fc640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8dec0a2bb0 0x7f8dec0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.226+0000 7f8e0578f640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8dec0a2bb0 0x7f8dec0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.227+0000 7f8df67fc640 1 -- 172.21.15.123:0/3780336728 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8df80f09d0 con 0x7f8e001034f0 2024-08-18T22:07:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.227+0000 7f8e0578f640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8dec0a2bb0 0x7f8dec0a5070 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8e00102990 tx=0x7f8dfc00a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.230+0000 7f8df67fc640 1 -- 172.21.15.123:0/3780336728 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f8df80bd540 con 0x7f8e001034f0 2024-08-18T22:07:20.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.414+0000 7f8e079f3640 1 -- 172.21.15.123:0/3780336728 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f8e00062360 con 0x7f8dec0a2bb0 2024-08-18T22:07:20.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.415+0000 7f8df67fc640 1 -- 172.21.15.123:0/3780336728 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f8e00062360 con 0x7f8dec0a2bb0 2024-08-18T22:07:20.416 INFO:teuthology.orchestra.run.smithi123.stdout:Backend: cephadm 2024-08-18T22:07:20.416 INFO:teuthology.orchestra.run.smithi123.stdout:Available: Yes 2024-08-18T22:07:20.416 INFO:teuthology.orchestra.run.smithi123.stdout:Paused: No 2024-08-18T22:07:20.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.417+0000 7f8e079f3640 1 -- 172.21.15.123:0/3780336728 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8dec0a2bb0 msgr2=0x7f8dec0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:20.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.417+0000 7f8e079f3640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8dec0a2bb0 0x7f8dec0a5070 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8e00102990 tx=0x7f8dfc00a5e0 comp rx=0 tx=0).stop 2024-08-18T22:07:20.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.417+0000 7f8e079f3640 1 -- 172.21.15.123:0/3780336728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e001034f0 msgr2=0x7f8e0019f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:20.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.417+0000 7f8e079f3640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e001034f0 0x7f8e0019f0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8df8005e30 tx=0x7f8df8031ee0 comp rx=0 tx=0).stop 2024-08-18T22:07:20.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.417+0000 7f8e079f3640 1 -- 172.21.15.123:0/3780336728 shutdown_connections 2024-08-18T22:07:20.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.418+0000 7f8e079f3640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e001034f0 0x7f8e0019f0c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:20.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.418+0000 7f8e079f3640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e00102b30 0x7f8e00198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:20.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.418+0000 7f8e079f3640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8dec0a2bb0 0x7f8dec0a5070 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:20.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.418+0000 7f8e079f3640 1 --2- 172.21.15.123:0/3780336728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e00101930 0x7f8e00197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:20.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.418+0000 7f8e079f3640 1 -- 172.21.15.123:0/3780336728 >> 172.21.15.123:0/3780336728 conn(0x7f8e000fd0c0 msgr2=0x7f8e00105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:20.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.418+0000 7f8e079f3640 1 -- 172.21.15.123:0/3780336728 shutdown_connections 2024-08-18T22:07:20.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:20.418+0000 7f8e079f3640 1 -- 172.21.15.123:0/3780336728 wait complete. 2024-08-18T22:07:20.711 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:20 smithi183 ceph-mon[22097]: pgmap v327: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 694 B/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:20.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:20 smithi123 ceph-mon[18462]: pgmap v327: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 694 B/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:20 smithi130 ceph-mon[21698]: pgmap v327: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 694 B/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:21.142 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-18T22:07:21.389 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:21.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:21 smithi123 ceph-mon[18462]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:07:21.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:21 smithi130 ceph-mon[21698]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:07:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.877+0000 7fc0dc5dc640 1 -- 172.21.15.123:0/1870643286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d4107690 msgr2=0x7fc0d4109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.877+0000 7fc0dc5dc640 1 --2- 172.21.15.123:0/1870643286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d4107690 0x7fc0d4109a80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009ca0 tx=0x7fc0cc02a8c0 comp rx=0 tx=0).stop 2024-08-18T22:07:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.877+0000 7fc0dc5dc640 1 -- 172.21.15.123:0/1870643286 shutdown_connections 2024-08-18T22:07:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.877+0000 7fc0dc5dc640 1 --2- 172.21.15.123:0/1870643286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d4107690 0x7fc0d4109a80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.877+0000 7fc0dc5dc640 1 --2- 172.21.15.123:0/1870643286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0d4104d60 0x7fc0d4107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.877+0000 7fc0dc5dc640 1 --2- 172.21.15.123:0/1870643286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0d4102430 0x7fc0d4104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.877+0000 7fc0dc5dc640 1 -- 172.21.15.123:0/1870643286 >> 172.21.15.123:0/1870643286 conn(0x7fc0d40fbfb0 msgr2=0x7fc0d40fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.877+0000 7fc0dc5dc640 1 -- 172.21.15.123:0/1870643286 shutdown_connections 2024-08-18T22:07:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.877+0000 7fc0dc5dc640 1 -- 172.21.15.123:0/1870643286 wait complete. 2024-08-18T22:07:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0dc5dc640 1 Processor -- start 2024-08-18T22:07:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0dc5dc640 1 -- start start 2024-08-18T22:07:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0dc5dc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0d4102430 0x7fc0d4101d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0dc5dc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d4104d60 0x7fc0d41003e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0dc5dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0d4107690 0x7fc0d4100920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0dc5dc640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d410d590 con 0x7fc0d4104d60 2024-08-18T22:07:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0dc5dc640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d410d410 con 0x7fc0d4107690 2024-08-18T22:07:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0dc5dc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d410d710 con 0x7fc0d4102430 2024-08-18T22:07:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0d9b77640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d4104d60 0x7fc0d41003e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0d9b77640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d4104d60 0x7fc0d41003e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56234/0 (socket says 172.21.15.123:56234) 2024-08-18T22:07:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0d9b77640 1 -- 172.21.15.123:0/2592229767 learned_addr learned my addr 172.21.15.123:0/2592229767 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0da378640 1 --2- 172.21.15.123:0/2592229767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0d4102430 0x7fc0d4101d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0dab79640 1 --2- 172.21.15.123:0/2592229767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0d4107690 0x7fc0d4100920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0d9b77640 1 -- 172.21.15.123:0/2592229767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0d4102430 msgr2=0x7fc0d4101d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0d9b77640 1 --2- 172.21.15.123:0/2592229767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0d4102430 0x7fc0d4101d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0d9b77640 1 -- 172.21.15.123:0/2592229767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0d4107690 msgr2=0x7fc0d4100920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0d9b77640 1 --2- 172.21.15.123:0/2592229767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0d4107690 0x7fc0d4100920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0d9b77640 1 -- 172.21.15.123:0/2592229767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d41011e0 con 0x7fc0d4104d60 2024-08-18T22:07:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.878+0000 7fc0d9b77640 1 --2- 172.21.15.123:0/2592229767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d4104d60 0x7fc0d41003e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400e9c0 tx=0x7fc0c400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.879+0000 7fc0cb7fe640 1 -- 172.21.15.123:0/2592229767 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c400cd80 con 0x7fc0d4104d60 2024-08-18T22:07:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.879+0000 7fc0dc5dc640 1 -- 172.21.15.123:0/2592229767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d41a1d70 con 0x7fc0d4104d60 2024-08-18T22:07:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.879+0000 7fc0cb7fe640 1 -- 172.21.15.123:0/2592229767 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0c4005500 con 0x7fc0d4104d60 2024-08-18T22:07:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.879+0000 7fc0cb7fe640 1 -- 172.21.15.123:0/2592229767 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4010690 con 0x7fc0d4104d60 2024-08-18T22:07:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.879+0000 7fc0dc5dc640 1 -- 172.21.15.123:0/2592229767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d41a2220 con 0x7fc0d4104d60 2024-08-18T22:07:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.880+0000 7fc0dc5dc640 1 -- 172.21.15.123:0/2592229767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d40fdaa0 con 0x7fc0d4104d60 2024-08-18T22:07:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.881+0000 7fc0cb7fe640 1 -- 172.21.15.123:0/2592229767 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fc0c40046c0 con 0x7fc0d4104d60 2024-08-18T22:07:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.882+0000 7fc0cb7fe640 1 --2- 172.21.15.123:0/2592229767 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0c00a2b80 0x7fc0c00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.882+0000 7fc0da378640 1 --2- 172.21.15.123:0/2592229767 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0c00a2b80 0x7fc0c00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.882+0000 7fc0cb7fe640 1 -- 172.21.15.123:0/2592229767 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fc0c40cf740 con 0x7fc0d4104d60 2024-08-18T22:07:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.882+0000 7fc0da378640 1 --2- 172.21.15.123:0/2592229767 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0c00a2b80 0x7fc0c00a5040 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000bbe0 tx=0x7fc0d000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:21.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:21.886+0000 7fc0cb7fe640 1 -- 172.21.15.123:0/2592229767 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fc0c409c310 con 0x7fc0d4104d60 2024-08-18T22:07:21.908 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:21 smithi183 ceph-mon[22097]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:07:22.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:22.080+0000 7fc0dc5dc640 1 -- 172.21.15.123:0/2592229767 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc0d4062360 con 0x7fc0c00a2b80 2024-08-18T22:07:22.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:22.101+0000 7fc0cb7fe640 1 -- 172.21.15.123:0/2592229767 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4092 (secure 0 0 0) 0x7fc0d4062360 con 0x7fc0c00a2b80 2024-08-18T22:07:22.102 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:07:22.102 INFO:teuthology.orchestra.run.smithi123.stdout:mds.a smithi123 running (2m) 61s ago 2m 15.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9da9ee9cac77 2024-08-18T22:07:22.102 INFO:teuthology.orchestra.run.smithi123.stdout:mds.b smithi130 running (2m) 62s ago 2m 17.5M - 19.1.0-1382-gde09dd01 ea7a5189f30b f6df05a461af 2024-08-18T22:07:22.102 INFO:teuthology.orchestra.run.smithi123.stdout:mds.c smithi183 running (2m) 62s ago 2m 19.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b f3078d6d7702 2024-08-18T22:07:22.102 INFO:teuthology.orchestra.run.smithi123.stdout:mds.d smithi123 running (2m) 61s ago 2m 14.3M - 19.1.0-1382-gde09dd01 ea7a5189f30b ec3e4f2e0ff6 2024-08-18T22:07:22.103 INFO:teuthology.orchestra.run.smithi123.stdout:mds.e smithi130 running (2m) 62s ago 2m 18.3M - 19.1.0-1382-gde09dd01 ea7a5189f30b 615d28a876da 2024-08-18T22:07:22.103 INFO:teuthology.orchestra.run.smithi123.stdout:mds.f smithi183 running (2m) 62s ago 2m 16.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b d92ded7cbce3 2024-08-18T22:07:22.103 INFO:teuthology.orchestra.run.smithi123.stdout:mds.g smithi123 running (2m) 61s ago 2m 15.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b 3d4cd7dae5ad 2024-08-18T22:07:22.103 INFO:teuthology.orchestra.run.smithi123.stdout:mds.h smithi130 running (2m) 62s ago 2m 18.1M - 19.1.0-1382-gde09dd01 ea7a5189f30b cfb66ef090c7 2024-08-18T22:07:22.103 INFO:teuthology.orchestra.run.smithi123.stdout:mds.i smithi183 running (2m) 62s ago 2m 26.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9f6d80154c0d 2024-08-18T22:07:22.103 INFO:teuthology.orchestra.run.smithi123.stdout:mds.j smithi123 running (2m) 61s ago 2m 16.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b 6f9c82a6bd43 2024-08-18T22:07:22.103 INFO:teuthology.orchestra.run.smithi123.stdout:mds.k smithi130 running (2m) 62s ago 2m 16.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b e654da7fc334 2024-08-18T22:07:22.103 INFO:teuthology.orchestra.run.smithi123.stdout:mds.l smithi183 running (2m) 62s ago 2m 15.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b 44d1e94f470e 2024-08-18T22:07:22.103 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.x smithi123 *:9283,8765 running (8m) 61s ago 8m 510M - 19.1.0-1382-gde09dd01 ea7a5189f30b 27eeeff18cbb 2024-08-18T22:07:22.103 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.y smithi130 *:8443,8765 running (7m) 62s ago 7m 443M - 19.1.0-1382-gde09dd01 ea7a5189f30b 803a4ff97461 2024-08-18T22:07:22.103 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.z smithi183 *:8443,8765 running (7m) 62s ago 7m 443M - 19.1.0-1382-gde09dd01 ea7a5189f30b d5afc1953c8e 2024-08-18T22:07:22.103 INFO:teuthology.orchestra.run.smithi123.stdout:mon.a smithi123 running (8m) 61s ago 8m 53.2M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 391aeb56646b 2024-08-18T22:07:22.103 INFO:teuthology.orchestra.run.smithi123.stdout:mon.b smithi130 running (7m) 62s ago 7m 41.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 480d5f7bdf7b 2024-08-18T22:07:22.104 INFO:teuthology.orchestra.run.smithi123.stdout:mon.c smithi183 running (7m) 62s ago 7m 41.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 9943b5f35ebf 2024-08-18T22:07:22.104 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (7m) 61s ago 7m 56.3M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b 43045ed06590 2024-08-18T22:07:22.104 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi130 running (6m) 62s ago 6m 46.8M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b 2772066fbbb8 2024-08-18T22:07:22.104 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi183 running (6m) 62s ago 6m 47.7M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b 14c1d21e7e65 2024-08-18T22:07:22.104 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi123 running (5m) 61s ago 5m 54.1M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b 6f65fef3a85a 2024-08-18T22:07:22.104 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi130 running (5m) 62s ago 5m 52.0M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b d5a0b6068b55 2024-08-18T22:07:22.104 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi183 running (5m) 62s ago 5m 44.8M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b c847ebb7b838 2024-08-18T22:07:22.104 INFO:teuthology.orchestra.run.smithi123.stdout:osd.6 smithi123 running (4m) 61s ago 4m 42.0M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b be223c51d6eb 2024-08-18T22:07:22.104 INFO:teuthology.orchestra.run.smithi123.stdout:osd.7 smithi130 running (4m) 62s ago 4m 55.0M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b 41ce6b637b66 2024-08-18T22:07:22.104 INFO:teuthology.orchestra.run.smithi123.stdout:osd.8 smithi183 running (4m) 62s ago 4m 53.1M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b 6626e1b4c59c 2024-08-18T22:07:22.104 INFO:teuthology.orchestra.run.smithi123.stdout:osd.9 smithi123 running (3m) 61s ago 3m 41.1M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b 63859c9ce86c 2024-08-18T22:07:22.104 INFO:teuthology.orchestra.run.smithi123.stdout:osd.10 smithi130 running (3m) 62s ago 3m 53.4M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b 4a75d6241be9 2024-08-18T22:07:22.104 INFO:teuthology.orchestra.run.smithi123.stdout:osd.11 smithi183 running (2m) 62s ago 2m 42.6M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b a1f858d34629 2024-08-18T22:07:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:22.103+0000 7fc0dc5dc640 1 -- 172.21.15.123:0/2592229767 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0c00a2b80 msgr2=0x7fc0c00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:22.103+0000 7fc0dc5dc640 1 --2- 172.21.15.123:0/2592229767 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0c00a2b80 0x7fc0c00a5040 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000bbe0 tx=0x7fc0d000b390 comp rx=0 tx=0).stop 2024-08-18T22:07:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:22.103+0000 7fc0dc5dc640 1 -- 172.21.15.123:0/2592229767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d4104d60 msgr2=0x7fc0d41003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:22.103+0000 7fc0dc5dc640 1 --2- 172.21.15.123:0/2592229767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d4104d60 0x7fc0d41003e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400e9c0 tx=0x7fc0c400ee80 comp rx=0 tx=0).stop 2024-08-18T22:07:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:22.103+0000 7fc0dc5dc640 1 -- 172.21.15.123:0/2592229767 shutdown_connections 2024-08-18T22:07:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:22.103+0000 7fc0dc5dc640 1 --2- 172.21.15.123:0/2592229767 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0c00a2b80 0x7fc0c00a5040 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:22.103+0000 7fc0dc5dc640 1 --2- 172.21.15.123:0/2592229767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0d4107690 0x7fc0d4100920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:22.103+0000 7fc0dc5dc640 1 --2- 172.21.15.123:0/2592229767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d4104d60 0x7fc0d41003e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:22.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:22.103+0000 7fc0dc5dc640 1 --2- 172.21.15.123:0/2592229767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0d4102430 0x7fc0d4101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:22.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:22.103+0000 7fc0dc5dc640 1 -- 172.21.15.123:0/2592229767 >> 172.21.15.123:0/2592229767 conn(0x7fc0d40fbfb0 msgr2=0x7fc0d4102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:22.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:22.104+0000 7fc0dc5dc640 1 -- 172.21.15.123:0/2592229767 shutdown_connections 2024-08-18T22:07:22.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:22.104+0000 7fc0dc5dc640 1 -- 172.21.15.123:0/2592229767 wait complete. 2024-08-18T22:07:22.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:22 smithi183 ceph-mon[22097]: pgmap v328: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 614 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:22.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:22 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:07:22.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:22 smithi123 ceph-mon[18462]: pgmap v328: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 614 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:22.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:22 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:07:22.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:22 smithi130 ceph-mon[21698]: pgmap v328: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 614 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:22.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:22 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:07:22.869 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-18T22:07:23.561 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:23.684 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:23 smithi123 ceph-mon[18462]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:07:23.684 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:23.684 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:23.684 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:23.684 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:23 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:23.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:23 smithi130 ceph-mon[21698]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:07:23.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:23.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:23.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:23.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:23 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:23.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:23 smithi183 ceph-mon[22097]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:07:23.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:23.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:23.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:23.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:23 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.028+0000 7f87beaec640 1 -- 172.21.15.123:0/625662639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b81034f0 msgr2=0x7f87b8109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.028+0000 7f87beaec640 1 --2- 172.21.15.123:0/625662639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b81034f0 0x7f87b8109d80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009ca0 tx=0x7f87b002a8c0 comp rx=0 tx=0).stop 2024-08-18T22:07:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.028+0000 7f87beaec640 1 -- 172.21.15.123:0/625662639 shutdown_connections 2024-08-18T22:07:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.028+0000 7f87beaec640 1 --2- 172.21.15.123:0/625662639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b81034f0 0x7f87b8109d80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.028+0000 7f87beaec640 1 --2- 172.21.15.123:0/625662639 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87b8102b30 0x7f87b8102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.028+0000 7f87beaec640 1 --2- 172.21.15.123:0/625662639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87b8101930 0x7f87b8101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.028+0000 7f87beaec640 1 -- 172.21.15.123:0/625662639 >> 172.21.15.123:0/625662639 conn(0x7f87b80fd0c0 msgr2=0x7f87b80ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.028+0000 7f87beaec640 1 -- 172.21.15.123:0/625662639 shutdown_connections 2024-08-18T22:07:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.028+0000 7f87beaec640 1 -- 172.21.15.123:0/625662639 wait complete. 2024-08-18T22:07:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.029+0000 7f87beaec640 1 Processor -- start 2024-08-18T22:07:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.029+0000 7f87beaec640 1 -- start start 2024-08-18T22:07:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.029+0000 7f87beaec640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b8101930 0x7f87b8075cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.029+0000 7f87beaec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87b8102b30 0x7f87b8074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.029+0000 7f87beaec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87b81034f0 0x7f87b8074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.029+0000 7f87beaec640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f87b810d660 con 0x7f87b8101930 2024-08-18T22:07:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.029+0000 7f87beaec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f87b810d4e0 con 0x7f87b8102b30 2024-08-18T22:07:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.029+0000 7f87beaec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f87b810d7e0 con 0x7f87b81034f0 2024-08-18T22:07:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.029+0000 7f87bc888640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b8101930 0x7f87b8075cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.029+0000 7f87bc888640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b8101930 0x7f87b8075cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46078/0 (socket says 172.21.15.123:46078) 2024-08-18T22:07:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.029+0000 7f87bc888640 1 -- 172.21.15.123:0/3040362510 learned_addr learned my addr 172.21.15.123:0/3040362510 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.029+0000 7f87bd089640 1 --2- 172.21.15.123:0/3040362510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87b81034f0 0x7f87b8074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.029+0000 7f87affff640 1 --2- 172.21.15.123:0/3040362510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87b8102b30 0x7f87b8074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:24.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.030+0000 7f87bc888640 1 -- 172.21.15.123:0/3040362510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87b81034f0 msgr2=0x7f87b8074850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:24.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.030+0000 7f87bc888640 1 --2- 172.21.15.123:0/3040362510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87b81034f0 0x7f87b8074850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:24.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.030+0000 7f87bc888640 1 -- 172.21.15.123:0/3040362510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87b8102b30 msgr2=0x7f87b8074310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:24.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.030+0000 7f87bc888640 1 --2- 172.21.15.123:0/3040362510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87b8102b30 0x7f87b8074310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:24.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.030+0000 7f87bc888640 1 -- 172.21.15.123:0/3040362510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b8075110 con 0x7f87b8101930 2024-08-18T22:07:24.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.030+0000 7f87bc888640 1 --2- 172.21.15.123:0/3040362510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b8101930 0x7f87b8075cc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f87b400b450 tx=0x7f87b400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:24.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.030+0000 7f87adffb640 1 -- 172.21.15.123:0/3040362510 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4015020 con 0x7f87b8101930 2024-08-18T22:07:24.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.030+0000 7f87adffb640 1 -- 172.21.15.123:0/3040362510 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87b4011d70 con 0x7f87b8101930 2024-08-18T22:07:24.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.030+0000 7f87beaec640 1 -- 172.21.15.123:0/3040362510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b81a1de0 con 0x7f87b8101930 2024-08-18T22:07:24.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.030+0000 7f87adffb640 1 -- 172.21.15.123:0/3040362510 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b400f340 con 0x7f87b8101930 2024-08-18T22:07:24.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.030+0000 7f87beaec640 1 -- 172.21.15.123:0/3040362510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b81a2250 con 0x7f87b8101930 2024-08-18T22:07:24.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.031+0000 7f87beaec640 1 -- 172.21.15.123:0/3040362510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b8108ce0 con 0x7f87b8101930 2024-08-18T22:07:24.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.032+0000 7f87adffb640 1 -- 172.21.15.123:0/3040362510 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f87b4018020 con 0x7f87b8101930 2024-08-18T22:07:24.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.033+0000 7f87adffb640 1 --2- 172.21.15.123:0/3040362510 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f87a00a2b80 0x7f87a00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:24.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.033+0000 7f87affff640 1 --2- 172.21.15.123:0/3040362510 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f87a00a2b80 0x7f87a00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:24.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.033+0000 7f87adffb640 1 -- 172.21.15.123:0/3040362510 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f87b40ceda0 con 0x7f87b8101930 2024-08-18T22:07:24.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.033+0000 7f87affff640 1 --2- 172.21.15.123:0/3040362510 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f87a00a2b80 0x7f87a00a5040 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f87b8075a40 tx=0x7f87a800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:24.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.037+0000 7f87adffb640 1 -- 172.21.15.123:0/3040362510 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f87b401f020 con 0x7f87b8101930 2024-08-18T22:07:24.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.226+0000 7f87beaec640 1 -- 172.21.15.123:0/3040362510 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f87b8062360 con 0x7f87a00a2b80 2024-08-18T22:07:24.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.233+0000 7f87adffb640 1 -- 172.21.15.123:0/3040362510 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f87b8062360 con 0x7f87a00a2b80 2024-08-18T22:07:24.236 INFO:teuthology.orchestra.run.smithi123.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-18T22:07:24.236 INFO:teuthology.orchestra.run.smithi123.stdout:mds.all 12/12 63s ago 2m smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l;count:12 2024-08-18T22:07:24.236 INFO:teuthology.orchestra.run.smithi123.stdout:mgr 3/3 63s ago 7m smithi123=x;smithi130=y;smithi183=z;count:3 2024-08-18T22:07:24.236 INFO:teuthology.orchestra.run.smithi123.stdout:mon 3/3 63s ago 7m smithi123:172.21.15.123=a;smithi130:172.21.15.130=b;smithi183:172.21.15.183=c;count:3 2024-08-18T22:07:24.236 INFO:teuthology.orchestra.run.smithi123.stdout:osd 12 63s ago - 2024-08-18T22:07:24.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.235+0000 7f87beaec640 1 -- 172.21.15.123:0/3040362510 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f87a00a2b80 msgr2=0x7f87a00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:24.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.235+0000 7f87beaec640 1 --2- 172.21.15.123:0/3040362510 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f87a00a2b80 0x7f87a00a5040 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f87b8075a40 tx=0x7f87a800b390 comp rx=0 tx=0).stop 2024-08-18T22:07:24.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.235+0000 7f87beaec640 1 -- 172.21.15.123:0/3040362510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b8101930 msgr2=0x7f87b8075cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:24.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.235+0000 7f87beaec640 1 --2- 172.21.15.123:0/3040362510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b8101930 0x7f87b8075cc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f87b400b450 tx=0x7f87b400b910 comp rx=0 tx=0).stop 2024-08-18T22:07:24.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.235+0000 7f87beaec640 1 -- 172.21.15.123:0/3040362510 shutdown_connections 2024-08-18T22:07:24.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.235+0000 7f87beaec640 1 --2- 172.21.15.123:0/3040362510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87b81034f0 0x7f87b8074850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:24.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.235+0000 7f87beaec640 1 --2- 172.21.15.123:0/3040362510 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f87a00a2b80 0x7f87a00a5040 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:24.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.235+0000 7f87beaec640 1 --2- 172.21.15.123:0/3040362510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87b8102b30 0x7f87b8074310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:24.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.235+0000 7f87beaec640 1 --2- 172.21.15.123:0/3040362510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b8101930 0x7f87b8075cc0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:24.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.235+0000 7f87beaec640 1 -- 172.21.15.123:0/3040362510 >> 172.21.15.123:0/3040362510 conn(0x7f87b80fd0c0 msgr2=0x7f87b8105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:24.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.235+0000 7f87beaec640 1 -- 172.21.15.123:0/3040362510 shutdown_connections 2024-08-18T22:07:24.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:24.235+0000 7f87beaec640 1 -- 172.21.15.123:0/3040362510 wait complete. 2024-08-18T22:07:24.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:24 smithi123 ceph-mon[18462]: pgmap v329: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 518 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:24.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:24 smithi130 ceph-mon[21698]: pgmap v329: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 518 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:24.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:24 smithi183 ceph-mon[22097]: pgmap v329: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 518 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:25.033 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-18T22:07:25.311 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:25.708 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:25 smithi123 ceph-mon[18462]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:07:25.709 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:25 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:25.709 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:25 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:25.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:25 smithi130 ceph-mon[21698]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:07:25.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:25 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:25.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:25 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.792+0000 7f271bc9b640 1 -- 172.21.15.123:0/2463894636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27141001c0 msgr2=0x7f27141025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.792+0000 7f271bc9b640 1 --2- 172.21.15.123:0/2463894636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27141001c0 0x7f27141025d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f270c009900 tx=0x7f270c02a410 comp rx=0 tx=0).stop 2024-08-18T22:07:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.792+0000 7f271bc9b640 1 -- 172.21.15.123:0/2463894636 shutdown_connections 2024-08-18T22:07:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.792+0000 7f271bc9b640 1 --2- 172.21.15.123:0/2463894636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27141054c0 0x7f2714105970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.792+0000 7f271bc9b640 1 --2- 172.21.15.123:0/2463894636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2714102b10 0x7f2714104f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.792+0000 7f271bc9b640 1 --2- 172.21.15.123:0/2463894636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27141001c0 0x7f27141025d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.792+0000 7f271bc9b640 1 -- 172.21.15.123:0/2463894636 >> 172.21.15.123:0/2463894636 conn(0x7f27140fbfd0 msgr2=0x7f27140fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.792+0000 7f271bc9b640 1 -- 172.21.15.123:0/2463894636 shutdown_connections 2024-08-18T22:07:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.792+0000 7f271bc9b640 1 -- 172.21.15.123:0/2463894636 wait complete. 2024-08-18T22:07:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.793+0000 7f271bc9b640 1 Processor -- start 2024-08-18T22:07:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.793+0000 7f271bc9b640 1 -- start start 2024-08-18T22:07:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.793+0000 7f271bc9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27141001c0 0x7f271419e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.793+0000 7f271bc9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2714102b10 0x7f271419e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.793+0000 7f271bc9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27141054c0 0x7f27141a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.793+0000 7f271bc9b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2714113bd0 con 0x7f27141054c0 2024-08-18T22:07:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.793+0000 7f271bc9b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2714113a50 con 0x7f27141001c0 2024-08-18T22:07:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.793+0000 7f271bc9b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2714113d50 con 0x7f2714102b10 2024-08-18T22:07:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.793+0000 7f271a238640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27141054c0 0x7f27141a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.793+0000 7f271a238640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27141054c0 0x7f27141a5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46090/0 (socket says 172.21.15.123:46090) 2024-08-18T22:07:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.793+0000 7f271a238640 1 -- 172.21.15.123:0/4247154806 learned_addr learned my addr 172.21.15.123:0/4247154806 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.794+0000 7f2719236640 1 --2- 172.21.15.123:0/4247154806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2714102b10 0x7f271419e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.794+0000 7f2719a37640 1 --2- 172.21.15.123:0/4247154806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27141001c0 0x7f271419e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.794+0000 7f271a238640 1 -- 172.21.15.123:0/4247154806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2714102b10 msgr2=0x7f271419e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.794+0000 7f271a238640 1 --2- 172.21.15.123:0/4247154806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2714102b10 0x7f271419e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.794+0000 7f271a238640 1 -- 172.21.15.123:0/4247154806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27141001c0 msgr2=0x7f271419e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:25.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.794+0000 7f271a238640 1 --2- 172.21.15.123:0/4247154806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27141001c0 0x7f271419e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:25.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.794+0000 7f271a238640 1 -- 172.21.15.123:0/4247154806 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27141a5e70 con 0x7f27141054c0 2024-08-18T22:07:25.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.794+0000 7f271a238640 1 --2- 172.21.15.123:0/4247154806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27141054c0 0x7f27141a5800 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f270400d750 tx=0x7f270400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:25.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.794+0000 7f2712ffd640 1 -- 172.21.15.123:0/4247154806 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2704017070 con 0x7f27141054c0 2024-08-18T22:07:25.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.794+0000 7f2712ffd640 1 -- 172.21.15.123:0/4247154806 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2704005500 con 0x7f27141054c0 2024-08-18T22:07:25.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.794+0000 7f271bc9b640 1 -- 172.21.15.123:0/4247154806 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27141a6160 con 0x7f27141054c0 2024-08-18T22:07:25.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.794+0000 7f2712ffd640 1 -- 172.21.15.123:0/4247154806 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2704004d90 con 0x7f27141054c0 2024-08-18T22:07:25.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.794+0000 7f271bc9b640 1 -- 172.21.15.123:0/4247154806 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27141a6650 con 0x7f27141054c0 2024-08-18T22:07:25.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.795+0000 7f271bc9b640 1 -- 172.21.15.123:0/4247154806 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27140fdac0 con 0x7f27141054c0 2024-08-18T22:07:25.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.796+0000 7f2712ffd640 1 -- 172.21.15.123:0/4247154806 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f2704004f30 con 0x7f27141054c0 2024-08-18T22:07:25.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.797+0000 7f2712ffd640 1 --2- 172.21.15.123:0/4247154806 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f26fc0a2bb0 0x7f26fc0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:25.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.797+0000 7f2719a37640 1 --2- 172.21.15.123:0/4247154806 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f26fc0a2bb0 0x7f26fc0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:25.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.797+0000 7f2712ffd640 1 -- 172.21.15.123:0/4247154806 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f27040ced00 con 0x7f27141054c0 2024-08-18T22:07:25.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.797+0000 7f2719a37640 1 --2- 172.21.15.123:0/4247154806 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f26fc0a2bb0 0x7f26fc0a5070 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f270c0314e0 tx=0x7f270c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:25.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.801+0000 7f2712ffd640 1 -- 172.21.15.123:0/4247154806 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f270409b280 con 0x7f27141054c0 2024-08-18T22:07:25.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:25 smithi183 ceph-mon[22097]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:07:25.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:25 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:25.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:25 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:25.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.978+0000 7f271bc9b640 1 -- 172.21.15.123:0/4247154806 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f2714062360 con 0x7f26fc0a2bb0 2024-08-18T22:07:25.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.980+0000 7f2712ffd640 1 -- 172.21.15.123:0/4247154806 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f2714062360 con 0x7f26fc0a2bb0 2024-08-18T22:07:25.980 INFO:teuthology.orchestra.run.smithi123.stdout:HOST ADDR LABELS STATUS 2024-08-18T22:07:25.981 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123 172.21.15.123 2024-08-18T22:07:25.981 INFO:teuthology.orchestra.run.smithi123.stdout:smithi130 172.21.15.130 2024-08-18T22:07:25.981 INFO:teuthology.orchestra.run.smithi123.stdout:smithi183 172.21.15.183 2024-08-18T22:07:25.981 INFO:teuthology.orchestra.run.smithi123.stdout:3 hosts in cluster 2024-08-18T22:07:25.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.982+0000 7f271bc9b640 1 -- 172.21.15.123:0/4247154806 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f26fc0a2bb0 msgr2=0x7f26fc0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:25.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.982+0000 7f271bc9b640 1 --2- 172.21.15.123:0/4247154806 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f26fc0a2bb0 0x7f26fc0a5070 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f270c0314e0 tx=0x7f270c000bc0 comp rx=0 tx=0).stop 2024-08-18T22:07:25.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.982+0000 7f271bc9b640 1 -- 172.21.15.123:0/4247154806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27141054c0 msgr2=0x7f27141a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:25.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.982+0000 7f271bc9b640 1 --2- 172.21.15.123:0/4247154806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27141054c0 0x7f27141a5800 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f270400d750 tx=0x7f270400dc10 comp rx=0 tx=0).stop 2024-08-18T22:07:25.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.982+0000 7f271bc9b640 1 -- 172.21.15.123:0/4247154806 shutdown_connections 2024-08-18T22:07:25.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.982+0000 7f271bc9b640 1 --2- 172.21.15.123:0/4247154806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27141054c0 0x7f27141a5800 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:25.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.982+0000 7f271bc9b640 1 --2- 172.21.15.123:0/4247154806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2714102b10 0x7f271419e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:25.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.982+0000 7f271bc9b640 1 --2- 172.21.15.123:0/4247154806 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f26fc0a2bb0 0x7f26fc0a5070 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:25.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.982+0000 7f271bc9b640 1 --2- 172.21.15.123:0/4247154806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27141001c0 0x7f271419e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:25.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.982+0000 7f271bc9b640 1 -- 172.21.15.123:0/4247154806 >> 172.21.15.123:0/4247154806 conn(0x7f27140fbfd0 msgr2=0x7f2714103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:25.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.982+0000 7f271bc9b640 1 -- 172.21.15.123:0/4247154806 shutdown_connections 2024-08-18T22:07:25.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:25.982+0000 7f271bc9b640 1 -- 172.21.15.123:0/4247154806 wait complete. 2024-08-18T22:07:26.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:26 smithi123 ceph-mon[18462]: pgmap v330: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:26.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:26 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:07:26.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:26 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:07:26.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:26 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:26 smithi130 ceph-mon[21698]: pgmap v330: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:26 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:07:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:26 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:07:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:26 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:26.802 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-18T22:07:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:26 smithi183 ceph-mon[22097]: pgmap v330: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-08-18T22:07:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:26 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:07:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:26 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:07:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:26 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:07:27.054 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.545+0000 7f78f1d17640 1 -- 172.21.15.123:0/4190391448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78ec101a40 msgr2=0x7f78ec101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.545+0000 7f78f1d17640 1 --2- 172.21.15.123:0/4190391448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78ec101a40 0x7f78ec101ec0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009900 tx=0x7f78e002a410 comp rx=0 tx=0).stop 2024-08-18T22:07:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.545+0000 7f78f1d17640 1 -- 172.21.15.123:0/4190391448 shutdown_connections 2024-08-18T22:07:27.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.545+0000 7f78f1d17640 1 --2- 172.21.15.123:0/4190391448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78ec102400 0x7f78ec108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.545+0000 7f78f1d17640 1 --2- 172.21.15.123:0/4190391448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78ec101a40 0x7f78ec101ec0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.545+0000 7f78f1d17640 1 --2- 172.21.15.123:0/4190391448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78ec100840 0x7f78ec100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.545+0000 7f78f1d17640 1 -- 172.21.15.123:0/4190391448 >> 172.21.15.123:0/4190391448 conn(0x7f78ec0fbfd0 msgr2=0x7f78ec0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.545+0000 7f78f1d17640 1 -- 172.21.15.123:0/4190391448 shutdown_connections 2024-08-18T22:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.545+0000 7f78f1d17640 1 -- 172.21.15.123:0/4190391448 wait complete. 2024-08-18T22:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.546+0000 7f78f1d17640 1 Processor -- start 2024-08-18T22:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.546+0000 7f78f1d17640 1 -- start start 2024-08-18T22:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.546+0000 7f78f1d17640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78ec100840 0x7f78ec06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.546+0000 7f78f1d17640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78ec101a40 0x7f78ec19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.546+0000 7f78f1d17640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78ec102400 0x7f78ec19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.546+0000 7f78f1d17640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec10c4a0 con 0x7f78ec101a40 2024-08-18T22:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.546+0000 7f78f1d17640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec10c320 con 0x7f78ec102400 2024-08-18T22:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.546+0000 7f78f1d17640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec10c620 con 0x7f78ec100840 2024-08-18T22:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.546+0000 7f78eaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78ec101a40 0x7f78ec19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.546+0000 7f78eaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78ec101a40 0x7f78ec19c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46118/0 (socket says 172.21.15.123:46118) 2024-08-18T22:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.547+0000 7f78eaffd640 1 -- 172.21.15.123:0/1932981329 learned_addr learned my addr 172.21.15.123:0/1932981329 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.547+0000 7f78eb7fe640 1 --2- 172.21.15.123:0/1932981329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78ec100840 0x7f78ec06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.547+0000 7f78ebfff640 1 --2- 172.21.15.123:0/1932981329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78ec102400 0x7f78ec19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.547+0000 7f78eaffd640 1 -- 172.21.15.123:0/1932981329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78ec100840 msgr2=0x7f78ec06b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.547+0000 7f78eaffd640 1 --2- 172.21.15.123:0/1932981329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78ec100840 0x7f78ec06b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.547+0000 7f78eaffd640 1 -- 172.21.15.123:0/1932981329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78ec102400 msgr2=0x7f78ec19efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.547+0000 7f78eaffd640 1 --2- 172.21.15.123:0/1932981329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78ec102400 0x7f78ec19efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.547+0000 7f78eaffd640 1 -- 172.21.15.123:0/1932981329 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ec19f8b0 con 0x7f78ec101a40 2024-08-18T22:07:27.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.547+0000 7f78ebfff640 1 --2- 172.21.15.123:0/1932981329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78ec102400 0x7f78ec19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:07:27.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.547+0000 7f78eaffd640 1 --2- 172.21.15.123:0/1932981329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78ec101a40 0x7f78ec19c980 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009230 tx=0x7f78e0004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:27.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.547+0000 7f78e8ff9640 1 -- 172.21.15.123:0/1932981329 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e003f030 con 0x7f78ec101a40 2024-08-18T22:07:27.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.547+0000 7f78f1d17640 1 -- 172.21.15.123:0/1932981329 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ec19fae0 con 0x7f78ec101a40 2024-08-18T22:07:27.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.547+0000 7f78e8ff9640 1 -- 172.21.15.123:0/1932981329 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78e0003ce0 con 0x7f78ec101a40 2024-08-18T22:07:27.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.547+0000 7f78e8ff9640 1 -- 172.21.15.123:0/1932981329 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0035070 con 0x7f78ec101a40 2024-08-18T22:07:27.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.547+0000 7f78f1d17640 1 -- 172.21.15.123:0/1932981329 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ec1a0010 con 0x7f78ec101a40 2024-08-18T22:07:27.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.548+0000 7f78f1d17640 1 -- 172.21.15.123:0/1932981329 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78ec107c60 con 0x7f78ec101a40 2024-08-18T22:07:27.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.549+0000 7f78e8ff9640 1 -- 172.21.15.123:0/1932981329 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f78e0042030 con 0x7f78ec101a40 2024-08-18T22:07:27.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.550+0000 7f78e8ff9640 1 --2- 172.21.15.123:0/1932981329 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f78d40a2b80 0x7f78d40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:27.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.550+0000 7f78e8ff9640 1 -- 172.21.15.123:0/1932981329 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f78e00efdc0 con 0x7f78ec101a40 2024-08-18T22:07:27.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.550+0000 7f78eb7fe640 1 --2- 172.21.15.123:0/1932981329 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f78d40a2b80 0x7f78d40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:27.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.551+0000 7f78eb7fe640 1 --2- 172.21.15.123:0/1932981329 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f78d40a2b80 0x7f78d40a5040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f78ec1018a0 tx=0x7f78dc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:27.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.554+0000 7f78e8ff9640 1 -- 172.21.15.123:0/1932981329 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f78e00bc990 con 0x7f78ec101a40 2024-08-18T22:07:27.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.735+0000 7f78f1d17640 1 -- 172.21.15.123:0/1932981329 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f78ec062360 con 0x7f78d40a2b80 2024-08-18T22:07:27.737 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:27 smithi123 ceph-mon[18462]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:07:27.738 INFO:teuthology.orchestra.run.smithi123.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-18T22:07:27.739 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400YK400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-18T22:07:27.739 INFO:teuthology.orchestra.run.smithi123.stdout:smithi130 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500Q1400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-18T22:07:27.739 INFO:teuthology.orchestra.run.smithi123.stdout:smithi183 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500QJ400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-18T22:07:27.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.737+0000 7f78e8ff9640 1 -- 172.21.15.123:0/1932981329 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f78ec062360 con 0x7f78d40a2b80 2024-08-18T22:07:27.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.740+0000 7f78f1d17640 1 -- 172.21.15.123:0/1932981329 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f78d40a2b80 msgr2=0x7f78d40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:27.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.740+0000 7f78f1d17640 1 --2- 172.21.15.123:0/1932981329 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f78d40a2b80 0x7f78d40a5040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f78ec1018a0 tx=0x7f78dc00a2d0 comp rx=0 tx=0).stop 2024-08-18T22:07:27.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.740+0000 7f78f1d17640 1 -- 172.21.15.123:0/1932981329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78ec101a40 msgr2=0x7f78ec19c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:27.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.740+0000 7f78f1d17640 1 --2- 172.21.15.123:0/1932981329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78ec101a40 0x7f78ec19c980 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009230 tx=0x7f78e0004360 comp rx=0 tx=0).stop 2024-08-18T22:07:27.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.740+0000 7f78f1d17640 1 -- 172.21.15.123:0/1932981329 shutdown_connections 2024-08-18T22:07:27.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.740+0000 7f78f1d17640 1 --2- 172.21.15.123:0/1932981329 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f78d40a2b80 0x7f78d40a5040 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:27.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.740+0000 7f78f1d17640 1 --2- 172.21.15.123:0/1932981329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78ec102400 0x7f78ec19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:27.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.740+0000 7f78f1d17640 1 --2- 172.21.15.123:0/1932981329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78ec101a40 0x7f78ec19c980 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:27.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.740+0000 7f78f1d17640 1 --2- 172.21.15.123:0/1932981329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78ec100840 0x7f78ec06b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:27.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.740+0000 7f78f1d17640 1 -- 172.21.15.123:0/1932981329 >> 172.21.15.123:0/1932981329 conn(0x7f78ec0fbfd0 msgr2=0x7f78ec104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:27.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.740+0000 7f78f1d17640 1 -- 172.21.15.123:0/1932981329 shutdown_connections 2024-08-18T22:07:27.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:27.740+0000 7f78f1d17640 1 -- 172.21.15.123:0/1932981329 wait complete. 2024-08-18T22:07:27.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:27 smithi130 ceph-mon[21698]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:07:27.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:27 smithi183 ceph-mon[22097]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:07:28.501 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-18T22:07:28.510 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi123.front.sepia.ceph.com 2024-08-18T22:07:28.510 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-18T22:07:28.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:28 smithi123 ceph-mon[18462]: pgmap v331: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:28.763 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:28.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:28 smithi130 ceph-mon[21698]: pgmap v331: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:28.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:28 smithi183 ceph-mon[22097]: pgmap v331: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:29.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.257+0000 7f8f86d5c640 1 -- 172.21.15.123:0/1022013258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f801014e0 msgr2=0x7f8f80101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:29.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.257+0000 7f8f86d5c640 1 --2- 172.21.15.123:0/1022013258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f801014e0 0x7f8f80101990 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009ca0 tx=0x7f8f7002a8c0 comp rx=0 tx=0).stop 2024-08-18T22:07:29.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.257+0000 7f8f86d5c640 1 -- 172.21.15.123:0/1022013258 shutdown_connections 2024-08-18T22:07:29.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.257+0000 7f8f86d5c640 1 --2- 172.21.15.123:0/1022013258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f801014e0 0x7f8f80101990 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:29.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.257+0000 7f8f86d5c640 1 --2- 172.21.15.123:0/1022013258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f80100b40 0x7f8f80100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:29.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.257+0000 7f8f86d5c640 1 --2- 172.21.15.123:0/1022013258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f80100200 0x7f8f80100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:29.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.257+0000 7f8f86d5c640 1 -- 172.21.15.123:0/1022013258 >> 172.21.15.123:0/1022013258 conn(0x7f8f800fbfb0 msgr2=0x7f8f800fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:29.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.257+0000 7f8f86d5c640 1 -- 172.21.15.123:0/1022013258 shutdown_connections 2024-08-18T22:07:29.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.257+0000 7f8f86d5c640 1 -- 172.21.15.123:0/1022013258 wait complete. 2024-08-18T22:07:29.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.257+0000 7f8f86d5c640 1 Processor -- start 2024-08-18T22:07:29.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.257+0000 7f8f86d5c640 1 -- start start 2024-08-18T22:07:29.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f86d5c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f80100200 0x7f8f80199e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:29.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f86d5c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f80100b40 0x7f8f8019a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:29.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f86d5c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f801014e0 0x7f8f801a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:29.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f86d5c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8010f7d0 con 0x7f8f80100200 2024-08-18T22:07:29.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f86d5c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8010f650 con 0x7f8f801014e0 2024-08-18T22:07:29.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f86d5c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8010f950 con 0x7f8f80100b40 2024-08-18T22:07:29.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f84af8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f80100200 0x7f8f80199e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:29.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f84af8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f80100200 0x7f8f80199e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46140/0 (socket says 172.21.15.123:46140) 2024-08-18T22:07:29.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f84af8640 1 -- 172.21.15.123:0/3312777856 learned_addr learned my addr 172.21.15.123:0/3312777856 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:29.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f852f9640 1 --2- 172.21.15.123:0/3312777856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f801014e0 0x7f8f801a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:29.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f7ffff640 1 --2- 172.21.15.123:0/3312777856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f80100b40 0x7f8f8019a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:29.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f84af8640 1 -- 172.21.15.123:0/3312777856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f80100b40 msgr2=0x7f8f8019a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:29.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f84af8640 1 --2- 172.21.15.123:0/3312777856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f80100b40 0x7f8f8019a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:29.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f84af8640 1 -- 172.21.15.123:0/3312777856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f801014e0 msgr2=0x7f8f801a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:29.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f84af8640 1 --2- 172.21.15.123:0/3312777856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f801014e0 0x7f8f801a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:29.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f84af8640 1 -- 172.21.15.123:0/3312777856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f801a1a60 con 0x7f8f80100200 2024-08-18T22:07:29.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f852f9640 1 --2- 172.21.15.123:0/3312777856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f801014e0 0x7f8f801a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:29.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f84af8640 1 --2- 172.21.15.123:0/3312777856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f80100200 0x7f8f80199e30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800b4a0 tx=0x7f8f7800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:29.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f7dffb640 1 -- 172.21.15.123:0/3312777856 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f78014070 con 0x7f8f80100200 2024-08-18T22:07:29.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f86d5c640 1 -- 172.21.15.123:0/3312777856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f801a1d50 con 0x7f8f80100200 2024-08-18T22:07:29.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f7dffb640 1 -- 172.21.15.123:0/3312777856 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f78010af0 con 0x7f8f80100200 2024-08-18T22:07:29.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.258+0000 7f8f7dffb640 1 -- 172.21.15.123:0/3312777856 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f78017d10 con 0x7f8f80100200 2024-08-18T22:07:29.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.259+0000 7f8f86d5c640 1 -- 172.21.15.123:0/3312777856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f801a2250 con 0x7f8f80100200 2024-08-18T22:07:29.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.260+0000 7f8f86d5c640 1 -- 172.21.15.123:0/3312777856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f8010af50 con 0x7f8f80100200 2024-08-18T22:07:29.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.261+0000 7f8f7dffb640 1 -- 172.21.15.123:0/3312777856 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f8f78017070 con 0x7f8f80100200 2024-08-18T22:07:29.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.261+0000 7f8f7dffb640 1 --2- 172.21.15.123:0/3312777856 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f6c0a2bb0 0x7f8f6c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:29.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.261+0000 7f8f7ffff640 1 --2- 172.21.15.123:0/3312777856 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f6c0a2bb0 0x7f8f6c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:29.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.261+0000 7f8f7dffb640 1 -- 172.21.15.123:0/3312777856 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8f780ce7e0 con 0x7f8f80100200 2024-08-18T22:07:29.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.262+0000 7f8f7ffff640 1 --2- 172.21.15.123:0/3312777856 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f6c0a2bb0 0x7f8f6c0a5070 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8f8019b350 tx=0x7f8f6800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:29.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.265+0000 7f8f7dffb640 1 -- 172.21.15.123:0/3312777856 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f8f7809b3b0 con 0x7f8f80100200 2024-08-18T22:07:29.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.471+0000 7f8f86d5c640 1 -- 172.21.15.123:0/3312777856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8f80062bc0 con 0x7f8f80100200 2024-08-18T22:07:29.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.471+0000 7f8f7dffb640 1 -- 172.21.15.123:0/3312777856 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3092 (secure 0 0 0) 0x7f8f7809acb0 con 0x7f8f80100200 2024-08-18T22:07:29.473 INFO:teuthology.orchestra.run.smithi123.stdout:e25 2024-08-18T22:07:29.473 INFO:teuthology.orchestra.run.smithi123.stdout:btime 2024-08-18T22:06:00:456703+0000 2024-08-18T22:07:29.473 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:07:29.473 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-18T22:07:29.473 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-08-18T22:07:29.473 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:29.473 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:07:29.473 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-08-18T22:07:29.473 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 25 2024-08-18T22:07:29.473 INFO:teuthology.orchestra.run.smithi123.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-18T22:07:29.473 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-08-18T22:05:22.597053+0000 2024-08-18T22:07:29.474 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-08-18T22:06:00.091798+0000 2024-08-18T22:07:29.474 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-08-18T22:07:29.474 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-08-18T22:07:29.474 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 300 2024-08-18T22:07:29.474 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-08-18T22:07:29.474 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-08-18T22:07:29.474 INFO:teuthology.orchestra.run.smithi123.stdout:max_xattr_size 65536 2024-08-18T22:07:29.474 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-08-18T22:07:29.474 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-08-18T22:07:29.474 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 0 2024-08-18T22:07:29.474 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-18T22:07:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 3 2024-08-18T22:07:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:in 0,1,2 2024-08-18T22:07:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=24466,1=24458,2=24448} 2024-08-18T22:07:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-08-18T22:07:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-08-18T22:07:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-08-18T22:07:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3,4] 2024-08-18T22:07:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-08-18T22:07:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data disabled 2024-08-18T22:07:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-08-18T22:07:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:bal_rank_mask -1 2024-08-18T22:07:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 0 2024-08-18T22:07:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:qdb_cluster leader: 24466 members: 24448,24458,24466 2024-08-18T22:07:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.i{0:24466} state up:active seq 7 addr [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:07:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.f{0:24442} state up:standby-replay seq 1 addr [v2:172.21.15.183:6834/1138667446,v1:172.21.15.183:6835/1138667446] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:07:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b{1:24458} state up:active seq 13 addr [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:07:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.h{1:24437} state up:standby-replay seq 1 addr [v2:172.21.15.130:6836/29028326,v1:172.21.15.130:6837/29028326] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:07:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c{2:24448} state up:active seq 17 addr [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:07:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.e{2:24422} state up:standby-replay seq 1 addr [v2:172.21.15.130:6834/579024659,v1:172.21.15.130:6835/579024659] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:07:29.476 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:29.476 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-08-18T22:07:29.476 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.j{-1:14517} state up:standby seq 1 addr [v2:172.21.15.123:6834/3015555290,v1:172.21.15.123:6835/3015555290] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:07:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d{-1:14529} state up:standby seq 1 addr [v2:172.21.15.123:6836/1466506081,v1:172.21.15.123:6837/1466506081] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:07:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.g{-1:14580} state up:standby seq 1 addr [v2:172.21.15.123:6838/1921278824,v1:172.21.15.123:6839/1921278824] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:07:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a{-1:14586} state up:standby seq 1 addr [v2:172.21.15.123:6840/344960390,v1:172.21.15.123:6841/344960390] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:07:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.k{-1:24407} state up:standby seq 1 addr [v2:172.21.15.130:6832/2515758332,v1:172.21.15.130:6833/2515758332] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:07:29.477 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.l{-1:24409} state up:standby seq 1 addr [v2:172.21.15.183:6832/3134276,v1:172.21.15.183:6833/3134276] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:07:29.477 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 25 2024-08-18T22:07:29.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.474+0000 7f8f86d5c640 1 -- 172.21.15.123:0/3312777856 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f6c0a2bb0 msgr2=0x7f8f6c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:29.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.474+0000 7f8f86d5c640 1 --2- 172.21.15.123:0/3312777856 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f6c0a2bb0 0x7f8f6c0a5070 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8f8019b350 tx=0x7f8f6800a4c0 comp rx=0 tx=0).stop 2024-08-18T22:07:29.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.474+0000 7f8f86d5c640 1 -- 172.21.15.123:0/3312777856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f80100200 msgr2=0x7f8f80199e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.474+0000 7f8f86d5c640 1 --2- 172.21.15.123:0/3312777856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f80100200 0x7f8f80199e30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800b4a0 tx=0x7f8f7800b960 comp rx=0 tx=0).stop 2024-08-18T22:07:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.474+0000 7f8f86d5c640 1 -- 172.21.15.123:0/3312777856 shutdown_connections 2024-08-18T22:07:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.474+0000 7f8f86d5c640 1 --2- 172.21.15.123:0/3312777856 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f6c0a2bb0 0x7f8f6c0a5070 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.474+0000 7f8f86d5c640 1 --2- 172.21.15.123:0/3312777856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f801014e0 0x7f8f801a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.474+0000 7f8f86d5c640 1 --2- 172.21.15.123:0/3312777856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f80100b40 0x7f8f8019a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.474+0000 7f8f86d5c640 1 --2- 172.21.15.123:0/3312777856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f80100200 0x7f8f80199e30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.474+0000 7f8f86d5c640 1 -- 172.21.15.123:0/3312777856 >> 172.21.15.123:0/3312777856 conn(0x7f8f800fbfb0 msgr2=0x7f8f800fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.474+0000 7f8f86d5c640 1 -- 172.21.15.123:0/3312777856 shutdown_connections 2024-08-18T22:07:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:29.474+0000 7f8f86d5c640 1 -- 172.21.15.123:0/3312777856 wait complete. 2024-08-18T22:07:29.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:29 smithi123 ceph-mon[18462]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:07:29.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:29 smithi130 ceph-mon[21698]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:07:29.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:29 smithi183 ceph-mon[22097]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:07:30.245 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- bash -c 'ceph osd dump' 2024-08-18T22:07:30.500 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:30.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:30 smithi123 ceph-mon[18462]: pgmap v332: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:30.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:30 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3312777856' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:07:30.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:30 smithi130 ceph-mon[21698]: pgmap v332: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:30.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:30 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3312777856' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:07:30.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:30 smithi183 ceph-mon[22097]: pgmap v332: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:30.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:30 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3312777856' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:07:30.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.958+0000 7f30c1e0c640 1 -- 172.21.15.123:0/1040653894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30bc1034f0 msgr2=0x7f30bc109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:30.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.958+0000 7f30c1e0c640 1 --2- 172.21.15.123:0/1040653894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30bc1034f0 0x7f30bc109d80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009ca0 tx=0x7f30b402a8c0 comp rx=0 tx=0).stop 2024-08-18T22:07:30.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.958+0000 7f30c1e0c640 1 -- 172.21.15.123:0/1040653894 shutdown_connections 2024-08-18T22:07:30.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.958+0000 7f30c1e0c640 1 --2- 172.21.15.123:0/1040653894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30bc1034f0 0x7f30bc109d80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:30.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.958+0000 7f30c1e0c640 1 --2- 172.21.15.123:0/1040653894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30bc102b30 0x7f30bc102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:30.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.958+0000 7f30c1e0c640 1 --2- 172.21.15.123:0/1040653894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30bc101930 0x7f30bc101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:30.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.958+0000 7f30c1e0c640 1 -- 172.21.15.123:0/1040653894 >> 172.21.15.123:0/1040653894 conn(0x7f30bc0fd0c0 msgr2=0x7f30bc0ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:30.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.958+0000 7f30c1e0c640 1 -- 172.21.15.123:0/1040653894 shutdown_connections 2024-08-18T22:07:30.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.958+0000 7f30c1e0c640 1 -- 172.21.15.123:0/1040653894 wait complete. 2024-08-18T22:07:30.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.958+0000 7f30c1e0c640 1 Processor -- start 2024-08-18T22:07:30.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30c1e0c640 1 -- start start 2024-08-18T22:07:30.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30c1e0c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30bc101930 0x7f30bc075cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:30.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30c1e0c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30bc102b30 0x7f30bc074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30c1e0c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30bc1034f0 0x7f30bc074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30c1e0c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc10d6b0 con 0x7f30bc102b30 2024-08-18T22:07:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30c1e0c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc10d530 con 0x7f30bc101930 2024-08-18T22:07:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30c1e0c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc10d830 con 0x7f30bc1034f0 2024-08-18T22:07:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30b2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30bc102b30 0x7f30bc074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30b2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30bc102b30 0x7f30bc074310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46154/0 (socket says 172.21.15.123:46154) 2024-08-18T22:07:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30b2ffd640 1 -- 172.21.15.123:0/244342055 learned_addr learned my addr 172.21.15.123:0/244342055 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30bb7fe640 1 --2- 172.21.15.123:0/244342055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30bc101930 0x7f30bc075cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30bbfff640 1 --2- 172.21.15.123:0/244342055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30bc1034f0 0x7f30bc074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30b2ffd640 1 -- 172.21.15.123:0/244342055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30bc1034f0 msgr2=0x7f30bc074850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30b2ffd640 1 --2- 172.21.15.123:0/244342055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30bc1034f0 0x7f30bc074850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30b2ffd640 1 -- 172.21.15.123:0/244342055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30bc101930 msgr2=0x7f30bc075cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30b2ffd640 1 --2- 172.21.15.123:0/244342055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30bc101930 0x7f30bc075cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:30.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30b2ffd640 1 -- 172.21.15.123:0/244342055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc075110 con 0x7f30bc102b30 2024-08-18T22:07:30.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30bb7fe640 1 --2- 172.21.15.123:0/244342055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30bc101930 0x7f30bc075cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:30.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.959+0000 7f30b2ffd640 1 --2- 172.21.15.123:0/244342055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30bc102b30 0x7f30bc074310 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f30a400b4a0 tx=0x7f30a400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:30.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.960+0000 7f30b97fa640 1 -- 172.21.15.123:0/244342055 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4014070 con 0x7f30bc102b30 2024-08-18T22:07:30.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.960+0000 7f30b97fa640 1 -- 172.21.15.123:0/244342055 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30a4010af0 con 0x7f30bc102b30 2024-08-18T22:07:30.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.960+0000 7f30c1e0c640 1 -- 172.21.15.123:0/244342055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30bc1a1ef0 con 0x7f30bc102b30 2024-08-18T22:07:30.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.960+0000 7f30b97fa640 1 -- 172.21.15.123:0/244342055 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4017d10 con 0x7f30bc102b30 2024-08-18T22:07:30.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.960+0000 7f30c1e0c640 1 -- 172.21.15.123:0/244342055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30bc1a23d0 con 0x7f30bc102b30 2024-08-18T22:07:30.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.961+0000 7f30c1e0c640 1 -- 172.21.15.123:0/244342055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30bc108d80 con 0x7f30bc102b30 2024-08-18T22:07:30.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.962+0000 7f30b97fa640 1 -- 172.21.15.123:0/244342055 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f30a4017070 con 0x7f30bc102b30 2024-08-18T22:07:30.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.962+0000 7f30b97fa640 1 --2- 172.21.15.123:0/244342055 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f30a80a2b80 0x7f30a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:30.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.963+0000 7f30b97fa640 1 -- 172.21.15.123:0/244342055 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f30a40ce7f0 con 0x7f30bc102b30 2024-08-18T22:07:30.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.963+0000 7f30bb7fe640 1 --2- 172.21.15.123:0/244342055 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f30a80a2b80 0x7f30a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:30.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.963+0000 7f30bb7fe640 1 --2- 172.21.15.123:0/244342055 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f30a80a2b80 0x7f30a80a5040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f30bc102990 tx=0x7f30ac008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:30.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:30.967+0000 7f30b97fa640 1 -- 172.21.15.123:0/244342055 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f30a409b3c0 con 0x7f30bc102b30 2024-08-18T22:07:31.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:31.135+0000 7f30c1e0c640 1 -- 172.21.15.123:0/244342055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f30bc02d5e0 con 0x7f30bc102b30 2024-08-18T22:07:31.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:31.136+0000 7f30b97fa640 1 -- 172.21.15.123:0/244342055 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v92) ==== 56+0+5683 (secure 0 0 0) 0x7f30a409acc0 con 0x7f30bc102b30 2024-08-18T22:07:31.136 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 92 2024-08-18T22:07:31.137 INFO:teuthology.orchestra.run.smithi123.stdout:fsid dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T22:07:31.137 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-08-18T21:58:23.301274+0000 2024-08-18T22:07:31.137 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-08-18T22:07:11.513362+0000 2024-08-18T22:07:31.137 INFO:teuthology.orchestra.run.smithi123.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-08-18T22:07:31.137 INFO:teuthology.orchestra.run.smithi123.stdout:crush_version 27 2024-08-18T22:07:31.137 INFO:teuthology.orchestra.run.smithi123.stdout:full_ratio 0.95 2024-08-18T22:07:31.137 INFO:teuthology.orchestra.run.smithi123.stdout:backfillfull_ratio 0.9 2024-08-18T22:07:31.137 INFO:teuthology.orchestra.run.smithi123.stdout:nearfull_ratio 0.85 2024-08-18T22:07:31.137 INFO:teuthology.orchestra.run.smithi123.stdout:require_min_compat_client luminous 2024-08-18T22:07:31.137 INFO:teuthology.orchestra.run.smithi123.stdout:min_compat_client luminous 2024-08-18T22:07:31.137 INFO:teuthology.orchestra.run.smithi123.stdout:require_osd_release squid 2024-08-18T22:07:31.137 INFO:teuthology.orchestra.run.smithi123.stdout:stretch_mode_enabled false 2024-08-18T22:07:31.137 INFO:teuthology.orchestra.run.smithi123.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-08-18T22:07:31.138 INFO:teuthology.orchestra.run.smithi123.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-08-18T22:07:31.138 INFO:teuthology.orchestra.run.smithi123.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-08-18T22:07:31.138 INFO:teuthology.orchestra.run.smithi123.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 88 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-08-18T22:07:31.138 INFO:teuthology.orchestra.run.smithi123.stdout:max_osd 12 2024-08-18T22:07:31.138 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 up in weight 1 up_from 8 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6802/2904363725,v1:172.21.15.123:6803/2904363725] [v2:172.21.15.123:6804/2904363725,v1:172.21.15.123:6805/2904363725] exists,up c488e31f-717b-4e62-9a65-2716c0c0b138 2024-08-18T22:07:31.138 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 up in weight 1 up_from 13 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6800/328938210,v1:172.21.15.130:6801/328938210] [v2:172.21.15.130:6802/328938210,v1:172.21.15.130:6803/328938210] exists,up fc6d894a-bf9f-45f3-9902-8fabe7a564ee 2024-08-18T22:07:31.138 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 up in weight 1 up_from 18 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6800/2507871173,v1:172.21.15.183:6801/2507871173] [v2:172.21.15.183:6802/2507871173,v1:172.21.15.183:6803/2507871173] exists,up 8d53b95f-7d21-4c8b-bdfb-de99b494ca99 2024-08-18T22:07:31.138 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 up in weight 1 up_from 25 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6810/969520577,v1:172.21.15.123:6811/969520577] [v2:172.21.15.123:6812/969520577,v1:172.21.15.123:6813/969520577] exists,up 80751174-10e5-4717-9f1b-2216aae9402c 2024-08-18T22:07:31.138 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 up in weight 1 up_from 32 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6808/3632746383,v1:172.21.15.130:6809/3632746383] [v2:172.21.15.130:6810/3632746383,v1:172.21.15.130:6811/3632746383] exists,up 489f811e-7dc9-4c1b-8c2a-3b7a52f40432 2024-08-18T22:07:31.138 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 up in weight 1 up_from 37 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6808/2372027015,v1:172.21.15.183:6809/2372027015] [v2:172.21.15.183:6810/2372027015,v1:172.21.15.183:6811/2372027015] exists,up 79675f4f-62df-4a95-9c74-4cf200b53e6b 2024-08-18T22:07:31.138 INFO:teuthology.orchestra.run.smithi123.stdout:osd.6 up in weight 1 up_from 44 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6818/1703847973,v1:172.21.15.123:6819/1703847973] [v2:172.21.15.123:6820/1703847973,v1:172.21.15.123:6821/1703847973] exists,up 4de09e6b-76c9-4dbf-99ee-b7a876b245b7 2024-08-18T22:07:31.138 INFO:teuthology.orchestra.run.smithi123.stdout:osd.7 up in weight 1 up_from 49 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6816/1750872957,v1:172.21.15.130:6817/1750872957] [v2:172.21.15.130:6818/1750872957,v1:172.21.15.130:6819/1750872957] exists,up dfe0b1bb-066d-4cd2-8089-b7719769d0da 2024-08-18T22:07:31.138 INFO:teuthology.orchestra.run.smithi123.stdout:osd.8 up in weight 1 up_from 56 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6816/1180542594,v1:172.21.15.183:6817/1180542594] [v2:172.21.15.183:6818/1180542594,v1:172.21.15.183:6819/1180542594] exists,up 457ed7c9-c4ab-4099-b8ef-e628f2a068db 2024-08-18T22:07:31.139 INFO:teuthology.orchestra.run.smithi123.stdout:osd.9 up in weight 1 up_from 64 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6826/2915312663,v1:172.21.15.123:6827/2915312663] [v2:172.21.15.123:6828/2915312663,v1:172.21.15.123:6829/2915312663] exists,up b869af87-d9cf-4504-b44e-e95d5a0e2e32 2024-08-18T22:07:31.139 INFO:teuthology.orchestra.run.smithi123.stdout:osd.10 up in weight 1 up_from 69 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6824/2924260086,v1:172.21.15.130:6825/2924260086] [v2:172.21.15.130:6826/2924260086,v1:172.21.15.130:6827/2924260086] exists,up ca063387-151b-4025-bed4-af51b9c4fa5d 2024-08-18T22:07:31.139 INFO:teuthology.orchestra.run.smithi123.stdout:osd.11 up in weight 1 up_from 76 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6824/739766724,v1:172.21.15.183:6825/739766724] [v2:172.21.15.183:6826/739766724,v1:172.21.15.183:6827/739766724] exists,up e39da61d-5326-4697-a188-321d5ba93b04 2024-08-18T22:07:31.139 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 2.b [8,11] 2024-08-18T22:07:31.139 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 2.14 [2,4] 2024-08-18T22:07:31.139 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 2.16 [2,4] 2024-08-18T22:07:31.139 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 2.1c [8,11] 2024-08-18T22:07:31.139 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 3.11 [5,9] 2024-08-18T22:07:31.139 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 3.13 [4,9] 2024-08-18T22:07:31.139 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 3.1d [4,8] 2024-08-18T22:07:31.139 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 3.24 [4,9] 2024-08-18T22:07:31.139 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 4.b [9,8] 2024-08-18T22:07:31.139 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 4.c [9,10] 2024-08-18T22:07:31.139 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 4.e [9,11] 2024-08-18T22:07:31.139 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 4.1c [5,8] 2024-08-18T22:07:31.140 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:6801/4048905381 expires 2024-08-19T21:59:09.243300+0000 2024-08-18T22:07:31.140 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:6800/4048905381 expires 2024-08-19T21:59:09.243300+0000 2024-08-18T22:07:31.140 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:0/3344429295 expires 2024-08-19T21:58:46.762466+0000 2024-08-18T22:07:31.140 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:0/1091246574 expires 2024-08-19T21:58:46.762466+0000 2024-08-18T22:07:31.140 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:0/1435078155 expires 2024-08-19T21:59:09.243300+0000 2024-08-18T22:07:31.140 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:0/3196395967 expires 2024-08-19T21:58:46.762466+0000 2024-08-18T22:07:31.140 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:0/3505218516 expires 2024-08-19T21:59:09.243300+0000 2024-08-18T22:07:31.140 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:0/2299071339 expires 2024-08-19T21:59:09.243300+0000 2024-08-18T22:07:31.140 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:6801/1909168969 expires 2024-08-19T21:58:46.762466+0000 2024-08-18T22:07:31.141 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:6800/1909168969 expires 2024-08-19T21:58:46.762466+0000 2024-08-18T22:07:31.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:31.138+0000 7f30c1e0c640 1 -- 172.21.15.123:0/244342055 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f30a80a2b80 msgr2=0x7f30a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:31.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:31.138+0000 7f30c1e0c640 1 --2- 172.21.15.123:0/244342055 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f30a80a2b80 0x7f30a80a5040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f30bc102990 tx=0x7f30ac008040 comp rx=0 tx=0).stop 2024-08-18T22:07:31.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:31.138+0000 7f30c1e0c640 1 -- 172.21.15.123:0/244342055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30bc102b30 msgr2=0x7f30bc074310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:31.138+0000 7f30c1e0c640 1 --2- 172.21.15.123:0/244342055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30bc102b30 0x7f30bc074310 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f30a400b4a0 tx=0x7f30a400b960 comp rx=0 tx=0).stop 2024-08-18T22:07:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:31.139+0000 7f30c1e0c640 1 -- 172.21.15.123:0/244342055 shutdown_connections 2024-08-18T22:07:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:31.139+0000 7f30c1e0c640 1 --2- 172.21.15.123:0/244342055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30bc1034f0 0x7f30bc074850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:31.139+0000 7f30c1e0c640 1 --2- 172.21.15.123:0/244342055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30bc102b30 0x7f30bc074310 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:31.139+0000 7f30c1e0c640 1 --2- 172.21.15.123:0/244342055 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f30a80a2b80 0x7f30a80a5040 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:31.139+0000 7f30c1e0c640 1 --2- 172.21.15.123:0/244342055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30bc101930 0x7f30bc075cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:31.139+0000 7f30c1e0c640 1 -- 172.21.15.123:0/244342055 >> 172.21.15.123:0/244342055 conn(0x7f30bc0fd0c0 msgr2=0x7f30bc105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:31.139+0000 7f30c1e0c640 1 -- 172.21.15.123:0/244342055 shutdown_connections 2024-08-18T22:07:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:31.139+0000 7f30c1e0c640 1 -- 172.21.15.123:0/244342055 wait complete. 2024-08-18T22:07:31.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:31 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/244342055' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-08-18T22:07:31.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:31 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/244342055' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-08-18T22:07:31.905 INFO:teuthology.run_tasks:Running task fs.ready... 2024-08-18T22:07:31.916 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:07:31.917 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:31 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/244342055' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-08-18T22:07:32.167 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:32.563 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:32 smithi123 ceph-mon[18462]: pgmap v333: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:32.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.641+0000 7f8a19962640 1 -- 172.21.15.123:0/3158210558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a14102250 msgr2=0x7f8a1410e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:32.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.641+0000 7f8a19962640 1 --2- 172.21.15.123:0/3158210558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a14102250 0x7f8a1410e780 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009cd0 tx=0x7f8a0c02a8e0 comp rx=0 tx=0).stop 2024-08-18T22:07:32.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.641+0000 7f8a19962640 1 -- 172.21.15.123:0/3158210558 shutdown_connections 2024-08-18T22:07:32.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.641+0000 7f8a19962640 1 --2- 172.21.15.123:0/3158210558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a14102250 0x7f8a1410e780 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:32.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.641+0000 7f8a19962640 1 --2- 172.21.15.123:0/3158210558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a141018b0 0x7f8a14101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.641+0000 7f8a19962640 1 --2- 172.21.15.123:0/3158210558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a141078b0 0x7f8a14107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.641+0000 7f8a19962640 1 -- 172.21.15.123:0/3158210558 >> 172.21.15.123:0/3158210558 conn(0x7f8a140fd5f0 msgr2=0x7f8a140ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.641+0000 7f8a19962640 1 -- 172.21.15.123:0/3158210558 shutdown_connections 2024-08-18T22:07:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.641+0000 7f8a19962640 1 -- 172.21.15.123:0/3158210558 wait complete. 2024-08-18T22:07:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.642+0000 7f8a19962640 1 Processor -- start 2024-08-18T22:07:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.642+0000 7f8a19962640 1 -- start start 2024-08-18T22:07:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.642+0000 7f8a19962640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a141018b0 0x7f8a14074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.642+0000 7f8a19962640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a14102250 0x7f8a14074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.642+0000 7f8a19962640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a141078b0 0x7f8a14074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.642+0000 7f8a19962640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8a14111cb0 con 0x7f8a141078b0 2024-08-18T22:07:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.642+0000 7f8a19962640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8a14111b30 con 0x7f8a14102250 2024-08-18T22:07:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.642+0000 7f8a19962640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8a14111e30 con 0x7f8a141018b0 2024-08-18T22:07:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.642+0000 7f8a137fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a141078b0 0x7f8a14074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.642+0000 7f8a137fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a141078b0 0x7f8a14074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46174/0 (socket says 172.21.15.123:46174) 2024-08-18T22:07:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.642+0000 7f8a137fe640 1 -- 172.21.15.123:0/4087232279 learned_addr learned my addr 172.21.15.123:0/4087232279 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.642+0000 7f8a0a7fc640 1 --2- 172.21.15.123:0/4087232279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a14102250 0x7f8a14074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.643+0000 7f8a12ffd640 1 --2- 172.21.15.123:0/4087232279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a141018b0 0x7f8a14074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.643+0000 7f8a137fe640 1 -- 172.21.15.123:0/4087232279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a141018b0 msgr2=0x7f8a14074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.643+0000 7f8a137fe640 1 --2- 172.21.15.123:0/4087232279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a141018b0 0x7f8a14074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.643+0000 7f8a137fe640 1 -- 172.21.15.123:0/4087232279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a14102250 msgr2=0x7f8a14074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.643+0000 7f8a137fe640 1 --2- 172.21.15.123:0/4087232279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a14102250 0x7f8a14074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.643+0000 7f8a137fe640 1 -- 172.21.15.123:0/4087232279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a141a6630 con 0x7f8a141078b0 2024-08-18T22:07:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.643+0000 7f8a12ffd640 1 --2- 172.21.15.123:0/4087232279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a141018b0 0x7f8a14074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.643+0000 7f8a137fe640 1 --2- 172.21.15.123:0/4087232279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a141078b0 0x7f8a14074ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c005cc0 tx=0x7f8a0c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.643+0000 7f8a18960640 1 -- 172.21.15.123:0/4087232279 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c004040 con 0x7f8a141078b0 2024-08-18T22:07:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.643+0000 7f8a18960640 1 -- 172.21.15.123:0/4087232279 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a0c0046c0 con 0x7f8a141078b0 2024-08-18T22:07:32.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.643+0000 7f8a19962640 1 -- 172.21.15.123:0/4087232279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a141a68c0 con 0x7f8a141078b0 2024-08-18T22:07:32.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.643+0000 7f8a18960640 1 -- 172.21.15.123:0/4087232279 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c046480 con 0x7f8a141078b0 2024-08-18T22:07:32.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.643+0000 7f8a19962640 1 -- 172.21.15.123:0/4087232279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a141a6e00 con 0x7f8a141078b0 2024-08-18T22:07:32.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.644+0000 7f8a19962640 1 -- 172.21.15.123:0/4087232279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a14101d10 con 0x7f8a141078b0 2024-08-18T22:07:32.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.645+0000 7f8a18960640 1 -- 172.21.15.123:0/4087232279 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f8a0c0305a0 con 0x7f8a141078b0 2024-08-18T22:07:32.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.646+0000 7f8a18960640 1 --2- 172.21.15.123:0/4087232279 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8a000a2b80 0x7f8a000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:32.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.646+0000 7f8a12ffd640 1 --2- 172.21.15.123:0/4087232279 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8a000a2b80 0x7f8a000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:32.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.646+0000 7f8a18960640 1 -- 172.21.15.123:0/4087232279 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8a0c02e030 con 0x7f8a141078b0 2024-08-18T22:07:32.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.647+0000 7f8a12ffd640 1 --2- 172.21.15.123:0/4087232279 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8a000a2b80 0x7f8a000a5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8a04005fd0 tx=0x7f8a04005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:32.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.650+0000 7f8a18960640 1 -- 172.21.15.123:0/4087232279 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f8a0c04b060 con 0x7f8a141078b0 2024-08-18T22:07:32.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:32 smithi130 ceph-mon[21698]: pgmap v333: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:32.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.850+0000 7f8a19962640 1 -- 172.21.15.123:0/4087232279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a14109e20 con 0x7f8a141078b0 2024-08-18T22:07:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.851+0000 7f8a18960640 1 -- 172.21.15.123:0/4087232279 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11918 (secure 0 0 0) 0x7f8a0c0bd810 con 0x7f8a141078b0 2024-08-18T22:07:32.852 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:32.852 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":25,"btime":"2024-08-18T22:06:00:456703+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:06:00.091798+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24448,24458,24466]},"id":1}]} 2024-08-18T22:07:32.853 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 25 2024-08-18T22:07:32.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.853+0000 7f8a19962640 1 -- 172.21.15.123:0/4087232279 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8a000a2b80 msgr2=0x7f8a000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:32.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.853+0000 7f8a19962640 1 --2- 172.21.15.123:0/4087232279 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8a000a2b80 0x7f8a000a5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8a04005fd0 tx=0x7f8a04005850 comp rx=0 tx=0).stop 2024-08-18T22:07:32.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.853+0000 7f8a19962640 1 -- 172.21.15.123:0/4087232279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a141078b0 msgr2=0x7f8a14074ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.853+0000 7f8a19962640 1 --2- 172.21.15.123:0/4087232279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a141078b0 0x7f8a14074ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c005cc0 tx=0x7f8a0c003970 comp rx=0 tx=0).stop 2024-08-18T22:07:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.853+0000 7f8a19962640 1 -- 172.21.15.123:0/4087232279 shutdown_connections 2024-08-18T22:07:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.853+0000 7f8a19962640 1 --2- 172.21.15.123:0/4087232279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a141078b0 0x7f8a14074ca0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.853+0000 7f8a19962640 1 --2- 172.21.15.123:0/4087232279 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8a000a2b80 0x7f8a000a5040 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.853+0000 7f8a19962640 1 --2- 172.21.15.123:0/4087232279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a14102250 0x7f8a14074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.853+0000 7f8a19962640 1 --2- 172.21.15.123:0/4087232279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a141018b0 0x7f8a14074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.853+0000 7f8a19962640 1 -- 172.21.15.123:0/4087232279 >> 172.21.15.123:0/4087232279 conn(0x7f8a140fd5f0 msgr2=0x7f8a140fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.853+0000 7f8a19962640 1 -- 172.21.15.123:0/4087232279 shutdown_connections 2024-08-18T22:07:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:32.853+0000 7f8a19962640 1 -- 172.21.15.123:0/4087232279 wait complete. 2024-08-18T22:07:32.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:32 smithi183 ceph-mon[22097]: pgmap v333: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:33.618 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:33 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/4087232279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:33.651 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:07:33.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:33 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/4087232279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:33.904 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:33.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:33 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/4087232279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:34.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.392+0000 7f1e0d16d640 1 -- 172.21.15.123:0/771268080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e081067b0 msgr2=0x7f1e08106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:34.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.392+0000 7f1e0d16d640 1 --2- 172.21.15.123:0/771268080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e081067b0 0x7f1e08106b90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009930 tx=0x7f1dfc02a420 comp rx=0 tx=0).stop 2024-08-18T22:07:34.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.392+0000 7f1e0d16d640 1 -- 172.21.15.123:0/771268080 shutdown_connections 2024-08-18T22:07:34.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.392+0000 7f1e0d16d640 1 --2- 172.21.15.123:0/771268080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e08101150 0x7f1e0810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:34.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.392+0000 7f1e0d16d640 1 --2- 172.21.15.123:0/771268080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e081007b0 0x7f1e08100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:34.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.392+0000 7f1e0d16d640 1 --2- 172.21.15.123:0/771268080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e081067b0 0x7f1e08106b90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:34.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.392+0000 7f1e0d16d640 1 -- 172.21.15.123:0/771268080 >> 172.21.15.123:0/771268080 conn(0x7f1e080fc4d0 msgr2=0x7f1e080fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:34.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.392+0000 7f1e0d16d640 1 -- 172.21.15.123:0/771268080 shutdown_connections 2024-08-18T22:07:34.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.393+0000 7f1e0d16d640 1 -- 172.21.15.123:0/771268080 wait complete. 2024-08-18T22:07:34.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.393+0000 7f1e0d16d640 1 Processor -- start 2024-08-18T22:07:34.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.393+0000 7f1e0d16d640 1 -- start start 2024-08-18T22:07:34.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0d16d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e081007b0 0x7f1e0819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:34.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0d16d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e08101150 0x7f1e0819a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:34.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0d16d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e081067b0 0x7f1e0819ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:34.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0d16d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1e08110bd0 con 0x7f1e08101150 2024-08-18T22:07:34.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0d16d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1e08110a50 con 0x7f1e081067b0 2024-08-18T22:07:34.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0d16d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1e08110d50 con 0x7f1e081007b0 2024-08-18T22:07:34.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e08101150 0x7f1e0819a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:34.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e08101150 0x7f1e0819a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48048/0 (socket says 172.21.15.123:48048) 2024-08-18T22:07:34.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0659c640 1 -- 172.21.15.123:0/3287993846 learned_addr learned my addr 172.21.15.123:0/3287993846 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:34.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0759e640 1 --2- 172.21.15.123:0/3287993846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e081067b0 0x7f1e0819ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:34.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e06d9d640 1 --2- 172.21.15.123:0/3287993846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e081007b0 0x7f1e0819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:34.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0659c640 1 -- 172.21.15.123:0/3287993846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e081007b0 msgr2=0x7f1e0819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:34.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0659c640 1 --2- 172.21.15.123:0/3287993846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e081007b0 0x7f1e0819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:34.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0659c640 1 -- 172.21.15.123:0/3287993846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e081067b0 msgr2=0x7f1e0819ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:34.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0659c640 1 --2- 172.21.15.123:0/3287993846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e081067b0 0x7f1e0819ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:34.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0659c640 1 -- 172.21.15.123:0/3287993846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0819f310 con 0x7f1e08101150 2024-08-18T22:07:34.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e06d9d640 1 --2- 172.21.15.123:0/3287993846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e081007b0 0x7f1e0819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:07:34.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0659c640 1 --2- 172.21.15.123:0/3287993846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e08101150 0x7f1e0819a8a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1df800cce0 tx=0x7f1df800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:34.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1deffff640 1 -- 172.21.15.123:0/3287993846 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df800f650 con 0x7f1e08101150 2024-08-18T22:07:34.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1deffff640 1 -- 172.21.15.123:0/3287993846 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1df800fcd0 con 0x7f1e08101150 2024-08-18T22:07:34.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1e0d16d640 1 -- 172.21.15.123:0/3287993846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0819f600 con 0x7f1e08101150 2024-08-18T22:07:34.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.394+0000 7f1deffff640 1 -- 172.21.15.123:0/3287993846 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df8018c70 con 0x7f1e08101150 2024-08-18T22:07:34.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.395+0000 7f1e0d16d640 1 -- 172.21.15.123:0/3287993846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e081a6ee0 con 0x7f1e08101150 2024-08-18T22:07:34.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.396+0000 7f1e0d16d640 1 -- 172.21.15.123:0/3287993846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e08100c10 con 0x7f1e08101150 2024-08-18T22:07:34.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.397+0000 7f1deffff640 1 -- 172.21.15.123:0/3287993846 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f1df800f7f0 con 0x7f1e08101150 2024-08-18T22:07:34.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.397+0000 7f1deffff640 1 --2- 172.21.15.123:0/3287993846 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1df00a2b80 0x7f1df00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:34.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.397+0000 7f1e06d9d640 1 --2- 172.21.15.123:0/3287993846 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1df00a2b80 0x7f1df00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:34.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.397+0000 7f1deffff640 1 -- 172.21.15.123:0/3287993846 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f1df80cfb70 con 0x7f1e08101150 2024-08-18T22:07:34.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.398+0000 7f1e06d9d640 1 --2- 172.21.15.123:0/3287993846 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1df00a2b80 0x7f1df00a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc000c00 tx=0x7f1dfc032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:34.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.401+0000 7f1deffff640 1 -- 172.21.15.123:0/3287993846 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1df8014030 con 0x7f1e08101150 2024-08-18T22:07:34.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.601+0000 7f1e0d16d640 1 -- 172.21.15.123:0/3287993846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e081a71d0 con 0x7f1e08101150 2024-08-18T22:07:34.603 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:34 smithi123 ceph-mon[18462]: pgmap v334: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:07:34.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.602+0000 7f1deffff640 1 -- 172.21.15.123:0/3287993846 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11918 (secure 0 0 0) 0x7f1df809c7d0 con 0x7f1e08101150 2024-08-18T22:07:34.604 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:34.604 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":25,"btime":"2024-08-18T22:06:00:456703+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:06:00.091798+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24448,24458,24466]},"id":1}]} 2024-08-18T22:07:34.604 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 25 2024-08-18T22:07:34.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.604+0000 7f1e0d16d640 1 -- 172.21.15.123:0/3287993846 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1df00a2b80 msgr2=0x7f1df00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:34.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.604+0000 7f1e0d16d640 1 --2- 172.21.15.123:0/3287993846 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1df00a2b80 0x7f1df00a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc000c00 tx=0x7f1dfc032d50 comp rx=0 tx=0).stop 2024-08-18T22:07:34.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.604+0000 7f1e0d16d640 1 -- 172.21.15.123:0/3287993846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e08101150 msgr2=0x7f1e0819a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:34.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.604+0000 7f1e0d16d640 1 --2- 172.21.15.123:0/3287993846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e08101150 0x7f1e0819a8a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1df800cce0 tx=0x7f1df800a620 comp rx=0 tx=0).stop 2024-08-18T22:07:34.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.604+0000 7f1e0d16d640 1 -- 172.21.15.123:0/3287993846 shutdown_connections 2024-08-18T22:07:34.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.604+0000 7f1e0d16d640 1 --2- 172.21.15.123:0/3287993846 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1df00a2b80 0x7f1df00a5040 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:34.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.604+0000 7f1e0d16d640 1 --2- 172.21.15.123:0/3287993846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e081067b0 0x7f1e0819ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:34.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.604+0000 7f1e0d16d640 1 --2- 172.21.15.123:0/3287993846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e08101150 0x7f1e0819a8a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:34.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.604+0000 7f1e0d16d640 1 --2- 172.21.15.123:0/3287993846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e081007b0 0x7f1e0819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:34.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.604+0000 7f1e0d16d640 1 -- 172.21.15.123:0/3287993846 >> 172.21.15.123:0/3287993846 conn(0x7f1e080fc4d0 msgr2=0x7f1e0806a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:34.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.605+0000 7f1e0d16d640 1 -- 172.21.15.123:0/3287993846 shutdown_connections 2024-08-18T22:07:34.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:34.605+0000 7f1e0d16d640 1 -- 172.21.15.123:0/3287993846 wait complete. 2024-08-18T22:07:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:34 smithi130 ceph-mon[21698]: pgmap v334: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:07:34.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:34 smithi183 ceph-mon[22097]: pgmap v334: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:07:35.434 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:07:35.689 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:35.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:35 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3287993846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:35.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:35 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3287993846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:35.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:35 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3287993846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:36.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.151+0000 7fd47be71640 1 -- 172.21.15.123:0/241299956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4741067b0 msgr2=0x7fd474106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:36.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.151+0000 7fd47be71640 1 --2- 172.21.15.123:0/241299956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4741067b0 0x7fd474106b90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd464009cd0 tx=0x7fd46402a8e0 comp rx=0 tx=0).stop 2024-08-18T22:07:36.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.151+0000 7fd47be71640 1 -- 172.21.15.123:0/241299956 shutdown_connections 2024-08-18T22:07:36.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.151+0000 7fd47be71640 1 --2- 172.21.15.123:0/241299956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd474101150 0x7fd47410d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:36.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.151+0000 7fd47be71640 1 --2- 172.21.15.123:0/241299956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4741007b0 0x7fd474100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:36.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.151+0000 7fd47be71640 1 --2- 172.21.15.123:0/241299956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4741067b0 0x7fd474106b90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:36.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.151+0000 7fd47be71640 1 -- 172.21.15.123:0/241299956 >> 172.21.15.123:0/241299956 conn(0x7fd4740fc4d0 msgr2=0x7fd4740fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:36.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.152+0000 7fd47be71640 1 -- 172.21.15.123:0/241299956 shutdown_connections 2024-08-18T22:07:36.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.152+0000 7fd47be71640 1 -- 172.21.15.123:0/241299956 wait complete. 2024-08-18T22:07:36.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.152+0000 7fd47be71640 1 Processor -- start 2024-08-18T22:07:36.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.152+0000 7fd47be71640 1 -- start start 2024-08-18T22:07:36.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.152+0000 7fd47be71640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4741007b0 0x7fd474198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:36.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.152+0000 7fd47be71640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd474101150 0x7fd474199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:36.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.152+0000 7fd47be71640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4741067b0 0x7fd4741a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:36.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.152+0000 7fd47be71640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd474110bd0 con 0x7fd4741067b0 2024-08-18T22:07:36.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.152+0000 7fd47be71640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd474110a50 con 0x7fd4741007b0 2024-08-18T22:07:36.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.152+0000 7fd47be71640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd474110d50 con 0x7fd474101150 2024-08-18T22:07:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.152+0000 7fd47a40e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4741067b0 0x7fd4741a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.152+0000 7fd47a40e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4741067b0 0x7fd4741a4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48076/0 (socket says 172.21.15.123:48076) 2024-08-18T22:07:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.153+0000 7fd47a40e640 1 -- 172.21.15.123:0/426446112 learned_addr learned my addr 172.21.15.123:0/426446112 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.153+0000 7fd47940c640 1 --2- 172.21.15.123:0/426446112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd474101150 0x7fd474199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.153+0000 7fd479c0d640 1 --2- 172.21.15.123:0/426446112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4741007b0 0x7fd474198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.153+0000 7fd47a40e640 1 -- 172.21.15.123:0/426446112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd474101150 msgr2=0x7fd474199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.153+0000 7fd47a40e640 1 --2- 172.21.15.123:0/426446112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd474101150 0x7fd474199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.153+0000 7fd47a40e640 1 -- 172.21.15.123:0/426446112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4741007b0 msgr2=0x7fd474198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.153+0000 7fd47a40e640 1 --2- 172.21.15.123:0/426446112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4741007b0 0x7fd474198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.153+0000 7fd47a40e640 1 -- 172.21.15.123:0/426446112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4741a45a0 con 0x7fd4741067b0 2024-08-18T22:07:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.153+0000 7fd479c0d640 1 --2- 172.21.15.123:0/426446112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4741007b0 0x7fd474198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.153+0000 7fd47a40e640 1 --2- 172.21.15.123:0/426446112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4741067b0 0x7fd4741a4060 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009fd0 tx=0x7fd46c00b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.153+0000 7fd472ffd640 1 -- 172.21.15.123:0/426446112 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c015020 con 0x7fd4741067b0 2024-08-18T22:07:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.153+0000 7fd472ffd640 1 -- 172.21.15.123:0/426446112 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd46c011d10 con 0x7fd4741067b0 2024-08-18T22:07:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.153+0000 7fd47be71640 1 -- 172.21.15.123:0/426446112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4741a4770 con 0x7fd4741067b0 2024-08-18T22:07:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.153+0000 7fd472ffd640 1 -- 172.21.15.123:0/426446112 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c00f2e0 con 0x7fd4741067b0 2024-08-18T22:07:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.153+0000 7fd47be71640 1 -- 172.21.15.123:0/426446112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4741a4c30 con 0x7fd4741067b0 2024-08-18T22:07:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.154+0000 7fd47be71640 1 -- 172.21.15.123:0/426446112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd474100c10 con 0x7fd4741067b0 2024-08-18T22:07:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.156+0000 7fd472ffd640 1 -- 172.21.15.123:0/426446112 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fd46c018020 con 0x7fd4741067b0 2024-08-18T22:07:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.157+0000 7fd472ffd640 1 --2- 172.21.15.123:0/426446112 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd45c0a2b80 0x7fd45c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.157+0000 7fd479c0d640 1 --2- 172.21.15.123:0/426446112 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd45c0a2b80 0x7fd45c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.157+0000 7fd472ffd640 1 -- 172.21.15.123:0/426446112 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fd46c0cf260 con 0x7fd4741067b0 2024-08-18T22:07:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.157+0000 7fd479c0d640 1 --2- 172.21.15.123:0/426446112 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd45c0a2b80 0x7fd45c0a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd464000f80 tx=0x7fd464009890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.160+0000 7fd472ffd640 1 -- 172.21.15.123:0/426446112 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd46c01f020 con 0x7fd4741067b0 2024-08-18T22:07:36.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.327+0000 7fd47be71640 1 -- 172.21.15.123:0/426446112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4741a4ef0 con 0x7fd4741067b0 2024-08-18T22:07:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.329+0000 7fd472ffd640 1 -- 172.21.15.123:0/426446112 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24810 (secure 0 0 0) 0x7fd46c09be30 con 0x7fd4741067b0 2024-08-18T22:07:36.330 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:36.331 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":92,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:07:11.513362+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:05:18.077632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:05:20.808463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:05:27.136662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:07:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.332+0000 7fd47be71640 1 -- 172.21.15.123:0/426446112 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd45c0a2b80 msgr2=0x7fd45c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.332+0000 7fd47be71640 1 --2- 172.21.15.123:0/426446112 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd45c0a2b80 0x7fd45c0a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd464000f80 tx=0x7fd464009890 comp rx=0 tx=0).stop 2024-08-18T22:07:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.332+0000 7fd47be71640 1 -- 172.21.15.123:0/426446112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4741067b0 msgr2=0x7fd4741a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.332+0000 7fd47be71640 1 --2- 172.21.15.123:0/426446112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4741067b0 0x7fd4741a4060 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009fd0 tx=0x7fd46c00b820 comp rx=0 tx=0).stop 2024-08-18T22:07:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.332+0000 7fd47be71640 1 -- 172.21.15.123:0/426446112 shutdown_connections 2024-08-18T22:07:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.332+0000 7fd47be71640 1 --2- 172.21.15.123:0/426446112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4741067b0 0x7fd4741a4060 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.332+0000 7fd47be71640 1 --2- 172.21.15.123:0/426446112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd474101150 0x7fd474199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.332+0000 7fd47be71640 1 --2- 172.21.15.123:0/426446112 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd45c0a2b80 0x7fd45c0a5040 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.332+0000 7fd47be71640 1 --2- 172.21.15.123:0/426446112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4741007b0 0x7fd474198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.332+0000 7fd47be71640 1 -- 172.21.15.123:0/426446112 >> 172.21.15.123:0/426446112 conn(0x7fd4740fc4d0 msgr2=0x7fd4740fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.332+0000 7fd47be71640 1 -- 172.21.15.123:0/426446112 shutdown_connections 2024-08-18T22:07:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:36.332+0000 7fd47be71640 1 -- 172.21.15.123:0/426446112 wait complete. 2024-08-18T22:07:36.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:36 smithi123 ceph-mon[18462]: pgmap v335: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:36.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:36 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/426446112' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:07:36.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:36 smithi130 ceph-mon[21698]: pgmap v335: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:36.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:36 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/426446112' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:07:36.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:36 smithi183 ceph-mon[22097]: pgmap v335: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:36.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:36 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/426446112' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:07:37.242 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-18T22:05:22.597053+0000', 'modified': '2024-08-18T22:06:00.091798+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24466, 'mds_1': 24458, 'mds_2': 24448}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24422': {'gid': 24422, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6835/579024659', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6834', 'nonce': 579024659}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 579024659}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6837/29028326', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6836', 'nonce': 29028326}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 29028326}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.183:6835/1138667446', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6834', 'nonce': 1138667446}, {'type': 'v1', 'addr': '172.21.15.183:6835', 'nonce': 1138667446}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.183:6837/1468802140', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6836', 'nonce': 1468802140}, {'type': 'v1', 'addr': '172.21.15.183:6837', 'nonce': 1468802140}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'b', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.130:6839/991946562', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6838', 'nonce': 991946562}, {'type': 'v1', 'addr': '172.21.15.130:6839', 'nonce': 991946562}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.183:6839/1902275683', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6838', 'nonce': 1902275683}, {'type': 'v1', 'addr': '172.21.15.183:6839', 'nonce': 1902275683}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24466, 'qdb_cluster': [24448, 24458, 24466]} 2024-08-18T22:07:37.243 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-18T22:07:37.243 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.c status 2024-08-18T22:07:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:37.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.962+0000 7f628d571640 1 -- 172.21.15.123:0/3197098914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6288101340 msgr2=0x7f6288101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:37.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.962+0000 7f628d571640 1 --2- 172.21.15.123:0/3197098914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6288101340 0x7f6288101720 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6278009900 tx=0x7f627802a410 comp rx=0 tx=0).stop 2024-08-18T22:07:37.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.962+0000 7f628d571640 1 -- 172.21.15.123:0/3197098914 shutdown_connections 2024-08-18T22:07:37.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.962+0000 7f628d571640 1 --2- 172.21.15.123:0/3197098914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6288105b30 0x7f628810d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.962+0000 7f628d571640 1 --2- 172.21.15.123:0/3197098914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6288101cf0 0x7f6288105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.962+0000 7f628d571640 1 --2- 172.21.15.123:0/3197098914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6288101340 0x7f6288101720 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.962+0000 7f628d571640 1 -- 172.21.15.123:0/3197098914 >> 172.21.15.123:0/3197098914 conn(0x7f62880fc2f0 msgr2=0x7f62880fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.962+0000 7f628d571640 1 -- 172.21.15.123:0/3197098914 shutdown_connections 2024-08-18T22:07:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.962+0000 7f628d571640 1 -- 172.21.15.123:0/3197098914 wait complete. 2024-08-18T22:07:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.962+0000 7f628d571640 1 Processor -- start 2024-08-18T22:07:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f628d571640 1 -- start start 2024-08-18T22:07:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f628d571640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6288101340 0x7f62881981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f628d571640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6288101cf0 0x7f6288198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f628d571640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6288105b30 0x7f628819cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f628d571640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6288110bd0 con 0x7f6288101cf0 2024-08-18T22:07:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f628d571640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6288110a50 con 0x7f6288101340 2024-08-18T22:07:37.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f628d571640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6288110d50 con 0x7f6288105b30 2024-08-18T22:07:37.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f627ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6288101cf0 0x7f6288198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:37.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f627ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6288101cf0 0x7f6288198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48080/0 (socket says 172.21.15.123:48080) 2024-08-18T22:07:37.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f627ffff640 1 -- 172.21.15.123:0/4203738436 learned_addr learned my addr 172.21.15.123:0/4203738436 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:37.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f6286ffd640 1 --2- 172.21.15.123:0/4203738436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6288101340 0x7f62881981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:37.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f62877fe640 1 --2- 172.21.15.123:0/4203738436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6288105b30 0x7f628819cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:37.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f627ffff640 1 -- 172.21.15.123:0/4203738436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6288105b30 msgr2=0x7f628819cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:37.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f627ffff640 1 --2- 172.21.15.123:0/4203738436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6288105b30 0x7f628819cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:37.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f627ffff640 1 -- 172.21.15.123:0/4203738436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6288101340 msgr2=0x7f62881981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:37.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f627ffff640 1 --2- 172.21.15.123:0/4203738436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6288101340 0x7f62881981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:37.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f627ffff640 1 -- 172.21.15.123:0/4203738436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628819d190 con 0x7f6288101cf0 2024-08-18T22:07:37.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f627ffff640 1 --2- 172.21.15.123:0/4203738436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6288101cf0 0x7f6288198720 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f627000b450 tx=0x7f627000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:37.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.963+0000 7f6284ff9640 1 -- 172.21.15.123:0/4203738436 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6270015020 con 0x7f6288101cf0 2024-08-18T22:07:37.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.964+0000 7f6284ff9640 1 -- 172.21.15.123:0/4203738436 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6270011d70 con 0x7f6288101cf0 2024-08-18T22:07:37.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.964+0000 7f628d571640 1 -- 172.21.15.123:0/4203738436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628819d480 con 0x7f6288101cf0 2024-08-18T22:07:37.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.964+0000 7f6284ff9640 1 -- 172.21.15.123:0/4203738436 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627000f340 con 0x7f6288101cf0 2024-08-18T22:07:37.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.964+0000 7f628d571640 1 -- 172.21.15.123:0/4203738436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62881a4d60 con 0x7f6288101cf0 2024-08-18T22:07:37.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.966+0000 7f6284ff9640 1 -- 172.21.15.123:0/4203738436 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f6270018020 con 0x7f6288101cf0 2024-08-18T22:07:37.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.966+0000 7f628f96f740 1 Processor -- start 2024-08-18T22:07:37.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.966+0000 7f628f96f740 1 -- start start 2024-08-18T22:07:37.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.966+0000 7f628f96f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfd630 0x55bdc4dfda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:37.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.966+0000 7f628f96f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e082d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:37.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.966+0000 7f628f96f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4e08810 0x55bdc4e0ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:37.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f628f96f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bdc4d62710 con 0x55bdc4e08810 2024-08-18T22:07:37.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f628f96f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bdc4cfa770 con 0x55bdc4dfdf50 2024-08-18T22:07:37.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f628f96f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bdc4d5e6d0 con 0x55bdc4dfd630 2024-08-18T22:07:37.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f6284ff9640 1 --2- 172.21.15.123:0/4203738436 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f62740a2b80 0x7f62740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:37.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f627ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4e08810 0x55bdc4e0ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:37.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f627ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4e08810 0x55bdc4e0ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48094/0 (socket says 172.21.15.123:48094) 2024-08-18T22:07:37.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f627ffff640 1 -- 172.21.15.123:0/987847051 learned_addr learned my addr 172.21.15.123:0/987847051 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:37.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f62877fe640 1 --2- 172.21.15.123:0/4203738436 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f62740a2b80 0x7f62740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:37.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f6286ffd640 1 --2- 172.21.15.123:0/987847051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:37.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f62877fe640 1 --2- 172.21.15.123:0/987847051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfd630 0x55bdc4dfda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:37.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f6284ff9640 1 -- 172.21.15.123:0/4203738436 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f62700ceee0 con 0x7f6288101cf0 2024-08-18T22:07:37.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f627ffff640 1 -- 172.21.15.123:0/987847051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfd630 msgr2=0x55bdc4dfda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:37.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f627ffff640 1 --2- 172.21.15.123:0/987847051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfd630 0x55bdc4dfda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:37.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f627ffff640 1 -- 172.21.15.123:0/987847051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4dfdf50 msgr2=0x55bdc4e082d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:37.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f627ffff640 1 --2- 172.21.15.123:0/987847051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e082d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:37.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f627ffff640 1 -- 172.21.15.123:0/987847051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdc4d013e0 con 0x55bdc4e08810 2024-08-18T22:07:37.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f62877fe640 1 --2- 172.21.15.123:0/987847051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfd630 0x55bdc4dfda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:37.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f627ffff640 1 --2- 172.21.15.123:0/987847051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4e08810 0x55bdc4e0ac00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f62700a3af0 tx=0x7f62700047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48adeef2038e391a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:37.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f62877fe640 1 --2- 172.21.15.123:0/4203738436 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f62740a2b80 0x7f62740a5040 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6280005fd0 tx=0x7f6280009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:37.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f627d7fa640 1 -- 172.21.15.123:0/987847051 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627009b3b0 con 0x55bdc4e08810 2024-08-18T22:07:37.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f627d7fa640 1 -- 172.21.15.123:0/987847051 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f627009f760 con 0x55bdc4e08810 2024-08-18T22:07:37.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.967+0000 7f627d7fa640 1 -- 172.21.15.123:0/987847051 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627009a800 con 0x55bdc4e08810 2024-08-18T22:07:37.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.968+0000 7f628f96f740 1 -- 172.21.15.123:0/987847051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4e08810 msgr2=0x55bdc4e0ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:37.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.968+0000 7f628f96f740 1 --2- 172.21.15.123:0/987847051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4e08810 0x55bdc4e0ac00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f62700a3af0 tx=0x7f62700047d0 comp rx=0 tx=0).stop 2024-08-18T22:07:37.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.968+0000 7f628f96f740 1 -- 172.21.15.123:0/987847051 shutdown_connections 2024-08-18T22:07:37.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.968+0000 7f628f96f740 1 --2- 172.21.15.123:0/987847051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4e08810 0x55bdc4e0ac00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:37.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.968+0000 7f628f96f740 1 --2- 172.21.15.123:0/987847051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:37.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.968+0000 7f628f96f740 1 --2- 172.21.15.123:0/987847051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfd630 0x55bdc4dfda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:37.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.968+0000 7f628f96f740 1 -- 172.21.15.123:0/987847051 >> 172.21.15.123:0/987847051 conn(0x55bdc4df9bc0 msgr2=0x55bdc4df9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:37.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.968+0000 7f628f96f740 1 -- 172.21.15.123:0/987847051 shutdown_connections 2024-08-18T22:07:37.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.968+0000 7f628f96f740 1 -- 172.21.15.123:0/987847051 wait complete. 2024-08-18T22:07:37.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f628f96f740 1 -- start start 2024-08-18T22:07:37.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f628f96f740 1 Processor -- start 2024-08-18T22:07:37.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f628f96f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4dfd630 0x55bdc4e056c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:37.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f628f96f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e05c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:37.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f628f96f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4e08810 0x55bdc4e06140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:37.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f628f96f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bdc4e0b3e0 con 0x55bdc4e08810 2024-08-18T22:07:37.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f628f96f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bdc4d1d970 con 0x55bdc4dfd630 2024-08-18T22:07:37.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f628f96f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bdc4e0b560 con 0x55bdc4dfdf50 2024-08-18T22:07:37.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f628f96f740 10 client.0 _ll_register_callbacks cb 0x55bdc4a717b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:37.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f62877fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4e08810 0x55bdc4e06140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:37.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f62877fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4e08810 0x55bdc4e06140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48106/0 (socket says 172.21.15.123:48106) 2024-08-18T22:07:37.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f62877fe640 1 -- 172.21.15.123:0/3638299445 learned_addr learned my addr 172.21.15.123:0/3638299445 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:37.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f6286ffd640 1 --2- 172.21.15.123:0/3638299445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4dfd630 0x55bdc4e056c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:37.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f627ffff640 1 --2- 172.21.15.123:0/3638299445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e05c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:37.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f62877fe640 1 -- 172.21.15.123:0/3638299445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfdf50 msgr2=0x55bdc4e05c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:37.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f62877fe640 1 --2- 172.21.15.123:0/3638299445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e05c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:37.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f62877fe640 1 -- 172.21.15.123:0/3638299445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4dfd630 msgr2=0x55bdc4e056c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:37.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f62877fe640 1 --2- 172.21.15.123:0/3638299445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4dfd630 0x55bdc4e056c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:37.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.969+0000 7f62877fe640 1 -- 172.21.15.123:0/3638299445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdc4ad42b0 con 0x55bdc4e08810 2024-08-18T22:07:37.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f62877fe640 1 --2- 172.21.15.123:0/3638299445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4e08810 0x55bdc4e06140 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f62800108e0 tx=0x7f6280004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fccb4bdf1abe861 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f626e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f626e7fc640 1 -- 172.21.15.123:0/3638299445 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628002c060 con 0x55bdc4e08810 2024-08-18T22:07:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f626e7fc640 1 -- 172.21.15.123:0/3638299445 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f628001d970 con 0x55bdc4e08810 2024-08-18T22:07:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f628f96f740 1 -- 172.21.15.123:0/3638299445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f627009f760 con 0x55bdc4e08810 2024-08-18T22:07:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f626e7fc640 1 -- 172.21.15.123:0/3638299445 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6280033050 con 0x55bdc4e08810 2024-08-18T22:07:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f628f96f740 10 client.15174 fetch_fsmap learned FSMap version 25 2024-08-18T22:07:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f628f96f740 1 -- 172.21.15.123:0/3638299445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bdc4e17010 con 0x55bdc4e08810 2024-08-18T22:07:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f626e7fc640 1 -- 172.21.15.123:0/3638299445 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f627009f760 con 0x55bdc4e08810 2024-08-18T22:07:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f626e7fc640 1 -- 172.21.15.123:0/3638299445 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f6280027c90 con 0x55bdc4e08810 2024-08-18T22:07:38.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f628f96f740 10 client.15174 fetch_fsmap finished waiting for FSMap version 25 2024-08-18T22:07:38.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f628f96f740 10 client.15174 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:07:38.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f628f96f740 20 client.15174 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:38.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f628f96f740 1 --2- 172.21.15.123:0/3638299445 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55bdc4e19650 0x55bdc4e1aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:38.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f628f96f740 4 client.15174 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:07:38.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.970+0000 7f628f96f740 1 -- 172.21.15.123:0/3638299445 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bdc4d6fc80 con 0x55bdc4e19650 2024-08-18T22:07:38.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.971+0000 7f6286ffd640 1 --2- 172.21.15.123:0/3638299445 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55bdc4e19650 0x55bdc4e1aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:38.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.971+0000 7f626e7fc640 10 client.15174 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:07:38.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.971+0000 7f6286ffd640 1 --2- 172.21.15.123:0/3638299445 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55bdc4e19650 0x55bdc4e1aac0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aa11fc4edd52177a server_cookie=f38d1d5f9cd7b20 in_seq=0 out_seq=0 2024-08-18T22:07:38.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.972+0000 7f626e7fc640 1 -- 172.21.15.123:0/3638299445 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bdc4d6fc80 con 0x55bdc4e19650 2024-08-18T22:07:38.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.972+0000 7f626e7fc640 10 client.15174 handle_command_reply: tid=0 2024-08-18T22:07:38.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.972+0000 7f628f96f740 1 client.15174 shutdown 2024-08-18T22:07:38.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.972+0000 7f628f96f740 1 -- 172.21.15.123:0/3638299445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4e08810 msgr2=0x55bdc4e06140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:38.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.972+0000 7f628f96f740 1 --2- 172.21.15.123:0/3638299445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4e08810 0x55bdc4e06140 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f62800108e0 tx=0x7f6280004ab0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.972+0000 7f628f96f740 1 -- 172.21.15.123:0/3638299445 shutdown_connections 2024-08-18T22:07:38.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.972+0000 7f628f96f740 1 --2- 172.21.15.123:0/3638299445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4e08810 0x55bdc4e06140 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.972+0000 7f628f96f740 1 --2- 172.21.15.123:0/3638299445 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55bdc4e19650 0x55bdc4e1aac0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.972+0000 7f628f96f740 1 --2- 172.21.15.123:0/3638299445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e05c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.972+0000 7f628f96f740 1 --2- 172.21.15.123:0/3638299445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4dfd630 0x55bdc4e056c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.972+0000 7f628f96f740 1 -- 172.21.15.123:0/3638299445 >> 172.21.15.123:0/3638299445 conn(0x55bdc4df9bc0 msgr2=0x55bdc4dff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:38.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.972+0000 7f626e7fc640 0 client.15174 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:07:38.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.972+0000 7f628f96f740 1 -- 172.21.15.123:0/3638299445 shutdown_connections 2024-08-18T22:07:38.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.972+0000 7f628f96f740 1 -- 172.21.15.123:0/3638299445 wait complete. 2024-08-18T22:07:38.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.972+0000 7f628f96f740 20 client.15174 trim_cache size 0 max 16384 2024-08-18T22:07:38.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.990+0000 7f628f96f740 1 Processor -- start 2024-08-18T22:07:38.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.990+0000 7f628f96f740 1 -- start start 2024-08-18T22:07:38.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.990+0000 7f628f96f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4dfd630 0x55bdc4e19d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:38.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.990+0000 7f628f96f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e18f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:38.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.990+0000 7f628f96f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4e08810 0x55bdc4e04fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:38.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.990+0000 7f628f96f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bdc4e18e00 con 0x55bdc4dfd630 2024-08-18T22:07:38.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.990+0000 7f628f96f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bdc4e194d0 con 0x55bdc4e08810 2024-08-18T22:07:38.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.990+0000 7f628f96f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bdc4e19ba0 con 0x55bdc4dfdf50 2024-08-18T22:07:38.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.990+0000 7f6286ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4dfd630 0x55bdc4e19d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:38.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.991+0000 7f6286ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4dfd630 0x55bdc4e19d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48108/0 (socket says 172.21.15.123:48108) 2024-08-18T22:07:38.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.991+0000 7f6286ffd640 1 -- 172.21.15.123:0/2821732758 learned_addr learned my addr 172.21.15.123:0/2821732758 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:38.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.991+0000 7f627ffff640 1 --2- 172.21.15.123:0/2821732758 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e18f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.991+0000 7f62877fe640 1 --2- 172.21.15.123:0/2821732758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4e08810 0x55bdc4e04fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.991+0000 7f6286ffd640 1 -- 172.21.15.123:0/2821732758 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfdf50 msgr2=0x55bdc4e18f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.991+0000 7f6286ffd640 1 --2- 172.21.15.123:0/2821732758 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e18f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.991+0000 7f6286ffd640 1 -- 172.21.15.123:0/2821732758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4e08810 msgr2=0x55bdc4e04fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.991+0000 7f6286ffd640 1 --2- 172.21.15.123:0/2821732758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4e08810 0x55bdc4e04fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.991+0000 7f6286ffd640 1 -- 172.21.15.123:0/2821732758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdc4df99f0 con 0x55bdc4dfd630 2024-08-18T22:07:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.991+0000 7f62877fe640 1 --2- 172.21.15.123:0/2821732758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4e08810 0x55bdc4e04fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.991+0000 7f6286ffd640 1 --2- 172.21.15.123:0/2821732758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4dfd630 0x55bdc4e19d20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f627802a930 tx=0x7f62780058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21ad98bf918ee79 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.991+0000 7f627cff9640 1 -- 172.21.15.123:0/2821732758 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627804a070 con 0x55bdc4dfd630 2024-08-18T22:07:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.991+0000 7f627cff9640 1 -- 172.21.15.123:0/2821732758 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6278004240 con 0x55bdc4dfd630 2024-08-18T22:07:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.991+0000 7f627cff9640 1 -- 172.21.15.123:0/2821732758 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278035040 con 0x55bdc4dfd630 2024-08-18T22:07:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.992+0000 7f628f96f740 1 -- 172.21.15.123:0/2821732758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4dfd630 msgr2=0x55bdc4e19d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.992+0000 7f628f96f740 1 --2- 172.21.15.123:0/2821732758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4dfd630 0x55bdc4e19d20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f627802a930 tx=0x7f62780058d0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.992+0000 7f628f96f740 1 -- 172.21.15.123:0/2821732758 shutdown_connections 2024-08-18T22:07:38.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.992+0000 7f628f96f740 1 --2- 172.21.15.123:0/2821732758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4e08810 0x55bdc4e04fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.992+0000 7f628f96f740 1 --2- 172.21.15.123:0/2821732758 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e18f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.992+0000 7f628f96f740 1 --2- 172.21.15.123:0/2821732758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4dfd630 0x55bdc4e19d20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.992+0000 7f628f96f740 1 -- 172.21.15.123:0/2821732758 >> 172.21.15.123:0/2821732758 conn(0x55bdc4df9bc0 msgr2=0x55bdc4df8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:38.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.992+0000 7f628f96f740 1 -- 172.21.15.123:0/2821732758 shutdown_connections 2024-08-18T22:07:38.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.992+0000 7f628f96f740 1 -- 172.21.15.123:0/2821732758 wait complete. 2024-08-18T22:07:38.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.992+0000 7f628f96f740 1 -- start start 2024-08-18T22:07:38.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.992+0000 7f628f96f740 1 Processor -- start 2024-08-18T22:07:38.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f628f96f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4dfd630 0x55bdc4e01ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:38.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f628f96f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e02010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:38.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f628f96f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4e08810 0x55bdc4e02550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:38.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f628f96f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bdc4e1a940 con 0x55bdc4dfd630 2024-08-18T22:07:38.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f628f96f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bdc4e1a270 con 0x55bdc4dfdf50 2024-08-18T22:07:38.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f628f96f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bdc4e1b010 con 0x55bdc4e08810 2024-08-18T22:07:38.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f628f96f740 10 client.0 _ll_register_callbacks cb 0x7f6280009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:38.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f6286ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4dfd630 0x55bdc4e01ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:38.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f6286ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4dfd630 0x55bdc4e01ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48120/0 (socket says 172.21.15.123:48120) 2024-08-18T22:07:38.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f6286ffd640 1 -- 172.21.15.123:0/3147589074 learned_addr learned my addr 172.21.15.123:0/3147589074 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:38.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f627ffff640 1 --2- 172.21.15.123:0/3147589074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e02010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:38.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f6286ffd640 1 -- 172.21.15.123:0/3147589074 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4e08810 msgr2=0x55bdc4e02550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:38.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f6286ffd640 1 --2- 172.21.15.123:0/3147589074 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4e08810 0x55bdc4e02550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f6286ffd640 1 -- 172.21.15.123:0/3147589074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4dfdf50 msgr2=0x55bdc4e02010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:38.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f6286ffd640 1 --2- 172.21.15.123:0/3147589074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e02010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f6286ffd640 1 -- 172.21.15.123:0/3147589074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdc4e21e90 con 0x55bdc4dfd630 2024-08-18T22:07:38.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f6286ffd640 1 --2- 172.21.15.123:0/3147589074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4dfd630 0x55bdc4e01ad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6278009900 tx=0x7f6278003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba0f5783a25b774 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:38.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f626e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:38.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f626e7fc640 1 -- 172.21.15.123:0/3147589074 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278035050 con 0x55bdc4dfd630 2024-08-18T22:07:38.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f626e7fc640 1 -- 172.21.15.123:0/3147589074 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f62780037f0 con 0x55bdc4dfd630 2024-08-18T22:07:38.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.993+0000 7f628f96f740 1 -- 172.21.15.123:0/3147589074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6278004240 con 0x55bdc4dfd630 2024-08-18T22:07:38.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.994+0000 7f626e7fc640 1 -- 172.21.15.123:0/3147589074 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6278061050 con 0x55bdc4dfd630 2024-08-18T22:07:38.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.994+0000 7f628f96f740 10 client.15180 fetch_fsmap learned FSMap version 25 2024-08-18T22:07:38.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.994+0000 7f628f96f740 1 -- 172.21.15.123:0/3147589074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bdc4e23190 con 0x55bdc4dfd630 2024-08-18T22:07:38.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.994+0000 7f626e7fc640 1 -- 172.21.15.123:0/3147589074 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6278004240 con 0x55bdc4dfd630 2024-08-18T22:07:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.994+0000 7f626e7fc640 1 -- 172.21.15.123:0/3147589074 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f6278004ab0 con 0x55bdc4dfd630 2024-08-18T22:07:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.994+0000 7f628f96f740 10 client.15180 fetch_fsmap finished waiting for FSMap version 25 2024-08-18T22:07:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.994+0000 7f628f96f740 10 client.15180 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:07:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.994+0000 7f628f96f740 20 client.15180 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.994+0000 7f628f96f740 1 --2- 172.21.15.123:0/3147589074 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55bdc4e87a10 0x55bdc4e86720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.994+0000 7f628f96f740 4 client.15180 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:07:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.994+0000 7f628f96f740 1 -- 172.21.15.123:0/3147589074 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "status"}) -- 0x55bdc4d6a190 con 0x55bdc4e87a10 2024-08-18T22:07:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.994+0000 7f627ffff640 1 --2- 172.21.15.123:0/3147589074 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55bdc4e87a10 0x55bdc4e86720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f626e7fc640 10 client.15180 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:07:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f627ffff640 1 --2- 172.21.15.123:0/3147589074 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55bdc4e87a10 0x55bdc4e86720 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=af5f476c7319ebf1 server_cookie=ffbf1fd0ba8bc2e in_seq=0 out_seq=0 2024-08-18T22:07:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f626e7fc640 1 -- 172.21.15.123:0/3147589074 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55bdc4d6a190 con 0x55bdc4e87a10 2024-08-18T22:07:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f626e7fc640 10 client.15180 handle_command_reply: tid=0 2024-08-18T22:07:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f628f96f740 1 client.15180 shutdown 2024-08-18T22:07:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f628f96f740 1 -- 172.21.15.123:0/3147589074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4dfd630 msgr2=0x55bdc4e01ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:38.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f628f96f740 1 --2- 172.21.15.123:0/3147589074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4dfd630 0x55bdc4e01ad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6278009900 tx=0x7f6278003f20 comp rx=0 tx=0).stop 2024-08-18T22:07:38.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f628f96f740 1 -- 172.21.15.123:0/3147589074 shutdown_connections 2024-08-18T22:07:38.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f628f96f740 1 --2- 172.21.15.123:0/3147589074 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x55bdc4e87a10 0x55bdc4e86720 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f628f96f740 1 --2- 172.21.15.123:0/3147589074 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bdc4e08810 0x55bdc4e02550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f626e7fc640 0 client.15180 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:07:38.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f628f96f740 1 --2- 172.21.15.123:0/3147589074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdc4dfdf50 0x55bdc4e02010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f628f96f740 1 --2- 172.21.15.123:0/3147589074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bdc4dfd630 0x55bdc4e01ad0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f628f96f740 1 -- 172.21.15.123:0/3147589074 >> 172.21.15.123:0/3147589074 conn(0x55bdc4df9bc0 msgr2=0x55bdc4e13fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:38.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f628f96f740 1 -- 172.21.15.123:0/3147589074 shutdown_connections 2024-08-18T22:07:38.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f628f96f740 1 -- 172.21.15.123:0/3147589074 wait complete. 2024-08-18T22:07:38.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.995+0000 7f628f96f740 20 client.15180 trim_cache size 0 max 16384 2024-08-18T22:07:38.014 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:07:38.014 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "dfa1db70-5dac-11ef-bccf-c7b262605968", 2024-08-18T22:07:38.014 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 2, 2024-08-18T22:07:38.015 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24448, 2024-08-18T22:07:38.015 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-08-18T22:07:38.015 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-08-18T22:07:38.015 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-08-18T22:07:38.015 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 100.548919342, 2024-08-18T22:07:38.015 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 25, 2024-08-18T22:07:38.015 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 92, 2024-08-18T22:07:38.015 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 88, 2024-08-18T22:07:38.015 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 160.65542111100001 2024-08-18T22:07:38.015 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:07:38.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.996+0000 7f628d571640 1 -- 172.21.15.123:0/4203738436 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f62740a2b80 msgr2=0x7f62740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:38.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.996+0000 7f628d571640 1 --2- 172.21.15.123:0/4203738436 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f62740a2b80 0x7f62740a5040 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6280005fd0 tx=0x7f6280009550 comp rx=0 tx=0).stop 2024-08-18T22:07:38.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.996+0000 7f628d571640 1 -- 172.21.15.123:0/4203738436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6288101cf0 msgr2=0x7f6288198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:38.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.996+0000 7f628d571640 1 --2- 172.21.15.123:0/4203738436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6288101cf0 0x7f6288198720 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f627000b450 tx=0x7f627000b910 comp rx=0 tx=0).stop 2024-08-18T22:07:38.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.996+0000 7f628d571640 1 -- 172.21.15.123:0/4203738436 shutdown_connections 2024-08-18T22:07:38.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.996+0000 7f628d571640 1 --2- 172.21.15.123:0/4203738436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6288105b30 0x7f628819cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.996+0000 7f628d571640 1 --2- 172.21.15.123:0/4203738436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6288101cf0 0x7f6288198720 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.996+0000 7f628d571640 1 --2- 172.21.15.123:0/4203738436 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f62740a2b80 0x7f62740a5040 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.996+0000 7f628d571640 1 --2- 172.21.15.123:0/4203738436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6288101340 0x7f62881981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:38.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.996+0000 7f628d571640 1 -- 172.21.15.123:0/4203738436 >> 172.21.15.123:0/4203738436 conn(0x7f62880fc2f0 msgr2=0x7f62881003d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:38.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.996+0000 7f628d571640 1 -- 172.21.15.123:0/4203738436 shutdown_connections 2024-08-18T22:07:38.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:37.996+0000 7f628d571640 1 -- 172.21.15.123:0/4203738436 wait complete. 2024-08-18T22:07:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:38 smithi123 ceph-mon[18462]: pgmap v336: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:38.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:38 smithi130 ceph-mon[21698]: pgmap v336: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:38.866 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.b status 2024-08-18T22:07:38.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:38 smithi183 ceph-mon[22097]: pgmap v336: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:39.117 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:39.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.629+0000 7f0bf60fe640 1 -- 172.21.15.123:0/3510307353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf01018c0 msgr2=0x7f0bf0101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:39.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.629+0000 7f0bf60fe640 1 --2- 172.21.15.123:0/3510307353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf01018c0 0x7f0bf0101d20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009930 tx=0x7f0bd802a420 comp rx=0 tx=0).stop 2024-08-18T22:07:39.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.629+0000 7f0bf60fe640 1 -- 172.21.15.123:0/3510307353 shutdown_connections 2024-08-18T22:07:39.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.629+0000 7f0bf60fe640 1 --2- 172.21.15.123:0/3510307353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bf0102260 0x7f0bf010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.629+0000 7f0bf60fe640 1 --2- 172.21.15.123:0/3510307353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf01018c0 0x7f0bf0101d20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.629+0000 7f0bf60fe640 1 --2- 172.21.15.123:0/3510307353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bf01078c0 0x7f0bf0107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.629+0000 7f0bf60fe640 1 -- 172.21.15.123:0/3510307353 >> 172.21.15.123:0/3510307353 conn(0x7f0bf00fd620 msgr2=0x7f0bf00ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:39.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.629+0000 7f0bf60fe640 1 -- 172.21.15.123:0/3510307353 shutdown_connections 2024-08-18T22:07:39.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.629+0000 7f0bf60fe640 1 -- 172.21.15.123:0/3510307353 wait complete. 2024-08-18T22:07:39.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.629+0000 7f0bf60fe640 1 Processor -- start 2024-08-18T22:07:39.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bf60fe640 1 -- start start 2024-08-18T22:07:39.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bf60fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf01018c0 0x7f0bf0074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bf60fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bf0102260 0x7f0bf0074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bf60fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bf01078c0 0x7f0bf0074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bf60fe640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf0111ce0 con 0x7f0bf01018c0 2024-08-18T22:07:39.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bf60fe640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf0111b60 con 0x7f0bf0102260 2024-08-18T22:07:39.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bf60fe640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf0111e60 con 0x7f0bf01078c0 2024-08-18T22:07:39.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf01018c0 0x7f0bf0074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf01018c0 0x7f0bf0074220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48142/0 (socket says 172.21.15.123:48142) 2024-08-18T22:07:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bef7fe640 1 -- 172.21.15.123:0/333935210 learned_addr learned my addr 172.21.15.123:0/333935210 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0beeffd640 1 --2- 172.21.15.123:0/333935210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bf0102260 0x7f0bf0074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0beffff640 1 --2- 172.21.15.123:0/333935210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bf01078c0 0x7f0bf0074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bef7fe640 1 -- 172.21.15.123:0/333935210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bf01078c0 msgr2=0x7f0bf0074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bef7fe640 1 --2- 172.21.15.123:0/333935210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bf01078c0 0x7f0bf0074ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bef7fe640 1 -- 172.21.15.123:0/333935210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bf0102260 msgr2=0x7f0bf0074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bef7fe640 1 --2- 172.21.15.123:0/333935210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bf0102260 0x7f0bf0074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bef7fe640 1 -- 172.21.15.123:0/333935210 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf01a6700 con 0x7f0bf01018c0 2024-08-18T22:07:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0beffff640 1 --2- 172.21.15.123:0/333935210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bf01078c0 0x7f0bf0074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:07:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.630+0000 7f0bef7fe640 1 --2- 172.21.15.123:0/333935210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf01018c0 0x7f0bf0074220 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0be000eab0 tx=0x7f0be000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.631+0000 7f0becff9640 1 -- 172.21.15.123:0/333935210 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be000ce40 con 0x7f0bf01018c0 2024-08-18T22:07:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.631+0000 7f0bf60fe640 1 -- 172.21.15.123:0/333935210 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf01a69f0 con 0x7f0bf01018c0 2024-08-18T22:07:39.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.631+0000 7f0becff9640 1 -- 172.21.15.123:0/333935210 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0be0011950 con 0x7f0bf01018c0 2024-08-18T22:07:39.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.631+0000 7f0bf60fe640 1 -- 172.21.15.123:0/333935210 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf01a6f50 con 0x7f0bf01018c0 2024-08-18T22:07:39.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.631+0000 7f0becff9640 1 -- 172.21.15.123:0/333935210 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0010ae0 con 0x7f0bf01018c0 2024-08-18T22:07:39.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.633+0000 7f0becff9640 1 -- 172.21.15.123:0/333935210 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f0be0011b00 con 0x7f0bf01018c0 2024-08-18T22:07:39.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.633+0000 7f0bf84fc740 1 Processor -- start 2024-08-18T22:07:39.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.633+0000 7f0bf84fc740 1 -- start start 2024-08-18T22:07:39.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.633+0000 7f0bf84fc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa25630 0x558b8fa25a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.633+0000 7f0bf84fc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa302d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.633+0000 7f0bf84fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa30810 0x558b8fa32c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.633+0000 7f0bf84fc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x558b8f98a710 con 0x558b8fa25f50 2024-08-18T22:07:39.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.633+0000 7f0bf84fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558b8f922770 con 0x558b8fa30810 2024-08-18T22:07:39.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.633+0000 7f0bf84fc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558b8f9866d0 con 0x558b8fa25630 2024-08-18T22:07:39.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0bef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa302d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0bef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa302d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48154/0 (socket says 172.21.15.123:48154) 2024-08-18T22:07:39.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0bef7fe640 1 -- 172.21.15.123:0/382164507 learned_addr learned my addr 172.21.15.123:0/382164507 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:39.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0beffff640 1 --2- 172.21.15.123:0/382164507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa25630 0x558b8fa25a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0becff9640 1 --2- 172.21.15.123:0/333935210 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0bdc0a2b80 0x7f0bdc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0beeffd640 1 --2- 172.21.15.123:0/382164507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa30810 0x558b8fa32c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0beffff640 1 --2- 172.21.15.123:0/333935210 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0bdc0a2b80 0x7f0bdc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0bef7fe640 1 -- 172.21.15.123:0/382164507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa25630 msgr2=0x558b8fa25a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:39.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0bef7fe640 1 --2- 172.21.15.123:0/382164507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa25630 0x558b8fa25a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0bef7fe640 1 -- 172.21.15.123:0/382164507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa30810 msgr2=0x558b8fa32c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:39.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0bef7fe640 1 --2- 172.21.15.123:0/382164507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa30810 0x558b8fa32c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0bef7fe640 1 -- 172.21.15.123:0/382164507 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8f9293e0 con 0x558b8fa25f50 2024-08-18T22:07:39.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0becff9640 1 -- 172.21.15.123:0/333935210 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0be00cfac0 con 0x7f0bf01018c0 2024-08-18T22:07:39.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0bef7fe640 1 --2- 172.21.15.123:0/382164507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa302d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0be0098960 tx=0x7f0be009bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d9a6aea739473b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:39.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0beffff640 1 --2- 172.21.15.123:0/333935210 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0bdc0a2b80 0x7f0bdc0a5040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0be800af50 tx=0x7f0be80046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:39.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0be5ffb640 1 -- 172.21.15.123:0/382164507 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be00bc070 con 0x558b8fa25f50 2024-08-18T22:07:39.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0be5ffb640 1 -- 172.21.15.123:0/382164507 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0be009c690 con 0x558b8fa25f50 2024-08-18T22:07:39.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.634+0000 7f0be5ffb640 1 -- 172.21.15.123:0/382164507 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0098600 con 0x558b8fa25f50 2024-08-18T22:07:39.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.635+0000 7f0bf84fc740 1 -- 172.21.15.123:0/382164507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 msgr2=0x558b8fa302d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:39.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.635+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/382164507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa302d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0be0098960 tx=0x7f0be009bc00 comp rx=0 tx=0).stop 2024-08-18T22:07:39.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.635+0000 7f0bf84fc740 1 -- 172.21.15.123:0/382164507 shutdown_connections 2024-08-18T22:07:39.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.635+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/382164507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa30810 0x558b8fa32c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.635+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/382164507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa302d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.635+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/382164507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa25630 0x558b8fa25a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.635+0000 7f0bf84fc740 1 -- 172.21.15.123:0/382164507 >> 172.21.15.123:0/382164507 conn(0x558b8fa21bc0 msgr2=0x558b8fa21fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:39.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.635+0000 7f0bf84fc740 1 -- 172.21.15.123:0/382164507 shutdown_connections 2024-08-18T22:07:39.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.635+0000 7f0bf84fc740 1 -- 172.21.15.123:0/382164507 wait complete. 2024-08-18T22:07:39.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.636+0000 7f0bf84fc740 1 -- start start 2024-08-18T22:07:39.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.636+0000 7f0bf84fc740 1 Processor -- start 2024-08-18T22:07:39.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.636+0000 7f0bf84fc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa25630 0x558b8fa2d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.636+0000 7f0bf84fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa25f50 0x558b8fa2db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.636+0000 7f0bf84fc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa30810 0x558b8fa2e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.636+0000 7f0bf84fc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x558b8fa333e0 con 0x558b8fa30810 2024-08-18T22:07:39.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.636+0000 7f0bf84fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558b8f945970 con 0x558b8fa25f50 2024-08-18T22:07:39.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.636+0000 7f0bf84fc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558b8fa33560 con 0x558b8fa25630 2024-08-18T22:07:39.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.636+0000 7f0bf84fc740 10 client.0 _ll_register_callbacks cb 0x558b8f6997b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:39.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.636+0000 7f0beffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa30810 0x558b8fa2e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.636+0000 7f0bef7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa25630 0x558b8fa2d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.636+0000 7f0beffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa30810 0x558b8fa2e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48162/0 (socket says 172.21.15.123:48162) 2024-08-18T22:07:39.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.636+0000 7f0beffff640 1 -- 172.21.15.123:0/1428537096 learned_addr learned my addr 172.21.15.123:0/1428537096 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:39.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.636+0000 7f0beeffd640 1 --2- 172.21.15.123:0/1428537096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa25f50 0x558b8fa2db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.637+0000 7f0beffff640 1 -- 172.21.15.123:0/1428537096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa25630 msgr2=0x558b8fa2d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:39.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.637+0000 7f0beffff640 1 --2- 172.21.15.123:0/1428537096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa25630 0x558b8fa2d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.637+0000 7f0beffff640 1 -- 172.21.15.123:0/1428537096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa25f50 msgr2=0x558b8fa2db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:39.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.637+0000 7f0beffff640 1 --2- 172.21.15.123:0/1428537096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa25f50 0x558b8fa2db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.637+0000 7f0beffff640 1 -- 172.21.15.123:0/1428537096 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b8f6fc2b0 con 0x558b8fa30810 2024-08-18T22:07:39.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.637+0000 7f0bef7fe640 1 --2- 172.21.15.123:0/1428537096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa25630 0x558b8fa2d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:07:39.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.637+0000 7f0beffff640 1 --2- 172.21.15.123:0/1428537096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa30810 0x558b8fa2e0d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0be80167b0 tx=0x7f0be80047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4c567568517af2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:39.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.637+0000 7f0bceffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:39.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.637+0000 7f0bceffd640 1 -- 172.21.15.123:0/1428537096 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8026060 con 0x558b8fa30810 2024-08-18T22:07:39.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.637+0000 7f0bceffd640 1 -- 172.21.15.123:0/1428537096 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0be8015b10 con 0x558b8fa30810 2024-08-18T22:07:39.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.637+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1428537096 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0be009c690 con 0x558b8fa30810 2024-08-18T22:07:39.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.637+0000 7f0bceffd640 1 -- 172.21.15.123:0/1428537096 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0be802d050 con 0x558b8fa30810 2024-08-18T22:07:39.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.637+0000 7f0bf84fc740 10 client.15192 fetch_fsmap learned FSMap version 25 2024-08-18T22:07:39.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.637+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1428537096 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558b8fa3efb0 con 0x558b8fa30810 2024-08-18T22:07:39.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.637+0000 7f0bceffd640 1 -- 172.21.15.123:0/1428537096 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0be009c690 con 0x558b8fa30810 2024-08-18T22:07:39.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.638+0000 7f0bceffd640 1 -- 172.21.15.123:0/1428537096 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f0be8015070 con 0x558b8fa30810 2024-08-18T22:07:39.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.638+0000 7f0bf84fc740 10 client.15192 fetch_fsmap finished waiting for FSMap version 25 2024-08-18T22:07:39.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.638+0000 7f0bf84fc740 10 client.15192 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-18T22:07:39.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.638+0000 7f0bf84fc740 20 client.15192 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:39.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.638+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/1428537096 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x558b8fa415d0 0x558b8fa42a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.638+0000 7f0bf84fc740 4 client.15192 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:07:39.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.638+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1428537096 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b8f997c80 con 0x558b8fa415d0 2024-08-18T22:07:39.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.638+0000 7f0bef7fe640 1 --2- 172.21.15.123:0/1428537096 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x558b8fa415d0 0x558b8fa42a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.638+0000 7f0bef7fe640 1 --2- 172.21.15.123:0/1428537096 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x558b8fa415d0 0x558b8fa42a40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=efd43dc56ef9b3bb server_cookie=c2405cff9634f819 in_seq=0 out_seq=0 2024-08-18T22:07:39.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.638+0000 7f0bceffd640 10 client.15192 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:07:39.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.639+0000 7f0bceffd640 1 -- 172.21.15.123:0/1428537096 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b8f997c80 con 0x558b8fa415d0 2024-08-18T22:07:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.639+0000 7f0bceffd640 10 client.15192 handle_command_reply: tid=0 2024-08-18T22:07:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.639+0000 7f0bf84fc740 1 client.15192 shutdown 2024-08-18T22:07:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.639+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1428537096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa30810 msgr2=0x558b8fa2e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.639+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/1428537096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa30810 0x558b8fa2e0d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0be80167b0 tx=0x7f0be80047d0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.639+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1428537096 shutdown_connections 2024-08-18T22:07:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.639+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/1428537096 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x558b8fa415d0 0x558b8fa42a40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.639+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/1428537096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa30810 0x558b8fa2e0d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.639+0000 7f0bceffd640 0 client.15192 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:07:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.639+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/1428537096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa25f50 0x558b8fa2db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.639+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/1428537096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa25630 0x558b8fa2d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.639+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1428537096 >> 172.21.15.123:0/1428537096 conn(0x558b8fa21bc0 msgr2=0x558b8fa278f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.640+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1428537096 shutdown_connections 2024-08-18T22:07:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.640+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1428537096 wait complete. 2024-08-18T22:07:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.640+0000 7f0bf84fc740 20 client.15192 trim_cache size 0 max 16384 2024-08-18T22:07:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.657+0000 7f0bf84fc740 1 Processor -- start 2024-08-18T22:07:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.657+0000 7f0bf84fc740 1 -- start start 2024-08-18T22:07:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.657+0000 7f0bf84fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa25630 0x558b8fa41ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.657+0000 7f0bf84fc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa2cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.657+0000 7f0bf84fc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa30810 0x558b8fa27790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.657+0000 7f0bf84fc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x558b8fa40d80 con 0x558b8fa25f50 2024-08-18T22:07:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.657+0000 7f0bf84fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558b8fa41450 con 0x558b8fa25630 2024-08-18T22:07:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.657+0000 7f0bf84fc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558b8fa41b20 con 0x558b8fa30810 2024-08-18T22:07:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.658+0000 7f0beeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa2cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.658+0000 7f0beeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa2cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48176/0 (socket says 172.21.15.123:48176) 2024-08-18T22:07:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.658+0000 7f0beeffd640 1 -- 172.21.15.123:0/3009483277 learned_addr learned my addr 172.21.15.123:0/3009483277 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.658+0000 7f0beffff640 1 --2- 172.21.15.123:0/3009483277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa30810 0x558b8fa27790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.658+0000 7f0beeffd640 1 -- 172.21.15.123:0/3009483277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa30810 msgr2=0x558b8fa27790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.658+0000 7f0beeffd640 1 --2- 172.21.15.123:0/3009483277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa30810 0x558b8fa27790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.658+0000 7f0beeffd640 1 -- 172.21.15.123:0/3009483277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa25630 msgr2=0x558b8fa41ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.658+0000 7f0beeffd640 1 --2- 172.21.15.123:0/3009483277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa25630 0x558b8fa41ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.658+0000 7f0beeffd640 1 -- 172.21.15.123:0/3009483277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8fa219f0 con 0x558b8fa25f50 2024-08-18T22:07:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.658+0000 7f0beeffd640 1 --2- 172.21.15.123:0/3009483277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa2cf30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0bd802a940 tx=0x7f0bd8031880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63eeefba27f3373 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.658+0000 7f0be57fa640 1 -- 172.21.15.123:0/3009483277 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8035040 con 0x558b8fa25f50 2024-08-18T22:07:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.658+0000 7f0be57fa640 1 -- 172.21.15.123:0/3009483277 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bd8005020 con 0x558b8fa25f50 2024-08-18T22:07:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.658+0000 7f0be57fa640 1 -- 172.21.15.123:0/3009483277 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8004b20 con 0x558b8fa25f50 2024-08-18T22:07:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.659+0000 7f0bf84fc740 1 -- 172.21.15.123:0/3009483277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 msgr2=0x558b8fa2cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.659+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/3009483277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa2cf30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0bd802a940 tx=0x7f0bd8031880 comp rx=0 tx=0).stop 2024-08-18T22:07:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.659+0000 7f0bf84fc740 1 -- 172.21.15.123:0/3009483277 shutdown_connections 2024-08-18T22:07:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.659+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/3009483277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa30810 0x558b8fa27790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.659+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/3009483277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa2cf30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.659+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/3009483277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa25630 0x558b8fa41ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.659+0000 7f0bf84fc740 1 -- 172.21.15.123:0/3009483277 >> 172.21.15.123:0/3009483277 conn(0x558b8fa21bc0 msgr2=0x558b8fa27080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:39.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.659+0000 7f0bf84fc740 1 -- 172.21.15.123:0/3009483277 shutdown_connections 2024-08-18T22:07:39.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.659+0000 7f0bf84fc740 1 -- 172.21.15.123:0/3009483277 wait complete. 2024-08-18T22:07:39.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.659+0000 7f0bf84fc740 1 -- start start 2024-08-18T22:07:39.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.659+0000 7f0bf84fc740 1 Processor -- start 2024-08-18T22:07:39.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0bf84fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa25630 0x558b8fa4b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0bf84fc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa44820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0bf84fc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa30810 0x558b8fa44d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0bf84fc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x558b8fa428c0 con 0x558b8fa25f50 2024-08-18T22:07:39.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0bf84fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558b8fa421f0 con 0x558b8fa25630 2024-08-18T22:07:39.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0bf84fc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558b8fa42f90 con 0x558b8fa30810 2024-08-18T22:07:39.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0bf84fc740 10 client.0 _ll_register_callbacks cb 0x7f0be8016430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:39.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0beeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa44820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0beeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa44820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48184/0 (socket says 172.21.15.123:48184) 2024-08-18T22:07:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0beeffd640 1 -- 172.21.15.123:0/1389290467 learned_addr learned my addr 172.21.15.123:0/1389290467 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0bef7fe640 1 --2- 172.21.15.123:0/1389290467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa25630 0x558b8fa4b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0beffff640 1 --2- 172.21.15.123:0/1389290467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa30810 0x558b8fa44d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0beeffd640 1 -- 172.21.15.123:0/1389290467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa30810 msgr2=0x558b8fa44d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0beeffd640 1 --2- 172.21.15.123:0/1389290467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa30810 0x558b8fa44d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0beeffd640 1 -- 172.21.15.123:0/1389290467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa25630 msgr2=0x558b8fa4b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0beeffd640 1 --2- 172.21.15.123:0/1389290467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa25630 0x558b8fa4b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0beeffd640 1 -- 172.21.15.123:0/1389290467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b8fa1d130 con 0x558b8fa25f50 2024-08-18T22:07:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0beeffd640 1 --2- 172.21.15.123:0/1389290467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa44820 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8006010 tx=0x7f0bd802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9d62cd0d0fd51d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0bceffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0bceffd640 1 -- 172.21.15.123:0/1389290467 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8035040 con 0x558b8fa25f50 2024-08-18T22:07:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0bceffd640 1 -- 172.21.15.123:0/1389290467 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0bd8004ab0 con 0x558b8fa25f50 2024-08-18T22:07:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.660+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1389290467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bd8005020 con 0x558b8fa25f50 2024-08-18T22:07:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.661+0000 7f0bceffd640 1 -- 172.21.15.123:0/1389290467 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0bd8059050 con 0x558b8fa25f50 2024-08-18T22:07:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.661+0000 7f0bf84fc740 10 client.15198 fetch_fsmap learned FSMap version 25 2024-08-18T22:07:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.661+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1389290467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558b8fab44f0 con 0x558b8fa25f50 2024-08-18T22:07:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.661+0000 7f0bceffd640 1 -- 172.21.15.123:0/1389290467 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bd8005020 con 0x558b8fa25f50 2024-08-18T22:07:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.661+0000 7f0bceffd640 1 -- 172.21.15.123:0/1389290467 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f0bd803db70 con 0x558b8fa25f50 2024-08-18T22:07:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.661+0000 7f0bf84fc740 10 client.15198 fetch_fsmap finished waiting for FSMap version 25 2024-08-18T22:07:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.661+0000 7f0bf84fc740 10 client.15198 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-18T22:07:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.661+0000 7f0bf84fc740 20 client.15198 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.661+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/1389290467 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x558b8fa415d0 0x558b8fab7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.661+0000 7f0bf84fc740 4 client.15198 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:07:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.661+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1389290467 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "status"}) -- 0x558b8f992190 con 0x558b8fa415d0 2024-08-18T22:07:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.661+0000 7f0bef7fe640 1 --2- 172.21.15.123:0/1389290467 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x558b8fa415d0 0x558b8fab7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bceffd640 10 client.15198 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:07:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bef7fe640 1 --2- 172.21.15.123:0/1389290467 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x558b8fa415d0 0x558b8fab7750 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=35b469fa58628c4c server_cookie=680c62e66a323d1a in_seq=0 out_seq=0 2024-08-18T22:07:39.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bceffd640 1 -- 172.21.15.123:0/1389290467 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558b8f992190 con 0x558b8fa415d0 2024-08-18T22:07:39.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bceffd640 10 client.15198 handle_command_reply: tid=0 2024-08-18T22:07:39.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bf84fc740 1 client.15198 shutdown 2024-08-18T22:07:39.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1389290467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 msgr2=0x558b8fa44820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:39.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/1389290467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa44820 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8006010 tx=0x7f0bd802a420 comp rx=0 tx=0).stop 2024-08-18T22:07:39.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1389290467 shutdown_connections 2024-08-18T22:07:39.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/1389290467 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x558b8fa415d0 0x558b8fab7750 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/1389290467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8fa30810 0x558b8fa44d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/1389290467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558b8fa25f50 0x558b8fa44820 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bf84fc740 1 --2- 172.21.15.123:0/1389290467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b8fa25630 0x558b8fa4b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1389290467 >> 172.21.15.123:0/1389290467 conn(0x558b8fa21bc0 msgr2=0x558b8fa278a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:39.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bceffd640 0 client.15198 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:07:39.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1389290467 shutdown_connections 2024-08-18T22:07:39.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bf84fc740 1 -- 172.21.15.123:0/1389290467 wait complete. 2024-08-18T22:07:39.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.662+0000 7f0bf84fc740 20 client.15198 trim_cache size 0 max 16384 2024-08-18T22:07:39.726 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:07:39.726 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "dfa1db70-5dac-11ef-bccf-c7b262605968", 2024-08-18T22:07:39.726 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 1, 2024-08-18T22:07:39.726 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24458, 2024-08-18T22:07:39.726 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-08-18T22:07:39.726 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-08-18T22:07:39.726 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-08-18T22:07:39.726 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 103.224628835, 2024-08-18T22:07:39.727 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 25, 2024-08-18T22:07:39.727 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 92, 2024-08-18T22:07:39.727 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 88, 2024-08-18T22:07:39.727 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 148.01417406600001 2024-08-18T22:07:39.727 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:07:39.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.663+0000 7f0bf60fe640 1 -- 172.21.15.123:0/333935210 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0bdc0a2b80 msgr2=0x7f0bdc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:39.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.663+0000 7f0bf60fe640 1 --2- 172.21.15.123:0/333935210 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0bdc0a2b80 0x7f0bdc0a5040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0be800af50 tx=0x7f0be80046c0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.663+0000 7f0bf60fe640 1 -- 172.21.15.123:0/333935210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf01018c0 msgr2=0x7f0bf0074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.663+0000 7f0bf60fe640 1 --2- 172.21.15.123:0/333935210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf01018c0 0x7f0bf0074220 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0be000eab0 tx=0x7f0be000ef70 comp rx=0 tx=0).stop 2024-08-18T22:07:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.663+0000 7f0bf60fe640 1 -- 172.21.15.123:0/333935210 shutdown_connections 2024-08-18T22:07:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.663+0000 7f0bf60fe640 1 --2- 172.21.15.123:0/333935210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bf01078c0 0x7f0bf0074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.663+0000 7f0bf60fe640 1 --2- 172.21.15.123:0/333935210 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0bdc0a2b80 0x7f0bdc0a5040 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.663+0000 7f0bf60fe640 1 --2- 172.21.15.123:0/333935210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bf0102260 0x7f0bf0074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.663+0000 7f0bf60fe640 1 --2- 172.21.15.123:0/333935210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf01018c0 0x7f0bf0074220 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.663+0000 7f0bf60fe640 1 -- 172.21.15.123:0/333935210 >> 172.21.15.123:0/333935210 conn(0x7f0bf00fd620 msgr2=0x7f0bf00fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.663+0000 7f0bf60fe640 1 -- 172.21.15.123:0/333935210 shutdown_connections 2024-08-18T22:07:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:39.663+0000 7f0bf60fe640 1 -- 172.21.15.123:0/333935210 wait complete. 2024-08-18T22:07:40.441 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.i status 2024-08-18T22:07:40.689 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:40.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:40 smithi123 ceph-mon[18462]: pgmap v337: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:40.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:40 smithi130 ceph-mon[21698]: pgmap v337: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:40.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:40 smithi183 ceph-mon[22097]: pgmap v337: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:41.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.160+0000 7f683c5d7640 1 -- 172.21.15.123:0/1647448578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68341067b0 msgr2=0x7f6834106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:41.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.160+0000 7f683c5d7640 1 --2- 172.21.15.123:0/1647448578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68341067b0 0x7f6834106b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6830009930 tx=0x7f683002a420 comp rx=0 tx=0).stop 2024-08-18T22:07:41.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f683c5d7640 1 -- 172.21.15.123:0/1647448578 shutdown_connections 2024-08-18T22:07:41.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f683c5d7640 1 --2- 172.21.15.123:0/1647448578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6834101150 0x7f683410d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f683c5d7640 1 --2- 172.21.15.123:0/1647448578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68341007b0 0x7f6834100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f683c5d7640 1 --2- 172.21.15.123:0/1647448578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68341067b0 0x7f6834106b90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f683c5d7640 1 -- 172.21.15.123:0/1647448578 >> 172.21.15.123:0/1647448578 conn(0x7f68340fc4d0 msgr2=0x7f68340fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:41.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f683c5d7640 1 -- 172.21.15.123:0/1647448578 shutdown_connections 2024-08-18T22:07:41.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f683c5d7640 1 -- 172.21.15.123:0/1647448578 wait complete. 2024-08-18T22:07:41.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f683c5d7640 1 Processor -- start 2024-08-18T22:07:41.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f683c5d7640 1 -- start start 2024-08-18T22:07:41.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f683c5d7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68341007b0 0x7f683419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f683c5d7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6834101150 0x7f683419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f683c5d7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68341067b0 0x7f683419ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f683c5d7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6834110bd0 con 0x7f6834101150 2024-08-18T22:07:41.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f683c5d7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6834110a50 con 0x7f68341067b0 2024-08-18T22:07:41.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f683c5d7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6834110d50 con 0x7f68341007b0 2024-08-18T22:07:41.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.161+0000 7f6839b72640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6834101150 0x7f683419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f6839b72640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6834101150 0x7f683419a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48200/0 (socket says 172.21.15.123:48200) 2024-08-18T22:07:41.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f6839b72640 1 -- 172.21.15.123:0/3906760177 learned_addr learned my addr 172.21.15.123:0/3906760177 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:41.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f683ab74640 1 --2- 172.21.15.123:0/3906760177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68341067b0 0x7f683419ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f683a373640 1 --2- 172.21.15.123:0/3906760177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68341007b0 0x7f683419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f6839b72640 1 -- 172.21.15.123:0/3906760177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68341007b0 msgr2=0x7f683419a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:41.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f6839b72640 1 --2- 172.21.15.123:0/3906760177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68341007b0 0x7f683419a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f6839b72640 1 -- 172.21.15.123:0/3906760177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68341067b0 msgr2=0x7f683419ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:41.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f6839b72640 1 --2- 172.21.15.123:0/3906760177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68341067b0 0x7f683419ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f6839b72640 1 -- 172.21.15.123:0/3906760177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683419f390 con 0x7f6834101150 2024-08-18T22:07:41.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f683ab74640 1 --2- 172.21.15.123:0/3906760177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68341067b0 0x7f683419ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:41.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f6839b72640 1 --2- 172.21.15.123:0/3906760177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6834101150 0x7f683419a920 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f682400b4a0 tx=0x7f682400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:41.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f682b7fe640 1 -- 172.21.15.123:0/3906760177 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824014070 con 0x7f6834101150 2024-08-18T22:07:41.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f682b7fe640 1 -- 172.21.15.123:0/3906760177 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6824010af0 con 0x7f6834101150 2024-08-18T22:07:41.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f683c5d7640 1 -- 172.21.15.123:0/3906760177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683419f680 con 0x7f6834101150 2024-08-18T22:07:41.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f682b7fe640 1 -- 172.21.15.123:0/3906760177 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824017d10 con 0x7f6834101150 2024-08-18T22:07:41.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.162+0000 7f683c5d7640 1 -- 172.21.15.123:0/3906760177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68341a6f60 con 0x7f6834101150 2024-08-18T22:07:41.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.164+0000 7f682b7fe640 1 -- 172.21.15.123:0/3906760177 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f6824017070 con 0x7f6834101150 2024-08-18T22:07:41.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.165+0000 7f683e9d5740 1 Processor -- start 2024-08-18T22:07:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.165+0000 7f683e9d5740 1 -- start start 2024-08-18T22:07:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.165+0000 7f683e9d5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09630 0x556f7cf09a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.165+0000 7f683e9d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf09f50 0x556f7cf142d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.165+0000 7f683e9d5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf14810 0x556f7cf16c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.165+0000 7f683e9d5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556f7ce6e710 con 0x556f7cf14810 2024-08-18T22:07:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.165+0000 7f683e9d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556f7ce06770 con 0x556f7cf09f50 2024-08-18T22:07:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.165+0000 7f683e9d5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556f7ce6a6d0 con 0x556f7cf09630 2024-08-18T22:07:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.165+0000 7f682b7fe640 1 --2- 172.21.15.123:0/3906760177 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f68200a2b80 0x7f68200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.165+0000 7f6839b72640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf14810 0x556f7cf16c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.165+0000 7f6839b72640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf14810 0x556f7cf16c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48216/0 (socket says 172.21.15.123:48216) 2024-08-18T22:07:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.165+0000 7f6839b72640 1 -- 172.21.15.123:0/1259499204 learned_addr learned my addr 172.21.15.123:0/1259499204 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.165+0000 7f683ab74640 1 --2- 172.21.15.123:0/1259499204 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09630 0x556f7cf09a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.165+0000 7f683ab74640 1 --2- 172.21.15.123:0/3906760177 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f68200a2b80 0x7f68200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.165+0000 7f683a373640 1 --2- 172.21.15.123:0/1259499204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf09f50 0x556f7cf142d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.166+0000 7f682b7fe640 1 -- 172.21.15.123:0/3906760177 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f68240ce7f0 con 0x7f6834101150 2024-08-18T22:07:41.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.166+0000 7f6839b72640 1 -- 172.21.15.123:0/1259499204 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09630 msgr2=0x556f7cf09a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:41.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.166+0000 7f6839b72640 1 --2- 172.21.15.123:0/1259499204 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09630 0x556f7cf09a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.166+0000 7f6839b72640 1 -- 172.21.15.123:0/1259499204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf09f50 msgr2=0x556f7cf142d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:41.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.166+0000 7f6839b72640 1 --2- 172.21.15.123:0/1259499204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf09f50 0x556f7cf142d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.166+0000 7f6839b72640 1 -- 172.21.15.123:0/1259499204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f7ce0d3e0 con 0x556f7cf14810 2024-08-18T22:07:41.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.166+0000 7f6839b72640 1 --2- 172.21.15.123:0/1259499204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf14810 0x556f7cf16c00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f68240cbf00 tx=0x7f682409ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826ad78a5f31858 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:41.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.166+0000 7f683ab74640 1 --2- 172.21.15.123:0/3906760177 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f68200a2b80 0x7f68200a5040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f682c009fd0 tx=0x7f682c0094a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:41.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.166+0000 7f6828ff9640 1 -- 172.21.15.123:0/1259499204 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682401e030 con 0x556f7cf14810 2024-08-18T22:07:41.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.166+0000 7f6828ff9640 1 -- 172.21.15.123:0/1259499204 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68240a3930 con 0x556f7cf14810 2024-08-18T22:07:41.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.166+0000 7f6828ff9640 1 -- 172.21.15.123:0/1259499204 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824017360 con 0x556f7cf14810 2024-08-18T22:07:41.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.167+0000 7f683e9d5740 1 -- 172.21.15.123:0/1259499204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf14810 msgr2=0x556f7cf16c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:41.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.167+0000 7f683e9d5740 1 --2- 172.21.15.123:0/1259499204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf14810 0x556f7cf16c00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f68240cbf00 tx=0x7f682409ab90 comp rx=0 tx=0).stop 2024-08-18T22:07:41.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.167+0000 7f683e9d5740 1 -- 172.21.15.123:0/1259499204 shutdown_connections 2024-08-18T22:07:41.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.167+0000 7f683e9d5740 1 --2- 172.21.15.123:0/1259499204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf14810 0x556f7cf16c00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.167+0000 7f683e9d5740 1 --2- 172.21.15.123:0/1259499204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf09f50 0x556f7cf142d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.167+0000 7f683e9d5740 1 --2- 172.21.15.123:0/1259499204 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09630 0x556f7cf09a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.167+0000 7f683e9d5740 1 -- 172.21.15.123:0/1259499204 >> 172.21.15.123:0/1259499204 conn(0x556f7cf05bc0 msgr2=0x556f7cf05fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:41.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.167+0000 7f683e9d5740 1 -- 172.21.15.123:0/1259499204 shutdown_connections 2024-08-18T22:07:41.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.167+0000 7f683e9d5740 1 -- 172.21.15.123:0/1259499204 wait complete. 2024-08-18T22:07:41.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.167+0000 7f683e9d5740 1 -- start start 2024-08-18T22:07:41.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.167+0000 7f683e9d5740 1 Processor -- start 2024-08-18T22:07:41.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683e9d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf09630 0x556f7cf11750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683e9d5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09f50 0x556f7cf11c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683e9d5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf14810 0x556f7cf121d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683e9d5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556f7cf17380 con 0x556f7cf14810 2024-08-18T22:07:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683e9d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556f7ce29970 con 0x556f7cf09630 2024-08-18T22:07:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683e9d5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556f7cf17500 con 0x556f7cf09f50 2024-08-18T22:07:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683e9d5740 10 client.0 _ll_register_callbacks cb 0x556f7cb7d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683ab74640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf14810 0x556f7cf121d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683ab74640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf14810 0x556f7cf121d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48230/0 (socket says 172.21.15.123:48230) 2024-08-18T22:07:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683ab74640 1 -- 172.21.15.123:0/518193671 learned_addr learned my addr 172.21.15.123:0/518193671 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683a373640 1 --2- 172.21.15.123:0/518193671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf09630 0x556f7cf11750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f6839b72640 1 --2- 172.21.15.123:0/518193671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09f50 0x556f7cf11c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683ab74640 1 -- 172.21.15.123:0/518193671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09f50 msgr2=0x556f7cf11c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683ab74640 1 --2- 172.21.15.123:0/518193671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09f50 0x556f7cf11c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683ab74640 1 -- 172.21.15.123:0/518193671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf09630 msgr2=0x556f7cf11750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683ab74640 1 --2- 172.21.15.123:0/518193671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf09630 0x556f7cf11750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683ab74640 1 -- 172.21.15.123:0/518193671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f7cbe02b0 con 0x556f7cf14810 2024-08-18T22:07:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f6839b72640 1 --2- 172.21.15.123:0/518193671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09f50 0x556f7cf11c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683ab74640 1 --2- 172.21.15.123:0/518193671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf14810 0x556f7cf121d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f682c012a40 tx=0x7f682c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f1cf2a54e95c6b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f681dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f681dffb640 1 -- 172.21.15.123:0/518193671 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c010d60 con 0x556f7cf14810 2024-08-18T22:07:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f681dffb640 1 -- 172.21.15.123:0/518193671 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f682c004b20 con 0x556f7cf14810 2024-08-18T22:07:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.168+0000 7f683e9d5740 1 -- 172.21.15.123:0/518193671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68240a3930 con 0x556f7cf14810 2024-08-18T22:07:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.169+0000 7f681dffb640 1 -- 172.21.15.123:0/518193671 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f682c031050 con 0x556f7cf14810 2024-08-18T22:07:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.169+0000 7f683e9d5740 10 client.15210 fetch_fsmap learned FSMap version 25 2024-08-18T22:07:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.169+0000 7f683e9d5740 1 -- 172.21.15.123:0/518193671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556f7cf23040 con 0x556f7cf14810 2024-08-18T22:07:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.169+0000 7f681dffb640 1 -- 172.21.15.123:0/518193671 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68240a3930 con 0x556f7cf14810 2024-08-18T22:07:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.169+0000 7f681dffb640 1 -- 172.21.15.123:0/518193671 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f682c029400 con 0x556f7cf14810 2024-08-18T22:07:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.169+0000 7f683e9d5740 10 client.15210 fetch_fsmap finished waiting for FSMap version 25 2024-08-18T22:07:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.169+0000 7f683e9d5740 10 client.15210 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-18T22:07:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.169+0000 7f683e9d5740 20 client.15210 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.169+0000 7f683e9d5740 1 --2- 172.21.15.123:0/518193671 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556f7cf256a0 0x556f7cf26b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.169+0000 7f683e9d5740 4 client.15210 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:07:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.169+0000 7f683e9d5740 1 -- 172.21.15.123:0/518193671 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f7ce7bc80 con 0x556f7cf256a0 2024-08-18T22:07:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.169+0000 7f683a373640 1 --2- 172.21.15.123:0/518193671 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556f7cf256a0 0x556f7cf26b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.170+0000 7f681dffb640 10 client.15210 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.170+0000 7f683a373640 1 --2- 172.21.15.123:0/518193671 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556f7cf256a0 0x556f7cf26b10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96330a86892643fd server_cookie=1d8241d1af55dca0 in_seq=0 out_seq=0 2024-08-18T22:07:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.170+0000 7f681dffb640 1 -- 172.21.15.123:0/518193671 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f7ce7bc80 con 0x556f7cf256a0 2024-08-18T22:07:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.170+0000 7f681dffb640 10 client.15210 handle_command_reply: tid=0 2024-08-18T22:07:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.170+0000 7f683e9d5740 1 client.15210 shutdown 2024-08-18T22:07:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.171+0000 7f683e9d5740 1 -- 172.21.15.123:0/518193671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf14810 msgr2=0x556f7cf121d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.171+0000 7f683e9d5740 1 --2- 172.21.15.123:0/518193671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf14810 0x556f7cf121d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f682c012a40 tx=0x7f682c004a40 comp rx=0 tx=0).stop 2024-08-18T22:07:41.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.171+0000 7f683e9d5740 1 -- 172.21.15.123:0/518193671 shutdown_connections 2024-08-18T22:07:41.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.171+0000 7f683e9d5740 1 --2- 172.21.15.123:0/518193671 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556f7cf256a0 0x556f7cf26b10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.171+0000 7f683e9d5740 1 --2- 172.21.15.123:0/518193671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf14810 0x556f7cf121d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.171+0000 7f683e9d5740 1 --2- 172.21.15.123:0/518193671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09f50 0x556f7cf11c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.171+0000 7f683e9d5740 1 --2- 172.21.15.123:0/518193671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf09630 0x556f7cf11750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.171+0000 7f683e9d5740 1 -- 172.21.15.123:0/518193671 >> 172.21.15.123:0/518193671 conn(0x556f7cf05bc0 msgr2=0x556f7cf0b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:41.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.171+0000 7f681dffb640 0 client.15210 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:41.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.171+0000 7f683e9d5740 1 -- 172.21.15.123:0/518193671 shutdown_connections 2024-08-18T22:07:41.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.171+0000 7f683e9d5740 1 -- 172.21.15.123:0/518193671 wait complete. 2024-08-18T22:07:41.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.171+0000 7f683e9d5740 20 client.15210 trim_cache size 0 max 16384 2024-08-18T22:07:41.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f683e9d5740 1 Processor -- start 2024-08-18T22:07:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f683e9d5740 1 -- start start 2024-08-18T22:07:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f683e9d5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09630 0x556f7cf26440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f683e9d5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf09f50 0x556f7cf11030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f683e9d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf14810 0x556f7cf0b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f683e9d5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556f7cf24e50 con 0x556f7cf09f50 2024-08-18T22:07:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f683e9d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556f7cf25520 con 0x556f7cf14810 2024-08-18T22:07:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f683e9d5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556f7cf25bf0 con 0x556f7cf09630 2024-08-18T22:07:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f6839b72640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf09f50 0x556f7cf11030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f6839b72640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf09f50 0x556f7cf11030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48246/0 (socket says 172.21.15.123:48246) 2024-08-18T22:07:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f6839b72640 1 -- 172.21.15.123:0/958088657 learned_addr learned my addr 172.21.15.123:0/958088657 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:41.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f683ab74640 1 --2- 172.21.15.123:0/958088657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf14810 0x556f7cf0b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f683a373640 1 --2- 172.21.15.123:0/958088657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09630 0x556f7cf26440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f6839b72640 1 -- 172.21.15.123:0/958088657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09630 msgr2=0x556f7cf26440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:41.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f6839b72640 1 --2- 172.21.15.123:0/958088657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09630 0x556f7cf26440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f6839b72640 1 -- 172.21.15.123:0/958088657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf14810 msgr2=0x556f7cf0b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:41.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f6839b72640 1 --2- 172.21.15.123:0/958088657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf14810 0x556f7cf0b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f6839b72640 1 -- 172.21.15.123:0/958088657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f7cf24c80 con 0x556f7cf09f50 2024-08-18T22:07:41.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f683ab74640 1 --2- 172.21.15.123:0/958088657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf14810 0x556f7cf0b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:41.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.189+0000 7f683a373640 1 --2- 172.21.15.123:0/958088657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09630 0x556f7cf26440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:41.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.190+0000 7f6839b72640 1 --2- 172.21.15.123:0/958088657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf09f50 0x556f7cf11030 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f68240cbf60 tx=0x7f68240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8f76342af774d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:41.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.190+0000 7f681ffff640 1 -- 172.21.15.123:0/958088657 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682401e070 con 0x556f7cf09f50 2024-08-18T22:07:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.190+0000 7f681ffff640 1 -- 172.21.15.123:0/958088657 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68240a3930 con 0x556f7cf09f50 2024-08-18T22:07:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.190+0000 7f681ffff640 1 -- 172.21.15.123:0/958088657 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824097330 con 0x556f7cf09f50 2024-08-18T22:07:41.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.190+0000 7f683e9d5740 1 -- 172.21.15.123:0/958088657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf09f50 msgr2=0x556f7cf11030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:41.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.190+0000 7f683e9d5740 1 --2- 172.21.15.123:0/958088657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf09f50 0x556f7cf11030 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f68240cbf60 tx=0x7f68240046c0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.190+0000 7f683e9d5740 1 -- 172.21.15.123:0/958088657 shutdown_connections 2024-08-18T22:07:41.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.190+0000 7f683e9d5740 1 --2- 172.21.15.123:0/958088657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf14810 0x556f7cf0b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.190+0000 7f683e9d5740 1 --2- 172.21.15.123:0/958088657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf09f50 0x556f7cf11030 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.190+0000 7f683e9d5740 1 --2- 172.21.15.123:0/958088657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09630 0x556f7cf26440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.190+0000 7f683e9d5740 1 -- 172.21.15.123:0/958088657 >> 172.21.15.123:0/958088657 conn(0x556f7cf05bc0 msgr2=0x556f7cf0b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:41.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.190+0000 7f683e9d5740 1 -- 172.21.15.123:0/958088657 shutdown_connections 2024-08-18T22:07:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.190+0000 7f683e9d5740 1 -- 172.21.15.123:0/958088657 wait complete. 2024-08-18T22:07:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.191+0000 7f683e9d5740 1 -- start start 2024-08-18T22:07:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.191+0000 7f683e9d5740 1 Processor -- start 2024-08-18T22:07:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.191+0000 7f683e9d5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf09630 0x556f7cf27e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.191+0000 7f683e9d5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09f50 0x556f7cf283d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.191+0000 7f683e9d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf14810 0x556f7cf8dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.191+0000 7f683e9d5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556f7cf26990 con 0x556f7cf09630 2024-08-18T22:07:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.191+0000 7f683e9d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556f7cf262c0 con 0x556f7cf14810 2024-08-18T22:07:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.191+0000 7f683e9d5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556f7cf27060 con 0x556f7cf09f50 2024-08-18T22:07:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.191+0000 7f683e9d5740 10 client.0 _ll_register_callbacks cb 0x7f682c009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.191+0000 7f683a373640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf09630 0x556f7cf27e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.191+0000 7f683a373640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf09630 0x556f7cf27e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48258/0 (socket says 172.21.15.123:48258) 2024-08-18T22:07:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.191+0000 7f683a373640 1 -- 172.21.15.123:0/2211504105 learned_addr learned my addr 172.21.15.123:0/2211504105 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.191+0000 7f6839b72640 1 --2- 172.21.15.123:0/2211504105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09f50 0x556f7cf283d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f683ab74640 1 --2- 172.21.15.123:0/2211504105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf14810 0x556f7cf8dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f683a373640 1 -- 172.21.15.123:0/2211504105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09f50 msgr2=0x556f7cf283d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f683a373640 1 --2- 172.21.15.123:0/2211504105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09f50 0x556f7cf283d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f683a373640 1 -- 172.21.15.123:0/2211504105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf14810 msgr2=0x556f7cf8dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f683a373640 1 --2- 172.21.15.123:0/2211504105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf14810 0x556f7cf8dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f683a373640 1 -- 172.21.15.123:0/2211504105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f7cf28ca0 con 0x556f7cf09630 2024-08-18T22:07:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f683ab74640 1 --2- 172.21.15.123:0/2211504105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf14810 0x556f7cf8dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:07:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f683a373640 1 --2- 172.21.15.123:0/2211504105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf09630 0x556f7cf27e90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f683002a940 tx=0x7f6830004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c5d0bdcf00aef server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f681dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f681dffb640 1 -- 172.21.15.123:0/2211504105 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830035040 con 0x556f7cf09630 2024-08-18T22:07:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f681dffb640 1 -- 172.21.15.123:0/2211504105 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f6830005040 con 0x556f7cf09630 2024-08-18T22:07:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f683e9d5740 1 -- 172.21.15.123:0/2211504105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68240a3930 con 0x556f7cf09630 2024-08-18T22:07:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f681dffb640 1 -- 172.21.15.123:0/2211504105 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6830053050 con 0x556f7cf09630 2024-08-18T22:07:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f683e9d5740 10 client.15216 fetch_fsmap learned FSMap version 25 2024-08-18T22:07:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f683e9d5740 1 -- 172.21.15.123:0/2211504105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556f7cf8f440 con 0x556f7cf09630 2024-08-18T22:07:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.192+0000 7f681dffb640 1 -- 172.21.15.123:0/2211504105 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68240a3930 con 0x556f7cf09630 2024-08-18T22:07:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.193+0000 7f681dffb640 1 -- 172.21.15.123:0/2211504105 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f68300046c0 con 0x556f7cf09630 2024-08-18T22:07:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.193+0000 7f683e9d5740 10 client.15216 fetch_fsmap finished waiting for FSMap version 25 2024-08-18T22:07:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.193+0000 7f683e9d5740 10 client.15216 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-18T22:07:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.193+0000 7f683e9d5740 20 client.15216 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.193+0000 7f683e9d5740 1 --2- 172.21.15.123:0/2211504105 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556f7cf93ff0 0x556f7cf92d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.193+0000 7f683e9d5740 4 client.15216 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:07:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.193+0000 7f683e9d5740 1 -- 172.21.15.123:0/2211504105 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "status"}) -- 0x556f7ce76190 con 0x556f7cf93ff0 2024-08-18T22:07:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.193+0000 7f6839b72640 1 --2- 172.21.15.123:0/2211504105 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556f7cf93ff0 0x556f7cf92d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.193+0000 7f681dffb640 10 client.15216 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.193+0000 7f6839b72640 1 --2- 172.21.15.123:0/2211504105 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556f7cf93ff0 0x556f7cf92d00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8257cfea9cc96a87 server_cookie=5fea2fb3901c4f04 in_seq=0 out_seq=0 2024-08-18T22:07:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.193+0000 7f681dffb640 1 -- 172.21.15.123:0/2211504105 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x556f7ce76190 con 0x556f7cf93ff0 2024-08-18T22:07:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.193+0000 7f681dffb640 10 client.15216 handle_command_reply: tid=0 2024-08-18T22:07:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.193+0000 7f683e9d5740 1 client.15216 shutdown 2024-08-18T22:07:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f683e9d5740 1 -- 172.21.15.123:0/2211504105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf09630 msgr2=0x556f7cf27e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f683e9d5740 1 --2- 172.21.15.123:0/2211504105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf09630 0x556f7cf27e90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f683002a940 tx=0x7f6830004040 comp rx=0 tx=0).stop 2024-08-18T22:07:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f683e9d5740 1 -- 172.21.15.123:0/2211504105 shutdown_connections 2024-08-18T22:07:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f683e9d5740 1 --2- 172.21.15.123:0/2211504105 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556f7cf93ff0 0x556f7cf92d00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f683e9d5740 1 --2- 172.21.15.123:0/2211504105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f7cf14810 0x556f7cf8dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f683e9d5740 1 --2- 172.21.15.123:0/2211504105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f7cf09f50 0x556f7cf283d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f681dffb640 0 client.15216 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f683e9d5740 1 --2- 172.21.15.123:0/2211504105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556f7cf09630 0x556f7cf27e90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f683e9d5740 1 -- 172.21.15.123:0/2211504105 >> 172.21.15.123:0/2211504105 conn(0x556f7cf05bc0 msgr2=0x556f7cf1ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f683e9d5740 1 -- 172.21.15.123:0/2211504105 shutdown_connections 2024-08-18T22:07:41.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f683e9d5740 1 -- 172.21.15.123:0/2211504105 wait complete. 2024-08-18T22:07:41.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f683e9d5740 20 client.15216 trim_cache size 0 max 16384 2024-08-18T22:07:41.202 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:07:41.202 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "dfa1db70-5dac-11ef-bccf-c7b262605968", 2024-08-18T22:07:41.202 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-08-18T22:07:41.202 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24466, 2024-08-18T22:07:41.202 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-08-18T22:07:41.202 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-08-18T22:07:41.202 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-08-18T22:07:41.203 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 138.332982942, 2024-08-18T22:07:41.203 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 25, 2024-08-18T22:07:41.203 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 92, 2024-08-18T22:07:41.203 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 88, 2024-08-18T22:07:41.203 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 158.556650811 2024-08-18T22:07:41.203 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:07:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f683c5d7640 1 -- 172.21.15.123:0/3906760177 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f68200a2b80 msgr2=0x7f68200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f683c5d7640 1 --2- 172.21.15.123:0/3906760177 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f68200a2b80 0x7f68200a5040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f682c009fd0 tx=0x7f682c0094a0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f683c5d7640 1 -- 172.21.15.123:0/3906760177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6834101150 msgr2=0x7f683419a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.194+0000 7f683c5d7640 1 --2- 172.21.15.123:0/3906760177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6834101150 0x7f683419a920 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f682400b4a0 tx=0x7f682400b960 comp rx=0 tx=0).stop 2024-08-18T22:07:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.195+0000 7f683c5d7640 1 -- 172.21.15.123:0/3906760177 shutdown_connections 2024-08-18T22:07:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.195+0000 7f683c5d7640 1 --2- 172.21.15.123:0/3906760177 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f68200a2b80 0x7f68200a5040 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.195+0000 7f683c5d7640 1 --2- 172.21.15.123:0/3906760177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68341067b0 0x7f683419ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.195+0000 7f683c5d7640 1 --2- 172.21.15.123:0/3906760177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6834101150 0x7f683419a920 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.195+0000 7f683c5d7640 1 --2- 172.21.15.123:0/3906760177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68341007b0 0x7f683419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.195+0000 7f683c5d7640 1 -- 172.21.15.123:0/3906760177 >> 172.21.15.123:0/3906760177 conn(0x7f68340fc4d0 msgr2=0x7f68340fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.195+0000 7f683c5d7640 1 -- 172.21.15.123:0/3906760177 shutdown_connections 2024-08-18T22:07:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:41.195+0000 7f683c5d7640 1 -- 172.21.15.123:0/3906760177 wait complete. 2024-08-18T22:07:41.934 INFO:teuthology.run_tasks:Running task sequential... 2024-08-18T22:07:41.946 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-08-18T22:07:41.946 INFO:teuthology.task.sequential:In sequential, running task print... 2024-08-18T22:07:41.946 INFO:teuthology.task.print:Enabling mgr modules 2024-08-18T22:07:41.946 INFO:teuthology.run_tasks:Running task kclient... 2024-08-18T22:07:41.959 INFO:tasks.kclient:Mounting kernel clients... 2024-08-18T22:07:41.959 INFO:tasks.kclient:config is {'client.0': {}} 2024-08-18T22:07:41.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:07:41.959 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-08-18T22:07:41.976 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-08-18T22:07:41.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:07:41.977 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T22:07:42.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:07:42.044 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-08-18T22:07:42.144 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-08-18T22:07:42.144 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-18T22:07:42.144 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:07:42.145 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs ls 2024-08-18T22:07:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:42.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:42 smithi123 ceph-mon[18462]: pgmap v338: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:42.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:42 smithi130 ceph-mon[21698]: pgmap v338: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:42.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.873+0000 7f8337a05640 1 -- 172.21.15.123:0/871772090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83301007b0 msgr2=0x7f8330100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:42.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.873+0000 7f8337a05640 1 --2- 172.21.15.123:0/871772090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83301007b0 0x7f8330100c10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8320009930 tx=0x7f832002a420 comp rx=0 tx=0).stop 2024-08-18T22:07:42.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.873+0000 7f8337a05640 1 -- 172.21.15.123:0/871772090 shutdown_connections 2024-08-18T22:07:42.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.873+0000 7f8337a05640 1 --2- 172.21.15.123:0/871772090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8330101150 0x7f833010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:42.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.873+0000 7f8337a05640 1 --2- 172.21.15.123:0/871772090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83301007b0 0x7f8330100c10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:42.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.873+0000 7f8337a05640 1 --2- 172.21.15.123:0/871772090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83301067b0 0x7f8330106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:42.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.873+0000 7f8337a05640 1 -- 172.21.15.123:0/871772090 >> 172.21.15.123:0/871772090 conn(0x7f83300fc4d0 msgr2=0x7f83300fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:42.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.873+0000 7f8337a05640 1 -- 172.21.15.123:0/871772090 shutdown_connections 2024-08-18T22:07:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.873+0000 7f8337a05640 1 -- 172.21.15.123:0/871772090 wait complete. 2024-08-18T22:07:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.873+0000 7f8337a05640 1 Processor -- start 2024-08-18T22:07:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.873+0000 7f8337a05640 1 -- start start 2024-08-18T22:07:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f8337a05640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83301007b0 0x7f8330199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f8337a05640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8330101150 0x7f83301996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f8337a05640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83301067b0 0x7f83301a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f8337a05640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8330110c50 con 0x7f83301007b0 2024-08-18T22:07:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f8337a05640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8330110ad0 con 0x7f8330101150 2024-08-18T22:07:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f8337a05640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8330110dd0 con 0x7f83301067b0 2024-08-18T22:07:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f83357a1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83301007b0 0x7f8330199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f83357a1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83301007b0 0x7f8330199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47502/0 (socket says 172.21.15.123:47502) 2024-08-18T22:07:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f83357a1640 1 -- 172.21.15.123:0/406909888 learned_addr learned my addr 172.21.15.123:0/406909888 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f8335fa2640 1 --2- 172.21.15.123:0/406909888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83301067b0 0x7f83301a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:42.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f8334fa0640 1 --2- 172.21.15.123:0/406909888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8330101150 0x7f83301996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:42.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f83357a1640 1 -- 172.21.15.123:0/406909888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83301067b0 msgr2=0x7f83301a4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:42.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f83357a1640 1 --2- 172.21.15.123:0/406909888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83301067b0 0x7f83301a4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:42.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f83357a1640 1 -- 172.21.15.123:0/406909888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8330101150 msgr2=0x7f83301996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:42.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f83357a1640 1 --2- 172.21.15.123:0/406909888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8330101150 0x7f83301996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:42.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f83357a1640 1 -- 172.21.15.123:0/406909888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83301a4740 con 0x7f83301007b0 2024-08-18T22:07:42.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f8334fa0640 1 --2- 172.21.15.123:0/406909888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8330101150 0x7f83301996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:07:42.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f83357a1640 1 --2- 172.21.15.123:0/406909888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83301007b0 0x7f8330199180 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f832c00b4a0 tx=0x7f832c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:42.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f83267fc640 1 -- 172.21.15.123:0/406909888 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c014070 con 0x7f83301007b0 2024-08-18T22:07:42.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f83267fc640 1 -- 172.21.15.123:0/406909888 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f832c010af0 con 0x7f83301007b0 2024-08-18T22:07:42.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f8337a05640 1 -- 172.21.15.123:0/406909888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83301a4910 con 0x7f83301007b0 2024-08-18T22:07:42.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f83267fc640 1 -- 172.21.15.123:0/406909888 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c017d10 con 0x7f83301007b0 2024-08-18T22:07:42.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.874+0000 7f8337a05640 1 -- 172.21.15.123:0/406909888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83301a4e50 con 0x7f83301007b0 2024-08-18T22:07:42.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.876+0000 7f8337a05640 1 -- 172.21.15.123:0/406909888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8330100c90 con 0x7f83301007b0 2024-08-18T22:07:42.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.877+0000 7f83267fc640 1 -- 172.21.15.123:0/406909888 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f832c017070 con 0x7f83301007b0 2024-08-18T22:07:42.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.877+0000 7f83267fc640 1 --2- 172.21.15.123:0/406909888 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f831c0a2c00 0x7f831c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:42.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.877+0000 7f8334fa0640 1 --2- 172.21.15.123:0/406909888 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f831c0a2c00 0x7f831c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:42.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.877+0000 7f83267fc640 1 -- 172.21.15.123:0/406909888 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f832c0ceb90 con 0x7f83301007b0 2024-08-18T22:07:42.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.878+0000 7f8334fa0640 1 --2- 172.21.15.123:0/406909888 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f831c0a2c00 0x7f831c0a50c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8320000c00 tx=0x7f8320032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:42.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:42.881+0000 7f83267fc640 1 -- 172.21.15.123:0/406909888 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f832c09b760 con 0x7f83301007b0 2024-08-18T22:07:42.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:42 smithi183 ceph-mon[22097]: pgmap v338: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:07:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43.082+0000 7f8337a05640 1 -- 172.21.15.123:0/406909888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8330108d40 con 0x7f83301007b0 2024-08-18T22:07:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43.082+0000 7f83267fc640 1 -- 172.21.15.123:0/406909888 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+88 (secure 0 0 0) 0x7f832c09b060 con 0x7f83301007b0 2024-08-18T22:07:43.083 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-18T22:07:43.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43.084+0000 7f8337a05640 1 -- 172.21.15.123:0/406909888 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f831c0a2c00 msgr2=0x7f831c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:43.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43.084+0000 7f8337a05640 1 --2- 172.21.15.123:0/406909888 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f831c0a2c00 0x7f831c0a50c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8320000c00 tx=0x7f8320032d50 comp rx=0 tx=0).stop 2024-08-18T22:07:43.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43.084+0000 7f8337a05640 1 -- 172.21.15.123:0/406909888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83301007b0 msgr2=0x7f8330199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:43.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43.084+0000 7f8337a05640 1 --2- 172.21.15.123:0/406909888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83301007b0 0x7f8330199180 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f832c00b4a0 tx=0x7f832c00b960 comp rx=0 tx=0).stop 2024-08-18T22:07:43.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43.084+0000 7f8337a05640 1 -- 172.21.15.123:0/406909888 shutdown_connections 2024-08-18T22:07:43.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43.084+0000 7f8337a05640 1 --2- 172.21.15.123:0/406909888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83301067b0 0x7f83301a4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:43.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43.084+0000 7f8337a05640 1 --2- 172.21.15.123:0/406909888 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f831c0a2c00 0x7f831c0a50c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:43.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43.084+0000 7f8337a05640 1 --2- 172.21.15.123:0/406909888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8330101150 0x7f83301996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:43.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43.084+0000 7f8337a05640 1 --2- 172.21.15.123:0/406909888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83301007b0 0x7f8330199180 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:43.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43.084+0000 7f8337a05640 1 -- 172.21.15.123:0/406909888 >> 172.21.15.123:0/406909888 conn(0x7f83300fc4d0 msgr2=0x7f83300fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:43.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43.084+0000 7f8337a05640 1 -- 172.21.15.123:0/406909888 shutdown_connections 2024-08-18T22:07:43.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43.084+0000 7f8337a05640 1 -- 172.21.15.123:0/406909888 wait complete. 2024-08-18T22:07:43.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:43 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/406909888' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-18T22:07:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:43 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/406909888' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-18T22:07:43.820 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-18T22:07:43.820 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:07:43.820 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-08-18T22:07:43.821 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:07:43.821 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:07:43.821 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-18T22:07:43.821 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-18T22:07:43.821 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:07:43.821 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:07:43.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:07:43.821 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-08-18T22:07:43.839 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:07:43.839 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:07:43.839 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:07:43.839 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:07:43.839 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-08-18T22:07:43.839 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:07:43.839 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T22:07:43.839 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-08-18T22:07:43.839 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-08-18T22:07:43.839 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T22:07:43.839 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-08-18T22:07:43.839 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-08-18T22:07:43.840 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T22:07:43.840 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:07:43.840 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:07:43.840 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:07:43.840 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-18T22:07:43.840 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42306sec preferred_lft 42306sec 2024-08-18T22:07:43.840 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-08-18T22:07:43.840 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:07:43.840 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-18T22:07:43.840 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:07:43.841 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-18T22:07:43.841 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add name ceph-brx type bridge 2024-08-18T22:07:43.841 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr flush dev ceph-brx 2024-08-18T22:07:43.841 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set ceph-brx up 2024-08-18T22:07:43.841 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-18T22:07:43.841 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-18T22:07:43.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:43 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/406909888' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-18T22:07:43.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:07:43.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:07:43.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:07:43.980 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:07:44.003 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-08-18T22:07:44.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:07:44.005 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-08-18T22:07:44.061 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-08-18T22:07:44.061 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:07:44.062 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-18T22:07:44.062 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-18T22:07:44.062 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:07:44.062 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:07:44.062 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-18T22:07:44.062 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-18T22:07:44.062 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-18T22:07:44.062 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-18T22:07:44.062 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-18T22:07:44.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:07:44.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:07:44.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:07:44.188 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-08-18T22:07:44.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:07:44.204 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-08-18T22:07:44.259 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:07:44.259 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-18T22:07:44.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:07:44.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-18T22:07:44.259 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-18T22:07:44.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:07:44.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:07:44.376 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-18T22:07:44.376 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:07:44.377 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-18T22:07:44.377 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-18T22:07:44.377 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-18T22:07:44.377 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-18T22:07:44.377 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-18T22:07:44.377 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-18T22:07:44.377 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-18T22:07:44.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:07:44.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:07:44.490 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:07:44.490 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-18T22:07:44.490 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-08-18T22:07:44.490 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.0 master ceph-brx 2024-08-18T22:07:44.490 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-18T22:07:44.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:07:44.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:07:44.565 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:07:44.566 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:07:44.590 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:07:44.590 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:07:44.590 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:07:44.645 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-08-18T22:07:44.645 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-08-18T22:07:44.645 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235 2024-08-18T22:07:44.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:07:44.645 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-08-18T22:07:44.706 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:44 smithi123 ceph-mon[18462]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:07:44.728 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-08-18T22:07:44.728 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-08-18T22:07:44.728 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-08-18T22:07:44.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:44 smithi130 ceph-mon[21698]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:07:44.869 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-08-18T22:07:44.869 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-08-18T22:07:44.869 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-08-18T22:07:44.869 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.130:3300,172.21.15.183:3300" 2024-08-18T22:07:44.869 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:3300,172.21.15.130:3300,172.21.15.183:3300:/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235 2024-08-18T22:07:44.869 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=dfa1db70-5dac-11ef-bccf-c7b262605968" will pass to kernel 2024-08-18T22:07:44.870 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-18T22:07:44.870 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-08-18T22:07:44.870 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-18T22:07:44.870 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-08-18T22:07:44.871 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-18T22:07:44.872 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:07:44.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:07:44.872 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:07:44.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:44 smithi183 ceph-mon[22097]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:07:44.944 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:07:45.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:07:45.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:07:45.042 INFO:teuthology.orchestra.run.smithi123.stdout:client15225 2024-08-18T22:07:45.042 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T22:07:45.042 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:07:45.059 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:07:45.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:07:45.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:07:45.156 INFO:teuthology.orchestra.run.smithi123.stdout:client15225 2024-08-18T22:07:45.156 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:07:45.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:07:45.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:07:45.212 INFO:teuthology.orchestra.run.smithi123.stdout:client15225 2024-08-18T22:07:45.212 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968.client15225/status') 2024-08-18T22:07:45.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:07:45.270 INFO:teuthology.orchestra.run.smithi123.stdout:instance: client.15225 (3)192.168.0.1:0/3161622742 2024-08-18T22:07:45.270 INFO:teuthology.orchestra.run.smithi123.stdout:blocklisted: false 2024-08-18T22:07:45.270 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records in 2024-08-18T22:07:45.270 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records out 2024-08-18T22:07:45.270 INFO:teuthology.orchestra.run.smithi123.stderr:70 bytes copied, 2.2187e-05 s, 3.2 MB/s 2024-08-18T22:07:45.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:07:45.277 INFO:teuthology.run_tasks:Running task exec... 2024-08-18T22:07:45.287 INFO:teuthology.task.exec:Executing custom commands... 2024-08-18T22:07:45.287 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi123.front.sepia.ceph.com 2024-08-18T22:07:45.287 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-08-18T22:07:45.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.386+0000 7f5508554640 1 -- 172.21.15.123:0/2005309909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5500102370 msgr2=0x7f5500104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:45.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.386+0000 7f5508554640 1 --2- 172.21.15.123:0/2005309909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5500102370 0x7f5500104760 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009ca0 tx=0x7f54fc02a8c0 comp rx=0 tx=0).stop 2024-08-18T22:07:45.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.386+0000 7f5508554640 1 -- 172.21.15.123:0/2005309909 shutdown_connections 2024-08-18T22:07:45.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.386+0000 7f5508554640 1 --2- 172.21.15.123:0/2005309909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55001075d0 0x7f55001099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:45.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.386+0000 7f5508554640 1 --2- 172.21.15.123:0/2005309909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5500104ca0 0x7f5500107090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:45.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.386+0000 7f5508554640 1 --2- 172.21.15.123:0/2005309909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5500102370 0x7f5500104760 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:45.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.386+0000 7f5508554640 1 -- 172.21.15.123:0/2005309909 >> 172.21.15.123:0/2005309909 conn(0x7f55000fbf10 msgr2=0x7f55000fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:45.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.386+0000 7f5508554640 1 -- 172.21.15.123:0/2005309909 shutdown_connections 2024-08-18T22:07:45.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.386+0000 7f5508554640 1 -- 172.21.15.123:0/2005309909 wait complete. 2024-08-18T22:07:45.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5508554640 1 Processor -- start 2024-08-18T22:07:45.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5508554640 1 -- start start 2024-08-18T22:07:45.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5508554640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5500102370 0x7f5500197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:45.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5508554640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5500104ca0 0x7f5500198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:45.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5508554640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55001075d0 0x7f550019f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:45.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5508554640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f550010d530 con 0x7f55001075d0 2024-08-18T22:07:45.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5508554640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f550010d3b0 con 0x7f5500104ca0 2024-08-18T22:07:45.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5508554640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f550010d6b0 con 0x7f5500102370 2024-08-18T22:07:45.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5506af1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55001075d0 0x7f550019f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:45.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5506af1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55001075d0 0x7f550019f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47532/0 (socket says 172.21.15.123:47532) 2024-08-18T22:07:45.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5506af1640 1 -- 172.21.15.123:0/3487560249 learned_addr learned my addr 172.21.15.123:0/3487560249 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:45.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f55062f0640 1 --2- 172.21.15.123:0/3487560249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5500102370 0x7f5500197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:45.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5506af1640 1 -- 172.21.15.123:0/3487560249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5500102370 msgr2=0x7f5500197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:45.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5506af1640 1 --2- 172.21.15.123:0/3487560249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5500102370 0x7f5500197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:45.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5506af1640 1 -- 172.21.15.123:0/3487560249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5500104ca0 msgr2=0x7f5500198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:45.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5505aef640 1 --2- 172.21.15.123:0/3487560249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5500104ca0 0x7f5500198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:45.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5506af1640 1 --2- 172.21.15.123:0/3487560249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5500104ca0 0x7f5500198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:45.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5506af1640 1 -- 172.21.15.123:0/3487560249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550019f720 con 0x7f55001075d0 2024-08-18T22:07:45.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f55062f0640 1 --2- 172.21.15.123:0/3487560249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5500102370 0x7f5500197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:45.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f5506af1640 1 --2- 172.21.15.123:0/3487560249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55001075d0 0x7f550019f0b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f54f800c970 tx=0x7f54f800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:45.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.387+0000 7f54f77fe640 1 -- 172.21.15.123:0/3487560249 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f8007bb0 con 0x7f55001075d0 2024-08-18T22:07:45.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.388+0000 7f54f77fe640 1 -- 172.21.15.123:0/3487560249 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54f8007d50 con 0x7f55001075d0 2024-08-18T22:07:45.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.388+0000 7f5508554640 1 -- 172.21.15.123:0/3487560249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550019fa10 con 0x7f55001075d0 2024-08-18T22:07:45.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.388+0000 7f54f77fe640 1 -- 172.21.15.123:0/3487560249 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f8018800 con 0x7f55001075d0 2024-08-18T22:07:45.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.388+0000 7f5508554640 1 -- 172.21.15.123:0/3487560249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550019ff10 con 0x7f55001075d0 2024-08-18T22:07:45.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.389+0000 7f5508554640 1 -- 172.21.15.123:0/3487560249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55000fda00 con 0x7f55001075d0 2024-08-18T22:07:45.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.390+0000 7f54f77fe640 1 -- 172.21.15.123:0/3487560249 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f54f800f450 con 0x7f55001075d0 2024-08-18T22:07:45.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.390+0000 7f54f77fe640 1 --2- 172.21.15.123:0/3487560249 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54ec0a2c30 0x7f54ec0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:45.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.391+0000 7f55062f0640 1 --2- 172.21.15.123:0/3487560249 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54ec0a2c30 0x7f54ec0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:45.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.391+0000 7f54f77fe640 1 -- 172.21.15.123:0/3487560249 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f54f80cf550 con 0x7f55001075d0 2024-08-18T22:07:45.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.391+0000 7f55062f0640 1 --2- 172.21.15.123:0/3487560249 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54ec0a2c30 0x7f54ec0a50f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f54fc031c10 tx=0x7f54fc009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:45.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.394+0000 7f54f77fe640 1 -- 172.21.15.123:0/3487560249 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f54f8014030 con 0x7f55001075d0 2024-08-18T22:07:45.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:45.598+0000 7f5508554640 1 -- 172.21.15.123:0/3487560249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f550002d790 con 0x7f55001075d0 2024-08-18T22:07:46.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.498+0000 7f54f77fe640 1 -- 172.21.15.123:0/3487560249 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7f54f801f300 con 0x7f55001075d0 2024-08-18T22:07:46.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.501+0000 7f5508554640 1 -- 172.21.15.123:0/3487560249 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54ec0a2c30 msgr2=0x7f54ec0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:46.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.501+0000 7f5508554640 1 --2- 172.21.15.123:0/3487560249 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54ec0a2c30 0x7f54ec0a50f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f54fc031c10 tx=0x7f54fc009360 comp rx=0 tx=0).stop 2024-08-18T22:07:46.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.501+0000 7f5508554640 1 -- 172.21.15.123:0/3487560249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55001075d0 msgr2=0x7f550019f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:46.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.501+0000 7f5508554640 1 --2- 172.21.15.123:0/3487560249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55001075d0 0x7f550019f0b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f54f800c970 tx=0x7f54f800ce30 comp rx=0 tx=0).stop 2024-08-18T22:07:46.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.501+0000 7f5508554640 1 -- 172.21.15.123:0/3487560249 shutdown_connections 2024-08-18T22:07:46.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.501+0000 7f5508554640 1 --2- 172.21.15.123:0/3487560249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55001075d0 0x7f550019f0b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.501+0000 7f5508554640 1 --2- 172.21.15.123:0/3487560249 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54ec0a2c30 0x7f54ec0a50f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.501+0000 7f5508554640 1 --2- 172.21.15.123:0/3487560249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5500104ca0 0x7f5500198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.501+0000 7f5508554640 1 --2- 172.21.15.123:0/3487560249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5500102370 0x7f5500197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.501+0000 7f5508554640 1 -- 172.21.15.123:0/3487560249 >> 172.21.15.123:0/3487560249 conn(0x7f55000fbf10 msgr2=0x7f5500102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.501+0000 7f5508554640 1 -- 172.21.15.123:0/3487560249 shutdown_connections 2024-08-18T22:07:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.501+0000 7f5508554640 1 -- 172.21.15.123:0/3487560249 wait complete. 2024-08-18T22:07:46.516 INFO:teuthology.run_tasks:Running task check-counter... 2024-08-18T22:07:46.526 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-08-18T22:07:46.535 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:07:46.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.638+0000 7f95d3084640 1 -- 172.21.15.123:0/576483612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95cc100270 msgr2=0x7f95cc109e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:46.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.638+0000 7f95d3084640 1 --2- 172.21.15.123:0/576483612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95cc100270 0x7f95cc109e20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f95c4009cd0 tx=0x7f95c402a8e0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.638+0000 7f95d3084640 1 -- 172.21.15.123:0/576483612 shutdown_connections 2024-08-18T22:07:46.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.638+0000 7f95d3084640 1 --2- 172.21.15.123:0/576483612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95cc100270 0x7f95cc109e20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.638+0000 7f95d3084640 1 --2- 172.21.15.123:0/576483612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95cc0ff8b0 0x7f95cc0ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.638+0000 7f95d3084640 1 --2- 172.21.15.123:0/576483612 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95cc102e40 0x7f95cc103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.638+0000 7f95d3084640 1 -- 172.21.15.123:0/576483612 >> 172.21.15.123:0/576483612 conn(0x7f95cc0fb640 msgr2=0x7f95cc0fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:46.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.638+0000 7f95d3084640 1 -- 172.21.15.123:0/576483612 shutdown_connections 2024-08-18T22:07:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.638+0000 7f95d3084640 1 -- 172.21.15.123:0/576483612 wait complete. 2024-08-18T22:07:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.638+0000 7f95d3084640 1 Processor -- start 2024-08-18T22:07:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95d3084640 1 -- start start 2024-08-18T22:07:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95d3084640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95cc0ff8b0 0x7f95cc197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95d3084640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95cc100270 0x7f95cc198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95d3084640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95cc102e40 0x7f95cc19f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95d3084640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc10d4e0 con 0x7f95cc100270 2024-08-18T22:07:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95d3084640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc10d360 con 0x7f95cc0ff8b0 2024-08-18T22:07:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95d3084640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc10d660 con 0x7f95cc102e40 2024-08-18T22:07:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95cbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95cc100270 0x7f95cc198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95cbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95cc100270 0x7f95cc198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47556/0 (socket says 172.21.15.123:47556) 2024-08-18T22:07:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95cbfff640 1 -- 172.21.15.123:0/1335425812 learned_addr learned my addr 172.21.15.123:0/1335425812 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95d1621640 1 --2- 172.21.15.123:0/1335425812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95cc102e40 0x7f95cc19f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95d0e20640 1 --2- 172.21.15.123:0/1335425812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95cc0ff8b0 0x7f95cc197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95cbfff640 1 -- 172.21.15.123:0/1335425812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95cc102e40 msgr2=0x7f95cc19f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95cbfff640 1 --2- 172.21.15.123:0/1335425812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95cc102e40 0x7f95cc19f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95cbfff640 1 -- 172.21.15.123:0/1335425812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95cc0ff8b0 msgr2=0x7f95cc197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95cbfff640 1 --2- 172.21.15.123:0/1335425812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95cc0ff8b0 0x7f95cc197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95cbfff640 1 -- 172.21.15.123:0/1335425812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc19f750 con 0x7f95cc100270 2024-08-18T22:07:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95cbfff640 1 --2- 172.21.15.123:0/1335425812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95cc100270 0x7f95cc198070 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00d950 tx=0x7f95bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95c9ffb640 1 -- 172.21.15.123:0/1335425812 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc017070 con 0x7f95cc100270 2024-08-18T22:07:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95c9ffb640 1 -- 172.21.15.123:0/1335425812 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95bc009c30 con 0x7f95cc100270 2024-08-18T22:07:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95d3084640 1 -- 172.21.15.123:0/1335425812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95cc19fa40 con 0x7f95cc100270 2024-08-18T22:07:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.639+0000 7f95c9ffb640 1 -- 172.21.15.123:0/1335425812 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00f6b0 con 0x7f95cc100270 2024-08-18T22:07:46.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.640+0000 7f95d3084640 1 -- 172.21.15.123:0/1335425812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95cc19ff90 con 0x7f95cc100270 2024-08-18T22:07:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.641+0000 7f95d3084640 1 -- 172.21.15.123:0/1335425812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95cc108d80 con 0x7f95cc100270 2024-08-18T22:07:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.642+0000 7f95c9ffb640 1 -- 172.21.15.123:0/1335425812 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f95bc0109d0 con 0x7f95cc100270 2024-08-18T22:07:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.642+0000 7f95c9ffb640 1 --2- 172.21.15.123:0/1335425812 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f95b80a2b90 0x7f95b80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:46.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.642+0000 7f95d0e20640 1 --2- 172.21.15.123:0/1335425812 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f95b80a2b90 0x7f95b80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:46.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.642+0000 7f95c9ffb640 1 -- 172.21.15.123:0/1335425812 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f95bc0cefb0 con 0x7f95cc100270 2024-08-18T22:07:46.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.643+0000 7f95d0e20640 1 --2- 172.21.15.123:0/1335425812 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f95b80a2b90 0x7f95b80a5050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f95cc069e90 tx=0x7f95b400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:46.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.646+0000 7f95c9ffb640 1 -- 172.21.15.123:0/1335425812 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f95bc009de0 con 0x7f95cc100270 2024-08-18T22:07:46.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:46 smithi123 ceph-mon[18462]: pgmap v340: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:46.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:46 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3487560249' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-08-18T22:07:46.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:46 smithi130 ceph-mon[21698]: pgmap v340: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:46.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:46 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3487560249' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-08-18T22:07:46.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.816+0000 7f95d3084640 1 -- 172.21.15.123:0/1335425812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95cc062b50 con 0x7f95cc100270 2024-08-18T22:07:46.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.817+0000 7f95c9ffb640 1 -- 172.21.15.123:0/1335425812 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24810 (secure 0 0 0) 0x7f95bc09b530 con 0x7f95cc100270 2024-08-18T22:07:46.820 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:46.820 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":92,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:07:11.513362+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:05:18.077632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:05:20.808463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:05:27.136662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:07:46.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.819+0000 7f95d3084640 1 -- 172.21.15.123:0/1335425812 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f95b80a2b90 msgr2=0x7f95b80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:46.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.819+0000 7f95d3084640 1 --2- 172.21.15.123:0/1335425812 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f95b80a2b90 0x7f95b80a5050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f95cc069e90 tx=0x7f95b400a2d0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.819+0000 7f95d3084640 1 -- 172.21.15.123:0/1335425812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95cc100270 msgr2=0x7f95cc198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:46.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.819+0000 7f95d3084640 1 --2- 172.21.15.123:0/1335425812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95cc100270 0x7f95cc198070 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00d950 tx=0x7f95bc00de10 comp rx=0 tx=0).stop 2024-08-18T22:07:46.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.819+0000 7f95d3084640 1 -- 172.21.15.123:0/1335425812 shutdown_connections 2024-08-18T22:07:46.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.819+0000 7f95d3084640 1 --2- 172.21.15.123:0/1335425812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95cc102e40 0x7f95cc19f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.819+0000 7f95d3084640 1 --2- 172.21.15.123:0/1335425812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95cc100270 0x7f95cc198070 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.819+0000 7f95d3084640 1 --2- 172.21.15.123:0/1335425812 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f95b80a2b90 0x7f95b80a5050 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.819+0000 7f95d3084640 1 --2- 172.21.15.123:0/1335425812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95cc0ff8b0 0x7f95cc197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.819+0000 7f95d3084640 1 -- 172.21.15.123:0/1335425812 >> 172.21.15.123:0/1335425812 conn(0x7f95cc0fb640 msgr2=0x7f95cc105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:46.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.820+0000 7f95d3084640 1 -- 172.21.15.123:0/1335425812 shutdown_connections 2024-08-18T22:07:46.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.820+0000 7f95d3084640 1 -- 172.21.15.123:0/1335425812 wait complete. 2024-08-18T22:07:46.833 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:01:09.550765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-18T22:05:18.077632+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-18T22:05:20.808463+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-18T22:05:27.136662+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-18T22:07:46.834 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T22:07:46.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:46 smithi183 ceph-mon[22097]: pgmap v340: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-18T22:07:46.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:46 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3487560249' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-08-18T22:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.934+0000 7f1187479640 1 -- 172.21.15.123:0/471721952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11801033f0 msgr2=0x7f1180109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.934+0000 7f1187479640 1 --2- 172.21.15.123:0/471721952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11801033f0 0x7f1180109c80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1178009ca0 tx=0x7f117802a8c0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.934+0000 7f1187479640 1 -- 172.21.15.123:0/471721952 shutdown_connections 2024-08-18T22:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.934+0000 7f1187479640 1 --2- 172.21.15.123:0/471721952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11801033f0 0x7f1180109c80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.934+0000 7f1187479640 1 --2- 172.21.15.123:0/471721952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1180102a30 0x7f1180102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.934+0000 7f1187479640 1 --2- 172.21.15.123:0/471721952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1180101840 0x7f1180101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.934+0000 7f1187479640 1 -- 172.21.15.123:0/471721952 >> 172.21.15.123:0/471721952 conn(0x7f11800fcfe0 msgr2=0x7f11800ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.934+0000 7f1187479640 1 -- 172.21.15.123:0/471721952 shutdown_connections 2024-08-18T22:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.934+0000 7f1187479640 1 -- 172.21.15.123:0/471721952 wait complete. 2024-08-18T22:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1187479640 1 Processor -- start 2024-08-18T22:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1187479640 1 -- start start 2024-08-18T22:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1187479640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1180101840 0x7f1180197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1187479640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1180102a30 0x7f1180198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1187479640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11801033f0 0x7f118019f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1187479640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f118010d540 con 0x7f11801033f0 2024-08-18T22:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1187479640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f118010d3c0 con 0x7f1180102a30 2024-08-18T22:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1187479640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f118010d6c0 con 0x7f1180101840 2024-08-18T22:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1185a16640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11801033f0 0x7f118019f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1185a16640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11801033f0 0x7f118019f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47572/0 (socket says 172.21.15.123:47572) 2024-08-18T22:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1185a16640 1 -- 172.21.15.123:0/1513032825 learned_addr learned my addr 172.21.15.123:0/1513032825 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1185215640 1 --2- 172.21.15.123:0/1513032825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1180101840 0x7f1180197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:46.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1184a14640 1 --2- 172.21.15.123:0/1513032825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1180102a30 0x7f1180198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:46.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1185a16640 1 -- 172.21.15.123:0/1513032825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1180101840 msgr2=0x7f1180197bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:46.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1185a16640 1 --2- 172.21.15.123:0/1513032825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1180101840 0x7f1180197bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1185a16640 1 -- 172.21.15.123:0/1513032825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1180102a30 msgr2=0x7f1180198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:46.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1185a16640 1 --2- 172.21.15.123:0/1513032825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1180102a30 0x7f1180198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:46.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1185a16640 1 -- 172.21.15.123:0/1513032825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118019f810 con 0x7f11801033f0 2024-08-18T22:07:46.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.935+0000 7f1185a16640 1 --2- 172.21.15.123:0/1513032825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11801033f0 0x7f118019f1a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1178005e30 tx=0x7f1178031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:46.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.936+0000 7f11767fc640 1 -- 172.21.15.123:0/1513032825 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178003b70 con 0x7f11801033f0 2024-08-18T22:07:46.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.936+0000 7f11767fc640 1 -- 172.21.15.123:0/1513032825 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1178003d10 con 0x7f11801033f0 2024-08-18T22:07:46.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.936+0000 7f1187479640 1 -- 172.21.15.123:0/1513032825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118019faa0 con 0x7f11801033f0 2024-08-18T22:07:46.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.936+0000 7f11767fc640 1 -- 172.21.15.123:0/1513032825 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117802fd30 con 0x7f11801033f0 2024-08-18T22:07:46.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.936+0000 7f1187479640 1 -- 172.21.15.123:0/1513032825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f118019fff0 con 0x7f11801033f0 2024-08-18T22:07:46.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.937+0000 7f1187479640 1 -- 172.21.15.123:0/1513032825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1180108c30 con 0x7f11801033f0 2024-08-18T22:07:46.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.938+0000 7f11767fc640 1 -- 172.21.15.123:0/1513032825 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f1178004050 con 0x7f11801033f0 2024-08-18T22:07:46.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.938+0000 7f11767fc640 1 --2- 172.21.15.123:0/1513032825 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f116c0a2b90 0x7f116c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:46.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.939+0000 7f1185215640 1 --2- 172.21.15.123:0/1513032825 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f116c0a2b90 0x7f116c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:46.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.939+0000 7f11767fc640 1 -- 172.21.15.123:0/1513032825 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f11780f0890 con 0x7f11801033f0 2024-08-18T22:07:46.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.939+0000 7f1185215640 1 --2- 172.21.15.123:0/1513032825 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f116c0a2b90 0x7f116c0a5050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1180102890 tx=0x7f1170009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:46.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:46.942+0000 7f11767fc640 1 -- 172.21.15.123:0/1513032825 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f11780bd460 con 0x7f11801033f0 2024-08-18T22:07:47.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.106+0000 7f1187479640 1 -- 172.21.15.123:0/1513032825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1180062b20 con 0x7f11801033f0 2024-08-18T22:07:47.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.106+0000 7f11767fc640 1 -- 172.21.15.123:0/1513032825 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7f11780bcd60 con 0x7f11801033f0 2024-08-18T22:07:47.109 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-08-18T22:07:47.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.108+0000 7f1187479640 1 -- 172.21.15.123:0/1513032825 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f116c0a2b90 msgr2=0x7f116c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.108+0000 7f1187479640 1 --2- 172.21.15.123:0/1513032825 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f116c0a2b90 0x7f116c0a5050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1180102890 tx=0x7f1170009110 comp rx=0 tx=0).stop 2024-08-18T22:07:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.108+0000 7f1187479640 1 -- 172.21.15.123:0/1513032825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11801033f0 msgr2=0x7f118019f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.108+0000 7f1187479640 1 --2- 172.21.15.123:0/1513032825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11801033f0 0x7f118019f1a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1178005e30 tx=0x7f1178031ee0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.108+0000 7f1187479640 1 -- 172.21.15.123:0/1513032825 shutdown_connections 2024-08-18T22:07:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.108+0000 7f1187479640 1 --2- 172.21.15.123:0/1513032825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11801033f0 0x7f118019f1a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.108+0000 7f1187479640 1 --2- 172.21.15.123:0/1513032825 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f116c0a2b90 0x7f116c0a5050 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.108+0000 7f1187479640 1 --2- 172.21.15.123:0/1513032825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1180102a30 0x7f1180198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.108+0000 7f1187479640 1 --2- 172.21.15.123:0/1513032825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1180101840 0x7f1180197bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.108+0000 7f1187479640 1 -- 172.21.15.123:0/1513032825 >> 172.21.15.123:0/1513032825 conn(0x7f11800fcfe0 msgr2=0x7f1180105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.108+0000 7f1187479640 1 -- 172.21.15.123:0/1513032825 shutdown_connections 2024-08-18T22:07:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.108+0000 7f1187479640 1 -- 172.21.15.123:0/1513032825 wait complete. 2024-08-18T22:07:47.122 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-18T22:07:47.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 -- 172.21.15.123:0/3773750187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9080104c30 msgr2=0x7f9080107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 --2- 172.21.15.123:0/3773750187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9080104c30 0x7f9080107020 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9074009900 tx=0x7f907402a410 comp rx=0 tx=0).stop 2024-08-18T22:07:47.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 -- 172.21.15.123:0/3773750187 shutdown_connections 2024-08-18T22:07:47.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 --2- 172.21.15.123:0/3773750187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9080107560 0x7f9080109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 --2- 172.21.15.123:0/3773750187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9080104c30 0x7f9080107020 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 --2- 172.21.15.123:0/3773750187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9080102300 0x7f90801046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 -- 172.21.15.123:0/3773750187 >> 172.21.15.123:0/3773750187 conn(0x7f90800fbe80 msgr2=0x7f90800fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:47.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 -- 172.21.15.123:0/3773750187 shutdown_connections 2024-08-18T22:07:47.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 -- 172.21.15.123:0/3773750187 wait complete. 2024-08-18T22:07:47.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 Processor -- start 2024-08-18T22:07:47.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 -- start start 2024-08-18T22:07:47.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9080102300 0x7f9080197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:47.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9080104c30 0x7f9080198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:47.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9080107560 0x7f908019f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:47.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f908010d4c0 con 0x7f9080102300 2024-08-18T22:07:47.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f908010d340 con 0x7f9080104c30 2024-08-18T22:07:47.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9087ee6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f908010d640 con 0x7f9080107560 2024-08-18T22:07:47.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.222+0000 7f9085c82640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9080102300 0x7f9080197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:47.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.223+0000 7f9085c82640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9080102300 0x7f9080197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47584/0 (socket says 172.21.15.123:47584) 2024-08-18T22:07:47.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.223+0000 7f9085c82640 1 -- 172.21.15.123:0/1847702074 learned_addr learned my addr 172.21.15.123:0/1847702074 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:47.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.223+0000 7f9085481640 1 --2- 172.21.15.123:0/1847702074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9080104c30 0x7f9080198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:47.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.223+0000 7f9086483640 1 --2- 172.21.15.123:0/1847702074 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9080107560 0x7f908019f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:47.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.223+0000 7f9085c82640 1 -- 172.21.15.123:0/1847702074 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9080107560 msgr2=0x7f908019f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.223+0000 7f9085c82640 1 --2- 172.21.15.123:0/1847702074 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9080107560 0x7f908019f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.223+0000 7f9085c82640 1 -- 172.21.15.123:0/1847702074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9080104c30 msgr2=0x7f9080198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.223+0000 7f9085c82640 1 --2- 172.21.15.123:0/1847702074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9080104c30 0x7f9080198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.223+0000 7f9085c82640 1 -- 172.21.15.123:0/1847702074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908019f760 con 0x7f9080102300 2024-08-18T22:07:47.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.223+0000 7f9085c82640 1 --2- 172.21.15.123:0/1847702074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9080102300 0x7f9080197b40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f907000cce0 tx=0x7f907000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:47.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.223+0000 7f907effd640 1 -- 172.21.15.123:0/1847702074 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907000f650 con 0x7f9080102300 2024-08-18T22:07:47.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.223+0000 7f907effd640 1 -- 172.21.15.123:0/1847702074 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f907000fcd0 con 0x7f9080102300 2024-08-18T22:07:47.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.223+0000 7f9087ee6640 1 -- 172.21.15.123:0/1847702074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908019fa50 con 0x7f9080102300 2024-08-18T22:07:47.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.223+0000 7f907effd640 1 -- 172.21.15.123:0/1847702074 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9070018c70 con 0x7f9080102300 2024-08-18T22:07:47.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.223+0000 7f9087ee6640 1 -- 172.21.15.123:0/1847702074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f908019ffc0 con 0x7f9080102300 2024-08-18T22:07:47.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.224+0000 7f9087ee6640 1 -- 172.21.15.123:0/1847702074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90800fd970 con 0x7f9080102300 2024-08-18T22:07:47.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.226+0000 7f907effd640 1 -- 172.21.15.123:0/1847702074 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f907000f7f0 con 0x7f9080102300 2024-08-18T22:07:47.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.226+0000 7f907effd640 1 --2- 172.21.15.123:0/1847702074 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f90680a2c10 0x7f90680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:47.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.226+0000 7f9085481640 1 --2- 172.21.15.123:0/1847702074 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f90680a2c10 0x7f90680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:47.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.226+0000 7f907effd640 1 -- 172.21.15.123:0/1847702074 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f90700cfb80 con 0x7f9080102300 2024-08-18T22:07:47.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.227+0000 7f9085481640 1 --2- 172.21.15.123:0/1847702074 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f90680a2c10 0x7f90680a50d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9074006010 tx=0x7f9074000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:47.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.229+0000 7f907effd640 1 -- 172.21.15.123:0/1847702074 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9070014030 con 0x7f9080102300 2024-08-18T22:07:47.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.397+0000 7f9087ee6640 1 -- 172.21.15.123:0/1847702074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9080062b20 con 0x7f9080102300 2024-08-18T22:07:47.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.397+0000 7f907effd640 1 -- 172.21.15.123:0/1847702074 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) ==== 104+0+11 (secure 0 0 0) 0x7f907009c860 con 0x7f9080102300 2024-08-18T22:07:47.400 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-08-18T22:07:47.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.399+0000 7f9087ee6640 1 -- 172.21.15.123:0/1847702074 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f90680a2c10 msgr2=0x7f90680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.399+0000 7f9087ee6640 1 --2- 172.21.15.123:0/1847702074 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f90680a2c10 0x7f90680a50d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9074006010 tx=0x7f9074000bc0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.399+0000 7f9087ee6640 1 -- 172.21.15.123:0/1847702074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9080102300 msgr2=0x7f9080197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.399+0000 7f9087ee6640 1 --2- 172.21.15.123:0/1847702074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9080102300 0x7f9080197b40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f907000cce0 tx=0x7f907000a620 comp rx=0 tx=0).stop 2024-08-18T22:07:47.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.399+0000 7f9087ee6640 1 -- 172.21.15.123:0/1847702074 shutdown_connections 2024-08-18T22:07:47.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.399+0000 7f9087ee6640 1 --2- 172.21.15.123:0/1847702074 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9080107560 0x7f908019f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.399+0000 7f9087ee6640 1 --2- 172.21.15.123:0/1847702074 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f90680a2c10 0x7f90680a50d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.399+0000 7f9087ee6640 1 --2- 172.21.15.123:0/1847702074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9080104c30 0x7f9080198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.399+0000 7f9087ee6640 1 --2- 172.21.15.123:0/1847702074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9080102300 0x7f9080197b40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.399+0000 7f9087ee6640 1 -- 172.21.15.123:0/1847702074 >> 172.21.15.123:0/1847702074 conn(0x7f90800fbe80 msgr2=0x7f9080102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:47.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.399+0000 7f9087ee6640 1 -- 172.21.15.123:0/1847702074 shutdown_connections 2024-08-18T22:07:47.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.399+0000 7f9087ee6640 1 -- 172.21.15.123:0/1847702074 wait complete. 2024-08-18T22:07:47.412 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-18T22:07:47.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.512+0000 7f699a2ae640 1 -- 172.21.15.123:0/2525664985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6994100290 msgr2=0x7f6994109e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.512+0000 7f699a2ae640 1 --2- 172.21.15.123:0/2525664985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6994100290 0x7f6994109e40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f698c009cd0 tx=0x7f698c02a8e0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.512+0000 7f699a2ae640 1 -- 172.21.15.123:0/2525664985 shutdown_connections 2024-08-18T22:07:47.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.512+0000 7f699a2ae640 1 --2- 172.21.15.123:0/2525664985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6994100290 0x7f6994109e40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.512+0000 7f699a2ae640 1 --2- 172.21.15.123:0/2525664985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69940ff8d0 0x7f69940ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.512+0000 7f699a2ae640 1 --2- 172.21.15.123:0/2525664985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6994102e60 0x7f6994103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.512+0000 7f699a2ae640 1 -- 172.21.15.123:0/2525664985 >> 172.21.15.123:0/2525664985 conn(0x7f69940fb680 msgr2=0x7f69940fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:47.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.512+0000 7f699a2ae640 1 -- 172.21.15.123:0/2525664985 shutdown_connections 2024-08-18T22:07:47.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.512+0000 7f699a2ae640 1 -- 172.21.15.123:0/2525664985 wait complete. 2024-08-18T22:07:47.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f699a2ae640 1 Processor -- start 2024-08-18T22:07:47.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f699a2ae640 1 -- start start 2024-08-18T22:07:47.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f699a2ae640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69940ff8d0 0x7f6994197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:47.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f699a2ae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6994100290 0x7f6994198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:47.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f699a2ae640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6994102e60 0x7f699419f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:47.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f699a2ae640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f699410d500 con 0x7f6994100290 2024-08-18T22:07:47.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f699a2ae640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f699410d380 con 0x7f69940ff8d0 2024-08-18T22:07:47.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f699a2ae640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f699410d680 con 0x7f6994102e60 2024-08-18T22:07:47.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f69937fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6994100290 0x7f6994198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:47.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f69937fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6994100290 0x7f6994198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47600/0 (socket says 172.21.15.123:47600) 2024-08-18T22:07:47.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f69937fe640 1 -- 172.21.15.123:0/4204187046 learned_addr learned my addr 172.21.15.123:0/4204187046 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:47.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f699884b640 1 --2- 172.21.15.123:0/4204187046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6994102e60 0x7f699419f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:47.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f6993fff640 1 --2- 172.21.15.123:0/4204187046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69940ff8d0 0x7f6994197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:47.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f69937fe640 1 -- 172.21.15.123:0/4204187046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6994102e60 msgr2=0x7f699419f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f69937fe640 1 --2- 172.21.15.123:0/4204187046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6994102e60 0x7f699419f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f69937fe640 1 -- 172.21.15.123:0/4204187046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69940ff8d0 msgr2=0x7f6994197c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.513+0000 7f69937fe640 1 --2- 172.21.15.123:0/4204187046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69940ff8d0 0x7f6994197c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.514+0000 7f69937fe640 1 -- 172.21.15.123:0/4204187046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699419f840 con 0x7f6994100290 2024-08-18T22:07:47.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.514+0000 7f6993fff640 1 --2- 172.21.15.123:0/4204187046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69940ff8d0 0x7f6994197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:47.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.514+0000 7f69937fe640 1 --2- 172.21.15.123:0/4204187046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6994100290 0x7f6994198170 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f698800e9f0 tx=0x7f698800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:47.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.514+0000 7f69917fa640 1 -- 172.21.15.123:0/4204187046 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698800cd80 con 0x7f6994100290 2024-08-18T22:07:47.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.514+0000 7f699a2ae640 1 -- 172.21.15.123:0/4204187046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f699419fb30 con 0x7f6994100290 2024-08-18T22:07:47.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.514+0000 7f69917fa640 1 -- 172.21.15.123:0/4204187046 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6988010910 con 0x7f6994100290 2024-08-18T22:07:47.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.514+0000 7f69917fa640 1 -- 172.21.15.123:0/4204187046 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69880188f0 con 0x7f6994100290 2024-08-18T22:07:47.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.514+0000 7f699a2ae640 1 -- 172.21.15.123:0/4204187046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69941a0080 con 0x7f6994100290 2024-08-18T22:07:47.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.515+0000 7f699a2ae640 1 -- 172.21.15.123:0/4204187046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6994108e90 con 0x7f6994100290 2024-08-18T22:07:47.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.516+0000 7f69917fa640 1 -- 172.21.15.123:0/4204187046 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f6988010ac0 con 0x7f6994100290 2024-08-18T22:07:47.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.516+0000 7f69917fa640 1 --2- 172.21.15.123:0/4204187046 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f697c0a2b90 0x7f697c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:47.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.517+0000 7f6993fff640 1 --2- 172.21.15.123:0/4204187046 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f697c0a2b90 0x7f697c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:47.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.517+0000 7f69917fa640 1 -- 172.21.15.123:0/4204187046 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f69880cf8a0 con 0x7f6994100290 2024-08-18T22:07:47.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.517+0000 7f6993fff640 1 --2- 172.21.15.123:0/4204187046 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f697c0a2b90 0x7f697c0a5050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6994199100 tx=0x7f6984005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:47.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.521+0000 7f69917fa640 1 -- 172.21.15.123:0/4204187046 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f698809c470 con 0x7f6994100290 2024-08-18T22:07:47.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.687+0000 7f699a2ae640 1 -- 172.21.15.123:0/4204187046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6994062b50 con 0x7f6994100290 2024-08-18T22:07:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.688+0000 7f69917fa640 1 -- 172.21.15.123:0/4204187046 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) ==== 100+0+11 (secure 0 0 0) 0x7f698809bd70 con 0x7f6994100290 2024-08-18T22:07:47.690 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-08-18T22:07:47.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.690+0000 7f699a2ae640 1 -- 172.21.15.123:0/4204187046 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f697c0a2b90 msgr2=0x7f697c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.690+0000 7f699a2ae640 1 --2- 172.21.15.123:0/4204187046 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f697c0a2b90 0x7f697c0a5050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6994199100 tx=0x7f6984005f90 comp rx=0 tx=0).stop 2024-08-18T22:07:47.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.690+0000 7f699a2ae640 1 -- 172.21.15.123:0/4204187046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6994100290 msgr2=0x7f6994198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.690+0000 7f699a2ae640 1 --2- 172.21.15.123:0/4204187046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6994100290 0x7f6994198170 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f698800e9f0 tx=0x7f698800eeb0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.690+0000 7f699a2ae640 1 -- 172.21.15.123:0/4204187046 shutdown_connections 2024-08-18T22:07:47.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.690+0000 7f699a2ae640 1 --2- 172.21.15.123:0/4204187046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6994102e60 0x7f699419f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.690+0000 7f699a2ae640 1 --2- 172.21.15.123:0/4204187046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6994100290 0x7f6994198170 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.690+0000 7f699a2ae640 1 --2- 172.21.15.123:0/4204187046 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f697c0a2b90 0x7f697c0a5050 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.690+0000 7f699a2ae640 1 --2- 172.21.15.123:0/4204187046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69940ff8d0 0x7f6994197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.690+0000 7f699a2ae640 1 -- 172.21.15.123:0/4204187046 >> 172.21.15.123:0/4204187046 conn(0x7f69940fb680 msgr2=0x7f6994106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:47.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.690+0000 7f699a2ae640 1 -- 172.21.15.123:0/4204187046 shutdown_connections 2024-08-18T22:07:47.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.690+0000 7f699a2ae640 1 -- 172.21.15.123:0/4204187046 wait complete. 2024-08-18T22:07:47.702 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:47 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3487560249' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-18T22:07:47.702 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:47 smithi123 ceph-mon[18462]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:07:47.702 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:47 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1335425812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:07:47.703 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:47 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1513032825' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-18T22:07:47.703 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:47 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1847702074' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-18T22:07:47.704 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-18T22:07:47.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:47 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3487560249' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-18T22:07:47.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:47 smithi130 ceph-mon[21698]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:07:47.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:47 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1335425812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:07:47.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:47 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1513032825' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-18T22:07:47.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:47 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1847702074' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-18T22:07:47.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.805+0000 7fbfef552640 1 -- 172.21.15.123:0/3923704691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe81000a0 msgr2=0x7fbfe81024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.805+0000 7fbfef552640 1 --2- 172.21.15.123:0/3923704691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe81000a0 0x7fbfe81024b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009900 tx=0x7fbfe402a410 comp rx=0 tx=0).stop 2024-08-18T22:07:47.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.805+0000 7fbfef552640 1 -- 172.21.15.123:0/3923704691 shutdown_connections 2024-08-18T22:07:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.805+0000 7fbfef552640 1 --2- 172.21.15.123:0/3923704691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfe81053a0 0x7fbfe8105850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.805+0000 7fbfef552640 1 --2- 172.21.15.123:0/3923704691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfe81029f0 0x7fbfe8104e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.805+0000 7fbfef552640 1 --2- 172.21.15.123:0/3923704691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe81000a0 0x7fbfe81024b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.805+0000 7fbfef552640 1 -- 172.21.15.123:0/3923704691 >> 172.21.15.123:0/3923704691 conn(0x7fbfe80fbeb0 msgr2=0x7fbfe80fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.805+0000 7fbfef552640 1 -- 172.21.15.123:0/3923704691 shutdown_connections 2024-08-18T22:07:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.805+0000 7fbfef552640 1 -- 172.21.15.123:0/3923704691 wait complete. 2024-08-18T22:07:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfef552640 1 Processor -- start 2024-08-18T22:07:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfef552640 1 -- start start 2024-08-18T22:07:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfef552640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe81000a0 0x7fbfe819e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfef552640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfe81029f0 0x7fbfe819e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfef552640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfe81053a0 0x7fbfe81a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfef552640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe8113aa0 con 0x7fbfe81000a0 2024-08-18T22:07:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfef552640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe8113920 con 0x7fbfe81029f0 2024-08-18T22:07:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfef552640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe8113c20 con 0x7fbfe81053a0 2024-08-18T22:07:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfed2ee640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe81000a0 0x7fbfe819e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfed2ee640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe81000a0 0x7fbfe819e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47626/0 (socket says 172.21.15.123:47626) 2024-08-18T22:07:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfed2ee640 1 -- 172.21.15.123:0/1996214368 learned_addr learned my addr 172.21.15.123:0/1996214368 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfedaef640 1 --2- 172.21.15.123:0/1996214368 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfe81053a0 0x7fbfe81a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfed2ee640 1 -- 172.21.15.123:0/1996214368 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfe81053a0 msgr2=0x7fbfe81a5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfed2ee640 1 --2- 172.21.15.123:0/1996214368 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfe81053a0 0x7fbfe81a5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfecaed640 1 --2- 172.21.15.123:0/1996214368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfe81029f0 0x7fbfe819e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfed2ee640 1 -- 172.21.15.123:0/1996214368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfe81029f0 msgr2=0x7fbfe819e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfed2ee640 1 --2- 172.21.15.123:0/1996214368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfe81029f0 0x7fbfe819e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfed2ee640 1 -- 172.21.15.123:0/1996214368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe81a5dd0 con 0x7fbfe81000a0 2024-08-18T22:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfed2ee640 1 --2- 172.21.15.123:0/1996214368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe81000a0 0x7fbfe819e1b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009230 tx=0x7fbfe4004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfde7fc640 1 -- 172.21.15.123:0/1996214368 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe403f030 con 0x7fbfe81000a0 2024-08-18T22:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.806+0000 7fbfde7fc640 1 -- 172.21.15.123:0/1996214368 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfe4003ce0 con 0x7fbfe81000a0 2024-08-18T22:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.807+0000 7fbfde7fc640 1 -- 172.21.15.123:0/1996214368 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4035070 con 0x7fbfe81000a0 2024-08-18T22:07:47.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.807+0000 7fbfef552640 1 -- 172.21.15.123:0/1996214368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe81a6060 con 0x7fbfe81000a0 2024-08-18T22:07:47.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.807+0000 7fbfef552640 1 -- 172.21.15.123:0/1996214368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe81a6550 con 0x7fbfe81000a0 2024-08-18T22:07:47.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.808+0000 7fbfef552640 1 -- 172.21.15.123:0/1996214368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe80fd9a0 con 0x7fbfe81000a0 2024-08-18T22:07:47.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.809+0000 7fbfde7fc640 1 -- 172.21.15.123:0/1996214368 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fbfe4042030 con 0x7fbfe81000a0 2024-08-18T22:07:47.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.809+0000 7fbfde7fc640 1 --2- 172.21.15.123:0/1996214368 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbfd40a2b90 0x7fbfd40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:47.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.809+0000 7fbfecaed640 1 --2- 172.21.15.123:0/1996214368 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbfd40a2b90 0x7fbfd40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:47.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.809+0000 7fbfde7fc640 1 -- 172.21.15.123:0/1996214368 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fbfe40efe70 con 0x7fbfe81000a0 2024-08-18T22:07:47.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.810+0000 7fbfecaed640 1 --2- 172.21.15.123:0/1996214368 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbfd40a2b90 0x7fbfd40a5050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8005fd0 tx=0x7fbfd8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:47.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.812+0000 7fbfde7fc640 1 -- 172.21.15.123:0/1996214368 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbfe40bca40 con 0x7fbfe81000a0 2024-08-18T22:07:47.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:47 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3487560249' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-18T22:07:47.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:47 smithi183 ceph-mon[22097]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:07:47.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:47 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1335425812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:07:47.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:47 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1513032825' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-18T22:07:47.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:47 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1847702074' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-18T22:07:47.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.980+0000 7fbfef552640 1 -- 172.21.15.123:0/1996214368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fbfe8062b20 con 0x7fbfe81000a0 2024-08-18T22:07:47.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.981+0000 7fbfde7fc640 1 -- 172.21.15.123:0/1996214368 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) ==== 103+0+11 (secure 0 0 0) 0x7fbfe40bc340 con 0x7fbfe81000a0 2024-08-18T22:07:47.983 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-08-18T22:07:47.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.982+0000 7fbfef552640 1 -- 172.21.15.123:0/1996214368 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbfd40a2b90 msgr2=0x7fbfd40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.982+0000 7fbfef552640 1 --2- 172.21.15.123:0/1996214368 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbfd40a2b90 0x7fbfd40a5050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8005fd0 tx=0x7fbfd8005850 comp rx=0 tx=0).stop 2024-08-18T22:07:47.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.983+0000 7fbfef552640 1 -- 172.21.15.123:0/1996214368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe81000a0 msgr2=0x7fbfe819e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:47.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.983+0000 7fbfef552640 1 --2- 172.21.15.123:0/1996214368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe81000a0 0x7fbfe819e1b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009230 tx=0x7fbfe4004360 comp rx=0 tx=0).stop 2024-08-18T22:07:47.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.983+0000 7fbfef552640 1 -- 172.21.15.123:0/1996214368 shutdown_connections 2024-08-18T22:07:47.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.983+0000 7fbfef552640 1 --2- 172.21.15.123:0/1996214368 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfe81053a0 0x7fbfe81a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.983+0000 7fbfef552640 1 --2- 172.21.15.123:0/1996214368 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbfd40a2b90 0x7fbfd40a5050 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.983+0000 7fbfef552640 1 --2- 172.21.15.123:0/1996214368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfe81029f0 0x7fbfe819e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.983+0000 7fbfef552640 1 --2- 172.21.15.123:0/1996214368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe81000a0 0x7fbfe819e1b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:47.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.983+0000 7fbfef552640 1 -- 172.21.15.123:0/1996214368 >> 172.21.15.123:0/1996214368 conn(0x7fbfe80fbeb0 msgr2=0x7fbfe8100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:47.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.983+0000 7fbfef552640 1 -- 172.21.15.123:0/1996214368 shutdown_connections 2024-08-18T22:07:47.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:47.983+0000 7fbfef552640 1 -- 172.21.15.123:0/1996214368 wait complete. 2024-08-18T22:07:47.996 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-08-18T22:07:47.996 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:07:48.245 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:48.672 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:48 smithi123 ceph-mon[18462]: pgmap v341: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-18T22:07:48.672 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:48 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/4204187046' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-18T22:07:48.673 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:48 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1996214368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-08-18T22:07:48.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.750+0000 7fd8c3a2c640 1 -- 172.21.15.123:0/4069563410 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8bc1128c0 msgr2=0x7fd8bc114cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:48.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.750+0000 7fd8c3a2c640 1 --2- 172.21.15.123:0/4069563410 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8bc1128c0 0x7fd8bc114cb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009ca0 tx=0x7fd8b402a950 comp rx=0 tx=0).stop 2024-08-18T22:07:48.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.750+0000 7fd8c3a2c640 1 -- 172.21.15.123:0/4069563410 shutdown_connections 2024-08-18T22:07:48.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.750+0000 7fd8c3a2c640 1 --2- 172.21.15.123:0/4069563410 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8bc1128c0 0x7fd8bc114cb0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:48.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.750+0000 7fd8c3a2c640 1 --2- 172.21.15.123:0/4069563410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8bc074be0 0x7fd8bc112380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.750+0000 7fd8c3a2c640 1 --2- 172.21.15.123:0/4069563410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8bc0742c0 0x7fd8bc0746a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.750+0000 7fd8c3a2c640 1 -- 172.21.15.123:0/4069563410 >> 172.21.15.123:0/4069563410 conn(0x7fd8bc0fd5f0 msgr2=0x7fd8bc0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.751+0000 7fd8c3a2c640 1 -- 172.21.15.123:0/4069563410 shutdown_connections 2024-08-18T22:07:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.751+0000 7fd8c3a2c640 1 -- 172.21.15.123:0/4069563410 wait complete. 2024-08-18T22:07:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.751+0000 7fd8c3a2c640 1 Processor -- start 2024-08-18T22:07:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.751+0000 7fd8c3a2c640 1 -- start start 2024-08-18T22:07:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.751+0000 7fd8c3a2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8bc0742c0 0x7fd8bc19e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.751+0000 7fd8c3a2c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8bc074be0 0x7fd8bc19ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.751+0000 7fd8c3a2c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8bc1128c0 0x7fd8bc1a2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.751+0000 7fd8c3a2c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd8bc118280 con 0x7fd8bc1128c0 2024-08-18T22:07:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.751+0000 7fd8c3a2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd8bc118100 con 0x7fd8bc0742c0 2024-08-18T22:07:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.751+0000 7fd8c3a2c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd8bc118400 con 0x7fd8bc074be0 2024-08-18T22:07:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8c1fc9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8bc1128c0 0x7fd8bc1a2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8c1fc9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8bc1128c0 0x7fd8bc1a2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47644/0 (socket says 172.21.15.123:47644) 2024-08-18T22:07:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8c1fc9640 1 -- 172.21.15.123:0/3256622342 learned_addr learned my addr 172.21.15.123:0/3256622342 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8c17c8640 1 --2- 172.21.15.123:0/3256622342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8bc0742c0 0x7fd8bc19e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8c0fc7640 1 --2- 172.21.15.123:0/3256622342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8bc074be0 0x7fd8bc19ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8c1fc9640 1 -- 172.21.15.123:0/3256622342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8bc074be0 msgr2=0x7fd8bc19ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8c1fc9640 1 --2- 172.21.15.123:0/3256622342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8bc074be0 0x7fd8bc19ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8c1fc9640 1 -- 172.21.15.123:0/3256622342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8bc0742c0 msgr2=0x7fd8bc19e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8c1fc9640 1 --2- 172.21.15.123:0/3256622342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8bc0742c0 0x7fd8bc19e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8c1fc9640 1 -- 172.21.15.123:0/3256622342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8bc1a36d0 con 0x7fd8bc1128c0 2024-08-18T22:07:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8c1fc9640 1 --2- 172.21.15.123:0/3256622342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8bc1128c0 0x7fd8bc1a2ff0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd8b402ae70 tx=0x7fd8b402f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8b27fc640 1 -- 172.21.15.123:0/3256622342 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4034040 con 0x7fd8bc1128c0 2024-08-18T22:07:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8c3a2c640 1 -- 172.21.15.123:0/3256622342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8bc1a3960 con 0x7fd8bc1128c0 2024-08-18T22:07:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8b27fc640 1 -- 172.21.15.123:0/3256622342 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8b4030920 con 0x7fd8bc1128c0 2024-08-18T22:07:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8b27fc640 1 -- 172.21.15.123:0/3256622342 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4004780 con 0x7fd8bc1128c0 2024-08-18T22:07:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.752+0000 7fd8c3a2c640 1 -- 172.21.15.123:0/3256622342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8bc1ab2a0 con 0x7fd8bc1128c0 2024-08-18T22:07:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.753+0000 7fd8c3a2c640 1 -- 172.21.15.123:0/3256622342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8bc0746a0 con 0x7fd8bc1128c0 2024-08-18T22:07:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.755+0000 7fd8b27fc640 1 -- 172.21.15.123:0/3256622342 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fd8b4037020 con 0x7fd8bc1128c0 2024-08-18T22:07:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.755+0000 7fd8b27fc640 1 --2- 172.21.15.123:0/3256622342 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd8a80a2b80 0x7fd8a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.755+0000 7fd8c17c8640 1 --2- 172.21.15.123:0/3256622342 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd8a80a2b80 0x7fd8a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.755+0000 7fd8b27fc640 1 -- 172.21.15.123:0/3256622342 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fd8b40f01f0 con 0x7fd8bc1128c0 2024-08-18T22:07:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.756+0000 7fd8c17c8640 1 --2- 172.21.15.123:0/3256622342 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd8a80a2b80 0x7fd8a80a5040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00abe0 tx=0x7fd8ac00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.759+0000 7fd8b27fc640 1 -- 172.21.15.123:0/3256622342 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd8b40bcdc0 con 0x7fd8bc1128c0 2024-08-18T22:07:48.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:48 smithi183 ceph-mon[22097]: pgmap v341: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-18T22:07:48.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:48 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/4204187046' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-18T22:07:48.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:48 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1996214368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-08-18T22:07:48.933 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:48 smithi130 ceph-mon[21698]: pgmap v341: 129 pgs: 129 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-18T22:07:48.933 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:48 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/4204187046' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-18T22:07:48.933 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:48 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1996214368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-08-18T22:07:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.961+0000 7fd8c3a2c640 1 -- 172.21.15.123:0/3256622342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8bc19fa80 con 0x7fd8bc1128c0 2024-08-18T22:07:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.961+0000 7fd8b27fc640 1 -- 172.21.15.123:0/3256622342 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7fd8bc19fa80 con 0x7fd8bc1128c0 2024-08-18T22:07:48.964 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:48.964 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"btime":"2024-08-18T22:07:46:492460+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:07:45.601053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:07:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 26 2024-08-18T22:07:48.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.963+0000 7fd8c3a2c640 1 -- 172.21.15.123:0/3256622342 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd8a80a2b80 msgr2=0x7fd8a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:48.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.963+0000 7fd8c3a2c640 1 --2- 172.21.15.123:0/3256622342 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd8a80a2b80 0x7fd8a80a5040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00abe0 tx=0x7fd8ac00a2d0 comp rx=0 tx=0).stop 2024-08-18T22:07:48.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.963+0000 7fd8c3a2c640 1 -- 172.21.15.123:0/3256622342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8bc1128c0 msgr2=0x7fd8bc1a2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:48.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.963+0000 7fd8c3a2c640 1 --2- 172.21.15.123:0/3256622342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8bc1128c0 0x7fd8bc1a2ff0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd8b402ae70 tx=0x7fd8b402f5b0 comp rx=0 tx=0).stop 2024-08-18T22:07:48.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.964+0000 7fd8c3a2c640 1 -- 172.21.15.123:0/3256622342 shutdown_connections 2024-08-18T22:07:48.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.964+0000 7fd8c3a2c640 1 --2- 172.21.15.123:0/3256622342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8bc1128c0 0x7fd8bc1a2ff0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:48.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.964+0000 7fd8c3a2c640 1 --2- 172.21.15.123:0/3256622342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8bc074be0 0x7fd8bc19ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:48.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.964+0000 7fd8c3a2c640 1 --2- 172.21.15.123:0/3256622342 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd8a80a2b80 0x7fd8a80a5040 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:48.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.964+0000 7fd8c3a2c640 1 --2- 172.21.15.123:0/3256622342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8bc0742c0 0x7fd8bc19e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:48.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.964+0000 7fd8c3a2c640 1 -- 172.21.15.123:0/3256622342 >> 172.21.15.123:0/3256622342 conn(0x7fd8bc0fd5f0 msgr2=0x7fd8bc0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:48.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.964+0000 7fd8c3a2c640 1 -- 172.21.15.123:0/3256622342 shutdown_connections 2024-08-18T22:07:48.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:48.964+0000 7fd8c3a2c640 1 -- 172.21.15.123:0/3256622342 wait complete. 2024-08-18T22:07:49.655 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:49 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3256622342' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:49.656 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-08-18T22:07:49.657 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-08-18T22:07:49.657 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:07:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.759+0000 7fe0d57a1640 1 -- 172.21.15.123:0/4127770973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0d0107380 msgr2=0x7fe0d01097f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.759+0000 7fe0d57a1640 1 --2- 172.21.15.123:0/4127770973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0d0107380 0x7fe0d01097f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009ca0 tx=0x7fe0c802a8c0 comp rx=0 tx=0).stop 2024-08-18T22:07:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.759+0000 7fe0d57a1640 1 -- 172.21.15.123:0/4127770973 shutdown_connections 2024-08-18T22:07:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.759+0000 7fe0d57a1640 1 --2- 172.21.15.123:0/4127770973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0d0107380 0x7fe0d01097f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.759+0000 7fe0d57a1640 1 --2- 172.21.15.123:0/4127770973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d0104a50 0x7fe0d0106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.759+0000 7fe0d57a1640 1 --2- 172.21.15.123:0/4127770973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0d0102120 0x7fe0d0104510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.759+0000 7fe0d57a1640 1 -- 172.21.15.123:0/4127770973 >> 172.21.15.123:0/4127770973 conn(0x7fe0d00fbd20 msgr2=0x7fe0d00fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.759+0000 7fe0d57a1640 1 -- 172.21.15.123:0/4127770973 shutdown_connections 2024-08-18T22:07:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.759+0000 7fe0d57a1640 1 -- 172.21.15.123:0/4127770973 wait complete. 2024-08-18T22:07:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.759+0000 7fe0d57a1640 1 Processor -- start 2024-08-18T22:07:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.759+0000 7fe0d57a1640 1 -- start start 2024-08-18T22:07:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d57a1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0d0102120 0x7fe0d0197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d57a1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d0104a50 0x7fe0d0198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d57a1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0d0107380 0x7fe0d019f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d57a1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d010d3b0 con 0x7fe0d0107380 2024-08-18T22:07:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d57a1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d010d230 con 0x7fe0d0102120 2024-08-18T22:07:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d57a1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d010d530 con 0x7fe0d0104a50 2024-08-18T22:07:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d4fa0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0d0107380 0x7fe0d019f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d4fa0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0d0107380 0x7fe0d019f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47656/0 (socket says 172.21.15.123:47656) 2024-08-18T22:07:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d4fa0640 1 -- 172.21.15.123:0/2053269725 learned_addr learned my addr 172.21.15.123:0/2053269725 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0cffff640 1 --2- 172.21.15.123:0/2053269725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0d0102120 0x7fe0d0197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0cf7fe640 1 --2- 172.21.15.123:0/2053269725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d0104a50 0x7fe0d0198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d4fa0640 1 -- 172.21.15.123:0/2053269725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d0104a50 msgr2=0x7fe0d0198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d4fa0640 1 --2- 172.21.15.123:0/2053269725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d0104a50 0x7fe0d0198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d4fa0640 1 -- 172.21.15.123:0/2053269725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0d0102120 msgr2=0x7fe0d0197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d4fa0640 1 --2- 172.21.15.123:0/2053269725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0d0102120 0x7fe0d0197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d4fa0640 1 -- 172.21.15.123:0/2053269725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d019f6f0 con 0x7fe0d0107380 2024-08-18T22:07:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0cffff640 1 --2- 172.21.15.123:0/2053269725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0d0102120 0x7fe0d0197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:07:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d4fa0640 1 --2- 172.21.15.123:0/2053269725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0d0107380 0x7fe0d019f080 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009bf0 tx=0x7fe0c8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0cd7fa640 1 -- 172.21.15.123:0/2053269725 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8003b70 con 0x7fe0d0107380 2024-08-18T22:07:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0cd7fa640 1 -- 172.21.15.123:0/2053269725 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0c8003d10 con 0x7fe0d0107380 2024-08-18T22:07:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d57a1640 1 -- 172.21.15.123:0/2053269725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d019f980 con 0x7fe0d0107380 2024-08-18T22:07:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0cd7fa640 1 -- 172.21.15.123:0/2053269725 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c802fc50 con 0x7fe0d0107380 2024-08-18T22:07:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.760+0000 7fe0d57a1640 1 -- 172.21.15.123:0/2053269725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d019ff50 con 0x7fe0d0107380 2024-08-18T22:07:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.761+0000 7fe0d57a1640 1 -- 172.21.15.123:0/2053269725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d00fd810 con 0x7fe0d0107380 2024-08-18T22:07:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.763+0000 7fe0cd7fa640 1 -- 172.21.15.123:0/2053269725 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fe0c8004050 con 0x7fe0d0107380 2024-08-18T22:07:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.764+0000 7fe0cd7fa640 1 --2- 172.21.15.123:0/2053269725 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe0b80a2b90 0x7fe0b80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.764+0000 7fe0cffff640 1 --2- 172.21.15.123:0/2053269725 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe0b80a2b90 0x7fe0b80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.764+0000 7fe0cd7fa640 1 -- 172.21.15.123:0/2053269725 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe0c80f0760 con 0x7fe0d0107380 2024-08-18T22:07:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.764+0000 7fe0cffff640 1 --2- 172.21.15.123:0/2053269725 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe0b80a2b90 0x7fe0b80a5050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009fc0 tx=0x7fe0c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.767+0000 7fe0cd7fa640 1 -- 172.21.15.123:0/2053269725 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe0c80bd450 con 0x7fe0d0107380 2024-08-18T22:07:49.841 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:49 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3256622342' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:49.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:49 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3256622342' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:49.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.929+0000 7fe0d57a1640 1 -- 172.21.15.123:0/2053269725 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0d0062360 con 0x7fe0b80a2b90 2024-08-18T22:07:49.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.937+0000 7fe0cd7fa640 1 -- 172.21.15.123:0/2053269725 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340502 (secure 0 0 0) 0x7fe0d0062360 con 0x7fe0b80a2b90 2024-08-18T22:07:49.942 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:49.944 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-08-18T22:07:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.940+0000 7fe0d57a1640 1 -- 172.21.15.123:0/2053269725 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe0b80a2b90 msgr2=0x7fe0b80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.941+0000 7fe0d57a1640 1 --2- 172.21.15.123:0/2053269725 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe0b80a2b90 0x7fe0b80a5050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009fc0 tx=0x7fe0c0005f90 comp rx=0 tx=0).stop 2024-08-18T22:07:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.941+0000 7fe0d57a1640 1 -- 172.21.15.123:0/2053269725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0d0107380 msgr2=0x7fe0d019f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.941+0000 7fe0d57a1640 1 --2- 172.21.15.123:0/2053269725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0d0107380 0x7fe0d019f080 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009bf0 tx=0x7fe0c8004ab0 comp rx=0 tx=0).stop 2024-08-18T22:07:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.941+0000 7fe0d57a1640 1 -- 172.21.15.123:0/2053269725 shutdown_connections 2024-08-18T22:07:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.941+0000 7fe0d57a1640 1 --2- 172.21.15.123:0/2053269725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0d0107380 0x7fe0d019f080 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.941+0000 7fe0d57a1640 1 --2- 172.21.15.123:0/2053269725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d0104a50 0x7fe0d0198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.941+0000 7fe0d57a1640 1 --2- 172.21.15.123:0/2053269725 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe0b80a2b90 0x7fe0b80a5050 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.941+0000 7fe0d57a1640 1 --2- 172.21.15.123:0/2053269725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0d0102120 0x7fe0d0197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.941+0000 7fe0d57a1640 1 -- 172.21.15.123:0/2053269725 >> 172.21.15.123:0/2053269725 conn(0x7fe0d00fbd20 msgr2=0x7fe0d0102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.941+0000 7fe0d57a1640 1 -- 172.21.15.123:0/2053269725 shutdown_connections 2024-08-18T22:07:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:49.941+0000 7fe0d57a1640 1 -- 172.21.15.123:0/2053269725 wait complete. 2024-08-18T22:07:49.953 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-08-18T22:07:49.373563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662721,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":813,"num_read_kb":525,"num_write":363,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1229945,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":793,"ondisk_log_size":793,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388624,"kb_used_data":14444,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553200,"statfs":{"total":1151940427776,"available":1151542476800,"internally_reserved":0,"allocated":14790656,"data_stored":8242709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":52,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003269"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523825+0000","last_change":"2024-08-18T22:05:19.844674+0000","last_active":"2024-08-18T22:07:11.523825+0000","last_peered":"2024-08-18T22:07:11.523825+0000","last_clean":"2024-08-18T22:07:11.523825+0000","last_became_active":"2024-08-18T22:05:19.844381+0000","last_became_peered":"2024-08-18T22:05:19.844381+0000","last_unstale":"2024-08-18T22:07:11.523825+0000","last_undegraded":"2024-08-18T22:07:11.523825+0000","last_fullsized":"2024-08-18T22:07:11.523825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:58.783222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572759+0000","last_change":"2024-08-18T22:05:21.859013+0000","last_active":"2024-08-18T22:07:11.572759+0000","last_peered":"2024-08-18T22:07:11.572759+0000","last_clean":"2024-08-18T22:07:11.572759+0000","last_became_active":"2024-08-18T22:05:21.858709+0000","last_became_peered":"2024-08-18T22:05:21.858709+0000","last_unstale":"2024-08-18T22:07:11.572759+0000","last_undegraded":"2024-08-18T22:07:11.572759+0000","last_fullsized":"2024-08-18T22:07:11.572759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:34.272340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530547+0000","last_change":"2024-08-18T22:05:28.925735+0000","last_active":"2024-08-18T22:07:11.530547+0000","last_peered":"2024-08-18T22:07:11.530547+0000","last_clean":"2024-08-18T22:07:11.530547+0000","last_became_active":"2024-08-18T22:05:28.925324+0000","last_became_peered":"2024-08-18T22:05:28.925324+0000","last_unstale":"2024-08-18T22:07:11.530547+0000","last_undegraded":"2024-08-18T22:07:11.530547+0000","last_fullsized":"2024-08-18T22:07:11.530547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:15:58.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572915+0000","last_change":"2024-08-18T22:05:20.290861+0000","last_active":"2024-08-18T22:07:11.572915+0000","last_peered":"2024-08-18T22:07:11.572915+0000","last_clean":"2024-08-18T22:07:11.572915+0000","last_became_active":"2024-08-18T22:05:20.290508+0000","last_became_peered":"2024-08-18T22:05:20.290508+0000","last_unstale":"2024-08-18T22:07:11.572915+0000","last_undegraded":"2024-08-18T22:07:11.572915+0000","last_fullsized":"2024-08-18T22:07:11.572915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:21.462206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623639+0000","last_change":"2024-08-18T22:05:21.863441+0000","last_active":"2024-08-18T22:07:11.623639+0000","last_peered":"2024-08-18T22:07:11.623639+0000","last_clean":"2024-08-18T22:07:11.623639+0000","last_became_active":"2024-08-18T22:05:21.863121+0000","last_became_peered":"2024-08-18T22:05:21.863121+0000","last_unstale":"2024-08-18T22:07:11.623639+0000","last_undegraded":"2024-08-18T22:07:11.623639+0000","last_fullsized":"2024-08-18T22:07:11.623639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:47.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572680+0000","last_change":"2024-08-18T22:05:28.925477+0000","last_active":"2024-08-18T22:07:11.572680+0000","last_peered":"2024-08-18T22:07:11.572680+0000","last_clean":"2024-08-18T22:07:11.572680+0000","last_became_active":"2024-08-18T22:05:28.924922+0000","last_became_peered":"2024-08-18T22:05:28.924922+0000","last_unstale":"2024-08-18T22:07:11.572680+0000","last_undegraded":"2024-08-18T22:07:11.572680+0000","last_fullsized":"2024-08-18T22:07:11.572680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:35.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524930+0000","last_change":"2024-08-18T22:05:19.847979+0000","last_active":"2024-08-18T22:07:11.524930+0000","last_peered":"2024-08-18T22:07:11.524930+0000","last_clean":"2024-08-18T22:07:11.524930+0000","last_became_active":"2024-08-18T22:05:19.847643+0000","last_became_peered":"2024-08-18T22:05:19.847643+0000","last_unstale":"2024-08-18T22:07:11.524930+0000","last_undegraded":"2024-08-18T22:07:11.524930+0000","last_fullsized":"2024-08-18T22:07:11.524930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:33.875378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528910+0000","last_change":"2024-08-18T22:05:21.860225+0000","last_active":"2024-08-18T22:07:11.528910+0000","last_peered":"2024-08-18T22:07:11.528910+0000","last_clean":"2024-08-18T22:07:11.528910+0000","last_became_active":"2024-08-18T22:05:21.859889+0000","last_became_peered":"2024-08-18T22:05:21.859889+0000","last_unstale":"2024-08-18T22:07:11.528910+0000","last_undegraded":"2024-08-18T22:07:11.528910+0000","last_fullsized":"2024-08-18T22:07:11.528910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:06:27.084401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573134+0000","last_change":"2024-08-18T22:05:28.922230+0000","last_active":"2024-08-18T22:07:11.573134+0000","last_peered":"2024-08-18T22:07:11.573134+0000","last_clean":"2024-08-18T22:07:11.573134+0000","last_became_active":"2024-08-18T22:05:28.921804+0000","last_became_peered":"2024-08-18T22:05:28.921804+0000","last_unstale":"2024-08-18T22:07:11.573134+0000","last_undegraded":"2024-08-18T22:07:11.573134+0000","last_fullsized":"2024-08-18T22:07:11.573134+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:17.735645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.533950+0000","last_change":"2024-08-18T22:07:11.533541+0000","last_active":"2024-08-18T22:07:11.533950+0000","last_peered":"2024-08-18T22:07:11.533950+0000","last_clean":"2024-08-18T22:07:11.533950+0000","last_became_active":"2024-08-18T22:07:11.530034+0000","last_became_peered":"2024-08-18T22:07:11.530034+0000","last_unstale":"2024-08-18T22:07:11.533950+0000","last_undegraded":"2024-08-18T22:07:11.533950+0000","last_fullsized":"2024-08-18T22:07:11.533950+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:29.575399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528705+0000","last_change":"2024-08-18T22:06:10.514673+0000","last_active":"2024-08-18T22:07:11.528705+0000","last_peered":"2024-08-18T22:07:11.528705+0000","last_clean":"2024-08-18T22:07:11.528705+0000","last_became_active":"2024-08-18T22:06:10.514264+0000","last_became_peered":"2024-08-18T22:06:10.514264+0000","last_unstale":"2024-08-18T22:07:11.528705+0000","last_undegraded":"2024-08-18T22:07:11.528705+0000","last_fullsized":"2024-08-18T22:07:11.528705+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:03.626895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572808+0000","last_change":"2024-08-18T22:05:28.924521+0000","last_active":"2024-08-18T22:07:11.572808+0000","last_peered":"2024-08-18T22:07:11.572808+0000","last_clean":"2024-08-18T22:07:11.572808+0000","last_became_active":"2024-08-18T22:05:28.924107+0000","last_became_peered":"2024-08-18T22:05:28.924107+0000","last_unstale":"2024-08-18T22:07:11.572808+0000","last_undegraded":"2024-08-18T22:07:11.572808+0000","last_fullsized":"2024-08-18T22:07:11.572808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:37.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527669+0000","last_change":"2024-08-18T22:05:21.861696+0000","last_active":"2024-08-18T22:07:11.527669+0000","last_peered":"2024-08-18T22:07:11.527669+0000","last_clean":"2024-08-18T22:07:11.527669+0000","last_became_active":"2024-08-18T22:05:21.861220+0000","last_became_peered":"2024-08-18T22:05:21.861220+0000","last_unstale":"2024-08-18T22:07:11.527669+0000","last_undegraded":"2024-08-18T22:07:11.527669+0000","last_fullsized":"2024-08-18T22:07:11.527669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:01.098281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526302+0000","last_change":"2024-08-18T22:06:10.520097+0000","last_active":"2024-08-18T22:07:11.526302+0000","last_peered":"2024-08-18T22:07:11.526302+0000","last_clean":"2024-08-18T22:07:11.526302+0000","last_became_active":"2024-08-18T22:06:10.513286+0000","last_became_peered":"2024-08-18T22:06:10.513286+0000","last_unstale":"2024-08-18T22:07:11.526302+0000","last_undegraded":"2024-08-18T22:07:11.526302+0000","last_fullsized":"2024-08-18T22:07:11.526302+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:08:18.861243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573335+0000","last_change":"2024-08-18T22:05:29.013139+0000","last_active":"2024-08-18T22:07:11.573335+0000","last_peered":"2024-08-18T22:07:11.573335+0000","last_clean":"2024-08-18T22:07:11.573335+0000","last_became_active":"2024-08-18T22:05:29.012322+0000","last_became_peered":"2024-08-18T22:05:29.012322+0000","last_unstale":"2024-08-18T22:07:11.573335+0000","last_undegraded":"2024-08-18T22:07:11.573335+0000","last_fullsized":"2024-08-18T22:07:11.573335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:32.348201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572558+0000","last_change":"2024-08-18T22:05:21.860410+0000","last_active":"2024-08-18T22:07:11.572558+0000","last_peered":"2024-08-18T22:07:11.572558+0000","last_clean":"2024-08-18T22:07:11.572558+0000","last_became_active":"2024-08-18T22:05:21.860173+0000","last_became_peered":"2024-08-18T22:05:21.860173+0000","last_unstale":"2024-08-18T22:07:11.572558+0000","last_undegraded":"2024-08-18T22:07:11.572558+0000","last_fullsized":"2024-08-18T22:07:11.572558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:00.879178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530486+0000","last_change":"2024-08-18T22:05:19.845785+0000","last_active":"2024-08-18T22:07:11.530486+0000","last_peered":"2024-08-18T22:07:11.530486+0000","last_clean":"2024-08-18T22:07:11.530486+0000","last_became_active":"2024-08-18T22:05:19.845414+0000","last_became_peered":"2024-08-18T22:05:19.845414+0000","last_unstale":"2024-08-18T22:07:11.530486+0000","last_undegraded":"2024-08-18T22:07:11.530486+0000","last_fullsized":"2024-08-18T22:07:11.530486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:13.504885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573296+0000","last_change":"2024-08-18T22:06:10.523404+0000","last_active":"2024-08-18T22:07:11.573296+0000","last_peered":"2024-08-18T22:07:11.573296+0000","last_clean":"2024-08-18T22:07:11.573296+0000","last_became_active":"2024-08-18T22:06:10.516652+0000","last_became_peered":"2024-08-18T22:06:10.516652+0000","last_unstale":"2024-08-18T22:07:11.573296+0000","last_undegraded":"2024-08-18T22:07:11.573296+0000","last_fullsized":"2024-08-18T22:07:11.573296+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:58.197636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526366+0000","last_change":"2024-08-18T22:05:21.858329+0000","last_active":"2024-08-18T22:07:11.526366+0000","last_peered":"2024-08-18T22:07:11.526366+0000","last_clean":"2024-08-18T22:07:11.526366+0000","last_became_active":"2024-08-18T22:05:21.857854+0000","last_became_peered":"2024-08-18T22:05:21.857854+0000","last_unstale":"2024-08-18T22:07:11.526366+0000","last_undegraded":"2024-08-18T22:07:11.526366+0000","last_fullsized":"2024-08-18T22:07:11.526366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:45:19.934647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572567+0000","last_change":"2024-08-18T22:05:19.843031+0000","last_active":"2024-08-18T22:07:11.572567+0000","last_peered":"2024-08-18T22:07:11.572567+0000","last_clean":"2024-08-18T22:07:11.572567+0000","last_became_active":"2024-08-18T22:05:19.842694+0000","last_became_peered":"2024-08-18T22:05:19.842694+0000","last_unstale":"2024-08-18T22:07:11.572567+0000","last_undegraded":"2024-08-18T22:07:11.572567+0000","last_fullsized":"2024-08-18T22:07:11.572567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:01.135449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523703+0000","last_change":"2024-08-18T22:05:28.920647+0000","last_active":"2024-08-18T22:07:11.523703+0000","last_peered":"2024-08-18T22:07:11.523703+0000","last_clean":"2024-08-18T22:07:11.523703+0000","last_became_active":"2024-08-18T22:05:28.920295+0000","last_became_peered":"2024-08-18T22:05:28.920295+0000","last_unstale":"2024-08-18T22:07:11.523703+0000","last_undegraded":"2024-08-18T22:07:11.523703+0000","last_fullsized":"2024-08-18T22:07:11.523703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:41.295009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524432+0000","last_change":"2024-08-18T22:05:21.858413+0000","last_active":"2024-08-18T22:07:11.524432+0000","last_peered":"2024-08-18T22:07:11.524432+0000","last_clean":"2024-08-18T22:07:11.524432+0000","last_became_active":"2024-08-18T22:05:21.858102+0000","last_became_peered":"2024-08-18T22:05:21.858102+0000","last_unstale":"2024-08-18T22:07:11.524432+0000","last_undegraded":"2024-08-18T22:07:11.524432+0000","last_fullsized":"2024-08-18T22:07:11.524432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:24:59.432666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528669+0000","last_change":"2024-08-18T22:05:20.292085+0000","last_active":"2024-08-18T22:07:11.528669+0000","last_peered":"2024-08-18T22:07:11.528669+0000","last_clean":"2024-08-18T22:07:11.528669+0000","last_became_active":"2024-08-18T22:05:20.291606+0000","last_became_peered":"2024-08-18T22:05:20.291606+0000","last_unstale":"2024-08-18T22:07:11.528669+0000","last_undegraded":"2024-08-18T22:07:11.528669+0000","last_fullsized":"2024-08-18T22:07:11.528669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:22:46.801719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573405+0000","last_change":"2024-08-18T22:06:10.515755+0000","last_active":"2024-08-18T22:07:11.573405+0000","last_peered":"2024-08-18T22:07:11.573405+0000","last_clean":"2024-08-18T22:07:11.573405+0000","last_became_active":"2024-08-18T22:06:10.514624+0000","last_became_peered":"2024-08-18T22:06:10.514624+0000","last_unstale":"2024-08-18T22:07:11.573405+0000","last_undegraded":"2024-08-18T22:07:11.573405+0000","last_fullsized":"2024-08-18T22:07:11.573405+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:18:50.785139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623553+0000","last_change":"2024-08-18T22:05:21.855163+0000","last_active":"2024-08-18T22:07:11.623553+0000","last_peered":"2024-08-18T22:07:11.623553+0000","last_clean":"2024-08-18T22:07:11.623553+0000","last_became_active":"2024-08-18T22:05:21.854867+0000","last_became_peered":"2024-08-18T22:05:21.854867+0000","last_unstale":"2024-08-18T22:07:11.623553+0000","last_undegraded":"2024-08-18T22:07:11.623553+0000","last_fullsized":"2024-08-18T22:07:11.623553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:10.300307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573516+0000","last_change":"2024-08-18T22:05:20.082363+0000","last_active":"2024-08-18T22:07:11.573516+0000","last_peered":"2024-08-18T22:07:11.573516+0000","last_clean":"2024-08-18T22:07:11.573516+0000","last_became_active":"2024-08-18T22:05:20.081998+0000","last_became_peered":"2024-08-18T22:05:20.081998+0000","last_unstale":"2024-08-18T22:07:11.573516+0000","last_undegraded":"2024-08-18T22:07:11.573516+0000","last_fullsized":"2024-08-18T22:07:11.573516+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:44.960512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530726+0000","last_change":"2024-08-18T22:05:28.924072+0000","last_active":"2024-08-18T22:07:11.530726+0000","last_peered":"2024-08-18T22:07:11.530726+0000","last_clean":"2024-08-18T22:07:11.530726+0000","last_became_active":"2024-08-18T22:05:28.923673+0000","last_became_peered":"2024-08-18T22:05:28.923673+0000","last_unstale":"2024-08-18T22:07:11.530726+0000","last_undegraded":"2024-08-18T22:07:11.530726+0000","last_fullsized":"2024-08-18T22:07:11.530726+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:44.593009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572927+0000","last_change":"2024-08-18T22:05:21.851377+0000","last_active":"2024-08-18T22:07:11.572927+0000","last_peered":"2024-08-18T22:07:11.572927+0000","last_clean":"2024-08-18T22:07:11.572927+0000","last_became_active":"2024-08-18T22:05:21.851031+0000","last_became_peered":"2024-08-18T22:05:21.851031+0000","last_unstale":"2024-08-18T22:07:11.572927+0000","last_undegraded":"2024-08-18T22:07:11.572927+0000","last_fullsized":"2024-08-18T22:07:11.572927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.547244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'13","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:31.609491+0000","last_change":"2024-08-18T22:05:19.840697+0000","last_active":"2024-08-18T22:07:31.609491+0000","last_peered":"2024-08-18T22:07:31.609491+0000","last_clean":"2024-08-18T22:07:31.609491+0000","last_became_active":"2024-08-18T22:05:19.840382+0000","last_became_peered":"2024-08-18T22:05:19.840382+0000","last_unstale":"2024-08-18T22:07:31.609491+0000","last_undegraded":"2024-08-18T22:07:31.609491+0000","last_fullsized":"2024-08-18T22:07:31.609491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:24.514428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572248+0000","last_change":"2024-08-18T22:05:29.012305+0000","last_active":"2024-08-18T22:07:11.572248+0000","last_peered":"2024-08-18T22:07:11.572248+0000","last_clean":"2024-08-18T22:07:11.572248+0000","last_became_active":"2024-08-18T22:05:29.011846+0000","last_became_peered":"2024-08-18T22:05:29.011846+0000","last_unstale":"2024-08-18T22:07:11.572248+0000","last_undegraded":"2024-08-18T22:07:11.572248+0000","last_fullsized":"2024-08-18T22:07:11.572248+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:36.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570893+0000","last_change":"2024-08-18T22:05:21.856182+0000","last_active":"2024-08-18T22:07:11.570893+0000","last_peered":"2024-08-18T22:07:11.570893+0000","last_clean":"2024-08-18T22:07:11.570893+0000","last_became_active":"2024-08-18T22:05:21.855855+0000","last_became_peered":"2024-08-18T22:05:21.855855+0000","last_unstale":"2024-08-18T22:07:11.570893+0000","last_undegraded":"2024-08-18T22:07:11.570893+0000","last_fullsized":"2024-08-18T22:07:11.570893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:00.166809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524985+0000","last_change":"2024-08-18T22:05:20.291272+0000","last_active":"2024-08-18T22:07:11.524985+0000","last_peered":"2024-08-18T22:07:11.524985+0000","last_clean":"2024-08-18T22:07:11.524985+0000","last_became_active":"2024-08-18T22:05:20.290970+0000","last_became_peered":"2024-08-18T22:05:20.290970+0000","last_unstale":"2024-08-18T22:07:11.524985+0000","last_undegraded":"2024-08-18T22:07:11.524985+0000","last_fullsized":"2024-08-18T22:07:11.524985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:29.438996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526400+0000","last_change":"2024-08-18T22:05:28.923141+0000","last_active":"2024-08-18T22:07:11.526400+0000","last_peered":"2024-08-18T22:07:11.526400+0000","last_clean":"2024-08-18T22:07:11.526400+0000","last_became_active":"2024-08-18T22:05:28.922269+0000","last_became_peered":"2024-08-18T22:05:28.922269+0000","last_unstale":"2024-08-18T22:07:11.526400+0000","last_undegraded":"2024-08-18T22:07:11.526400+0000","last_fullsized":"2024-08-18T22:07:11.526400+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:58.092640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522176+0000","last_change":"2024-08-18T22:05:21.850124+0000","last_active":"2024-08-18T22:07:11.522176+0000","last_peered":"2024-08-18T22:07:11.522176+0000","last_clean":"2024-08-18T22:07:11.522176+0000","last_became_active":"2024-08-18T22:05:21.849805+0000","last_became_peered":"2024-08-18T22:05:21.849805+0000","last_unstale":"2024-08-18T22:07:11.522176+0000","last_undegraded":"2024-08-18T22:07:11.522176+0000","last_fullsized":"2024-08-18T22:07:11.522176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:53.492613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523594+0000","last_change":"2024-08-18T22:05:20.292836+0000","last_active":"2024-08-18T22:07:11.523594+0000","last_peered":"2024-08-18T22:07:11.523594+0000","last_clean":"2024-08-18T22:07:11.523594+0000","last_became_active":"2024-08-18T22:05:20.292456+0000","last_became_peered":"2024-08-18T22:05:20.292456+0000","last_unstale":"2024-08-18T22:07:11.523594+0000","last_undegraded":"2024-08-18T22:07:11.523594+0000","last_fullsized":"2024-08-18T22:07:11.523594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:19.525037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524433+0000","last_change":"2024-08-18T22:05:29.012439+0000","last_active":"2024-08-18T22:07:11.524433+0000","last_peered":"2024-08-18T22:07:11.524433+0000","last_clean":"2024-08-18T22:07:11.524433+0000","last_became_active":"2024-08-18T22:05:29.011860+0000","last_became_peered":"2024-08-18T22:05:29.011860+0000","last_unstale":"2024-08-18T22:07:11.524433+0000","last_undegraded":"2024-08-18T22:07:11.524433+0000","last_fullsized":"2024-08-18T22:07:11.524433+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:03.432217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522230+0000","last_change":"2024-08-18T22:05:21.855598+0000","last_active":"2024-08-18T22:07:11.522230+0000","last_peered":"2024-08-18T22:07:11.522230+0000","last_clean":"2024-08-18T22:07:11.522230+0000","last_became_active":"2024-08-18T22:05:21.855228+0000","last_became_peered":"2024-08-18T22:05:21.855228+0000","last_unstale":"2024-08-18T22:07:11.522230+0000","last_undegraded":"2024-08-18T22:07:11.522230+0000","last_fullsized":"2024-08-18T22:07:11.522230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:33.762700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527786+0000","last_change":"2024-08-18T22:05:19.844638+0000","last_active":"2024-08-18T22:07:11.527786+0000","last_peered":"2024-08-18T22:07:11.527786+0000","last_clean":"2024-08-18T22:07:11.527786+0000","last_became_active":"2024-08-18T22:05:19.844333+0000","last_became_peered":"2024-08-18T22:05:19.844333+0000","last_unstale":"2024-08-18T22:07:11.527786+0000","last_undegraded":"2024-08-18T22:07:11.527786+0000","last_fullsized":"2024-08-18T22:07:11.527786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:26.947512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570807+0000","last_change":"2024-08-18T22:05:28.919965+0000","last_active":"2024-08-18T22:07:11.570807+0000","last_peered":"2024-08-18T22:07:11.570807+0000","last_clean":"2024-08-18T22:07:11.570807+0000","last_became_active":"2024-08-18T22:05:28.919546+0000","last_became_peered":"2024-08-18T22:05:28.919546+0000","last_unstale":"2024-08-18T22:07:11.570807+0000","last_undegraded":"2024-08-18T22:07:11.570807+0000","last_fullsized":"2024-08-18T22:07:11.570807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:49.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528844+0000","last_change":"2024-08-18T22:05:21.857867+0000","last_active":"2024-08-18T22:07:11.528844+0000","last_peered":"2024-08-18T22:07:11.528844+0000","last_clean":"2024-08-18T22:07:11.528844+0000","last_became_active":"2024-08-18T22:05:21.857515+0000","last_became_peered":"2024-08-18T22:05:21.857515+0000","last_unstale":"2024-08-18T22:07:11.528844+0000","last_undegraded":"2024-08-18T22:07:11.528844+0000","last_fullsized":"2024-08-18T22:07:11.528844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:51.148321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":154,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:46.621204+0000","last_change":"2024-08-18T22:05:20.290924+0000","last_active":"2024-08-18T22:07:46.621204+0000","last_peered":"2024-08-18T22:07:46.621204+0000","last_clean":"2024-08-18T22:07:46.621204+0000","last_became_active":"2024-08-18T22:05:20.290587+0000","last_became_peered":"2024-08-18T22:05:20.290587+0000","last_unstale":"2024-08-18T22:07:46.621204+0000","last_undegraded":"2024-08-18T22:07:46.621204+0000","last_fullsized":"2024-08-18T22:07:46.621204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:35.029634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570655+0000","last_change":"2024-08-18T22:05:29.012876+0000","last_active":"2024-08-18T22:07:11.570655+0000","last_peered":"2024-08-18T22:07:11.570655+0000","last_clean":"2024-08-18T22:07:11.570655+0000","last_became_active":"2024-08-18T22:05:29.011930+0000","last_became_peered":"2024-08-18T22:05:29.011930+0000","last_unstale":"2024-08-18T22:07:11.570655+0000","last_undegraded":"2024-08-18T22:07:11.570655+0000","last_fullsized":"2024-08-18T22:07:11.570655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:22:35.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570198+0000","last_change":"2024-08-18T22:05:21.860798+0000","last_active":"2024-08-18T22:07:11.570198+0000","last_peered":"2024-08-18T22:07:11.570198+0000","last_clean":"2024-08-18T22:07:11.570198+0000","last_became_active":"2024-08-18T22:05:21.856968+0000","last_became_peered":"2024-08-18T22:05:21.856968+0000","last_unstale":"2024-08-18T22:07:11.570198+0000","last_undegraded":"2024-08-18T22:07:11.570198+0000","last_fullsized":"2024-08-18T22:07:11.570198+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:54.934400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527098+0000","last_change":"2024-08-18T22:05:19.844775+0000","last_active":"2024-08-18T22:07:11.527098+0000","last_peered":"2024-08-18T22:07:11.527098+0000","last_clean":"2024-08-18T22:07:11.527098+0000","last_became_active":"2024-08-18T22:05:19.844465+0000","last_became_peered":"2024-08-18T22:05:19.844465+0000","last_unstale":"2024-08-18T22:07:11.527098+0000","last_undegraded":"2024-08-18T22:07:11.527098+0000","last_fullsized":"2024-08-18T22:07:11.527098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.042335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528645+0000","last_change":"2024-08-18T22:05:29.013275+0000","last_active":"2024-08-18T22:07:11.528645+0000","last_peered":"2024-08-18T22:07:11.528645+0000","last_clean":"2024-08-18T22:07:11.528645+0000","last_became_active":"2024-08-18T22:05:29.012537+0000","last_became_peered":"2024-08-18T22:05:29.012537+0000","last_unstale":"2024-08-18T22:07:11.528645+0000","last_undegraded":"2024-08-18T22:07:11.528645+0000","last_fullsized":"2024-08-18T22:07:11.528645+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:15:39.775360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572574+0000","last_change":"2024-08-18T22:05:21.853358+0000","last_active":"2024-08-18T22:07:11.572574+0000","last_peered":"2024-08-18T22:07:11.572574+0000","last_clean":"2024-08-18T22:07:11.572574+0000","last_became_active":"2024-08-18T22:05:21.853071+0000","last_became_peered":"2024-08-18T22:05:21.853071+0000","last_unstale":"2024-08-18T22:07:11.572574+0000","last_undegraded":"2024-08-18T22:07:11.572574+0000","last_fullsized":"2024-08-18T22:07:11.572574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:23.755263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573411+0000","last_change":"2024-08-18T22:05:19.846922+0000","last_active":"2024-08-18T22:07:11.573411+0000","last_peered":"2024-08-18T22:07:11.573411+0000","last_clean":"2024-08-18T22:07:11.573411+0000","last_became_active":"2024-08-18T22:05:19.846619+0000","last_became_peered":"2024-08-18T22:05:19.846619+0000","last_unstale":"2024-08-18T22:07:11.573411+0000","last_undegraded":"2024-08-18T22:07:11.573411+0000","last_fullsized":"2024-08-18T22:07:11.573411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:36:16.232344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":357,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527160+0000","last_change":"2024-08-18T22:04:11.878703+0000","last_active":"2024-08-18T22:07:11.527160+0000","last_peered":"2024-08-18T22:07:11.527160+0000","last_clean":"2024-08-18T22:07:11.527160+0000","last_became_active":"2024-08-18T22:04:11.878157+0000","last_became_peered":"2024-08-18T22:04:11.878157+0000","last_unstale":"2024-08-18T22:07:11.527160+0000","last_undegraded":"2024-08-18T22:07:11.527160+0000","last_fullsized":"2024-08-18T22:07:11.527160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_clean_scrub_stamp":"2024-08-18T22:01:09.551264+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:24:07.391758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527387+0000","last_change":"2024-08-18T22:05:28.928882+0000","last_active":"2024-08-18T22:07:11.527387+0000","last_peered":"2024-08-18T22:07:11.527387+0000","last_clean":"2024-08-18T22:07:11.527387+0000","last_became_active":"2024-08-18T22:05:28.928482+0000","last_became_peered":"2024-08-18T22:05:28.928482+0000","last_unstale":"2024-08-18T22:07:11.527387+0000","last_undegraded":"2024-08-18T22:07:11.527387+0000","last_fullsized":"2024-08-18T22:07:11.527387+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:41.739482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527496+0000","last_change":"2024-08-18T22:05:21.863045+0000","last_active":"2024-08-18T22:07:11.527496+0000","last_peered":"2024-08-18T22:07:11.527496+0000","last_clean":"2024-08-18T22:07:11.527496+0000","last_became_active":"2024-08-18T22:05:21.862758+0000","last_became_peered":"2024-08-18T22:05:21.862758+0000","last_unstale":"2024-08-18T22:07:11.527496+0000","last_undegraded":"2024-08-18T22:07:11.527496+0000","last_fullsized":"2024-08-18T22:07:11.527496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:08:39.111147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531069+0000","last_change":"2024-08-18T22:05:20.291030+0000","last_active":"2024-08-18T22:07:11.531069+0000","last_peered":"2024-08-18T22:07:11.531069+0000","last_clean":"2024-08-18T22:07:11.531069+0000","last_became_active":"2024-08-18T22:05:20.290427+0000","last_became_peered":"2024-08-18T22:05:20.290427+0000","last_unstale":"2024-08-18T22:07:11.531069+0000","last_undegraded":"2024-08-18T22:07:11.531069+0000","last_fullsized":"2024-08-18T22:07:11.531069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:14:42.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528742+0000","last_change":"2024-08-18T22:05:28.923700+0000","last_active":"2024-08-18T22:07:11.528742+0000","last_peered":"2024-08-18T22:07:11.528742+0000","last_clean":"2024-08-18T22:07:11.528742+0000","last_became_active":"2024-08-18T22:05:28.923280+0000","last_became_peered":"2024-08-18T22:05:28.923280+0000","last_unstale":"2024-08-18T22:07:11.528742+0000","last_undegraded":"2024-08-18T22:07:11.528742+0000","last_fullsized":"2024-08-18T22:07:11.528742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:25:45.343542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527521+0000","last_change":"2024-08-18T22:05:21.856107+0000","last_active":"2024-08-18T22:07:11.527521+0000","last_peered":"2024-08-18T22:07:11.527521+0000","last_clean":"2024-08-18T22:07:11.527521+0000","last_became_active":"2024-08-18T22:05:21.853276+0000","last_became_peered":"2024-08-18T22:05:21.853276+0000","last_unstale":"2024-08-18T22:07:11.527521+0000","last_undegraded":"2024-08-18T22:07:11.527521+0000","last_fullsized":"2024-08-18T22:07:11.527521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:58.280375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528926+0000","last_change":"2024-08-18T22:05:19.843445+0000","last_active":"2024-08-18T22:07:11.528926+0000","last_peered":"2024-08-18T22:07:11.528926+0000","last_clean":"2024-08-18T22:07:11.528926+0000","last_became_active":"2024-08-18T22:05:19.843000+0000","last_became_peered":"2024-08-18T22:05:19.843000+0000","last_unstale":"2024-08-18T22:07:11.528926+0000","last_undegraded":"2024-08-18T22:07:11.528926+0000","last_fullsized":"2024-08-18T22:07:11.528926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:23.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623212+0000","last_change":"2024-08-18T22:06:10.515953+0000","last_active":"2024-08-18T22:07:11.623212+0000","last_peered":"2024-08-18T22:07:11.623212+0000","last_clean":"2024-08-18T22:07:11.623212+0000","last_became_active":"2024-08-18T22:06:10.515662+0000","last_became_peered":"2024-08-18T22:06:10.515662+0000","last_unstale":"2024-08-18T22:07:11.623212+0000","last_undegraded":"2024-08-18T22:07:11.623212+0000","last_fullsized":"2024-08-18T22:07:11.623212+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:43.150180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527523+0000","last_change":"2024-08-18T22:05:21.864029+0000","last_active":"2024-08-18T22:07:11.527523+0000","last_peered":"2024-08-18T22:07:11.527523+0000","last_clean":"2024-08-18T22:07:11.527523+0000","last_became_active":"2024-08-18T22:05:21.863509+0000","last_became_peered":"2024-08-18T22:05:21.863509+0000","last_unstale":"2024-08-18T22:07:11.527523+0000","last_undegraded":"2024-08-18T22:07:11.527523+0000","last_fullsized":"2024-08-18T22:07:11.527523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:42.879243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570764+0000","last_change":"2024-08-18T22:05:19.846514+0000","last_active":"2024-08-18T22:07:11.570764+0000","last_peered":"2024-08-18T22:07:11.570764+0000","last_clean":"2024-08-18T22:07:11.570764+0000","last_became_active":"2024-08-18T22:05:19.846190+0000","last_became_peered":"2024-08-18T22:05:19.846190+0000","last_unstale":"2024-08-18T22:07:11.570764+0000","last_undegraded":"2024-08-18T22:07:11.570764+0000","last_fullsized":"2024-08-18T22:07:11.570764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:49:00.317597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528349+0000","last_change":"2024-08-18T22:05:28.923183+0000","last_active":"2024-08-18T22:07:11.528349+0000","last_peered":"2024-08-18T22:07:11.528349+0000","last_clean":"2024-08-18T22:07:11.528349+0000","last_became_active":"2024-08-18T22:05:28.922809+0000","last_became_peered":"2024-08-18T22:05:28.922809+0000","last_unstale":"2024-08-18T22:07:11.528349+0000","last_undegraded":"2024-08-18T22:07:11.528349+0000","last_fullsized":"2024-08-18T22:07:11.528349+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:26.416920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526764+0000","last_change":"2024-08-18T22:05:21.849075+0000","last_active":"2024-08-18T22:07:11.526764+0000","last_peered":"2024-08-18T22:07:11.526764+0000","last_clean":"2024-08-18T22:07:11.526764+0000","last_became_active":"2024-08-18T22:05:21.848759+0000","last_became_peered":"2024-08-18T22:05:21.848759+0000","last_unstale":"2024-08-18T22:07:11.526764+0000","last_undegraded":"2024-08-18T22:07:11.526764+0000","last_fullsized":"2024-08-18T22:07:11.526764+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:26.531534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524964+0000","last_change":"2024-08-18T22:05:19.849210+0000","last_active":"2024-08-18T22:07:11.524964+0000","last_peered":"2024-08-18T22:07:11.524964+0000","last_clean":"2024-08-18T22:07:11.524964+0000","last_became_active":"2024-08-18T22:05:19.848829+0000","last_became_peered":"2024-08-18T22:05:19.848829+0000","last_unstale":"2024-08-18T22:07:11.524964+0000","last_undegraded":"2024-08-18T22:07:11.524964+0000","last_fullsized":"2024-08-18T22:07:11.524964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:19.321686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528709+0000","last_change":"2024-08-18T22:05:28.924577+0000","last_active":"2024-08-18T22:07:11.528709+0000","last_peered":"2024-08-18T22:07:11.528709+0000","last_clean":"2024-08-18T22:07:11.528709+0000","last_became_active":"2024-08-18T22:05:28.924183+0000","last_became_peered":"2024-08-18T22:05:28.924183+0000","last_unstale":"2024-08-18T22:07:11.528709+0000","last_undegraded":"2024-08-18T22:07:11.528709+0000","last_fullsized":"2024-08-18T22:07:11.528709+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:22.702757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523154+0000","last_change":"2024-08-18T22:06:10.513610+0000","last_active":"2024-08-18T22:07:11.523154+0000","last_peered":"2024-08-18T22:07:11.523154+0000","last_clean":"2024-08-18T22:07:11.523154+0000","last_became_active":"2024-08-18T22:06:10.513400+0000","last_became_peered":"2024-08-18T22:06:10.513400+0000","last_unstale":"2024-08-18T22:07:11.523154+0000","last_undegraded":"2024-08-18T22:07:11.523154+0000","last_fullsized":"2024-08-18T22:07:11.523154+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:49.275223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524463+0000","last_change":"2024-08-18T22:05:20.291752+0000","last_active":"2024-08-18T22:07:11.524463+0000","last_peered":"2024-08-18T22:07:11.524463+0000","last_clean":"2024-08-18T22:07:11.524463+0000","last_became_active":"2024-08-18T22:05:20.291431+0000","last_became_peered":"2024-08-18T22:05:20.291431+0000","last_unstale":"2024-08-18T22:07:11.524463+0000","last_undegraded":"2024-08-18T22:07:11.524463+0000","last_fullsized":"2024-08-18T22:07:11.524463+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:32.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570623+0000","last_change":"2024-08-18T22:05:28.924121+0000","last_active":"2024-08-18T22:07:11.570623+0000","last_peered":"2024-08-18T22:07:11.570623+0000","last_clean":"2024-08-18T22:07:11.570623+0000","last_became_active":"2024-08-18T22:05:28.923753+0000","last_became_peered":"2024-08-18T22:05:28.923753+0000","last_unstale":"2024-08-18T22:07:11.570623+0000","last_undegraded":"2024-08-18T22:07:11.570623+0000","last_fullsized":"2024-08-18T22:07:11.570623+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:57.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527050+0000","last_change":"2024-08-18T22:05:21.858366+0000","last_active":"2024-08-18T22:07:11.527050+0000","last_peered":"2024-08-18T22:07:11.527050+0000","last_clean":"2024-08-18T22:07:11.527050+0000","last_became_active":"2024-08-18T22:05:21.858021+0000","last_became_peered":"2024-08-18T22:05:21.858021+0000","last_unstale":"2024-08-18T22:07:11.527050+0000","last_undegraded":"2024-08-18T22:07:11.527050+0000","last_fullsized":"2024-08-18T22:07:11.527050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:55.662965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":159,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:47.623483+0000","last_change":"2024-08-18T22:05:19.850013+0000","last_active":"2024-08-18T22:07:47.623483+0000","last_peered":"2024-08-18T22:07:47.623483+0000","last_clean":"2024-08-18T22:07:47.623483+0000","last_became_active":"2024-08-18T22:05:19.849551+0000","last_became_peered":"2024-08-18T22:05:19.849551+0000","last_unstale":"2024-08-18T22:07:47.623483+0000","last_undegraded":"2024-08-18T22:07:47.623483+0000","last_fullsized":"2024-08-18T22:07:47.623483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:15.182999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523685+0000","last_change":"2024-08-18T22:05:28.927318+0000","last_active":"2024-08-18T22:07:11.523685+0000","last_peered":"2024-08-18T22:07:11.523685+0000","last_clean":"2024-08-18T22:07:11.523685+0000","last_became_active":"2024-08-18T22:05:28.926786+0000","last_became_peered":"2024-08-18T22:05:28.926786+0000","last_unstale":"2024-08-18T22:07:11.523685+0000","last_undegraded":"2024-08-18T22:07:11.523685+0000","last_fullsized":"2024-08-18T22:07:11.523685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:45.798247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527690+0000","last_change":"2024-08-18T22:06:10.511821+0000","last_active":"2024-08-18T22:07:11.527690+0000","last_peered":"2024-08-18T22:07:11.527690+0000","last_clean":"2024-08-18T22:07:11.527690+0000","last_became_active":"2024-08-18T22:06:10.511135+0000","last_became_peered":"2024-08-18T22:06:10.511135+0000","last_unstale":"2024-08-18T22:07:11.527690+0000","last_undegraded":"2024-08-18T22:07:11.527690+0000","last_fullsized":"2024-08-18T22:07:11.527690+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:07.108531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528618+0000","last_change":"2024-08-18T22:05:19.844061+0000","last_active":"2024-08-18T22:07:11.528618+0000","last_peered":"2024-08-18T22:07:11.528618+0000","last_clean":"2024-08-18T22:07:11.528618+0000","last_became_active":"2024-08-18T22:05:19.843513+0000","last_became_peered":"2024-08-18T22:05:19.843513+0000","last_unstale":"2024-08-18T22:07:11.528618+0000","last_undegraded":"2024-08-18T22:07:11.528618+0000","last_fullsized":"2024-08-18T22:07:11.528618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:53.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526996+0000","last_change":"2024-08-18T22:05:28.922986+0000","last_active":"2024-08-18T22:07:11.526996+0000","last_peered":"2024-08-18T22:07:11.526996+0000","last_clean":"2024-08-18T22:07:11.526996+0000","last_became_active":"2024-08-18T22:05:28.922322+0000","last_became_peered":"2024-08-18T22:05:28.922322+0000","last_unstale":"2024-08-18T22:07:11.526996+0000","last_undegraded":"2024-08-18T22:07:11.526996+0000","last_fullsized":"2024-08-18T22:07:11.526996+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:28.168299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570439+0000","last_change":"2024-08-18T22:05:21.853389+0000","last_active":"2024-08-18T22:07:11.570439+0000","last_peered":"2024-08-18T22:07:11.570439+0000","last_clean":"2024-08-18T22:07:11.570439+0000","last_became_active":"2024-08-18T22:05:21.853095+0000","last_became_peered":"2024-08-18T22:05:21.853095+0000","last_unstale":"2024-08-18T22:07:11.570439+0000","last_undegraded":"2024-08-18T22:07:11.570439+0000","last_fullsized":"2024-08-18T22:07:11.570439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:14.126983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531024+0000","last_change":"2024-08-18T22:05:19.846788+0000","last_active":"2024-08-18T22:07:11.531024+0000","last_peered":"2024-08-18T22:07:11.531024+0000","last_clean":"2024-08-18T22:07:11.531024+0000","last_became_active":"2024-08-18T22:05:19.846248+0000","last_became_peered":"2024-08-18T22:05:19.846248+0000","last_unstale":"2024-08-18T22:07:11.531024+0000","last_undegraded":"2024-08-18T22:07:11.531024+0000","last_fullsized":"2024-08-18T22:07:11.531024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:46.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528593+0000","last_change":"2024-08-18T22:05:28.920294+0000","last_active":"2024-08-18T22:07:11.528593+0000","last_peered":"2024-08-18T22:07:11.528593+0000","last_clean":"2024-08-18T22:07:11.528593+0000","last_became_active":"2024-08-18T22:05:28.919351+0000","last_became_peered":"2024-08-18T22:05:28.919351+0000","last_unstale":"2024-08-18T22:07:11.528593+0000","last_undegraded":"2024-08-18T22:07:11.528593+0000","last_fullsized":"2024-08-18T22:07:11.528593+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:49.425281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524875+0000","last_change":"2024-08-18T22:05:21.864529+0000","last_active":"2024-08-18T22:07:11.524875+0000","last_peered":"2024-08-18T22:07:11.524875+0000","last_clean":"2024-08-18T22:07:11.524875+0000","last_became_active":"2024-08-18T22:05:21.864062+0000","last_became_peered":"2024-08-18T22:05:21.864062+0000","last_unstale":"2024-08-18T22:07:11.524875+0000","last_undegraded":"2024-08-18T22:07:11.524875+0000","last_fullsized":"2024-08-18T22:07:11.524875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:24:49.037343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'37","reported_seq":327,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:48.675404+0000","last_change":"2024-08-18T22:06:10.522113+0000","last_active":"2024-08-18T22:07:48.675404+0000","last_peered":"2024-08-18T22:07:48.675404+0000","last_clean":"2024-08-18T22:07:48.675404+0000","last_became_active":"2024-08-18T22:06:10.514837+0000","last_became_peered":"2024-08-18T22:06:10.514837+0000","last_unstale":"2024-08-18T22:07:48.675404+0000","last_undegraded":"2024-08-18T22:07:48.675404+0000","last_fullsized":"2024-08-18T22:07:48.675404+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:46.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67447,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":228,"num_read_kb":175,"num_write":38,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523283+0000","last_change":"2024-08-18T22:05:28.926357+0000","last_active":"2024-08-18T22:07:11.523283+0000","last_peered":"2024-08-18T22:07:11.523283+0000","last_clean":"2024-08-18T22:07:11.523283+0000","last_became_active":"2024-08-18T22:05:28.926016+0000","last_became_peered":"2024-08-18T22:05:28.926016+0000","last_unstale":"2024-08-18T22:07:11.523283+0000","last_undegraded":"2024-08-18T22:07:11.523283+0000","last_fullsized":"2024-08-18T22:07:11.523283+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:16.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529123+0000","last_change":"2024-08-18T22:05:21.860237+0000","last_active":"2024-08-18T22:07:11.529123+0000","last_peered":"2024-08-18T22:07:11.529123+0000","last_clean":"2024-08-18T22:07:11.529123+0000","last_became_active":"2024-08-18T22:05:21.859919+0000","last_became_peered":"2024-08-18T22:05:21.859919+0000","last_unstale":"2024-08-18T22:07:11.529123+0000","last_undegraded":"2024-08-18T22:07:11.529123+0000","last_fullsized":"2024-08-18T22:07:11.529123+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:21.048413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528892+0000","last_change":"2024-08-18T22:05:20.291233+0000","last_active":"2024-08-18T22:07:11.528892+0000","last_peered":"2024-08-18T22:07:11.528892+0000","last_clean":"2024-08-18T22:07:11.528892+0000","last_became_active":"2024-08-18T22:05:20.290893+0000","last_became_peered":"2024-08-18T22:05:20.290893+0000","last_unstale":"2024-08-18T22:07:11.528892+0000","last_undegraded":"2024-08-18T22:07:11.528892+0000","last_fullsized":"2024-08-18T22:07:11.528892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:36.889561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573103+0000","last_change":"2024-08-18T22:05:28.923076+0000","last_active":"2024-08-18T22:07:11.573103+0000","last_peered":"2024-08-18T22:07:11.573103+0000","last_clean":"2024-08-18T22:07:11.573103+0000","last_became_active":"2024-08-18T22:05:28.922688+0000","last_became_peered":"2024-08-18T22:05:28.922688+0000","last_unstale":"2024-08-18T22:07:11.573103+0000","last_undegraded":"2024-08-18T22:07:11.573103+0000","last_fullsized":"2024-08-18T22:07:11.573103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:34.360540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623665+0000","last_change":"2024-08-18T22:05:21.855174+0000","last_active":"2024-08-18T22:07:11.623665+0000","last_peered":"2024-08-18T22:07:11.623665+0000","last_clean":"2024-08-18T22:07:11.623665+0000","last_became_active":"2024-08-18T22:05:21.854818+0000","last_became_peered":"2024-08-18T22:05:21.854818+0000","last_unstale":"2024-08-18T22:07:11.623665+0000","last_undegraded":"2024-08-18T22:07:11.623665+0000","last_fullsized":"2024-08-18T22:07:11.623665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:48:55.094624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.577365+0000","last_change":"2024-08-18T22:07:11.576894+0000","last_active":"2024-08-18T22:07:11.577365+0000","last_peered":"2024-08-18T22:07:11.577365+0000","last_clean":"2024-08-18T22:07:11.577365+0000","last_became_active":"2024-08-18T22:07:11.574159+0000","last_became_peered":"2024-08-18T22:07:11.574159+0000","last_unstale":"2024-08-18T22:07:11.577365+0000","last_undegraded":"2024-08-18T22:07:11.577365+0000","last_fullsized":"2024-08-18T22:07:11.577365+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:37.993056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523132+0000","last_change":"2024-08-18T22:05:28.921647+0000","last_active":"2024-08-18T22:07:11.523132+0000","last_peered":"2024-08-18T22:07:11.523132+0000","last_clean":"2024-08-18T22:07:11.523132+0000","last_became_active":"2024-08-18T22:05:28.921305+0000","last_became_peered":"2024-08-18T22:05:28.921305+0000","last_unstale":"2024-08-18T22:07:11.523132+0000","last_undegraded":"2024-08-18T22:07:11.523132+0000","last_fullsized":"2024-08-18T22:07:11.523132+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:29.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529467+0000","last_change":"2024-08-18T22:05:21.861151+0000","last_active":"2024-08-18T22:07:11.529467+0000","last_peered":"2024-08-18T22:07:11.529467+0000","last_clean":"2024-08-18T22:07:11.529467+0000","last_became_active":"2024-08-18T22:05:21.860834+0000","last_became_peered":"2024-08-18T22:05:21.860834+0000","last_unstale":"2024-08-18T22:07:11.529467+0000","last_undegraded":"2024-08-18T22:07:11.529467+0000","last_fullsized":"2024-08-18T22:07:11.529467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:32.890750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":154,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:47.623560+0000","last_change":"2024-08-18T22:05:19.846145+0000","last_active":"2024-08-18T22:07:47.623560+0000","last_peered":"2024-08-18T22:07:47.623560+0000","last_clean":"2024-08-18T22:07:47.623560+0000","last_became_active":"2024-08-18T22:05:19.845711+0000","last_became_peered":"2024-08-18T22:05:19.845711+0000","last_unstale":"2024-08-18T22:07:47.623560+0000","last_undegraded":"2024-08-18T22:07:47.623560+0000","last_fullsized":"2024-08-18T22:07:47.623560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:20.376131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572337+0000","last_change":"2024-08-18T22:05:28.923256+0000","last_active":"2024-08-18T22:07:11.572337+0000","last_peered":"2024-08-18T22:07:11.572337+0000","last_clean":"2024-08-18T22:07:11.572337+0000","last_became_active":"2024-08-18T22:05:28.922845+0000","last_became_peered":"2024-08-18T22:05:28.922845+0000","last_unstale":"2024-08-18T22:07:11.572337+0000","last_undegraded":"2024-08-18T22:07:11.572337+0000","last_fullsized":"2024-08-18T22:07:11.572337+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:41.930937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623447+0000","last_change":"2024-08-18T22:05:28.924743+0000","last_active":"2024-08-18T22:07:11.623447+0000","last_peered":"2024-08-18T22:07:11.623447+0000","last_clean":"2024-08-18T22:07:11.623447+0000","last_became_active":"2024-08-18T22:05:28.923674+0000","last_became_peered":"2024-08-18T22:05:28.923674+0000","last_unstale":"2024-08-18T22:07:11.623447+0000","last_undegraded":"2024-08-18T22:07:11.623447+0000","last_fullsized":"2024-08-18T22:07:11.623447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:19.834998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523308+0000","last_change":"2024-08-18T22:05:21.857194+0000","last_active":"2024-08-18T22:07:11.523308+0000","last_peered":"2024-08-18T22:07:11.523308+0000","last_clean":"2024-08-18T22:07:11.523308+0000","last_became_active":"2024-08-18T22:05:21.856916+0000","last_became_peered":"2024-08-18T22:05:21.856916+0000","last_unstale":"2024-08-18T22:07:11.523308+0000","last_undegraded":"2024-08-18T22:07:11.523308+0000","last_fullsized":"2024-08-18T22:07:11.523308+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:24.759501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529123+0000","last_change":"2024-08-18T22:05:19.844919+0000","last_active":"2024-08-18T22:07:11.529123+0000","last_peered":"2024-08-18T22:07:11.529123+0000","last_clean":"2024-08-18T22:07:11.529123+0000","last_became_active":"2024-08-18T22:05:19.844539+0000","last_became_peered":"2024-08-18T22:05:19.844539+0000","last_unstale":"2024-08-18T22:07:11.529123+0000","last_undegraded":"2024-08-18T22:07:11.529123+0000","last_fullsized":"2024-08-18T22:07:11.529123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:01.598535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526775+0000","last_change":"2024-08-18T22:05:28.923304+0000","last_active":"2024-08-18T22:07:11.526775+0000","last_peered":"2024-08-18T22:07:11.526775+0000","last_clean":"2024-08-18T22:07:11.526775+0000","last_became_active":"2024-08-18T22:05:28.922912+0000","last_became_peered":"2024-08-18T22:05:28.922912+0000","last_unstale":"2024-08-18T22:07:11.526775+0000","last_undegraded":"2024-08-18T22:07:11.526775+0000","last_fullsized":"2024-08-18T22:07:11.526775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:24:47.834354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572444+0000","last_change":"2024-08-18T22:05:21.849448+0000","last_active":"2024-08-18T22:07:11.572444+0000","last_peered":"2024-08-18T22:07:11.572444+0000","last_clean":"2024-08-18T22:07:11.572444+0000","last_became_active":"2024-08-18T22:05:21.849154+0000","last_became_peered":"2024-08-18T22:05:21.849154+0000","last_unstale":"2024-08-18T22:07:11.572444+0000","last_undegraded":"2024-08-18T22:07:11.572444+0000","last_fullsized":"2024-08-18T22:07:11.572444+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:38.583121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570212+0000","last_change":"2024-08-18T22:05:19.848483+0000","last_active":"2024-08-18T22:07:11.570212+0000","last_peered":"2024-08-18T22:07:11.570212+0000","last_clean":"2024-08-18T22:07:11.570212+0000","last_became_active":"2024-08-18T22:05:19.848190+0000","last_became_peered":"2024-08-18T22:05:19.848190+0000","last_unstale":"2024-08-18T22:07:11.570212+0000","last_undegraded":"2024-08-18T22:07:11.570212+0000","last_fullsized":"2024-08-18T22:07:11.570212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:01.719565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522263+0000","last_change":"2024-08-18T22:05:19.843796+0000","last_active":"2024-08-18T22:07:11.522263+0000","last_peered":"2024-08-18T22:07:11.522263+0000","last_clean":"2024-08-18T22:07:11.522263+0000","last_became_active":"2024-08-18T22:05:19.843495+0000","last_became_peered":"2024-08-18T22:05:19.843495+0000","last_unstale":"2024-08-18T22:07:11.522263+0000","last_undegraded":"2024-08-18T22:07:11.522263+0000","last_fullsized":"2024-08-18T22:07:11.522263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:21.583561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528701+0000","last_change":"2024-08-18T22:05:21.856370+0000","last_active":"2024-08-18T22:07:11.528701+0000","last_peered":"2024-08-18T22:07:11.528701+0000","last_clean":"2024-08-18T22:07:11.528701+0000","last_became_active":"2024-08-18T22:05:21.855954+0000","last_became_peered":"2024-08-18T22:05:21.855954+0000","last_unstale":"2024-08-18T22:07:11.528701+0000","last_undegraded":"2024-08-18T22:07:11.528701+0000","last_fullsized":"2024-08-18T22:07:11.528701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:30.828305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530403+0000","last_change":"2024-08-18T22:06:10.516344+0000","last_active":"2024-08-18T22:07:11.530403+0000","last_peered":"2024-08-18T22:07:11.530403+0000","last_clean":"2024-08-18T22:07:11.530403+0000","last_became_active":"2024-08-18T22:06:10.515925+0000","last_became_peered":"2024-08-18T22:06:10.515925+0000","last_unstale":"2024-08-18T22:07:11.530403+0000","last_undegraded":"2024-08-18T22:07:11.530403+0000","last_fullsized":"2024-08-18T22:07:11.530403+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:41:07.585521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":156,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:43.618096+0000","last_change":"2024-08-18T22:05:19.846860+0000","last_active":"2024-08-18T22:07:43.618096+0000","last_peered":"2024-08-18T22:07:43.618096+0000","last_clean":"2024-08-18T22:07:43.618096+0000","last_became_active":"2024-08-18T22:05:19.846496+0000","last_became_peered":"2024-08-18T22:05:19.846496+0000","last_unstale":"2024-08-18T22:07:43.618096+0000","last_undegraded":"2024-08-18T22:07:43.618096+0000","last_fullsized":"2024-08-18T22:07:43.618096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:16.555137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524444+0000","last_change":"2024-08-18T22:05:21.849058+0000","last_active":"2024-08-18T22:07:11.524444+0000","last_peered":"2024-08-18T22:07:11.524444+0000","last_clean":"2024-08-18T22:07:11.524444+0000","last_became_active":"2024-08-18T22:05:21.848703+0000","last_became_peered":"2024-08-18T22:05:21.848703+0000","last_unstale":"2024-08-18T22:07:11.524444+0000","last_undegraded":"2024-08-18T22:07:11.524444+0000","last_fullsized":"2024-08-18T22:07:11.524444+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:10.024156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530967+0000","last_change":"2024-08-18T22:05:28.922968+0000","last_active":"2024-08-18T22:07:11.530967+0000","last_peered":"2024-08-18T22:07:11.530967+0000","last_clean":"2024-08-18T22:07:11.530967+0000","last_became_active":"2024-08-18T22:05:28.922378+0000","last_became_peered":"2024-08-18T22:05:28.922378+0000","last_unstale":"2024-08-18T22:07:11.530967+0000","last_undegraded":"2024-08-18T22:07:11.530967+0000","last_fullsized":"2024-08-18T22:07:11.530967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:23:07.241028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526268+0000","last_change":"2024-08-18T22:05:21.858572+0000","last_active":"2024-08-18T22:07:11.526268+0000","last_peered":"2024-08-18T22:07:11.526268+0000","last_clean":"2024-08-18T22:07:11.526268+0000","last_became_active":"2024-08-18T22:05:21.858254+0000","last_became_peered":"2024-08-18T22:05:21.858254+0000","last_unstale":"2024-08-18T22:07:11.526268+0000","last_undegraded":"2024-08-18T22:07:11.526268+0000","last_fullsized":"2024-08-18T22:07:11.526268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:52.456087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531122+0000","last_change":"2024-08-18T22:05:21.856710+0000","last_active":"2024-08-18T22:07:11.531122+0000","last_peered":"2024-08-18T22:07:11.531122+0000","last_clean":"2024-08-18T22:07:11.531122+0000","last_became_active":"2024-08-18T22:05:21.855399+0000","last_became_peered":"2024-08-18T22:05:21.855399+0000","last_unstale":"2024-08-18T22:07:11.531122+0000","last_undegraded":"2024-08-18T22:07:11.531122+0000","last_fullsized":"2024-08-18T22:07:11.531122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:36.039953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530382+0000","last_change":"2024-08-18T22:05:21.856085+0000","last_active":"2024-08-18T22:07:11.530382+0000","last_peered":"2024-08-18T22:07:11.530382+0000","last_clean":"2024-08-18T22:07:11.530382+0000","last_became_active":"2024-08-18T22:05:21.855263+0000","last_became_peered":"2024-08-18T22:05:21.855263+0000","last_unstale":"2024-08-18T22:07:11.530382+0000","last_undegraded":"2024-08-18T22:07:11.530382+0000","last_fullsized":"2024-08-18T22:07:11.530382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:31.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623250+0000","last_change":"2024-08-18T22:05:21.855385+0000","last_active":"2024-08-18T22:07:11.623250+0000","last_peered":"2024-08-18T22:07:11.623250+0000","last_clean":"2024-08-18T22:07:11.623250+0000","last_became_active":"2024-08-18T22:05:21.854829+0000","last_became_peered":"2024-08-18T22:05:21.854829+0000","last_unstale":"2024-08-18T22:07:11.623250+0000","last_undegraded":"2024-08-18T22:07:11.623250+0000","last_fullsized":"2024-08-18T22:07:11.623250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:59.704154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570888+0000","last_change":"2024-08-18T22:06:10.510370+0000","last_active":"2024-08-18T22:07:11.570888+0000","last_peered":"2024-08-18T22:07:11.570888+0000","last_clean":"2024-08-18T22:07:11.570888+0000","last_became_active":"2024-08-18T22:06:10.509829+0000","last_became_peered":"2024-08-18T22:06:10.509829+0000","last_unstale":"2024-08-18T22:07:11.570888+0000","last_undegraded":"2024-08-18T22:07:11.570888+0000","last_fullsized":"2024-08-18T22:07:11.570888+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:20.171834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526688+0000","last_change":"2024-08-18T22:05:21.856137+0000","last_active":"2024-08-18T22:07:11.526688+0000","last_peered":"2024-08-18T22:07:11.526688+0000","last_clean":"2024-08-18T22:07:11.526688+0000","last_became_active":"2024-08-18T22:05:21.855425+0000","last_became_peered":"2024-08-18T22:05:21.855425+0000","last_unstale":"2024-08-18T22:07:11.526688+0000","last_undegraded":"2024-08-18T22:07:11.526688+0000","last_fullsized":"2024-08-18T22:07:11.526688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:37.514710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531196+0000","last_change":"2024-08-18T22:05:21.856084+0000","last_active":"2024-08-18T22:07:11.531196+0000","last_peered":"2024-08-18T22:07:11.531196+0000","last_clean":"2024-08-18T22:07:11.531196+0000","last_became_active":"2024-08-18T22:05:21.855779+0000","last_became_peered":"2024-08-18T22:05:21.855779+0000","last_unstale":"2024-08-18T22:07:11.531196+0000","last_undegraded":"2024-08-18T22:07:11.531196+0000","last_fullsized":"2024-08-18T22:07:11.531196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:02:47.833634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572883+0000","last_change":"2024-08-18T22:05:21.856729+0000","last_active":"2024-08-18T22:07:11.572883+0000","last_peered":"2024-08-18T22:07:11.572883+0000","last_clean":"2024-08-18T22:07:11.572883+0000","last_became_active":"2024-08-18T22:05:21.856446+0000","last_became_peered":"2024-08-18T22:05:21.856446+0000","last_unstale":"2024-08-18T22:07:11.572883+0000","last_undegraded":"2024-08-18T22:07:11.572883+0000","last_fullsized":"2024-08-18T22:07:11.572883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.482225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528910+0000","last_change":"2024-08-18T22:05:21.851772+0000","last_active":"2024-08-18T22:07:11.528910+0000","last_peered":"2024-08-18T22:07:11.528910+0000","last_clean":"2024-08-18T22:07:11.528910+0000","last_became_active":"2024-08-18T22:05:21.851417+0000","last_became_peered":"2024-08-18T22:05:21.851417+0000","last_unstale":"2024-08-18T22:07:11.528910+0000","last_undegraded":"2024-08-18T22:07:11.528910+0000","last_fullsized":"2024-08-18T22:07:11.528910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:32.509318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572470+0000","last_change":"2024-08-18T22:05:21.857887+0000","last_active":"2024-08-18T22:07:11.572470+0000","last_peered":"2024-08-18T22:07:11.572470+0000","last_clean":"2024-08-18T22:07:11.572470+0000","last_became_active":"2024-08-18T22:05:21.857585+0000","last_became_peered":"2024-08-18T22:05:21.857585+0000","last_unstale":"2024-08-18T22:07:11.572470+0000","last_undegraded":"2024-08-18T22:07:11.572470+0000","last_fullsized":"2024-08-18T22:07:11.572470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:23.299033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528948+0000","last_change":"2024-08-18T22:05:21.854626+0000","last_active":"2024-08-18T22:07:11.528948+0000","last_peered":"2024-08-18T22:07:11.528948+0000","last_clean":"2024-08-18T22:07:11.528948+0000","last_became_active":"2024-08-18T22:05:21.854290+0000","last_became_peered":"2024-08-18T22:05:21.854290+0000","last_unstale":"2024-08-18T22:07:11.528948+0000","last_undegraded":"2024-08-18T22:07:11.528948+0000","last_fullsized":"2024-08-18T22:07:11.528948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:45:24.988669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570558+0000","last_change":"2024-08-18T22:05:21.865863+0000","last_active":"2024-08-18T22:07:11.570558+0000","last_peered":"2024-08-18T22:07:11.570558+0000","last_clean":"2024-08-18T22:07:11.570558+0000","last_became_active":"2024-08-18T22:05:21.864634+0000","last_became_peered":"2024-08-18T22:05:21.864634+0000","last_unstale":"2024-08-18T22:07:11.570558+0000","last_undegraded":"2024-08-18T22:07:11.570558+0000","last_fullsized":"2024-08-18T22:07:11.570558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:34.051147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527095+0000","last_change":"2024-08-18T22:05:21.860193+0000","last_active":"2024-08-18T22:07:11.527095+0000","last_peered":"2024-08-18T22:07:11.527095+0000","last_clean":"2024-08-18T22:07:11.527095+0000","last_became_active":"2024-08-18T22:05:21.859761+0000","last_became_peered":"2024-08-18T22:05:21.859761+0000","last_unstale":"2024-08-18T22:07:11.527095+0000","last_undegraded":"2024-08-18T22:07:11.527095+0000","last_fullsized":"2024-08-18T22:07:11.527095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:18.465913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531192+0000","last_change":"2024-08-18T22:05:21.860569+0000","last_active":"2024-08-18T22:07:11.531192+0000","last_peered":"2024-08-18T22:07:11.531192+0000","last_clean":"2024-08-18T22:07:11.531192+0000","last_became_active":"2024-08-18T22:05:21.860250+0000","last_became_peered":"2024-08-18T22:05:21.860250+0000","last_unstale":"2024-08-18T22:07:11.531192+0000","last_undegraded":"2024-08-18T22:07:11.531192+0000","last_fullsized":"2024-08-18T22:07:11.531192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:52.097840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523697+0000","last_change":"2024-08-18T22:05:21.858271+0000","last_active":"2024-08-18T22:07:11.523697+0000","last_peered":"2024-08-18T22:07:11.523697+0000","last_clean":"2024-08-18T22:07:11.523697+0000","last_became_active":"2024-08-18T22:05:21.857968+0000","last_became_peered":"2024-08-18T22:05:21.857968+0000","last_unstale":"2024-08-18T22:07:11.523697+0000","last_undegraded":"2024-08-18T22:07:11.523697+0000","last_fullsized":"2024-08-18T22:07:11.523697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:24.023136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526949+0000","last_change":"2024-08-18T22:05:21.853799+0000","last_active":"2024-08-18T22:07:11.526949+0000","last_peered":"2024-08-18T22:07:11.526949+0000","last_clean":"2024-08-18T22:07:11.526949+0000","last_became_active":"2024-08-18T22:05:21.853432+0000","last_became_peered":"2024-08-18T22:05:21.853432+0000","last_unstale":"2024-08-18T22:07:11.526949+0000","last_undegraded":"2024-08-18T22:07:11.526949+0000","last_fullsized":"2024-08-18T22:07:11.526949+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:07.429169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528548+0000","last_change":"2024-08-18T22:05:21.855117+0000","last_active":"2024-08-18T22:07:11.528548+0000","last_peered":"2024-08-18T22:07:11.528548+0000","last_clean":"2024-08-18T22:07:11.528548+0000","last_became_active":"2024-08-18T22:05:21.854041+0000","last_became_peered":"2024-08-18T22:05:21.854041+0000","last_unstale":"2024-08-18T22:07:11.528548+0000","last_undegraded":"2024-08-18T22:07:11.528548+0000","last_fullsized":"2024-08-18T22:07:11.528548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:17.222658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623177+0000","last_change":"2024-08-18T22:05:21.861745+0000","last_active":"2024-08-18T22:07:11.623177+0000","last_peered":"2024-08-18T22:07:11.623177+0000","last_clean":"2024-08-18T22:07:11.623177+0000","last_became_active":"2024-08-18T22:05:21.861427+0000","last_became_peered":"2024-08-18T22:05:21.861427+0000","last_unstale":"2024-08-18T22:07:11.623177+0000","last_undegraded":"2024-08-18T22:07:11.623177+0000","last_fullsized":"2024-08-18T22:07:11.623177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:17.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623245+0000","last_change":"2024-08-18T22:05:21.860046+0000","last_active":"2024-08-18T22:07:11.623245+0000","last_peered":"2024-08-18T22:07:11.623245+0000","last_clean":"2024-08-18T22:07:11.623245+0000","last_became_active":"2024-08-18T22:05:21.859674+0000","last_became_peered":"2024-08-18T22:05:21.859674+0000","last_unstale":"2024-08-18T22:07:11.623245+0000","last_undegraded":"2024-08-18T22:07:11.623245+0000","last_fullsized":"2024-08-18T22:07:11.623245+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:44.615270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570548+0000","last_change":"2024-08-18T22:05:21.847647+0000","last_active":"2024-08-18T22:07:11.570548+0000","last_peered":"2024-08-18T22:07:11.570548+0000","last_clean":"2024-08-18T22:07:11.570548+0000","last_became_active":"2024-08-18T22:05:21.847367+0000","last_became_peered":"2024-08-18T22:05:21.847367+0000","last_unstale":"2024-08-18T22:07:11.570548+0000","last_undegraded":"2024-08-18T22:07:11.570548+0000","last_fullsized":"2024-08-18T22:07:11.570548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:33.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573513+0000","last_change":"2024-08-18T22:05:21.861326+0000","last_active":"2024-08-18T22:07:11.573513+0000","last_peered":"2024-08-18T22:07:11.573513+0000","last_clean":"2024-08-18T22:07:11.573513+0000","last_became_active":"2024-08-18T22:05:21.860968+0000","last_became_peered":"2024-08-18T22:05:21.860968+0000","last_unstale":"2024-08-18T22:07:11.573513+0000","last_undegraded":"2024-08-18T22:07:11.573513+0000","last_fullsized":"2024-08-18T22:07:11.573513+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:49.150670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527404+0000","last_change":"2024-08-18T22:05:21.852618+0000","last_active":"2024-08-18T22:07:11.527404+0000","last_peered":"2024-08-18T22:07:11.527404+0000","last_clean":"2024-08-18T22:07:11.527404+0000","last_became_active":"2024-08-18T22:05:21.852318+0000","last_became_peered":"2024-08-18T22:05:21.852318+0000","last_unstale":"2024-08-18T22:07:11.527404+0000","last_undegraded":"2024-08-18T22:07:11.527404+0000","last_fullsized":"2024-08-18T22:07:11.527404+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:06:49.085150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522585+0000","last_change":"2024-08-18T22:05:21.860108+0000","last_active":"2024-08-18T22:07:11.522585+0000","last_peered":"2024-08-18T22:07:11.522585+0000","last_clean":"2024-08-18T22:07:11.522585+0000","last_became_active":"2024-08-18T22:05:21.859794+0000","last_became_peered":"2024-08-18T22:05:21.859794+0000","last_unstale":"2024-08-18T22:07:11.522585+0000","last_undegraded":"2024-08-18T22:07:11.522585+0000","last_fullsized":"2024-08-18T22:07:11.522585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:01.974202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529519+0000","last_change":"2024-08-18T22:05:21.856404+0000","last_active":"2024-08-18T22:07:11.529519+0000","last_peered":"2024-08-18T22:07:11.529519+0000","last_clean":"2024-08-18T22:07:11.529519+0000","last_became_active":"2024-08-18T22:05:21.855800+0000","last_became_peered":"2024-08-18T22:05:21.855800+0000","last_unstale":"2024-08-18T22:07:11.529519+0000","last_undegraded":"2024-08-18T22:07:11.529519+0000","last_fullsized":"2024-08-18T22:07:11.529519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:09.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572303+0000","last_change":"2024-08-18T22:05:21.859891+0000","last_active":"2024-08-18T22:07:11.572303+0000","last_peered":"2024-08-18T22:07:11.572303+0000","last_clean":"2024-08-18T22:07:11.572303+0000","last_became_active":"2024-08-18T22:05:21.859407+0000","last_became_peered":"2024-08-18T22:05:21.859407+0000","last_unstale":"2024-08-18T22:07:11.572303+0000","last_undegraded":"2024-08-18T22:07:11.572303+0000","last_fullsized":"2024-08-18T22:07:11.572303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:59.285627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527004+0000","last_change":"2024-08-18T22:05:21.856428+0000","last_active":"2024-08-18T22:07:11.527004+0000","last_peered":"2024-08-18T22:07:11.527004+0000","last_clean":"2024-08-18T22:07:11.527004+0000","last_became_active":"2024-08-18T22:05:21.853374+0000","last_became_peered":"2024-08-18T22:05:21.853374+0000","last_unstale":"2024-08-18T22:07:11.527004+0000","last_undegraded":"2024-08-18T22:07:11.527004+0000","last_fullsized":"2024-08-18T22:07:11.527004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:07.087171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522013+0000","last_change":"2024-08-18T22:05:21.852688+0000","last_active":"2024-08-18T22:07:11.522013+0000","last_peered":"2024-08-18T22:07:11.522013+0000","last_clean":"2024-08-18T22:07:11.522013+0000","last_became_active":"2024-08-18T22:05:21.851107+0000","last_became_peered":"2024-08-18T22:05:21.851107+0000","last_unstale":"2024-08-18T22:07:11.522013+0000","last_undegraded":"2024-08-18T22:07:11.522013+0000","last_fullsized":"2024-08-18T22:07:11.522013+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:48.267166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524546+0000","last_change":"2024-08-18T22:05:21.850809+0000","last_active":"2024-08-18T22:07:11.524546+0000","last_peered":"2024-08-18T22:07:11.524546+0000","last_clean":"2024-08-18T22:07:11.524546+0000","last_became_active":"2024-08-18T22:05:21.850510+0000","last_became_peered":"2024-08-18T22:05:21.850510+0000","last_unstale":"2024-08-18T22:07:11.524546+0000","last_undegraded":"2024-08-18T22:07:11.524546+0000","last_fullsized":"2024-08-18T22:07:11.524546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:39.338051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573466+0000","last_change":"2024-08-18T22:05:21.856156+0000","last_active":"2024-08-18T22:07:11.573466+0000","last_peered":"2024-08-18T22:07:11.573466+0000","last_clean":"2024-08-18T22:07:11.573466+0000","last_became_active":"2024-08-18T22:05:21.855830+0000","last_became_peered":"2024-08-18T22:05:21.855830+0000","last_unstale":"2024-08-18T22:07:11.573466+0000","last_undegraded":"2024-08-18T22:07:11.573466+0000","last_fullsized":"2024-08-18T22:07:11.573466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:10.670405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623466+0000","last_change":"2024-08-18T22:05:21.865162+0000","last_active":"2024-08-18T22:07:11.623466+0000","last_peered":"2024-08-18T22:07:11.623466+0000","last_clean":"2024-08-18T22:07:11.623466+0000","last_became_active":"2024-08-18T22:05:21.864842+0000","last_became_peered":"2024-08-18T22:05:21.864842+0000","last_unstale":"2024-08-18T22:07:11.623466+0000","last_undegraded":"2024-08-18T22:07:11.623466+0000","last_fullsized":"2024-08-18T22:07:11.623466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:21.388638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623496+0000","last_change":"2024-08-18T22:05:21.859227+0000","last_active":"2024-08-18T22:07:11.623496+0000","last_peered":"2024-08-18T22:07:11.623496+0000","last_clean":"2024-08-18T22:07:11.623496+0000","last_became_active":"2024-08-18T22:05:21.858886+0000","last_became_peered":"2024-08-18T22:05:21.858886+0000","last_unstale":"2024-08-18T22:07:11.623496+0000","last_undegraded":"2024-08-18T22:07:11.623496+0000","last_fullsized":"2024-08-18T22:07:11.623496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:08.710772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526871+0000","last_change":"2024-08-18T22:05:21.854864+0000","last_active":"2024-08-18T22:07:11.526871+0000","last_peered":"2024-08-18T22:07:11.526871+0000","last_clean":"2024-08-18T22:07:11.526871+0000","last_became_active":"2024-08-18T22:05:21.854522+0000","last_became_peered":"2024-08-18T22:05:21.854522+0000","last_unstale":"2024-08-18T22:07:11.526871+0000","last_undegraded":"2024-08-18T22:07:11.526871+0000","last_fullsized":"2024-08-18T22:07:11.526871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:32.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72119,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":687,"num_read_kb":416,"num_write":180,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":216357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514537,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1052672,"data_stored":523218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743472,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37048,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708104,"statfs":{"total":95995035648,"available":95957098496,"internally_reserved":0,"allocated":1753088,"data_stored":1182560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906996,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":523454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168633,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1069056,"data_stored":523374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397564,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36968,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708184,"statfs":{"total":95995035648,"available":95957180416,"internally_reserved":0,"allocated":1662976,"data_stored":1119954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561090,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":518630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790021,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28656,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716496,"statfs":{"total":95995035648,"available":95965691904,"internally_reserved":0,"allocated":1671168,"data_stored":1115011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953547,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36448,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708704,"statfs":{"total":95995035648,"available":95957712896,"internally_reserved":0,"allocated":1138688,"data_stored":591258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1060864,"data_stored":518824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":520421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":585987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1073152,"data_stored":520018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:07:49.958 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:07:50.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.090+0000 7fd6634fc640 1 -- 172.21.15.123:0/3040466300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd65c1013e0 msgr2=0x7fd65c108c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:50.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.090+0000 7fd6634fc640 1 --2- 172.21.15.123:0/3040466300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd65c1013e0 0x7fd65c108c80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd654009ca0 tx=0x7fd65402a8c0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.090+0000 7fd6634fc640 1 -- 172.21.15.123:0/3040466300 shutdown_connections 2024-08-18T22:07:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.090+0000 7fd6634fc640 1 --2- 172.21.15.123:0/3040466300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd65c1013e0 0x7fd65c108c80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.090+0000 7fd6634fc640 1 --2- 172.21.15.123:0/3040466300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd65c100a20 0x7fd65c100ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.090+0000 7fd6634fc640 1 --2- 172.21.15.123:0/3040466300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd65c101cf0 0x7fd65c1020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.090+0000 7fd6634fc640 1 -- 172.21.15.123:0/3040466300 >> 172.21.15.123:0/3040466300 conn(0x7fd65c0fb640 msgr2=0x7fd65c0fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.090+0000 7fd6634fc640 1 -- 172.21.15.123:0/3040466300 shutdown_connections 2024-08-18T22:07:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.090+0000 7fd6634fc640 1 -- 172.21.15.123:0/3040466300 wait complete. 2024-08-18T22:07:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd6634fc640 1 Processor -- start 2024-08-18T22:07:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd6634fc640 1 -- start start 2024-08-18T22:07:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd6634fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd65c100a20 0x7fd65c197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd6634fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd65c1013e0 0x7fd65c198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd6634fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd65c101cf0 0x7fd65c19f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd6634fc640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c10d540 con 0x7fd65c100a20 2024-08-18T22:07:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd6634fc640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c10d3c0 con 0x7fd65c1013e0 2024-08-18T22:07:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd6634fc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c10d6c0 con 0x7fd65c101cf0 2024-08-18T22:07:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd661298640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd65c100a20 0x7fd65c197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd661298640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd65c100a20 0x7fd65c197b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47678/0 (socket says 172.21.15.123:47678) 2024-08-18T22:07:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd661298640 1 -- 172.21.15.123:0/4129572433 learned_addr learned my addr 172.21.15.123:0/4129572433 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd661a99640 1 --2- 172.21.15.123:0/4129572433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd65c101cf0 0x7fd65c19f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd661298640 1 -- 172.21.15.123:0/4129572433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd65c101cf0 msgr2=0x7fd65c19f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd661298640 1 --2- 172.21.15.123:0/4129572433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd65c101cf0 0x7fd65c19f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd660a97640 1 --2- 172.21.15.123:0/4129572433 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd65c1013e0 0x7fd65c198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd661298640 1 -- 172.21.15.123:0/4129572433 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd65c1013e0 msgr2=0x7fd65c198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd661298640 1 --2- 172.21.15.123:0/4129572433 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd65c1013e0 0x7fd65c198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.091+0000 7fd661298640 1 -- 172.21.15.123:0/4129572433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65c19f750 con 0x7fd65c100a20 2024-08-18T22:07:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.092+0000 7fd661298640 1 --2- 172.21.15.123:0/4129572433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd65c100a20 0x7fd65c197b30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00d950 tx=0x7fd64c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.092+0000 7fd6527fc640 1 -- 172.21.15.123:0/4129572433 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c017070 con 0x7fd65c100a20 2024-08-18T22:07:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.092+0000 7fd6634fc640 1 -- 172.21.15.123:0/4129572433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd65c19fa40 con 0x7fd65c100a20 2024-08-18T22:07:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.092+0000 7fd6527fc640 1 -- 172.21.15.123:0/4129572433 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd64c009c30 con 0x7fd65c100a20 2024-08-18T22:07:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.092+0000 7fd6527fc640 1 -- 172.21.15.123:0/4129572433 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c00f600 con 0x7fd65c100a20 2024-08-18T22:07:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.092+0000 7fd6634fc640 1 -- 172.21.15.123:0/4129572433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd65c19ff40 con 0x7fd65c100a20 2024-08-18T22:07:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.093+0000 7fd6634fc640 1 -- 172.21.15.123:0/4129572433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd65c107be0 con 0x7fd65c100a20 2024-08-18T22:07:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.094+0000 7fd6527fc640 1 -- 172.21.15.123:0/4129572433 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fd64c01a070 con 0x7fd65c100a20 2024-08-18T22:07:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.095+0000 7fd6527fc640 1 --2- 172.21.15.123:0/4129572433 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd6480a2b90 0x7fd6480a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.095+0000 7fd660a97640 1 --2- 172.21.15.123:0/4129572433 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd6480a2b90 0x7fd6480a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.095+0000 7fd6527fc640 1 -- 172.21.15.123:0/4129572433 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fd64c0cef00 con 0x7fd65c100a20 2024-08-18T22:07:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.095+0000 7fd660a97640 1 --2- 172.21.15.123:0/4129572433 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd6480a2b90 0x7fd6480a5050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd65c199040 tx=0x7fd658005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.098+0000 7fd6527fc640 1 -- 172.21.15.123:0/4129572433 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd64c009de0 con 0x7fd65c100a20 2024-08-18T22:07:50.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.263+0000 7fd6634fc640 1 -- 172.21.15.123:0/4129572433 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd65c062360 con 0x7fd6480a2b90 2024-08-18T22:07:50.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.271+0000 7fd6527fc640 1 -- 172.21.15.123:0/4129572433 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340502 (secure 0 0 0) 0x7fd65c062360 con 0x7fd6480a2b90 2024-08-18T22:07:50.275 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:50.277 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-08-18T22:07:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.275+0000 7fd6634fc640 1 -- 172.21.15.123:0/4129572433 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd6480a2b90 msgr2=0x7fd6480a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.275+0000 7fd6634fc640 1 --2- 172.21.15.123:0/4129572433 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd6480a2b90 0x7fd6480a5050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd65c199040 tx=0x7fd658005f90 comp rx=0 tx=0).stop 2024-08-18T22:07:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.275+0000 7fd6634fc640 1 -- 172.21.15.123:0/4129572433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd65c100a20 msgr2=0x7fd65c197b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.275+0000 7fd6634fc640 1 --2- 172.21.15.123:0/4129572433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd65c100a20 0x7fd65c197b30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00d950 tx=0x7fd64c00de10 comp rx=0 tx=0).stop 2024-08-18T22:07:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.275+0000 7fd6634fc640 1 -- 172.21.15.123:0/4129572433 shutdown_connections 2024-08-18T22:07:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.275+0000 7fd6634fc640 1 --2- 172.21.15.123:0/4129572433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd65c101cf0 0x7fd65c19f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.275+0000 7fd6634fc640 1 --2- 172.21.15.123:0/4129572433 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd6480a2b90 0x7fd6480a5050 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.275+0000 7fd6634fc640 1 --2- 172.21.15.123:0/4129572433 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd65c1013e0 0x7fd65c198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.275+0000 7fd6634fc640 1 --2- 172.21.15.123:0/4129572433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd65c100a20 0x7fd65c197b30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.275+0000 7fd6634fc640 1 -- 172.21.15.123:0/4129572433 >> 172.21.15.123:0/4129572433 conn(0x7fd65c0fb640 msgr2=0x7fd65c104db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.275+0000 7fd6634fc640 1 -- 172.21.15.123:0/4129572433 shutdown_connections 2024-08-18T22:07:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.275+0000 7fd6634fc640 1 -- 172.21.15.123:0/4129572433 wait complete. 2024-08-18T22:07:50.288 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-08-18T22:07:49.373563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662721,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":813,"num_read_kb":525,"num_write":363,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1229945,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":793,"ondisk_log_size":793,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388624,"kb_used_data":14444,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553200,"statfs":{"total":1151940427776,"available":1151542476800,"internally_reserved":0,"allocated":14790656,"data_stored":8242709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":52,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003269"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523825+0000","last_change":"2024-08-18T22:05:19.844674+0000","last_active":"2024-08-18T22:07:11.523825+0000","last_peered":"2024-08-18T22:07:11.523825+0000","last_clean":"2024-08-18T22:07:11.523825+0000","last_became_active":"2024-08-18T22:05:19.844381+0000","last_became_peered":"2024-08-18T22:05:19.844381+0000","last_unstale":"2024-08-18T22:07:11.523825+0000","last_undegraded":"2024-08-18T22:07:11.523825+0000","last_fullsized":"2024-08-18T22:07:11.523825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:58.783222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572759+0000","last_change":"2024-08-18T22:05:21.859013+0000","last_active":"2024-08-18T22:07:11.572759+0000","last_peered":"2024-08-18T22:07:11.572759+0000","last_clean":"2024-08-18T22:07:11.572759+0000","last_became_active":"2024-08-18T22:05:21.858709+0000","last_became_peered":"2024-08-18T22:05:21.858709+0000","last_unstale":"2024-08-18T22:07:11.572759+0000","last_undegraded":"2024-08-18T22:07:11.572759+0000","last_fullsized":"2024-08-18T22:07:11.572759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:34.272340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530547+0000","last_change":"2024-08-18T22:05:28.925735+0000","last_active":"2024-08-18T22:07:11.530547+0000","last_peered":"2024-08-18T22:07:11.530547+0000","last_clean":"2024-08-18T22:07:11.530547+0000","last_became_active":"2024-08-18T22:05:28.925324+0000","last_became_peered":"2024-08-18T22:05:28.925324+0000","last_unstale":"2024-08-18T22:07:11.530547+0000","last_undegraded":"2024-08-18T22:07:11.530547+0000","last_fullsized":"2024-08-18T22:07:11.530547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:15:58.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572915+0000","last_change":"2024-08-18T22:05:20.290861+0000","last_active":"2024-08-18T22:07:11.572915+0000","last_peered":"2024-08-18T22:07:11.572915+0000","last_clean":"2024-08-18T22:07:11.572915+0000","last_became_active":"2024-08-18T22:05:20.290508+0000","last_became_peered":"2024-08-18T22:05:20.290508+0000","last_unstale":"2024-08-18T22:07:11.572915+0000","last_undegraded":"2024-08-18T22:07:11.572915+0000","last_fullsized":"2024-08-18T22:07:11.572915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:21.462206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623639+0000","last_change":"2024-08-18T22:05:21.863441+0000","last_active":"2024-08-18T22:07:11.623639+0000","last_peered":"2024-08-18T22:07:11.623639+0000","last_clean":"2024-08-18T22:07:11.623639+0000","last_became_active":"2024-08-18T22:05:21.863121+0000","last_became_peered":"2024-08-18T22:05:21.863121+0000","last_unstale":"2024-08-18T22:07:11.623639+0000","last_undegraded":"2024-08-18T22:07:11.623639+0000","last_fullsized":"2024-08-18T22:07:11.623639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:47.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572680+0000","last_change":"2024-08-18T22:05:28.925477+0000","last_active":"2024-08-18T22:07:11.572680+0000","last_peered":"2024-08-18T22:07:11.572680+0000","last_clean":"2024-08-18T22:07:11.572680+0000","last_became_active":"2024-08-18T22:05:28.924922+0000","last_became_peered":"2024-08-18T22:05:28.924922+0000","last_unstale":"2024-08-18T22:07:11.572680+0000","last_undegraded":"2024-08-18T22:07:11.572680+0000","last_fullsized":"2024-08-18T22:07:11.572680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:35.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524930+0000","last_change":"2024-08-18T22:05:19.847979+0000","last_active":"2024-08-18T22:07:11.524930+0000","last_peered":"2024-08-18T22:07:11.524930+0000","last_clean":"2024-08-18T22:07:11.524930+0000","last_became_active":"2024-08-18T22:05:19.847643+0000","last_became_peered":"2024-08-18T22:05:19.847643+0000","last_unstale":"2024-08-18T22:07:11.524930+0000","last_undegraded":"2024-08-18T22:07:11.524930+0000","last_fullsized":"2024-08-18T22:07:11.524930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:33.875378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528910+0000","last_change":"2024-08-18T22:05:21.860225+0000","last_active":"2024-08-18T22:07:11.528910+0000","last_peered":"2024-08-18T22:07:11.528910+0000","last_clean":"2024-08-18T22:07:11.528910+0000","last_became_active":"2024-08-18T22:05:21.859889+0000","last_became_peered":"2024-08-18T22:05:21.859889+0000","last_unstale":"2024-08-18T22:07:11.528910+0000","last_undegraded":"2024-08-18T22:07:11.528910+0000","last_fullsized":"2024-08-18T22:07:11.528910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:06:27.084401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573134+0000","last_change":"2024-08-18T22:05:28.922230+0000","last_active":"2024-08-18T22:07:11.573134+0000","last_peered":"2024-08-18T22:07:11.573134+0000","last_clean":"2024-08-18T22:07:11.573134+0000","last_became_active":"2024-08-18T22:05:28.921804+0000","last_became_peered":"2024-08-18T22:05:28.921804+0000","last_unstale":"2024-08-18T22:07:11.573134+0000","last_undegraded":"2024-08-18T22:07:11.573134+0000","last_fullsized":"2024-08-18T22:07:11.573134+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:17.735645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.533950+0000","last_change":"2024-08-18T22:07:11.533541+0000","last_active":"2024-08-18T22:07:11.533950+0000","last_peered":"2024-08-18T22:07:11.533950+0000","last_clean":"2024-08-18T22:07:11.533950+0000","last_became_active":"2024-08-18T22:07:11.530034+0000","last_became_peered":"2024-08-18T22:07:11.530034+0000","last_unstale":"2024-08-18T22:07:11.533950+0000","last_undegraded":"2024-08-18T22:07:11.533950+0000","last_fullsized":"2024-08-18T22:07:11.533950+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:29.575399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528705+0000","last_change":"2024-08-18T22:06:10.514673+0000","last_active":"2024-08-18T22:07:11.528705+0000","last_peered":"2024-08-18T22:07:11.528705+0000","last_clean":"2024-08-18T22:07:11.528705+0000","last_became_active":"2024-08-18T22:06:10.514264+0000","last_became_peered":"2024-08-18T22:06:10.514264+0000","last_unstale":"2024-08-18T22:07:11.528705+0000","last_undegraded":"2024-08-18T22:07:11.528705+0000","last_fullsized":"2024-08-18T22:07:11.528705+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:03.626895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572808+0000","last_change":"2024-08-18T22:05:28.924521+0000","last_active":"2024-08-18T22:07:11.572808+0000","last_peered":"2024-08-18T22:07:11.572808+0000","last_clean":"2024-08-18T22:07:11.572808+0000","last_became_active":"2024-08-18T22:05:28.924107+0000","last_became_peered":"2024-08-18T22:05:28.924107+0000","last_unstale":"2024-08-18T22:07:11.572808+0000","last_undegraded":"2024-08-18T22:07:11.572808+0000","last_fullsized":"2024-08-18T22:07:11.572808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:37.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527669+0000","last_change":"2024-08-18T22:05:21.861696+0000","last_active":"2024-08-18T22:07:11.527669+0000","last_peered":"2024-08-18T22:07:11.527669+0000","last_clean":"2024-08-18T22:07:11.527669+0000","last_became_active":"2024-08-18T22:05:21.861220+0000","last_became_peered":"2024-08-18T22:05:21.861220+0000","last_unstale":"2024-08-18T22:07:11.527669+0000","last_undegraded":"2024-08-18T22:07:11.527669+0000","last_fullsized":"2024-08-18T22:07:11.527669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:01.098281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526302+0000","last_change":"2024-08-18T22:06:10.520097+0000","last_active":"2024-08-18T22:07:11.526302+0000","last_peered":"2024-08-18T22:07:11.526302+0000","last_clean":"2024-08-18T22:07:11.526302+0000","last_became_active":"2024-08-18T22:06:10.513286+0000","last_became_peered":"2024-08-18T22:06:10.513286+0000","last_unstale":"2024-08-18T22:07:11.526302+0000","last_undegraded":"2024-08-18T22:07:11.526302+0000","last_fullsized":"2024-08-18T22:07:11.526302+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:08:18.861243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573335+0000","last_change":"2024-08-18T22:05:29.013139+0000","last_active":"2024-08-18T22:07:11.573335+0000","last_peered":"2024-08-18T22:07:11.573335+0000","last_clean":"2024-08-18T22:07:11.573335+0000","last_became_active":"2024-08-18T22:05:29.012322+0000","last_became_peered":"2024-08-18T22:05:29.012322+0000","last_unstale":"2024-08-18T22:07:11.573335+0000","last_undegraded":"2024-08-18T22:07:11.573335+0000","last_fullsized":"2024-08-18T22:07:11.573335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:32.348201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572558+0000","last_change":"2024-08-18T22:05:21.860410+0000","last_active":"2024-08-18T22:07:11.572558+0000","last_peered":"2024-08-18T22:07:11.572558+0000","last_clean":"2024-08-18T22:07:11.572558+0000","last_became_active":"2024-08-18T22:05:21.860173+0000","last_became_peered":"2024-08-18T22:05:21.860173+0000","last_unstale":"2024-08-18T22:07:11.572558+0000","last_undegraded":"2024-08-18T22:07:11.572558+0000","last_fullsized":"2024-08-18T22:07:11.572558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:00.879178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530486+0000","last_change":"2024-08-18T22:05:19.845785+0000","last_active":"2024-08-18T22:07:11.530486+0000","last_peered":"2024-08-18T22:07:11.530486+0000","last_clean":"2024-08-18T22:07:11.530486+0000","last_became_active":"2024-08-18T22:05:19.845414+0000","last_became_peered":"2024-08-18T22:05:19.845414+0000","last_unstale":"2024-08-18T22:07:11.530486+0000","last_undegraded":"2024-08-18T22:07:11.530486+0000","last_fullsized":"2024-08-18T22:07:11.530486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:13.504885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573296+0000","last_change":"2024-08-18T22:06:10.523404+0000","last_active":"2024-08-18T22:07:11.573296+0000","last_peered":"2024-08-18T22:07:11.573296+0000","last_clean":"2024-08-18T22:07:11.573296+0000","last_became_active":"2024-08-18T22:06:10.516652+0000","last_became_peered":"2024-08-18T22:06:10.516652+0000","last_unstale":"2024-08-18T22:07:11.573296+0000","last_undegraded":"2024-08-18T22:07:11.573296+0000","last_fullsized":"2024-08-18T22:07:11.573296+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:58.197636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526366+0000","last_change":"2024-08-18T22:05:21.858329+0000","last_active":"2024-08-18T22:07:11.526366+0000","last_peered":"2024-08-18T22:07:11.526366+0000","last_clean":"2024-08-18T22:07:11.526366+0000","last_became_active":"2024-08-18T22:05:21.857854+0000","last_became_peered":"2024-08-18T22:05:21.857854+0000","last_unstale":"2024-08-18T22:07:11.526366+0000","last_undegraded":"2024-08-18T22:07:11.526366+0000","last_fullsized":"2024-08-18T22:07:11.526366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:45:19.934647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572567+0000","last_change":"2024-08-18T22:05:19.843031+0000","last_active":"2024-08-18T22:07:11.572567+0000","last_peered":"2024-08-18T22:07:11.572567+0000","last_clean":"2024-08-18T22:07:11.572567+0000","last_became_active":"2024-08-18T22:05:19.842694+0000","last_became_peered":"2024-08-18T22:05:19.842694+0000","last_unstale":"2024-08-18T22:07:11.572567+0000","last_undegraded":"2024-08-18T22:07:11.572567+0000","last_fullsized":"2024-08-18T22:07:11.572567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:01.135449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523703+0000","last_change":"2024-08-18T22:05:28.920647+0000","last_active":"2024-08-18T22:07:11.523703+0000","last_peered":"2024-08-18T22:07:11.523703+0000","last_clean":"2024-08-18T22:07:11.523703+0000","last_became_active":"2024-08-18T22:05:28.920295+0000","last_became_peered":"2024-08-18T22:05:28.920295+0000","last_unstale":"2024-08-18T22:07:11.523703+0000","last_undegraded":"2024-08-18T22:07:11.523703+0000","last_fullsized":"2024-08-18T22:07:11.523703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:41.295009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524432+0000","last_change":"2024-08-18T22:05:21.858413+0000","last_active":"2024-08-18T22:07:11.524432+0000","last_peered":"2024-08-18T22:07:11.524432+0000","last_clean":"2024-08-18T22:07:11.524432+0000","last_became_active":"2024-08-18T22:05:21.858102+0000","last_became_peered":"2024-08-18T22:05:21.858102+0000","last_unstale":"2024-08-18T22:07:11.524432+0000","last_undegraded":"2024-08-18T22:07:11.524432+0000","last_fullsized":"2024-08-18T22:07:11.524432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:24:59.432666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528669+0000","last_change":"2024-08-18T22:05:20.292085+0000","last_active":"2024-08-18T22:07:11.528669+0000","last_peered":"2024-08-18T22:07:11.528669+0000","last_clean":"2024-08-18T22:07:11.528669+0000","last_became_active":"2024-08-18T22:05:20.291606+0000","last_became_peered":"2024-08-18T22:05:20.291606+0000","last_unstale":"2024-08-18T22:07:11.528669+0000","last_undegraded":"2024-08-18T22:07:11.528669+0000","last_fullsized":"2024-08-18T22:07:11.528669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:22:46.801719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573405+0000","last_change":"2024-08-18T22:06:10.515755+0000","last_active":"2024-08-18T22:07:11.573405+0000","last_peered":"2024-08-18T22:07:11.573405+0000","last_clean":"2024-08-18T22:07:11.573405+0000","last_became_active":"2024-08-18T22:06:10.514624+0000","last_became_peered":"2024-08-18T22:06:10.514624+0000","last_unstale":"2024-08-18T22:07:11.573405+0000","last_undegraded":"2024-08-18T22:07:11.573405+0000","last_fullsized":"2024-08-18T22:07:11.573405+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:18:50.785139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623553+0000","last_change":"2024-08-18T22:05:21.855163+0000","last_active":"2024-08-18T22:07:11.623553+0000","last_peered":"2024-08-18T22:07:11.623553+0000","last_clean":"2024-08-18T22:07:11.623553+0000","last_became_active":"2024-08-18T22:05:21.854867+0000","last_became_peered":"2024-08-18T22:05:21.854867+0000","last_unstale":"2024-08-18T22:07:11.623553+0000","last_undegraded":"2024-08-18T22:07:11.623553+0000","last_fullsized":"2024-08-18T22:07:11.623553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:10.300307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573516+0000","last_change":"2024-08-18T22:05:20.082363+0000","last_active":"2024-08-18T22:07:11.573516+0000","last_peered":"2024-08-18T22:07:11.573516+0000","last_clean":"2024-08-18T22:07:11.573516+0000","last_became_active":"2024-08-18T22:05:20.081998+0000","last_became_peered":"2024-08-18T22:05:20.081998+0000","last_unstale":"2024-08-18T22:07:11.573516+0000","last_undegraded":"2024-08-18T22:07:11.573516+0000","last_fullsized":"2024-08-18T22:07:11.573516+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:44.960512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530726+0000","last_change":"2024-08-18T22:05:28.924072+0000","last_active":"2024-08-18T22:07:11.530726+0000","last_peered":"2024-08-18T22:07:11.530726+0000","last_clean":"2024-08-18T22:07:11.530726+0000","last_became_active":"2024-08-18T22:05:28.923673+0000","last_became_peered":"2024-08-18T22:05:28.923673+0000","last_unstale":"2024-08-18T22:07:11.530726+0000","last_undegraded":"2024-08-18T22:07:11.530726+0000","last_fullsized":"2024-08-18T22:07:11.530726+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:44.593009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572927+0000","last_change":"2024-08-18T22:05:21.851377+0000","last_active":"2024-08-18T22:07:11.572927+0000","last_peered":"2024-08-18T22:07:11.572927+0000","last_clean":"2024-08-18T22:07:11.572927+0000","last_became_active":"2024-08-18T22:05:21.851031+0000","last_became_peered":"2024-08-18T22:05:21.851031+0000","last_unstale":"2024-08-18T22:07:11.572927+0000","last_undegraded":"2024-08-18T22:07:11.572927+0000","last_fullsized":"2024-08-18T22:07:11.572927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.547244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'13","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:31.609491+0000","last_change":"2024-08-18T22:05:19.840697+0000","last_active":"2024-08-18T22:07:31.609491+0000","last_peered":"2024-08-18T22:07:31.609491+0000","last_clean":"2024-08-18T22:07:31.609491+0000","last_became_active":"2024-08-18T22:05:19.840382+0000","last_became_peered":"2024-08-18T22:05:19.840382+0000","last_unstale":"2024-08-18T22:07:31.609491+0000","last_undegraded":"2024-08-18T22:07:31.609491+0000","last_fullsized":"2024-08-18T22:07:31.609491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:24.514428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572248+0000","last_change":"2024-08-18T22:05:29.012305+0000","last_active":"2024-08-18T22:07:11.572248+0000","last_peered":"2024-08-18T22:07:11.572248+0000","last_clean":"2024-08-18T22:07:11.572248+0000","last_became_active":"2024-08-18T22:05:29.011846+0000","last_became_peered":"2024-08-18T22:05:29.011846+0000","last_unstale":"2024-08-18T22:07:11.572248+0000","last_undegraded":"2024-08-18T22:07:11.572248+0000","last_fullsized":"2024-08-18T22:07:11.572248+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:36.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570893+0000","last_change":"2024-08-18T22:05:21.856182+0000","last_active":"2024-08-18T22:07:11.570893+0000","last_peered":"2024-08-18T22:07:11.570893+0000","last_clean":"2024-08-18T22:07:11.570893+0000","last_became_active":"2024-08-18T22:05:21.855855+0000","last_became_peered":"2024-08-18T22:05:21.855855+0000","last_unstale":"2024-08-18T22:07:11.570893+0000","last_undegraded":"2024-08-18T22:07:11.570893+0000","last_fullsized":"2024-08-18T22:07:11.570893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:00.166809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524985+0000","last_change":"2024-08-18T22:05:20.291272+0000","last_active":"2024-08-18T22:07:11.524985+0000","last_peered":"2024-08-18T22:07:11.524985+0000","last_clean":"2024-08-18T22:07:11.524985+0000","last_became_active":"2024-08-18T22:05:20.290970+0000","last_became_peered":"2024-08-18T22:05:20.290970+0000","last_unstale":"2024-08-18T22:07:11.524985+0000","last_undegraded":"2024-08-18T22:07:11.524985+0000","last_fullsized":"2024-08-18T22:07:11.524985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:29.438996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526400+0000","last_change":"2024-08-18T22:05:28.923141+0000","last_active":"2024-08-18T22:07:11.526400+0000","last_peered":"2024-08-18T22:07:11.526400+0000","last_clean":"2024-08-18T22:07:11.526400+0000","last_became_active":"2024-08-18T22:05:28.922269+0000","last_became_peered":"2024-08-18T22:05:28.922269+0000","last_unstale":"2024-08-18T22:07:11.526400+0000","last_undegraded":"2024-08-18T22:07:11.526400+0000","last_fullsized":"2024-08-18T22:07:11.526400+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:58.092640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522176+0000","last_change":"2024-08-18T22:05:21.850124+0000","last_active":"2024-08-18T22:07:11.522176+0000","last_peered":"2024-08-18T22:07:11.522176+0000","last_clean":"2024-08-18T22:07:11.522176+0000","last_became_active":"2024-08-18T22:05:21.849805+0000","last_became_peered":"2024-08-18T22:05:21.849805+0000","last_unstale":"2024-08-18T22:07:11.522176+0000","last_undegraded":"2024-08-18T22:07:11.522176+0000","last_fullsized":"2024-08-18T22:07:11.522176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:53.492613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523594+0000","last_change":"2024-08-18T22:05:20.292836+0000","last_active":"2024-08-18T22:07:11.523594+0000","last_peered":"2024-08-18T22:07:11.523594+0000","last_clean":"2024-08-18T22:07:11.523594+0000","last_became_active":"2024-08-18T22:05:20.292456+0000","last_became_peered":"2024-08-18T22:05:20.292456+0000","last_unstale":"2024-08-18T22:07:11.523594+0000","last_undegraded":"2024-08-18T22:07:11.523594+0000","last_fullsized":"2024-08-18T22:07:11.523594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:19.525037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524433+0000","last_change":"2024-08-18T22:05:29.012439+0000","last_active":"2024-08-18T22:07:11.524433+0000","last_peered":"2024-08-18T22:07:11.524433+0000","last_clean":"2024-08-18T22:07:11.524433+0000","last_became_active":"2024-08-18T22:05:29.011860+0000","last_became_peered":"2024-08-18T22:05:29.011860+0000","last_unstale":"2024-08-18T22:07:11.524433+0000","last_undegraded":"2024-08-18T22:07:11.524433+0000","last_fullsized":"2024-08-18T22:07:11.524433+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:03.432217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522230+0000","last_change":"2024-08-18T22:05:21.855598+0000","last_active":"2024-08-18T22:07:11.522230+0000","last_peered":"2024-08-18T22:07:11.522230+0000","last_clean":"2024-08-18T22:07:11.522230+0000","last_became_active":"2024-08-18T22:05:21.855228+0000","last_became_peered":"2024-08-18T22:05:21.855228+0000","last_unstale":"2024-08-18T22:07:11.522230+0000","last_undegraded":"2024-08-18T22:07:11.522230+0000","last_fullsized":"2024-08-18T22:07:11.522230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:33.762700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527786+0000","last_change":"2024-08-18T22:05:19.844638+0000","last_active":"2024-08-18T22:07:11.527786+0000","last_peered":"2024-08-18T22:07:11.527786+0000","last_clean":"2024-08-18T22:07:11.527786+0000","last_became_active":"2024-08-18T22:05:19.844333+0000","last_became_peered":"2024-08-18T22:05:19.844333+0000","last_unstale":"2024-08-18T22:07:11.527786+0000","last_undegraded":"2024-08-18T22:07:11.527786+0000","last_fullsized":"2024-08-18T22:07:11.527786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:26.947512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570807+0000","last_change":"2024-08-18T22:05:28.919965+0000","last_active":"2024-08-18T22:07:11.570807+0000","last_peered":"2024-08-18T22:07:11.570807+0000","last_clean":"2024-08-18T22:07:11.570807+0000","last_became_active":"2024-08-18T22:05:28.919546+0000","last_became_peered":"2024-08-18T22:05:28.919546+0000","last_unstale":"2024-08-18T22:07:11.570807+0000","last_undegraded":"2024-08-18T22:07:11.570807+0000","last_fullsized":"2024-08-18T22:07:11.570807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:49.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528844+0000","last_change":"2024-08-18T22:05:21.857867+0000","last_active":"2024-08-18T22:07:11.528844+0000","last_peered":"2024-08-18T22:07:11.528844+0000","last_clean":"2024-08-18T22:07:11.528844+0000","last_became_active":"2024-08-18T22:05:21.857515+0000","last_became_peered":"2024-08-18T22:05:21.857515+0000","last_unstale":"2024-08-18T22:07:11.528844+0000","last_undegraded":"2024-08-18T22:07:11.528844+0000","last_fullsized":"2024-08-18T22:07:11.528844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:51.148321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":154,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:46.621204+0000","last_change":"2024-08-18T22:05:20.290924+0000","last_active":"2024-08-18T22:07:46.621204+0000","last_peered":"2024-08-18T22:07:46.621204+0000","last_clean":"2024-08-18T22:07:46.621204+0000","last_became_active":"2024-08-18T22:05:20.290587+0000","last_became_peered":"2024-08-18T22:05:20.290587+0000","last_unstale":"2024-08-18T22:07:46.621204+0000","last_undegraded":"2024-08-18T22:07:46.621204+0000","last_fullsized":"2024-08-18T22:07:46.621204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:35.029634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570655+0000","last_change":"2024-08-18T22:05:29.012876+0000","last_active":"2024-08-18T22:07:11.570655+0000","last_peered":"2024-08-18T22:07:11.570655+0000","last_clean":"2024-08-18T22:07:11.570655+0000","last_became_active":"2024-08-18T22:05:29.011930+0000","last_became_peered":"2024-08-18T22:05:29.011930+0000","last_unstale":"2024-08-18T22:07:11.570655+0000","last_undegraded":"2024-08-18T22:07:11.570655+0000","last_fullsized":"2024-08-18T22:07:11.570655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:22:35.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570198+0000","last_change":"2024-08-18T22:05:21.860798+0000","last_active":"2024-08-18T22:07:11.570198+0000","last_peered":"2024-08-18T22:07:11.570198+0000","last_clean":"2024-08-18T22:07:11.570198+0000","last_became_active":"2024-08-18T22:05:21.856968+0000","last_became_peered":"2024-08-18T22:05:21.856968+0000","last_unstale":"2024-08-18T22:07:11.570198+0000","last_undegraded":"2024-08-18T22:07:11.570198+0000","last_fullsized":"2024-08-18T22:07:11.570198+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:54.934400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527098+0000","last_change":"2024-08-18T22:05:19.844775+0000","last_active":"2024-08-18T22:07:11.527098+0000","last_peered":"2024-08-18T22:07:11.527098+0000","last_clean":"2024-08-18T22:07:11.527098+0000","last_became_active":"2024-08-18T22:05:19.844465+0000","last_became_peered":"2024-08-18T22:05:19.844465+0000","last_unstale":"2024-08-18T22:07:11.527098+0000","last_undegraded":"2024-08-18T22:07:11.527098+0000","last_fullsized":"2024-08-18T22:07:11.527098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.042335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528645+0000","last_change":"2024-08-18T22:05:29.013275+0000","last_active":"2024-08-18T22:07:11.528645+0000","last_peered":"2024-08-18T22:07:11.528645+0000","last_clean":"2024-08-18T22:07:11.528645+0000","last_became_active":"2024-08-18T22:05:29.012537+0000","last_became_peered":"2024-08-18T22:05:29.012537+0000","last_unstale":"2024-08-18T22:07:11.528645+0000","last_undegraded":"2024-08-18T22:07:11.528645+0000","last_fullsized":"2024-08-18T22:07:11.528645+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:15:39.775360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572574+0000","last_change":"2024-08-18T22:05:21.853358+0000","last_active":"2024-08-18T22:07:11.572574+0000","last_peered":"2024-08-18T22:07:11.572574+0000","last_clean":"2024-08-18T22:07:11.572574+0000","last_became_active":"2024-08-18T22:05:21.853071+0000","last_became_peered":"2024-08-18T22:05:21.853071+0000","last_unstale":"2024-08-18T22:07:11.572574+0000","last_undegraded":"2024-08-18T22:07:11.572574+0000","last_fullsized":"2024-08-18T22:07:11.572574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:23.755263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573411+0000","last_change":"2024-08-18T22:05:19.846922+0000","last_active":"2024-08-18T22:07:11.573411+0000","last_peered":"2024-08-18T22:07:11.573411+0000","last_clean":"2024-08-18T22:07:11.573411+0000","last_became_active":"2024-08-18T22:05:19.846619+0000","last_became_peered":"2024-08-18T22:05:19.846619+0000","last_unstale":"2024-08-18T22:07:11.573411+0000","last_undegraded":"2024-08-18T22:07:11.573411+0000","last_fullsized":"2024-08-18T22:07:11.573411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:36:16.232344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":357,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527160+0000","last_change":"2024-08-18T22:04:11.878703+0000","last_active":"2024-08-18T22:07:11.527160+0000","last_peered":"2024-08-18T22:07:11.527160+0000","last_clean":"2024-08-18T22:07:11.527160+0000","last_became_active":"2024-08-18T22:04:11.878157+0000","last_became_peered":"2024-08-18T22:04:11.878157+0000","last_unstale":"2024-08-18T22:07:11.527160+0000","last_undegraded":"2024-08-18T22:07:11.527160+0000","last_fullsized":"2024-08-18T22:07:11.527160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_clean_scrub_stamp":"2024-08-18T22:01:09.551264+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:24:07.391758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527387+0000","last_change":"2024-08-18T22:05:28.928882+0000","last_active":"2024-08-18T22:07:11.527387+0000","last_peered":"2024-08-18T22:07:11.527387+0000","last_clean":"2024-08-18T22:07:11.527387+0000","last_became_active":"2024-08-18T22:05:28.928482+0000","last_became_peered":"2024-08-18T22:05:28.928482+0000","last_unstale":"2024-08-18T22:07:11.527387+0000","last_undegraded":"2024-08-18T22:07:11.527387+0000","last_fullsized":"2024-08-18T22:07:11.527387+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:41.739482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527496+0000","last_change":"2024-08-18T22:05:21.863045+0000","last_active":"2024-08-18T22:07:11.527496+0000","last_peered":"2024-08-18T22:07:11.527496+0000","last_clean":"2024-08-18T22:07:11.527496+0000","last_became_active":"2024-08-18T22:05:21.862758+0000","last_became_peered":"2024-08-18T22:05:21.862758+0000","last_unstale":"2024-08-18T22:07:11.527496+0000","last_undegraded":"2024-08-18T22:07:11.527496+0000","last_fullsized":"2024-08-18T22:07:11.527496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:08:39.111147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531069+0000","last_change":"2024-08-18T22:05:20.291030+0000","last_active":"2024-08-18T22:07:11.531069+0000","last_peered":"2024-08-18T22:07:11.531069+0000","last_clean":"2024-08-18T22:07:11.531069+0000","last_became_active":"2024-08-18T22:05:20.290427+0000","last_became_peered":"2024-08-18T22:05:20.290427+0000","last_unstale":"2024-08-18T22:07:11.531069+0000","last_undegraded":"2024-08-18T22:07:11.531069+0000","last_fullsized":"2024-08-18T22:07:11.531069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:14:42.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528742+0000","last_change":"2024-08-18T22:05:28.923700+0000","last_active":"2024-08-18T22:07:11.528742+0000","last_peered":"2024-08-18T22:07:11.528742+0000","last_clean":"2024-08-18T22:07:11.528742+0000","last_became_active":"2024-08-18T22:05:28.923280+0000","last_became_peered":"2024-08-18T22:05:28.923280+0000","last_unstale":"2024-08-18T22:07:11.528742+0000","last_undegraded":"2024-08-18T22:07:11.528742+0000","last_fullsized":"2024-08-18T22:07:11.528742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:25:45.343542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527521+0000","last_change":"2024-08-18T22:05:21.856107+0000","last_active":"2024-08-18T22:07:11.527521+0000","last_peered":"2024-08-18T22:07:11.527521+0000","last_clean":"2024-08-18T22:07:11.527521+0000","last_became_active":"2024-08-18T22:05:21.853276+0000","last_became_peered":"2024-08-18T22:05:21.853276+0000","last_unstale":"2024-08-18T22:07:11.527521+0000","last_undegraded":"2024-08-18T22:07:11.527521+0000","last_fullsized":"2024-08-18T22:07:11.527521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:58.280375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528926+0000","last_change":"2024-08-18T22:05:19.843445+0000","last_active":"2024-08-18T22:07:11.528926+0000","last_peered":"2024-08-18T22:07:11.528926+0000","last_clean":"2024-08-18T22:07:11.528926+0000","last_became_active":"2024-08-18T22:05:19.843000+0000","last_became_peered":"2024-08-18T22:05:19.843000+0000","last_unstale":"2024-08-18T22:07:11.528926+0000","last_undegraded":"2024-08-18T22:07:11.528926+0000","last_fullsized":"2024-08-18T22:07:11.528926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:23.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623212+0000","last_change":"2024-08-18T22:06:10.515953+0000","last_active":"2024-08-18T22:07:11.623212+0000","last_peered":"2024-08-18T22:07:11.623212+0000","last_clean":"2024-08-18T22:07:11.623212+0000","last_became_active":"2024-08-18T22:06:10.515662+0000","last_became_peered":"2024-08-18T22:06:10.515662+0000","last_unstale":"2024-08-18T22:07:11.623212+0000","last_undegraded":"2024-08-18T22:07:11.623212+0000","last_fullsized":"2024-08-18T22:07:11.623212+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:43.150180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527523+0000","last_change":"2024-08-18T22:05:21.864029+0000","last_active":"2024-08-18T22:07:11.527523+0000","last_peered":"2024-08-18T22:07:11.527523+0000","last_clean":"2024-08-18T22:07:11.527523+0000","last_became_active":"2024-08-18T22:05:21.863509+0000","last_became_peered":"2024-08-18T22:05:21.863509+0000","last_unstale":"2024-08-18T22:07:11.527523+0000","last_undegraded":"2024-08-18T22:07:11.527523+0000","last_fullsized":"2024-08-18T22:07:11.527523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:42.879243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570764+0000","last_change":"2024-08-18T22:05:19.846514+0000","last_active":"2024-08-18T22:07:11.570764+0000","last_peered":"2024-08-18T22:07:11.570764+0000","last_clean":"2024-08-18T22:07:11.570764+0000","last_became_active":"2024-08-18T22:05:19.846190+0000","last_became_peered":"2024-08-18T22:05:19.846190+0000","last_unstale":"2024-08-18T22:07:11.570764+0000","last_undegraded":"2024-08-18T22:07:11.570764+0000","last_fullsized":"2024-08-18T22:07:11.570764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:49:00.317597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528349+0000","last_change":"2024-08-18T22:05:28.923183+0000","last_active":"2024-08-18T22:07:11.528349+0000","last_peered":"2024-08-18T22:07:11.528349+0000","last_clean":"2024-08-18T22:07:11.528349+0000","last_became_active":"2024-08-18T22:05:28.922809+0000","last_became_peered":"2024-08-18T22:05:28.922809+0000","last_unstale":"2024-08-18T22:07:11.528349+0000","last_undegraded":"2024-08-18T22:07:11.528349+0000","last_fullsized":"2024-08-18T22:07:11.528349+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:26.416920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526764+0000","last_change":"2024-08-18T22:05:21.849075+0000","last_active":"2024-08-18T22:07:11.526764+0000","last_peered":"2024-08-18T22:07:11.526764+0000","last_clean":"2024-08-18T22:07:11.526764+0000","last_became_active":"2024-08-18T22:05:21.848759+0000","last_became_peered":"2024-08-18T22:05:21.848759+0000","last_unstale":"2024-08-18T22:07:11.526764+0000","last_undegraded":"2024-08-18T22:07:11.526764+0000","last_fullsized":"2024-08-18T22:07:11.526764+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:26.531534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524964+0000","last_change":"2024-08-18T22:05:19.849210+0000","last_active":"2024-08-18T22:07:11.524964+0000","last_peered":"2024-08-18T22:07:11.524964+0000","last_clean":"2024-08-18T22:07:11.524964+0000","last_became_active":"2024-08-18T22:05:19.848829+0000","last_became_peered":"2024-08-18T22:05:19.848829+0000","last_unstale":"2024-08-18T22:07:11.524964+0000","last_undegraded":"2024-08-18T22:07:11.524964+0000","last_fullsized":"2024-08-18T22:07:11.524964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:19.321686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528709+0000","last_change":"2024-08-18T22:05:28.924577+0000","last_active":"2024-08-18T22:07:11.528709+0000","last_peered":"2024-08-18T22:07:11.528709+0000","last_clean":"2024-08-18T22:07:11.528709+0000","last_became_active":"2024-08-18T22:05:28.924183+0000","last_became_peered":"2024-08-18T22:05:28.924183+0000","last_unstale":"2024-08-18T22:07:11.528709+0000","last_undegraded":"2024-08-18T22:07:11.528709+0000","last_fullsized":"2024-08-18T22:07:11.528709+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:22.702757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523154+0000","last_change":"2024-08-18T22:06:10.513610+0000","last_active":"2024-08-18T22:07:11.523154+0000","last_peered":"2024-08-18T22:07:11.523154+0000","last_clean":"2024-08-18T22:07:11.523154+0000","last_became_active":"2024-08-18T22:06:10.513400+0000","last_became_peered":"2024-08-18T22:06:10.513400+0000","last_unstale":"2024-08-18T22:07:11.523154+0000","last_undegraded":"2024-08-18T22:07:11.523154+0000","last_fullsized":"2024-08-18T22:07:11.523154+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:49.275223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524463+0000","last_change":"2024-08-18T22:05:20.291752+0000","last_active":"2024-08-18T22:07:11.524463+0000","last_peered":"2024-08-18T22:07:11.524463+0000","last_clean":"2024-08-18T22:07:11.524463+0000","last_became_active":"2024-08-18T22:05:20.291431+0000","last_became_peered":"2024-08-18T22:05:20.291431+0000","last_unstale":"2024-08-18T22:07:11.524463+0000","last_undegraded":"2024-08-18T22:07:11.524463+0000","last_fullsized":"2024-08-18T22:07:11.524463+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:32.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570623+0000","last_change":"2024-08-18T22:05:28.924121+0000","last_active":"2024-08-18T22:07:11.570623+0000","last_peered":"2024-08-18T22:07:11.570623+0000","last_clean":"2024-08-18T22:07:11.570623+0000","last_became_active":"2024-08-18T22:05:28.923753+0000","last_became_peered":"2024-08-18T22:05:28.923753+0000","last_unstale":"2024-08-18T22:07:11.570623+0000","last_undegraded":"2024-08-18T22:07:11.570623+0000","last_fullsized":"2024-08-18T22:07:11.570623+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:57.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527050+0000","last_change":"2024-08-18T22:05:21.858366+0000","last_active":"2024-08-18T22:07:11.527050+0000","last_peered":"2024-08-18T22:07:11.527050+0000","last_clean":"2024-08-18T22:07:11.527050+0000","last_became_active":"2024-08-18T22:05:21.858021+0000","last_became_peered":"2024-08-18T22:05:21.858021+0000","last_unstale":"2024-08-18T22:07:11.527050+0000","last_undegraded":"2024-08-18T22:07:11.527050+0000","last_fullsized":"2024-08-18T22:07:11.527050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:55.662965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":159,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:47.623483+0000","last_change":"2024-08-18T22:05:19.850013+0000","last_active":"2024-08-18T22:07:47.623483+0000","last_peered":"2024-08-18T22:07:47.623483+0000","last_clean":"2024-08-18T22:07:47.623483+0000","last_became_active":"2024-08-18T22:05:19.849551+0000","last_became_peered":"2024-08-18T22:05:19.849551+0000","last_unstale":"2024-08-18T22:07:47.623483+0000","last_undegraded":"2024-08-18T22:07:47.623483+0000","last_fullsized":"2024-08-18T22:07:47.623483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:15.182999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523685+0000","last_change":"2024-08-18T22:05:28.927318+0000","last_active":"2024-08-18T22:07:11.523685+0000","last_peered":"2024-08-18T22:07:11.523685+0000","last_clean":"2024-08-18T22:07:11.523685+0000","last_became_active":"2024-08-18T22:05:28.926786+0000","last_became_peered":"2024-08-18T22:05:28.926786+0000","last_unstale":"2024-08-18T22:07:11.523685+0000","last_undegraded":"2024-08-18T22:07:11.523685+0000","last_fullsized":"2024-08-18T22:07:11.523685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:45.798247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527690+0000","last_change":"2024-08-18T22:06:10.511821+0000","last_active":"2024-08-18T22:07:11.527690+0000","last_peered":"2024-08-18T22:07:11.527690+0000","last_clean":"2024-08-18T22:07:11.527690+0000","last_became_active":"2024-08-18T22:06:10.511135+0000","last_became_peered":"2024-08-18T22:06:10.511135+0000","last_unstale":"2024-08-18T22:07:11.527690+0000","last_undegraded":"2024-08-18T22:07:11.527690+0000","last_fullsized":"2024-08-18T22:07:11.527690+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:07.108531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528618+0000","last_change":"2024-08-18T22:05:19.844061+0000","last_active":"2024-08-18T22:07:11.528618+0000","last_peered":"2024-08-18T22:07:11.528618+0000","last_clean":"2024-08-18T22:07:11.528618+0000","last_became_active":"2024-08-18T22:05:19.843513+0000","last_became_peered":"2024-08-18T22:05:19.843513+0000","last_unstale":"2024-08-18T22:07:11.528618+0000","last_undegraded":"2024-08-18T22:07:11.528618+0000","last_fullsized":"2024-08-18T22:07:11.528618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:53.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526996+0000","last_change":"2024-08-18T22:05:28.922986+0000","last_active":"2024-08-18T22:07:11.526996+0000","last_peered":"2024-08-18T22:07:11.526996+0000","last_clean":"2024-08-18T22:07:11.526996+0000","last_became_active":"2024-08-18T22:05:28.922322+0000","last_became_peered":"2024-08-18T22:05:28.922322+0000","last_unstale":"2024-08-18T22:07:11.526996+0000","last_undegraded":"2024-08-18T22:07:11.526996+0000","last_fullsized":"2024-08-18T22:07:11.526996+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:28.168299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570439+0000","last_change":"2024-08-18T22:05:21.853389+0000","last_active":"2024-08-18T22:07:11.570439+0000","last_peered":"2024-08-18T22:07:11.570439+0000","last_clean":"2024-08-18T22:07:11.570439+0000","last_became_active":"2024-08-18T22:05:21.853095+0000","last_became_peered":"2024-08-18T22:05:21.853095+0000","last_unstale":"2024-08-18T22:07:11.570439+0000","last_undegraded":"2024-08-18T22:07:11.570439+0000","last_fullsized":"2024-08-18T22:07:11.570439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:14.126983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531024+0000","last_change":"2024-08-18T22:05:19.846788+0000","last_active":"2024-08-18T22:07:11.531024+0000","last_peered":"2024-08-18T22:07:11.531024+0000","last_clean":"2024-08-18T22:07:11.531024+0000","last_became_active":"2024-08-18T22:05:19.846248+0000","last_became_peered":"2024-08-18T22:05:19.846248+0000","last_unstale":"2024-08-18T22:07:11.531024+0000","last_undegraded":"2024-08-18T22:07:11.531024+0000","last_fullsized":"2024-08-18T22:07:11.531024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:46.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528593+0000","last_change":"2024-08-18T22:05:28.920294+0000","last_active":"2024-08-18T22:07:11.528593+0000","last_peered":"2024-08-18T22:07:11.528593+0000","last_clean":"2024-08-18T22:07:11.528593+0000","last_became_active":"2024-08-18T22:05:28.919351+0000","last_became_peered":"2024-08-18T22:05:28.919351+0000","last_unstale":"2024-08-18T22:07:11.528593+0000","last_undegraded":"2024-08-18T22:07:11.528593+0000","last_fullsized":"2024-08-18T22:07:11.528593+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:49.425281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524875+0000","last_change":"2024-08-18T22:05:21.864529+0000","last_active":"2024-08-18T22:07:11.524875+0000","last_peered":"2024-08-18T22:07:11.524875+0000","last_clean":"2024-08-18T22:07:11.524875+0000","last_became_active":"2024-08-18T22:05:21.864062+0000","last_became_peered":"2024-08-18T22:05:21.864062+0000","last_unstale":"2024-08-18T22:07:11.524875+0000","last_undegraded":"2024-08-18T22:07:11.524875+0000","last_fullsized":"2024-08-18T22:07:11.524875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:24:49.037343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'37","reported_seq":327,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:48.675404+0000","last_change":"2024-08-18T22:06:10.522113+0000","last_active":"2024-08-18T22:07:48.675404+0000","last_peered":"2024-08-18T22:07:48.675404+0000","last_clean":"2024-08-18T22:07:48.675404+0000","last_became_active":"2024-08-18T22:06:10.514837+0000","last_became_peered":"2024-08-18T22:06:10.514837+0000","last_unstale":"2024-08-18T22:07:48.675404+0000","last_undegraded":"2024-08-18T22:07:48.675404+0000","last_fullsized":"2024-08-18T22:07:48.675404+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:46.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67447,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":228,"num_read_kb":175,"num_write":38,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523283+0000","last_change":"2024-08-18T22:05:28.926357+0000","last_active":"2024-08-18T22:07:11.523283+0000","last_peered":"2024-08-18T22:07:11.523283+0000","last_clean":"2024-08-18T22:07:11.523283+0000","last_became_active":"2024-08-18T22:05:28.926016+0000","last_became_peered":"2024-08-18T22:05:28.926016+0000","last_unstale":"2024-08-18T22:07:11.523283+0000","last_undegraded":"2024-08-18T22:07:11.523283+0000","last_fullsized":"2024-08-18T22:07:11.523283+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:16.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529123+0000","last_change":"2024-08-18T22:05:21.860237+0000","last_active":"2024-08-18T22:07:11.529123+0000","last_peered":"2024-08-18T22:07:11.529123+0000","last_clean":"2024-08-18T22:07:11.529123+0000","last_became_active":"2024-08-18T22:05:21.859919+0000","last_became_peered":"2024-08-18T22:05:21.859919+0000","last_unstale":"2024-08-18T22:07:11.529123+0000","last_undegraded":"2024-08-18T22:07:11.529123+0000","last_fullsized":"2024-08-18T22:07:11.529123+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:21.048413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528892+0000","last_change":"2024-08-18T22:05:20.291233+0000","last_active":"2024-08-18T22:07:11.528892+0000","last_peered":"2024-08-18T22:07:11.528892+0000","last_clean":"2024-08-18T22:07:11.528892+0000","last_became_active":"2024-08-18T22:05:20.290893+0000","last_became_peered":"2024-08-18T22:05:20.290893+0000","last_unstale":"2024-08-18T22:07:11.528892+0000","last_undegraded":"2024-08-18T22:07:11.528892+0000","last_fullsized":"2024-08-18T22:07:11.528892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:36.889561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573103+0000","last_change":"2024-08-18T22:05:28.923076+0000","last_active":"2024-08-18T22:07:11.573103+0000","last_peered":"2024-08-18T22:07:11.573103+0000","last_clean":"2024-08-18T22:07:11.573103+0000","last_became_active":"2024-08-18T22:05:28.922688+0000","last_became_peered":"2024-08-18T22:05:28.922688+0000","last_unstale":"2024-08-18T22:07:11.573103+0000","last_undegraded":"2024-08-18T22:07:11.573103+0000","last_fullsized":"2024-08-18T22:07:11.573103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:34.360540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623665+0000","last_change":"2024-08-18T22:05:21.855174+0000","last_active":"2024-08-18T22:07:11.623665+0000","last_peered":"2024-08-18T22:07:11.623665+0000","last_clean":"2024-08-18T22:07:11.623665+0000","last_became_active":"2024-08-18T22:05:21.854818+0000","last_became_peered":"2024-08-18T22:05:21.854818+0000","last_unstale":"2024-08-18T22:07:11.623665+0000","last_undegraded":"2024-08-18T22:07:11.623665+0000","last_fullsized":"2024-08-18T22:07:11.623665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:48:55.094624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.577365+0000","last_change":"2024-08-18T22:07:11.576894+0000","last_active":"2024-08-18T22:07:11.577365+0000","last_peered":"2024-08-18T22:07:11.577365+0000","last_clean":"2024-08-18T22:07:11.577365+0000","last_became_active":"2024-08-18T22:07:11.574159+0000","last_became_peered":"2024-08-18T22:07:11.574159+0000","last_unstale":"2024-08-18T22:07:11.577365+0000","last_undegraded":"2024-08-18T22:07:11.577365+0000","last_fullsized":"2024-08-18T22:07:11.577365+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:37.993056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523132+0000","last_change":"2024-08-18T22:05:28.921647+0000","last_active":"2024-08-18T22:07:11.523132+0000","last_peered":"2024-08-18T22:07:11.523132+0000","last_clean":"2024-08-18T22:07:11.523132+0000","last_became_active":"2024-08-18T22:05:28.921305+0000","last_became_peered":"2024-08-18T22:05:28.921305+0000","last_unstale":"2024-08-18T22:07:11.523132+0000","last_undegraded":"2024-08-18T22:07:11.523132+0000","last_fullsized":"2024-08-18T22:07:11.523132+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:29.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529467+0000","last_change":"2024-08-18T22:05:21.861151+0000","last_active":"2024-08-18T22:07:11.529467+0000","last_peered":"2024-08-18T22:07:11.529467+0000","last_clean":"2024-08-18T22:07:11.529467+0000","last_became_active":"2024-08-18T22:05:21.860834+0000","last_became_peered":"2024-08-18T22:05:21.860834+0000","last_unstale":"2024-08-18T22:07:11.529467+0000","last_undegraded":"2024-08-18T22:07:11.529467+0000","last_fullsized":"2024-08-18T22:07:11.529467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:32.890750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":154,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:47.623560+0000","last_change":"2024-08-18T22:05:19.846145+0000","last_active":"2024-08-18T22:07:47.623560+0000","last_peered":"2024-08-18T22:07:47.623560+0000","last_clean":"2024-08-18T22:07:47.623560+0000","last_became_active":"2024-08-18T22:05:19.845711+0000","last_became_peered":"2024-08-18T22:05:19.845711+0000","last_unstale":"2024-08-18T22:07:47.623560+0000","last_undegraded":"2024-08-18T22:07:47.623560+0000","last_fullsized":"2024-08-18T22:07:47.623560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:20.376131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572337+0000","last_change":"2024-08-18T22:05:28.923256+0000","last_active":"2024-08-18T22:07:11.572337+0000","last_peered":"2024-08-18T22:07:11.572337+0000","last_clean":"2024-08-18T22:07:11.572337+0000","last_became_active":"2024-08-18T22:05:28.922845+0000","last_became_peered":"2024-08-18T22:05:28.922845+0000","last_unstale":"2024-08-18T22:07:11.572337+0000","last_undegraded":"2024-08-18T22:07:11.572337+0000","last_fullsized":"2024-08-18T22:07:11.572337+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:41.930937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623447+0000","last_change":"2024-08-18T22:05:28.924743+0000","last_active":"2024-08-18T22:07:11.623447+0000","last_peered":"2024-08-18T22:07:11.623447+0000","last_clean":"2024-08-18T22:07:11.623447+0000","last_became_active":"2024-08-18T22:05:28.923674+0000","last_became_peered":"2024-08-18T22:05:28.923674+0000","last_unstale":"2024-08-18T22:07:11.623447+0000","last_undegraded":"2024-08-18T22:07:11.623447+0000","last_fullsized":"2024-08-18T22:07:11.623447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:19.834998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523308+0000","last_change":"2024-08-18T22:05:21.857194+0000","last_active":"2024-08-18T22:07:11.523308+0000","last_peered":"2024-08-18T22:07:11.523308+0000","last_clean":"2024-08-18T22:07:11.523308+0000","last_became_active":"2024-08-18T22:05:21.856916+0000","last_became_peered":"2024-08-18T22:05:21.856916+0000","last_unstale":"2024-08-18T22:07:11.523308+0000","last_undegraded":"2024-08-18T22:07:11.523308+0000","last_fullsized":"2024-08-18T22:07:11.523308+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:24.759501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529123+0000","last_change":"2024-08-18T22:05:19.844919+0000","last_active":"2024-08-18T22:07:11.529123+0000","last_peered":"2024-08-18T22:07:11.529123+0000","last_clean":"2024-08-18T22:07:11.529123+0000","last_became_active":"2024-08-18T22:05:19.844539+0000","last_became_peered":"2024-08-18T22:05:19.844539+0000","last_unstale":"2024-08-18T22:07:11.529123+0000","last_undegraded":"2024-08-18T22:07:11.529123+0000","last_fullsized":"2024-08-18T22:07:11.529123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:01.598535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526775+0000","last_change":"2024-08-18T22:05:28.923304+0000","last_active":"2024-08-18T22:07:11.526775+0000","last_peered":"2024-08-18T22:07:11.526775+0000","last_clean":"2024-08-18T22:07:11.526775+0000","last_became_active":"2024-08-18T22:05:28.922912+0000","last_became_peered":"2024-08-18T22:05:28.922912+0000","last_unstale":"2024-08-18T22:07:11.526775+0000","last_undegraded":"2024-08-18T22:07:11.526775+0000","last_fullsized":"2024-08-18T22:07:11.526775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:24:47.834354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572444+0000","last_change":"2024-08-18T22:05:21.849448+0000","last_active":"2024-08-18T22:07:11.572444+0000","last_peered":"2024-08-18T22:07:11.572444+0000","last_clean":"2024-08-18T22:07:11.572444+0000","last_became_active":"2024-08-18T22:05:21.849154+0000","last_became_peered":"2024-08-18T22:05:21.849154+0000","last_unstale":"2024-08-18T22:07:11.572444+0000","last_undegraded":"2024-08-18T22:07:11.572444+0000","last_fullsized":"2024-08-18T22:07:11.572444+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:38.583121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570212+0000","last_change":"2024-08-18T22:05:19.848483+0000","last_active":"2024-08-18T22:07:11.570212+0000","last_peered":"2024-08-18T22:07:11.570212+0000","last_clean":"2024-08-18T22:07:11.570212+0000","last_became_active":"2024-08-18T22:05:19.848190+0000","last_became_peered":"2024-08-18T22:05:19.848190+0000","last_unstale":"2024-08-18T22:07:11.570212+0000","last_undegraded":"2024-08-18T22:07:11.570212+0000","last_fullsized":"2024-08-18T22:07:11.570212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:01.719565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522263+0000","last_change":"2024-08-18T22:05:19.843796+0000","last_active":"2024-08-18T22:07:11.522263+0000","last_peered":"2024-08-18T22:07:11.522263+0000","last_clean":"2024-08-18T22:07:11.522263+0000","last_became_active":"2024-08-18T22:05:19.843495+0000","last_became_peered":"2024-08-18T22:05:19.843495+0000","last_unstale":"2024-08-18T22:07:11.522263+0000","last_undegraded":"2024-08-18T22:07:11.522263+0000","last_fullsized":"2024-08-18T22:07:11.522263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:21.583561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528701+0000","last_change":"2024-08-18T22:05:21.856370+0000","last_active":"2024-08-18T22:07:11.528701+0000","last_peered":"2024-08-18T22:07:11.528701+0000","last_clean":"2024-08-18T22:07:11.528701+0000","last_became_active":"2024-08-18T22:05:21.855954+0000","last_became_peered":"2024-08-18T22:05:21.855954+0000","last_unstale":"2024-08-18T22:07:11.528701+0000","last_undegraded":"2024-08-18T22:07:11.528701+0000","last_fullsized":"2024-08-18T22:07:11.528701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:30.828305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530403+0000","last_change":"2024-08-18T22:06:10.516344+0000","last_active":"2024-08-18T22:07:11.530403+0000","last_peered":"2024-08-18T22:07:11.530403+0000","last_clean":"2024-08-18T22:07:11.530403+0000","last_became_active":"2024-08-18T22:06:10.515925+0000","last_became_peered":"2024-08-18T22:06:10.515925+0000","last_unstale":"2024-08-18T22:07:11.530403+0000","last_undegraded":"2024-08-18T22:07:11.530403+0000","last_fullsized":"2024-08-18T22:07:11.530403+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:41:07.585521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":156,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:43.618096+0000","last_change":"2024-08-18T22:05:19.846860+0000","last_active":"2024-08-18T22:07:43.618096+0000","last_peered":"2024-08-18T22:07:43.618096+0000","last_clean":"2024-08-18T22:07:43.618096+0000","last_became_active":"2024-08-18T22:05:19.846496+0000","last_became_peered":"2024-08-18T22:05:19.846496+0000","last_unstale":"2024-08-18T22:07:43.618096+0000","last_undegraded":"2024-08-18T22:07:43.618096+0000","last_fullsized":"2024-08-18T22:07:43.618096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:16.555137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524444+0000","last_change":"2024-08-18T22:05:21.849058+0000","last_active":"2024-08-18T22:07:11.524444+0000","last_peered":"2024-08-18T22:07:11.524444+0000","last_clean":"2024-08-18T22:07:11.524444+0000","last_became_active":"2024-08-18T22:05:21.848703+0000","last_became_peered":"2024-08-18T22:05:21.848703+0000","last_unstale":"2024-08-18T22:07:11.524444+0000","last_undegraded":"2024-08-18T22:07:11.524444+0000","last_fullsized":"2024-08-18T22:07:11.524444+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:10.024156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530967+0000","last_change":"2024-08-18T22:05:28.922968+0000","last_active":"2024-08-18T22:07:11.530967+0000","last_peered":"2024-08-18T22:07:11.530967+0000","last_clean":"2024-08-18T22:07:11.530967+0000","last_became_active":"2024-08-18T22:05:28.922378+0000","last_became_peered":"2024-08-18T22:05:28.922378+0000","last_unstale":"2024-08-18T22:07:11.530967+0000","last_undegraded":"2024-08-18T22:07:11.530967+0000","last_fullsized":"2024-08-18T22:07:11.530967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:23:07.241028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526268+0000","last_change":"2024-08-18T22:05:21.858572+0000","last_active":"2024-08-18T22:07:11.526268+0000","last_peered":"2024-08-18T22:07:11.526268+0000","last_clean":"2024-08-18T22:07:11.526268+0000","last_became_active":"2024-08-18T22:05:21.858254+0000","last_became_peered":"2024-08-18T22:05:21.858254+0000","last_unstale":"2024-08-18T22:07:11.526268+0000","last_undegraded":"2024-08-18T22:07:11.526268+0000","last_fullsized":"2024-08-18T22:07:11.526268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:52.456087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531122+0000","last_change":"2024-08-18T22:05:21.856710+0000","last_active":"2024-08-18T22:07:11.531122+0000","last_peered":"2024-08-18T22:07:11.531122+0000","last_clean":"2024-08-18T22:07:11.531122+0000","last_became_active":"2024-08-18T22:05:21.855399+0000","last_became_peered":"2024-08-18T22:05:21.855399+0000","last_unstale":"2024-08-18T22:07:11.531122+0000","last_undegraded":"2024-08-18T22:07:11.531122+0000","last_fullsized":"2024-08-18T22:07:11.531122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:36.039953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530382+0000","last_change":"2024-08-18T22:05:21.856085+0000","last_active":"2024-08-18T22:07:11.530382+0000","last_peered":"2024-08-18T22:07:11.530382+0000","last_clean":"2024-08-18T22:07:11.530382+0000","last_became_active":"2024-08-18T22:05:21.855263+0000","last_became_peered":"2024-08-18T22:05:21.855263+0000","last_unstale":"2024-08-18T22:07:11.530382+0000","last_undegraded":"2024-08-18T22:07:11.530382+0000","last_fullsized":"2024-08-18T22:07:11.530382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:31.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623250+0000","last_change":"2024-08-18T22:05:21.855385+0000","last_active":"2024-08-18T22:07:11.623250+0000","last_peered":"2024-08-18T22:07:11.623250+0000","last_clean":"2024-08-18T22:07:11.623250+0000","last_became_active":"2024-08-18T22:05:21.854829+0000","last_became_peered":"2024-08-18T22:05:21.854829+0000","last_unstale":"2024-08-18T22:07:11.623250+0000","last_undegraded":"2024-08-18T22:07:11.623250+0000","last_fullsized":"2024-08-18T22:07:11.623250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:59.704154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570888+0000","last_change":"2024-08-18T22:06:10.510370+0000","last_active":"2024-08-18T22:07:11.570888+0000","last_peered":"2024-08-18T22:07:11.570888+0000","last_clean":"2024-08-18T22:07:11.570888+0000","last_became_active":"2024-08-18T22:06:10.509829+0000","last_became_peered":"2024-08-18T22:06:10.509829+0000","last_unstale":"2024-08-18T22:07:11.570888+0000","last_undegraded":"2024-08-18T22:07:11.570888+0000","last_fullsized":"2024-08-18T22:07:11.570888+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:20.171834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526688+0000","last_change":"2024-08-18T22:05:21.856137+0000","last_active":"2024-08-18T22:07:11.526688+0000","last_peered":"2024-08-18T22:07:11.526688+0000","last_clean":"2024-08-18T22:07:11.526688+0000","last_became_active":"2024-08-18T22:05:21.855425+0000","last_became_peered":"2024-08-18T22:05:21.855425+0000","last_unstale":"2024-08-18T22:07:11.526688+0000","last_undegraded":"2024-08-18T22:07:11.526688+0000","last_fullsized":"2024-08-18T22:07:11.526688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:37.514710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531196+0000","last_change":"2024-08-18T22:05:21.856084+0000","last_active":"2024-08-18T22:07:11.531196+0000","last_peered":"2024-08-18T22:07:11.531196+0000","last_clean":"2024-08-18T22:07:11.531196+0000","last_became_active":"2024-08-18T22:05:21.855779+0000","last_became_peered":"2024-08-18T22:05:21.855779+0000","last_unstale":"2024-08-18T22:07:11.531196+0000","last_undegraded":"2024-08-18T22:07:11.531196+0000","last_fullsized":"2024-08-18T22:07:11.531196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:02:47.833634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572883+0000","last_change":"2024-08-18T22:05:21.856729+0000","last_active":"2024-08-18T22:07:11.572883+0000","last_peered":"2024-08-18T22:07:11.572883+0000","last_clean":"2024-08-18T22:07:11.572883+0000","last_became_active":"2024-08-18T22:05:21.856446+0000","last_became_peered":"2024-08-18T22:05:21.856446+0000","last_unstale":"2024-08-18T22:07:11.572883+0000","last_undegraded":"2024-08-18T22:07:11.572883+0000","last_fullsized":"2024-08-18T22:07:11.572883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.482225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528910+0000","last_change":"2024-08-18T22:05:21.851772+0000","last_active":"2024-08-18T22:07:11.528910+0000","last_peered":"2024-08-18T22:07:11.528910+0000","last_clean":"2024-08-18T22:07:11.528910+0000","last_became_active":"2024-08-18T22:05:21.851417+0000","last_became_peered":"2024-08-18T22:05:21.851417+0000","last_unstale":"2024-08-18T22:07:11.528910+0000","last_undegraded":"2024-08-18T22:07:11.528910+0000","last_fullsized":"2024-08-18T22:07:11.528910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:32.509318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572470+0000","last_change":"2024-08-18T22:05:21.857887+0000","last_active":"2024-08-18T22:07:11.572470+0000","last_peered":"2024-08-18T22:07:11.572470+0000","last_clean":"2024-08-18T22:07:11.572470+0000","last_became_active":"2024-08-18T22:05:21.857585+0000","last_became_peered":"2024-08-18T22:05:21.857585+0000","last_unstale":"2024-08-18T22:07:11.572470+0000","last_undegraded":"2024-08-18T22:07:11.572470+0000","last_fullsized":"2024-08-18T22:07:11.572470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:23.299033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528948+0000","last_change":"2024-08-18T22:05:21.854626+0000","last_active":"2024-08-18T22:07:11.528948+0000","last_peered":"2024-08-18T22:07:11.528948+0000","last_clean":"2024-08-18T22:07:11.528948+0000","last_became_active":"2024-08-18T22:05:21.854290+0000","last_became_peered":"2024-08-18T22:05:21.854290+0000","last_unstale":"2024-08-18T22:07:11.528948+0000","last_undegraded":"2024-08-18T22:07:11.528948+0000","last_fullsized":"2024-08-18T22:07:11.528948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:45:24.988669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570558+0000","last_change":"2024-08-18T22:05:21.865863+0000","last_active":"2024-08-18T22:07:11.570558+0000","last_peered":"2024-08-18T22:07:11.570558+0000","last_clean":"2024-08-18T22:07:11.570558+0000","last_became_active":"2024-08-18T22:05:21.864634+0000","last_became_peered":"2024-08-18T22:05:21.864634+0000","last_unstale":"2024-08-18T22:07:11.570558+0000","last_undegraded":"2024-08-18T22:07:11.570558+0000","last_fullsized":"2024-08-18T22:07:11.570558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:34.051147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527095+0000","last_change":"2024-08-18T22:05:21.860193+0000","last_active":"2024-08-18T22:07:11.527095+0000","last_peered":"2024-08-18T22:07:11.527095+0000","last_clean":"2024-08-18T22:07:11.527095+0000","last_became_active":"2024-08-18T22:05:21.859761+0000","last_became_peered":"2024-08-18T22:05:21.859761+0000","last_unstale":"2024-08-18T22:07:11.527095+0000","last_undegraded":"2024-08-18T22:07:11.527095+0000","last_fullsized":"2024-08-18T22:07:11.527095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:18.465913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531192+0000","last_change":"2024-08-18T22:05:21.860569+0000","last_active":"2024-08-18T22:07:11.531192+0000","last_peered":"2024-08-18T22:07:11.531192+0000","last_clean":"2024-08-18T22:07:11.531192+0000","last_became_active":"2024-08-18T22:05:21.860250+0000","last_became_peered":"2024-08-18T22:05:21.860250+0000","last_unstale":"2024-08-18T22:07:11.531192+0000","last_undegraded":"2024-08-18T22:07:11.531192+0000","last_fullsized":"2024-08-18T22:07:11.531192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:52.097840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523697+0000","last_change":"2024-08-18T22:05:21.858271+0000","last_active":"2024-08-18T22:07:11.523697+0000","last_peered":"2024-08-18T22:07:11.523697+0000","last_clean":"2024-08-18T22:07:11.523697+0000","last_became_active":"2024-08-18T22:05:21.857968+0000","last_became_peered":"2024-08-18T22:05:21.857968+0000","last_unstale":"2024-08-18T22:07:11.523697+0000","last_undegraded":"2024-08-18T22:07:11.523697+0000","last_fullsized":"2024-08-18T22:07:11.523697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:24.023136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526949+0000","last_change":"2024-08-18T22:05:21.853799+0000","last_active":"2024-08-18T22:07:11.526949+0000","last_peered":"2024-08-18T22:07:11.526949+0000","last_clean":"2024-08-18T22:07:11.526949+0000","last_became_active":"2024-08-18T22:05:21.853432+0000","last_became_peered":"2024-08-18T22:05:21.853432+0000","last_unstale":"2024-08-18T22:07:11.526949+0000","last_undegraded":"2024-08-18T22:07:11.526949+0000","last_fullsized":"2024-08-18T22:07:11.526949+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:07.429169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528548+0000","last_change":"2024-08-18T22:05:21.855117+0000","last_active":"2024-08-18T22:07:11.528548+0000","last_peered":"2024-08-18T22:07:11.528548+0000","last_clean":"2024-08-18T22:07:11.528548+0000","last_became_active":"2024-08-18T22:05:21.854041+0000","last_became_peered":"2024-08-18T22:05:21.854041+0000","last_unstale":"2024-08-18T22:07:11.528548+0000","last_undegraded":"2024-08-18T22:07:11.528548+0000","last_fullsized":"2024-08-18T22:07:11.528548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:17.222658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623177+0000","last_change":"2024-08-18T22:05:21.861745+0000","last_active":"2024-08-18T22:07:11.623177+0000","last_peered":"2024-08-18T22:07:11.623177+0000","last_clean":"2024-08-18T22:07:11.623177+0000","last_became_active":"2024-08-18T22:05:21.861427+0000","last_became_peered":"2024-08-18T22:05:21.861427+0000","last_unstale":"2024-08-18T22:07:11.623177+0000","last_undegraded":"2024-08-18T22:07:11.623177+0000","last_fullsized":"2024-08-18T22:07:11.623177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:17.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623245+0000","last_change":"2024-08-18T22:05:21.860046+0000","last_active":"2024-08-18T22:07:11.623245+0000","last_peered":"2024-08-18T22:07:11.623245+0000","last_clean":"2024-08-18T22:07:11.623245+0000","last_became_active":"2024-08-18T22:05:21.859674+0000","last_became_peered":"2024-08-18T22:05:21.859674+0000","last_unstale":"2024-08-18T22:07:11.623245+0000","last_undegraded":"2024-08-18T22:07:11.623245+0000","last_fullsized":"2024-08-18T22:07:11.623245+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:44.615270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570548+0000","last_change":"2024-08-18T22:05:21.847647+0000","last_active":"2024-08-18T22:07:11.570548+0000","last_peered":"2024-08-18T22:07:11.570548+0000","last_clean":"2024-08-18T22:07:11.570548+0000","last_became_active":"2024-08-18T22:05:21.847367+0000","last_became_peered":"2024-08-18T22:05:21.847367+0000","last_unstale":"2024-08-18T22:07:11.570548+0000","last_undegraded":"2024-08-18T22:07:11.570548+0000","last_fullsized":"2024-08-18T22:07:11.570548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:33.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573513+0000","last_change":"2024-08-18T22:05:21.861326+0000","last_active":"2024-08-18T22:07:11.573513+0000","last_peered":"2024-08-18T22:07:11.573513+0000","last_clean":"2024-08-18T22:07:11.573513+0000","last_became_active":"2024-08-18T22:05:21.860968+0000","last_became_peered":"2024-08-18T22:05:21.860968+0000","last_unstale":"2024-08-18T22:07:11.573513+0000","last_undegraded":"2024-08-18T22:07:11.573513+0000","last_fullsized":"2024-08-18T22:07:11.573513+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:49.150670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527404+0000","last_change":"2024-08-18T22:05:21.852618+0000","last_active":"2024-08-18T22:07:11.527404+0000","last_peered":"2024-08-18T22:07:11.527404+0000","last_clean":"2024-08-18T22:07:11.527404+0000","last_became_active":"2024-08-18T22:05:21.852318+0000","last_became_peered":"2024-08-18T22:05:21.852318+0000","last_unstale":"2024-08-18T22:07:11.527404+0000","last_undegraded":"2024-08-18T22:07:11.527404+0000","last_fullsized":"2024-08-18T22:07:11.527404+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:06:49.085150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522585+0000","last_change":"2024-08-18T22:05:21.860108+0000","last_active":"2024-08-18T22:07:11.522585+0000","last_peered":"2024-08-18T22:07:11.522585+0000","last_clean":"2024-08-18T22:07:11.522585+0000","last_became_active":"2024-08-18T22:05:21.859794+0000","last_became_peered":"2024-08-18T22:05:21.859794+0000","last_unstale":"2024-08-18T22:07:11.522585+0000","last_undegraded":"2024-08-18T22:07:11.522585+0000","last_fullsized":"2024-08-18T22:07:11.522585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:01.974202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529519+0000","last_change":"2024-08-18T22:05:21.856404+0000","last_active":"2024-08-18T22:07:11.529519+0000","last_peered":"2024-08-18T22:07:11.529519+0000","last_clean":"2024-08-18T22:07:11.529519+0000","last_became_active":"2024-08-18T22:05:21.855800+0000","last_became_peered":"2024-08-18T22:05:21.855800+0000","last_unstale":"2024-08-18T22:07:11.529519+0000","last_undegraded":"2024-08-18T22:07:11.529519+0000","last_fullsized":"2024-08-18T22:07:11.529519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:09.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572303+0000","last_change":"2024-08-18T22:05:21.859891+0000","last_active":"2024-08-18T22:07:11.572303+0000","last_peered":"2024-08-18T22:07:11.572303+0000","last_clean":"2024-08-18T22:07:11.572303+0000","last_became_active":"2024-08-18T22:05:21.859407+0000","last_became_peered":"2024-08-18T22:05:21.859407+0000","last_unstale":"2024-08-18T22:07:11.572303+0000","last_undegraded":"2024-08-18T22:07:11.572303+0000","last_fullsized":"2024-08-18T22:07:11.572303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:59.285627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527004+0000","last_change":"2024-08-18T22:05:21.856428+0000","last_active":"2024-08-18T22:07:11.527004+0000","last_peered":"2024-08-18T22:07:11.527004+0000","last_clean":"2024-08-18T22:07:11.527004+0000","last_became_active":"2024-08-18T22:05:21.853374+0000","last_became_peered":"2024-08-18T22:05:21.853374+0000","last_unstale":"2024-08-18T22:07:11.527004+0000","last_undegraded":"2024-08-18T22:07:11.527004+0000","last_fullsized":"2024-08-18T22:07:11.527004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:07.087171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522013+0000","last_change":"2024-08-18T22:05:21.852688+0000","last_active":"2024-08-18T22:07:11.522013+0000","last_peered":"2024-08-18T22:07:11.522013+0000","last_clean":"2024-08-18T22:07:11.522013+0000","last_became_active":"2024-08-18T22:05:21.851107+0000","last_became_peered":"2024-08-18T22:05:21.851107+0000","last_unstale":"2024-08-18T22:07:11.522013+0000","last_undegraded":"2024-08-18T22:07:11.522013+0000","last_fullsized":"2024-08-18T22:07:11.522013+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:48.267166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524546+0000","last_change":"2024-08-18T22:05:21.850809+0000","last_active":"2024-08-18T22:07:11.524546+0000","last_peered":"2024-08-18T22:07:11.524546+0000","last_clean":"2024-08-18T22:07:11.524546+0000","last_became_active":"2024-08-18T22:05:21.850510+0000","last_became_peered":"2024-08-18T22:05:21.850510+0000","last_unstale":"2024-08-18T22:07:11.524546+0000","last_undegraded":"2024-08-18T22:07:11.524546+0000","last_fullsized":"2024-08-18T22:07:11.524546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:39.338051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573466+0000","last_change":"2024-08-18T22:05:21.856156+0000","last_active":"2024-08-18T22:07:11.573466+0000","last_peered":"2024-08-18T22:07:11.573466+0000","last_clean":"2024-08-18T22:07:11.573466+0000","last_became_active":"2024-08-18T22:05:21.855830+0000","last_became_peered":"2024-08-18T22:05:21.855830+0000","last_unstale":"2024-08-18T22:07:11.573466+0000","last_undegraded":"2024-08-18T22:07:11.573466+0000","last_fullsized":"2024-08-18T22:07:11.573466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:10.670405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623466+0000","last_change":"2024-08-18T22:05:21.865162+0000","last_active":"2024-08-18T22:07:11.623466+0000","last_peered":"2024-08-18T22:07:11.623466+0000","last_clean":"2024-08-18T22:07:11.623466+0000","last_became_active":"2024-08-18T22:05:21.864842+0000","last_became_peered":"2024-08-18T22:05:21.864842+0000","last_unstale":"2024-08-18T22:07:11.623466+0000","last_undegraded":"2024-08-18T22:07:11.623466+0000","last_fullsized":"2024-08-18T22:07:11.623466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:21.388638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623496+0000","last_change":"2024-08-18T22:05:21.859227+0000","last_active":"2024-08-18T22:07:11.623496+0000","last_peered":"2024-08-18T22:07:11.623496+0000","last_clean":"2024-08-18T22:07:11.623496+0000","last_became_active":"2024-08-18T22:05:21.858886+0000","last_became_peered":"2024-08-18T22:05:21.858886+0000","last_unstale":"2024-08-18T22:07:11.623496+0000","last_undegraded":"2024-08-18T22:07:11.623496+0000","last_fullsized":"2024-08-18T22:07:11.623496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:08.710772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526871+0000","last_change":"2024-08-18T22:05:21.854864+0000","last_active":"2024-08-18T22:07:11.526871+0000","last_peered":"2024-08-18T22:07:11.526871+0000","last_clean":"2024-08-18T22:07:11.526871+0000","last_became_active":"2024-08-18T22:05:21.854522+0000","last_became_peered":"2024-08-18T22:05:21.854522+0000","last_unstale":"2024-08-18T22:07:11.526871+0000","last_undegraded":"2024-08-18T22:07:11.526871+0000","last_fullsized":"2024-08-18T22:07:11.526871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:32.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72119,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":687,"num_read_kb":416,"num_write":180,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":216357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514537,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1052672,"data_stored":523218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743472,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37048,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708104,"statfs":{"total":95995035648,"available":95957098496,"internally_reserved":0,"allocated":1753088,"data_stored":1182560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906996,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":523454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168633,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1069056,"data_stored":523374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397564,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36968,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708184,"statfs":{"total":95995035648,"available":95957180416,"internally_reserved":0,"allocated":1662976,"data_stored":1119954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561090,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":518630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790021,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28656,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716496,"statfs":{"total":95995035648,"available":95965691904,"internally_reserved":0,"allocated":1671168,"data_stored":1115011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953547,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36448,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708704,"statfs":{"total":95995035648,"available":95957712896,"internally_reserved":0,"allocated":1138688,"data_stored":591258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1060864,"data_stored":518824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":520421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":585987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1073152,"data_stored":520018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:07:50.293 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-08-18T22:07:50.293 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:07:50.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.426+0000 7ff96d2fc640 1 -- 172.21.15.123:0/717995131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff968102310 msgr2=0x7ff968108ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.426+0000 7ff96d2fc640 1 --2- 172.21.15.123:0/717995131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff968102310 0x7ff968108ba0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff960009ca0 tx=0x7ff96002a8c0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.426+0000 7ff96d2fc640 1 -- 172.21.15.123:0/717995131 shutdown_connections 2024-08-18T22:07:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.426+0000 7ff96d2fc640 1 --2- 172.21.15.123:0/717995131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff968102310 0x7ff968108ba0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.426+0000 7ff96d2fc640 1 --2- 172.21.15.123:0/717995131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff968101950 0x7ff968101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.426+0000 7ff96d2fc640 1 --2- 172.21.15.123:0/717995131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff968100760 0x7ff968100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.426+0000 7ff96d2fc640 1 -- 172.21.15.123:0/717995131 >> 172.21.15.123:0/717995131 conn(0x7ff9680fbee0 msgr2=0x7ff9680fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.426+0000 7ff96d2fc640 1 -- 172.21.15.123:0/717995131 shutdown_connections 2024-08-18T22:07:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.426+0000 7ff96d2fc640 1 -- 172.21.15.123:0/717995131 wait complete. 2024-08-18T22:07:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.426+0000 7ff96d2fc640 1 Processor -- start 2024-08-18T22:07:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff96d2fc640 1 -- start start 2024-08-18T22:07:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff96d2fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff968100760 0x7ff968196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff96d2fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff968101950 0x7ff968196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff96d2fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff968102310 0x7ff96819e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff96d2fc640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff96810c3e0 con 0x7ff968101950 2024-08-18T22:07:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff96d2fc640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff96810c260 con 0x7ff968100760 2024-08-18T22:07:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff96d2fc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff96810c560 con 0x7ff968102310 2024-08-18T22:07:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff95e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff968101950 0x7ff968196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff95e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff968101950 0x7ff968196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47696/0 (socket says 172.21.15.123:47696) 2024-08-18T22:07:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff95e7fc640 1 -- 172.21.15.123:0/3779760548 learned_addr learned my addr 172.21.15.123:0/3779760548 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff9677fe640 1 --2- 172.21.15.123:0/3779760548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff968102310 0x7ff96819e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff966ffd640 1 --2- 172.21.15.123:0/3779760548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff968100760 0x7ff968196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff95e7fc640 1 -- 172.21.15.123:0/3779760548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff968102310 msgr2=0x7ff96819e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff95e7fc640 1 --2- 172.21.15.123:0/3779760548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff968102310 0x7ff96819e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff95e7fc640 1 -- 172.21.15.123:0/3779760548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff968100760 msgr2=0x7ff968196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff95e7fc640 1 --2- 172.21.15.123:0/3779760548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff968100760 0x7ff968196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.427+0000 7ff95e7fc640 1 -- 172.21.15.123:0/3779760548 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96819e6b0 con 0x7ff968101950 2024-08-18T22:07:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.428+0000 7ff95e7fc640 1 --2- 172.21.15.123:0/3779760548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff968101950 0x7ff968196fd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff95000d770 tx=0x7ff95000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.428+0000 7ff964ff9640 1 -- 172.21.15.123:0/3779760548 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff950017070 con 0x7ff968101950 2024-08-18T22:07:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.428+0000 7ff964ff9640 1 -- 172.21.15.123:0/3779760548 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff950005500 con 0x7ff968101950 2024-08-18T22:07:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.428+0000 7ff96d2fc640 1 -- 172.21.15.123:0/3779760548 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff96819e9a0 con 0x7ff968101950 2024-08-18T22:07:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.428+0000 7ff964ff9640 1 -- 172.21.15.123:0/3779760548 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff950004e00 con 0x7ff968101950 2024-08-18T22:07:50.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.428+0000 7ff96d2fc640 1 -- 172.21.15.123:0/3779760548 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff96819eef0 con 0x7ff968101950 2024-08-18T22:07:50.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.429+0000 7ff96d2fc640 1 -- 172.21.15.123:0/3779760548 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff968107ba0 con 0x7ff968101950 2024-08-18T22:07:50.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.430+0000 7ff964ff9640 1 -- 172.21.15.123:0/3779760548 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7ff950004fa0 con 0x7ff968101950 2024-08-18T22:07:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.431+0000 7ff964ff9640 1 --2- 172.21.15.123:0/3779760548 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9540a2c10 0x7ff9540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.431+0000 7ff966ffd640 1 --2- 172.21.15.123:0/3779760548 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9540a2c10 0x7ff9540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.431+0000 7ff964ff9640 1 -- 172.21.15.123:0/3779760548 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ff9500ceda0 con 0x7ff968101950 2024-08-18T22:07:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.431+0000 7ff966ffd640 1 --2- 172.21.15.123:0/3779760548 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9540a2c10 0x7ff9540a50d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff9681017b0 tx=0x7ff958005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:50.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.435+0000 7ff964ff9640 1 -- 172.21.15.123:0/3779760548 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff95009b970 con 0x7ff968101950 2024-08-18T22:07:50.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.600+0000 7ff96d2fc640 1 -- 172.21.15.123:0/3779760548 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff968062360 con 0x7ff9540a2c10 2024-08-18T22:07:50.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.607+0000 7ff964ff9640 1 -- 172.21.15.123:0/3779760548 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340502 (secure 0 0 0) 0x7ff968062360 con 0x7ff9540a2c10 2024-08-18T22:07:50.613 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:50.615 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-08-18T22:07:50.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.611+0000 7ff96d2fc640 1 -- 172.21.15.123:0/3779760548 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9540a2c10 msgr2=0x7ff9540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:50.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.611+0000 7ff96d2fc640 1 --2- 172.21.15.123:0/3779760548 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9540a2c10 0x7ff9540a50d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff9681017b0 tx=0x7ff958005f90 comp rx=0 tx=0).stop 2024-08-18T22:07:50.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.611+0000 7ff96d2fc640 1 -- 172.21.15.123:0/3779760548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff968101950 msgr2=0x7ff968196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:50.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.611+0000 7ff96d2fc640 1 --2- 172.21.15.123:0/3779760548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff968101950 0x7ff968196fd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff95000d770 tx=0x7ff95000dc30 comp rx=0 tx=0).stop 2024-08-18T22:07:50.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.611+0000 7ff96d2fc640 1 -- 172.21.15.123:0/3779760548 shutdown_connections 2024-08-18T22:07:50.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.611+0000 7ff96d2fc640 1 --2- 172.21.15.123:0/3779760548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff968102310 0x7ff96819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.611+0000 7ff96d2fc640 1 --2- 172.21.15.123:0/3779760548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff968101950 0x7ff968196fd0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.611+0000 7ff96d2fc640 1 --2- 172.21.15.123:0/3779760548 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9540a2c10 0x7ff9540a50d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.611+0000 7ff96d2fc640 1 --2- 172.21.15.123:0/3779760548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff968100760 0x7ff968196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:50.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.611+0000 7ff96d2fc640 1 -- 172.21.15.123:0/3779760548 >> 172.21.15.123:0/3779760548 conn(0x7ff9680fbee0 msgr2=0x7ff968104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:50.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.611+0000 7ff96d2fc640 1 -- 172.21.15.123:0/3779760548 shutdown_connections 2024-08-18T22:07:50.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:50.611+0000 7ff96d2fc640 1 -- 172.21.15.123:0/3779760548 wait complete. 2024-08-18T22:07:50.622 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:50 smithi123 ceph-mon[18462]: pgmap v342: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-18T22:07:50.622 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:50 smithi123 ceph-mon[18462]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:50.622 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:50 smithi123 ceph-mon[18462]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:50.623 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-08-18T22:07:49.373563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662721,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":813,"num_read_kb":525,"num_write":363,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1229945,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":793,"ondisk_log_size":793,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388624,"kb_used_data":14444,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553200,"statfs":{"total":1151940427776,"available":1151542476800,"internally_reserved":0,"allocated":14790656,"data_stored":8242709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":52,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003269"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523825+0000","last_change":"2024-08-18T22:05:19.844674+0000","last_active":"2024-08-18T22:07:11.523825+0000","last_peered":"2024-08-18T22:07:11.523825+0000","last_clean":"2024-08-18T22:07:11.523825+0000","last_became_active":"2024-08-18T22:05:19.844381+0000","last_became_peered":"2024-08-18T22:05:19.844381+0000","last_unstale":"2024-08-18T22:07:11.523825+0000","last_undegraded":"2024-08-18T22:07:11.523825+0000","last_fullsized":"2024-08-18T22:07:11.523825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:58.783222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572759+0000","last_change":"2024-08-18T22:05:21.859013+0000","last_active":"2024-08-18T22:07:11.572759+0000","last_peered":"2024-08-18T22:07:11.572759+0000","last_clean":"2024-08-18T22:07:11.572759+0000","last_became_active":"2024-08-18T22:05:21.858709+0000","last_became_peered":"2024-08-18T22:05:21.858709+0000","last_unstale":"2024-08-18T22:07:11.572759+0000","last_undegraded":"2024-08-18T22:07:11.572759+0000","last_fullsized":"2024-08-18T22:07:11.572759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:34.272340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530547+0000","last_change":"2024-08-18T22:05:28.925735+0000","last_active":"2024-08-18T22:07:11.530547+0000","last_peered":"2024-08-18T22:07:11.530547+0000","last_clean":"2024-08-18T22:07:11.530547+0000","last_became_active":"2024-08-18T22:05:28.925324+0000","last_became_peered":"2024-08-18T22:05:28.925324+0000","last_unstale":"2024-08-18T22:07:11.530547+0000","last_undegraded":"2024-08-18T22:07:11.530547+0000","last_fullsized":"2024-08-18T22:07:11.530547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:15:58.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572915+0000","last_change":"2024-08-18T22:05:20.290861+0000","last_active":"2024-08-18T22:07:11.572915+0000","last_peered":"2024-08-18T22:07:11.572915+0000","last_clean":"2024-08-18T22:07:11.572915+0000","last_became_active":"2024-08-18T22:05:20.290508+0000","last_became_peered":"2024-08-18T22:05:20.290508+0000","last_unstale":"2024-08-18T22:07:11.572915+0000","last_undegraded":"2024-08-18T22:07:11.572915+0000","last_fullsized":"2024-08-18T22:07:11.572915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:21.462206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623639+0000","last_change":"2024-08-18T22:05:21.863441+0000","last_active":"2024-08-18T22:07:11.623639+0000","last_peered":"2024-08-18T22:07:11.623639+0000","last_clean":"2024-08-18T22:07:11.623639+0000","last_became_active":"2024-08-18T22:05:21.863121+0000","last_became_peered":"2024-08-18T22:05:21.863121+0000","last_unstale":"2024-08-18T22:07:11.623639+0000","last_undegraded":"2024-08-18T22:07:11.623639+0000","last_fullsized":"2024-08-18T22:07:11.623639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:47.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572680+0000","last_change":"2024-08-18T22:05:28.925477+0000","last_active":"2024-08-18T22:07:11.572680+0000","last_peered":"2024-08-18T22:07:11.572680+0000","last_clean":"2024-08-18T22:07:11.572680+0000","last_became_active":"2024-08-18T22:05:28.924922+0000","last_became_peered":"2024-08-18T22:05:28.924922+0000","last_unstale":"2024-08-18T22:07:11.572680+0000","last_undegraded":"2024-08-18T22:07:11.572680+0000","last_fullsized":"2024-08-18T22:07:11.572680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:35.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524930+0000","last_change":"2024-08-18T22:05:19.847979+0000","last_active":"2024-08-18T22:07:11.524930+0000","last_peered":"2024-08-18T22:07:11.524930+0000","last_clean":"2024-08-18T22:07:11.524930+0000","last_became_active":"2024-08-18T22:05:19.847643+0000","last_became_peered":"2024-08-18T22:05:19.847643+0000","last_unstale":"2024-08-18T22:07:11.524930+0000","last_undegraded":"2024-08-18T22:07:11.524930+0000","last_fullsized":"2024-08-18T22:07:11.524930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:33.875378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528910+0000","last_change":"2024-08-18T22:05:21.860225+0000","last_active":"2024-08-18T22:07:11.528910+0000","last_peered":"2024-08-18T22:07:11.528910+0000","last_clean":"2024-08-18T22:07:11.528910+0000","last_became_active":"2024-08-18T22:05:21.859889+0000","last_became_peered":"2024-08-18T22:05:21.859889+0000","last_unstale":"2024-08-18T22:07:11.528910+0000","last_undegraded":"2024-08-18T22:07:11.528910+0000","last_fullsized":"2024-08-18T22:07:11.528910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:06:27.084401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573134+0000","last_change":"2024-08-18T22:05:28.922230+0000","last_active":"2024-08-18T22:07:11.573134+0000","last_peered":"2024-08-18T22:07:11.573134+0000","last_clean":"2024-08-18T22:07:11.573134+0000","last_became_active":"2024-08-18T22:05:28.921804+0000","last_became_peered":"2024-08-18T22:05:28.921804+0000","last_unstale":"2024-08-18T22:07:11.573134+0000","last_undegraded":"2024-08-18T22:07:11.573134+0000","last_fullsized":"2024-08-18T22:07:11.573134+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:17.735645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.533950+0000","last_change":"2024-08-18T22:07:11.533541+0000","last_active":"2024-08-18T22:07:11.533950+0000","last_peered":"2024-08-18T22:07:11.533950+0000","last_clean":"2024-08-18T22:07:11.533950+0000","last_became_active":"2024-08-18T22:07:11.530034+0000","last_became_peered":"2024-08-18T22:07:11.530034+0000","last_unstale":"2024-08-18T22:07:11.533950+0000","last_undegraded":"2024-08-18T22:07:11.533950+0000","last_fullsized":"2024-08-18T22:07:11.533950+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:29.575399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528705+0000","last_change":"2024-08-18T22:06:10.514673+0000","last_active":"2024-08-18T22:07:11.528705+0000","last_peered":"2024-08-18T22:07:11.528705+0000","last_clean":"2024-08-18T22:07:11.528705+0000","last_became_active":"2024-08-18T22:06:10.514264+0000","last_became_peered":"2024-08-18T22:06:10.514264+0000","last_unstale":"2024-08-18T22:07:11.528705+0000","last_undegraded":"2024-08-18T22:07:11.528705+0000","last_fullsized":"2024-08-18T22:07:11.528705+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:03.626895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572808+0000","last_change":"2024-08-18T22:05:28.924521+0000","last_active":"2024-08-18T22:07:11.572808+0000","last_peered":"2024-08-18T22:07:11.572808+0000","last_clean":"2024-08-18T22:07:11.572808+0000","last_became_active":"2024-08-18T22:05:28.924107+0000","last_became_peered":"2024-08-18T22:05:28.924107+0000","last_unstale":"2024-08-18T22:07:11.572808+0000","last_undegraded":"2024-08-18T22:07:11.572808+0000","last_fullsized":"2024-08-18T22:07:11.572808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:37.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527669+0000","last_change":"2024-08-18T22:05:21.861696+0000","last_active":"2024-08-18T22:07:11.527669+0000","last_peered":"2024-08-18T22:07:11.527669+0000","last_clean":"2024-08-18T22:07:11.527669+0000","last_became_active":"2024-08-18T22:05:21.861220+0000","last_became_peered":"2024-08-18T22:05:21.861220+0000","last_unstale":"2024-08-18T22:07:11.527669+0000","last_undegraded":"2024-08-18T22:07:11.527669+0000","last_fullsized":"2024-08-18T22:07:11.527669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:01.098281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526302+0000","last_change":"2024-08-18T22:06:10.520097+0000","last_active":"2024-08-18T22:07:11.526302+0000","last_peered":"2024-08-18T22:07:11.526302+0000","last_clean":"2024-08-18T22:07:11.526302+0000","last_became_active":"2024-08-18T22:06:10.513286+0000","last_became_peered":"2024-08-18T22:06:10.513286+0000","last_unstale":"2024-08-18T22:07:11.526302+0000","last_undegraded":"2024-08-18T22:07:11.526302+0000","last_fullsized":"2024-08-18T22:07:11.526302+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:08:18.861243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573335+0000","last_change":"2024-08-18T22:05:29.013139+0000","last_active":"2024-08-18T22:07:11.573335+0000","last_peered":"2024-08-18T22:07:11.573335+0000","last_clean":"2024-08-18T22:07:11.573335+0000","last_became_active":"2024-08-18T22:05:29.012322+0000","last_became_peered":"2024-08-18T22:05:29.012322+0000","last_unstale":"2024-08-18T22:07:11.573335+0000","last_undegraded":"2024-08-18T22:07:11.573335+0000","last_fullsized":"2024-08-18T22:07:11.573335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:32.348201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572558+0000","last_change":"2024-08-18T22:05:21.860410+0000","last_active":"2024-08-18T22:07:11.572558+0000","last_peered":"2024-08-18T22:07:11.572558+0000","last_clean":"2024-08-18T22:07:11.572558+0000","last_became_active":"2024-08-18T22:05:21.860173+0000","last_became_peered":"2024-08-18T22:05:21.860173+0000","last_unstale":"2024-08-18T22:07:11.572558+0000","last_undegraded":"2024-08-18T22:07:11.572558+0000","last_fullsized":"2024-08-18T22:07:11.572558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:00.879178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530486+0000","last_change":"2024-08-18T22:05:19.845785+0000","last_active":"2024-08-18T22:07:11.530486+0000","last_peered":"2024-08-18T22:07:11.530486+0000","last_clean":"2024-08-18T22:07:11.530486+0000","last_became_active":"2024-08-18T22:05:19.845414+0000","last_became_peered":"2024-08-18T22:05:19.845414+0000","last_unstale":"2024-08-18T22:07:11.530486+0000","last_undegraded":"2024-08-18T22:07:11.530486+0000","last_fullsized":"2024-08-18T22:07:11.530486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:13.504885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573296+0000","last_change":"2024-08-18T22:06:10.523404+0000","last_active":"2024-08-18T22:07:11.573296+0000","last_peered":"2024-08-18T22:07:11.573296+0000","last_clean":"2024-08-18T22:07:11.573296+0000","last_became_active":"2024-08-18T22:06:10.516652+0000","last_became_peered":"2024-08-18T22:06:10.516652+0000","last_unstale":"2024-08-18T22:07:11.573296+0000","last_undegraded":"2024-08-18T22:07:11.573296+0000","last_fullsized":"2024-08-18T22:07:11.573296+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:58.197636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526366+0000","last_change":"2024-08-18T22:05:21.858329+0000","last_active":"2024-08-18T22:07:11.526366+0000","last_peered":"2024-08-18T22:07:11.526366+0000","last_clean":"2024-08-18T22:07:11.526366+0000","last_became_active":"2024-08-18T22:05:21.857854+0000","last_became_peered":"2024-08-18T22:05:21.857854+0000","last_unstale":"2024-08-18T22:07:11.526366+0000","last_undegraded":"2024-08-18T22:07:11.526366+0000","last_fullsized":"2024-08-18T22:07:11.526366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:45:19.934647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572567+0000","last_change":"2024-08-18T22:05:19.843031+0000","last_active":"2024-08-18T22:07:11.572567+0000","last_peered":"2024-08-18T22:07:11.572567+0000","last_clean":"2024-08-18T22:07:11.572567+0000","last_became_active":"2024-08-18T22:05:19.842694+0000","last_became_peered":"2024-08-18T22:05:19.842694+0000","last_unstale":"2024-08-18T22:07:11.572567+0000","last_undegraded":"2024-08-18T22:07:11.572567+0000","last_fullsized":"2024-08-18T22:07:11.572567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:01.135449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523703+0000","last_change":"2024-08-18T22:05:28.920647+0000","last_active":"2024-08-18T22:07:11.523703+0000","last_peered":"2024-08-18T22:07:11.523703+0000","last_clean":"2024-08-18T22:07:11.523703+0000","last_became_active":"2024-08-18T22:05:28.920295+0000","last_became_peered":"2024-08-18T22:05:28.920295+0000","last_unstale":"2024-08-18T22:07:11.523703+0000","last_undegraded":"2024-08-18T22:07:11.523703+0000","last_fullsized":"2024-08-18T22:07:11.523703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:41.295009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524432+0000","last_change":"2024-08-18T22:05:21.858413+0000","last_active":"2024-08-18T22:07:11.524432+0000","last_peered":"2024-08-18T22:07:11.524432+0000","last_clean":"2024-08-18T22:07:11.524432+0000","last_became_active":"2024-08-18T22:05:21.858102+0000","last_became_peered":"2024-08-18T22:05:21.858102+0000","last_unstale":"2024-08-18T22:07:11.524432+0000","last_undegraded":"2024-08-18T22:07:11.524432+0000","last_fullsized":"2024-08-18T22:07:11.524432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:24:59.432666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528669+0000","last_change":"2024-08-18T22:05:20.292085+0000","last_active":"2024-08-18T22:07:11.528669+0000","last_peered":"2024-08-18T22:07:11.528669+0000","last_clean":"2024-08-18T22:07:11.528669+0000","last_became_active":"2024-08-18T22:05:20.291606+0000","last_became_peered":"2024-08-18T22:05:20.291606+0000","last_unstale":"2024-08-18T22:07:11.528669+0000","last_undegraded":"2024-08-18T22:07:11.528669+0000","last_fullsized":"2024-08-18T22:07:11.528669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:22:46.801719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573405+0000","last_change":"2024-08-18T22:06:10.515755+0000","last_active":"2024-08-18T22:07:11.573405+0000","last_peered":"2024-08-18T22:07:11.573405+0000","last_clean":"2024-08-18T22:07:11.573405+0000","last_became_active":"2024-08-18T22:06:10.514624+0000","last_became_peered":"2024-08-18T22:06:10.514624+0000","last_unstale":"2024-08-18T22:07:11.573405+0000","last_undegraded":"2024-08-18T22:07:11.573405+0000","last_fullsized":"2024-08-18T22:07:11.573405+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:18:50.785139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623553+0000","last_change":"2024-08-18T22:05:21.855163+0000","last_active":"2024-08-18T22:07:11.623553+0000","last_peered":"2024-08-18T22:07:11.623553+0000","last_clean":"2024-08-18T22:07:11.623553+0000","last_became_active":"2024-08-18T22:05:21.854867+0000","last_became_peered":"2024-08-18T22:05:21.854867+0000","last_unstale":"2024-08-18T22:07:11.623553+0000","last_undegraded":"2024-08-18T22:07:11.623553+0000","last_fullsized":"2024-08-18T22:07:11.623553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:10.300307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573516+0000","last_change":"2024-08-18T22:05:20.082363+0000","last_active":"2024-08-18T22:07:11.573516+0000","last_peered":"2024-08-18T22:07:11.573516+0000","last_clean":"2024-08-18T22:07:11.573516+0000","last_became_active":"2024-08-18T22:05:20.081998+0000","last_became_peered":"2024-08-18T22:05:20.081998+0000","last_unstale":"2024-08-18T22:07:11.573516+0000","last_undegraded":"2024-08-18T22:07:11.573516+0000","last_fullsized":"2024-08-18T22:07:11.573516+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:44.960512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530726+0000","last_change":"2024-08-18T22:05:28.924072+0000","last_active":"2024-08-18T22:07:11.530726+0000","last_peered":"2024-08-18T22:07:11.530726+0000","last_clean":"2024-08-18T22:07:11.530726+0000","last_became_active":"2024-08-18T22:05:28.923673+0000","last_became_peered":"2024-08-18T22:05:28.923673+0000","last_unstale":"2024-08-18T22:07:11.530726+0000","last_undegraded":"2024-08-18T22:07:11.530726+0000","last_fullsized":"2024-08-18T22:07:11.530726+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:44.593009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572927+0000","last_change":"2024-08-18T22:05:21.851377+0000","last_active":"2024-08-18T22:07:11.572927+0000","last_peered":"2024-08-18T22:07:11.572927+0000","last_clean":"2024-08-18T22:07:11.572927+0000","last_became_active":"2024-08-18T22:05:21.851031+0000","last_became_peered":"2024-08-18T22:05:21.851031+0000","last_unstale":"2024-08-18T22:07:11.572927+0000","last_undegraded":"2024-08-18T22:07:11.572927+0000","last_fullsized":"2024-08-18T22:07:11.572927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.547244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'13","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:31.609491+0000","last_change":"2024-08-18T22:05:19.840697+0000","last_active":"2024-08-18T22:07:31.609491+0000","last_peered":"2024-08-18T22:07:31.609491+0000","last_clean":"2024-08-18T22:07:31.609491+0000","last_became_active":"2024-08-18T22:05:19.840382+0000","last_became_peered":"2024-08-18T22:05:19.840382+0000","last_unstale":"2024-08-18T22:07:31.609491+0000","last_undegraded":"2024-08-18T22:07:31.609491+0000","last_fullsized":"2024-08-18T22:07:31.609491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:24.514428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572248+0000","last_change":"2024-08-18T22:05:29.012305+0000","last_active":"2024-08-18T22:07:11.572248+0000","last_peered":"2024-08-18T22:07:11.572248+0000","last_clean":"2024-08-18T22:07:11.572248+0000","last_became_active":"2024-08-18T22:05:29.011846+0000","last_became_peered":"2024-08-18T22:05:29.011846+0000","last_unstale":"2024-08-18T22:07:11.572248+0000","last_undegraded":"2024-08-18T22:07:11.572248+0000","last_fullsized":"2024-08-18T22:07:11.572248+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:36.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570893+0000","last_change":"2024-08-18T22:05:21.856182+0000","last_active":"2024-08-18T22:07:11.570893+0000","last_peered":"2024-08-18T22:07:11.570893+0000","last_clean":"2024-08-18T22:07:11.570893+0000","last_became_active":"2024-08-18T22:05:21.855855+0000","last_became_peered":"2024-08-18T22:05:21.855855+0000","last_unstale":"2024-08-18T22:07:11.570893+0000","last_undegraded":"2024-08-18T22:07:11.570893+0000","last_fullsized":"2024-08-18T22:07:11.570893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:00.166809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524985+0000","last_change":"2024-08-18T22:05:20.291272+0000","last_active":"2024-08-18T22:07:11.524985+0000","last_peered":"2024-08-18T22:07:11.524985+0000","last_clean":"2024-08-18T22:07:11.524985+0000","last_became_active":"2024-08-18T22:05:20.290970+0000","last_became_peered":"2024-08-18T22:05:20.290970+0000","last_unstale":"2024-08-18T22:07:11.524985+0000","last_undegraded":"2024-08-18T22:07:11.524985+0000","last_fullsized":"2024-08-18T22:07:11.524985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:29.438996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526400+0000","last_change":"2024-08-18T22:05:28.923141+0000","last_active":"2024-08-18T22:07:11.526400+0000","last_peered":"2024-08-18T22:07:11.526400+0000","last_clean":"2024-08-18T22:07:11.526400+0000","last_became_active":"2024-08-18T22:05:28.922269+0000","last_became_peered":"2024-08-18T22:05:28.922269+0000","last_unstale":"2024-08-18T22:07:11.526400+0000","last_undegraded":"2024-08-18T22:07:11.526400+0000","last_fullsized":"2024-08-18T22:07:11.526400+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:58.092640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522176+0000","last_change":"2024-08-18T22:05:21.850124+0000","last_active":"2024-08-18T22:07:11.522176+0000","last_peered":"2024-08-18T22:07:11.522176+0000","last_clean":"2024-08-18T22:07:11.522176+0000","last_became_active":"2024-08-18T22:05:21.849805+0000","last_became_peered":"2024-08-18T22:05:21.849805+0000","last_unstale":"2024-08-18T22:07:11.522176+0000","last_undegraded":"2024-08-18T22:07:11.522176+0000","last_fullsized":"2024-08-18T22:07:11.522176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:53.492613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523594+0000","last_change":"2024-08-18T22:05:20.292836+0000","last_active":"2024-08-18T22:07:11.523594+0000","last_peered":"2024-08-18T22:07:11.523594+0000","last_clean":"2024-08-18T22:07:11.523594+0000","last_became_active":"2024-08-18T22:05:20.292456+0000","last_became_peered":"2024-08-18T22:05:20.292456+0000","last_unstale":"2024-08-18T22:07:11.523594+0000","last_undegraded":"2024-08-18T22:07:11.523594+0000","last_fullsized":"2024-08-18T22:07:11.523594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:19.525037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524433+0000","last_change":"2024-08-18T22:05:29.012439+0000","last_active":"2024-08-18T22:07:11.524433+0000","last_peered":"2024-08-18T22:07:11.524433+0000","last_clean":"2024-08-18T22:07:11.524433+0000","last_became_active":"2024-08-18T22:05:29.011860+0000","last_became_peered":"2024-08-18T22:05:29.011860+0000","last_unstale":"2024-08-18T22:07:11.524433+0000","last_undegraded":"2024-08-18T22:07:11.524433+0000","last_fullsized":"2024-08-18T22:07:11.524433+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:03.432217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522230+0000","last_change":"2024-08-18T22:05:21.855598+0000","last_active":"2024-08-18T22:07:11.522230+0000","last_peered":"2024-08-18T22:07:11.522230+0000","last_clean":"2024-08-18T22:07:11.522230+0000","last_became_active":"2024-08-18T22:05:21.855228+0000","last_became_peered":"2024-08-18T22:05:21.855228+0000","last_unstale":"2024-08-18T22:07:11.522230+0000","last_undegraded":"2024-08-18T22:07:11.522230+0000","last_fullsized":"2024-08-18T22:07:11.522230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:33.762700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527786+0000","last_change":"2024-08-18T22:05:19.844638+0000","last_active":"2024-08-18T22:07:11.527786+0000","last_peered":"2024-08-18T22:07:11.527786+0000","last_clean":"2024-08-18T22:07:11.527786+0000","last_became_active":"2024-08-18T22:05:19.844333+0000","last_became_peered":"2024-08-18T22:05:19.844333+0000","last_unstale":"2024-08-18T22:07:11.527786+0000","last_undegraded":"2024-08-18T22:07:11.527786+0000","last_fullsized":"2024-08-18T22:07:11.527786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:26.947512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570807+0000","last_change":"2024-08-18T22:05:28.919965+0000","last_active":"2024-08-18T22:07:11.570807+0000","last_peered":"2024-08-18T22:07:11.570807+0000","last_clean":"2024-08-18T22:07:11.570807+0000","last_became_active":"2024-08-18T22:05:28.919546+0000","last_became_peered":"2024-08-18T22:05:28.919546+0000","last_unstale":"2024-08-18T22:07:11.570807+0000","last_undegraded":"2024-08-18T22:07:11.570807+0000","last_fullsized":"2024-08-18T22:07:11.570807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:49.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528844+0000","last_change":"2024-08-18T22:05:21.857867+0000","last_active":"2024-08-18T22:07:11.528844+0000","last_peered":"2024-08-18T22:07:11.528844+0000","last_clean":"2024-08-18T22:07:11.528844+0000","last_became_active":"2024-08-18T22:05:21.857515+0000","last_became_peered":"2024-08-18T22:05:21.857515+0000","last_unstale":"2024-08-18T22:07:11.528844+0000","last_undegraded":"2024-08-18T22:07:11.528844+0000","last_fullsized":"2024-08-18T22:07:11.528844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:51.148321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":154,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:46.621204+0000","last_change":"2024-08-18T22:05:20.290924+0000","last_active":"2024-08-18T22:07:46.621204+0000","last_peered":"2024-08-18T22:07:46.621204+0000","last_clean":"2024-08-18T22:07:46.621204+0000","last_became_active":"2024-08-18T22:05:20.290587+0000","last_became_peered":"2024-08-18T22:05:20.290587+0000","last_unstale":"2024-08-18T22:07:46.621204+0000","last_undegraded":"2024-08-18T22:07:46.621204+0000","last_fullsized":"2024-08-18T22:07:46.621204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:35.029634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570655+0000","last_change":"2024-08-18T22:05:29.012876+0000","last_active":"2024-08-18T22:07:11.570655+0000","last_peered":"2024-08-18T22:07:11.570655+0000","last_clean":"2024-08-18T22:07:11.570655+0000","last_became_active":"2024-08-18T22:05:29.011930+0000","last_became_peered":"2024-08-18T22:05:29.011930+0000","last_unstale":"2024-08-18T22:07:11.570655+0000","last_undegraded":"2024-08-18T22:07:11.570655+0000","last_fullsized":"2024-08-18T22:07:11.570655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:22:35.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570198+0000","last_change":"2024-08-18T22:05:21.860798+0000","last_active":"2024-08-18T22:07:11.570198+0000","last_peered":"2024-08-18T22:07:11.570198+0000","last_clean":"2024-08-18T22:07:11.570198+0000","last_became_active":"2024-08-18T22:05:21.856968+0000","last_became_peered":"2024-08-18T22:05:21.856968+0000","last_unstale":"2024-08-18T22:07:11.570198+0000","last_undegraded":"2024-08-18T22:07:11.570198+0000","last_fullsized":"2024-08-18T22:07:11.570198+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:54.934400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527098+0000","last_change":"2024-08-18T22:05:19.844775+0000","last_active":"2024-08-18T22:07:11.527098+0000","last_peered":"2024-08-18T22:07:11.527098+0000","last_clean":"2024-08-18T22:07:11.527098+0000","last_became_active":"2024-08-18T22:05:19.844465+0000","last_became_peered":"2024-08-18T22:05:19.844465+0000","last_unstale":"2024-08-18T22:07:11.527098+0000","last_undegraded":"2024-08-18T22:07:11.527098+0000","last_fullsized":"2024-08-18T22:07:11.527098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.042335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528645+0000","last_change":"2024-08-18T22:05:29.013275+0000","last_active":"2024-08-18T22:07:11.528645+0000","last_peered":"2024-08-18T22:07:11.528645+0000","last_clean":"2024-08-18T22:07:11.528645+0000","last_became_active":"2024-08-18T22:05:29.012537+0000","last_became_peered":"2024-08-18T22:05:29.012537+0000","last_unstale":"2024-08-18T22:07:11.528645+0000","last_undegraded":"2024-08-18T22:07:11.528645+0000","last_fullsized":"2024-08-18T22:07:11.528645+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:15:39.775360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572574+0000","last_change":"2024-08-18T22:05:21.853358+0000","last_active":"2024-08-18T22:07:11.572574+0000","last_peered":"2024-08-18T22:07:11.572574+0000","last_clean":"2024-08-18T22:07:11.572574+0000","last_became_active":"2024-08-18T22:05:21.853071+0000","last_became_peered":"2024-08-18T22:05:21.853071+0000","last_unstale":"2024-08-18T22:07:11.572574+0000","last_undegraded":"2024-08-18T22:07:11.572574+0000","last_fullsized":"2024-08-18T22:07:11.572574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:23.755263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573411+0000","last_change":"2024-08-18T22:05:19.846922+0000","last_active":"2024-08-18T22:07:11.573411+0000","last_peered":"2024-08-18T22:07:11.573411+0000","last_clean":"2024-08-18T22:07:11.573411+0000","last_became_active":"2024-08-18T22:05:19.846619+0000","last_became_peered":"2024-08-18T22:05:19.846619+0000","last_unstale":"2024-08-18T22:07:11.573411+0000","last_undegraded":"2024-08-18T22:07:11.573411+0000","last_fullsized":"2024-08-18T22:07:11.573411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:36:16.232344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":357,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527160+0000","last_change":"2024-08-18T22:04:11.878703+0000","last_active":"2024-08-18T22:07:11.527160+0000","last_peered":"2024-08-18T22:07:11.527160+0000","last_clean":"2024-08-18T22:07:11.527160+0000","last_became_active":"2024-08-18T22:04:11.878157+0000","last_became_peered":"2024-08-18T22:04:11.878157+0000","last_unstale":"2024-08-18T22:07:11.527160+0000","last_undegraded":"2024-08-18T22:07:11.527160+0000","last_fullsized":"2024-08-18T22:07:11.527160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_clean_scrub_stamp":"2024-08-18T22:01:09.551264+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:24:07.391758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527387+0000","last_change":"2024-08-18T22:05:28.928882+0000","last_active":"2024-08-18T22:07:11.527387+0000","last_peered":"2024-08-18T22:07:11.527387+0000","last_clean":"2024-08-18T22:07:11.527387+0000","last_became_active":"2024-08-18T22:05:28.928482+0000","last_became_peered":"2024-08-18T22:05:28.928482+0000","last_unstale":"2024-08-18T22:07:11.527387+0000","last_undegraded":"2024-08-18T22:07:11.527387+0000","last_fullsized":"2024-08-18T22:07:11.527387+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:41.739482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527496+0000","last_change":"2024-08-18T22:05:21.863045+0000","last_active":"2024-08-18T22:07:11.527496+0000","last_peered":"2024-08-18T22:07:11.527496+0000","last_clean":"2024-08-18T22:07:11.527496+0000","last_became_active":"2024-08-18T22:05:21.862758+0000","last_became_peered":"2024-08-18T22:05:21.862758+0000","last_unstale":"2024-08-18T22:07:11.527496+0000","last_undegraded":"2024-08-18T22:07:11.527496+0000","last_fullsized":"2024-08-18T22:07:11.527496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:08:39.111147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531069+0000","last_change":"2024-08-18T22:05:20.291030+0000","last_active":"2024-08-18T22:07:11.531069+0000","last_peered":"2024-08-18T22:07:11.531069+0000","last_clean":"2024-08-18T22:07:11.531069+0000","last_became_active":"2024-08-18T22:05:20.290427+0000","last_became_peered":"2024-08-18T22:05:20.290427+0000","last_unstale":"2024-08-18T22:07:11.531069+0000","last_undegraded":"2024-08-18T22:07:11.531069+0000","last_fullsized":"2024-08-18T22:07:11.531069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:14:42.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528742+0000","last_change":"2024-08-18T22:05:28.923700+0000","last_active":"2024-08-18T22:07:11.528742+0000","last_peered":"2024-08-18T22:07:11.528742+0000","last_clean":"2024-08-18T22:07:11.528742+0000","last_became_active":"2024-08-18T22:05:28.923280+0000","last_became_peered":"2024-08-18T22:05:28.923280+0000","last_unstale":"2024-08-18T22:07:11.528742+0000","last_undegraded":"2024-08-18T22:07:11.528742+0000","last_fullsized":"2024-08-18T22:07:11.528742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:25:45.343542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527521+0000","last_change":"2024-08-18T22:05:21.856107+0000","last_active":"2024-08-18T22:07:11.527521+0000","last_peered":"2024-08-18T22:07:11.527521+0000","last_clean":"2024-08-18T22:07:11.527521+0000","last_became_active":"2024-08-18T22:05:21.853276+0000","last_became_peered":"2024-08-18T22:05:21.853276+0000","last_unstale":"2024-08-18T22:07:11.527521+0000","last_undegraded":"2024-08-18T22:07:11.527521+0000","last_fullsized":"2024-08-18T22:07:11.527521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:58.280375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528926+0000","last_change":"2024-08-18T22:05:19.843445+0000","last_active":"2024-08-18T22:07:11.528926+0000","last_peered":"2024-08-18T22:07:11.528926+0000","last_clean":"2024-08-18T22:07:11.528926+0000","last_became_active":"2024-08-18T22:05:19.843000+0000","last_became_peered":"2024-08-18T22:05:19.843000+0000","last_unstale":"2024-08-18T22:07:11.528926+0000","last_undegraded":"2024-08-18T22:07:11.528926+0000","last_fullsized":"2024-08-18T22:07:11.528926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:23.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623212+0000","last_change":"2024-08-18T22:06:10.515953+0000","last_active":"2024-08-18T22:07:11.623212+0000","last_peered":"2024-08-18T22:07:11.623212+0000","last_clean":"2024-08-18T22:07:11.623212+0000","last_became_active":"2024-08-18T22:06:10.515662+0000","last_became_peered":"2024-08-18T22:06:10.515662+0000","last_unstale":"2024-08-18T22:07:11.623212+0000","last_undegraded":"2024-08-18T22:07:11.623212+0000","last_fullsized":"2024-08-18T22:07:11.623212+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:43.150180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527523+0000","last_change":"2024-08-18T22:05:21.864029+0000","last_active":"2024-08-18T22:07:11.527523+0000","last_peered":"2024-08-18T22:07:11.527523+0000","last_clean":"2024-08-18T22:07:11.527523+0000","last_became_active":"2024-08-18T22:05:21.863509+0000","last_became_peered":"2024-08-18T22:05:21.863509+0000","last_unstale":"2024-08-18T22:07:11.527523+0000","last_undegraded":"2024-08-18T22:07:11.527523+0000","last_fullsized":"2024-08-18T22:07:11.527523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:42.879243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570764+0000","last_change":"2024-08-18T22:05:19.846514+0000","last_active":"2024-08-18T22:07:11.570764+0000","last_peered":"2024-08-18T22:07:11.570764+0000","last_clean":"2024-08-18T22:07:11.570764+0000","last_became_active":"2024-08-18T22:05:19.846190+0000","last_became_peered":"2024-08-18T22:05:19.846190+0000","last_unstale":"2024-08-18T22:07:11.570764+0000","last_undegraded":"2024-08-18T22:07:11.570764+0000","last_fullsized":"2024-08-18T22:07:11.570764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:49:00.317597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528349+0000","last_change":"2024-08-18T22:05:28.923183+0000","last_active":"2024-08-18T22:07:11.528349+0000","last_peered":"2024-08-18T22:07:11.528349+0000","last_clean":"2024-08-18T22:07:11.528349+0000","last_became_active":"2024-08-18T22:05:28.922809+0000","last_became_peered":"2024-08-18T22:05:28.922809+0000","last_unstale":"2024-08-18T22:07:11.528349+0000","last_undegraded":"2024-08-18T22:07:11.528349+0000","last_fullsized":"2024-08-18T22:07:11.528349+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:26.416920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526764+0000","last_change":"2024-08-18T22:05:21.849075+0000","last_active":"2024-08-18T22:07:11.526764+0000","last_peered":"2024-08-18T22:07:11.526764+0000","last_clean":"2024-08-18T22:07:11.526764+0000","last_became_active":"2024-08-18T22:05:21.848759+0000","last_became_peered":"2024-08-18T22:05:21.848759+0000","last_unstale":"2024-08-18T22:07:11.526764+0000","last_undegraded":"2024-08-18T22:07:11.526764+0000","last_fullsized":"2024-08-18T22:07:11.526764+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:26.531534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524964+0000","last_change":"2024-08-18T22:05:19.849210+0000","last_active":"2024-08-18T22:07:11.524964+0000","last_peered":"2024-08-18T22:07:11.524964+0000","last_clean":"2024-08-18T22:07:11.524964+0000","last_became_active":"2024-08-18T22:05:19.848829+0000","last_became_peered":"2024-08-18T22:05:19.848829+0000","last_unstale":"2024-08-18T22:07:11.524964+0000","last_undegraded":"2024-08-18T22:07:11.524964+0000","last_fullsized":"2024-08-18T22:07:11.524964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:19.321686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528709+0000","last_change":"2024-08-18T22:05:28.924577+0000","last_active":"2024-08-18T22:07:11.528709+0000","last_peered":"2024-08-18T22:07:11.528709+0000","last_clean":"2024-08-18T22:07:11.528709+0000","last_became_active":"2024-08-18T22:05:28.924183+0000","last_became_peered":"2024-08-18T22:05:28.924183+0000","last_unstale":"2024-08-18T22:07:11.528709+0000","last_undegraded":"2024-08-18T22:07:11.528709+0000","last_fullsized":"2024-08-18T22:07:11.528709+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:22.702757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523154+0000","last_change":"2024-08-18T22:06:10.513610+0000","last_active":"2024-08-18T22:07:11.523154+0000","last_peered":"2024-08-18T22:07:11.523154+0000","last_clean":"2024-08-18T22:07:11.523154+0000","last_became_active":"2024-08-18T22:06:10.513400+0000","last_became_peered":"2024-08-18T22:06:10.513400+0000","last_unstale":"2024-08-18T22:07:11.523154+0000","last_undegraded":"2024-08-18T22:07:11.523154+0000","last_fullsized":"2024-08-18T22:07:11.523154+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:49.275223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524463+0000","last_change":"2024-08-18T22:05:20.291752+0000","last_active":"2024-08-18T22:07:11.524463+0000","last_peered":"2024-08-18T22:07:11.524463+0000","last_clean":"2024-08-18T22:07:11.524463+0000","last_became_active":"2024-08-18T22:05:20.291431+0000","last_became_peered":"2024-08-18T22:05:20.291431+0000","last_unstale":"2024-08-18T22:07:11.524463+0000","last_undegraded":"2024-08-18T22:07:11.524463+0000","last_fullsized":"2024-08-18T22:07:11.524463+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:32.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570623+0000","last_change":"2024-08-18T22:05:28.924121+0000","last_active":"2024-08-18T22:07:11.570623+0000","last_peered":"2024-08-18T22:07:11.570623+0000","last_clean":"2024-08-18T22:07:11.570623+0000","last_became_active":"2024-08-18T22:05:28.923753+0000","last_became_peered":"2024-08-18T22:05:28.923753+0000","last_unstale":"2024-08-18T22:07:11.570623+0000","last_undegraded":"2024-08-18T22:07:11.570623+0000","last_fullsized":"2024-08-18T22:07:11.570623+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:57.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527050+0000","last_change":"2024-08-18T22:05:21.858366+0000","last_active":"2024-08-18T22:07:11.527050+0000","last_peered":"2024-08-18T22:07:11.527050+0000","last_clean":"2024-08-18T22:07:11.527050+0000","last_became_active":"2024-08-18T22:05:21.858021+0000","last_became_peered":"2024-08-18T22:05:21.858021+0000","last_unstale":"2024-08-18T22:07:11.527050+0000","last_undegraded":"2024-08-18T22:07:11.527050+0000","last_fullsized":"2024-08-18T22:07:11.527050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:55.662965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":159,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:47.623483+0000","last_change":"2024-08-18T22:05:19.850013+0000","last_active":"2024-08-18T22:07:47.623483+0000","last_peered":"2024-08-18T22:07:47.623483+0000","last_clean":"2024-08-18T22:07:47.623483+0000","last_became_active":"2024-08-18T22:05:19.849551+0000","last_became_peered":"2024-08-18T22:05:19.849551+0000","last_unstale":"2024-08-18T22:07:47.623483+0000","last_undegraded":"2024-08-18T22:07:47.623483+0000","last_fullsized":"2024-08-18T22:07:47.623483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:15.182999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523685+0000","last_change":"2024-08-18T22:05:28.927318+0000","last_active":"2024-08-18T22:07:11.523685+0000","last_peered":"2024-08-18T22:07:11.523685+0000","last_clean":"2024-08-18T22:07:11.523685+0000","last_became_active":"2024-08-18T22:05:28.926786+0000","last_became_peered":"2024-08-18T22:05:28.926786+0000","last_unstale":"2024-08-18T22:07:11.523685+0000","last_undegraded":"2024-08-18T22:07:11.523685+0000","last_fullsized":"2024-08-18T22:07:11.523685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:45.798247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527690+0000","last_change":"2024-08-18T22:06:10.511821+0000","last_active":"2024-08-18T22:07:11.527690+0000","last_peered":"2024-08-18T22:07:11.527690+0000","last_clean":"2024-08-18T22:07:11.527690+0000","last_became_active":"2024-08-18T22:06:10.511135+0000","last_became_peered":"2024-08-18T22:06:10.511135+0000","last_unstale":"2024-08-18T22:07:11.527690+0000","last_undegraded":"2024-08-18T22:07:11.527690+0000","last_fullsized":"2024-08-18T22:07:11.527690+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:07.108531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528618+0000","last_change":"2024-08-18T22:05:19.844061+0000","last_active":"2024-08-18T22:07:11.528618+0000","last_peered":"2024-08-18T22:07:11.528618+0000","last_clean":"2024-08-18T22:07:11.528618+0000","last_became_active":"2024-08-18T22:05:19.843513+0000","last_became_peered":"2024-08-18T22:05:19.843513+0000","last_unstale":"2024-08-18T22:07:11.528618+0000","last_undegraded":"2024-08-18T22:07:11.528618+0000","last_fullsized":"2024-08-18T22:07:11.528618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:53.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526996+0000","last_change":"2024-08-18T22:05:28.922986+0000","last_active":"2024-08-18T22:07:11.526996+0000","last_peered":"2024-08-18T22:07:11.526996+0000","last_clean":"2024-08-18T22:07:11.526996+0000","last_became_active":"2024-08-18T22:05:28.922322+0000","last_became_peered":"2024-08-18T22:05:28.922322+0000","last_unstale":"2024-08-18T22:07:11.526996+0000","last_undegraded":"2024-08-18T22:07:11.526996+0000","last_fullsized":"2024-08-18T22:07:11.526996+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:28.168299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570439+0000","last_change":"2024-08-18T22:05:21.853389+0000","last_active":"2024-08-18T22:07:11.570439+0000","last_peered":"2024-08-18T22:07:11.570439+0000","last_clean":"2024-08-18T22:07:11.570439+0000","last_became_active":"2024-08-18T22:05:21.853095+0000","last_became_peered":"2024-08-18T22:05:21.853095+0000","last_unstale":"2024-08-18T22:07:11.570439+0000","last_undegraded":"2024-08-18T22:07:11.570439+0000","last_fullsized":"2024-08-18T22:07:11.570439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:14.126983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531024+0000","last_change":"2024-08-18T22:05:19.846788+0000","last_active":"2024-08-18T22:07:11.531024+0000","last_peered":"2024-08-18T22:07:11.531024+0000","last_clean":"2024-08-18T22:07:11.531024+0000","last_became_active":"2024-08-18T22:05:19.846248+0000","last_became_peered":"2024-08-18T22:05:19.846248+0000","last_unstale":"2024-08-18T22:07:11.531024+0000","last_undegraded":"2024-08-18T22:07:11.531024+0000","last_fullsized":"2024-08-18T22:07:11.531024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:46.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528593+0000","last_change":"2024-08-18T22:05:28.920294+0000","last_active":"2024-08-18T22:07:11.528593+0000","last_peered":"2024-08-18T22:07:11.528593+0000","last_clean":"2024-08-18T22:07:11.528593+0000","last_became_active":"2024-08-18T22:05:28.919351+0000","last_became_peered":"2024-08-18T22:05:28.919351+0000","last_unstale":"2024-08-18T22:07:11.528593+0000","last_undegraded":"2024-08-18T22:07:11.528593+0000","last_fullsized":"2024-08-18T22:07:11.528593+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:49.425281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524875+0000","last_change":"2024-08-18T22:05:21.864529+0000","last_active":"2024-08-18T22:07:11.524875+0000","last_peered":"2024-08-18T22:07:11.524875+0000","last_clean":"2024-08-18T22:07:11.524875+0000","last_became_active":"2024-08-18T22:05:21.864062+0000","last_became_peered":"2024-08-18T22:05:21.864062+0000","last_unstale":"2024-08-18T22:07:11.524875+0000","last_undegraded":"2024-08-18T22:07:11.524875+0000","last_fullsized":"2024-08-18T22:07:11.524875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:24:49.037343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'37","reported_seq":327,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:48.675404+0000","last_change":"2024-08-18T22:06:10.522113+0000","last_active":"2024-08-18T22:07:48.675404+0000","last_peered":"2024-08-18T22:07:48.675404+0000","last_clean":"2024-08-18T22:07:48.675404+0000","last_became_active":"2024-08-18T22:06:10.514837+0000","last_became_peered":"2024-08-18T22:06:10.514837+0000","last_unstale":"2024-08-18T22:07:48.675404+0000","last_undegraded":"2024-08-18T22:07:48.675404+0000","last_fullsized":"2024-08-18T22:07:48.675404+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:46.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67447,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":228,"num_read_kb":175,"num_write":38,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523283+0000","last_change":"2024-08-18T22:05:28.926357+0000","last_active":"2024-08-18T22:07:11.523283+0000","last_peered":"2024-08-18T22:07:11.523283+0000","last_clean":"2024-08-18T22:07:11.523283+0000","last_became_active":"2024-08-18T22:05:28.926016+0000","last_became_peered":"2024-08-18T22:05:28.926016+0000","last_unstale":"2024-08-18T22:07:11.523283+0000","last_undegraded":"2024-08-18T22:07:11.523283+0000","last_fullsized":"2024-08-18T22:07:11.523283+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:16.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529123+0000","last_change":"2024-08-18T22:05:21.860237+0000","last_active":"2024-08-18T22:07:11.529123+0000","last_peered":"2024-08-18T22:07:11.529123+0000","last_clean":"2024-08-18T22:07:11.529123+0000","last_became_active":"2024-08-18T22:05:21.859919+0000","last_became_peered":"2024-08-18T22:05:21.859919+0000","last_unstale":"2024-08-18T22:07:11.529123+0000","last_undegraded":"2024-08-18T22:07:11.529123+0000","last_fullsized":"2024-08-18T22:07:11.529123+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:21.048413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528892+0000","last_change":"2024-08-18T22:05:20.291233+0000","last_active":"2024-08-18T22:07:11.528892+0000","last_peered":"2024-08-18T22:07:11.528892+0000","last_clean":"2024-08-18T22:07:11.528892+0000","last_became_active":"2024-08-18T22:05:20.290893+0000","last_became_peered":"2024-08-18T22:05:20.290893+0000","last_unstale":"2024-08-18T22:07:11.528892+0000","last_undegraded":"2024-08-18T22:07:11.528892+0000","last_fullsized":"2024-08-18T22:07:11.528892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:36.889561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573103+0000","last_change":"2024-08-18T22:05:28.923076+0000","last_active":"2024-08-18T22:07:11.573103+0000","last_peered":"2024-08-18T22:07:11.573103+0000","last_clean":"2024-08-18T22:07:11.573103+0000","last_became_active":"2024-08-18T22:05:28.922688+0000","last_became_peered":"2024-08-18T22:05:28.922688+0000","last_unstale":"2024-08-18T22:07:11.573103+0000","last_undegraded":"2024-08-18T22:07:11.573103+0000","last_fullsized":"2024-08-18T22:07:11.573103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:34.360540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623665+0000","last_change":"2024-08-18T22:05:21.855174+0000","last_active":"2024-08-18T22:07:11.623665+0000","last_peered":"2024-08-18T22:07:11.623665+0000","last_clean":"2024-08-18T22:07:11.623665+0000","last_became_active":"2024-08-18T22:05:21.854818+0000","last_became_peered":"2024-08-18T22:05:21.854818+0000","last_unstale":"2024-08-18T22:07:11.623665+0000","last_undegraded":"2024-08-18T22:07:11.623665+0000","last_fullsized":"2024-08-18T22:07:11.623665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:48:55.094624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.577365+0000","last_change":"2024-08-18T22:07:11.576894+0000","last_active":"2024-08-18T22:07:11.577365+0000","last_peered":"2024-08-18T22:07:11.577365+0000","last_clean":"2024-08-18T22:07:11.577365+0000","last_became_active":"2024-08-18T22:07:11.574159+0000","last_became_peered":"2024-08-18T22:07:11.574159+0000","last_unstale":"2024-08-18T22:07:11.577365+0000","last_undegraded":"2024-08-18T22:07:11.577365+0000","last_fullsized":"2024-08-18T22:07:11.577365+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:37.993056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523132+0000","last_change":"2024-08-18T22:05:28.921647+0000","last_active":"2024-08-18T22:07:11.523132+0000","last_peered":"2024-08-18T22:07:11.523132+0000","last_clean":"2024-08-18T22:07:11.523132+0000","last_became_active":"2024-08-18T22:05:28.921305+0000","last_became_peered":"2024-08-18T22:05:28.921305+0000","last_unstale":"2024-08-18T22:07:11.523132+0000","last_undegraded":"2024-08-18T22:07:11.523132+0000","last_fullsized":"2024-08-18T22:07:11.523132+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:29.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529467+0000","last_change":"2024-08-18T22:05:21.861151+0000","last_active":"2024-08-18T22:07:11.529467+0000","last_peered":"2024-08-18T22:07:11.529467+0000","last_clean":"2024-08-18T22:07:11.529467+0000","last_became_active":"2024-08-18T22:05:21.860834+0000","last_became_peered":"2024-08-18T22:05:21.860834+0000","last_unstale":"2024-08-18T22:07:11.529467+0000","last_undegraded":"2024-08-18T22:07:11.529467+0000","last_fullsized":"2024-08-18T22:07:11.529467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:32.890750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":154,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:47.623560+0000","last_change":"2024-08-18T22:05:19.846145+0000","last_active":"2024-08-18T22:07:47.623560+0000","last_peered":"2024-08-18T22:07:47.623560+0000","last_clean":"2024-08-18T22:07:47.623560+0000","last_became_active":"2024-08-18T22:05:19.845711+0000","last_became_peered":"2024-08-18T22:05:19.845711+0000","last_unstale":"2024-08-18T22:07:47.623560+0000","last_undegraded":"2024-08-18T22:07:47.623560+0000","last_fullsized":"2024-08-18T22:07:47.623560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:20.376131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572337+0000","last_change":"2024-08-18T22:05:28.923256+0000","last_active":"2024-08-18T22:07:11.572337+0000","last_peered":"2024-08-18T22:07:11.572337+0000","last_clean":"2024-08-18T22:07:11.572337+0000","last_became_active":"2024-08-18T22:05:28.922845+0000","last_became_peered":"2024-08-18T22:05:28.922845+0000","last_unstale":"2024-08-18T22:07:11.572337+0000","last_undegraded":"2024-08-18T22:07:11.572337+0000","last_fullsized":"2024-08-18T22:07:11.572337+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:41.930937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623447+0000","last_change":"2024-08-18T22:05:28.924743+0000","last_active":"2024-08-18T22:07:11.623447+0000","last_peered":"2024-08-18T22:07:11.623447+0000","last_clean":"2024-08-18T22:07:11.623447+0000","last_became_active":"2024-08-18T22:05:28.923674+0000","last_became_peered":"2024-08-18T22:05:28.923674+0000","last_unstale":"2024-08-18T22:07:11.623447+0000","last_undegraded":"2024-08-18T22:07:11.623447+0000","last_fullsized":"2024-08-18T22:07:11.623447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:19.834998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523308+0000","last_change":"2024-08-18T22:05:21.857194+0000","last_active":"2024-08-18T22:07:11.523308+0000","last_peered":"2024-08-18T22:07:11.523308+0000","last_clean":"2024-08-18T22:07:11.523308+0000","last_became_active":"2024-08-18T22:05:21.856916+0000","last_became_peered":"2024-08-18T22:05:21.856916+0000","last_unstale":"2024-08-18T22:07:11.523308+0000","last_undegraded":"2024-08-18T22:07:11.523308+0000","last_fullsized":"2024-08-18T22:07:11.523308+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:24.759501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529123+0000","last_change":"2024-08-18T22:05:19.844919+0000","last_active":"2024-08-18T22:07:11.529123+0000","last_peered":"2024-08-18T22:07:11.529123+0000","last_clean":"2024-08-18T22:07:11.529123+0000","last_became_active":"2024-08-18T22:05:19.844539+0000","last_became_peered":"2024-08-18T22:05:19.844539+0000","last_unstale":"2024-08-18T22:07:11.529123+0000","last_undegraded":"2024-08-18T22:07:11.529123+0000","last_fullsized":"2024-08-18T22:07:11.529123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:01.598535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526775+0000","last_change":"2024-08-18T22:05:28.923304+0000","last_active":"2024-08-18T22:07:11.526775+0000","last_peered":"2024-08-18T22:07:11.526775+0000","last_clean":"2024-08-18T22:07:11.526775+0000","last_became_active":"2024-08-18T22:05:28.922912+0000","last_became_peered":"2024-08-18T22:05:28.922912+0000","last_unstale":"2024-08-18T22:07:11.526775+0000","last_undegraded":"2024-08-18T22:07:11.526775+0000","last_fullsized":"2024-08-18T22:07:11.526775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:24:47.834354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572444+0000","last_change":"2024-08-18T22:05:21.849448+0000","last_active":"2024-08-18T22:07:11.572444+0000","last_peered":"2024-08-18T22:07:11.572444+0000","last_clean":"2024-08-18T22:07:11.572444+0000","last_became_active":"2024-08-18T22:05:21.849154+0000","last_became_peered":"2024-08-18T22:05:21.849154+0000","last_unstale":"2024-08-18T22:07:11.572444+0000","last_undegraded":"2024-08-18T22:07:11.572444+0000","last_fullsized":"2024-08-18T22:07:11.572444+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:38.583121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570212+0000","last_change":"2024-08-18T22:05:19.848483+0000","last_active":"2024-08-18T22:07:11.570212+0000","last_peered":"2024-08-18T22:07:11.570212+0000","last_clean":"2024-08-18T22:07:11.570212+0000","last_became_active":"2024-08-18T22:05:19.848190+0000","last_became_peered":"2024-08-18T22:05:19.848190+0000","last_unstale":"2024-08-18T22:07:11.570212+0000","last_undegraded":"2024-08-18T22:07:11.570212+0000","last_fullsized":"2024-08-18T22:07:11.570212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:01.719565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522263+0000","last_change":"2024-08-18T22:05:19.843796+0000","last_active":"2024-08-18T22:07:11.522263+0000","last_peered":"2024-08-18T22:07:11.522263+0000","last_clean":"2024-08-18T22:07:11.522263+0000","last_became_active":"2024-08-18T22:05:19.843495+0000","last_became_peered":"2024-08-18T22:05:19.843495+0000","last_unstale":"2024-08-18T22:07:11.522263+0000","last_undegraded":"2024-08-18T22:07:11.522263+0000","last_fullsized":"2024-08-18T22:07:11.522263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:21.583561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528701+0000","last_change":"2024-08-18T22:05:21.856370+0000","last_active":"2024-08-18T22:07:11.528701+0000","last_peered":"2024-08-18T22:07:11.528701+0000","last_clean":"2024-08-18T22:07:11.528701+0000","last_became_active":"2024-08-18T22:05:21.855954+0000","last_became_peered":"2024-08-18T22:05:21.855954+0000","last_unstale":"2024-08-18T22:07:11.528701+0000","last_undegraded":"2024-08-18T22:07:11.528701+0000","last_fullsized":"2024-08-18T22:07:11.528701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:30.828305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530403+0000","last_change":"2024-08-18T22:06:10.516344+0000","last_active":"2024-08-18T22:07:11.530403+0000","last_peered":"2024-08-18T22:07:11.530403+0000","last_clean":"2024-08-18T22:07:11.530403+0000","last_became_active":"2024-08-18T22:06:10.515925+0000","last_became_peered":"2024-08-18T22:06:10.515925+0000","last_unstale":"2024-08-18T22:07:11.530403+0000","last_undegraded":"2024-08-18T22:07:11.530403+0000","last_fullsized":"2024-08-18T22:07:11.530403+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:41:07.585521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":156,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:43.618096+0000","last_change":"2024-08-18T22:05:19.846860+0000","last_active":"2024-08-18T22:07:43.618096+0000","last_peered":"2024-08-18T22:07:43.618096+0000","last_clean":"2024-08-18T22:07:43.618096+0000","last_became_active":"2024-08-18T22:05:19.846496+0000","last_became_peered":"2024-08-18T22:05:19.846496+0000","last_unstale":"2024-08-18T22:07:43.618096+0000","last_undegraded":"2024-08-18T22:07:43.618096+0000","last_fullsized":"2024-08-18T22:07:43.618096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:16.555137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524444+0000","last_change":"2024-08-18T22:05:21.849058+0000","last_active":"2024-08-18T22:07:11.524444+0000","last_peered":"2024-08-18T22:07:11.524444+0000","last_clean":"2024-08-18T22:07:11.524444+0000","last_became_active":"2024-08-18T22:05:21.848703+0000","last_became_peered":"2024-08-18T22:05:21.848703+0000","last_unstale":"2024-08-18T22:07:11.524444+0000","last_undegraded":"2024-08-18T22:07:11.524444+0000","last_fullsized":"2024-08-18T22:07:11.524444+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:10.024156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530967+0000","last_change":"2024-08-18T22:05:28.922968+0000","last_active":"2024-08-18T22:07:11.530967+0000","last_peered":"2024-08-18T22:07:11.530967+0000","last_clean":"2024-08-18T22:07:11.530967+0000","last_became_active":"2024-08-18T22:05:28.922378+0000","last_became_peered":"2024-08-18T22:05:28.922378+0000","last_unstale":"2024-08-18T22:07:11.530967+0000","last_undegraded":"2024-08-18T22:07:11.530967+0000","last_fullsized":"2024-08-18T22:07:11.530967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:23:07.241028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526268+0000","last_change":"2024-08-18T22:05:21.858572+0000","last_active":"2024-08-18T22:07:11.526268+0000","last_peered":"2024-08-18T22:07:11.526268+0000","last_clean":"2024-08-18T22:07:11.526268+0000","last_became_active":"2024-08-18T22:05:21.858254+0000","last_became_peered":"2024-08-18T22:05:21.858254+0000","last_unstale":"2024-08-18T22:07:11.526268+0000","last_undegraded":"2024-08-18T22:07:11.526268+0000","last_fullsized":"2024-08-18T22:07:11.526268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:52.456087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531122+0000","last_change":"2024-08-18T22:05:21.856710+0000","last_active":"2024-08-18T22:07:11.531122+0000","last_peered":"2024-08-18T22:07:11.531122+0000","last_clean":"2024-08-18T22:07:11.531122+0000","last_became_active":"2024-08-18T22:05:21.855399+0000","last_became_peered":"2024-08-18T22:05:21.855399+0000","last_unstale":"2024-08-18T22:07:11.531122+0000","last_undegraded":"2024-08-18T22:07:11.531122+0000","last_fullsized":"2024-08-18T22:07:11.531122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:36.039953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530382+0000","last_change":"2024-08-18T22:05:21.856085+0000","last_active":"2024-08-18T22:07:11.530382+0000","last_peered":"2024-08-18T22:07:11.530382+0000","last_clean":"2024-08-18T22:07:11.530382+0000","last_became_active":"2024-08-18T22:05:21.855263+0000","last_became_peered":"2024-08-18T22:05:21.855263+0000","last_unstale":"2024-08-18T22:07:11.530382+0000","last_undegraded":"2024-08-18T22:07:11.530382+0000","last_fullsized":"2024-08-18T22:07:11.530382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:31.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623250+0000","last_change":"2024-08-18T22:05:21.855385+0000","last_active":"2024-08-18T22:07:11.623250+0000","last_peered":"2024-08-18T22:07:11.623250+0000","last_clean":"2024-08-18T22:07:11.623250+0000","last_became_active":"2024-08-18T22:05:21.854829+0000","last_became_peered":"2024-08-18T22:05:21.854829+0000","last_unstale":"2024-08-18T22:07:11.623250+0000","last_undegraded":"2024-08-18T22:07:11.623250+0000","last_fullsized":"2024-08-18T22:07:11.623250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:59.704154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570888+0000","last_change":"2024-08-18T22:06:10.510370+0000","last_active":"2024-08-18T22:07:11.570888+0000","last_peered":"2024-08-18T22:07:11.570888+0000","last_clean":"2024-08-18T22:07:11.570888+0000","last_became_active":"2024-08-18T22:06:10.509829+0000","last_became_peered":"2024-08-18T22:06:10.509829+0000","last_unstale":"2024-08-18T22:07:11.570888+0000","last_undegraded":"2024-08-18T22:07:11.570888+0000","last_fullsized":"2024-08-18T22:07:11.570888+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:20.171834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526688+0000","last_change":"2024-08-18T22:05:21.856137+0000","last_active":"2024-08-18T22:07:11.526688+0000","last_peered":"2024-08-18T22:07:11.526688+0000","last_clean":"2024-08-18T22:07:11.526688+0000","last_became_active":"2024-08-18T22:05:21.855425+0000","last_became_peered":"2024-08-18T22:05:21.855425+0000","last_unstale":"2024-08-18T22:07:11.526688+0000","last_undegraded":"2024-08-18T22:07:11.526688+0000","last_fullsized":"2024-08-18T22:07:11.526688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:37.514710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531196+0000","last_change":"2024-08-18T22:05:21.856084+0000","last_active":"2024-08-18T22:07:11.531196+0000","last_peered":"2024-08-18T22:07:11.531196+0000","last_clean":"2024-08-18T22:07:11.531196+0000","last_became_active":"2024-08-18T22:05:21.855779+0000","last_became_peered":"2024-08-18T22:05:21.855779+0000","last_unstale":"2024-08-18T22:07:11.531196+0000","last_undegraded":"2024-08-18T22:07:11.531196+0000","last_fullsized":"2024-08-18T22:07:11.531196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:02:47.833634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572883+0000","last_change":"2024-08-18T22:05:21.856729+0000","last_active":"2024-08-18T22:07:11.572883+0000","last_peered":"2024-08-18T22:07:11.572883+0000","last_clean":"2024-08-18T22:07:11.572883+0000","last_became_active":"2024-08-18T22:05:21.856446+0000","last_became_peered":"2024-08-18T22:05:21.856446+0000","last_unstale":"2024-08-18T22:07:11.572883+0000","last_undegraded":"2024-08-18T22:07:11.572883+0000","last_fullsized":"2024-08-18T22:07:11.572883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.482225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528910+0000","last_change":"2024-08-18T22:05:21.851772+0000","last_active":"2024-08-18T22:07:11.528910+0000","last_peered":"2024-08-18T22:07:11.528910+0000","last_clean":"2024-08-18T22:07:11.528910+0000","last_became_active":"2024-08-18T22:05:21.851417+0000","last_became_peered":"2024-08-18T22:05:21.851417+0000","last_unstale":"2024-08-18T22:07:11.528910+0000","last_undegraded":"2024-08-18T22:07:11.528910+0000","last_fullsized":"2024-08-18T22:07:11.528910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:32.509318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572470+0000","last_change":"2024-08-18T22:05:21.857887+0000","last_active":"2024-08-18T22:07:11.572470+0000","last_peered":"2024-08-18T22:07:11.572470+0000","last_clean":"2024-08-18T22:07:11.572470+0000","last_became_active":"2024-08-18T22:05:21.857585+0000","last_became_peered":"2024-08-18T22:05:21.857585+0000","last_unstale":"2024-08-18T22:07:11.572470+0000","last_undegraded":"2024-08-18T22:07:11.572470+0000","last_fullsized":"2024-08-18T22:07:11.572470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:23.299033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528948+0000","last_change":"2024-08-18T22:05:21.854626+0000","last_active":"2024-08-18T22:07:11.528948+0000","last_peered":"2024-08-18T22:07:11.528948+0000","last_clean":"2024-08-18T22:07:11.528948+0000","last_became_active":"2024-08-18T22:05:21.854290+0000","last_became_peered":"2024-08-18T22:05:21.854290+0000","last_unstale":"2024-08-18T22:07:11.528948+0000","last_undegraded":"2024-08-18T22:07:11.528948+0000","last_fullsized":"2024-08-18T22:07:11.528948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:45:24.988669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570558+0000","last_change":"2024-08-18T22:05:21.865863+0000","last_active":"2024-08-18T22:07:11.570558+0000","last_peered":"2024-08-18T22:07:11.570558+0000","last_clean":"2024-08-18T22:07:11.570558+0000","last_became_active":"2024-08-18T22:05:21.864634+0000","last_became_peered":"2024-08-18T22:05:21.864634+0000","last_unstale":"2024-08-18T22:07:11.570558+0000","last_undegraded":"2024-08-18T22:07:11.570558+0000","last_fullsized":"2024-08-18T22:07:11.570558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:34.051147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527095+0000","last_change":"2024-08-18T22:05:21.860193+0000","last_active":"2024-08-18T22:07:11.527095+0000","last_peered":"2024-08-18T22:07:11.527095+0000","last_clean":"2024-08-18T22:07:11.527095+0000","last_became_active":"2024-08-18T22:05:21.859761+0000","last_became_peered":"2024-08-18T22:05:21.859761+0000","last_unstale":"2024-08-18T22:07:11.527095+0000","last_undegraded":"2024-08-18T22:07:11.527095+0000","last_fullsized":"2024-08-18T22:07:11.527095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:18.465913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531192+0000","last_change":"2024-08-18T22:05:21.860569+0000","last_active":"2024-08-18T22:07:11.531192+0000","last_peered":"2024-08-18T22:07:11.531192+0000","last_clean":"2024-08-18T22:07:11.531192+0000","last_became_active":"2024-08-18T22:05:21.860250+0000","last_became_peered":"2024-08-18T22:05:21.860250+0000","last_unstale":"2024-08-18T22:07:11.531192+0000","last_undegraded":"2024-08-18T22:07:11.531192+0000","last_fullsized":"2024-08-18T22:07:11.531192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:52.097840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523697+0000","last_change":"2024-08-18T22:05:21.858271+0000","last_active":"2024-08-18T22:07:11.523697+0000","last_peered":"2024-08-18T22:07:11.523697+0000","last_clean":"2024-08-18T22:07:11.523697+0000","last_became_active":"2024-08-18T22:05:21.857968+0000","last_became_peered":"2024-08-18T22:05:21.857968+0000","last_unstale":"2024-08-18T22:07:11.523697+0000","last_undegraded":"2024-08-18T22:07:11.523697+0000","last_fullsized":"2024-08-18T22:07:11.523697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:24.023136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526949+0000","last_change":"2024-08-18T22:05:21.853799+0000","last_active":"2024-08-18T22:07:11.526949+0000","last_peered":"2024-08-18T22:07:11.526949+0000","last_clean":"2024-08-18T22:07:11.526949+0000","last_became_active":"2024-08-18T22:05:21.853432+0000","last_became_peered":"2024-08-18T22:05:21.853432+0000","last_unstale":"2024-08-18T22:07:11.526949+0000","last_undegraded":"2024-08-18T22:07:11.526949+0000","last_fullsized":"2024-08-18T22:07:11.526949+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:07.429169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528548+0000","last_change":"2024-08-18T22:05:21.855117+0000","last_active":"2024-08-18T22:07:11.528548+0000","last_peered":"2024-08-18T22:07:11.528548+0000","last_clean":"2024-08-18T22:07:11.528548+0000","last_became_active":"2024-08-18T22:05:21.854041+0000","last_became_peered":"2024-08-18T22:05:21.854041+0000","last_unstale":"2024-08-18T22:07:11.528548+0000","last_undegraded":"2024-08-18T22:07:11.528548+0000","last_fullsized":"2024-08-18T22:07:11.528548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:17.222658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623177+0000","last_change":"2024-08-18T22:05:21.861745+0000","last_active":"2024-08-18T22:07:11.623177+0000","last_peered":"2024-08-18T22:07:11.623177+0000","last_clean":"2024-08-18T22:07:11.623177+0000","last_became_active":"2024-08-18T22:05:21.861427+0000","last_became_peered":"2024-08-18T22:05:21.861427+0000","last_unstale":"2024-08-18T22:07:11.623177+0000","last_undegraded":"2024-08-18T22:07:11.623177+0000","last_fullsized":"2024-08-18T22:07:11.623177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:17.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623245+0000","last_change":"2024-08-18T22:05:21.860046+0000","last_active":"2024-08-18T22:07:11.623245+0000","last_peered":"2024-08-18T22:07:11.623245+0000","last_clean":"2024-08-18T22:07:11.623245+0000","last_became_active":"2024-08-18T22:05:21.859674+0000","last_became_peered":"2024-08-18T22:05:21.859674+0000","last_unstale":"2024-08-18T22:07:11.623245+0000","last_undegraded":"2024-08-18T22:07:11.623245+0000","last_fullsized":"2024-08-18T22:07:11.623245+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:44.615270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570548+0000","last_change":"2024-08-18T22:05:21.847647+0000","last_active":"2024-08-18T22:07:11.570548+0000","last_peered":"2024-08-18T22:07:11.570548+0000","last_clean":"2024-08-18T22:07:11.570548+0000","last_became_active":"2024-08-18T22:05:21.847367+0000","last_became_peered":"2024-08-18T22:05:21.847367+0000","last_unstale":"2024-08-18T22:07:11.570548+0000","last_undegraded":"2024-08-18T22:07:11.570548+0000","last_fullsized":"2024-08-18T22:07:11.570548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:33.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573513+0000","last_change":"2024-08-18T22:05:21.861326+0000","last_active":"2024-08-18T22:07:11.573513+0000","last_peered":"2024-08-18T22:07:11.573513+0000","last_clean":"2024-08-18T22:07:11.573513+0000","last_became_active":"2024-08-18T22:05:21.860968+0000","last_became_peered":"2024-08-18T22:05:21.860968+0000","last_unstale":"2024-08-18T22:07:11.573513+0000","last_undegraded":"2024-08-18T22:07:11.573513+0000","last_fullsized":"2024-08-18T22:07:11.573513+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:49.150670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527404+0000","last_change":"2024-08-18T22:05:21.852618+0000","last_active":"2024-08-18T22:07:11.527404+0000","last_peered":"2024-08-18T22:07:11.527404+0000","last_clean":"2024-08-18T22:07:11.527404+0000","last_became_active":"2024-08-18T22:05:21.852318+0000","last_became_peered":"2024-08-18T22:05:21.852318+0000","last_unstale":"2024-08-18T22:07:11.527404+0000","last_undegraded":"2024-08-18T22:07:11.527404+0000","last_fullsized":"2024-08-18T22:07:11.527404+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:06:49.085150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522585+0000","last_change":"2024-08-18T22:05:21.860108+0000","last_active":"2024-08-18T22:07:11.522585+0000","last_peered":"2024-08-18T22:07:11.522585+0000","last_clean":"2024-08-18T22:07:11.522585+0000","last_became_active":"2024-08-18T22:05:21.859794+0000","last_became_peered":"2024-08-18T22:05:21.859794+0000","last_unstale":"2024-08-18T22:07:11.522585+0000","last_undegraded":"2024-08-18T22:07:11.522585+0000","last_fullsized":"2024-08-18T22:07:11.522585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:01.974202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529519+0000","last_change":"2024-08-18T22:05:21.856404+0000","last_active":"2024-08-18T22:07:11.529519+0000","last_peered":"2024-08-18T22:07:11.529519+0000","last_clean":"2024-08-18T22:07:11.529519+0000","last_became_active":"2024-08-18T22:05:21.855800+0000","last_became_peered":"2024-08-18T22:05:21.855800+0000","last_unstale":"2024-08-18T22:07:11.529519+0000","last_undegraded":"2024-08-18T22:07:11.529519+0000","last_fullsized":"2024-08-18T22:07:11.529519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:09.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572303+0000","last_change":"2024-08-18T22:05:21.859891+0000","last_active":"2024-08-18T22:07:11.572303+0000","last_peered":"2024-08-18T22:07:11.572303+0000","last_clean":"2024-08-18T22:07:11.572303+0000","last_became_active":"2024-08-18T22:05:21.859407+0000","last_became_peered":"2024-08-18T22:05:21.859407+0000","last_unstale":"2024-08-18T22:07:11.572303+0000","last_undegraded":"2024-08-18T22:07:11.572303+0000","last_fullsized":"2024-08-18T22:07:11.572303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:59.285627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527004+0000","last_change":"2024-08-18T22:05:21.856428+0000","last_active":"2024-08-18T22:07:11.527004+0000","last_peered":"2024-08-18T22:07:11.527004+0000","last_clean":"2024-08-18T22:07:11.527004+0000","last_became_active":"2024-08-18T22:05:21.853374+0000","last_became_peered":"2024-08-18T22:05:21.853374+0000","last_unstale":"2024-08-18T22:07:11.527004+0000","last_undegraded":"2024-08-18T22:07:11.527004+0000","last_fullsized":"2024-08-18T22:07:11.527004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:07.087171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522013+0000","last_change":"2024-08-18T22:05:21.852688+0000","last_active":"2024-08-18T22:07:11.522013+0000","last_peered":"2024-08-18T22:07:11.522013+0000","last_clean":"2024-08-18T22:07:11.522013+0000","last_became_active":"2024-08-18T22:05:21.851107+0000","last_became_peered":"2024-08-18T22:05:21.851107+0000","last_unstale":"2024-08-18T22:07:11.522013+0000","last_undegraded":"2024-08-18T22:07:11.522013+0000","last_fullsized":"2024-08-18T22:07:11.522013+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:48.267166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524546+0000","last_change":"2024-08-18T22:05:21.850809+0000","last_active":"2024-08-18T22:07:11.524546+0000","last_peered":"2024-08-18T22:07:11.524546+0000","last_clean":"2024-08-18T22:07:11.524546+0000","last_became_active":"2024-08-18T22:05:21.850510+0000","last_became_peered":"2024-08-18T22:05:21.850510+0000","last_unstale":"2024-08-18T22:07:11.524546+0000","last_undegraded":"2024-08-18T22:07:11.524546+0000","last_fullsized":"2024-08-18T22:07:11.524546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:39.338051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573466+0000","last_change":"2024-08-18T22:05:21.856156+0000","last_active":"2024-08-18T22:07:11.573466+0000","last_peered":"2024-08-18T22:07:11.573466+0000","last_clean":"2024-08-18T22:07:11.573466+0000","last_became_active":"2024-08-18T22:05:21.855830+0000","last_became_peered":"2024-08-18T22:05:21.855830+0000","last_unstale":"2024-08-18T22:07:11.573466+0000","last_undegraded":"2024-08-18T22:07:11.573466+0000","last_fullsized":"2024-08-18T22:07:11.573466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:10.670405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623466+0000","last_change":"2024-08-18T22:05:21.865162+0000","last_active":"2024-08-18T22:07:11.623466+0000","last_peered":"2024-08-18T22:07:11.623466+0000","last_clean":"2024-08-18T22:07:11.623466+0000","last_became_active":"2024-08-18T22:05:21.864842+0000","last_became_peered":"2024-08-18T22:05:21.864842+0000","last_unstale":"2024-08-18T22:07:11.623466+0000","last_undegraded":"2024-08-18T22:07:11.623466+0000","last_fullsized":"2024-08-18T22:07:11.623466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:21.388638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623496+0000","last_change":"2024-08-18T22:05:21.859227+0000","last_active":"2024-08-18T22:07:11.623496+0000","last_peered":"2024-08-18T22:07:11.623496+0000","last_clean":"2024-08-18T22:07:11.623496+0000","last_became_active":"2024-08-18T22:05:21.858886+0000","last_became_peered":"2024-08-18T22:05:21.858886+0000","last_unstale":"2024-08-18T22:07:11.623496+0000","last_undegraded":"2024-08-18T22:07:11.623496+0000","last_fullsized":"2024-08-18T22:07:11.623496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:08.710772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526871+0000","last_change":"2024-08-18T22:05:21.854864+0000","last_active":"2024-08-18T22:07:11.526871+0000","last_peered":"2024-08-18T22:07:11.526871+0000","last_clean":"2024-08-18T22:07:11.526871+0000","last_became_active":"2024-08-18T22:05:21.854522+0000","last_became_peered":"2024-08-18T22:05:21.854522+0000","last_unstale":"2024-08-18T22:07:11.526871+0000","last_undegraded":"2024-08-18T22:07:11.526871+0000","last_fullsized":"2024-08-18T22:07:11.526871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:32.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72119,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":687,"num_read_kb":416,"num_write":180,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":216357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514537,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1052672,"data_stored":523218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743472,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37048,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708104,"statfs":{"total":95995035648,"available":95957098496,"internally_reserved":0,"allocated":1753088,"data_stored":1182560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906996,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":523454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168633,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1069056,"data_stored":523374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397564,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36968,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708184,"statfs":{"total":95995035648,"available":95957180416,"internally_reserved":0,"allocated":1662976,"data_stored":1119954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561090,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":518630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790021,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28656,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716496,"statfs":{"total":95995035648,"available":95965691904,"internally_reserved":0,"allocated":1671168,"data_stored":1115011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953547,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36448,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708704,"statfs":{"total":95995035648,"available":95957712896,"internally_reserved":0,"allocated":1138688,"data_stored":591258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1060864,"data_stored":518824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":520421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":585987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1073152,"data_stored":520018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:07:50.629 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:07:50.810 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:50 smithi183 ceph-mon[22097]: pgmap v342: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-18T22:07:50.810 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:50 smithi183 ceph-mon[22097]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:50.811 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:50 smithi183 ceph-mon[22097]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:50.911 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:51.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:50 smithi130 ceph-mon[21698]: pgmap v342: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-18T22:07:51.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:50 smithi130 ceph-mon[21698]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:51.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:50 smithi130 ceph-mon[21698]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:51.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.404+0000 7fa06e456640 1 -- 172.21.15.123:0/2029418540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068101150 msgr2=0x7fa06810d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:51.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.404+0000 7fa06e456640 1 --2- 172.21.15.123:0/2029418540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068101150 0x7fa06810d680 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa060009cd0 tx=0x7fa06002a8e0 comp rx=0 tx=0).stop 2024-08-18T22:07:51.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.404+0000 7fa06e456640 1 -- 172.21.15.123:0/2029418540 shutdown_connections 2024-08-18T22:07:51.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.404+0000 7fa06e456640 1 --2- 172.21.15.123:0/2029418540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068101150 0x7fa06810d680 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:51.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.404+0000 7fa06e456640 1 --2- 172.21.15.123:0/2029418540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0681007b0 0x7fa068100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:51.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.404+0000 7fa06e456640 1 --2- 172.21.15.123:0/2029418540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0681067b0 0x7fa068106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:51.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.404+0000 7fa06e456640 1 -- 172.21.15.123:0/2029418540 >> 172.21.15.123:0/2029418540 conn(0x7fa0680fc4d0 msgr2=0x7fa0680fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:51.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.404+0000 7fa06e456640 1 -- 172.21.15.123:0/2029418540 shutdown_connections 2024-08-18T22:07:51.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.404+0000 7fa06e456640 1 -- 172.21.15.123:0/2029418540 wait complete. 2024-08-18T22:07:51.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.404+0000 7fa06e456640 1 Processor -- start 2024-08-18T22:07:51.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa06e456640 1 -- start start 2024-08-18T22:07:51.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa06e456640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0681007b0 0x7fa0681970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:51.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa06e456640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068101150 0x7fa0681975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:51.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa06e456640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0681067b0 0x7fa06819b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:51.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa06e456640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa068110bd0 con 0x7fa068101150 2024-08-18T22:07:51.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa06e456640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa068110a50 con 0x7fa0681067b0 2024-08-18T22:07:51.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa06e456640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa068110d50 con 0x7fa0681007b0 2024-08-18T22:07:51.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa05ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068101150 0x7fa0681975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:51.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa05ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068101150 0x7fa0681975f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47704/0 (socket says 172.21.15.123:47704) 2024-08-18T22:07:51.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa05ffff640 1 -- 172.21.15.123:0/814899564 learned_addr learned my addr 172.21.15.123:0/814899564 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:51.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa067fff640 1 --2- 172.21.15.123:0/814899564 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0681007b0 0x7fa0681970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:51.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa06c9f3640 1 --2- 172.21.15.123:0/814899564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0681067b0 0x7fa06819b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:51.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa05ffff640 1 -- 172.21.15.123:0/814899564 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0681007b0 msgr2=0x7fa0681970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:51.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa05ffff640 1 --2- 172.21.15.123:0/814899564 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0681007b0 0x7fa0681970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:51.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa05ffff640 1 -- 172.21.15.123:0/814899564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0681067b0 msgr2=0x7fa06819b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:51.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa05ffff640 1 --2- 172.21.15.123:0/814899564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0681067b0 0x7fa06819b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:51.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa05ffff640 1 -- 172.21.15.123:0/814899564 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06819c060 con 0x7fa068101150 2024-08-18T22:07:51.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa06c9f3640 1 --2- 172.21.15.123:0/814899564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0681067b0 0x7fa06819b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:51.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.405+0000 7fa05ffff640 1 --2- 172.21.15.123:0/814899564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068101150 0x7fa0681975f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa05000b4a0 tx=0x7fa05000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:51.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.406+0000 7fa065ffb640 1 -- 172.21.15.123:0/814899564 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa050014070 con 0x7fa068101150 2024-08-18T22:07:51.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.406+0000 7fa065ffb640 1 -- 172.21.15.123:0/814899564 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa050010af0 con 0x7fa068101150 2024-08-18T22:07:51.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.406+0000 7fa065ffb640 1 -- 172.21.15.123:0/814899564 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa050017d10 con 0x7fa068101150 2024-08-18T22:07:51.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.406+0000 7fa06e456640 1 -- 172.21.15.123:0/814899564 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06819c350 con 0x7fa068101150 2024-08-18T22:07:51.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.406+0000 7fa06e456640 1 -- 172.21.15.123:0/814899564 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0681a3c30 con 0x7fa068101150 2024-08-18T22:07:51.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.407+0000 7fa06e456640 1 -- 172.21.15.123:0/814899564 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa068100c10 con 0x7fa068101150 2024-08-18T22:07:51.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.408+0000 7fa065ffb640 1 -- 172.21.15.123:0/814899564 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fa050017070 con 0x7fa068101150 2024-08-18T22:07:51.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.408+0000 7fa065ffb640 1 --2- 172.21.15.123:0/814899564 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa0540a2c00 0x7fa0540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:51.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.409+0000 7fa065ffb640 1 -- 172.21.15.123:0/814899564 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fa0500ceb30 con 0x7fa068101150 2024-08-18T22:07:51.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.409+0000 7fa067fff640 1 --2- 172.21.15.123:0/814899564 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa0540a2c00 0x7fa0540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:51.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.409+0000 7fa067fff640 1 --2- 172.21.15.123:0/814899564 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa0540a2c00 0x7fa0540a50c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa0580058c0 tx=0x7fa05800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:51.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.412+0000 7fa065ffb640 1 -- 172.21.15.123:0/814899564 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa05009b700 con 0x7fa068101150 2024-08-18T22:07:51.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.615+0000 7fa06e456640 1 -- 172.21.15.123:0/814899564 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa068198410 con 0x7fa068101150 2024-08-18T22:07:51.616 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:51 smithi123 ceph-mon[18462]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:51.616 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:51 smithi123 ceph-mon[18462]: pgmap v343: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-08-18T22:07:51.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.615+0000 7fa065ffb640 1 -- 172.21.15.123:0/814899564 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7fa068198410 con 0x7fa068101150 2024-08-18T22:07:51.617 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:51.617 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"btime":"2024-08-18T22:07:46:492460+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:07:45.601053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:07:51.617 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 26 2024-08-18T22:07:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.618+0000 7fa06e456640 1 -- 172.21.15.123:0/814899564 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa0540a2c00 msgr2=0x7fa0540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.618+0000 7fa06e456640 1 --2- 172.21.15.123:0/814899564 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa0540a2c00 0x7fa0540a50c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa0580058c0 tx=0x7fa05800a2d0 comp rx=0 tx=0).stop 2024-08-18T22:07:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.618+0000 7fa06e456640 1 -- 172.21.15.123:0/814899564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068101150 msgr2=0x7fa0681975f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.618+0000 7fa06e456640 1 --2- 172.21.15.123:0/814899564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068101150 0x7fa0681975f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa05000b4a0 tx=0x7fa05000b960 comp rx=0 tx=0).stop 2024-08-18T22:07:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.618+0000 7fa06e456640 1 -- 172.21.15.123:0/814899564 shutdown_connections 2024-08-18T22:07:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.618+0000 7fa06e456640 1 --2- 172.21.15.123:0/814899564 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa0540a2c00 0x7fa0540a50c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.618+0000 7fa06e456640 1 --2- 172.21.15.123:0/814899564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0681067b0 0x7fa06819b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.618+0000 7fa06e456640 1 --2- 172.21.15.123:0/814899564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068101150 0x7fa0681975f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.618+0000 7fa06e456640 1 --2- 172.21.15.123:0/814899564 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0681007b0 0x7fa0681970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.618+0000 7fa06e456640 1 -- 172.21.15.123:0/814899564 >> 172.21.15.123:0/814899564 conn(0x7fa0680fc4d0 msgr2=0x7fa0680fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:51.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.618+0000 7fa06e456640 1 -- 172.21.15.123:0/814899564 shutdown_connections 2024-08-18T22:07:51.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:51.618+0000 7fa06e456640 1 -- 172.21.15.123:0/814899564 wait complete. 2024-08-18T22:07:51.835 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:51 smithi183 ceph-mon[22097]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:51.836 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:51 smithi183 ceph-mon[22097]: pgmap v343: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-08-18T22:07:52.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:51 smithi130 ceph-mon[21698]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:52.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:51 smithi130 ceph-mon[21698]: pgmap v343: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-08-18T22:07:52.318 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:07:52.572 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:52.694 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:52 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/814899564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:52.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:52 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/814899564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:53.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:52 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/814899564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:07:53.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.093+0000 7f4f743b0640 1 -- 172.21.15.123:0/2826094389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c1078b0 msgr2=0x7f4f6c107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:53.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.093+0000 7f4f743b0640 1 --2- 172.21.15.123:0/2826094389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c1078b0 0x7f4f6c107c90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009930 tx=0x7f4f6002a420 comp rx=0 tx=0).stop 2024-08-18T22:07:53.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.093+0000 7f4f743b0640 1 -- 172.21.15.123:0/2826094389 shutdown_connections 2024-08-18T22:07:53.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.093+0000 7f4f743b0640 1 --2- 172.21.15.123:0/2826094389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f6c102250 0x7f4f6c10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:53.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.093+0000 7f4f743b0640 1 --2- 172.21.15.123:0/2826094389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f6c1018b0 0x7f4f6c101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:53.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.093+0000 7f4f743b0640 1 --2- 172.21.15.123:0/2826094389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c1078b0 0x7f4f6c107c90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:53.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.093+0000 7f4f743b0640 1 -- 172.21.15.123:0/2826094389 >> 172.21.15.123:0/2826094389 conn(0x7f4f6c0fd5f0 msgr2=0x7f4f6c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:53.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.093+0000 7f4f743b0640 1 -- 172.21.15.123:0/2826094389 shutdown_connections 2024-08-18T22:07:53.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.093+0000 7f4f743b0640 1 -- 172.21.15.123:0/2826094389 wait complete. 2024-08-18T22:07:53.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f743b0640 1 Processor -- start 2024-08-18T22:07:53.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f743b0640 1 -- start start 2024-08-18T22:07:53.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f743b0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f6c1018b0 0x7f4f6c198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:53.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f743b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f6c102250 0x7f4f6c1987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:53.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f743b0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c1078b0 0x7f4f6c19cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:53.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f743b0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c111d20 con 0x7f4f6c1078b0 2024-08-18T22:07:53.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f743b0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c111ba0 con 0x7f4f6c1018b0 2024-08-18T22:07:53.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f743b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c111ea0 con 0x7f4f6c102250 2024-08-18T22:07:53.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f7294d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c1078b0 0x7f4f6c19cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:53.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f7294d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c1078b0 0x7f4f6c19cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46276/0 (socket says 172.21.15.123:46276) 2024-08-18T22:07:53.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f7294d640 1 -- 172.21.15.123:0/1211592362 learned_addr learned my addr 172.21.15.123:0/1211592362 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:53.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f7194b640 1 --2- 172.21.15.123:0/1211592362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f6c102250 0x7f4f6c1987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:53.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f7214c640 1 --2- 172.21.15.123:0/1211592362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f6c1018b0 0x7f4f6c198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:53.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f7294d640 1 -- 172.21.15.123:0/1211592362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f6c102250 msgr2=0x7f4f6c1987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:53.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f7294d640 1 --2- 172.21.15.123:0/1211592362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f6c102250 0x7f4f6c1987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:53.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f7294d640 1 -- 172.21.15.123:0/1211592362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f6c1018b0 msgr2=0x7f4f6c198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:53.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f7294d640 1 --2- 172.21.15.123:0/1211592362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f6c1018b0 0x7f4f6c198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:53.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.094+0000 7f4f7294d640 1 -- 172.21.15.123:0/1211592362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6c19d210 con 0x7f4f6c1078b0 2024-08-18T22:07:53.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.095+0000 7f4f7294d640 1 --2- 172.21.15.123:0/1211592362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c1078b0 0x7f4f6c19cb30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009fd0 tx=0x7f4f6400def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.095+0000 7f4f5f7fe640 1 -- 172.21.15.123:0/1211592362 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f64017070 con 0x7f4f6c1078b0 2024-08-18T22:07:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.095+0000 7f4f5f7fe640 1 -- 172.21.15.123:0/1211592362 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f64003e50 con 0x7f4f6c1078b0 2024-08-18T22:07:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.095+0000 7f4f743b0640 1 -- 172.21.15.123:0/1211592362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f6c19d500 con 0x7f4f6c1078b0 2024-08-18T22:07:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.095+0000 7f4f5f7fe640 1 -- 172.21.15.123:0/1211592362 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f64010460 con 0x7f4f6c1078b0 2024-08-18T22:07:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.095+0000 7f4f743b0640 1 -- 172.21.15.123:0/1211592362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f6c1a4de0 con 0x7f4f6c1078b0 2024-08-18T22:07:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.096+0000 7f4f743b0640 1 -- 172.21.15.123:0/1211592362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f6c101d10 con 0x7f4f6c1078b0 2024-08-18T22:07:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.097+0000 7f4f5f7fe640 1 -- 172.21.15.123:0/1211592362 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f4f64003970 con 0x7f4f6c1078b0 2024-08-18T22:07:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.097+0000 7f4f5f7fe640 1 --2- 172.21.15.123:0/1211592362 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4f580a2b80 0x7f4f580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.098+0000 7f4f7214c640 1 --2- 172.21.15.123:0/1211592362 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4f580a2b80 0x7f4f580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.098+0000 7f4f5f7fe640 1 -- 172.21.15.123:0/1211592362 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f4f640cf0f0 con 0x7f4f6c1078b0 2024-08-18T22:07:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.098+0000 7f4f7214c640 1 --2- 172.21.15.123:0/1211592362 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4f580a2b80 0x7f4f580a5040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4f60006010 tx=0x7f4f60005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.102+0000 7f4f5f7fe640 1 -- 172.21.15.123:0/1211592362 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4f6409bcc0 con 0x7f4f6c1078b0 2024-08-18T22:07:53.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.268+0000 7f4f743b0640 1 -- 172.21.15.123:0/1211592362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f6c109e80 con 0x7f4f6c1078b0 2024-08-18T22:07:53.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.271+0000 7f4f5f7fe640 1 -- 172.21.15.123:0/1211592362 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24810 (secure 0 0 0) 0x7f4f6409b5c0 con 0x7f4f6c1078b0 2024-08-18T22:07:53.272 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:53.272 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":92,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:07:11.513362+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:05:18.077632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:05:20.808463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:05:27.136662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:07:53.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.273+0000 7f4f743b0640 1 -- 172.21.15.123:0/1211592362 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4f580a2b80 msgr2=0x7f4f580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:53.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.273+0000 7f4f743b0640 1 --2- 172.21.15.123:0/1211592362 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4f580a2b80 0x7f4f580a5040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4f60006010 tx=0x7f4f60005a20 comp rx=0 tx=0).stop 2024-08-18T22:07:53.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.273+0000 7f4f743b0640 1 -- 172.21.15.123:0/1211592362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c1078b0 msgr2=0x7f4f6c19cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:53.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.273+0000 7f4f743b0640 1 --2- 172.21.15.123:0/1211592362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c1078b0 0x7f4f6c19cb30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009fd0 tx=0x7f4f6400def0 comp rx=0 tx=0).stop 2024-08-18T22:07:53.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.273+0000 7f4f743b0640 1 -- 172.21.15.123:0/1211592362 shutdown_connections 2024-08-18T22:07:53.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.273+0000 7f4f743b0640 1 --2- 172.21.15.123:0/1211592362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c1078b0 0x7f4f6c19cb30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:53.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.273+0000 7f4f743b0640 1 --2- 172.21.15.123:0/1211592362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f6c102250 0x7f4f6c1987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:53.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.273+0000 7f4f743b0640 1 --2- 172.21.15.123:0/1211592362 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4f580a2b80 0x7f4f580a5040 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:53.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.273+0000 7f4f743b0640 1 --2- 172.21.15.123:0/1211592362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f6c1018b0 0x7f4f6c198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:53.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.273+0000 7f4f743b0640 1 -- 172.21.15.123:0/1211592362 >> 172.21.15.123:0/1211592362 conn(0x7f4f6c0fd5f0 msgr2=0x7f4f6c0fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:53.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.273+0000 7f4f743b0640 1 -- 172.21.15.123:0/1211592362 shutdown_connections 2024-08-18T22:07:53.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:53.273+0000 7f4f743b0640 1 -- 172.21.15.123:0/1211592362 wait complete. 2024-08-18T22:07:53.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:53 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1211592362' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:07:53.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:53 smithi183 ceph-mon[22097]: pgmap v344: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-08-18T22:07:53.945 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:53 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1211592362' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:07:53.945 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:53 smithi123 ceph-mon[18462]: pgmap v344: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-08-18T22:07:53.973 DEBUG:tasks.fwd_scrub:Yielding 2024-08-18T22:07:53.973 INFO:teuthology.run_tasks:Running task background_exec... 2024-08-18T22:07:53.983 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi123.front.sepia.ceph.com 2024-08-18T22:07:53.983 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-08-18T22:07:53.984 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-08-18T22:07:53.984 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-18T22:07:53.984 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-18T22:07:53.986 INFO:teuthology.run_tasks:Running task quiescer... 2024-08-18T22:07:53.999 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-18T22:07:53.999 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-18T22:07:54.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:53 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1211592362' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:07:54.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:53 smithi130 ceph-mon[21698]: pgmap v344: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-08-18T22:07:54.252 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:54.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.966+0000 7f5b6cf9b640 1 -- 172.21.15.123:0/2996950388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b68103390 msgr2=0x7f5b6810b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.966+0000 7f5b6cf9b640 1 --2- 172.21.15.123:0/2996950388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b68103390 0x7f5b6810b880 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5b50009900 tx=0x7f5b5002a480 comp rx=0 tx=0).stop 2024-08-18T22:07:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.966+0000 7f5b6cf9b640 1 -- 172.21.15.123:0/2996950388 shutdown_connections 2024-08-18T22:07:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.966+0000 7f5b6cf9b640 1 --2- 172.21.15.123:0/2996950388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b6810bea0 0x7f5b6810e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.966+0000 7f5b6cf9b640 1 --2- 172.21.15.123:0/2996950388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b68103390 0x7f5b6810b880 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.966+0000 7f5b6cf9b640 1 --2- 172.21.15.123:0/2996950388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b68102a70 0x7f5b68102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.966+0000 7f5b6cf9b640 1 -- 172.21.15.123:0/2996950388 >> 172.21.15.123:0/2996950388 conn(0x7f5b680fc4d0 msgr2=0x7f5b680fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.966+0000 7f5b6cf9b640 1 -- 172.21.15.123:0/2996950388 shutdown_connections 2024-08-18T22:07:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.966+0000 7f5b6cf9b640 1 -- 172.21.15.123:0/2996950388 wait complete. 2024-08-18T22:07:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.967+0000 7f5b6cf9b640 1 Processor -- start 2024-08-18T22:07:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.967+0000 7f5b6cf9b640 1 -- start start 2024-08-18T22:07:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.967+0000 7f5b6cf9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b68102a70 0x7f5b68198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.967+0000 7f5b6cf9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b68103390 0x7f5b68198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.967+0000 7f5b6cf9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b6810bea0 0x7f5b6819cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.967+0000 7f5b6cf9b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5b68111d00 con 0x7f5b6810bea0 2024-08-18T22:07:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.967+0000 7f5b6cf9b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b68111b80 con 0x7f5b68103390 2024-08-18T22:07:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.967+0000 7f5b6cf9b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5b68111e80 con 0x7f5b68102a70 2024-08-18T22:07:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b66d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b6810bea0 0x7f5b6819cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b66d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b6810bea0 0x7f5b6819cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46298/0 (socket says 172.21.15.123:46298) 2024-08-18T22:07:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b66d9d640 1 -- 172.21.15.123:0/2181089732 learned_addr learned my addr 172.21.15.123:0/2181089732 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b6659c640 1 --2- 172.21.15.123:0/2181089732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b68102a70 0x7f5b68198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/2181089732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b68103390 0x7f5b68198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b66d9d640 1 -- 172.21.15.123:0/2181089732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b68102a70 msgr2=0x7f5b68198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b66d9d640 1 --2- 172.21.15.123:0/2181089732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b68102a70 0x7f5b68198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b66d9d640 1 -- 172.21.15.123:0/2181089732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b68103390 msgr2=0x7f5b68198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b66d9d640 1 --2- 172.21.15.123:0/2181089732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b68103390 0x7f5b68198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b66d9d640 1 -- 172.21.15.123:0/2181089732 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6819d1b0 con 0x7f5b6810bea0 2024-08-18T22:07:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/2181089732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b68103390 0x7f5b68198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b66d9d640 1 --2- 172.21.15.123:0/2181089732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b6810bea0 0x7f5b6819cad0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000cad0 tx=0x7f5b6000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b5ffff640 1 -- 172.21.15.123:0/2181089732 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6000ad60 con 0x7f5b6810bea0 2024-08-18T22:07:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b5ffff640 1 -- 172.21.15.123:0/2181089732 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b60005020 con 0x7f5b6810bea0 2024-08-18T22:07:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b6cf9b640 1 -- 172.21.15.123:0/2181089732 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b6819d4a0 con 0x7f5b6810bea0 2024-08-18T22:07:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b5ffff640 1 -- 172.21.15.123:0/2181089732 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6000f6b0 con 0x7f5b6810bea0 2024-08-18T22:07:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.968+0000 7f5b6cf9b640 1 -- 172.21.15.123:0/2181089732 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b681a4d80 con 0x7f5b6810bea0 2024-08-18T22:07:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.971+0000 7f5b5ffff640 1 -- 172.21.15.123:0/2181089732 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f5b60005560 con 0x7f5b6810bea0 2024-08-18T22:07:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.971+0000 7f5b6f399740 1 Processor -- start 2024-08-18T22:07:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.971+0000 7f5b6f399740 1 -- start start 2024-08-18T22:07:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.971+0000 7f5b6f399740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9e2200 0x55c45d9e25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.971+0000 7f5b6f399740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2b20 0x55c45d9ecea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.971+0000 7f5b6f399740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9ed3e0 0x55c45d9ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:54.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.971+0000 7f5b6f399740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c45d9a5e40 con 0x55c45d9ed3e0 2024-08-18T22:07:54.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.971+0000 7f5b6f399740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c45d9477f0 con 0x55c45d9e2200 2024-08-18T22:07:54.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.971+0000 7f5b6f399740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c45d8eefb0 con 0x55c45d9e2b20 2024-08-18T22:07:54.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b5ffff640 1 --2- 172.21.15.123:0/2181089732 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5b540a2b80 0x7f5b540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:54.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b5dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9ed3e0 0x55c45d9ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:54.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b5dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9ed3e0 0x55c45d9ef7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46314/0 (socket says 172.21.15.123:46314) 2024-08-18T22:07:54.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b5dd9b640 1 -- 172.21.15.123:0/2356468170 learned_addr learned my addr 172.21.15.123:0/2356468170 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:54.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b6659c640 1 --2- 172.21.15.123:0/2356468170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2b20 0x55c45d9ecea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:54.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b66d9d640 1 --2- 172.21.15.123:0/2181089732 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5b540a2b80 0x7f5b540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:54.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/2356468170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9e2200 0x55c45d9e25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:54.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b5ffff640 1 -- 172.21.15.123:0/2181089732 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f5b600cf370 con 0x7f5b6810bea0 2024-08-18T22:07:54.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b5dd9b640 1 -- 172.21.15.123:0/2356468170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2b20 msgr2=0x55c45d9ecea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/2356468170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2b20 0x55c45d9ecea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b5dd9b640 1 -- 172.21.15.123:0/2356468170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9e2200 msgr2=0x55c45d9e25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/2356468170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9e2200 0x55c45d9e25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b5dd9b640 1 -- 172.21.15.123:0/2356468170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c45d6b96a0 con 0x55c45d9ed3e0 2024-08-18T22:07:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b6659c640 1 --2- 172.21.15.123:0/2356468170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2b20 0x55c45d9ecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:07:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/2356468170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9ed3e0 0x55c45d9ef7d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5b50032fd0 tx=0x7f5b50031480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0edc2e7af7a8646 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b66d9d640 1 --2- 172.21.15.123:0/2181089732 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5b540a2b80 0x7f5b540a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5b600982b0 tx=0x7f5b600c6470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b5cd99640 1 -- 172.21.15.123:0/2356468170 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50035040 con 0x55c45d9ed3e0 2024-08-18T22:07:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b5cd99640 1 -- 172.21.15.123:0/2356468170 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b50031730 con 0x55c45d9ed3e0 2024-08-18T22:07:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.972+0000 7f5b5cd99640 1 -- 172.21.15.123:0/2356468170 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b500047a0 con 0x55c45d9ed3e0 2024-08-18T22:07:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.973+0000 7f5b6f399740 1 -- 172.21.15.123:0/2356468170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9ed3e0 msgr2=0x55c45d9ef7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.973+0000 7f5b6f399740 1 --2- 172.21.15.123:0/2356468170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9ed3e0 0x55c45d9ef7d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5b50032fd0 tx=0x7f5b50031480 comp rx=0 tx=0).stop 2024-08-18T22:07:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.973+0000 7f5b6f399740 1 -- 172.21.15.123:0/2356468170 shutdown_connections 2024-08-18T22:07:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.973+0000 7f5b6f399740 1 --2- 172.21.15.123:0/2356468170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9ed3e0 0x55c45d9ef7d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.973+0000 7f5b6f399740 1 --2- 172.21.15.123:0/2356468170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2b20 0x55c45d9ecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.973+0000 7f5b6f399740 1 --2- 172.21.15.123:0/2356468170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9e2200 0x55c45d9e25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.973+0000 7f5b6f399740 1 -- 172.21.15.123:0/2356468170 >> 172.21.15.123:0/2356468170 conn(0x55c45d9de790 msgr2=0x55c45d9deb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.973+0000 7f5b6f399740 1 -- 172.21.15.123:0/2356468170 shutdown_connections 2024-08-18T22:07:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.973+0000 7f5b6f399740 1 -- 172.21.15.123:0/2356468170 wait complete. 2024-08-18T22:07:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.973+0000 7f5b6f399740 1 -- start start 2024-08-18T22:07:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6f399740 1 Processor -- start 2024-08-18T22:07:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6f399740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2200 0x55c45d9ea340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6f399740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9e2b20 0x55c45d9ea880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6f399740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9ed3e0 0x55c45d9eadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6f399740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c45d902cb0 con 0x55c45d9e2b20 2024-08-18T22:07:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6f399740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c45d9437b0 con 0x55c45d9ed3e0 2024-08-18T22:07:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6f399740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c45d9effb0 con 0x55c45d9e2200 2024-08-18T22:07:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6f399740 10 client.0 _ll_register_callbacks cb 0x55c45d656ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9e2b20 0x55c45d9ea880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9e2b20 0x55c45d9ea880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46324/0 (socket says 172.21.15.123:46324) 2024-08-18T22:07:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6659c640 1 -- 172.21.15.123:0/2687015892 learned_addr learned my addr 172.21.15.123:0/2687015892 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/2687015892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2200 0x55c45d9ea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6659c640 1 -- 172.21.15.123:0/2687015892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2200 msgr2=0x55c45d9ea340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6659c640 1 --2- 172.21.15.123:0/2687015892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2200 0x55c45d9ea340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/2687015892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9ed3e0 0x55c45d9eadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6659c640 1 -- 172.21.15.123:0/2687015892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9ed3e0 msgr2=0x55c45d9eadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6659c640 1 --2- 172.21.15.123:0/2687015892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9ed3e0 0x55c45d9eadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6659c640 1 -- 172.21.15.123:0/2687015892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c45d901bc0 con 0x55c45d9e2b20 2024-08-18T22:07:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b6659c640 1 --2- 172.21.15.123:0/2687015892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9e2b20 0x55c45d9ea880 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5b58011540 tx=0x7f5b58011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b340d22dfcd78b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.974+0000 7f5b4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.975+0000 7f5b4dffb640 1 -- 172.21.15.123:0/2687015892 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5800f6d0 con 0x55c45d9e2b20 2024-08-18T22:07:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.975+0000 7f5b4dffb640 1 -- 172.21.15.123:0/2687015892 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f5b5800f870 con 0x55c45d9e2b20 2024-08-18T22:07:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.975+0000 7f5b6f399740 1 -- 172.21.15.123:0/2687015892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b50031730 con 0x55c45d9e2b20 2024-08-18T22:07:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.975+0000 7f5b4dffb640 1 -- 172.21.15.123:0/2687015892 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5b5800fa70 con 0x55c45d9e2b20 2024-08-18T22:07:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.975+0000 7f5b6f399740 10 client.15309 fetch_fsmap learned FSMap version 26 2024-08-18T22:07:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.975+0000 7f5b6f399740 1 -- 172.21.15.123:0/2687015892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c45d9fbf50 con 0x55c45d9e2b20 2024-08-18T22:07:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.975+0000 7f5b4dffb640 1 -- 172.21.15.123:0/2687015892 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b50031730 con 0x55c45d9e2b20 2024-08-18T22:07:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.975+0000 7f5b4dffb640 1 -- 172.21.15.123:0/2687015892 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5b58027420 con 0x55c45d9e2b20 2024-08-18T22:07:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.975+0000 7f5b6f399740 10 client.15309 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:07:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.975+0000 7f5b6f399740 10 client.15309 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:07:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.975+0000 7f5b6f399740 20 client.15309 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.975+0000 7f5b6f399740 1 --2- 172.21.15.123:0/2687015892 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c45d9fd460 0x55c45d9ff850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.975+0000 7f5b6f399740 4 client.15309 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:07:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.975+0000 7f5b6f399740 1 -- 172.21.15.123:0/2687015892 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c45d954d60 con 0x55c45d9fd460 2024-08-18T22:07:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.976+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/2687015892 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c45d9fd460 0x55c45d9ff850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.976+0000 7f5b4dffb640 10 client.15309 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.976+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/2687015892 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c45d9fd460 0x55c45d9ff850 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91f1d76371228e82 server_cookie=36da9f893ad635d0 in_seq=0 out_seq=0 2024-08-18T22:07:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.977+0000 7f5b4dffb640 1 -- 172.21.15.123:0/2687015892 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c45d954d60 con 0x55c45d9fd460 2024-08-18T22:07:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.977+0000 7f5b4dffb640 10 client.15309 handle_command_reply: tid=0 2024-08-18T22:07:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.977+0000 7f5b6f399740 1 client.15309 shutdown 2024-08-18T22:07:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.977+0000 7f5b6f399740 1 -- 172.21.15.123:0/2687015892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9e2b20 msgr2=0x55c45d9ea880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.977+0000 7f5b6f399740 1 --2- 172.21.15.123:0/2687015892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9e2b20 0x55c45d9ea880 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5b58011540 tx=0x7f5b58011a00 comp rx=0 tx=0).stop 2024-08-18T22:07:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.977+0000 7f5b6f399740 1 -- 172.21.15.123:0/2687015892 shutdown_connections 2024-08-18T22:07:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.977+0000 7f5b6f399740 1 --2- 172.21.15.123:0/2687015892 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c45d9fd460 0x55c45d9ff850 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.977+0000 7f5b6f399740 1 --2- 172.21.15.123:0/2687015892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9ed3e0 0x55c45d9eadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.977+0000 7f5b6f399740 1 --2- 172.21.15.123:0/2687015892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9e2b20 0x55c45d9ea880 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.977+0000 7f5b6f399740 1 --2- 172.21.15.123:0/2687015892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2200 0x55c45d9ea340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.977+0000 7f5b6f399740 1 -- 172.21.15.123:0/2687015892 >> 172.21.15.123:0/2687015892 conn(0x55c45d9de790 msgr2=0x55c45d9e4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.977+0000 7f5b4dffb640 0 client.15309 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.977+0000 7f5b6f399740 1 -- 172.21.15.123:0/2687015892 shutdown_connections 2024-08-18T22:07:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.977+0000 7f5b6f399740 1 -- 172.21.15.123:0/2687015892 wait complete. 2024-08-18T22:07:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.977+0000 7f5b6f399740 20 client.15309 trim_cache size 0 max 16384 2024-08-18T22:07:55.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.998+0000 7f5b6f399740 1 Processor -- start 2024-08-18T22:07:55.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.998+0000 7f5b6f399740 1 -- start start 2024-08-18T22:07:55.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.998+0000 7f5b6f399740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2200 0x55c45d9e4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:55.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.998+0000 7f5b6f399740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9e2b20 0x55c45d9eac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:55.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.998+0000 7f5b6f399740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9ed3e0 0x55c45da05120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:55.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.998+0000 7f5b6f399740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5b681b12b0 con 0x55c45d9ed3e0 2024-08-18T22:07:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.998+0000 7f5b6f399740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b681aeb80 con 0x55c45d9e2b20 2024-08-18T22:07:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.998+0000 7f5b6f399740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5b681ac9d0 con 0x55c45d9e2200 2024-08-18T22:07:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.999+0000 7f5b5dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9ed3e0 0x55c45da05120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.999+0000 7f5b5dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9ed3e0 0x55c45da05120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46332/0 (socket says 172.21.15.123:46332) 2024-08-18T22:07:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.999+0000 7f5b5dd9b640 1 -- 172.21.15.123:0/610320592 learned_addr learned my addr 172.21.15.123:0/610320592 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.999+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/610320592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2200 0x55c45d9e4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.999+0000 7f5b6659c640 1 --2- 172.21.15.123:0/610320592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9e2b20 0x55c45d9eac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.999+0000 7f5b5dd9b640 1 -- 172.21.15.123:0/610320592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2200 msgr2=0x55c45d9e4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.999+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/610320592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2200 0x55c45d9e4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.999+0000 7f5b5dd9b640 1 -- 172.21.15.123:0/610320592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9e2b20 msgr2=0x55c45d9eac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.999+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/610320592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9e2b20 0x55c45d9eac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.999+0000 7f5b5dd9b640 1 -- 172.21.15.123:0/610320592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c45d9df900 con 0x55c45d9ed3e0 2024-08-18T22:07:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.999+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/610320592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9ed3e0 0x55c45da05120 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5b50005380 tx=0x7f5b5003f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bcb65bc3e0412b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:55.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.999+0000 7f5b4ffff640 1 -- 172.21.15.123:0/610320592 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50035070 con 0x55c45d9ed3e0 2024-08-18T22:07:55.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.999+0000 7f5b4ffff640 1 -- 172.21.15.123:0/610320592 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b500316b0 con 0x55c45d9ed3e0 2024-08-18T22:07:55.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:54.999+0000 7f5b4ffff640 1 -- 172.21.15.123:0/610320592 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50004a90 con 0x55c45d9ed3e0 2024-08-18T22:07:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.000+0000 7f5b6f399740 1 -- 172.21.15.123:0/610320592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9ed3e0 msgr2=0x55c45da05120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.000+0000 7f5b6f399740 1 --2- 172.21.15.123:0/610320592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9ed3e0 0x55c45da05120 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5b50005380 tx=0x7f5b5003f040 comp rx=0 tx=0).stop 2024-08-18T22:07:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.000+0000 7f5b6f399740 1 -- 172.21.15.123:0/610320592 shutdown_connections 2024-08-18T22:07:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.000+0000 7f5b6f399740 1 --2- 172.21.15.123:0/610320592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9ed3e0 0x55c45da05120 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.000+0000 7f5b6f399740 1 --2- 172.21.15.123:0/610320592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9e2b20 0x55c45d9eac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.000+0000 7f5b6f399740 1 --2- 172.21.15.123:0/610320592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2200 0x55c45d9e4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.000+0000 7f5b6f399740 1 -- 172.21.15.123:0/610320592 >> 172.21.15.123:0/610320592 conn(0x55c45d9de790 msgr2=0x55c45d9e3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.000+0000 7f5b6f399740 1 -- 172.21.15.123:0/610320592 shutdown_connections 2024-08-18T22:07:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.000+0000 7f5b6f399740 1 -- 172.21.15.123:0/610320592 wait complete. 2024-08-18T22:07:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.000+0000 7f5b6f399740 1 -- start start 2024-08-18T22:07:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.000+0000 7f5b6f399740 1 Processor -- start 2024-08-18T22:07:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b6f399740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9e2200 0x55c45d9f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b6f399740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2b20 0x55c45d9f5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b6f399740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9ed3e0 0x55c45d9e6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b6f399740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5b681ad040 con 0x55c45d9e2200 2024-08-18T22:07:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b6f399740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b681ae4b0 con 0x55c45d9ed3e0 2024-08-18T22:07:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b6f399740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5b681ad710 con 0x55c45d9e2b20 2024-08-18T22:07:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b6f399740 10 client.0 _ll_register_callbacks cb 0x7f5b580095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b5dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9e2200 0x55c45d9f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b5dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9e2200 0x55c45d9f53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46334/0 (socket says 172.21.15.123:46334) 2024-08-18T22:07:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b5dd9b640 1 -- 172.21.15.123:0/105683630 learned_addr learned my addr 172.21.15.123:0/105683630 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b6659c640 1 --2- 172.21.15.123:0/105683630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2b20 0x55c45d9f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b5dd9b640 1 -- 172.21.15.123:0/105683630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2b20 msgr2=0x55c45d9f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/105683630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2b20 0x55c45d9f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b5dd9b640 1 -- 172.21.15.123:0/105683630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9ed3e0 msgr2=0x55c45d9e6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/105683630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9ed3e0 0x55c45d9e6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b5dd9b640 1 -- 172.21.15.123:0/105683630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c45d9e7380 con 0x55c45d9e2200 2024-08-18T22:07:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b5dd9b640 1 --2- 172.21.15.123:0/105683630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9e2200 0x55c45d9f53e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5b50053040 tx=0x7f5b5002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb44f364ea7ede12 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b4dffb640 1 -- 172.21.15.123:0/105683630 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5004e070 con 0x55c45d9e2200 2024-08-18T22:07:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b4dffb640 1 -- 172.21.15.123:0/105683630 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f5b50004810 con 0x55c45d9e2200 2024-08-18T22:07:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.001+0000 7f5b6f399740 1 -- 172.21.15.123:0/105683630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b500316b0 con 0x55c45d9e2200 2024-08-18T22:07:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.002+0000 7f5b4dffb640 1 -- 172.21.15.123:0/105683630 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5b50035040 con 0x55c45d9e2200 2024-08-18T22:07:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.002+0000 7f5b6f399740 10 client.15315 fetch_fsmap learned FSMap version 26 2024-08-18T22:07:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.002+0000 7f5b6f399740 1 -- 172.21.15.123:0/105683630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c45da67c70 con 0x55c45d9e2200 2024-08-18T22:07:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.002+0000 7f5b4dffb640 1 -- 172.21.15.123:0/105683630 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b500316b0 con 0x55c45d9e2200 2024-08-18T22:07:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.002+0000 7f5b4dffb640 1 -- 172.21.15.123:0/105683630 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5b5003a040 con 0x55c45d9e2200 2024-08-18T22:07:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.002+0000 7f5b6f399740 10 client.15315 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:07:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.002+0000 7f5b6f399740 10 client.15315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:07:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.002+0000 7f5b6f399740 20 client.15315 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.002+0000 7f5b6f399740 1 --2- 172.21.15.123:0/105683630 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c45da67ef0 0x55c45da6a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.002+0000 7f5b6f399740 4 client.15315 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-18T22:07:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.002+0000 7f5b6f399740 1 -- 172.21.15.123:0/105683630 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c45d94f270 con 0x55c45da67ef0 2024-08-18T22:07:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.002+0000 7f5b6659c640 1 --2- 172.21.15.123:0/105683630 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c45da67ef0 0x55c45da6a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.003+0000 7f5b4dffb640 10 client.15315 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.003+0000 7f5b6659c640 1 --2- 172.21.15.123:0/105683630 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c45da67ef0 0x55c45da6a2e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=370a13e71119b187 server_cookie=13ccf8eb9ca0cc89 in_seq=0 out_seq=0 2024-08-18T22:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.004+0000 7f5b4dffb640 1 -- 172.21.15.123:0/105683630 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c45d94f270 con 0x55c45da67ef0 2024-08-18T22:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.004+0000 7f5b4dffb640 10 client.15315 handle_command_reply: tid=0 2024-08-18T22:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.004+0000 7f5b6f399740 1 client.15315 shutdown 2024-08-18T22:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.004+0000 7f5b6f399740 1 -- 172.21.15.123:0/105683630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9e2200 msgr2=0x55c45d9f53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.004+0000 7f5b6f399740 1 --2- 172.21.15.123:0/105683630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9e2200 0x55c45d9f53e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5b50053040 tx=0x7f5b5002a480 comp rx=0 tx=0).stop 2024-08-18T22:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.004+0000 7f5b6f399740 1 -- 172.21.15.123:0/105683630 shutdown_connections 2024-08-18T22:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.004+0000 7f5b6f399740 1 --2- 172.21.15.123:0/105683630 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c45da67ef0 0x55c45da6a2e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.004+0000 7f5b6f399740 1 --2- 172.21.15.123:0/105683630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c45d9ed3e0 0x55c45d9e6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.004+0000 7f5b4dffb640 0 client.15315 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.004+0000 7f5b6f399740 1 --2- 172.21.15.123:0/105683630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c45d9e2b20 0x55c45d9f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.004+0000 7f5b6f399740 1 --2- 172.21.15.123:0/105683630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c45d9e2200 0x55c45d9f53e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.004+0000 7f5b6f399740 1 -- 172.21.15.123:0/105683630 >> 172.21.15.123:0/105683630 conn(0x55c45d9de790 msgr2=0x55c45d9dd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.004+0000 7f5b6f399740 1 -- 172.21.15.123:0/105683630 shutdown_connections 2024-08-18T22:07:55.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.004+0000 7f5b6f399740 1 -- 172.21.15.123:0/105683630 wait complete. 2024-08-18T22:07:55.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.004+0000 7f5b6f399740 20 client.15315 trim_cache size 0 max 16384 2024-08-18T22:07:55.010 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:07:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-08-18T22:07:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "e027a0de-d136-4450-93c7-adcb94027c52", 2024-08-18T22:07:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-08-18T22:07:55.010 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:07:55.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.005+0000 7f5b6cf9b640 1 -- 172.21.15.123:0/2181089732 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5b540a2b80 msgr2=0x7f5b540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:55.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.005+0000 7f5b6cf9b640 1 --2- 172.21.15.123:0/2181089732 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5b540a2b80 0x7f5b540a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5b600982b0 tx=0x7f5b600c6470 comp rx=0 tx=0).stop 2024-08-18T22:07:55.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.005+0000 7f5b6cf9b640 1 -- 172.21.15.123:0/2181089732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b6810bea0 msgr2=0x7f5b6819cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:55.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.005+0000 7f5b6cf9b640 1 --2- 172.21.15.123:0/2181089732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b6810bea0 0x7f5b6819cad0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000cad0 tx=0x7f5b6000ced0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.005+0000 7f5b6cf9b640 1 -- 172.21.15.123:0/2181089732 shutdown_connections 2024-08-18T22:07:55.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.005+0000 7f5b6cf9b640 1 --2- 172.21.15.123:0/2181089732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b6810bea0 0x7f5b6819cad0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.005+0000 7f5b6cf9b640 1 --2- 172.21.15.123:0/2181089732 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5b540a2b80 0x7f5b540a5040 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.005+0000 7f5b6cf9b640 1 --2- 172.21.15.123:0/2181089732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b68103390 0x7f5b68198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.005+0000 7f5b6cf9b640 1 --2- 172.21.15.123:0/2181089732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b68102a70 0x7f5b68198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.005+0000 7f5b6cf9b640 1 -- 172.21.15.123:0/2181089732 >> 172.21.15.123:0/2181089732 conn(0x7f5b680fc4d0 msgr2=0x7f5b680fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:55.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.005+0000 7f5b6cf9b640 1 -- 172.21.15.123:0/2181089732 shutdown_connections 2024-08-18T22:07:55.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.005+0000 7f5b6cf9b640 1 -- 172.21.15.123:0/2181089732 wait complete. 2024-08-18T22:07:55.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.182+0000 7f8dc1896640 1 -- 172.21.15.123:0/555429160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc1007b0 msgr2=0x7f8dbc100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:55.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.182+0000 7f8dc1896640 1 --2- 172.21.15.123:0/555429160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc1007b0 0x7f8dbc100c10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009930 tx=0x7f8db002a420 comp rx=0 tx=0).stop 2024-08-18T22:07:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.182+0000 7f8dc1896640 1 -- 172.21.15.123:0/555429160 shutdown_connections 2024-08-18T22:07:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.182+0000 7f8dc1896640 1 --2- 172.21.15.123:0/555429160 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dbc101150 0x7f8dbc10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.182+0000 7f8dc1896640 1 --2- 172.21.15.123:0/555429160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc1007b0 0x7f8dbc100c10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.182+0000 7f8dc1896640 1 --2- 172.21.15.123:0/555429160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc1067b0 0x7f8dbc106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.182+0000 7f8dc1896640 1 -- 172.21.15.123:0/555429160 >> 172.21.15.123:0/555429160 conn(0x7f8dbc0fc4d0 msgr2=0x7f8dbc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.182+0000 7f8dc1896640 1 -- 172.21.15.123:0/555429160 shutdown_connections 2024-08-18T22:07:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.182+0000 7f8dc1896640 1 -- 172.21.15.123:0/555429160 wait complete. 2024-08-18T22:07:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.183+0000 7f8dc1896640 1 Processor -- start 2024-08-18T22:07:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.183+0000 7f8dc1896640 1 -- start start 2024-08-18T22:07:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.183+0000 7f8dc1896640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc1007b0 0x7f8dbc198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.183+0000 7f8dc1896640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc101150 0x7f8dbc1994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.183+0000 7f8dc1896640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dbc1067b0 0x7f8dbc1a4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.183+0000 7f8dc1896640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc110bb0 con 0x7f8dbc101150 2024-08-18T22:07:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.183+0000 7f8dc1896640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc110a30 con 0x7f8dbc1067b0 2024-08-18T22:07:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.183+0000 7f8dc1896640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc110d30 con 0x7f8dbc1007b0 2024-08-18T22:07:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.183+0000 7f8dba7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc101150 0x7f8dbc1994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.183+0000 7f8dba7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc101150 0x7f8dbc1994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46360/0 (socket says 172.21.15.123:46360) 2024-08-18T22:07:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.183+0000 7f8dba7fc640 1 -- 172.21.15.123:0/3908081275 learned_addr learned my addr 172.21.15.123:0/3908081275 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.183+0000 7f8dbaffd640 1 --2- 172.21.15.123:0/3908081275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc1007b0 0x7f8dbc198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.183+0000 7f8dbb7fe640 1 --2- 172.21.15.123:0/3908081275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dbc1067b0 0x7f8dbc1a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.184+0000 7f8dba7fc640 1 -- 172.21.15.123:0/3908081275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc1007b0 msgr2=0x7f8dbc198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.184+0000 7f8dba7fc640 1 --2- 172.21.15.123:0/3908081275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc1007b0 0x7f8dbc198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.184+0000 7f8dba7fc640 1 -- 172.21.15.123:0/3908081275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dbc1067b0 msgr2=0x7f8dbc1a4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.184+0000 7f8dba7fc640 1 --2- 172.21.15.123:0/3908081275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dbc1067b0 0x7f8dbc1a4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.184+0000 7f8dba7fc640 1 -- 172.21.15.123:0/3908081275 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc1a4570 con 0x7f8dbc101150 2024-08-18T22:07:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.184+0000 7f8dbb7fe640 1 --2- 172.21.15.123:0/3908081275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dbc1067b0 0x7f8dbc1a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:07:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.184+0000 7f8dba7fc640 1 --2- 172.21.15.123:0/3908081275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc101150 0x7f8dbc1994f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009a50 tx=0x7f8db0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.184+0000 7f8dc0894640 1 -- 172.21.15.123:0/3908081275 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db003f030 con 0x7f8dbc101150 2024-08-18T22:07:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.184+0000 7f8dc0894640 1 -- 172.21.15.123:0/3908081275 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8db0003ce0 con 0x7f8dbc101150 2024-08-18T22:07:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.184+0000 7f8dc1896640 1 -- 172.21.15.123:0/3908081275 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dbc1a4740 con 0x7f8dbc101150 2024-08-18T22:07:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.184+0000 7f8dc0894640 1 -- 172.21.15.123:0/3908081275 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db0035070 con 0x7f8dbc101150 2024-08-18T22:07:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.184+0000 7f8dc1896640 1 -- 172.21.15.123:0/3908081275 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dbc1a4b90 con 0x7f8dbc101150 2024-08-18T22:07:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.185+0000 7f8dc1896640 1 -- 172.21.15.123:0/3908081275 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dbc100c10 con 0x7f8dbc101150 2024-08-18T22:07:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.186+0000 7f8dc0894640 1 -- 172.21.15.123:0/3908081275 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f8db0042030 con 0x7f8dbc101150 2024-08-18T22:07:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.187+0000 7f8dc0894640 1 --2- 172.21.15.123:0/3908081275 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8da40a2b80 0x7f8da40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.187+0000 7f8dbaffd640 1 --2- 172.21.15.123:0/3908081275 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8da40a2b80 0x7f8da40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.187+0000 7f8dc0894640 1 -- 172.21.15.123:0/3908081275 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8db00efdc0 con 0x7f8dbc101150 2024-08-18T22:07:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.188+0000 7f8dbaffd640 1 --2- 172.21.15.123:0/3908081275 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8da40a2b80 0x7f8da40a5040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0058c0 tx=0x7f8dac00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.190+0000 7f8dc0894640 1 -- 172.21.15.123:0/3908081275 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f8db00bc990 con 0x7f8dbc101150 2024-08-18T22:07:55.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.356+0000 7f8dc1896640 1 -- 172.21.15.123:0/3908081275 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8dbc062360 con 0x7f8da40a2b80 2024-08-18T22:07:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.364+0000 7f8dc0894640 1 -- 172.21.15.123:0/3908081275 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340502 (secure 0 0 0) 0x7f8dbc062360 con 0x7f8da40a2b80 2024-08-18T22:07:55.368 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:55.370 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-08-18T22:07:55.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.368+0000 7f8dc1896640 1 -- 172.21.15.123:0/3908081275 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8da40a2b80 msgr2=0x7f8da40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:55.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.368+0000 7f8dc1896640 1 --2- 172.21.15.123:0/3908081275 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8da40a2b80 0x7f8da40a5040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0058c0 tx=0x7f8dac00a2d0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.368+0000 7f8dc1896640 1 -- 172.21.15.123:0/3908081275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc101150 msgr2=0x7f8dbc1994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:55.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.368+0000 7f8dc1896640 1 --2- 172.21.15.123:0/3908081275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc101150 0x7f8dbc1994f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009a50 tx=0x7f8db0004270 comp rx=0 tx=0).stop 2024-08-18T22:07:55.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.368+0000 7f8dc1896640 1 -- 172.21.15.123:0/3908081275 shutdown_connections 2024-08-18T22:07:55.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.368+0000 7f8dc1896640 1 --2- 172.21.15.123:0/3908081275 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8da40a2b80 0x7f8da40a5040 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.368+0000 7f8dc1896640 1 --2- 172.21.15.123:0/3908081275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dbc1067b0 0x7f8dbc1a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.368+0000 7f8dc1896640 1 --2- 172.21.15.123:0/3908081275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc101150 0x7f8dbc1994f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.368+0000 7f8dc1896640 1 --2- 172.21.15.123:0/3908081275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc1007b0 0x7f8dbc198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:55.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.368+0000 7f8dc1896640 1 -- 172.21.15.123:0/3908081275 >> 172.21.15.123:0/3908081275 conn(0x7f8dbc0fc4d0 msgr2=0x7f8dbc0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:55.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.368+0000 7f8dc1896640 1 -- 172.21.15.123:0/3908081275 shutdown_connections 2024-08-18T22:07:55.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:55.368+0000 7f8dc1896640 1 -- 172.21.15.123:0/3908081275 wait complete. 2024-08-18T22:07:56.121 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-08-18T22:07:53.374854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662721,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":818,"num_read_kb":525,"num_write":363,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1229945,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":793,"ondisk_log_size":793,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388624,"kb_used_data":14444,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553200,"statfs":{"total":1151940427776,"available":1151542476800,"internally_reserved":0,"allocated":14790656,"data_stored":8242709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003438"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523825+0000","last_change":"2024-08-18T22:05:19.844674+0000","last_active":"2024-08-18T22:07:11.523825+0000","last_peered":"2024-08-18T22:07:11.523825+0000","last_clean":"2024-08-18T22:07:11.523825+0000","last_became_active":"2024-08-18T22:05:19.844381+0000","last_became_peered":"2024-08-18T22:05:19.844381+0000","last_unstale":"2024-08-18T22:07:11.523825+0000","last_undegraded":"2024-08-18T22:07:11.523825+0000","last_fullsized":"2024-08-18T22:07:11.523825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:58.783222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572759+0000","last_change":"2024-08-18T22:05:21.859013+0000","last_active":"2024-08-18T22:07:11.572759+0000","last_peered":"2024-08-18T22:07:11.572759+0000","last_clean":"2024-08-18T22:07:11.572759+0000","last_became_active":"2024-08-18T22:05:21.858709+0000","last_became_peered":"2024-08-18T22:05:21.858709+0000","last_unstale":"2024-08-18T22:07:11.572759+0000","last_undegraded":"2024-08-18T22:07:11.572759+0000","last_fullsized":"2024-08-18T22:07:11.572759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:34.272340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530547+0000","last_change":"2024-08-18T22:05:28.925735+0000","last_active":"2024-08-18T22:07:11.530547+0000","last_peered":"2024-08-18T22:07:11.530547+0000","last_clean":"2024-08-18T22:07:11.530547+0000","last_became_active":"2024-08-18T22:05:28.925324+0000","last_became_peered":"2024-08-18T22:05:28.925324+0000","last_unstale":"2024-08-18T22:07:11.530547+0000","last_undegraded":"2024-08-18T22:07:11.530547+0000","last_fullsized":"2024-08-18T22:07:11.530547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:15:58.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572915+0000","last_change":"2024-08-18T22:05:20.290861+0000","last_active":"2024-08-18T22:07:11.572915+0000","last_peered":"2024-08-18T22:07:11.572915+0000","last_clean":"2024-08-18T22:07:11.572915+0000","last_became_active":"2024-08-18T22:05:20.290508+0000","last_became_peered":"2024-08-18T22:05:20.290508+0000","last_unstale":"2024-08-18T22:07:11.572915+0000","last_undegraded":"2024-08-18T22:07:11.572915+0000","last_fullsized":"2024-08-18T22:07:11.572915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:21.462206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623639+0000","last_change":"2024-08-18T22:05:21.863441+0000","last_active":"2024-08-18T22:07:11.623639+0000","last_peered":"2024-08-18T22:07:11.623639+0000","last_clean":"2024-08-18T22:07:11.623639+0000","last_became_active":"2024-08-18T22:05:21.863121+0000","last_became_peered":"2024-08-18T22:05:21.863121+0000","last_unstale":"2024-08-18T22:07:11.623639+0000","last_undegraded":"2024-08-18T22:07:11.623639+0000","last_fullsized":"2024-08-18T22:07:11.623639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:47.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572680+0000","last_change":"2024-08-18T22:05:28.925477+0000","last_active":"2024-08-18T22:07:11.572680+0000","last_peered":"2024-08-18T22:07:11.572680+0000","last_clean":"2024-08-18T22:07:11.572680+0000","last_became_active":"2024-08-18T22:05:28.924922+0000","last_became_peered":"2024-08-18T22:05:28.924922+0000","last_unstale":"2024-08-18T22:07:11.572680+0000","last_undegraded":"2024-08-18T22:07:11.572680+0000","last_fullsized":"2024-08-18T22:07:11.572680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:35.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524985+0000","last_change":"2024-08-18T22:05:19.847979+0000","last_active":"2024-08-18T22:07:11.524985+0000","last_peered":"2024-08-18T22:07:11.524985+0000","last_clean":"2024-08-18T22:07:11.524985+0000","last_became_active":"2024-08-18T22:05:19.847643+0000","last_became_peered":"2024-08-18T22:05:19.847643+0000","last_unstale":"2024-08-18T22:07:11.524985+0000","last_undegraded":"2024-08-18T22:07:11.524985+0000","last_fullsized":"2024-08-18T22:07:11.524985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:33.875378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528910+0000","last_change":"2024-08-18T22:05:21.860225+0000","last_active":"2024-08-18T22:07:11.528910+0000","last_peered":"2024-08-18T22:07:11.528910+0000","last_clean":"2024-08-18T22:07:11.528910+0000","last_became_active":"2024-08-18T22:05:21.859889+0000","last_became_peered":"2024-08-18T22:05:21.859889+0000","last_unstale":"2024-08-18T22:07:11.528910+0000","last_undegraded":"2024-08-18T22:07:11.528910+0000","last_fullsized":"2024-08-18T22:07:11.528910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:06:27.084401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573134+0000","last_change":"2024-08-18T22:05:28.922230+0000","last_active":"2024-08-18T22:07:11.573134+0000","last_peered":"2024-08-18T22:07:11.573134+0000","last_clean":"2024-08-18T22:07:11.573134+0000","last_became_active":"2024-08-18T22:05:28.921804+0000","last_became_peered":"2024-08-18T22:05:28.921804+0000","last_unstale":"2024-08-18T22:07:11.573134+0000","last_undegraded":"2024-08-18T22:07:11.573134+0000","last_fullsized":"2024-08-18T22:07:11.573134+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:17.735645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.533950+0000","last_change":"2024-08-18T22:07:11.533541+0000","last_active":"2024-08-18T22:07:11.533950+0000","last_peered":"2024-08-18T22:07:11.533950+0000","last_clean":"2024-08-18T22:07:11.533950+0000","last_became_active":"2024-08-18T22:07:11.530034+0000","last_became_peered":"2024-08-18T22:07:11.530034+0000","last_unstale":"2024-08-18T22:07:11.533950+0000","last_undegraded":"2024-08-18T22:07:11.533950+0000","last_fullsized":"2024-08-18T22:07:11.533950+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:29.575399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528705+0000","last_change":"2024-08-18T22:06:10.514673+0000","last_active":"2024-08-18T22:07:11.528705+0000","last_peered":"2024-08-18T22:07:11.528705+0000","last_clean":"2024-08-18T22:07:11.528705+0000","last_became_active":"2024-08-18T22:06:10.514264+0000","last_became_peered":"2024-08-18T22:06:10.514264+0000","last_unstale":"2024-08-18T22:07:11.528705+0000","last_undegraded":"2024-08-18T22:07:11.528705+0000","last_fullsized":"2024-08-18T22:07:11.528705+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:03.626895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572808+0000","last_change":"2024-08-18T22:05:28.924521+0000","last_active":"2024-08-18T22:07:11.572808+0000","last_peered":"2024-08-18T22:07:11.572808+0000","last_clean":"2024-08-18T22:07:11.572808+0000","last_became_active":"2024-08-18T22:05:28.924107+0000","last_became_peered":"2024-08-18T22:05:28.924107+0000","last_unstale":"2024-08-18T22:07:11.572808+0000","last_undegraded":"2024-08-18T22:07:11.572808+0000","last_fullsized":"2024-08-18T22:07:11.572808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:37.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527669+0000","last_change":"2024-08-18T22:05:21.861696+0000","last_active":"2024-08-18T22:07:11.527669+0000","last_peered":"2024-08-18T22:07:11.527669+0000","last_clean":"2024-08-18T22:07:11.527669+0000","last_became_active":"2024-08-18T22:05:21.861220+0000","last_became_peered":"2024-08-18T22:05:21.861220+0000","last_unstale":"2024-08-18T22:07:11.527669+0000","last_undegraded":"2024-08-18T22:07:11.527669+0000","last_fullsized":"2024-08-18T22:07:11.527669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:01.098281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526302+0000","last_change":"2024-08-18T22:06:10.520097+0000","last_active":"2024-08-18T22:07:11.526302+0000","last_peered":"2024-08-18T22:07:11.526302+0000","last_clean":"2024-08-18T22:07:11.526302+0000","last_became_active":"2024-08-18T22:06:10.513286+0000","last_became_peered":"2024-08-18T22:06:10.513286+0000","last_unstale":"2024-08-18T22:07:11.526302+0000","last_undegraded":"2024-08-18T22:07:11.526302+0000","last_fullsized":"2024-08-18T22:07:11.526302+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:08:18.861243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573335+0000","last_change":"2024-08-18T22:05:29.013139+0000","last_active":"2024-08-18T22:07:11.573335+0000","last_peered":"2024-08-18T22:07:11.573335+0000","last_clean":"2024-08-18T22:07:11.573335+0000","last_became_active":"2024-08-18T22:05:29.012322+0000","last_became_peered":"2024-08-18T22:05:29.012322+0000","last_unstale":"2024-08-18T22:07:11.573335+0000","last_undegraded":"2024-08-18T22:07:11.573335+0000","last_fullsized":"2024-08-18T22:07:11.573335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:32.348201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572558+0000","last_change":"2024-08-18T22:05:21.860410+0000","last_active":"2024-08-18T22:07:11.572558+0000","last_peered":"2024-08-18T22:07:11.572558+0000","last_clean":"2024-08-18T22:07:11.572558+0000","last_became_active":"2024-08-18T22:05:21.860173+0000","last_became_peered":"2024-08-18T22:05:21.860173+0000","last_unstale":"2024-08-18T22:07:11.572558+0000","last_undegraded":"2024-08-18T22:07:11.572558+0000","last_fullsized":"2024-08-18T22:07:11.572558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:00.879178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530486+0000","last_change":"2024-08-18T22:05:19.845785+0000","last_active":"2024-08-18T22:07:11.530486+0000","last_peered":"2024-08-18T22:07:11.530486+0000","last_clean":"2024-08-18T22:07:11.530486+0000","last_became_active":"2024-08-18T22:05:19.845414+0000","last_became_peered":"2024-08-18T22:05:19.845414+0000","last_unstale":"2024-08-18T22:07:11.530486+0000","last_undegraded":"2024-08-18T22:07:11.530486+0000","last_fullsized":"2024-08-18T22:07:11.530486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:13.504885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573296+0000","last_change":"2024-08-18T22:06:10.523404+0000","last_active":"2024-08-18T22:07:11.573296+0000","last_peered":"2024-08-18T22:07:11.573296+0000","last_clean":"2024-08-18T22:07:11.573296+0000","last_became_active":"2024-08-18T22:06:10.516652+0000","last_became_peered":"2024-08-18T22:06:10.516652+0000","last_unstale":"2024-08-18T22:07:11.573296+0000","last_undegraded":"2024-08-18T22:07:11.573296+0000","last_fullsized":"2024-08-18T22:07:11.573296+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:58.197636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526366+0000","last_change":"2024-08-18T22:05:21.858329+0000","last_active":"2024-08-18T22:07:11.526366+0000","last_peered":"2024-08-18T22:07:11.526366+0000","last_clean":"2024-08-18T22:07:11.526366+0000","last_became_active":"2024-08-18T22:05:21.857854+0000","last_became_peered":"2024-08-18T22:05:21.857854+0000","last_unstale":"2024-08-18T22:07:11.526366+0000","last_undegraded":"2024-08-18T22:07:11.526366+0000","last_fullsized":"2024-08-18T22:07:11.526366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:45:19.934647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572567+0000","last_change":"2024-08-18T22:05:19.843031+0000","last_active":"2024-08-18T22:07:11.572567+0000","last_peered":"2024-08-18T22:07:11.572567+0000","last_clean":"2024-08-18T22:07:11.572567+0000","last_became_active":"2024-08-18T22:05:19.842694+0000","last_became_peered":"2024-08-18T22:05:19.842694+0000","last_unstale":"2024-08-18T22:07:11.572567+0000","last_undegraded":"2024-08-18T22:07:11.572567+0000","last_fullsized":"2024-08-18T22:07:11.572567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:01.135449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523703+0000","last_change":"2024-08-18T22:05:28.920647+0000","last_active":"2024-08-18T22:07:11.523703+0000","last_peered":"2024-08-18T22:07:11.523703+0000","last_clean":"2024-08-18T22:07:11.523703+0000","last_became_active":"2024-08-18T22:05:28.920295+0000","last_became_peered":"2024-08-18T22:05:28.920295+0000","last_unstale":"2024-08-18T22:07:11.523703+0000","last_undegraded":"2024-08-18T22:07:11.523703+0000","last_fullsized":"2024-08-18T22:07:11.523703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:41.295009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524432+0000","last_change":"2024-08-18T22:05:21.858413+0000","last_active":"2024-08-18T22:07:11.524432+0000","last_peered":"2024-08-18T22:07:11.524432+0000","last_clean":"2024-08-18T22:07:11.524432+0000","last_became_active":"2024-08-18T22:05:21.858102+0000","last_became_peered":"2024-08-18T22:05:21.858102+0000","last_unstale":"2024-08-18T22:07:11.524432+0000","last_undegraded":"2024-08-18T22:07:11.524432+0000","last_fullsized":"2024-08-18T22:07:11.524432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:24:59.432666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528669+0000","last_change":"2024-08-18T22:05:20.292085+0000","last_active":"2024-08-18T22:07:11.528669+0000","last_peered":"2024-08-18T22:07:11.528669+0000","last_clean":"2024-08-18T22:07:11.528669+0000","last_became_active":"2024-08-18T22:05:20.291606+0000","last_became_peered":"2024-08-18T22:05:20.291606+0000","last_unstale":"2024-08-18T22:07:11.528669+0000","last_undegraded":"2024-08-18T22:07:11.528669+0000","last_fullsized":"2024-08-18T22:07:11.528669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:22:46.801719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573405+0000","last_change":"2024-08-18T22:06:10.515755+0000","last_active":"2024-08-18T22:07:11.573405+0000","last_peered":"2024-08-18T22:07:11.573405+0000","last_clean":"2024-08-18T22:07:11.573405+0000","last_became_active":"2024-08-18T22:06:10.514624+0000","last_became_peered":"2024-08-18T22:06:10.514624+0000","last_unstale":"2024-08-18T22:07:11.573405+0000","last_undegraded":"2024-08-18T22:07:11.573405+0000","last_fullsized":"2024-08-18T22:07:11.573405+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:18:50.785139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623553+0000","last_change":"2024-08-18T22:05:21.855163+0000","last_active":"2024-08-18T22:07:11.623553+0000","last_peered":"2024-08-18T22:07:11.623553+0000","last_clean":"2024-08-18T22:07:11.623553+0000","last_became_active":"2024-08-18T22:05:21.854867+0000","last_became_peered":"2024-08-18T22:05:21.854867+0000","last_unstale":"2024-08-18T22:07:11.623553+0000","last_undegraded":"2024-08-18T22:07:11.623553+0000","last_fullsized":"2024-08-18T22:07:11.623553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:10.300307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573516+0000","last_change":"2024-08-18T22:05:20.082363+0000","last_active":"2024-08-18T22:07:11.573516+0000","last_peered":"2024-08-18T22:07:11.573516+0000","last_clean":"2024-08-18T22:07:11.573516+0000","last_became_active":"2024-08-18T22:05:20.081998+0000","last_became_peered":"2024-08-18T22:05:20.081998+0000","last_unstale":"2024-08-18T22:07:11.573516+0000","last_undegraded":"2024-08-18T22:07:11.573516+0000","last_fullsized":"2024-08-18T22:07:11.573516+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:44.960512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530726+0000","last_change":"2024-08-18T22:05:28.924072+0000","last_active":"2024-08-18T22:07:11.530726+0000","last_peered":"2024-08-18T22:07:11.530726+0000","last_clean":"2024-08-18T22:07:11.530726+0000","last_became_active":"2024-08-18T22:05:28.923673+0000","last_became_peered":"2024-08-18T22:05:28.923673+0000","last_unstale":"2024-08-18T22:07:11.530726+0000","last_undegraded":"2024-08-18T22:07:11.530726+0000","last_fullsized":"2024-08-18T22:07:11.530726+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:44.593009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572927+0000","last_change":"2024-08-18T22:05:21.851377+0000","last_active":"2024-08-18T22:07:11.572927+0000","last_peered":"2024-08-18T22:07:11.572927+0000","last_clean":"2024-08-18T22:07:11.572927+0000","last_became_active":"2024-08-18T22:05:21.851031+0000","last_became_peered":"2024-08-18T22:05:21.851031+0000","last_unstale":"2024-08-18T22:07:11.572927+0000","last_undegraded":"2024-08-18T22:07:11.572927+0000","last_fullsized":"2024-08-18T22:07:11.572927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.547244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'13","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:31.609491+0000","last_change":"2024-08-18T22:05:19.840697+0000","last_active":"2024-08-18T22:07:31.609491+0000","last_peered":"2024-08-18T22:07:31.609491+0000","last_clean":"2024-08-18T22:07:31.609491+0000","last_became_active":"2024-08-18T22:05:19.840382+0000","last_became_peered":"2024-08-18T22:05:19.840382+0000","last_unstale":"2024-08-18T22:07:31.609491+0000","last_undegraded":"2024-08-18T22:07:31.609491+0000","last_fullsized":"2024-08-18T22:07:31.609491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:24.514428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572248+0000","last_change":"2024-08-18T22:05:29.012305+0000","last_active":"2024-08-18T22:07:11.572248+0000","last_peered":"2024-08-18T22:07:11.572248+0000","last_clean":"2024-08-18T22:07:11.572248+0000","last_became_active":"2024-08-18T22:05:29.011846+0000","last_became_peered":"2024-08-18T22:05:29.011846+0000","last_unstale":"2024-08-18T22:07:11.572248+0000","last_undegraded":"2024-08-18T22:07:11.572248+0000","last_fullsized":"2024-08-18T22:07:11.572248+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:36.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570893+0000","last_change":"2024-08-18T22:05:21.856182+0000","last_active":"2024-08-18T22:07:11.570893+0000","last_peered":"2024-08-18T22:07:11.570893+0000","last_clean":"2024-08-18T22:07:11.570893+0000","last_became_active":"2024-08-18T22:05:21.855855+0000","last_became_peered":"2024-08-18T22:05:21.855855+0000","last_unstale":"2024-08-18T22:07:11.570893+0000","last_undegraded":"2024-08-18T22:07:11.570893+0000","last_fullsized":"2024-08-18T22:07:11.570893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:00.166809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524985+0000","last_change":"2024-08-18T22:05:20.291272+0000","last_active":"2024-08-18T22:07:11.524985+0000","last_peered":"2024-08-18T22:07:11.524985+0000","last_clean":"2024-08-18T22:07:11.524985+0000","last_became_active":"2024-08-18T22:05:20.290970+0000","last_became_peered":"2024-08-18T22:05:20.290970+0000","last_unstale":"2024-08-18T22:07:11.524985+0000","last_undegraded":"2024-08-18T22:07:11.524985+0000","last_fullsized":"2024-08-18T22:07:11.524985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:29.438996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526400+0000","last_change":"2024-08-18T22:05:28.923141+0000","last_active":"2024-08-18T22:07:11.526400+0000","last_peered":"2024-08-18T22:07:11.526400+0000","last_clean":"2024-08-18T22:07:11.526400+0000","last_became_active":"2024-08-18T22:05:28.922269+0000","last_became_peered":"2024-08-18T22:05:28.922269+0000","last_unstale":"2024-08-18T22:07:11.526400+0000","last_undegraded":"2024-08-18T22:07:11.526400+0000","last_fullsized":"2024-08-18T22:07:11.526400+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:58.092640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522176+0000","last_change":"2024-08-18T22:05:21.850124+0000","last_active":"2024-08-18T22:07:11.522176+0000","last_peered":"2024-08-18T22:07:11.522176+0000","last_clean":"2024-08-18T22:07:11.522176+0000","last_became_active":"2024-08-18T22:05:21.849805+0000","last_became_peered":"2024-08-18T22:05:21.849805+0000","last_unstale":"2024-08-18T22:07:11.522176+0000","last_undegraded":"2024-08-18T22:07:11.522176+0000","last_fullsized":"2024-08-18T22:07:11.522176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:53.492613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523594+0000","last_change":"2024-08-18T22:05:20.292836+0000","last_active":"2024-08-18T22:07:11.523594+0000","last_peered":"2024-08-18T22:07:11.523594+0000","last_clean":"2024-08-18T22:07:11.523594+0000","last_became_active":"2024-08-18T22:05:20.292456+0000","last_became_peered":"2024-08-18T22:05:20.292456+0000","last_unstale":"2024-08-18T22:07:11.523594+0000","last_undegraded":"2024-08-18T22:07:11.523594+0000","last_fullsized":"2024-08-18T22:07:11.523594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:19.525037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524433+0000","last_change":"2024-08-18T22:05:29.012439+0000","last_active":"2024-08-18T22:07:11.524433+0000","last_peered":"2024-08-18T22:07:11.524433+0000","last_clean":"2024-08-18T22:07:11.524433+0000","last_became_active":"2024-08-18T22:05:29.011860+0000","last_became_peered":"2024-08-18T22:05:29.011860+0000","last_unstale":"2024-08-18T22:07:11.524433+0000","last_undegraded":"2024-08-18T22:07:11.524433+0000","last_fullsized":"2024-08-18T22:07:11.524433+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:03.432217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522230+0000","last_change":"2024-08-18T22:05:21.855598+0000","last_active":"2024-08-18T22:07:11.522230+0000","last_peered":"2024-08-18T22:07:11.522230+0000","last_clean":"2024-08-18T22:07:11.522230+0000","last_became_active":"2024-08-18T22:05:21.855228+0000","last_became_peered":"2024-08-18T22:05:21.855228+0000","last_unstale":"2024-08-18T22:07:11.522230+0000","last_undegraded":"2024-08-18T22:07:11.522230+0000","last_fullsized":"2024-08-18T22:07:11.522230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:33.762700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527786+0000","last_change":"2024-08-18T22:05:19.844638+0000","last_active":"2024-08-18T22:07:11.527786+0000","last_peered":"2024-08-18T22:07:11.527786+0000","last_clean":"2024-08-18T22:07:11.527786+0000","last_became_active":"2024-08-18T22:05:19.844333+0000","last_became_peered":"2024-08-18T22:05:19.844333+0000","last_unstale":"2024-08-18T22:07:11.527786+0000","last_undegraded":"2024-08-18T22:07:11.527786+0000","last_fullsized":"2024-08-18T22:07:11.527786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:26.947512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570807+0000","last_change":"2024-08-18T22:05:28.919965+0000","last_active":"2024-08-18T22:07:11.570807+0000","last_peered":"2024-08-18T22:07:11.570807+0000","last_clean":"2024-08-18T22:07:11.570807+0000","last_became_active":"2024-08-18T22:05:28.919546+0000","last_became_peered":"2024-08-18T22:05:28.919546+0000","last_unstale":"2024-08-18T22:07:11.570807+0000","last_undegraded":"2024-08-18T22:07:11.570807+0000","last_fullsized":"2024-08-18T22:07:11.570807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:49.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528844+0000","last_change":"2024-08-18T22:05:21.857867+0000","last_active":"2024-08-18T22:07:11.528844+0000","last_peered":"2024-08-18T22:07:11.528844+0000","last_clean":"2024-08-18T22:07:11.528844+0000","last_became_active":"2024-08-18T22:05:21.857515+0000","last_became_peered":"2024-08-18T22:05:21.857515+0000","last_unstale":"2024-08-18T22:07:11.528844+0000","last_undegraded":"2024-08-18T22:07:11.528844+0000","last_fullsized":"2024-08-18T22:07:11.528844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:51.148321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":154,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:46.621204+0000","last_change":"2024-08-18T22:05:20.290924+0000","last_active":"2024-08-18T22:07:46.621204+0000","last_peered":"2024-08-18T22:07:46.621204+0000","last_clean":"2024-08-18T22:07:46.621204+0000","last_became_active":"2024-08-18T22:05:20.290587+0000","last_became_peered":"2024-08-18T22:05:20.290587+0000","last_unstale":"2024-08-18T22:07:46.621204+0000","last_undegraded":"2024-08-18T22:07:46.621204+0000","last_fullsized":"2024-08-18T22:07:46.621204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:35.029634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570655+0000","last_change":"2024-08-18T22:05:29.012876+0000","last_active":"2024-08-18T22:07:11.570655+0000","last_peered":"2024-08-18T22:07:11.570655+0000","last_clean":"2024-08-18T22:07:11.570655+0000","last_became_active":"2024-08-18T22:05:29.011930+0000","last_became_peered":"2024-08-18T22:05:29.011930+0000","last_unstale":"2024-08-18T22:07:11.570655+0000","last_undegraded":"2024-08-18T22:07:11.570655+0000","last_fullsized":"2024-08-18T22:07:11.570655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:22:35.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570198+0000","last_change":"2024-08-18T22:05:21.860798+0000","last_active":"2024-08-18T22:07:11.570198+0000","last_peered":"2024-08-18T22:07:11.570198+0000","last_clean":"2024-08-18T22:07:11.570198+0000","last_became_active":"2024-08-18T22:05:21.856968+0000","last_became_peered":"2024-08-18T22:05:21.856968+0000","last_unstale":"2024-08-18T22:07:11.570198+0000","last_undegraded":"2024-08-18T22:07:11.570198+0000","last_fullsized":"2024-08-18T22:07:11.570198+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:54.934400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527098+0000","last_change":"2024-08-18T22:05:19.844775+0000","last_active":"2024-08-18T22:07:11.527098+0000","last_peered":"2024-08-18T22:07:11.527098+0000","last_clean":"2024-08-18T22:07:11.527098+0000","last_became_active":"2024-08-18T22:05:19.844465+0000","last_became_peered":"2024-08-18T22:05:19.844465+0000","last_unstale":"2024-08-18T22:07:11.527098+0000","last_undegraded":"2024-08-18T22:07:11.527098+0000","last_fullsized":"2024-08-18T22:07:11.527098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.042335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528645+0000","last_change":"2024-08-18T22:05:29.013275+0000","last_active":"2024-08-18T22:07:11.528645+0000","last_peered":"2024-08-18T22:07:11.528645+0000","last_clean":"2024-08-18T22:07:11.528645+0000","last_became_active":"2024-08-18T22:05:29.012537+0000","last_became_peered":"2024-08-18T22:05:29.012537+0000","last_unstale":"2024-08-18T22:07:11.528645+0000","last_undegraded":"2024-08-18T22:07:11.528645+0000","last_fullsized":"2024-08-18T22:07:11.528645+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:15:39.775360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572574+0000","last_change":"2024-08-18T22:05:21.853358+0000","last_active":"2024-08-18T22:07:11.572574+0000","last_peered":"2024-08-18T22:07:11.572574+0000","last_clean":"2024-08-18T22:07:11.572574+0000","last_became_active":"2024-08-18T22:05:21.853071+0000","last_became_peered":"2024-08-18T22:05:21.853071+0000","last_unstale":"2024-08-18T22:07:11.572574+0000","last_undegraded":"2024-08-18T22:07:11.572574+0000","last_fullsized":"2024-08-18T22:07:11.572574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:23.755263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573411+0000","last_change":"2024-08-18T22:05:19.846922+0000","last_active":"2024-08-18T22:07:11.573411+0000","last_peered":"2024-08-18T22:07:11.573411+0000","last_clean":"2024-08-18T22:07:11.573411+0000","last_became_active":"2024-08-18T22:05:19.846619+0000","last_became_peered":"2024-08-18T22:05:19.846619+0000","last_unstale":"2024-08-18T22:07:11.573411+0000","last_undegraded":"2024-08-18T22:07:11.573411+0000","last_fullsized":"2024-08-18T22:07:11.573411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:36:16.232344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":357,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527160+0000","last_change":"2024-08-18T22:04:11.878703+0000","last_active":"2024-08-18T22:07:11.527160+0000","last_peered":"2024-08-18T22:07:11.527160+0000","last_clean":"2024-08-18T22:07:11.527160+0000","last_became_active":"2024-08-18T22:04:11.878157+0000","last_became_peered":"2024-08-18T22:04:11.878157+0000","last_unstale":"2024-08-18T22:07:11.527160+0000","last_undegraded":"2024-08-18T22:07:11.527160+0000","last_fullsized":"2024-08-18T22:07:11.527160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_clean_scrub_stamp":"2024-08-18T22:01:09.551264+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:24:07.391758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527387+0000","last_change":"2024-08-18T22:05:28.928882+0000","last_active":"2024-08-18T22:07:11.527387+0000","last_peered":"2024-08-18T22:07:11.527387+0000","last_clean":"2024-08-18T22:07:11.527387+0000","last_became_active":"2024-08-18T22:05:28.928482+0000","last_became_peered":"2024-08-18T22:05:28.928482+0000","last_unstale":"2024-08-18T22:07:11.527387+0000","last_undegraded":"2024-08-18T22:07:11.527387+0000","last_fullsized":"2024-08-18T22:07:11.527387+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:41.739482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527496+0000","last_change":"2024-08-18T22:05:21.863045+0000","last_active":"2024-08-18T22:07:11.527496+0000","last_peered":"2024-08-18T22:07:11.527496+0000","last_clean":"2024-08-18T22:07:11.527496+0000","last_became_active":"2024-08-18T22:05:21.862758+0000","last_became_peered":"2024-08-18T22:05:21.862758+0000","last_unstale":"2024-08-18T22:07:11.527496+0000","last_undegraded":"2024-08-18T22:07:11.527496+0000","last_fullsized":"2024-08-18T22:07:11.527496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:08:39.111147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531069+0000","last_change":"2024-08-18T22:05:20.291030+0000","last_active":"2024-08-18T22:07:11.531069+0000","last_peered":"2024-08-18T22:07:11.531069+0000","last_clean":"2024-08-18T22:07:11.531069+0000","last_became_active":"2024-08-18T22:05:20.290427+0000","last_became_peered":"2024-08-18T22:05:20.290427+0000","last_unstale":"2024-08-18T22:07:11.531069+0000","last_undegraded":"2024-08-18T22:07:11.531069+0000","last_fullsized":"2024-08-18T22:07:11.531069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:14:42.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528742+0000","last_change":"2024-08-18T22:05:28.923700+0000","last_active":"2024-08-18T22:07:11.528742+0000","last_peered":"2024-08-18T22:07:11.528742+0000","last_clean":"2024-08-18T22:07:11.528742+0000","last_became_active":"2024-08-18T22:05:28.923280+0000","last_became_peered":"2024-08-18T22:05:28.923280+0000","last_unstale":"2024-08-18T22:07:11.528742+0000","last_undegraded":"2024-08-18T22:07:11.528742+0000","last_fullsized":"2024-08-18T22:07:11.528742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:25:45.343542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527521+0000","last_change":"2024-08-18T22:05:21.856107+0000","last_active":"2024-08-18T22:07:11.527521+0000","last_peered":"2024-08-18T22:07:11.527521+0000","last_clean":"2024-08-18T22:07:11.527521+0000","last_became_active":"2024-08-18T22:05:21.853276+0000","last_became_peered":"2024-08-18T22:05:21.853276+0000","last_unstale":"2024-08-18T22:07:11.527521+0000","last_undegraded":"2024-08-18T22:07:11.527521+0000","last_fullsized":"2024-08-18T22:07:11.527521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:58.280375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528926+0000","last_change":"2024-08-18T22:05:19.843445+0000","last_active":"2024-08-18T22:07:11.528926+0000","last_peered":"2024-08-18T22:07:11.528926+0000","last_clean":"2024-08-18T22:07:11.528926+0000","last_became_active":"2024-08-18T22:05:19.843000+0000","last_became_peered":"2024-08-18T22:05:19.843000+0000","last_unstale":"2024-08-18T22:07:11.528926+0000","last_undegraded":"2024-08-18T22:07:11.528926+0000","last_fullsized":"2024-08-18T22:07:11.528926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:23.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623212+0000","last_change":"2024-08-18T22:06:10.515953+0000","last_active":"2024-08-18T22:07:11.623212+0000","last_peered":"2024-08-18T22:07:11.623212+0000","last_clean":"2024-08-18T22:07:11.623212+0000","last_became_active":"2024-08-18T22:06:10.515662+0000","last_became_peered":"2024-08-18T22:06:10.515662+0000","last_unstale":"2024-08-18T22:07:11.623212+0000","last_undegraded":"2024-08-18T22:07:11.623212+0000","last_fullsized":"2024-08-18T22:07:11.623212+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:43.150180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527523+0000","last_change":"2024-08-18T22:05:21.864029+0000","last_active":"2024-08-18T22:07:11.527523+0000","last_peered":"2024-08-18T22:07:11.527523+0000","last_clean":"2024-08-18T22:07:11.527523+0000","last_became_active":"2024-08-18T22:05:21.863509+0000","last_became_peered":"2024-08-18T22:05:21.863509+0000","last_unstale":"2024-08-18T22:07:11.527523+0000","last_undegraded":"2024-08-18T22:07:11.527523+0000","last_fullsized":"2024-08-18T22:07:11.527523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:42.879243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570764+0000","last_change":"2024-08-18T22:05:19.846514+0000","last_active":"2024-08-18T22:07:11.570764+0000","last_peered":"2024-08-18T22:07:11.570764+0000","last_clean":"2024-08-18T22:07:11.570764+0000","last_became_active":"2024-08-18T22:05:19.846190+0000","last_became_peered":"2024-08-18T22:05:19.846190+0000","last_unstale":"2024-08-18T22:07:11.570764+0000","last_undegraded":"2024-08-18T22:07:11.570764+0000","last_fullsized":"2024-08-18T22:07:11.570764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:49:00.317597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528349+0000","last_change":"2024-08-18T22:05:28.923183+0000","last_active":"2024-08-18T22:07:11.528349+0000","last_peered":"2024-08-18T22:07:11.528349+0000","last_clean":"2024-08-18T22:07:11.528349+0000","last_became_active":"2024-08-18T22:05:28.922809+0000","last_became_peered":"2024-08-18T22:05:28.922809+0000","last_unstale":"2024-08-18T22:07:11.528349+0000","last_undegraded":"2024-08-18T22:07:11.528349+0000","last_fullsized":"2024-08-18T22:07:11.528349+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:26.416920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526764+0000","last_change":"2024-08-18T22:05:21.849075+0000","last_active":"2024-08-18T22:07:11.526764+0000","last_peered":"2024-08-18T22:07:11.526764+0000","last_clean":"2024-08-18T22:07:11.526764+0000","last_became_active":"2024-08-18T22:05:21.848759+0000","last_became_peered":"2024-08-18T22:05:21.848759+0000","last_unstale":"2024-08-18T22:07:11.526764+0000","last_undegraded":"2024-08-18T22:07:11.526764+0000","last_fullsized":"2024-08-18T22:07:11.526764+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:26.531534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524964+0000","last_change":"2024-08-18T22:05:19.849210+0000","last_active":"2024-08-18T22:07:11.524964+0000","last_peered":"2024-08-18T22:07:11.524964+0000","last_clean":"2024-08-18T22:07:11.524964+0000","last_became_active":"2024-08-18T22:05:19.848829+0000","last_became_peered":"2024-08-18T22:05:19.848829+0000","last_unstale":"2024-08-18T22:07:11.524964+0000","last_undegraded":"2024-08-18T22:07:11.524964+0000","last_fullsized":"2024-08-18T22:07:11.524964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:19.321686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528709+0000","last_change":"2024-08-18T22:05:28.924577+0000","last_active":"2024-08-18T22:07:11.528709+0000","last_peered":"2024-08-18T22:07:11.528709+0000","last_clean":"2024-08-18T22:07:11.528709+0000","last_became_active":"2024-08-18T22:05:28.924183+0000","last_became_peered":"2024-08-18T22:05:28.924183+0000","last_unstale":"2024-08-18T22:07:11.528709+0000","last_undegraded":"2024-08-18T22:07:11.528709+0000","last_fullsized":"2024-08-18T22:07:11.528709+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:22.702757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523154+0000","last_change":"2024-08-18T22:06:10.513610+0000","last_active":"2024-08-18T22:07:11.523154+0000","last_peered":"2024-08-18T22:07:11.523154+0000","last_clean":"2024-08-18T22:07:11.523154+0000","last_became_active":"2024-08-18T22:06:10.513400+0000","last_became_peered":"2024-08-18T22:06:10.513400+0000","last_unstale":"2024-08-18T22:07:11.523154+0000","last_undegraded":"2024-08-18T22:07:11.523154+0000","last_fullsized":"2024-08-18T22:07:11.523154+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:49.275223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524463+0000","last_change":"2024-08-18T22:05:20.291752+0000","last_active":"2024-08-18T22:07:11.524463+0000","last_peered":"2024-08-18T22:07:11.524463+0000","last_clean":"2024-08-18T22:07:11.524463+0000","last_became_active":"2024-08-18T22:05:20.291431+0000","last_became_peered":"2024-08-18T22:05:20.291431+0000","last_unstale":"2024-08-18T22:07:11.524463+0000","last_undegraded":"2024-08-18T22:07:11.524463+0000","last_fullsized":"2024-08-18T22:07:11.524463+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:32.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570623+0000","last_change":"2024-08-18T22:05:28.924121+0000","last_active":"2024-08-18T22:07:11.570623+0000","last_peered":"2024-08-18T22:07:11.570623+0000","last_clean":"2024-08-18T22:07:11.570623+0000","last_became_active":"2024-08-18T22:05:28.923753+0000","last_became_peered":"2024-08-18T22:05:28.923753+0000","last_unstale":"2024-08-18T22:07:11.570623+0000","last_undegraded":"2024-08-18T22:07:11.570623+0000","last_fullsized":"2024-08-18T22:07:11.570623+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:57.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527050+0000","last_change":"2024-08-18T22:05:21.858366+0000","last_active":"2024-08-18T22:07:11.527050+0000","last_peered":"2024-08-18T22:07:11.527050+0000","last_clean":"2024-08-18T22:07:11.527050+0000","last_became_active":"2024-08-18T22:05:21.858021+0000","last_became_peered":"2024-08-18T22:05:21.858021+0000","last_unstale":"2024-08-18T22:07:11.527050+0000","last_undegraded":"2024-08-18T22:07:11.527050+0000","last_fullsized":"2024-08-18T22:07:11.527050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:55.662965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":159,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:47.623483+0000","last_change":"2024-08-18T22:05:19.850013+0000","last_active":"2024-08-18T22:07:47.623483+0000","last_peered":"2024-08-18T22:07:47.623483+0000","last_clean":"2024-08-18T22:07:47.623483+0000","last_became_active":"2024-08-18T22:05:19.849551+0000","last_became_peered":"2024-08-18T22:05:19.849551+0000","last_unstale":"2024-08-18T22:07:47.623483+0000","last_undegraded":"2024-08-18T22:07:47.623483+0000","last_fullsized":"2024-08-18T22:07:47.623483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:15.182999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523685+0000","last_change":"2024-08-18T22:05:28.927318+0000","last_active":"2024-08-18T22:07:11.523685+0000","last_peered":"2024-08-18T22:07:11.523685+0000","last_clean":"2024-08-18T22:07:11.523685+0000","last_became_active":"2024-08-18T22:05:28.926786+0000","last_became_peered":"2024-08-18T22:05:28.926786+0000","last_unstale":"2024-08-18T22:07:11.523685+0000","last_undegraded":"2024-08-18T22:07:11.523685+0000","last_fullsized":"2024-08-18T22:07:11.523685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:45.798247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527690+0000","last_change":"2024-08-18T22:06:10.511821+0000","last_active":"2024-08-18T22:07:11.527690+0000","last_peered":"2024-08-18T22:07:11.527690+0000","last_clean":"2024-08-18T22:07:11.527690+0000","last_became_active":"2024-08-18T22:06:10.511135+0000","last_became_peered":"2024-08-18T22:06:10.511135+0000","last_unstale":"2024-08-18T22:07:11.527690+0000","last_undegraded":"2024-08-18T22:07:11.527690+0000","last_fullsized":"2024-08-18T22:07:11.527690+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:07.108531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528618+0000","last_change":"2024-08-18T22:05:19.844061+0000","last_active":"2024-08-18T22:07:11.528618+0000","last_peered":"2024-08-18T22:07:11.528618+0000","last_clean":"2024-08-18T22:07:11.528618+0000","last_became_active":"2024-08-18T22:05:19.843513+0000","last_became_peered":"2024-08-18T22:05:19.843513+0000","last_unstale":"2024-08-18T22:07:11.528618+0000","last_undegraded":"2024-08-18T22:07:11.528618+0000","last_fullsized":"2024-08-18T22:07:11.528618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:53.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527054+0000","last_change":"2024-08-18T22:05:28.922986+0000","last_active":"2024-08-18T22:07:11.527054+0000","last_peered":"2024-08-18T22:07:11.527054+0000","last_clean":"2024-08-18T22:07:11.527054+0000","last_became_active":"2024-08-18T22:05:28.922322+0000","last_became_peered":"2024-08-18T22:05:28.922322+0000","last_unstale":"2024-08-18T22:07:11.527054+0000","last_undegraded":"2024-08-18T22:07:11.527054+0000","last_fullsized":"2024-08-18T22:07:11.527054+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:28.168299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570439+0000","last_change":"2024-08-18T22:05:21.853389+0000","last_active":"2024-08-18T22:07:11.570439+0000","last_peered":"2024-08-18T22:07:11.570439+0000","last_clean":"2024-08-18T22:07:11.570439+0000","last_became_active":"2024-08-18T22:05:21.853095+0000","last_became_peered":"2024-08-18T22:05:21.853095+0000","last_unstale":"2024-08-18T22:07:11.570439+0000","last_undegraded":"2024-08-18T22:07:11.570439+0000","last_fullsized":"2024-08-18T22:07:11.570439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:14.126983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531024+0000","last_change":"2024-08-18T22:05:19.846788+0000","last_active":"2024-08-18T22:07:11.531024+0000","last_peered":"2024-08-18T22:07:11.531024+0000","last_clean":"2024-08-18T22:07:11.531024+0000","last_became_active":"2024-08-18T22:05:19.846248+0000","last_became_peered":"2024-08-18T22:05:19.846248+0000","last_unstale":"2024-08-18T22:07:11.531024+0000","last_undegraded":"2024-08-18T22:07:11.531024+0000","last_fullsized":"2024-08-18T22:07:11.531024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:46.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528593+0000","last_change":"2024-08-18T22:05:28.920294+0000","last_active":"2024-08-18T22:07:11.528593+0000","last_peered":"2024-08-18T22:07:11.528593+0000","last_clean":"2024-08-18T22:07:11.528593+0000","last_became_active":"2024-08-18T22:05:28.919351+0000","last_became_peered":"2024-08-18T22:05:28.919351+0000","last_unstale":"2024-08-18T22:07:11.528593+0000","last_undegraded":"2024-08-18T22:07:11.528593+0000","last_fullsized":"2024-08-18T22:07:11.528593+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:49.425281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524875+0000","last_change":"2024-08-18T22:05:21.864529+0000","last_active":"2024-08-18T22:07:11.524875+0000","last_peered":"2024-08-18T22:07:11.524875+0000","last_clean":"2024-08-18T22:07:11.524875+0000","last_became_active":"2024-08-18T22:05:21.864062+0000","last_became_peered":"2024-08-18T22:05:21.864062+0000","last_unstale":"2024-08-18T22:07:11.524875+0000","last_undegraded":"2024-08-18T22:07:11.524875+0000","last_fullsized":"2024-08-18T22:07:11.524875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:24:49.037343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'37","reported_seq":327,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:48.675404+0000","last_change":"2024-08-18T22:06:10.522113+0000","last_active":"2024-08-18T22:07:48.675404+0000","last_peered":"2024-08-18T22:07:48.675404+0000","last_clean":"2024-08-18T22:07:48.675404+0000","last_became_active":"2024-08-18T22:06:10.514837+0000","last_became_peered":"2024-08-18T22:06:10.514837+0000","last_unstale":"2024-08-18T22:07:48.675404+0000","last_undegraded":"2024-08-18T22:07:48.675404+0000","last_fullsized":"2024-08-18T22:07:48.675404+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:46.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67447,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":228,"num_read_kb":175,"num_write":38,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523335+0000","last_change":"2024-08-18T22:05:28.926357+0000","last_active":"2024-08-18T22:07:11.523335+0000","last_peered":"2024-08-18T22:07:11.523335+0000","last_clean":"2024-08-18T22:07:11.523335+0000","last_became_active":"2024-08-18T22:05:28.926016+0000","last_became_peered":"2024-08-18T22:05:28.926016+0000","last_unstale":"2024-08-18T22:07:11.523335+0000","last_undegraded":"2024-08-18T22:07:11.523335+0000","last_fullsized":"2024-08-18T22:07:11.523335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:16.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529123+0000","last_change":"2024-08-18T22:05:21.860237+0000","last_active":"2024-08-18T22:07:11.529123+0000","last_peered":"2024-08-18T22:07:11.529123+0000","last_clean":"2024-08-18T22:07:11.529123+0000","last_became_active":"2024-08-18T22:05:21.859919+0000","last_became_peered":"2024-08-18T22:05:21.859919+0000","last_unstale":"2024-08-18T22:07:11.529123+0000","last_undegraded":"2024-08-18T22:07:11.529123+0000","last_fullsized":"2024-08-18T22:07:11.529123+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:21.048413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528892+0000","last_change":"2024-08-18T22:05:20.291233+0000","last_active":"2024-08-18T22:07:11.528892+0000","last_peered":"2024-08-18T22:07:11.528892+0000","last_clean":"2024-08-18T22:07:11.528892+0000","last_became_active":"2024-08-18T22:05:20.290893+0000","last_became_peered":"2024-08-18T22:05:20.290893+0000","last_unstale":"2024-08-18T22:07:11.528892+0000","last_undegraded":"2024-08-18T22:07:11.528892+0000","last_fullsized":"2024-08-18T22:07:11.528892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:36.889561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573103+0000","last_change":"2024-08-18T22:05:28.923076+0000","last_active":"2024-08-18T22:07:11.573103+0000","last_peered":"2024-08-18T22:07:11.573103+0000","last_clean":"2024-08-18T22:07:11.573103+0000","last_became_active":"2024-08-18T22:05:28.922688+0000","last_became_peered":"2024-08-18T22:05:28.922688+0000","last_unstale":"2024-08-18T22:07:11.573103+0000","last_undegraded":"2024-08-18T22:07:11.573103+0000","last_fullsized":"2024-08-18T22:07:11.573103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:34.360540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623665+0000","last_change":"2024-08-18T22:05:21.855174+0000","last_active":"2024-08-18T22:07:11.623665+0000","last_peered":"2024-08-18T22:07:11.623665+0000","last_clean":"2024-08-18T22:07:11.623665+0000","last_became_active":"2024-08-18T22:05:21.854818+0000","last_became_peered":"2024-08-18T22:05:21.854818+0000","last_unstale":"2024-08-18T22:07:11.623665+0000","last_undegraded":"2024-08-18T22:07:11.623665+0000","last_fullsized":"2024-08-18T22:07:11.623665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:48:55.094624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.577365+0000","last_change":"2024-08-18T22:07:11.576894+0000","last_active":"2024-08-18T22:07:11.577365+0000","last_peered":"2024-08-18T22:07:11.577365+0000","last_clean":"2024-08-18T22:07:11.577365+0000","last_became_active":"2024-08-18T22:07:11.574159+0000","last_became_peered":"2024-08-18T22:07:11.574159+0000","last_unstale":"2024-08-18T22:07:11.577365+0000","last_undegraded":"2024-08-18T22:07:11.577365+0000","last_fullsized":"2024-08-18T22:07:11.577365+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:37.993056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523194+0000","last_change":"2024-08-18T22:05:28.921647+0000","last_active":"2024-08-18T22:07:11.523194+0000","last_peered":"2024-08-18T22:07:11.523194+0000","last_clean":"2024-08-18T22:07:11.523194+0000","last_became_active":"2024-08-18T22:05:28.921305+0000","last_became_peered":"2024-08-18T22:05:28.921305+0000","last_unstale":"2024-08-18T22:07:11.523194+0000","last_undegraded":"2024-08-18T22:07:11.523194+0000","last_fullsized":"2024-08-18T22:07:11.523194+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:29.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529467+0000","last_change":"2024-08-18T22:05:21.861151+0000","last_active":"2024-08-18T22:07:11.529467+0000","last_peered":"2024-08-18T22:07:11.529467+0000","last_clean":"2024-08-18T22:07:11.529467+0000","last_became_active":"2024-08-18T22:05:21.860834+0000","last_became_peered":"2024-08-18T22:05:21.860834+0000","last_unstale":"2024-08-18T22:07:11.529467+0000","last_undegraded":"2024-08-18T22:07:11.529467+0000","last_fullsized":"2024-08-18T22:07:11.529467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:32.890750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":154,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:47.623560+0000","last_change":"2024-08-18T22:05:19.846145+0000","last_active":"2024-08-18T22:07:47.623560+0000","last_peered":"2024-08-18T22:07:47.623560+0000","last_clean":"2024-08-18T22:07:47.623560+0000","last_became_active":"2024-08-18T22:05:19.845711+0000","last_became_peered":"2024-08-18T22:05:19.845711+0000","last_unstale":"2024-08-18T22:07:47.623560+0000","last_undegraded":"2024-08-18T22:07:47.623560+0000","last_fullsized":"2024-08-18T22:07:47.623560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:20.376131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572385+0000","last_change":"2024-08-18T22:05:28.923256+0000","last_active":"2024-08-18T22:07:11.572385+0000","last_peered":"2024-08-18T22:07:11.572385+0000","last_clean":"2024-08-18T22:07:11.572385+0000","last_became_active":"2024-08-18T22:05:28.922845+0000","last_became_peered":"2024-08-18T22:05:28.922845+0000","last_unstale":"2024-08-18T22:07:11.572385+0000","last_undegraded":"2024-08-18T22:07:11.572385+0000","last_fullsized":"2024-08-18T22:07:11.572385+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:41.930937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623447+0000","last_change":"2024-08-18T22:05:28.924743+0000","last_active":"2024-08-18T22:07:11.623447+0000","last_peered":"2024-08-18T22:07:11.623447+0000","last_clean":"2024-08-18T22:07:11.623447+0000","last_became_active":"2024-08-18T22:05:28.923674+0000","last_became_peered":"2024-08-18T22:05:28.923674+0000","last_unstale":"2024-08-18T22:07:11.623447+0000","last_undegraded":"2024-08-18T22:07:11.623447+0000","last_fullsized":"2024-08-18T22:07:11.623447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:19.834998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523308+0000","last_change":"2024-08-18T22:05:21.857194+0000","last_active":"2024-08-18T22:07:11.523308+0000","last_peered":"2024-08-18T22:07:11.523308+0000","last_clean":"2024-08-18T22:07:11.523308+0000","last_became_active":"2024-08-18T22:05:21.856916+0000","last_became_peered":"2024-08-18T22:05:21.856916+0000","last_unstale":"2024-08-18T22:07:11.523308+0000","last_undegraded":"2024-08-18T22:07:11.523308+0000","last_fullsized":"2024-08-18T22:07:11.523308+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:24.759501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529123+0000","last_change":"2024-08-18T22:05:19.844919+0000","last_active":"2024-08-18T22:07:11.529123+0000","last_peered":"2024-08-18T22:07:11.529123+0000","last_clean":"2024-08-18T22:07:11.529123+0000","last_became_active":"2024-08-18T22:05:19.844539+0000","last_became_peered":"2024-08-18T22:05:19.844539+0000","last_unstale":"2024-08-18T22:07:11.529123+0000","last_undegraded":"2024-08-18T22:07:11.529123+0000","last_fullsized":"2024-08-18T22:07:11.529123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:01.598535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526775+0000","last_change":"2024-08-18T22:05:28.923304+0000","last_active":"2024-08-18T22:07:11.526775+0000","last_peered":"2024-08-18T22:07:11.526775+0000","last_clean":"2024-08-18T22:07:11.526775+0000","last_became_active":"2024-08-18T22:05:28.922912+0000","last_became_peered":"2024-08-18T22:05:28.922912+0000","last_unstale":"2024-08-18T22:07:11.526775+0000","last_undegraded":"2024-08-18T22:07:11.526775+0000","last_fullsized":"2024-08-18T22:07:11.526775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:24:47.834354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572444+0000","last_change":"2024-08-18T22:05:21.849448+0000","last_active":"2024-08-18T22:07:11.572444+0000","last_peered":"2024-08-18T22:07:11.572444+0000","last_clean":"2024-08-18T22:07:11.572444+0000","last_became_active":"2024-08-18T22:05:21.849154+0000","last_became_peered":"2024-08-18T22:05:21.849154+0000","last_unstale":"2024-08-18T22:07:11.572444+0000","last_undegraded":"2024-08-18T22:07:11.572444+0000","last_fullsized":"2024-08-18T22:07:11.572444+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:38.583121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570212+0000","last_change":"2024-08-18T22:05:19.848483+0000","last_active":"2024-08-18T22:07:11.570212+0000","last_peered":"2024-08-18T22:07:11.570212+0000","last_clean":"2024-08-18T22:07:11.570212+0000","last_became_active":"2024-08-18T22:05:19.848190+0000","last_became_peered":"2024-08-18T22:05:19.848190+0000","last_unstale":"2024-08-18T22:07:11.570212+0000","last_undegraded":"2024-08-18T22:07:11.570212+0000","last_fullsized":"2024-08-18T22:07:11.570212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:01.719565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522263+0000","last_change":"2024-08-18T22:05:19.843796+0000","last_active":"2024-08-18T22:07:11.522263+0000","last_peered":"2024-08-18T22:07:11.522263+0000","last_clean":"2024-08-18T22:07:11.522263+0000","last_became_active":"2024-08-18T22:05:19.843495+0000","last_became_peered":"2024-08-18T22:05:19.843495+0000","last_unstale":"2024-08-18T22:07:11.522263+0000","last_undegraded":"2024-08-18T22:07:11.522263+0000","last_fullsized":"2024-08-18T22:07:11.522263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:21.583561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528701+0000","last_change":"2024-08-18T22:05:21.856370+0000","last_active":"2024-08-18T22:07:11.528701+0000","last_peered":"2024-08-18T22:07:11.528701+0000","last_clean":"2024-08-18T22:07:11.528701+0000","last_became_active":"2024-08-18T22:05:21.855954+0000","last_became_peered":"2024-08-18T22:05:21.855954+0000","last_unstale":"2024-08-18T22:07:11.528701+0000","last_undegraded":"2024-08-18T22:07:11.528701+0000","last_fullsized":"2024-08-18T22:07:11.528701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:30.828305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530403+0000","last_change":"2024-08-18T22:06:10.516344+0000","last_active":"2024-08-18T22:07:11.530403+0000","last_peered":"2024-08-18T22:07:11.530403+0000","last_clean":"2024-08-18T22:07:11.530403+0000","last_became_active":"2024-08-18T22:06:10.515925+0000","last_became_peered":"2024-08-18T22:06:10.515925+0000","last_unstale":"2024-08-18T22:07:11.530403+0000","last_undegraded":"2024-08-18T22:07:11.530403+0000","last_fullsized":"2024-08-18T22:07:11.530403+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:41:07.585521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":162,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:49.627294+0000","last_change":"2024-08-18T22:05:19.846860+0000","last_active":"2024-08-18T22:07:49.627294+0000","last_peered":"2024-08-18T22:07:49.627294+0000","last_clean":"2024-08-18T22:07:49.627294+0000","last_became_active":"2024-08-18T22:05:19.846496+0000","last_became_peered":"2024-08-18T22:05:19.846496+0000","last_unstale":"2024-08-18T22:07:49.627294+0000","last_undegraded":"2024-08-18T22:07:49.627294+0000","last_fullsized":"2024-08-18T22:07:49.627294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:16.555137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524517+0000","last_change":"2024-08-18T22:05:21.849058+0000","last_active":"2024-08-18T22:07:11.524517+0000","last_peered":"2024-08-18T22:07:11.524517+0000","last_clean":"2024-08-18T22:07:11.524517+0000","last_became_active":"2024-08-18T22:05:21.848703+0000","last_became_peered":"2024-08-18T22:05:21.848703+0000","last_unstale":"2024-08-18T22:07:11.524517+0000","last_undegraded":"2024-08-18T22:07:11.524517+0000","last_fullsized":"2024-08-18T22:07:11.524517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:10.024156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530967+0000","last_change":"2024-08-18T22:05:28.922968+0000","last_active":"2024-08-18T22:07:11.530967+0000","last_peered":"2024-08-18T22:07:11.530967+0000","last_clean":"2024-08-18T22:07:11.530967+0000","last_became_active":"2024-08-18T22:05:28.922378+0000","last_became_peered":"2024-08-18T22:05:28.922378+0000","last_unstale":"2024-08-18T22:07:11.530967+0000","last_undegraded":"2024-08-18T22:07:11.530967+0000","last_fullsized":"2024-08-18T22:07:11.530967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:23:07.241028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526268+0000","last_change":"2024-08-18T22:05:21.858572+0000","last_active":"2024-08-18T22:07:11.526268+0000","last_peered":"2024-08-18T22:07:11.526268+0000","last_clean":"2024-08-18T22:07:11.526268+0000","last_became_active":"2024-08-18T22:05:21.858254+0000","last_became_peered":"2024-08-18T22:05:21.858254+0000","last_unstale":"2024-08-18T22:07:11.526268+0000","last_undegraded":"2024-08-18T22:07:11.526268+0000","last_fullsized":"2024-08-18T22:07:11.526268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:52.456087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531122+0000","last_change":"2024-08-18T22:05:21.856710+0000","last_active":"2024-08-18T22:07:11.531122+0000","last_peered":"2024-08-18T22:07:11.531122+0000","last_clean":"2024-08-18T22:07:11.531122+0000","last_became_active":"2024-08-18T22:05:21.855399+0000","last_became_peered":"2024-08-18T22:05:21.855399+0000","last_unstale":"2024-08-18T22:07:11.531122+0000","last_undegraded":"2024-08-18T22:07:11.531122+0000","last_fullsized":"2024-08-18T22:07:11.531122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:36.039953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530382+0000","last_change":"2024-08-18T22:05:21.856085+0000","last_active":"2024-08-18T22:07:11.530382+0000","last_peered":"2024-08-18T22:07:11.530382+0000","last_clean":"2024-08-18T22:07:11.530382+0000","last_became_active":"2024-08-18T22:05:21.855263+0000","last_became_peered":"2024-08-18T22:05:21.855263+0000","last_unstale":"2024-08-18T22:07:11.530382+0000","last_undegraded":"2024-08-18T22:07:11.530382+0000","last_fullsized":"2024-08-18T22:07:11.530382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:31.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623250+0000","last_change":"2024-08-18T22:05:21.855385+0000","last_active":"2024-08-18T22:07:11.623250+0000","last_peered":"2024-08-18T22:07:11.623250+0000","last_clean":"2024-08-18T22:07:11.623250+0000","last_became_active":"2024-08-18T22:05:21.854829+0000","last_became_peered":"2024-08-18T22:05:21.854829+0000","last_unstale":"2024-08-18T22:07:11.623250+0000","last_undegraded":"2024-08-18T22:07:11.623250+0000","last_fullsized":"2024-08-18T22:07:11.623250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:59.704154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570888+0000","last_change":"2024-08-18T22:06:10.510370+0000","last_active":"2024-08-18T22:07:11.570888+0000","last_peered":"2024-08-18T22:07:11.570888+0000","last_clean":"2024-08-18T22:07:11.570888+0000","last_became_active":"2024-08-18T22:06:10.509829+0000","last_became_peered":"2024-08-18T22:06:10.509829+0000","last_unstale":"2024-08-18T22:07:11.570888+0000","last_undegraded":"2024-08-18T22:07:11.570888+0000","last_fullsized":"2024-08-18T22:07:11.570888+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:20.171834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526688+0000","last_change":"2024-08-18T22:05:21.856137+0000","last_active":"2024-08-18T22:07:11.526688+0000","last_peered":"2024-08-18T22:07:11.526688+0000","last_clean":"2024-08-18T22:07:11.526688+0000","last_became_active":"2024-08-18T22:05:21.855425+0000","last_became_peered":"2024-08-18T22:05:21.855425+0000","last_unstale":"2024-08-18T22:07:11.526688+0000","last_undegraded":"2024-08-18T22:07:11.526688+0000","last_fullsized":"2024-08-18T22:07:11.526688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:37.514710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531196+0000","last_change":"2024-08-18T22:05:21.856084+0000","last_active":"2024-08-18T22:07:11.531196+0000","last_peered":"2024-08-18T22:07:11.531196+0000","last_clean":"2024-08-18T22:07:11.531196+0000","last_became_active":"2024-08-18T22:05:21.855779+0000","last_became_peered":"2024-08-18T22:05:21.855779+0000","last_unstale":"2024-08-18T22:07:11.531196+0000","last_undegraded":"2024-08-18T22:07:11.531196+0000","last_fullsized":"2024-08-18T22:07:11.531196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:02:47.833634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572883+0000","last_change":"2024-08-18T22:05:21.856729+0000","last_active":"2024-08-18T22:07:11.572883+0000","last_peered":"2024-08-18T22:07:11.572883+0000","last_clean":"2024-08-18T22:07:11.572883+0000","last_became_active":"2024-08-18T22:05:21.856446+0000","last_became_peered":"2024-08-18T22:05:21.856446+0000","last_unstale":"2024-08-18T22:07:11.572883+0000","last_undegraded":"2024-08-18T22:07:11.572883+0000","last_fullsized":"2024-08-18T22:07:11.572883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.482225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528910+0000","last_change":"2024-08-18T22:05:21.851772+0000","last_active":"2024-08-18T22:07:11.528910+0000","last_peered":"2024-08-18T22:07:11.528910+0000","last_clean":"2024-08-18T22:07:11.528910+0000","last_became_active":"2024-08-18T22:05:21.851417+0000","last_became_peered":"2024-08-18T22:05:21.851417+0000","last_unstale":"2024-08-18T22:07:11.528910+0000","last_undegraded":"2024-08-18T22:07:11.528910+0000","last_fullsized":"2024-08-18T22:07:11.528910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:32.509318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572470+0000","last_change":"2024-08-18T22:05:21.857887+0000","last_active":"2024-08-18T22:07:11.572470+0000","last_peered":"2024-08-18T22:07:11.572470+0000","last_clean":"2024-08-18T22:07:11.572470+0000","last_became_active":"2024-08-18T22:05:21.857585+0000","last_became_peered":"2024-08-18T22:05:21.857585+0000","last_unstale":"2024-08-18T22:07:11.572470+0000","last_undegraded":"2024-08-18T22:07:11.572470+0000","last_fullsized":"2024-08-18T22:07:11.572470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:23.299033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528948+0000","last_change":"2024-08-18T22:05:21.854626+0000","last_active":"2024-08-18T22:07:11.528948+0000","last_peered":"2024-08-18T22:07:11.528948+0000","last_clean":"2024-08-18T22:07:11.528948+0000","last_became_active":"2024-08-18T22:05:21.854290+0000","last_became_peered":"2024-08-18T22:05:21.854290+0000","last_unstale":"2024-08-18T22:07:11.528948+0000","last_undegraded":"2024-08-18T22:07:11.528948+0000","last_fullsized":"2024-08-18T22:07:11.528948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:45:24.988669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570558+0000","last_change":"2024-08-18T22:05:21.865863+0000","last_active":"2024-08-18T22:07:11.570558+0000","last_peered":"2024-08-18T22:07:11.570558+0000","last_clean":"2024-08-18T22:07:11.570558+0000","last_became_active":"2024-08-18T22:05:21.864634+0000","last_became_peered":"2024-08-18T22:05:21.864634+0000","last_unstale":"2024-08-18T22:07:11.570558+0000","last_undegraded":"2024-08-18T22:07:11.570558+0000","last_fullsized":"2024-08-18T22:07:11.570558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:34.051147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527095+0000","last_change":"2024-08-18T22:05:21.860193+0000","last_active":"2024-08-18T22:07:11.527095+0000","last_peered":"2024-08-18T22:07:11.527095+0000","last_clean":"2024-08-18T22:07:11.527095+0000","last_became_active":"2024-08-18T22:05:21.859761+0000","last_became_peered":"2024-08-18T22:05:21.859761+0000","last_unstale":"2024-08-18T22:07:11.527095+0000","last_undegraded":"2024-08-18T22:07:11.527095+0000","last_fullsized":"2024-08-18T22:07:11.527095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:18.465913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531192+0000","last_change":"2024-08-18T22:05:21.860569+0000","last_active":"2024-08-18T22:07:11.531192+0000","last_peered":"2024-08-18T22:07:11.531192+0000","last_clean":"2024-08-18T22:07:11.531192+0000","last_became_active":"2024-08-18T22:05:21.860250+0000","last_became_peered":"2024-08-18T22:05:21.860250+0000","last_unstale":"2024-08-18T22:07:11.531192+0000","last_undegraded":"2024-08-18T22:07:11.531192+0000","last_fullsized":"2024-08-18T22:07:11.531192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:52.097840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523697+0000","last_change":"2024-08-18T22:05:21.858271+0000","last_active":"2024-08-18T22:07:11.523697+0000","last_peered":"2024-08-18T22:07:11.523697+0000","last_clean":"2024-08-18T22:07:11.523697+0000","last_became_active":"2024-08-18T22:05:21.857968+0000","last_became_peered":"2024-08-18T22:05:21.857968+0000","last_unstale":"2024-08-18T22:07:11.523697+0000","last_undegraded":"2024-08-18T22:07:11.523697+0000","last_fullsized":"2024-08-18T22:07:11.523697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:24.023136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526949+0000","last_change":"2024-08-18T22:05:21.853799+0000","last_active":"2024-08-18T22:07:11.526949+0000","last_peered":"2024-08-18T22:07:11.526949+0000","last_clean":"2024-08-18T22:07:11.526949+0000","last_became_active":"2024-08-18T22:05:21.853432+0000","last_became_peered":"2024-08-18T22:05:21.853432+0000","last_unstale":"2024-08-18T22:07:11.526949+0000","last_undegraded":"2024-08-18T22:07:11.526949+0000","last_fullsized":"2024-08-18T22:07:11.526949+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:07.429169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528548+0000","last_change":"2024-08-18T22:05:21.855117+0000","last_active":"2024-08-18T22:07:11.528548+0000","last_peered":"2024-08-18T22:07:11.528548+0000","last_clean":"2024-08-18T22:07:11.528548+0000","last_became_active":"2024-08-18T22:05:21.854041+0000","last_became_peered":"2024-08-18T22:05:21.854041+0000","last_unstale":"2024-08-18T22:07:11.528548+0000","last_undegraded":"2024-08-18T22:07:11.528548+0000","last_fullsized":"2024-08-18T22:07:11.528548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:17.222658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623177+0000","last_change":"2024-08-18T22:05:21.861745+0000","last_active":"2024-08-18T22:07:11.623177+0000","last_peered":"2024-08-18T22:07:11.623177+0000","last_clean":"2024-08-18T22:07:11.623177+0000","last_became_active":"2024-08-18T22:05:21.861427+0000","last_became_peered":"2024-08-18T22:05:21.861427+0000","last_unstale":"2024-08-18T22:07:11.623177+0000","last_undegraded":"2024-08-18T22:07:11.623177+0000","last_fullsized":"2024-08-18T22:07:11.623177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:17.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623245+0000","last_change":"2024-08-18T22:05:21.860046+0000","last_active":"2024-08-18T22:07:11.623245+0000","last_peered":"2024-08-18T22:07:11.623245+0000","last_clean":"2024-08-18T22:07:11.623245+0000","last_became_active":"2024-08-18T22:05:21.859674+0000","last_became_peered":"2024-08-18T22:05:21.859674+0000","last_unstale":"2024-08-18T22:07:11.623245+0000","last_undegraded":"2024-08-18T22:07:11.623245+0000","last_fullsized":"2024-08-18T22:07:11.623245+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:44.615270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570548+0000","last_change":"2024-08-18T22:05:21.847647+0000","last_active":"2024-08-18T22:07:11.570548+0000","last_peered":"2024-08-18T22:07:11.570548+0000","last_clean":"2024-08-18T22:07:11.570548+0000","last_became_active":"2024-08-18T22:05:21.847367+0000","last_became_peered":"2024-08-18T22:05:21.847367+0000","last_unstale":"2024-08-18T22:07:11.570548+0000","last_undegraded":"2024-08-18T22:07:11.570548+0000","last_fullsized":"2024-08-18T22:07:11.570548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:33.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573513+0000","last_change":"2024-08-18T22:05:21.861326+0000","last_active":"2024-08-18T22:07:11.573513+0000","last_peered":"2024-08-18T22:07:11.573513+0000","last_clean":"2024-08-18T22:07:11.573513+0000","last_became_active":"2024-08-18T22:05:21.860968+0000","last_became_peered":"2024-08-18T22:05:21.860968+0000","last_unstale":"2024-08-18T22:07:11.573513+0000","last_undegraded":"2024-08-18T22:07:11.573513+0000","last_fullsized":"2024-08-18T22:07:11.573513+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:49.150670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527532+0000","last_change":"2024-08-18T22:05:21.852618+0000","last_active":"2024-08-18T22:07:11.527532+0000","last_peered":"2024-08-18T22:07:11.527532+0000","last_clean":"2024-08-18T22:07:11.527532+0000","last_became_active":"2024-08-18T22:05:21.852318+0000","last_became_peered":"2024-08-18T22:05:21.852318+0000","last_unstale":"2024-08-18T22:07:11.527532+0000","last_undegraded":"2024-08-18T22:07:11.527532+0000","last_fullsized":"2024-08-18T22:07:11.527532+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:06:49.085150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522585+0000","last_change":"2024-08-18T22:05:21.860108+0000","last_active":"2024-08-18T22:07:11.522585+0000","last_peered":"2024-08-18T22:07:11.522585+0000","last_clean":"2024-08-18T22:07:11.522585+0000","last_became_active":"2024-08-18T22:05:21.859794+0000","last_became_peered":"2024-08-18T22:05:21.859794+0000","last_unstale":"2024-08-18T22:07:11.522585+0000","last_undegraded":"2024-08-18T22:07:11.522585+0000","last_fullsized":"2024-08-18T22:07:11.522585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:01.974202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529519+0000","last_change":"2024-08-18T22:05:21.856404+0000","last_active":"2024-08-18T22:07:11.529519+0000","last_peered":"2024-08-18T22:07:11.529519+0000","last_clean":"2024-08-18T22:07:11.529519+0000","last_became_active":"2024-08-18T22:05:21.855800+0000","last_became_peered":"2024-08-18T22:05:21.855800+0000","last_unstale":"2024-08-18T22:07:11.529519+0000","last_undegraded":"2024-08-18T22:07:11.529519+0000","last_fullsized":"2024-08-18T22:07:11.529519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:09.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572403+0000","last_change":"2024-08-18T22:05:21.859891+0000","last_active":"2024-08-18T22:07:11.572403+0000","last_peered":"2024-08-18T22:07:11.572403+0000","last_clean":"2024-08-18T22:07:11.572403+0000","last_became_active":"2024-08-18T22:05:21.859407+0000","last_became_peered":"2024-08-18T22:05:21.859407+0000","last_unstale":"2024-08-18T22:07:11.572403+0000","last_undegraded":"2024-08-18T22:07:11.572403+0000","last_fullsized":"2024-08-18T22:07:11.572403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:59.285627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527004+0000","last_change":"2024-08-18T22:05:21.856428+0000","last_active":"2024-08-18T22:07:11.527004+0000","last_peered":"2024-08-18T22:07:11.527004+0000","last_clean":"2024-08-18T22:07:11.527004+0000","last_became_active":"2024-08-18T22:05:21.853374+0000","last_became_peered":"2024-08-18T22:05:21.853374+0000","last_unstale":"2024-08-18T22:07:11.527004+0000","last_undegraded":"2024-08-18T22:07:11.527004+0000","last_fullsized":"2024-08-18T22:07:11.527004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:07.087171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522013+0000","last_change":"2024-08-18T22:05:21.852688+0000","last_active":"2024-08-18T22:07:11.522013+0000","last_peered":"2024-08-18T22:07:11.522013+0000","last_clean":"2024-08-18T22:07:11.522013+0000","last_became_active":"2024-08-18T22:05:21.851107+0000","last_became_peered":"2024-08-18T22:05:21.851107+0000","last_unstale":"2024-08-18T22:07:11.522013+0000","last_undegraded":"2024-08-18T22:07:11.522013+0000","last_fullsized":"2024-08-18T22:07:11.522013+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:48.267166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524601+0000","last_change":"2024-08-18T22:05:21.850809+0000","last_active":"2024-08-18T22:07:11.524601+0000","last_peered":"2024-08-18T22:07:11.524601+0000","last_clean":"2024-08-18T22:07:11.524601+0000","last_became_active":"2024-08-18T22:05:21.850510+0000","last_became_peered":"2024-08-18T22:05:21.850510+0000","last_unstale":"2024-08-18T22:07:11.524601+0000","last_undegraded":"2024-08-18T22:07:11.524601+0000","last_fullsized":"2024-08-18T22:07:11.524601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:39.338051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573466+0000","last_change":"2024-08-18T22:05:21.856156+0000","last_active":"2024-08-18T22:07:11.573466+0000","last_peered":"2024-08-18T22:07:11.573466+0000","last_clean":"2024-08-18T22:07:11.573466+0000","last_became_active":"2024-08-18T22:05:21.855830+0000","last_became_peered":"2024-08-18T22:05:21.855830+0000","last_unstale":"2024-08-18T22:07:11.573466+0000","last_undegraded":"2024-08-18T22:07:11.573466+0000","last_fullsized":"2024-08-18T22:07:11.573466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:10.670405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623466+0000","last_change":"2024-08-18T22:05:21.865162+0000","last_active":"2024-08-18T22:07:11.623466+0000","last_peered":"2024-08-18T22:07:11.623466+0000","last_clean":"2024-08-18T22:07:11.623466+0000","last_became_active":"2024-08-18T22:05:21.864842+0000","last_became_peered":"2024-08-18T22:05:21.864842+0000","last_unstale":"2024-08-18T22:07:11.623466+0000","last_undegraded":"2024-08-18T22:07:11.623466+0000","last_fullsized":"2024-08-18T22:07:11.623466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:21.388638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623496+0000","last_change":"2024-08-18T22:05:21.859227+0000","last_active":"2024-08-18T22:07:11.623496+0000","last_peered":"2024-08-18T22:07:11.623496+0000","last_clean":"2024-08-18T22:07:11.623496+0000","last_became_active":"2024-08-18T22:05:21.858886+0000","last_became_peered":"2024-08-18T22:05:21.858886+0000","last_unstale":"2024-08-18T22:07:11.623496+0000","last_undegraded":"2024-08-18T22:07:11.623496+0000","last_fullsized":"2024-08-18T22:07:11.623496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:08.710772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526871+0000","last_change":"2024-08-18T22:05:21.854864+0000","last_active":"2024-08-18T22:07:11.526871+0000","last_peered":"2024-08-18T22:07:11.526871+0000","last_clean":"2024-08-18T22:07:11.526871+0000","last_became_active":"2024-08-18T22:05:21.854522+0000","last_became_peered":"2024-08-18T22:05:21.854522+0000","last_unstale":"2024-08-18T22:07:11.526871+0000","last_undegraded":"2024-08-18T22:07:11.526871+0000","last_fullsized":"2024-08-18T22:07:11.526871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:32.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72119,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":692,"num_read_kb":416,"num_write":180,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":216357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514538,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1052672,"data_stored":523218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743472,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37048,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708104,"statfs":{"total":95995035648,"available":95957098496,"internally_reserved":0,"allocated":1753088,"data_stored":1182560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906997,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":523454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168634,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1069056,"data_stored":523374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397565,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36968,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708184,"statfs":{"total":95995035648,"available":95957180416,"internally_reserved":0,"allocated":1662976,"data_stored":1119954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561090,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":518630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790022,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28656,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716496,"statfs":{"total":95995035648,"available":95965691904,"internally_reserved":0,"allocated":1671168,"data_stored":1115011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953547,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36448,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708704,"statfs":{"total":95995035648,"available":95957712896,"internally_reserved":0,"allocated":1138688,"data_stored":591258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1060864,"data_stored":518824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":520421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":585987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1073152,"data_stored":520018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:07:56.126 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-18T22:07:56.640 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-18T22:07:56.713 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:56.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:56 smithi123 ceph-mon[18462]: scrub queued for path: / 2024-08-18T22:07:56.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:56 smithi123 ceph-mon[18462]: scrub summary: idle+waiting paths [/] 2024-08-18T22:07:56.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:56 smithi123 ceph-mon[18462]: scrub summary: active paths [/] 2024-08-18T22:07:56.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:56 smithi123 ceph-mon[18462]: scrub summary: idle+waiting paths [/] 2024-08-18T22:07:56.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:56 smithi123 ceph-mon[18462]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:56.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:56 smithi123 ceph-mon[18462]: pgmap v345: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-18T22:07:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:56 smithi130 ceph-mon[21698]: scrub queued for path: / 2024-08-18T22:07:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:56 smithi130 ceph-mon[21698]: scrub summary: idle+waiting paths [/] 2024-08-18T22:07:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:56 smithi130 ceph-mon[21698]: scrub summary: active paths [/] 2024-08-18T22:07:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:56 smithi130 ceph-mon[21698]: scrub summary: idle+waiting paths [/] 2024-08-18T22:07:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:56 smithi130 ceph-mon[21698]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:56.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:56 smithi130 ceph-mon[21698]: pgmap v345: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-18T22:07:56.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:56 smithi183 ceph-mon[22097]: scrub queued for path: / 2024-08-18T22:07:56.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:56 smithi183 ceph-mon[22097]: scrub summary: idle+waiting paths [/] 2024-08-18T22:07:56.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:56 smithi183 ceph-mon[22097]: scrub summary: active paths [/] 2024-08-18T22:07:56.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:56 smithi183 ceph-mon[22097]: scrub summary: idle+waiting paths [/] 2024-08-18T22:07:56.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:56 smithi183 ceph-mon[22097]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:56.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:56 smithi183 ceph-mon[22097]: pgmap v345: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-18T22:07:57.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.196+0000 7f5090fa7640 1 -- 172.21.15.123:0/1289855715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f508c1007b0 msgr2=0x7f508c100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.196+0000 7f5090fa7640 1 --2- 172.21.15.123:0/1289855715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f508c1007b0 0x7f508c100c10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5080009930 tx=0x7f508002a420 comp rx=0 tx=0).stop 2024-08-18T22:07:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.196+0000 7f5090fa7640 1 -- 172.21.15.123:0/1289855715 shutdown_connections 2024-08-18T22:07:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.196+0000 7f5090fa7640 1 --2- 172.21.15.123:0/1289855715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f508c101150 0x7f508c10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.196+0000 7f5090fa7640 1 --2- 172.21.15.123:0/1289855715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f508c1007b0 0x7f508c100c10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.196+0000 7f5090fa7640 1 --2- 172.21.15.123:0/1289855715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f508c1067b0 0x7f508c106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.196+0000 7f5090fa7640 1 -- 172.21.15.123:0/1289855715 >> 172.21.15.123:0/1289855715 conn(0x7f508c0fc4d0 msgr2=0x7f508c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.196+0000 7f5090fa7640 1 -- 172.21.15.123:0/1289855715 shutdown_connections 2024-08-18T22:07:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.196+0000 7f5090fa7640 1 -- 172.21.15.123:0/1289855715 wait complete. 2024-08-18T22:07:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.197+0000 7f5090fa7640 1 Processor -- start 2024-08-18T22:07:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.197+0000 7f5090fa7640 1 -- start start 2024-08-18T22:07:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.197+0000 7f5090fa7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f508c1007b0 0x7f508c196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.197+0000 7f5090fa7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f508c101150 0x7f508c1973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.197+0000 7f5090fa7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f508c1067b0 0x7f508c197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.197+0000 7f5090fa7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f508c110bd0 con 0x7f508c1067b0 2024-08-18T22:07:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.197+0000 7f5090fa7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f508c110a50 con 0x7f508c1007b0 2024-08-18T22:07:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.197+0000 7f5090fa7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f508c110d50 con 0x7f508c101150 2024-08-18T22:07:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.197+0000 7f508ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f508c1067b0 0x7f508c197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.197+0000 7f508ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f508c1067b0 0x7f508c197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46370/0 (socket says 172.21.15.123:46370) 2024-08-18T22:07:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.197+0000 7f508ad9d640 1 -- 172.21.15.123:0/1779067156 learned_addr learned my addr 172.21.15.123:0/1779067156 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.198+0000 7f5089d9b640 1 --2- 172.21.15.123:0/1779067156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f508c101150 0x7f508c1973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.198+0000 7f508a59c640 1 --2- 172.21.15.123:0/1779067156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f508c1007b0 0x7f508c196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.198+0000 7f508ad9d640 1 -- 172.21.15.123:0/1779067156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f508c101150 msgr2=0x7f508c1973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.198+0000 7f508ad9d640 1 --2- 172.21.15.123:0/1779067156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f508c101150 0x7f508c1973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.198+0000 7f508ad9d640 1 -- 172.21.15.123:0/1779067156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f508c1007b0 msgr2=0x7f508c196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.198+0000 7f508ad9d640 1 --2- 172.21.15.123:0/1779067156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f508c1007b0 0x7f508c196e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:57.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.198+0000 7f508ad9d640 1 -- 172.21.15.123:0/1779067156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c1a6700 con 0x7f508c1067b0 2024-08-18T22:07:57.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.198+0000 7f508ad9d640 1 --2- 172.21.15.123:0/1779067156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f508c1067b0 0x7f508c197910 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f508400cad0 tx=0x7f508400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:57.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.198+0000 7f507b7fe640 1 -- 172.21.15.123:0/1779067156 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508400ae20 con 0x7f508c1067b0 2024-08-18T22:07:57.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.198+0000 7f507b7fe640 1 -- 172.21.15.123:0/1779067156 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5084005020 con 0x7f508c1067b0 2024-08-18T22:07:57.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.198+0000 7f5090fa7640 1 -- 172.21.15.123:0/1779067156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508c1a69f0 con 0x7f508c1067b0 2024-08-18T22:07:57.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.198+0000 7f507b7fe640 1 -- 172.21.15.123:0/1779067156 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508400f6f0 con 0x7f508c1067b0 2024-08-18T22:07:57.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.198+0000 7f5090fa7640 1 -- 172.21.15.123:0/1779067156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f508c1a6eb0 con 0x7f508c1067b0 2024-08-18T22:07:57.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.199+0000 7f5090fa7640 1 -- 172.21.15.123:0/1779067156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f508c100c10 con 0x7f508c1067b0 2024-08-18T22:07:57.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.200+0000 7f507b7fe640 1 -- 172.21.15.123:0/1779067156 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f50840051d0 con 0x7f508c1067b0 2024-08-18T22:07:57.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.201+0000 7f507b7fe640 1 --2- 172.21.15.123:0/1779067156 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f50740a2b80 0x7f50740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:57.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.201+0000 7f508a59c640 1 --2- 172.21.15.123:0/1779067156 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f50740a2b80 0x7f50740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:57.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.201+0000 7f507b7fe640 1 -- 172.21.15.123:0/1779067156 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f50840cf7b0 con 0x7f508c1067b0 2024-08-18T22:07:57.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.201+0000 7f508a59c640 1 --2- 172.21.15.123:0/1779067156 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f50740a2b80 0x7f50740a5040 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f507c009890 tx=0x7f507c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:57.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.204+0000 7f507b7fe640 1 -- 172.21.15.123:0/1779067156 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5084014030 con 0x7f508c1067b0 2024-08-18T22:07:57.270 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.386+0000 7f5090fa7640 1 -- 172.21.15.123:0/1779067156 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f508c062360 con 0x7f50740a2b80 2024-08-18T22:07:57.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.394+0000 7f507b7fe640 1 -- 172.21.15.123:0/1779067156 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340502 (secure 0 0 0) 0x7f508c062360 con 0x7f50740a2b80 2024-08-18T22:07:57.398 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:57.400 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-08-18T22:07:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.398+0000 7f5090fa7640 1 -- 172.21.15.123:0/1779067156 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f50740a2b80 msgr2=0x7f50740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.398+0000 7f5090fa7640 1 --2- 172.21.15.123:0/1779067156 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f50740a2b80 0x7f50740a5040 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f507c009890 tx=0x7f507c008040 comp rx=0 tx=0).stop 2024-08-18T22:07:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.398+0000 7f5090fa7640 1 -- 172.21.15.123:0/1779067156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f508c1067b0 msgr2=0x7f508c197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.398+0000 7f5090fa7640 1 --2- 172.21.15.123:0/1779067156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f508c1067b0 0x7f508c197910 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f508400cad0 tx=0x7f508400cf90 comp rx=0 tx=0).stop 2024-08-18T22:07:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.398+0000 7f5090fa7640 1 -- 172.21.15.123:0/1779067156 shutdown_connections 2024-08-18T22:07:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.398+0000 7f5090fa7640 1 --2- 172.21.15.123:0/1779067156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f508c1067b0 0x7f508c197910 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.398+0000 7f5090fa7640 1 --2- 172.21.15.123:0/1779067156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f508c101150 0x7f508c1973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.398+0000 7f5090fa7640 1 --2- 172.21.15.123:0/1779067156 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f50740a2b80 0x7f50740a5040 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.398+0000 7f5090fa7640 1 --2- 172.21.15.123:0/1779067156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f508c1007b0 0x7f508c196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.398+0000 7f5090fa7640 1 -- 172.21.15.123:0/1779067156 >> 172.21.15.123:0/1779067156 conn(0x7f508c0fc4d0 msgr2=0x7f508c0fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.398+0000 7f5090fa7640 1 -- 172.21.15.123:0/1779067156 shutdown_connections 2024-08-18T22:07:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:57.398+0000 7f5090fa7640 1 -- 172.21.15.123:0/1779067156 wait complete. 2024-08-18T22:07:58.361 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2024-08-18T22:07:57.375939+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662721,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":849,"num_read_kb":541,"num_write":363,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1229945,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":793,"ondisk_log_size":793,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388624,"kb_used_data":14444,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553200,"statfs":{"total":1151940427776,"available":1151542476800,"internally_reserved":0,"allocated":14790656,"data_stored":8242709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003401"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:26.609141+0000","last_change":"2024-08-18T22:05:19.844674+0000","last_active":"2024-08-18T22:07:26.609141+0000","last_peered":"2024-08-18T22:07:26.609141+0000","last_clean":"2024-08-18T22:07:26.609141+0000","last_became_active":"2024-08-18T22:05:19.844381+0000","last_became_peered":"2024-08-18T22:05:19.844381+0000","last_unstale":"2024-08-18T22:07:26.609141+0000","last_undegraded":"2024-08-18T22:07:26.609141+0000","last_fullsized":"2024-08-18T22:07:26.609141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:58.783222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572759+0000","last_change":"2024-08-18T22:05:21.859013+0000","last_active":"2024-08-18T22:07:11.572759+0000","last_peered":"2024-08-18T22:07:11.572759+0000","last_clean":"2024-08-18T22:07:11.572759+0000","last_became_active":"2024-08-18T22:05:21.858709+0000","last_became_peered":"2024-08-18T22:05:21.858709+0000","last_unstale":"2024-08-18T22:07:11.572759+0000","last_undegraded":"2024-08-18T22:07:11.572759+0000","last_fullsized":"2024-08-18T22:07:11.572759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:34.272340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530666+0000","last_change":"2024-08-18T22:05:28.925735+0000","last_active":"2024-08-18T22:07:11.530666+0000","last_peered":"2024-08-18T22:07:11.530666+0000","last_clean":"2024-08-18T22:07:11.530666+0000","last_became_active":"2024-08-18T22:05:28.925324+0000","last_became_peered":"2024-08-18T22:05:28.925324+0000","last_unstale":"2024-08-18T22:07:11.530666+0000","last_undegraded":"2024-08-18T22:07:11.530666+0000","last_fullsized":"2024-08-18T22:07:11.530666+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:15:58.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572915+0000","last_change":"2024-08-18T22:05:20.290861+0000","last_active":"2024-08-18T22:07:11.572915+0000","last_peered":"2024-08-18T22:07:11.572915+0000","last_clean":"2024-08-18T22:07:11.572915+0000","last_became_active":"2024-08-18T22:05:20.290508+0000","last_became_peered":"2024-08-18T22:05:20.290508+0000","last_unstale":"2024-08-18T22:07:11.572915+0000","last_undegraded":"2024-08-18T22:07:11.572915+0000","last_fullsized":"2024-08-18T22:07:11.572915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:21.462206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623639+0000","last_change":"2024-08-18T22:05:21.863441+0000","last_active":"2024-08-18T22:07:11.623639+0000","last_peered":"2024-08-18T22:07:11.623639+0000","last_clean":"2024-08-18T22:07:11.623639+0000","last_became_active":"2024-08-18T22:05:21.863121+0000","last_became_peered":"2024-08-18T22:05:21.863121+0000","last_unstale":"2024-08-18T22:07:11.623639+0000","last_undegraded":"2024-08-18T22:07:11.623639+0000","last_fullsized":"2024-08-18T22:07:11.623639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:47.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572760+0000","last_change":"2024-08-18T22:05:28.925477+0000","last_active":"2024-08-18T22:07:11.572760+0000","last_peered":"2024-08-18T22:07:11.572760+0000","last_clean":"2024-08-18T22:07:11.572760+0000","last_became_active":"2024-08-18T22:05:28.924922+0000","last_became_peered":"2024-08-18T22:05:28.924922+0000","last_unstale":"2024-08-18T22:07:11.572760+0000","last_undegraded":"2024-08-18T22:07:11.572760+0000","last_fullsized":"2024-08-18T22:07:11.572760+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:35.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524985+0000","last_change":"2024-08-18T22:05:19.847979+0000","last_active":"2024-08-18T22:07:11.524985+0000","last_peered":"2024-08-18T22:07:11.524985+0000","last_clean":"2024-08-18T22:07:11.524985+0000","last_became_active":"2024-08-18T22:05:19.847643+0000","last_became_peered":"2024-08-18T22:05:19.847643+0000","last_unstale":"2024-08-18T22:07:11.524985+0000","last_undegraded":"2024-08-18T22:07:11.524985+0000","last_fullsized":"2024-08-18T22:07:11.524985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:33.875378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528980+0000","last_change":"2024-08-18T22:05:21.860225+0000","last_active":"2024-08-18T22:07:11.528980+0000","last_peered":"2024-08-18T22:07:11.528980+0000","last_clean":"2024-08-18T22:07:11.528980+0000","last_became_active":"2024-08-18T22:05:21.859889+0000","last_became_peered":"2024-08-18T22:05:21.859889+0000","last_unstale":"2024-08-18T22:07:11.528980+0000","last_undegraded":"2024-08-18T22:07:11.528980+0000","last_fullsized":"2024-08-18T22:07:11.528980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:06:27.084401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573134+0000","last_change":"2024-08-18T22:05:28.922230+0000","last_active":"2024-08-18T22:07:11.573134+0000","last_peered":"2024-08-18T22:07:11.573134+0000","last_clean":"2024-08-18T22:07:11.573134+0000","last_became_active":"2024-08-18T22:05:28.921804+0000","last_became_peered":"2024-08-18T22:05:28.921804+0000","last_unstale":"2024-08-18T22:07:11.573134+0000","last_undegraded":"2024-08-18T22:07:11.573134+0000","last_fullsized":"2024-08-18T22:07:11.573134+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:17.735645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.533950+0000","last_change":"2024-08-18T22:07:11.533541+0000","last_active":"2024-08-18T22:07:11.533950+0000","last_peered":"2024-08-18T22:07:11.533950+0000","last_clean":"2024-08-18T22:07:11.533950+0000","last_became_active":"2024-08-18T22:07:11.530034+0000","last_became_peered":"2024-08-18T22:07:11.530034+0000","last_unstale":"2024-08-18T22:07:11.533950+0000","last_undegraded":"2024-08-18T22:07:11.533950+0000","last_fullsized":"2024-08-18T22:07:11.533950+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:29.575399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528767+0000","last_change":"2024-08-18T22:06:10.514673+0000","last_active":"2024-08-18T22:07:11.528767+0000","last_peered":"2024-08-18T22:07:11.528767+0000","last_clean":"2024-08-18T22:07:11.528767+0000","last_became_active":"2024-08-18T22:06:10.514264+0000","last_became_peered":"2024-08-18T22:06:10.514264+0000","last_unstale":"2024-08-18T22:07:11.528767+0000","last_undegraded":"2024-08-18T22:07:11.528767+0000","last_fullsized":"2024-08-18T22:07:11.528767+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:03.626895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572808+0000","last_change":"2024-08-18T22:05:28.924521+0000","last_active":"2024-08-18T22:07:11.572808+0000","last_peered":"2024-08-18T22:07:11.572808+0000","last_clean":"2024-08-18T22:07:11.572808+0000","last_became_active":"2024-08-18T22:05:28.924107+0000","last_became_peered":"2024-08-18T22:05:28.924107+0000","last_unstale":"2024-08-18T22:07:11.572808+0000","last_undegraded":"2024-08-18T22:07:11.572808+0000","last_fullsized":"2024-08-18T22:07:11.572808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:37.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527669+0000","last_change":"2024-08-18T22:05:21.861696+0000","last_active":"2024-08-18T22:07:11.527669+0000","last_peered":"2024-08-18T22:07:11.527669+0000","last_clean":"2024-08-18T22:07:11.527669+0000","last_became_active":"2024-08-18T22:05:21.861220+0000","last_became_peered":"2024-08-18T22:05:21.861220+0000","last_unstale":"2024-08-18T22:07:11.527669+0000","last_undegraded":"2024-08-18T22:07:11.527669+0000","last_fullsized":"2024-08-18T22:07:11.527669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:01.098281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526302+0000","last_change":"2024-08-18T22:06:10.520097+0000","last_active":"2024-08-18T22:07:11.526302+0000","last_peered":"2024-08-18T22:07:11.526302+0000","last_clean":"2024-08-18T22:07:11.526302+0000","last_became_active":"2024-08-18T22:06:10.513286+0000","last_became_peered":"2024-08-18T22:06:10.513286+0000","last_unstale":"2024-08-18T22:07:11.526302+0000","last_undegraded":"2024-08-18T22:07:11.526302+0000","last_fullsized":"2024-08-18T22:07:11.526302+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:08:18.861243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573335+0000","last_change":"2024-08-18T22:05:29.013139+0000","last_active":"2024-08-18T22:07:11.573335+0000","last_peered":"2024-08-18T22:07:11.573335+0000","last_clean":"2024-08-18T22:07:11.573335+0000","last_became_active":"2024-08-18T22:05:29.012322+0000","last_became_peered":"2024-08-18T22:05:29.012322+0000","last_unstale":"2024-08-18T22:07:11.573335+0000","last_undegraded":"2024-08-18T22:07:11.573335+0000","last_fullsized":"2024-08-18T22:07:11.573335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:32.348201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572558+0000","last_change":"2024-08-18T22:05:21.860410+0000","last_active":"2024-08-18T22:07:11.572558+0000","last_peered":"2024-08-18T22:07:11.572558+0000","last_clean":"2024-08-18T22:07:11.572558+0000","last_became_active":"2024-08-18T22:05:21.860173+0000","last_became_peered":"2024-08-18T22:05:21.860173+0000","last_unstale":"2024-08-18T22:07:11.572558+0000","last_undegraded":"2024-08-18T22:07:11.572558+0000","last_fullsized":"2024-08-18T22:07:11.572558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:00.879178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530486+0000","last_change":"2024-08-18T22:05:19.845785+0000","last_active":"2024-08-18T22:07:11.530486+0000","last_peered":"2024-08-18T22:07:11.530486+0000","last_clean":"2024-08-18T22:07:11.530486+0000","last_became_active":"2024-08-18T22:05:19.845414+0000","last_became_peered":"2024-08-18T22:05:19.845414+0000","last_unstale":"2024-08-18T22:07:11.530486+0000","last_undegraded":"2024-08-18T22:07:11.530486+0000","last_fullsized":"2024-08-18T22:07:11.530486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:13.504885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573296+0000","last_change":"2024-08-18T22:06:10.523404+0000","last_active":"2024-08-18T22:07:11.573296+0000","last_peered":"2024-08-18T22:07:11.573296+0000","last_clean":"2024-08-18T22:07:11.573296+0000","last_became_active":"2024-08-18T22:06:10.516652+0000","last_became_peered":"2024-08-18T22:06:10.516652+0000","last_unstale":"2024-08-18T22:07:11.573296+0000","last_undegraded":"2024-08-18T22:07:11.573296+0000","last_fullsized":"2024-08-18T22:07:11.573296+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:58.197636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526366+0000","last_change":"2024-08-18T22:05:21.858329+0000","last_active":"2024-08-18T22:07:11.526366+0000","last_peered":"2024-08-18T22:07:11.526366+0000","last_clean":"2024-08-18T22:07:11.526366+0000","last_became_active":"2024-08-18T22:05:21.857854+0000","last_became_peered":"2024-08-18T22:05:21.857854+0000","last_unstale":"2024-08-18T22:07:11.526366+0000","last_undegraded":"2024-08-18T22:07:11.526366+0000","last_fullsized":"2024-08-18T22:07:11.526366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:45:19.934647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572567+0000","last_change":"2024-08-18T22:05:19.843031+0000","last_active":"2024-08-18T22:07:11.572567+0000","last_peered":"2024-08-18T22:07:11.572567+0000","last_clean":"2024-08-18T22:07:11.572567+0000","last_became_active":"2024-08-18T22:05:19.842694+0000","last_became_peered":"2024-08-18T22:05:19.842694+0000","last_unstale":"2024-08-18T22:07:11.572567+0000","last_undegraded":"2024-08-18T22:07:11.572567+0000","last_fullsized":"2024-08-18T22:07:11.572567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:01.135449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523703+0000","last_change":"2024-08-18T22:05:28.920647+0000","last_active":"2024-08-18T22:07:11.523703+0000","last_peered":"2024-08-18T22:07:11.523703+0000","last_clean":"2024-08-18T22:07:11.523703+0000","last_became_active":"2024-08-18T22:05:28.920295+0000","last_became_peered":"2024-08-18T22:05:28.920295+0000","last_unstale":"2024-08-18T22:07:11.523703+0000","last_undegraded":"2024-08-18T22:07:11.523703+0000","last_fullsized":"2024-08-18T22:07:11.523703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:41.295009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524432+0000","last_change":"2024-08-18T22:05:21.858413+0000","last_active":"2024-08-18T22:07:11.524432+0000","last_peered":"2024-08-18T22:07:11.524432+0000","last_clean":"2024-08-18T22:07:11.524432+0000","last_became_active":"2024-08-18T22:05:21.858102+0000","last_became_peered":"2024-08-18T22:05:21.858102+0000","last_unstale":"2024-08-18T22:07:11.524432+0000","last_undegraded":"2024-08-18T22:07:11.524432+0000","last_fullsized":"2024-08-18T22:07:11.524432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:24:59.432666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528669+0000","last_change":"2024-08-18T22:05:20.292085+0000","last_active":"2024-08-18T22:07:11.528669+0000","last_peered":"2024-08-18T22:07:11.528669+0000","last_clean":"2024-08-18T22:07:11.528669+0000","last_became_active":"2024-08-18T22:05:20.291606+0000","last_became_peered":"2024-08-18T22:05:20.291606+0000","last_unstale":"2024-08-18T22:07:11.528669+0000","last_undegraded":"2024-08-18T22:07:11.528669+0000","last_fullsized":"2024-08-18T22:07:11.528669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:22:46.801719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573405+0000","last_change":"2024-08-18T22:06:10.515755+0000","last_active":"2024-08-18T22:07:11.573405+0000","last_peered":"2024-08-18T22:07:11.573405+0000","last_clean":"2024-08-18T22:07:11.573405+0000","last_became_active":"2024-08-18T22:06:10.514624+0000","last_became_peered":"2024-08-18T22:06:10.514624+0000","last_unstale":"2024-08-18T22:07:11.573405+0000","last_undegraded":"2024-08-18T22:07:11.573405+0000","last_fullsized":"2024-08-18T22:07:11.573405+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:18:50.785139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623553+0000","last_change":"2024-08-18T22:05:21.855163+0000","last_active":"2024-08-18T22:07:11.623553+0000","last_peered":"2024-08-18T22:07:11.623553+0000","last_clean":"2024-08-18T22:07:11.623553+0000","last_became_active":"2024-08-18T22:05:21.854867+0000","last_became_peered":"2024-08-18T22:05:21.854867+0000","last_unstale":"2024-08-18T22:07:11.623553+0000","last_undegraded":"2024-08-18T22:07:11.623553+0000","last_fullsized":"2024-08-18T22:07:11.623553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:10.300307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573516+0000","last_change":"2024-08-18T22:05:20.082363+0000","last_active":"2024-08-18T22:07:11.573516+0000","last_peered":"2024-08-18T22:07:11.573516+0000","last_clean":"2024-08-18T22:07:11.573516+0000","last_became_active":"2024-08-18T22:05:20.081998+0000","last_became_peered":"2024-08-18T22:05:20.081998+0000","last_unstale":"2024-08-18T22:07:11.573516+0000","last_undegraded":"2024-08-18T22:07:11.573516+0000","last_fullsized":"2024-08-18T22:07:11.573516+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:44.960512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530726+0000","last_change":"2024-08-18T22:05:28.924072+0000","last_active":"2024-08-18T22:07:11.530726+0000","last_peered":"2024-08-18T22:07:11.530726+0000","last_clean":"2024-08-18T22:07:11.530726+0000","last_became_active":"2024-08-18T22:05:28.923673+0000","last_became_peered":"2024-08-18T22:05:28.923673+0000","last_unstale":"2024-08-18T22:07:11.530726+0000","last_undegraded":"2024-08-18T22:07:11.530726+0000","last_fullsized":"2024-08-18T22:07:11.530726+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:44.593009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572927+0000","last_change":"2024-08-18T22:05:21.851377+0000","last_active":"2024-08-18T22:07:11.572927+0000","last_peered":"2024-08-18T22:07:11.572927+0000","last_clean":"2024-08-18T22:07:11.572927+0000","last_became_active":"2024-08-18T22:05:21.851031+0000","last_became_peered":"2024-08-18T22:05:21.851031+0000","last_unstale":"2024-08-18T22:07:11.572927+0000","last_undegraded":"2024-08-18T22:07:11.572927+0000","last_fullsized":"2024-08-18T22:07:11.572927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.547244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'13","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:31.609491+0000","last_change":"2024-08-18T22:05:19.840697+0000","last_active":"2024-08-18T22:07:31.609491+0000","last_peered":"2024-08-18T22:07:31.609491+0000","last_clean":"2024-08-18T22:07:31.609491+0000","last_became_active":"2024-08-18T22:05:19.840382+0000","last_became_peered":"2024-08-18T22:05:19.840382+0000","last_unstale":"2024-08-18T22:07:31.609491+0000","last_undegraded":"2024-08-18T22:07:31.609491+0000","last_fullsized":"2024-08-18T22:07:31.609491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:24.514428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572248+0000","last_change":"2024-08-18T22:05:29.012305+0000","last_active":"2024-08-18T22:07:11.572248+0000","last_peered":"2024-08-18T22:07:11.572248+0000","last_clean":"2024-08-18T22:07:11.572248+0000","last_became_active":"2024-08-18T22:05:29.011846+0000","last_became_peered":"2024-08-18T22:05:29.011846+0000","last_unstale":"2024-08-18T22:07:11.572248+0000","last_undegraded":"2024-08-18T22:07:11.572248+0000","last_fullsized":"2024-08-18T22:07:11.572248+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:36.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570893+0000","last_change":"2024-08-18T22:05:21.856182+0000","last_active":"2024-08-18T22:07:11.570893+0000","last_peered":"2024-08-18T22:07:11.570893+0000","last_clean":"2024-08-18T22:07:11.570893+0000","last_became_active":"2024-08-18T22:05:21.855855+0000","last_became_peered":"2024-08-18T22:05:21.855855+0000","last_unstale":"2024-08-18T22:07:11.570893+0000","last_undegraded":"2024-08-18T22:07:11.570893+0000","last_fullsized":"2024-08-18T22:07:11.570893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:00.166809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524985+0000","last_change":"2024-08-18T22:05:20.291272+0000","last_active":"2024-08-18T22:07:11.524985+0000","last_peered":"2024-08-18T22:07:11.524985+0000","last_clean":"2024-08-18T22:07:11.524985+0000","last_became_active":"2024-08-18T22:05:20.290970+0000","last_became_peered":"2024-08-18T22:05:20.290970+0000","last_unstale":"2024-08-18T22:07:11.524985+0000","last_undegraded":"2024-08-18T22:07:11.524985+0000","last_fullsized":"2024-08-18T22:07:11.524985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:29.438996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526400+0000","last_change":"2024-08-18T22:05:28.923141+0000","last_active":"2024-08-18T22:07:11.526400+0000","last_peered":"2024-08-18T22:07:11.526400+0000","last_clean":"2024-08-18T22:07:11.526400+0000","last_became_active":"2024-08-18T22:05:28.922269+0000","last_became_peered":"2024-08-18T22:05:28.922269+0000","last_unstale":"2024-08-18T22:07:11.526400+0000","last_undegraded":"2024-08-18T22:07:11.526400+0000","last_fullsized":"2024-08-18T22:07:11.526400+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:58.092640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522176+0000","last_change":"2024-08-18T22:05:21.850124+0000","last_active":"2024-08-18T22:07:11.522176+0000","last_peered":"2024-08-18T22:07:11.522176+0000","last_clean":"2024-08-18T22:07:11.522176+0000","last_became_active":"2024-08-18T22:05:21.849805+0000","last_became_peered":"2024-08-18T22:05:21.849805+0000","last_unstale":"2024-08-18T22:07:11.522176+0000","last_undegraded":"2024-08-18T22:07:11.522176+0000","last_fullsized":"2024-08-18T22:07:11.522176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:53.492613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523594+0000","last_change":"2024-08-18T22:05:20.292836+0000","last_active":"2024-08-18T22:07:11.523594+0000","last_peered":"2024-08-18T22:07:11.523594+0000","last_clean":"2024-08-18T22:07:11.523594+0000","last_became_active":"2024-08-18T22:05:20.292456+0000","last_became_peered":"2024-08-18T22:05:20.292456+0000","last_unstale":"2024-08-18T22:07:11.523594+0000","last_undegraded":"2024-08-18T22:07:11.523594+0000","last_fullsized":"2024-08-18T22:07:11.523594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:19.525037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524433+0000","last_change":"2024-08-18T22:05:29.012439+0000","last_active":"2024-08-18T22:07:11.524433+0000","last_peered":"2024-08-18T22:07:11.524433+0000","last_clean":"2024-08-18T22:07:11.524433+0000","last_became_active":"2024-08-18T22:05:29.011860+0000","last_became_peered":"2024-08-18T22:05:29.011860+0000","last_unstale":"2024-08-18T22:07:11.524433+0000","last_undegraded":"2024-08-18T22:07:11.524433+0000","last_fullsized":"2024-08-18T22:07:11.524433+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:03.432217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522230+0000","last_change":"2024-08-18T22:05:21.855598+0000","last_active":"2024-08-18T22:07:11.522230+0000","last_peered":"2024-08-18T22:07:11.522230+0000","last_clean":"2024-08-18T22:07:11.522230+0000","last_became_active":"2024-08-18T22:05:21.855228+0000","last_became_peered":"2024-08-18T22:05:21.855228+0000","last_unstale":"2024-08-18T22:07:11.522230+0000","last_undegraded":"2024-08-18T22:07:11.522230+0000","last_fullsized":"2024-08-18T22:07:11.522230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:33.762700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527786+0000","last_change":"2024-08-18T22:05:19.844638+0000","last_active":"2024-08-18T22:07:11.527786+0000","last_peered":"2024-08-18T22:07:11.527786+0000","last_clean":"2024-08-18T22:07:11.527786+0000","last_became_active":"2024-08-18T22:05:19.844333+0000","last_became_peered":"2024-08-18T22:05:19.844333+0000","last_unstale":"2024-08-18T22:07:11.527786+0000","last_undegraded":"2024-08-18T22:07:11.527786+0000","last_fullsized":"2024-08-18T22:07:11.527786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:26.947512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570807+0000","last_change":"2024-08-18T22:05:28.919965+0000","last_active":"2024-08-18T22:07:11.570807+0000","last_peered":"2024-08-18T22:07:11.570807+0000","last_clean":"2024-08-18T22:07:11.570807+0000","last_became_active":"2024-08-18T22:05:28.919546+0000","last_became_peered":"2024-08-18T22:05:28.919546+0000","last_unstale":"2024-08-18T22:07:11.570807+0000","last_undegraded":"2024-08-18T22:07:11.570807+0000","last_fullsized":"2024-08-18T22:07:11.570807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:49.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528844+0000","last_change":"2024-08-18T22:05:21.857867+0000","last_active":"2024-08-18T22:07:11.528844+0000","last_peered":"2024-08-18T22:07:11.528844+0000","last_clean":"2024-08-18T22:07:11.528844+0000","last_became_active":"2024-08-18T22:05:21.857515+0000","last_became_peered":"2024-08-18T22:05:21.857515+0000","last_unstale":"2024-08-18T22:07:11.528844+0000","last_undegraded":"2024-08-18T22:07:11.528844+0000","last_fullsized":"2024-08-18T22:07:11.528844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:51.148321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":159,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:51.628564+0000","last_change":"2024-08-18T22:05:20.290924+0000","last_active":"2024-08-18T22:07:51.628564+0000","last_peered":"2024-08-18T22:07:51.628564+0000","last_clean":"2024-08-18T22:07:51.628564+0000","last_became_active":"2024-08-18T22:05:20.290587+0000","last_became_peered":"2024-08-18T22:05:20.290587+0000","last_unstale":"2024-08-18T22:07:51.628564+0000","last_undegraded":"2024-08-18T22:07:51.628564+0000","last_fullsized":"2024-08-18T22:07:51.628564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:35.029634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570655+0000","last_change":"2024-08-18T22:05:29.012876+0000","last_active":"2024-08-18T22:07:11.570655+0000","last_peered":"2024-08-18T22:07:11.570655+0000","last_clean":"2024-08-18T22:07:11.570655+0000","last_became_active":"2024-08-18T22:05:29.011930+0000","last_became_peered":"2024-08-18T22:05:29.011930+0000","last_unstale":"2024-08-18T22:07:11.570655+0000","last_undegraded":"2024-08-18T22:07:11.570655+0000","last_fullsized":"2024-08-18T22:07:11.570655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:22:35.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570198+0000","last_change":"2024-08-18T22:05:21.860798+0000","last_active":"2024-08-18T22:07:11.570198+0000","last_peered":"2024-08-18T22:07:11.570198+0000","last_clean":"2024-08-18T22:07:11.570198+0000","last_became_active":"2024-08-18T22:05:21.856968+0000","last_became_peered":"2024-08-18T22:05:21.856968+0000","last_unstale":"2024-08-18T22:07:11.570198+0000","last_undegraded":"2024-08-18T22:07:11.570198+0000","last_fullsized":"2024-08-18T22:07:11.570198+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:54.934400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527098+0000","last_change":"2024-08-18T22:05:19.844775+0000","last_active":"2024-08-18T22:07:11.527098+0000","last_peered":"2024-08-18T22:07:11.527098+0000","last_clean":"2024-08-18T22:07:11.527098+0000","last_became_active":"2024-08-18T22:05:19.844465+0000","last_became_peered":"2024-08-18T22:05:19.844465+0000","last_unstale":"2024-08-18T22:07:11.527098+0000","last_undegraded":"2024-08-18T22:07:11.527098+0000","last_fullsized":"2024-08-18T22:07:11.527098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.042335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528645+0000","last_change":"2024-08-18T22:05:29.013275+0000","last_active":"2024-08-18T22:07:11.528645+0000","last_peered":"2024-08-18T22:07:11.528645+0000","last_clean":"2024-08-18T22:07:11.528645+0000","last_became_active":"2024-08-18T22:05:29.012537+0000","last_became_peered":"2024-08-18T22:05:29.012537+0000","last_unstale":"2024-08-18T22:07:11.528645+0000","last_undegraded":"2024-08-18T22:07:11.528645+0000","last_fullsized":"2024-08-18T22:07:11.528645+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:15:39.775360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572574+0000","last_change":"2024-08-18T22:05:21.853358+0000","last_active":"2024-08-18T22:07:11.572574+0000","last_peered":"2024-08-18T22:07:11.572574+0000","last_clean":"2024-08-18T22:07:11.572574+0000","last_became_active":"2024-08-18T22:05:21.853071+0000","last_became_peered":"2024-08-18T22:05:21.853071+0000","last_unstale":"2024-08-18T22:07:11.572574+0000","last_undegraded":"2024-08-18T22:07:11.572574+0000","last_fullsized":"2024-08-18T22:07:11.572574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:23.755263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573411+0000","last_change":"2024-08-18T22:05:19.846922+0000","last_active":"2024-08-18T22:07:11.573411+0000","last_peered":"2024-08-18T22:07:11.573411+0000","last_clean":"2024-08-18T22:07:11.573411+0000","last_became_active":"2024-08-18T22:05:19.846619+0000","last_became_peered":"2024-08-18T22:05:19.846619+0000","last_unstale":"2024-08-18T22:07:11.573411+0000","last_undegraded":"2024-08-18T22:07:11.573411+0000","last_fullsized":"2024-08-18T22:07:11.573411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:36:16.232344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":357,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527160+0000","last_change":"2024-08-18T22:04:11.878703+0000","last_active":"2024-08-18T22:07:11.527160+0000","last_peered":"2024-08-18T22:07:11.527160+0000","last_clean":"2024-08-18T22:07:11.527160+0000","last_became_active":"2024-08-18T22:04:11.878157+0000","last_became_peered":"2024-08-18T22:04:11.878157+0000","last_unstale":"2024-08-18T22:07:11.527160+0000","last_undegraded":"2024-08-18T22:07:11.527160+0000","last_fullsized":"2024-08-18T22:07:11.527160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_clean_scrub_stamp":"2024-08-18T22:01:09.551264+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:24:07.391758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527387+0000","last_change":"2024-08-18T22:05:28.928882+0000","last_active":"2024-08-18T22:07:11.527387+0000","last_peered":"2024-08-18T22:07:11.527387+0000","last_clean":"2024-08-18T22:07:11.527387+0000","last_became_active":"2024-08-18T22:05:28.928482+0000","last_became_peered":"2024-08-18T22:05:28.928482+0000","last_unstale":"2024-08-18T22:07:11.527387+0000","last_undegraded":"2024-08-18T22:07:11.527387+0000","last_fullsized":"2024-08-18T22:07:11.527387+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:41.739482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527496+0000","last_change":"2024-08-18T22:05:21.863045+0000","last_active":"2024-08-18T22:07:11.527496+0000","last_peered":"2024-08-18T22:07:11.527496+0000","last_clean":"2024-08-18T22:07:11.527496+0000","last_became_active":"2024-08-18T22:05:21.862758+0000","last_became_peered":"2024-08-18T22:05:21.862758+0000","last_unstale":"2024-08-18T22:07:11.527496+0000","last_undegraded":"2024-08-18T22:07:11.527496+0000","last_fullsized":"2024-08-18T22:07:11.527496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:08:39.111147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531069+0000","last_change":"2024-08-18T22:05:20.291030+0000","last_active":"2024-08-18T22:07:11.531069+0000","last_peered":"2024-08-18T22:07:11.531069+0000","last_clean":"2024-08-18T22:07:11.531069+0000","last_became_active":"2024-08-18T22:05:20.290427+0000","last_became_peered":"2024-08-18T22:05:20.290427+0000","last_unstale":"2024-08-18T22:07:11.531069+0000","last_undegraded":"2024-08-18T22:07:11.531069+0000","last_fullsized":"2024-08-18T22:07:11.531069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:14:42.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528742+0000","last_change":"2024-08-18T22:05:28.923700+0000","last_active":"2024-08-18T22:07:11.528742+0000","last_peered":"2024-08-18T22:07:11.528742+0000","last_clean":"2024-08-18T22:07:11.528742+0000","last_became_active":"2024-08-18T22:05:28.923280+0000","last_became_peered":"2024-08-18T22:05:28.923280+0000","last_unstale":"2024-08-18T22:07:11.528742+0000","last_undegraded":"2024-08-18T22:07:11.528742+0000","last_fullsized":"2024-08-18T22:07:11.528742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:25:45.343542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527521+0000","last_change":"2024-08-18T22:05:21.856107+0000","last_active":"2024-08-18T22:07:11.527521+0000","last_peered":"2024-08-18T22:07:11.527521+0000","last_clean":"2024-08-18T22:07:11.527521+0000","last_became_active":"2024-08-18T22:05:21.853276+0000","last_became_peered":"2024-08-18T22:05:21.853276+0000","last_unstale":"2024-08-18T22:07:11.527521+0000","last_undegraded":"2024-08-18T22:07:11.527521+0000","last_fullsized":"2024-08-18T22:07:11.527521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:58.280375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528926+0000","last_change":"2024-08-18T22:05:19.843445+0000","last_active":"2024-08-18T22:07:11.528926+0000","last_peered":"2024-08-18T22:07:11.528926+0000","last_clean":"2024-08-18T22:07:11.528926+0000","last_became_active":"2024-08-18T22:05:19.843000+0000","last_became_peered":"2024-08-18T22:05:19.843000+0000","last_unstale":"2024-08-18T22:07:11.528926+0000","last_undegraded":"2024-08-18T22:07:11.528926+0000","last_fullsized":"2024-08-18T22:07:11.528926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:23.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623212+0000","last_change":"2024-08-18T22:06:10.515953+0000","last_active":"2024-08-18T22:07:11.623212+0000","last_peered":"2024-08-18T22:07:11.623212+0000","last_clean":"2024-08-18T22:07:11.623212+0000","last_became_active":"2024-08-18T22:06:10.515662+0000","last_became_peered":"2024-08-18T22:06:10.515662+0000","last_unstale":"2024-08-18T22:07:11.623212+0000","last_undegraded":"2024-08-18T22:07:11.623212+0000","last_fullsized":"2024-08-18T22:07:11.623212+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:43.150180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527523+0000","last_change":"2024-08-18T22:05:21.864029+0000","last_active":"2024-08-18T22:07:11.527523+0000","last_peered":"2024-08-18T22:07:11.527523+0000","last_clean":"2024-08-18T22:07:11.527523+0000","last_became_active":"2024-08-18T22:05:21.863509+0000","last_became_peered":"2024-08-18T22:05:21.863509+0000","last_unstale":"2024-08-18T22:07:11.527523+0000","last_undegraded":"2024-08-18T22:07:11.527523+0000","last_fullsized":"2024-08-18T22:07:11.527523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:42.879243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570764+0000","last_change":"2024-08-18T22:05:19.846514+0000","last_active":"2024-08-18T22:07:11.570764+0000","last_peered":"2024-08-18T22:07:11.570764+0000","last_clean":"2024-08-18T22:07:11.570764+0000","last_became_active":"2024-08-18T22:05:19.846190+0000","last_became_peered":"2024-08-18T22:05:19.846190+0000","last_unstale":"2024-08-18T22:07:11.570764+0000","last_undegraded":"2024-08-18T22:07:11.570764+0000","last_fullsized":"2024-08-18T22:07:11.570764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:49:00.317597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528349+0000","last_change":"2024-08-18T22:05:28.923183+0000","last_active":"2024-08-18T22:07:11.528349+0000","last_peered":"2024-08-18T22:07:11.528349+0000","last_clean":"2024-08-18T22:07:11.528349+0000","last_became_active":"2024-08-18T22:05:28.922809+0000","last_became_peered":"2024-08-18T22:05:28.922809+0000","last_unstale":"2024-08-18T22:07:11.528349+0000","last_undegraded":"2024-08-18T22:07:11.528349+0000","last_fullsized":"2024-08-18T22:07:11.528349+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:26.416920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526764+0000","last_change":"2024-08-18T22:05:21.849075+0000","last_active":"2024-08-18T22:07:11.526764+0000","last_peered":"2024-08-18T22:07:11.526764+0000","last_clean":"2024-08-18T22:07:11.526764+0000","last_became_active":"2024-08-18T22:05:21.848759+0000","last_became_peered":"2024-08-18T22:05:21.848759+0000","last_unstale":"2024-08-18T22:07:11.526764+0000","last_undegraded":"2024-08-18T22:07:11.526764+0000","last_fullsized":"2024-08-18T22:07:11.526764+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:26.531534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524964+0000","last_change":"2024-08-18T22:05:19.849210+0000","last_active":"2024-08-18T22:07:11.524964+0000","last_peered":"2024-08-18T22:07:11.524964+0000","last_clean":"2024-08-18T22:07:11.524964+0000","last_became_active":"2024-08-18T22:05:19.848829+0000","last_became_peered":"2024-08-18T22:05:19.848829+0000","last_unstale":"2024-08-18T22:07:11.524964+0000","last_undegraded":"2024-08-18T22:07:11.524964+0000","last_fullsized":"2024-08-18T22:07:11.524964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:19.321686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528709+0000","last_change":"2024-08-18T22:05:28.924577+0000","last_active":"2024-08-18T22:07:11.528709+0000","last_peered":"2024-08-18T22:07:11.528709+0000","last_clean":"2024-08-18T22:07:11.528709+0000","last_became_active":"2024-08-18T22:05:28.924183+0000","last_became_peered":"2024-08-18T22:05:28.924183+0000","last_unstale":"2024-08-18T22:07:11.528709+0000","last_undegraded":"2024-08-18T22:07:11.528709+0000","last_fullsized":"2024-08-18T22:07:11.528709+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:22.702757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523154+0000","last_change":"2024-08-18T22:06:10.513610+0000","last_active":"2024-08-18T22:07:11.523154+0000","last_peered":"2024-08-18T22:07:11.523154+0000","last_clean":"2024-08-18T22:07:11.523154+0000","last_became_active":"2024-08-18T22:06:10.513400+0000","last_became_peered":"2024-08-18T22:06:10.513400+0000","last_unstale":"2024-08-18T22:07:11.523154+0000","last_undegraded":"2024-08-18T22:07:11.523154+0000","last_fullsized":"2024-08-18T22:07:11.523154+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:49.275223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524463+0000","last_change":"2024-08-18T22:05:20.291752+0000","last_active":"2024-08-18T22:07:11.524463+0000","last_peered":"2024-08-18T22:07:11.524463+0000","last_clean":"2024-08-18T22:07:11.524463+0000","last_became_active":"2024-08-18T22:05:20.291431+0000","last_became_peered":"2024-08-18T22:05:20.291431+0000","last_unstale":"2024-08-18T22:07:11.524463+0000","last_undegraded":"2024-08-18T22:07:11.524463+0000","last_fullsized":"2024-08-18T22:07:11.524463+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:32.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570669+0000","last_change":"2024-08-18T22:05:28.924121+0000","last_active":"2024-08-18T22:07:11.570669+0000","last_peered":"2024-08-18T22:07:11.570669+0000","last_clean":"2024-08-18T22:07:11.570669+0000","last_became_active":"2024-08-18T22:05:28.923753+0000","last_became_peered":"2024-08-18T22:05:28.923753+0000","last_unstale":"2024-08-18T22:07:11.570669+0000","last_undegraded":"2024-08-18T22:07:11.570669+0000","last_fullsized":"2024-08-18T22:07:11.570669+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:57.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527050+0000","last_change":"2024-08-18T22:05:21.858366+0000","last_active":"2024-08-18T22:07:11.527050+0000","last_peered":"2024-08-18T22:07:11.527050+0000","last_clean":"2024-08-18T22:07:11.527050+0000","last_became_active":"2024-08-18T22:05:21.858021+0000","last_became_peered":"2024-08-18T22:05:21.858021+0000","last_unstale":"2024-08-18T22:07:11.527050+0000","last_undegraded":"2024-08-18T22:07:11.527050+0000","last_fullsized":"2024-08-18T22:07:11.527050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:55.662965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":164,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:52.631000+0000","last_change":"2024-08-18T22:05:19.850013+0000","last_active":"2024-08-18T22:07:52.631000+0000","last_peered":"2024-08-18T22:07:52.631000+0000","last_clean":"2024-08-18T22:07:52.631000+0000","last_became_active":"2024-08-18T22:05:19.849551+0000","last_became_peered":"2024-08-18T22:05:19.849551+0000","last_unstale":"2024-08-18T22:07:52.631000+0000","last_undegraded":"2024-08-18T22:07:52.631000+0000","last_fullsized":"2024-08-18T22:07:52.631000+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:15.182999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523736+0000","last_change":"2024-08-18T22:05:28.927318+0000","last_active":"2024-08-18T22:07:11.523736+0000","last_peered":"2024-08-18T22:07:11.523736+0000","last_clean":"2024-08-18T22:07:11.523736+0000","last_became_active":"2024-08-18T22:05:28.926786+0000","last_became_peered":"2024-08-18T22:05:28.926786+0000","last_unstale":"2024-08-18T22:07:11.523736+0000","last_undegraded":"2024-08-18T22:07:11.523736+0000","last_fullsized":"2024-08-18T22:07:11.523736+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:45.798247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527690+0000","last_change":"2024-08-18T22:06:10.511821+0000","last_active":"2024-08-18T22:07:11.527690+0000","last_peered":"2024-08-18T22:07:11.527690+0000","last_clean":"2024-08-18T22:07:11.527690+0000","last_became_active":"2024-08-18T22:06:10.511135+0000","last_became_peered":"2024-08-18T22:06:10.511135+0000","last_unstale":"2024-08-18T22:07:11.527690+0000","last_undegraded":"2024-08-18T22:07:11.527690+0000","last_fullsized":"2024-08-18T22:07:11.527690+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:07.108531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528618+0000","last_change":"2024-08-18T22:05:19.844061+0000","last_active":"2024-08-18T22:07:11.528618+0000","last_peered":"2024-08-18T22:07:11.528618+0000","last_clean":"2024-08-18T22:07:11.528618+0000","last_became_active":"2024-08-18T22:05:19.843513+0000","last_became_peered":"2024-08-18T22:05:19.843513+0000","last_unstale":"2024-08-18T22:07:11.528618+0000","last_undegraded":"2024-08-18T22:07:11.528618+0000","last_fullsized":"2024-08-18T22:07:11.528618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:53.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527054+0000","last_change":"2024-08-18T22:05:28.922986+0000","last_active":"2024-08-18T22:07:11.527054+0000","last_peered":"2024-08-18T22:07:11.527054+0000","last_clean":"2024-08-18T22:07:11.527054+0000","last_became_active":"2024-08-18T22:05:28.922322+0000","last_became_peered":"2024-08-18T22:05:28.922322+0000","last_unstale":"2024-08-18T22:07:11.527054+0000","last_undegraded":"2024-08-18T22:07:11.527054+0000","last_fullsized":"2024-08-18T22:07:11.527054+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:28.168299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570439+0000","last_change":"2024-08-18T22:05:21.853389+0000","last_active":"2024-08-18T22:07:11.570439+0000","last_peered":"2024-08-18T22:07:11.570439+0000","last_clean":"2024-08-18T22:07:11.570439+0000","last_became_active":"2024-08-18T22:05:21.853095+0000","last_became_peered":"2024-08-18T22:05:21.853095+0000","last_unstale":"2024-08-18T22:07:11.570439+0000","last_undegraded":"2024-08-18T22:07:11.570439+0000","last_fullsized":"2024-08-18T22:07:11.570439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:14.126983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531024+0000","last_change":"2024-08-18T22:05:19.846788+0000","last_active":"2024-08-18T22:07:11.531024+0000","last_peered":"2024-08-18T22:07:11.531024+0000","last_clean":"2024-08-18T22:07:11.531024+0000","last_became_active":"2024-08-18T22:05:19.846248+0000","last_became_peered":"2024-08-18T22:05:19.846248+0000","last_unstale":"2024-08-18T22:07:11.531024+0000","last_undegraded":"2024-08-18T22:07:11.531024+0000","last_fullsized":"2024-08-18T22:07:11.531024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:46.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528648+0000","last_change":"2024-08-18T22:05:28.920294+0000","last_active":"2024-08-18T22:07:11.528648+0000","last_peered":"2024-08-18T22:07:11.528648+0000","last_clean":"2024-08-18T22:07:11.528648+0000","last_became_active":"2024-08-18T22:05:28.919351+0000","last_became_peered":"2024-08-18T22:05:28.919351+0000","last_unstale":"2024-08-18T22:07:11.528648+0000","last_undegraded":"2024-08-18T22:07:11.528648+0000","last_fullsized":"2024-08-18T22:07:11.528648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:49.425281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524875+0000","last_change":"2024-08-18T22:05:21.864529+0000","last_active":"2024-08-18T22:07:11.524875+0000","last_peered":"2024-08-18T22:07:11.524875+0000","last_clean":"2024-08-18T22:07:11.524875+0000","last_became_active":"2024-08-18T22:05:21.864062+0000","last_became_peered":"2024-08-18T22:05:21.864062+0000","last_unstale":"2024-08-18T22:07:11.524875+0000","last_undegraded":"2024-08-18T22:07:11.524875+0000","last_fullsized":"2024-08-18T22:07:11.524875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:24:49.037343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'37","reported_seq":337,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:53.682999+0000","last_change":"2024-08-18T22:06:10.522113+0000","last_active":"2024-08-18T22:07:53.682999+0000","last_peered":"2024-08-18T22:07:53.682999+0000","last_clean":"2024-08-18T22:07:53.682999+0000","last_became_active":"2024-08-18T22:06:10.514837+0000","last_became_peered":"2024-08-18T22:06:10.514837+0000","last_unstale":"2024-08-18T22:07:53.682999+0000","last_undegraded":"2024-08-18T22:07:53.682999+0000","last_fullsized":"2024-08-18T22:07:53.682999+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:46.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67447,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":238,"num_read_kb":180,"num_write":38,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523335+0000","last_change":"2024-08-18T22:05:28.926357+0000","last_active":"2024-08-18T22:07:11.523335+0000","last_peered":"2024-08-18T22:07:11.523335+0000","last_clean":"2024-08-18T22:07:11.523335+0000","last_became_active":"2024-08-18T22:05:28.926016+0000","last_became_peered":"2024-08-18T22:05:28.926016+0000","last_unstale":"2024-08-18T22:07:11.523335+0000","last_undegraded":"2024-08-18T22:07:11.523335+0000","last_fullsized":"2024-08-18T22:07:11.523335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:16.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529123+0000","last_change":"2024-08-18T22:05:21.860237+0000","last_active":"2024-08-18T22:07:11.529123+0000","last_peered":"2024-08-18T22:07:11.529123+0000","last_clean":"2024-08-18T22:07:11.529123+0000","last_became_active":"2024-08-18T22:05:21.859919+0000","last_became_peered":"2024-08-18T22:05:21.859919+0000","last_unstale":"2024-08-18T22:07:11.529123+0000","last_undegraded":"2024-08-18T22:07:11.529123+0000","last_fullsized":"2024-08-18T22:07:11.529123+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:21.048413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528892+0000","last_change":"2024-08-18T22:05:20.291233+0000","last_active":"2024-08-18T22:07:11.528892+0000","last_peered":"2024-08-18T22:07:11.528892+0000","last_clean":"2024-08-18T22:07:11.528892+0000","last_became_active":"2024-08-18T22:05:20.290893+0000","last_became_peered":"2024-08-18T22:05:20.290893+0000","last_unstale":"2024-08-18T22:07:11.528892+0000","last_undegraded":"2024-08-18T22:07:11.528892+0000","last_fullsized":"2024-08-18T22:07:11.528892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:36.889561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573103+0000","last_change":"2024-08-18T22:05:28.923076+0000","last_active":"2024-08-18T22:07:11.573103+0000","last_peered":"2024-08-18T22:07:11.573103+0000","last_clean":"2024-08-18T22:07:11.573103+0000","last_became_active":"2024-08-18T22:05:28.922688+0000","last_became_peered":"2024-08-18T22:05:28.922688+0000","last_unstale":"2024-08-18T22:07:11.573103+0000","last_undegraded":"2024-08-18T22:07:11.573103+0000","last_fullsized":"2024-08-18T22:07:11.573103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:34.360540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623665+0000","last_change":"2024-08-18T22:05:21.855174+0000","last_active":"2024-08-18T22:07:11.623665+0000","last_peered":"2024-08-18T22:07:11.623665+0000","last_clean":"2024-08-18T22:07:11.623665+0000","last_became_active":"2024-08-18T22:05:21.854818+0000","last_became_peered":"2024-08-18T22:05:21.854818+0000","last_unstale":"2024-08-18T22:07:11.623665+0000","last_undegraded":"2024-08-18T22:07:11.623665+0000","last_fullsized":"2024-08-18T22:07:11.623665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:48:55.094624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.577365+0000","last_change":"2024-08-18T22:07:11.576894+0000","last_active":"2024-08-18T22:07:11.577365+0000","last_peered":"2024-08-18T22:07:11.577365+0000","last_clean":"2024-08-18T22:07:11.577365+0000","last_became_active":"2024-08-18T22:07:11.574159+0000","last_became_peered":"2024-08-18T22:07:11.574159+0000","last_unstale":"2024-08-18T22:07:11.577365+0000","last_undegraded":"2024-08-18T22:07:11.577365+0000","last_fullsized":"2024-08-18T22:07:11.577365+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:37.993056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523194+0000","last_change":"2024-08-18T22:05:28.921647+0000","last_active":"2024-08-18T22:07:11.523194+0000","last_peered":"2024-08-18T22:07:11.523194+0000","last_clean":"2024-08-18T22:07:11.523194+0000","last_became_active":"2024-08-18T22:05:28.921305+0000","last_became_peered":"2024-08-18T22:05:28.921305+0000","last_unstale":"2024-08-18T22:07:11.523194+0000","last_undegraded":"2024-08-18T22:07:11.523194+0000","last_fullsized":"2024-08-18T22:07:11.523194+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:29.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529467+0000","last_change":"2024-08-18T22:05:21.861151+0000","last_active":"2024-08-18T22:07:11.529467+0000","last_peered":"2024-08-18T22:07:11.529467+0000","last_clean":"2024-08-18T22:07:11.529467+0000","last_became_active":"2024-08-18T22:05:21.860834+0000","last_became_peered":"2024-08-18T22:05:21.860834+0000","last_unstale":"2024-08-18T22:07:11.529467+0000","last_undegraded":"2024-08-18T22:07:11.529467+0000","last_fullsized":"2024-08-18T22:07:11.529467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:32.890750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":159,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:52.630937+0000","last_change":"2024-08-18T22:05:19.846145+0000","last_active":"2024-08-18T22:07:52.630937+0000","last_peered":"2024-08-18T22:07:52.630937+0000","last_clean":"2024-08-18T22:07:52.630937+0000","last_became_active":"2024-08-18T22:05:19.845711+0000","last_became_peered":"2024-08-18T22:05:19.845711+0000","last_unstale":"2024-08-18T22:07:52.630937+0000","last_undegraded":"2024-08-18T22:07:52.630937+0000","last_fullsized":"2024-08-18T22:07:52.630937+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:20.376131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572385+0000","last_change":"2024-08-18T22:05:28.923256+0000","last_active":"2024-08-18T22:07:11.572385+0000","last_peered":"2024-08-18T22:07:11.572385+0000","last_clean":"2024-08-18T22:07:11.572385+0000","last_became_active":"2024-08-18T22:05:28.922845+0000","last_became_peered":"2024-08-18T22:05:28.922845+0000","last_unstale":"2024-08-18T22:07:11.572385+0000","last_undegraded":"2024-08-18T22:07:11.572385+0000","last_fullsized":"2024-08-18T22:07:11.572385+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:41.930937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623447+0000","last_change":"2024-08-18T22:05:28.924743+0000","last_active":"2024-08-18T22:07:11.623447+0000","last_peered":"2024-08-18T22:07:11.623447+0000","last_clean":"2024-08-18T22:07:11.623447+0000","last_became_active":"2024-08-18T22:05:28.923674+0000","last_became_peered":"2024-08-18T22:05:28.923674+0000","last_unstale":"2024-08-18T22:07:11.623447+0000","last_undegraded":"2024-08-18T22:07:11.623447+0000","last_fullsized":"2024-08-18T22:07:11.623447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:19.834998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523308+0000","last_change":"2024-08-18T22:05:21.857194+0000","last_active":"2024-08-18T22:07:11.523308+0000","last_peered":"2024-08-18T22:07:11.523308+0000","last_clean":"2024-08-18T22:07:11.523308+0000","last_became_active":"2024-08-18T22:05:21.856916+0000","last_became_peered":"2024-08-18T22:05:21.856916+0000","last_unstale":"2024-08-18T22:07:11.523308+0000","last_undegraded":"2024-08-18T22:07:11.523308+0000","last_fullsized":"2024-08-18T22:07:11.523308+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:24.759501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529123+0000","last_change":"2024-08-18T22:05:19.844919+0000","last_active":"2024-08-18T22:07:11.529123+0000","last_peered":"2024-08-18T22:07:11.529123+0000","last_clean":"2024-08-18T22:07:11.529123+0000","last_became_active":"2024-08-18T22:05:19.844539+0000","last_became_peered":"2024-08-18T22:05:19.844539+0000","last_unstale":"2024-08-18T22:07:11.529123+0000","last_undegraded":"2024-08-18T22:07:11.529123+0000","last_fullsized":"2024-08-18T22:07:11.529123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:01.598535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526775+0000","last_change":"2024-08-18T22:05:28.923304+0000","last_active":"2024-08-18T22:07:11.526775+0000","last_peered":"2024-08-18T22:07:11.526775+0000","last_clean":"2024-08-18T22:07:11.526775+0000","last_became_active":"2024-08-18T22:05:28.922912+0000","last_became_peered":"2024-08-18T22:05:28.922912+0000","last_unstale":"2024-08-18T22:07:11.526775+0000","last_undegraded":"2024-08-18T22:07:11.526775+0000","last_fullsized":"2024-08-18T22:07:11.526775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:24:47.834354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572444+0000","last_change":"2024-08-18T22:05:21.849448+0000","last_active":"2024-08-18T22:07:11.572444+0000","last_peered":"2024-08-18T22:07:11.572444+0000","last_clean":"2024-08-18T22:07:11.572444+0000","last_became_active":"2024-08-18T22:05:21.849154+0000","last_became_peered":"2024-08-18T22:05:21.849154+0000","last_unstale":"2024-08-18T22:07:11.572444+0000","last_undegraded":"2024-08-18T22:07:11.572444+0000","last_fullsized":"2024-08-18T22:07:11.572444+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:38.583121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570212+0000","last_change":"2024-08-18T22:05:19.848483+0000","last_active":"2024-08-18T22:07:11.570212+0000","last_peered":"2024-08-18T22:07:11.570212+0000","last_clean":"2024-08-18T22:07:11.570212+0000","last_became_active":"2024-08-18T22:05:19.848190+0000","last_became_peered":"2024-08-18T22:05:19.848190+0000","last_unstale":"2024-08-18T22:07:11.570212+0000","last_undegraded":"2024-08-18T22:07:11.570212+0000","last_fullsized":"2024-08-18T22:07:11.570212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:01.719565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522263+0000","last_change":"2024-08-18T22:05:19.843796+0000","last_active":"2024-08-18T22:07:11.522263+0000","last_peered":"2024-08-18T22:07:11.522263+0000","last_clean":"2024-08-18T22:07:11.522263+0000","last_became_active":"2024-08-18T22:05:19.843495+0000","last_became_peered":"2024-08-18T22:05:19.843495+0000","last_unstale":"2024-08-18T22:07:11.522263+0000","last_undegraded":"2024-08-18T22:07:11.522263+0000","last_fullsized":"2024-08-18T22:07:11.522263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:21.583561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528757+0000","last_change":"2024-08-18T22:05:21.856370+0000","last_active":"2024-08-18T22:07:11.528757+0000","last_peered":"2024-08-18T22:07:11.528757+0000","last_clean":"2024-08-18T22:07:11.528757+0000","last_became_active":"2024-08-18T22:05:21.855954+0000","last_became_peered":"2024-08-18T22:05:21.855954+0000","last_unstale":"2024-08-18T22:07:11.528757+0000","last_undegraded":"2024-08-18T22:07:11.528757+0000","last_fullsized":"2024-08-18T22:07:11.528757+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:30.828305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530403+0000","last_change":"2024-08-18T22:06:10.516344+0000","last_active":"2024-08-18T22:07:11.530403+0000","last_peered":"2024-08-18T22:07:11.530403+0000","last_clean":"2024-08-18T22:07:11.530403+0000","last_became_active":"2024-08-18T22:06:10.515925+0000","last_became_peered":"2024-08-18T22:06:10.515925+0000","last_unstale":"2024-08-18T22:07:11.530403+0000","last_undegraded":"2024-08-18T22:07:11.530403+0000","last_fullsized":"2024-08-18T22:07:11.530403+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:41:07.585521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":167,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:53.632703+0000","last_change":"2024-08-18T22:05:19.846860+0000","last_active":"2024-08-18T22:07:53.632703+0000","last_peered":"2024-08-18T22:07:53.632703+0000","last_clean":"2024-08-18T22:07:53.632703+0000","last_became_active":"2024-08-18T22:05:19.846496+0000","last_became_peered":"2024-08-18T22:05:19.846496+0000","last_unstale":"2024-08-18T22:07:53.632703+0000","last_undegraded":"2024-08-18T22:07:53.632703+0000","last_fullsized":"2024-08-18T22:07:53.632703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:16.555137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524517+0000","last_change":"2024-08-18T22:05:21.849058+0000","last_active":"2024-08-18T22:07:11.524517+0000","last_peered":"2024-08-18T22:07:11.524517+0000","last_clean":"2024-08-18T22:07:11.524517+0000","last_became_active":"2024-08-18T22:05:21.848703+0000","last_became_peered":"2024-08-18T22:05:21.848703+0000","last_unstale":"2024-08-18T22:07:11.524517+0000","last_undegraded":"2024-08-18T22:07:11.524517+0000","last_fullsized":"2024-08-18T22:07:11.524517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:10.024156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530967+0000","last_change":"2024-08-18T22:05:28.922968+0000","last_active":"2024-08-18T22:07:11.530967+0000","last_peered":"2024-08-18T22:07:11.530967+0000","last_clean":"2024-08-18T22:07:11.530967+0000","last_became_active":"2024-08-18T22:05:28.922378+0000","last_became_peered":"2024-08-18T22:05:28.922378+0000","last_unstale":"2024-08-18T22:07:11.530967+0000","last_undegraded":"2024-08-18T22:07:11.530967+0000","last_fullsized":"2024-08-18T22:07:11.530967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:23:07.241028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526268+0000","last_change":"2024-08-18T22:05:21.858572+0000","last_active":"2024-08-18T22:07:11.526268+0000","last_peered":"2024-08-18T22:07:11.526268+0000","last_clean":"2024-08-18T22:07:11.526268+0000","last_became_active":"2024-08-18T22:05:21.858254+0000","last_became_peered":"2024-08-18T22:05:21.858254+0000","last_unstale":"2024-08-18T22:07:11.526268+0000","last_undegraded":"2024-08-18T22:07:11.526268+0000","last_fullsized":"2024-08-18T22:07:11.526268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:52.456087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531122+0000","last_change":"2024-08-18T22:05:21.856710+0000","last_active":"2024-08-18T22:07:11.531122+0000","last_peered":"2024-08-18T22:07:11.531122+0000","last_clean":"2024-08-18T22:07:11.531122+0000","last_became_active":"2024-08-18T22:05:21.855399+0000","last_became_peered":"2024-08-18T22:05:21.855399+0000","last_unstale":"2024-08-18T22:07:11.531122+0000","last_undegraded":"2024-08-18T22:07:11.531122+0000","last_fullsized":"2024-08-18T22:07:11.531122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:36.039953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530382+0000","last_change":"2024-08-18T22:05:21.856085+0000","last_active":"2024-08-18T22:07:11.530382+0000","last_peered":"2024-08-18T22:07:11.530382+0000","last_clean":"2024-08-18T22:07:11.530382+0000","last_became_active":"2024-08-18T22:05:21.855263+0000","last_became_peered":"2024-08-18T22:05:21.855263+0000","last_unstale":"2024-08-18T22:07:11.530382+0000","last_undegraded":"2024-08-18T22:07:11.530382+0000","last_fullsized":"2024-08-18T22:07:11.530382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:31.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623250+0000","last_change":"2024-08-18T22:05:21.855385+0000","last_active":"2024-08-18T22:07:11.623250+0000","last_peered":"2024-08-18T22:07:11.623250+0000","last_clean":"2024-08-18T22:07:11.623250+0000","last_became_active":"2024-08-18T22:05:21.854829+0000","last_became_peered":"2024-08-18T22:05:21.854829+0000","last_unstale":"2024-08-18T22:07:11.623250+0000","last_undegraded":"2024-08-18T22:07:11.623250+0000","last_fullsized":"2024-08-18T22:07:11.623250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:59.704154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570888+0000","last_change":"2024-08-18T22:06:10.510370+0000","last_active":"2024-08-18T22:07:11.570888+0000","last_peered":"2024-08-18T22:07:11.570888+0000","last_clean":"2024-08-18T22:07:11.570888+0000","last_became_active":"2024-08-18T22:06:10.509829+0000","last_became_peered":"2024-08-18T22:06:10.509829+0000","last_unstale":"2024-08-18T22:07:11.570888+0000","last_undegraded":"2024-08-18T22:07:11.570888+0000","last_fullsized":"2024-08-18T22:07:11.570888+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:20.171834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526688+0000","last_change":"2024-08-18T22:05:21.856137+0000","last_active":"2024-08-18T22:07:11.526688+0000","last_peered":"2024-08-18T22:07:11.526688+0000","last_clean":"2024-08-18T22:07:11.526688+0000","last_became_active":"2024-08-18T22:05:21.855425+0000","last_became_peered":"2024-08-18T22:05:21.855425+0000","last_unstale":"2024-08-18T22:07:11.526688+0000","last_undegraded":"2024-08-18T22:07:11.526688+0000","last_fullsized":"2024-08-18T22:07:11.526688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:37.514710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531196+0000","last_change":"2024-08-18T22:05:21.856084+0000","last_active":"2024-08-18T22:07:11.531196+0000","last_peered":"2024-08-18T22:07:11.531196+0000","last_clean":"2024-08-18T22:07:11.531196+0000","last_became_active":"2024-08-18T22:05:21.855779+0000","last_became_peered":"2024-08-18T22:05:21.855779+0000","last_unstale":"2024-08-18T22:07:11.531196+0000","last_undegraded":"2024-08-18T22:07:11.531196+0000","last_fullsized":"2024-08-18T22:07:11.531196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:02:47.833634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572883+0000","last_change":"2024-08-18T22:05:21.856729+0000","last_active":"2024-08-18T22:07:11.572883+0000","last_peered":"2024-08-18T22:07:11.572883+0000","last_clean":"2024-08-18T22:07:11.572883+0000","last_became_active":"2024-08-18T22:05:21.856446+0000","last_became_peered":"2024-08-18T22:05:21.856446+0000","last_unstale":"2024-08-18T22:07:11.572883+0000","last_undegraded":"2024-08-18T22:07:11.572883+0000","last_fullsized":"2024-08-18T22:07:11.572883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.482225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528910+0000","last_change":"2024-08-18T22:05:21.851772+0000","last_active":"2024-08-18T22:07:11.528910+0000","last_peered":"2024-08-18T22:07:11.528910+0000","last_clean":"2024-08-18T22:07:11.528910+0000","last_became_active":"2024-08-18T22:05:21.851417+0000","last_became_peered":"2024-08-18T22:05:21.851417+0000","last_unstale":"2024-08-18T22:07:11.528910+0000","last_undegraded":"2024-08-18T22:07:11.528910+0000","last_fullsized":"2024-08-18T22:07:11.528910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:32.509318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572470+0000","last_change":"2024-08-18T22:05:21.857887+0000","last_active":"2024-08-18T22:07:11.572470+0000","last_peered":"2024-08-18T22:07:11.572470+0000","last_clean":"2024-08-18T22:07:11.572470+0000","last_became_active":"2024-08-18T22:05:21.857585+0000","last_became_peered":"2024-08-18T22:05:21.857585+0000","last_unstale":"2024-08-18T22:07:11.572470+0000","last_undegraded":"2024-08-18T22:07:11.572470+0000","last_fullsized":"2024-08-18T22:07:11.572470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:23.299033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528948+0000","last_change":"2024-08-18T22:05:21.854626+0000","last_active":"2024-08-18T22:07:11.528948+0000","last_peered":"2024-08-18T22:07:11.528948+0000","last_clean":"2024-08-18T22:07:11.528948+0000","last_became_active":"2024-08-18T22:05:21.854290+0000","last_became_peered":"2024-08-18T22:05:21.854290+0000","last_unstale":"2024-08-18T22:07:11.528948+0000","last_undegraded":"2024-08-18T22:07:11.528948+0000","last_fullsized":"2024-08-18T22:07:11.528948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:45:24.988669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570558+0000","last_change":"2024-08-18T22:05:21.865863+0000","last_active":"2024-08-18T22:07:11.570558+0000","last_peered":"2024-08-18T22:07:11.570558+0000","last_clean":"2024-08-18T22:07:11.570558+0000","last_became_active":"2024-08-18T22:05:21.864634+0000","last_became_peered":"2024-08-18T22:05:21.864634+0000","last_unstale":"2024-08-18T22:07:11.570558+0000","last_undegraded":"2024-08-18T22:07:11.570558+0000","last_fullsized":"2024-08-18T22:07:11.570558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:34.051147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527095+0000","last_change":"2024-08-18T22:05:21.860193+0000","last_active":"2024-08-18T22:07:11.527095+0000","last_peered":"2024-08-18T22:07:11.527095+0000","last_clean":"2024-08-18T22:07:11.527095+0000","last_became_active":"2024-08-18T22:05:21.859761+0000","last_became_peered":"2024-08-18T22:05:21.859761+0000","last_unstale":"2024-08-18T22:07:11.527095+0000","last_undegraded":"2024-08-18T22:07:11.527095+0000","last_fullsized":"2024-08-18T22:07:11.527095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:18.465913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531192+0000","last_change":"2024-08-18T22:05:21.860569+0000","last_active":"2024-08-18T22:07:11.531192+0000","last_peered":"2024-08-18T22:07:11.531192+0000","last_clean":"2024-08-18T22:07:11.531192+0000","last_became_active":"2024-08-18T22:05:21.860250+0000","last_became_peered":"2024-08-18T22:05:21.860250+0000","last_unstale":"2024-08-18T22:07:11.531192+0000","last_undegraded":"2024-08-18T22:07:11.531192+0000","last_fullsized":"2024-08-18T22:07:11.531192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:52.097840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523697+0000","last_change":"2024-08-18T22:05:21.858271+0000","last_active":"2024-08-18T22:07:11.523697+0000","last_peered":"2024-08-18T22:07:11.523697+0000","last_clean":"2024-08-18T22:07:11.523697+0000","last_became_active":"2024-08-18T22:05:21.857968+0000","last_became_peered":"2024-08-18T22:05:21.857968+0000","last_unstale":"2024-08-18T22:07:11.523697+0000","last_undegraded":"2024-08-18T22:07:11.523697+0000","last_fullsized":"2024-08-18T22:07:11.523697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:24.023136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526949+0000","last_change":"2024-08-18T22:05:21.853799+0000","last_active":"2024-08-18T22:07:11.526949+0000","last_peered":"2024-08-18T22:07:11.526949+0000","last_clean":"2024-08-18T22:07:11.526949+0000","last_became_active":"2024-08-18T22:05:21.853432+0000","last_became_peered":"2024-08-18T22:05:21.853432+0000","last_unstale":"2024-08-18T22:07:11.526949+0000","last_undegraded":"2024-08-18T22:07:11.526949+0000","last_fullsized":"2024-08-18T22:07:11.526949+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:07.429169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528548+0000","last_change":"2024-08-18T22:05:21.855117+0000","last_active":"2024-08-18T22:07:11.528548+0000","last_peered":"2024-08-18T22:07:11.528548+0000","last_clean":"2024-08-18T22:07:11.528548+0000","last_became_active":"2024-08-18T22:05:21.854041+0000","last_became_peered":"2024-08-18T22:05:21.854041+0000","last_unstale":"2024-08-18T22:07:11.528548+0000","last_undegraded":"2024-08-18T22:07:11.528548+0000","last_fullsized":"2024-08-18T22:07:11.528548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:17.222658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623177+0000","last_change":"2024-08-18T22:05:21.861745+0000","last_active":"2024-08-18T22:07:11.623177+0000","last_peered":"2024-08-18T22:07:11.623177+0000","last_clean":"2024-08-18T22:07:11.623177+0000","last_became_active":"2024-08-18T22:05:21.861427+0000","last_became_peered":"2024-08-18T22:05:21.861427+0000","last_unstale":"2024-08-18T22:07:11.623177+0000","last_undegraded":"2024-08-18T22:07:11.623177+0000","last_fullsized":"2024-08-18T22:07:11.623177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:17.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623245+0000","last_change":"2024-08-18T22:05:21.860046+0000","last_active":"2024-08-18T22:07:11.623245+0000","last_peered":"2024-08-18T22:07:11.623245+0000","last_clean":"2024-08-18T22:07:11.623245+0000","last_became_active":"2024-08-18T22:05:21.859674+0000","last_became_peered":"2024-08-18T22:05:21.859674+0000","last_unstale":"2024-08-18T22:07:11.623245+0000","last_undegraded":"2024-08-18T22:07:11.623245+0000","last_fullsized":"2024-08-18T22:07:11.623245+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:44.615270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570548+0000","last_change":"2024-08-18T22:05:21.847647+0000","last_active":"2024-08-18T22:07:11.570548+0000","last_peered":"2024-08-18T22:07:11.570548+0000","last_clean":"2024-08-18T22:07:11.570548+0000","last_became_active":"2024-08-18T22:05:21.847367+0000","last_became_peered":"2024-08-18T22:05:21.847367+0000","last_unstale":"2024-08-18T22:07:11.570548+0000","last_undegraded":"2024-08-18T22:07:11.570548+0000","last_fullsized":"2024-08-18T22:07:11.570548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:33.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573513+0000","last_change":"2024-08-18T22:05:21.861326+0000","last_active":"2024-08-18T22:07:11.573513+0000","last_peered":"2024-08-18T22:07:11.573513+0000","last_clean":"2024-08-18T22:07:11.573513+0000","last_became_active":"2024-08-18T22:05:21.860968+0000","last_became_peered":"2024-08-18T22:05:21.860968+0000","last_unstale":"2024-08-18T22:07:11.573513+0000","last_undegraded":"2024-08-18T22:07:11.573513+0000","last_fullsized":"2024-08-18T22:07:11.573513+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:49.150670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527532+0000","last_change":"2024-08-18T22:05:21.852618+0000","last_active":"2024-08-18T22:07:11.527532+0000","last_peered":"2024-08-18T22:07:11.527532+0000","last_clean":"2024-08-18T22:07:11.527532+0000","last_became_active":"2024-08-18T22:05:21.852318+0000","last_became_peered":"2024-08-18T22:05:21.852318+0000","last_unstale":"2024-08-18T22:07:11.527532+0000","last_undegraded":"2024-08-18T22:07:11.527532+0000","last_fullsized":"2024-08-18T22:07:11.527532+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:06:49.085150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522585+0000","last_change":"2024-08-18T22:05:21.860108+0000","last_active":"2024-08-18T22:07:11.522585+0000","last_peered":"2024-08-18T22:07:11.522585+0000","last_clean":"2024-08-18T22:07:11.522585+0000","last_became_active":"2024-08-18T22:05:21.859794+0000","last_became_peered":"2024-08-18T22:05:21.859794+0000","last_unstale":"2024-08-18T22:07:11.522585+0000","last_undegraded":"2024-08-18T22:07:11.522585+0000","last_fullsized":"2024-08-18T22:07:11.522585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:01.974202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529519+0000","last_change":"2024-08-18T22:05:21.856404+0000","last_active":"2024-08-18T22:07:11.529519+0000","last_peered":"2024-08-18T22:07:11.529519+0000","last_clean":"2024-08-18T22:07:11.529519+0000","last_became_active":"2024-08-18T22:05:21.855800+0000","last_became_peered":"2024-08-18T22:05:21.855800+0000","last_unstale":"2024-08-18T22:07:11.529519+0000","last_undegraded":"2024-08-18T22:07:11.529519+0000","last_fullsized":"2024-08-18T22:07:11.529519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:09.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572403+0000","last_change":"2024-08-18T22:05:21.859891+0000","last_active":"2024-08-18T22:07:11.572403+0000","last_peered":"2024-08-18T22:07:11.572403+0000","last_clean":"2024-08-18T22:07:11.572403+0000","last_became_active":"2024-08-18T22:05:21.859407+0000","last_became_peered":"2024-08-18T22:05:21.859407+0000","last_unstale":"2024-08-18T22:07:11.572403+0000","last_undegraded":"2024-08-18T22:07:11.572403+0000","last_fullsized":"2024-08-18T22:07:11.572403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:59.285627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527094+0000","last_change":"2024-08-18T22:05:21.856428+0000","last_active":"2024-08-18T22:07:11.527094+0000","last_peered":"2024-08-18T22:07:11.527094+0000","last_clean":"2024-08-18T22:07:11.527094+0000","last_became_active":"2024-08-18T22:05:21.853374+0000","last_became_peered":"2024-08-18T22:05:21.853374+0000","last_unstale":"2024-08-18T22:07:11.527094+0000","last_undegraded":"2024-08-18T22:07:11.527094+0000","last_fullsized":"2024-08-18T22:07:11.527094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:07.087171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522091+0000","last_change":"2024-08-18T22:05:21.852688+0000","last_active":"2024-08-18T22:07:11.522091+0000","last_peered":"2024-08-18T22:07:11.522091+0000","last_clean":"2024-08-18T22:07:11.522091+0000","last_became_active":"2024-08-18T22:05:21.851107+0000","last_became_peered":"2024-08-18T22:05:21.851107+0000","last_unstale":"2024-08-18T22:07:11.522091+0000","last_undegraded":"2024-08-18T22:07:11.522091+0000","last_fullsized":"2024-08-18T22:07:11.522091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:48.267166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524601+0000","last_change":"2024-08-18T22:05:21.850809+0000","last_active":"2024-08-18T22:07:11.524601+0000","last_peered":"2024-08-18T22:07:11.524601+0000","last_clean":"2024-08-18T22:07:11.524601+0000","last_became_active":"2024-08-18T22:05:21.850510+0000","last_became_peered":"2024-08-18T22:05:21.850510+0000","last_unstale":"2024-08-18T22:07:11.524601+0000","last_undegraded":"2024-08-18T22:07:11.524601+0000","last_fullsized":"2024-08-18T22:07:11.524601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:39.338051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573466+0000","last_change":"2024-08-18T22:05:21.856156+0000","last_active":"2024-08-18T22:07:11.573466+0000","last_peered":"2024-08-18T22:07:11.573466+0000","last_clean":"2024-08-18T22:07:11.573466+0000","last_became_active":"2024-08-18T22:05:21.855830+0000","last_became_peered":"2024-08-18T22:05:21.855830+0000","last_unstale":"2024-08-18T22:07:11.573466+0000","last_undegraded":"2024-08-18T22:07:11.573466+0000","last_fullsized":"2024-08-18T22:07:11.573466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:10.670405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623466+0000","last_change":"2024-08-18T22:05:21.865162+0000","last_active":"2024-08-18T22:07:11.623466+0000","last_peered":"2024-08-18T22:07:11.623466+0000","last_clean":"2024-08-18T22:07:11.623466+0000","last_became_active":"2024-08-18T22:05:21.864842+0000","last_became_peered":"2024-08-18T22:05:21.864842+0000","last_unstale":"2024-08-18T22:07:11.623466+0000","last_undegraded":"2024-08-18T22:07:11.623466+0000","last_fullsized":"2024-08-18T22:07:11.623466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:21.388638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623496+0000","last_change":"2024-08-18T22:05:21.859227+0000","last_active":"2024-08-18T22:07:11.623496+0000","last_peered":"2024-08-18T22:07:11.623496+0000","last_clean":"2024-08-18T22:07:11.623496+0000","last_became_active":"2024-08-18T22:05:21.858886+0000","last_became_peered":"2024-08-18T22:05:21.858886+0000","last_unstale":"2024-08-18T22:07:11.623496+0000","last_undegraded":"2024-08-18T22:07:11.623496+0000","last_fullsized":"2024-08-18T22:07:11.623496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:08.710772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526871+0000","last_change":"2024-08-18T22:05:21.854864+0000","last_active":"2024-08-18T22:07:11.526871+0000","last_peered":"2024-08-18T22:07:11.526871+0000","last_clean":"2024-08-18T22:07:11.526871+0000","last_became_active":"2024-08-18T22:05:21.854522+0000","last_became_peered":"2024-08-18T22:05:21.854522+0000","last_unstale":"2024-08-18T22:07:11.526871+0000","last_undegraded":"2024-08-18T22:07:11.526871+0000","last_fullsized":"2024-08-18T22:07:11.526871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:32.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72119,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":723,"num_read_kb":432,"num_write":180,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":216357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514539,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1052672,"data_stored":523218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743473,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37048,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708104,"statfs":{"total":95995035648,"available":95957098496,"internally_reserved":0,"allocated":1753088,"data_stored":1182560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906998,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":523454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168634,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1069056,"data_stored":523374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397566,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36968,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708184,"statfs":{"total":95995035648,"available":95957180416,"internally_reserved":0,"allocated":1662976,"data_stored":1119954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561091,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":518630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790023,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28656,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716496,"statfs":{"total":95995035648,"available":95965691904,"internally_reserved":0,"allocated":1671168,"data_stored":1115011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953548,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36448,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708704,"statfs":{"total":95995035648,"available":95957712896,"internally_reserved":0,"allocated":1138688,"data_stored":591258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182480,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1060864,"data_stored":518824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":520421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":585987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1073152,"data_stored":520018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:07:58.367 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-18T22:07:58.367 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-18T22:07:58.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.117+0000 7f3dadb8c640 1 -- 172.21.15.123:0/4121968550 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3da8102b20 msgr2=0x7f3da8102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:58.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.117+0000 7f3dadb8c640 1 --2- 172.21.15.123:0/4121968550 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3da8102b20 0x7f3da8102f00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009ca0 tx=0x7f3d9802a8c0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.117+0000 7f3dadb8c640 1 -- 172.21.15.123:0/4121968550 shutdown_connections 2024-08-18T22:07:58.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.117+0000 7f3dadb8c640 1 --2- 172.21.15.123:0/4121968550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3da810c020 0x7f3da810e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.117+0000 7f3dadb8c640 1 --2- 172.21.15.123:0/4121968550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3da81034d0 0x7f3da810b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.117+0000 7f3dadb8c640 1 --2- 172.21.15.123:0/4121968550 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3da8102b20 0x7f3da8102f00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.117+0000 7f3dadb8c640 1 -- 172.21.15.123:0/4121968550 >> 172.21.15.123:0/4121968550 conn(0x7f3da80fc500 msgr2=0x7f3da80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:58.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.117+0000 7f3dadb8c640 1 -- 172.21.15.123:0/4121968550 shutdown_connections 2024-08-18T22:07:58.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.118+0000 7f3dadb8c640 1 -- 172.21.15.123:0/4121968550 wait complete. 2024-08-18T22:07:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.118+0000 7f3dadb8c640 1 Processor -- start 2024-08-18T22:07:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.118+0000 7f3dadb8c640 1 -- start start 2024-08-18T22:07:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.118+0000 7f3dadb8c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3da8102b20 0x7f3da81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.118+0000 7f3dadb8c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3da81034d0 0x7f3da8198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.118+0000 7f3dadb8c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3da810c020 0x7f3da819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.118+0000 7f3dadb8c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3da8111ec0 con 0x7f3da810c020 2024-08-18T22:07:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.118+0000 7f3dadb8c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3da8111d40 con 0x7f3da81034d0 2024-08-18T22:07:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.118+0000 7f3dadb8c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3da8112040 con 0x7f3da8102b20 2024-08-18T22:07:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3da7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3da810c020 0x7f3da819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3da7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3da810c020 0x7f3da819ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46390/0 (socket says 172.21.15.123:46390) 2024-08-18T22:07:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3da7fff640 1 -- 172.21.15.123:0/2219913902 learned_addr learned my addr 172.21.15.123:0/2219913902 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3da77fe640 1 --2- 172.21.15.123:0/2219913902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3da8102b20 0x7f3da81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3da6ffd640 1 --2- 172.21.15.123:0/2219913902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3da81034d0 0x7f3da8198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3da7fff640 1 -- 172.21.15.123:0/2219913902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3da8102b20 msgr2=0x7f3da81983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3da7fff640 1 --2- 172.21.15.123:0/2219913902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3da8102b20 0x7f3da81983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3da7fff640 1 -- 172.21.15.123:0/2219913902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3da81034d0 msgr2=0x7f3da8198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3da7fff640 1 --2- 172.21.15.123:0/2219913902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3da81034d0 0x7f3da8198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3da7fff640 1 -- 172.21.15.123:0/2219913902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da819d390 con 0x7f3da810c020 2024-08-18T22:07:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3da7fff640 1 --2- 172.21.15.123:0/2219913902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3da810c020 0x7f3da819ccb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009fd0 tx=0x7f3da000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3da4ff9640 1 -- 172.21.15.123:0/2219913902 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da0011830 con 0x7f3da810c020 2024-08-18T22:07:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3da4ff9640 1 -- 172.21.15.123:0/2219913902 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3da0016070 con 0x7f3da810c020 2024-08-18T22:07:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3dadb8c640 1 -- 172.21.15.123:0/2219913902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da819d680 con 0x7f3da810c020 2024-08-18T22:07:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3da4ff9640 1 -- 172.21.15.123:0/2219913902 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da000f2e0 con 0x7f3da810c020 2024-08-18T22:07:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.119+0000 7f3dadb8c640 1 -- 172.21.15.123:0/2219913902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da81a4f60 con 0x7f3da810c020 2024-08-18T22:07:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.122+0000 7f3da4ff9640 1 -- 172.21.15.123:0/2219913902 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f3da00119d0 con 0x7f3da810c020 2024-08-18T22:07:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.122+0000 7f3da4ff9640 1 --2- 172.21.15.123:0/2219913902 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3d940a2b80 0x7f3d940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.123+0000 7f3da77fe640 1 --2- 172.21.15.123:0/2219913902 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3d940a2b80 0x7f3d940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.123+0000 7f3da4ff9640 1 -- 172.21.15.123:0/2219913902 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f3da00ce990 con 0x7f3da810c020 2024-08-18T22:07:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.123+0000 7f3daff8a740 1 Processor -- start 2024-08-18T22:07:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.123+0000 7f3daff8a740 1 -- start start 2024-08-18T22:07:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.123+0000 7f3da77fe640 1 --2- 172.21.15.123:0/2219913902 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3d940a2b80 0x7f3d940a5040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3d98006010 tx=0x7f3d98009900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.123+0000 7f3daff8a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1c6210 0x55f58e1c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.123+0000 7f3daff8a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1c6b30 0x55f58e1d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.123+0000 7f3daff8a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 0x55f58e1d37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.123+0000 7f3daff8a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f58e12b980 con 0x55f58e1c6210 2024-08-18T22:07:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.123+0000 7f3daff8a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f58e0c3a70 con 0x55f58e1c6b30 2024-08-18T22:07:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.123+0000 7f3daff8a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f58e127940 con 0x55f58e1d13f0 2024-08-18T22:07:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.123+0000 7f3da77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1c6210 0x55f58e1c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.123+0000 7f3da77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1c6210 0x55f58e1c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46394/0 (socket says 172.21.15.123:46394) 2024-08-18T22:07:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.123+0000 7f3da77fe640 1 -- 172.21.15.123:0/2897913027 learned_addr learned my addr 172.21.15.123:0/2897913027 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.124+0000 7f3da7fff640 1 --2- 172.21.15.123:0/2897913027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 0x55f58e1d37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.124+0000 7f3da6ffd640 1 --2- 172.21.15.123:0/2897913027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1c6b30 0x55f58e1d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.124+0000 7f3da77fe640 1 -- 172.21.15.123:0/2897913027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 msgr2=0x55f58e1d37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.124+0000 7f3da77fe640 1 --2- 172.21.15.123:0/2897913027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 0x55f58e1d37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.124+0000 7f3da77fe640 1 -- 172.21.15.123:0/2897913027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1c6b30 msgr2=0x55f58e1d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.124+0000 7f3da77fe640 1 --2- 172.21.15.123:0/2897913027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1c6b30 0x55f58e1d0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.124+0000 7f3da77fe640 1 -- 172.21.15.123:0/2897913027 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58e1266e0 con 0x55f58e1c6210 2024-08-18T22:07:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.124+0000 7f3da7fff640 1 --2- 172.21.15.123:0/2897913027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 0x55f58e1d37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.124+0000 7f3da77fe640 1 --2- 172.21.15.123:0/2897913027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1c6210 0x55f58e1c65f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009ca0 tx=0x7f3d9803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763fd5b4d8d126dc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.124+0000 7f3d9dffb640 1 -- 172.21.15.123:0/2897913027 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9802f810 con 0x55f58e1c6210 2024-08-18T22:07:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.124+0000 7f3d9dffb640 1 -- 172.21.15.123:0/2897913027 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d98036040 con 0x55f58e1c6210 2024-08-18T22:07:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.124+0000 7f3d9dffb640 1 -- 172.21.15.123:0/2897913027 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98030d90 con 0x55f58e1c6210 2024-08-18T22:07:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.125+0000 7f3daff8a740 1 -- 172.21.15.123:0/2897913027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1c6210 msgr2=0x55f58e1c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.125+0000 7f3daff8a740 1 --2- 172.21.15.123:0/2897913027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1c6210 0x55f58e1c65f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009ca0 tx=0x7f3d9803f000 comp rx=0 tx=0).stop 2024-08-18T22:07:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.125+0000 7f3daff8a740 1 -- 172.21.15.123:0/2897913027 shutdown_connections 2024-08-18T22:07:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.125+0000 7f3daff8a740 1 --2- 172.21.15.123:0/2897913027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 0x55f58e1d37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.125+0000 7f3daff8a740 1 --2- 172.21.15.123:0/2897913027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1c6b30 0x55f58e1d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.125+0000 7f3daff8a740 1 --2- 172.21.15.123:0/2897913027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1c6210 0x55f58e1c65f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.125+0000 7f3daff8a740 1 -- 172.21.15.123:0/2897913027 >> 172.21.15.123:0/2897913027 conn(0x55f58e1c27a0 msgr2=0x55f58e1c2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.125+0000 7f3daff8a740 1 -- 172.21.15.123:0/2897913027 shutdown_connections 2024-08-18T22:07:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.125+0000 7f3daff8a740 1 -- 172.21.15.123:0/2897913027 wait complete. 2024-08-18T22:07:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.125+0000 7f3daff8a740 1 -- start start 2024-08-18T22:07:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3daff8a740 1 Processor -- start 2024-08-18T22:07:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3daff8a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1c6b30 0x55f58e1ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3daff8a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1d13f0 0x55f58e1ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3daff8a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1cee90 0x55f58e1dd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3daff8a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f58e1d3e40 con 0x55f58e1cee90 2024-08-18T22:07:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3daff8a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f58e0e6aa0 con 0x55f58e1d13f0 2024-08-18T22:07:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3daff8a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f58e1d3fc0 con 0x55f58e1c6b30 2024-08-18T22:07:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3daff8a740 10 client.0 _ll_register_callbacks cb 0x55f58e0d5e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3da7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1cee90 0x55f58e1dd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3da7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1cee90 0x55f58e1dd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46400/0 (socket says 172.21.15.123:46400) 2024-08-18T22:07:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3da7fff640 1 -- 172.21.15.123:0/317527971 learned_addr learned my addr 172.21.15.123:0/317527971 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3da77fe640 1 --2- 172.21.15.123:0/317527971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1c6b30 0x55f58e1ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3da6ffd640 1 --2- 172.21.15.123:0/317527971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1d13f0 0x55f58e1ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3da7fff640 1 -- 172.21.15.123:0/317527971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1c6b30 msgr2=0x55f58e1ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3da7fff640 1 --2- 172.21.15.123:0/317527971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1c6b30 0x55f58e1ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3da7fff640 1 -- 172.21.15.123:0/317527971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1d13f0 msgr2=0x55f58e1ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.126+0000 7f3da7fff640 1 --2- 172.21.15.123:0/317527971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1d13f0 0x55f58e1ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3da7fff640 1 -- 172.21.15.123:0/317527971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f58e0ca650 con 0x55f58e1cee90 2024-08-18T22:07:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3da7fff640 1 --2- 172.21.15.123:0/317527971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1cee90 0x55f58e1dd2b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3da000bde0 tx=0x7f3da00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db133034254f037 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3d86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3d86ffd640 1 -- 172.21.15.123:0/317527971 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da009f210 con 0x55f58e1cee90 2024-08-18T22:07:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3daff8a740 1 -- 172.21.15.123:0/317527971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d98036040 con 0x55f58e1cee90 2024-08-18T22:07:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3d86ffd640 1 -- 172.21.15.123:0/317527971 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f3da00974d0 con 0x55f58e1cee90 2024-08-18T22:07:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3d86ffd640 1 -- 172.21.15.123:0/317527971 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3da00a3ad0 con 0x55f58e1cee90 2024-08-18T22:07:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3daff8a740 10 client.15339 fetch_fsmap learned FSMap version 26 2024-08-18T22:07:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3daff8a740 1 -- 172.21.15.123:0/317527971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f58de9d3c0 con 0x55f58e1cee90 2024-08-18T22:07:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3d86ffd640 1 -- 172.21.15.123:0/317527971 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d98036040 con 0x55f58e1cee90 2024-08-18T22:07:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3d86ffd640 1 -- 172.21.15.123:0/317527971 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f3da0099ec0 con 0x55f58e1cee90 2024-08-18T22:07:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3daff8a740 10 client.15339 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:07:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3daff8a740 10 client.15339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:07:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3daff8a740 20 client.15339 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3daff8a740 1 --2- 172.21.15.123:0/317527971 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f58e1e12f0 0x55f58e1e3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3daff8a740 4 client.15339 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:07:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.127+0000 7f3daff8a740 1 -- 172.21.15.123:0/317527971 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f58e138ef0 con 0x55f58e1e12f0 2024-08-18T22:07:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.128+0000 7f3da77fe640 1 --2- 172.21.15.123:0/317527971 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f58e1e12f0 0x55f58e1e3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.128+0000 7f3d86ffd640 10 client.15339 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.128+0000 7f3da77fe640 1 --2- 172.21.15.123:0/317527971 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f58e1e12f0 0x55f58e1e3720 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4457a9129d16d9c server_cookie=ffa7b47e37dac071 in_seq=0 out_seq=0 2024-08-18T22:07:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.129+0000 7f3d86ffd640 1 -- 172.21.15.123:0/317527971 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f58e138ef0 con 0x55f58e1e12f0 2024-08-18T22:07:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.129+0000 7f3d86ffd640 10 client.15339 handle_command_reply: tid=0 2024-08-18T22:07:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.129+0000 7f3daff8a740 1 client.15339 shutdown 2024-08-18T22:07:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.129+0000 7f3daff8a740 1 -- 172.21.15.123:0/317527971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1cee90 msgr2=0x55f58e1dd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.129+0000 7f3daff8a740 1 --2- 172.21.15.123:0/317527971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1cee90 0x55f58e1dd2b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3da000bde0 tx=0x7f3da00046c0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.129+0000 7f3daff8a740 1 -- 172.21.15.123:0/317527971 shutdown_connections 2024-08-18T22:07:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.129+0000 7f3daff8a740 1 --2- 172.21.15.123:0/317527971 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f58e1e12f0 0x55f58e1e3720 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.129+0000 7f3daff8a740 1 --2- 172.21.15.123:0/317527971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1cee90 0x55f58e1dd2b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.129+0000 7f3d86ffd640 0 client.15339 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.129+0000 7f3daff8a740 1 --2- 172.21.15.123:0/317527971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1d13f0 0x55f58e1ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.129+0000 7f3daff8a740 1 --2- 172.21.15.123:0/317527971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1c6b30 0x55f58e1ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.129+0000 7f3daff8a740 1 -- 172.21.15.123:0/317527971 >> 172.21.15.123:0/317527971 conn(0x55f58e1c27a0 msgr2=0x55f58e1c84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.129+0000 7f3daff8a740 1 -- 172.21.15.123:0/317527971 shutdown_connections 2024-08-18T22:07:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.129+0000 7f3daff8a740 1 -- 172.21.15.123:0/317527971 wait complete. 2024-08-18T22:07:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.129+0000 7f3daff8a740 20 client.15339 trim_cache size 0 max 16384 2024-08-18T22:07:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.146+0000 7f3daff8a740 1 Processor -- start 2024-08-18T22:07:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.146+0000 7f3daff8a740 1 -- start start 2024-08-18T22:07:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.146+0000 7f3daff8a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1c6b30 0x55f58e1c2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.146+0000 7f3daff8a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1cee90 0x55f58e1c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.146+0000 7f3daff8a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 0x55f58e1d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.146+0000 7f3daff8a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3da81b12b0 con 0x55f58e1cee90 2024-08-18T22:07:58.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.146+0000 7f3daff8a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3da81aeb80 con 0x55f58e1c6b30 2024-08-18T22:07:58.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.146+0000 7f3daff8a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3da81ac9d0 con 0x55f58e1d13f0 2024-08-18T22:07:58.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.146+0000 7f3da6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1cee90 0x55f58e1c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.146+0000 7f3da6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1cee90 0x55f58e1c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46412/0 (socket says 172.21.15.123:46412) 2024-08-18T22:07:58.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.146+0000 7f3da6ffd640 1 -- 172.21.15.123:0/70742990 learned_addr learned my addr 172.21.15.123:0/70742990 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:58.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.147+0000 7f3da77fe640 1 --2- 172.21.15.123:0/70742990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1c6b30 0x55f58e1c2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.147+0000 7f3da6ffd640 1 -- 172.21.15.123:0/70742990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 msgr2=0x55f58e1d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:58.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.147+0000 7f3da7fff640 1 --2- 172.21.15.123:0/70742990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 0x55f58e1d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.147+0000 7f3da6ffd640 1 --2- 172.21.15.123:0/70742990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 0x55f58e1d0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.147+0000 7f3da6ffd640 1 -- 172.21.15.123:0/70742990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1c6b30 msgr2=0x55f58e1c2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:58.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.147+0000 7f3da6ffd640 1 --2- 172.21.15.123:0/70742990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1c6b30 0x55f58e1c2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.147+0000 7f3da6ffd640 1 -- 172.21.15.123:0/70742990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58e1cd3c0 con 0x55f58e1cee90 2024-08-18T22:07:58.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.147+0000 7f3da77fe640 1 --2- 172.21.15.123:0/70742990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1c6b30 0x55f58e1c2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:07:58.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.147+0000 7f3da6ffd640 1 --2- 172.21.15.123:0/70742990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1cee90 0x55f58e1c8c70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3da8069fe0 tx=0x7f3d9000af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a675fbc47fd1d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:58.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.147+0000 7f3d9d7fa640 1 -- 172.21.15.123:0/70742990 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90012cf0 con 0x55f58e1cee90 2024-08-18T22:07:58.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.147+0000 7f3d9d7fa640 1 -- 172.21.15.123:0/70742990 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d9000f940 con 0x55f58e1cee90 2024-08-18T22:07:58.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.147+0000 7f3d9d7fa640 1 -- 172.21.15.123:0/70742990 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90011920 con 0x55f58e1cee90 2024-08-18T22:07:58.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.148+0000 7f3daff8a740 1 -- 172.21.15.123:0/70742990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1cee90 msgr2=0x55f58e1c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:58.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.148+0000 7f3daff8a740 1 --2- 172.21.15.123:0/70742990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1cee90 0x55f58e1c8c70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3da8069fe0 tx=0x7f3d9000af70 comp rx=0 tx=0).stop 2024-08-18T22:07:58.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.148+0000 7f3daff8a740 1 -- 172.21.15.123:0/70742990 shutdown_connections 2024-08-18T22:07:58.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.148+0000 7f3daff8a740 1 --2- 172.21.15.123:0/70742990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 0x55f58e1d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.148+0000 7f3daff8a740 1 --2- 172.21.15.123:0/70742990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1cee90 0x55f58e1c8c70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.148+0000 7f3daff8a740 1 --2- 172.21.15.123:0/70742990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1c6b30 0x55f58e1c2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.148+0000 7f3daff8a740 1 -- 172.21.15.123:0/70742990 >> 172.21.15.123:0/70742990 conn(0x55f58e1c27a0 msgr2=0x55f58e1cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.148+0000 7f3daff8a740 1 -- 172.21.15.123:0/70742990 shutdown_connections 2024-08-18T22:07:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.148+0000 7f3daff8a740 1 -- 172.21.15.123:0/70742990 wait complete. 2024-08-18T22:07:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.148+0000 7f3daff8a740 1 -- start start 2024-08-18T22:07:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3daff8a740 1 Processor -- start 2024-08-18T22:07:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3daff8a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1c6b30 0x55f58e1d9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3daff8a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1cee90 0x55f58e1d4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3daff8a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 0x55f58e1d5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3daff8a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3da81ad040 con 0x55f58e1c6b30 2024-08-18T22:07:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3daff8a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3da81ae4b0 con 0x55f58e1cee90 2024-08-18T22:07:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3daff8a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3da81ad710 con 0x55f58e1d13f0 2024-08-18T22:07:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3daff8a740 10 client.0 _ll_register_callbacks cb 0x7f3da00092c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:07:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3da77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1c6b30 0x55f58e1d9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3da77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1c6b30 0x55f58e1d9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46428/0 (socket says 172.21.15.123:46428) 2024-08-18T22:07:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3da77fe640 1 -- 172.21.15.123:0/2568254713 learned_addr learned my addr 172.21.15.123:0/2568254713 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3da7fff640 1 --2- 172.21.15.123:0/2568254713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 0x55f58e1d5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3da6ffd640 1 --2- 172.21.15.123:0/2568254713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1cee90 0x55f58e1d4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3da77fe640 1 -- 172.21.15.123:0/2568254713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 msgr2=0x55f58e1d5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3da77fe640 1 --2- 172.21.15.123:0/2568254713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 0x55f58e1d5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3da77fe640 1 -- 172.21.15.123:0/2568254713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1cee90 msgr2=0x55f58e1d4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:07:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3da77fe640 1 --2- 172.21.15.123:0/2568254713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1cee90 0x55f58e1d4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3da77fe640 1 -- 172.21.15.123:0/2568254713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f58e1d5b70 con 0x55f58e1c6b30 2024-08-18T22:07:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3da77fe640 1 --2- 172.21.15.123:0/2568254713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1c6b30 0x55f58e1d9a20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3d98030960 tx=0x7f3d98030990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb3318ad429307e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.149+0000 7f3d86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:07:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.150+0000 7f3d86ffd640 1 -- 172.21.15.123:0/2568254713 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98030bb0 con 0x55f58e1c6b30 2024-08-18T22:07:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.150+0000 7f3d86ffd640 1 -- 172.21.15.123:0/2568254713 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f3d98030d50 con 0x55f58e1c6b30 2024-08-18T22:07:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.150+0000 7f3daff8a740 1 -- 172.21.15.123:0/2568254713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d9000f940 con 0x55f58e1c6b30 2024-08-18T22:07:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.150+0000 7f3d86ffd640 1 -- 172.21.15.123:0/2568254713 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3d9806c050 con 0x55f58e1c6b30 2024-08-18T22:07:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.150+0000 7f3daff8a740 10 client.15345 fetch_fsmap learned FSMap version 26 2024-08-18T22:07:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.150+0000 7f3daff8a740 1 -- 172.21.15.123:0/2568254713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f58e24c070 con 0x55f58e1c6b30 2024-08-18T22:07:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.150+0000 7f3d86ffd640 1 -- 172.21.15.123:0/2568254713 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d9000f940 con 0x55f58e1c6b30 2024-08-18T22:07:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.150+0000 7f3d86ffd640 1 -- 172.21.15.123:0/2568254713 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f3d98004600 con 0x55f58e1c6b30 2024-08-18T22:07:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.150+0000 7f3daff8a740 10 client.15345 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:07:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.150+0000 7f3daff8a740 10 client.15345 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:07:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.150+0000 7f3daff8a740 20 client.15345 populate_metadata read hostname 'smithi123' 2024-08-18T22:07:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.150+0000 7f3daff8a740 1 --2- 172.21.15.123:0/2568254713 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f58e1e12f0 0x55f58e24e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.150+0000 7f3daff8a740 4 client.15345 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:07:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.150+0000 7f3daff8a740 1 -- 172.21.15.123:0/2568254713 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f58e133400 con 0x55f58e1e12f0 2024-08-18T22:07:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.150+0000 7f3da6ffd640 1 --2- 172.21.15.123:0/2568254713 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f58e1e12f0 0x55f58e24e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3d86ffd640 10 client.15345 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3da6ffd640 1 --2- 172.21.15.123:0/2568254713 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f58e1e12f0 0x55f58e24e4d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb498a852527dced server_cookie=1aac6ba6f0edf049 in_seq=0 out_seq=0 2024-08-18T22:07:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3d86ffd640 1 -- 172.21.15.123:0/2568254713 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f58e133400 con 0x55f58e1e12f0 2024-08-18T22:07:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3d86ffd640 10 client.15345 handle_command_reply: tid=0 2024-08-18T22:07:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3daff8a740 1 client.15345 shutdown 2024-08-18T22:07:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3daff8a740 1 -- 172.21.15.123:0/2568254713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1c6b30 msgr2=0x55f58e1d9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3daff8a740 1 --2- 172.21.15.123:0/2568254713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1c6b30 0x55f58e1d9a20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3d98030960 tx=0x7f3d98030990 comp rx=0 tx=0).stop 2024-08-18T22:07:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3daff8a740 1 -- 172.21.15.123:0/2568254713 shutdown_connections 2024-08-18T22:07:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3daff8a740 1 --2- 172.21.15.123:0/2568254713 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f58e1e12f0 0x55f58e24e4d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3daff8a740 1 --2- 172.21.15.123:0/2568254713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f58e1d13f0 0x55f58e1d5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3daff8a740 1 --2- 172.21.15.123:0/2568254713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f58e1cee90 0x55f58e1d4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3daff8a740 1 --2- 172.21.15.123:0/2568254713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f58e1c6b30 0x55f58e1d9a20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3daff8a740 1 -- 172.21.15.123:0/2568254713 >> 172.21.15.123:0/2568254713 conn(0x55f58e1c27a0 msgr2=0x55f58e1c1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3d86ffd640 0 client.15345 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3daff8a740 1 -- 172.21.15.123:0/2568254713 shutdown_connections 2024-08-18T22:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3daff8a740 1 -- 172.21.15.123:0/2568254713 wait complete. 2024-08-18T22:07:58.481 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:07:58.481 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-18T22:07:58.482 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": { 2024-08-18T22:07:58.482 INFO:teuthology.orchestra.run.smithi123.stdout: "e027a0de-d136-4450-93c7-adcb94027c52": { 2024-08-18T22:07:58.482 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/", 2024-08-18T22:07:58.482 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "e027a0de-d136-4450-93c7-adcb94027c52", 2024-08-18T22:07:58.482 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "recursive,force" 2024-08-18T22:07:58.482 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:07:58.483 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:07:58.483 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:07:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.151+0000 7f3daff8a740 20 client.15345 trim_cache size 0 max 16384 2024-08-18T22:07:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.152+0000 7f3dadb8c640 1 -- 172.21.15.123:0/2219913902 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3d940a2b80 msgr2=0x7f3d940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:58.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.152+0000 7f3dadb8c640 1 --2- 172.21.15.123:0/2219913902 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3d940a2b80 0x7f3d940a5040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3d98006010 tx=0x7f3d98009900 comp rx=0 tx=0).stop 2024-08-18T22:07:58.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.152+0000 7f3dadb8c640 1 -- 172.21.15.123:0/2219913902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3da810c020 msgr2=0x7f3da819ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:58.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.152+0000 7f3dadb8c640 1 --2- 172.21.15.123:0/2219913902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3da810c020 0x7f3da819ccb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009fd0 tx=0x7f3da000b8e0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.152+0000 7f3dadb8c640 1 -- 172.21.15.123:0/2219913902 shutdown_connections 2024-08-18T22:07:58.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.152+0000 7f3dadb8c640 1 --2- 172.21.15.123:0/2219913902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3da810c020 0x7f3da819ccb0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.152+0000 7f3dadb8c640 1 --2- 172.21.15.123:0/2219913902 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f3d940a2b80 0x7f3d940a5040 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.152+0000 7f3dadb8c640 1 --2- 172.21.15.123:0/2219913902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3da81034d0 0x7f3da8198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.152+0000 7f3dadb8c640 1 --2- 172.21.15.123:0/2219913902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3da8102b20 0x7f3da81983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:58.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.152+0000 7f3dadb8c640 1 -- 172.21.15.123:0/2219913902 >> 172.21.15.123:0/2219913902 conn(0x7f3da80fc500 msgr2=0x7f3da80fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:58.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.152+0000 7f3dadb8c640 1 -- 172.21.15.123:0/2219913902 shutdown_connections 2024-08-18T22:07:58.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:58.152+0000 7f3dadb8c640 1 -- 172.21.15.123:0/2219913902 wait complete. 2024-08-18T22:07:58.641 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:58 smithi123 ceph-mon[18462]: pgmap v346: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2024-08-18T22:07:58.641 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:07:58 smithi123 ceph-mon[18462]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:58 smithi130 ceph-mon[21698]: pgmap v346: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2024-08-18T22:07:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:07:58 smithi130 ceph-mon[21698]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:58.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:58 smithi183 ceph-mon[22097]: pgmap v346: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2024-08-18T22:07:58.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:07:58 smithi183 ceph-mon[22097]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:07:59.129 INFO:tasks.cephfs.filesystem:scrub status for tag:e027a0de-d136-4450-93c7-adcb94027c52 - {'path': '/', 'tag': 'e027a0de-d136-4450-93c7-adcb94027c52', 'options': 'recursive,force'} 2024-08-18T22:07:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:07:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.648+0000 7ff0a07bd640 1 -- 172.21.15.123:0/3825018831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff098102250 msgr2=0x7ff09810e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.648+0000 7ff0a07bd640 1 --2- 172.21.15.123:0/3825018831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff098102250 0x7ff09810e780 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff090009cd0 tx=0x7ff09002a8e0 comp rx=0 tx=0).stop 2024-08-18T22:07:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.648+0000 7ff0a07bd640 1 -- 172.21.15.123:0/3825018831 shutdown_connections 2024-08-18T22:07:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.648+0000 7ff0a07bd640 1 --2- 172.21.15.123:0/3825018831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff098102250 0x7ff09810e780 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.648+0000 7ff0a07bd640 1 --2- 172.21.15.123:0/3825018831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0981018b0 0x7ff098101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.648+0000 7ff0a07bd640 1 --2- 172.21.15.123:0/3825018831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0981078b0 0x7ff098107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.648+0000 7ff0a07bd640 1 -- 172.21.15.123:0/3825018831 >> 172.21.15.123:0/3825018831 conn(0x7ff0980fd5f0 msgr2=0x7ff0980ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.648+0000 7ff0a07bd640 1 -- 172.21.15.123:0/3825018831 shutdown_connections 2024-08-18T22:07:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.648+0000 7ff0a07bd640 1 -- 172.21.15.123:0/3825018831 wait complete. 2024-08-18T22:07:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.649+0000 7ff0a07bd640 1 Processor -- start 2024-08-18T22:07:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.649+0000 7ff0a07bd640 1 -- start start 2024-08-18T22:07:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.649+0000 7ff0a07bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0981018b0 0x7ff098074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.649+0000 7ff0a07bd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff098102250 0x7ff098074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.649+0000 7ff0a07bd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0981078b0 0x7ff098074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.649+0000 7ff0a07bd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff098111cb0 con 0x7ff0981078b0 2024-08-18T22:07:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.649+0000 7ff0a07bd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff098111b30 con 0x7ff098102250 2024-08-18T22:07:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.649+0000 7ff0a07bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff098111e30 con 0x7ff0981018b0 2024-08-18T22:07:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.649+0000 7ff09ed5a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0981078b0 0x7ff098074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.649+0000 7ff09ed5a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0981078b0 0x7ff098074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46446/0 (socket says 172.21.15.123:46446) 2024-08-18T22:07:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.649+0000 7ff09ed5a640 1 -- 172.21.15.123:0/2003620258 learned_addr learned my addr 172.21.15.123:0/2003620258 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:07:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.650+0000 7ff09dd58640 1 --2- 172.21.15.123:0/2003620258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff098102250 0x7ff098074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.650+0000 7ff09e559640 1 --2- 172.21.15.123:0/2003620258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0981018b0 0x7ff098074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.650+0000 7ff09ed5a640 1 -- 172.21.15.123:0/2003620258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0981018b0 msgr2=0x7ff098074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.650+0000 7ff09ed5a640 1 --2- 172.21.15.123:0/2003620258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0981018b0 0x7ff098074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.650+0000 7ff09ed5a640 1 -- 172.21.15.123:0/2003620258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff098102250 msgr2=0x7ff098074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.650+0000 7ff09ed5a640 1 --2- 172.21.15.123:0/2003620258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff098102250 0x7ff098074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.650+0000 7ff09ed5a640 1 -- 172.21.15.123:0/2003620258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0981a6630 con 0x7ff0981078b0 2024-08-18T22:07:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.650+0000 7ff09dd58640 1 --2- 172.21.15.123:0/2003620258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff098102250 0x7ff098074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:07:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.650+0000 7ff09ed5a640 1 --2- 172.21.15.123:0/2003620258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0981078b0 0x7ff098074ca0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff090005cc0 tx=0x7ff090032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.650+0000 7ff08f7fe640 1 -- 172.21.15.123:0/2003620258 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090004040 con 0x7ff0981078b0 2024-08-18T22:07:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.650+0000 7ff08f7fe640 1 -- 172.21.15.123:0/2003620258 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0900046c0 con 0x7ff0981078b0 2024-08-18T22:07:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.650+0000 7ff0a07bd640 1 -- 172.21.15.123:0/2003620258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0981a68c0 con 0x7ff0981078b0 2024-08-18T22:07:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.650+0000 7ff08f7fe640 1 -- 172.21.15.123:0/2003620258 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090030e00 con 0x7ff0981078b0 2024-08-18T22:07:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.650+0000 7ff0a07bd640 1 -- 172.21.15.123:0/2003620258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0981a6e00 con 0x7ff0981078b0 2024-08-18T22:07:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.651+0000 7ff0a07bd640 1 -- 172.21.15.123:0/2003620258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff098101d10 con 0x7ff0981078b0 2024-08-18T22:07:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.652+0000 7ff08f7fe640 1 -- 172.21.15.123:0/2003620258 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7ff0900305a0 con 0x7ff0981078b0 2024-08-18T22:07:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.653+0000 7ff08f7fe640 1 --2- 172.21.15.123:0/2003620258 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff0840a2b80 0x7ff0840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:07:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.653+0000 7ff09e559640 1 --2- 172.21.15.123:0/2003620258 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff0840a2b80 0x7ff0840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:07:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.653+0000 7ff08f7fe640 1 -- 172.21.15.123:0/2003620258 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ff09002e030 con 0x7ff0981078b0 2024-08-18T22:07:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.653+0000 7ff09e559640 1 --2- 172.21.15.123:0/2003620258 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff0840a2b80 0x7ff0840a5040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff094009b50 tx=0x7ff094005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:07:59.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.656+0000 7ff08f7fe640 1 -- 172.21.15.123:0/2003620258 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff09004b060 con 0x7ff0981078b0 2024-08-18T22:07:59.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.825+0000 7ff0a07bd640 1 -- 172.21.15.123:0/2003620258 --> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff098062360 con 0x7ff0840a2b80 2024-08-18T22:07:59.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.833+0000 7ff08f7fe640 1 -- 172.21.15.123:0/2003620258 <== mgr.14150 v2:172.21.15.123:6800/22123895 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340503 (secure 0 0 0) 0x7ff098062360 con 0x7ff0840a2b80 2024-08-18T22:07:59.837 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:07:59.839 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-08-18T22:07:59.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.836+0000 7ff0a07bd640 1 -- 172.21.15.123:0/2003620258 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff0840a2b80 msgr2=0x7ff0840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:59.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.836+0000 7ff0a07bd640 1 --2- 172.21.15.123:0/2003620258 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff0840a2b80 0x7ff0840a5040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff094009b50 tx=0x7ff094005f90 comp rx=0 tx=0).stop 2024-08-18T22:07:59.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.836+0000 7ff0a07bd640 1 -- 172.21.15.123:0/2003620258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0981078b0 msgr2=0x7ff098074ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:07:59.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.836+0000 7ff0a07bd640 1 --2- 172.21.15.123:0/2003620258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0981078b0 0x7ff098074ca0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff090005cc0 tx=0x7ff090032f40 comp rx=0 tx=0).stop 2024-08-18T22:07:59.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.836+0000 7ff0a07bd640 1 -- 172.21.15.123:0/2003620258 shutdown_connections 2024-08-18T22:07:59.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.836+0000 7ff0a07bd640 1 --2- 172.21.15.123:0/2003620258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0981078b0 0x7ff098074ca0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.836+0000 7ff0a07bd640 1 --2- 172.21.15.123:0/2003620258 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff0840a2b80 0x7ff0840a5040 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.836+0000 7ff0a07bd640 1 --2- 172.21.15.123:0/2003620258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff098102250 0x7ff098074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.836+0000 7ff0a07bd640 1 --2- 172.21.15.123:0/2003620258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0981018b0 0x7ff098074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:07:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.836+0000 7ff0a07bd640 1 -- 172.21.15.123:0/2003620258 >> 172.21.15.123:0/2003620258 conn(0x7ff0980fd5f0 msgr2=0x7ff0980fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:07:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.836+0000 7ff0a07bd640 1 -- 172.21.15.123:0/2003620258 shutdown_connections 2024-08-18T22:07:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:07:59.836+0000 7ff0a07bd640 1 -- 172.21.15.123:0/2003620258 wait complete. 2024-08-18T22:08:00.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:00 smithi123 ceph-mon[18462]: pgmap v347: 129 pgs: 129 active+clean; 648 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-18T22:08:00.564 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-08-18T22:07:59.376418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663859,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":876,"num_read_kb":559,"num_write":364,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1229945,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":794,"ondisk_log_size":794,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388624,"kb_used_data":14444,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553200,"statfs":{"total":1151940427776,"available":1151542476800,"internally_reserved":0,"allocated":14790656,"data_stored":8246123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6819,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":56,"num_write":4,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003392"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:26.609141+0000","last_change":"2024-08-18T22:05:19.844674+0000","last_active":"2024-08-18T22:07:26.609141+0000","last_peered":"2024-08-18T22:07:26.609141+0000","last_clean":"2024-08-18T22:07:26.609141+0000","last_became_active":"2024-08-18T22:05:19.844381+0000","last_became_peered":"2024-08-18T22:05:19.844381+0000","last_unstale":"2024-08-18T22:07:26.609141+0000","last_undegraded":"2024-08-18T22:07:26.609141+0000","last_fullsized":"2024-08-18T22:07:26.609141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:58.783222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572759+0000","last_change":"2024-08-18T22:05:21.859013+0000","last_active":"2024-08-18T22:07:11.572759+0000","last_peered":"2024-08-18T22:07:11.572759+0000","last_clean":"2024-08-18T22:07:11.572759+0000","last_became_active":"2024-08-18T22:05:21.858709+0000","last_became_peered":"2024-08-18T22:05:21.858709+0000","last_unstale":"2024-08-18T22:07:11.572759+0000","last_undegraded":"2024-08-18T22:07:11.572759+0000","last_fullsized":"2024-08-18T22:07:11.572759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:34.272340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530666+0000","last_change":"2024-08-18T22:05:28.925735+0000","last_active":"2024-08-18T22:07:11.530666+0000","last_peered":"2024-08-18T22:07:11.530666+0000","last_clean":"2024-08-18T22:07:11.530666+0000","last_became_active":"2024-08-18T22:05:28.925324+0000","last_became_peered":"2024-08-18T22:05:28.925324+0000","last_unstale":"2024-08-18T22:07:11.530666+0000","last_undegraded":"2024-08-18T22:07:11.530666+0000","last_fullsized":"2024-08-18T22:07:11.530666+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:15:58.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572915+0000","last_change":"2024-08-18T22:05:20.290861+0000","last_active":"2024-08-18T22:07:11.572915+0000","last_peered":"2024-08-18T22:07:11.572915+0000","last_clean":"2024-08-18T22:07:11.572915+0000","last_became_active":"2024-08-18T22:05:20.290508+0000","last_became_peered":"2024-08-18T22:05:20.290508+0000","last_unstale":"2024-08-18T22:07:11.572915+0000","last_undegraded":"2024-08-18T22:07:11.572915+0000","last_fullsized":"2024-08-18T22:07:11.572915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:21.462206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623639+0000","last_change":"2024-08-18T22:05:21.863441+0000","last_active":"2024-08-18T22:07:11.623639+0000","last_peered":"2024-08-18T22:07:11.623639+0000","last_clean":"2024-08-18T22:07:11.623639+0000","last_became_active":"2024-08-18T22:05:21.863121+0000","last_became_peered":"2024-08-18T22:05:21.863121+0000","last_unstale":"2024-08-18T22:07:11.623639+0000","last_undegraded":"2024-08-18T22:07:11.623639+0000","last_fullsized":"2024-08-18T22:07:11.623639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:47.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572760+0000","last_change":"2024-08-18T22:05:28.925477+0000","last_active":"2024-08-18T22:07:11.572760+0000","last_peered":"2024-08-18T22:07:11.572760+0000","last_clean":"2024-08-18T22:07:11.572760+0000","last_became_active":"2024-08-18T22:05:28.924922+0000","last_became_peered":"2024-08-18T22:05:28.924922+0000","last_unstale":"2024-08-18T22:07:11.572760+0000","last_undegraded":"2024-08-18T22:07:11.572760+0000","last_fullsized":"2024-08-18T22:07:11.572760+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:35.041943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524985+0000","last_change":"2024-08-18T22:05:19.847979+0000","last_active":"2024-08-18T22:07:11.524985+0000","last_peered":"2024-08-18T22:07:11.524985+0000","last_clean":"2024-08-18T22:07:11.524985+0000","last_became_active":"2024-08-18T22:05:19.847643+0000","last_became_peered":"2024-08-18T22:05:19.847643+0000","last_unstale":"2024-08-18T22:07:11.524985+0000","last_undegraded":"2024-08-18T22:07:11.524985+0000","last_fullsized":"2024-08-18T22:07:11.524985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:33.875378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528980+0000","last_change":"2024-08-18T22:05:21.860225+0000","last_active":"2024-08-18T22:07:11.528980+0000","last_peered":"2024-08-18T22:07:11.528980+0000","last_clean":"2024-08-18T22:07:11.528980+0000","last_became_active":"2024-08-18T22:05:21.859889+0000","last_became_peered":"2024-08-18T22:05:21.859889+0000","last_unstale":"2024-08-18T22:07:11.528980+0000","last_undegraded":"2024-08-18T22:07:11.528980+0000","last_fullsized":"2024-08-18T22:07:11.528980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:06:27.084401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573195+0000","last_change":"2024-08-18T22:05:28.922230+0000","last_active":"2024-08-18T22:07:11.573195+0000","last_peered":"2024-08-18T22:07:11.573195+0000","last_clean":"2024-08-18T22:07:11.573195+0000","last_became_active":"2024-08-18T22:05:28.921804+0000","last_became_peered":"2024-08-18T22:05:28.921804+0000","last_unstale":"2024-08-18T22:07:11.573195+0000","last_undegraded":"2024-08-18T22:07:11.573195+0000","last_fullsized":"2024-08-18T22:07:11.573195+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:17.735645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.533950+0000","last_change":"2024-08-18T22:07:11.533541+0000","last_active":"2024-08-18T22:07:11.533950+0000","last_peered":"2024-08-18T22:07:11.533950+0000","last_clean":"2024-08-18T22:07:11.533950+0000","last_became_active":"2024-08-18T22:07:11.530034+0000","last_became_peered":"2024-08-18T22:07:11.530034+0000","last_unstale":"2024-08-18T22:07:11.533950+0000","last_undegraded":"2024-08-18T22:07:11.533950+0000","last_fullsized":"2024-08-18T22:07:11.533950+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:29.575399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528767+0000","last_change":"2024-08-18T22:06:10.514673+0000","last_active":"2024-08-18T22:07:11.528767+0000","last_peered":"2024-08-18T22:07:11.528767+0000","last_clean":"2024-08-18T22:07:11.528767+0000","last_became_active":"2024-08-18T22:06:10.514264+0000","last_became_peered":"2024-08-18T22:06:10.514264+0000","last_unstale":"2024-08-18T22:07:11.528767+0000","last_undegraded":"2024-08-18T22:07:11.528767+0000","last_fullsized":"2024-08-18T22:07:11.528767+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:03.626895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572861+0000","last_change":"2024-08-18T22:05:28.924521+0000","last_active":"2024-08-18T22:07:11.572861+0000","last_peered":"2024-08-18T22:07:11.572861+0000","last_clean":"2024-08-18T22:07:11.572861+0000","last_became_active":"2024-08-18T22:05:28.924107+0000","last_became_peered":"2024-08-18T22:05:28.924107+0000","last_unstale":"2024-08-18T22:07:11.572861+0000","last_undegraded":"2024-08-18T22:07:11.572861+0000","last_fullsized":"2024-08-18T22:07:11.572861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:37.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527669+0000","last_change":"2024-08-18T22:05:21.861696+0000","last_active":"2024-08-18T22:07:11.527669+0000","last_peered":"2024-08-18T22:07:11.527669+0000","last_clean":"2024-08-18T22:07:11.527669+0000","last_became_active":"2024-08-18T22:05:21.861220+0000","last_became_peered":"2024-08-18T22:05:21.861220+0000","last_unstale":"2024-08-18T22:07:11.527669+0000","last_undegraded":"2024-08-18T22:07:11.527669+0000","last_fullsized":"2024-08-18T22:07:11.527669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:01.098281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526302+0000","last_change":"2024-08-18T22:06:10.520097+0000","last_active":"2024-08-18T22:07:11.526302+0000","last_peered":"2024-08-18T22:07:11.526302+0000","last_clean":"2024-08-18T22:07:11.526302+0000","last_became_active":"2024-08-18T22:06:10.513286+0000","last_became_peered":"2024-08-18T22:06:10.513286+0000","last_unstale":"2024-08-18T22:07:11.526302+0000","last_undegraded":"2024-08-18T22:07:11.526302+0000","last_fullsized":"2024-08-18T22:07:11.526302+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:08:18.861243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573335+0000","last_change":"2024-08-18T22:05:29.013139+0000","last_active":"2024-08-18T22:07:11.573335+0000","last_peered":"2024-08-18T22:07:11.573335+0000","last_clean":"2024-08-18T22:07:11.573335+0000","last_became_active":"2024-08-18T22:05:29.012322+0000","last_became_peered":"2024-08-18T22:05:29.012322+0000","last_unstale":"2024-08-18T22:07:11.573335+0000","last_undegraded":"2024-08-18T22:07:11.573335+0000","last_fullsized":"2024-08-18T22:07:11.573335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:32.348201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572558+0000","last_change":"2024-08-18T22:05:21.860410+0000","last_active":"2024-08-18T22:07:11.572558+0000","last_peered":"2024-08-18T22:07:11.572558+0000","last_clean":"2024-08-18T22:07:11.572558+0000","last_became_active":"2024-08-18T22:05:21.860173+0000","last_became_peered":"2024-08-18T22:05:21.860173+0000","last_unstale":"2024-08-18T22:07:11.572558+0000","last_undegraded":"2024-08-18T22:07:11.572558+0000","last_fullsized":"2024-08-18T22:07:11.572558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:00.879178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530486+0000","last_change":"2024-08-18T22:05:19.845785+0000","last_active":"2024-08-18T22:07:11.530486+0000","last_peered":"2024-08-18T22:07:11.530486+0000","last_clean":"2024-08-18T22:07:11.530486+0000","last_became_active":"2024-08-18T22:05:19.845414+0000","last_became_peered":"2024-08-18T22:05:19.845414+0000","last_unstale":"2024-08-18T22:07:11.530486+0000","last_undegraded":"2024-08-18T22:07:11.530486+0000","last_fullsized":"2024-08-18T22:07:11.530486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:13.504885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573296+0000","last_change":"2024-08-18T22:06:10.523404+0000","last_active":"2024-08-18T22:07:11.573296+0000","last_peered":"2024-08-18T22:07:11.573296+0000","last_clean":"2024-08-18T22:07:11.573296+0000","last_became_active":"2024-08-18T22:06:10.516652+0000","last_became_peered":"2024-08-18T22:06:10.516652+0000","last_unstale":"2024-08-18T22:07:11.573296+0000","last_undegraded":"2024-08-18T22:07:11.573296+0000","last_fullsized":"2024-08-18T22:07:11.573296+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:58.197636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526366+0000","last_change":"2024-08-18T22:05:21.858329+0000","last_active":"2024-08-18T22:07:11.526366+0000","last_peered":"2024-08-18T22:07:11.526366+0000","last_clean":"2024-08-18T22:07:11.526366+0000","last_became_active":"2024-08-18T22:05:21.857854+0000","last_became_peered":"2024-08-18T22:05:21.857854+0000","last_unstale":"2024-08-18T22:07:11.526366+0000","last_undegraded":"2024-08-18T22:07:11.526366+0000","last_fullsized":"2024-08-18T22:07:11.526366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:45:19.934647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572567+0000","last_change":"2024-08-18T22:05:19.843031+0000","last_active":"2024-08-18T22:07:11.572567+0000","last_peered":"2024-08-18T22:07:11.572567+0000","last_clean":"2024-08-18T22:07:11.572567+0000","last_became_active":"2024-08-18T22:05:19.842694+0000","last_became_peered":"2024-08-18T22:05:19.842694+0000","last_unstale":"2024-08-18T22:07:11.572567+0000","last_undegraded":"2024-08-18T22:07:11.572567+0000","last_fullsized":"2024-08-18T22:07:11.572567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:01.135449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523703+0000","last_change":"2024-08-18T22:05:28.920647+0000","last_active":"2024-08-18T22:07:11.523703+0000","last_peered":"2024-08-18T22:07:11.523703+0000","last_clean":"2024-08-18T22:07:11.523703+0000","last_became_active":"2024-08-18T22:05:28.920295+0000","last_became_peered":"2024-08-18T22:05:28.920295+0000","last_unstale":"2024-08-18T22:07:11.523703+0000","last_undegraded":"2024-08-18T22:07:11.523703+0000","last_fullsized":"2024-08-18T22:07:11.523703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:41.295009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524432+0000","last_change":"2024-08-18T22:05:21.858413+0000","last_active":"2024-08-18T22:07:11.524432+0000","last_peered":"2024-08-18T22:07:11.524432+0000","last_clean":"2024-08-18T22:07:11.524432+0000","last_became_active":"2024-08-18T22:05:21.858102+0000","last_became_peered":"2024-08-18T22:05:21.858102+0000","last_unstale":"2024-08-18T22:07:11.524432+0000","last_undegraded":"2024-08-18T22:07:11.524432+0000","last_fullsized":"2024-08-18T22:07:11.524432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:24:59.432666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528669+0000","last_change":"2024-08-18T22:05:20.292085+0000","last_active":"2024-08-18T22:07:11.528669+0000","last_peered":"2024-08-18T22:07:11.528669+0000","last_clean":"2024-08-18T22:07:11.528669+0000","last_became_active":"2024-08-18T22:05:20.291606+0000","last_became_peered":"2024-08-18T22:05:20.291606+0000","last_unstale":"2024-08-18T22:07:11.528669+0000","last_undegraded":"2024-08-18T22:07:11.528669+0000","last_fullsized":"2024-08-18T22:07:11.528669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:22:46.801719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573405+0000","last_change":"2024-08-18T22:06:10.515755+0000","last_active":"2024-08-18T22:07:11.573405+0000","last_peered":"2024-08-18T22:07:11.573405+0000","last_clean":"2024-08-18T22:07:11.573405+0000","last_became_active":"2024-08-18T22:06:10.514624+0000","last_became_peered":"2024-08-18T22:06:10.514624+0000","last_unstale":"2024-08-18T22:07:11.573405+0000","last_undegraded":"2024-08-18T22:07:11.573405+0000","last_fullsized":"2024-08-18T22:07:11.573405+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:18:50.785139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623553+0000","last_change":"2024-08-18T22:05:21.855163+0000","last_active":"2024-08-18T22:07:11.623553+0000","last_peered":"2024-08-18T22:07:11.623553+0000","last_clean":"2024-08-18T22:07:11.623553+0000","last_became_active":"2024-08-18T22:05:21.854867+0000","last_became_peered":"2024-08-18T22:05:21.854867+0000","last_unstale":"2024-08-18T22:07:11.623553+0000","last_undegraded":"2024-08-18T22:07:11.623553+0000","last_fullsized":"2024-08-18T22:07:11.623553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:10.300307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573516+0000","last_change":"2024-08-18T22:05:20.082363+0000","last_active":"2024-08-18T22:07:11.573516+0000","last_peered":"2024-08-18T22:07:11.573516+0000","last_clean":"2024-08-18T22:07:11.573516+0000","last_became_active":"2024-08-18T22:05:20.081998+0000","last_became_peered":"2024-08-18T22:05:20.081998+0000","last_unstale":"2024-08-18T22:07:11.573516+0000","last_undegraded":"2024-08-18T22:07:11.573516+0000","last_fullsized":"2024-08-18T22:07:11.573516+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:44.960512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530726+0000","last_change":"2024-08-18T22:05:28.924072+0000","last_active":"2024-08-18T22:07:11.530726+0000","last_peered":"2024-08-18T22:07:11.530726+0000","last_clean":"2024-08-18T22:07:11.530726+0000","last_became_active":"2024-08-18T22:05:28.923673+0000","last_became_peered":"2024-08-18T22:05:28.923673+0000","last_unstale":"2024-08-18T22:07:11.530726+0000","last_undegraded":"2024-08-18T22:07:11.530726+0000","last_fullsized":"2024-08-18T22:07:11.530726+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:44.593009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572927+0000","last_change":"2024-08-18T22:05:21.851377+0000","last_active":"2024-08-18T22:07:11.572927+0000","last_peered":"2024-08-18T22:07:11.572927+0000","last_clean":"2024-08-18T22:07:11.572927+0000","last_became_active":"2024-08-18T22:05:21.851031+0000","last_became_peered":"2024-08-18T22:05:21.851031+0000","last_unstale":"2024-08-18T22:07:11.572927+0000","last_undegraded":"2024-08-18T22:07:11.572927+0000","last_fullsized":"2024-08-18T22:07:11.572927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.547244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'13","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:31.609491+0000","last_change":"2024-08-18T22:05:19.840697+0000","last_active":"2024-08-18T22:07:31.609491+0000","last_peered":"2024-08-18T22:07:31.609491+0000","last_clean":"2024-08-18T22:07:31.609491+0000","last_became_active":"2024-08-18T22:05:19.840382+0000","last_became_peered":"2024-08-18T22:05:19.840382+0000","last_unstale":"2024-08-18T22:07:31.609491+0000","last_undegraded":"2024-08-18T22:07:31.609491+0000","last_fullsized":"2024-08-18T22:07:31.609491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:24.514428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572248+0000","last_change":"2024-08-18T22:05:29.012305+0000","last_active":"2024-08-18T22:07:11.572248+0000","last_peered":"2024-08-18T22:07:11.572248+0000","last_clean":"2024-08-18T22:07:11.572248+0000","last_became_active":"2024-08-18T22:05:29.011846+0000","last_became_peered":"2024-08-18T22:05:29.011846+0000","last_unstale":"2024-08-18T22:07:11.572248+0000","last_undegraded":"2024-08-18T22:07:11.572248+0000","last_fullsized":"2024-08-18T22:07:11.572248+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:36.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570893+0000","last_change":"2024-08-18T22:05:21.856182+0000","last_active":"2024-08-18T22:07:11.570893+0000","last_peered":"2024-08-18T22:07:11.570893+0000","last_clean":"2024-08-18T22:07:11.570893+0000","last_became_active":"2024-08-18T22:05:21.855855+0000","last_became_peered":"2024-08-18T22:05:21.855855+0000","last_unstale":"2024-08-18T22:07:11.570893+0000","last_undegraded":"2024-08-18T22:07:11.570893+0000","last_fullsized":"2024-08-18T22:07:11.570893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:00.166809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524985+0000","last_change":"2024-08-18T22:05:20.291272+0000","last_active":"2024-08-18T22:07:11.524985+0000","last_peered":"2024-08-18T22:07:11.524985+0000","last_clean":"2024-08-18T22:07:11.524985+0000","last_became_active":"2024-08-18T22:05:20.290970+0000","last_became_peered":"2024-08-18T22:05:20.290970+0000","last_unstale":"2024-08-18T22:07:11.524985+0000","last_undegraded":"2024-08-18T22:07:11.524985+0000","last_fullsized":"2024-08-18T22:07:11.524985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:29.438996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526400+0000","last_change":"2024-08-18T22:05:28.923141+0000","last_active":"2024-08-18T22:07:11.526400+0000","last_peered":"2024-08-18T22:07:11.526400+0000","last_clean":"2024-08-18T22:07:11.526400+0000","last_became_active":"2024-08-18T22:05:28.922269+0000","last_became_peered":"2024-08-18T22:05:28.922269+0000","last_unstale":"2024-08-18T22:07:11.526400+0000","last_undegraded":"2024-08-18T22:07:11.526400+0000","last_fullsized":"2024-08-18T22:07:11.526400+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:58.092640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522176+0000","last_change":"2024-08-18T22:05:21.850124+0000","last_active":"2024-08-18T22:07:11.522176+0000","last_peered":"2024-08-18T22:07:11.522176+0000","last_clean":"2024-08-18T22:07:11.522176+0000","last_became_active":"2024-08-18T22:05:21.849805+0000","last_became_peered":"2024-08-18T22:05:21.849805+0000","last_unstale":"2024-08-18T22:07:11.522176+0000","last_undegraded":"2024-08-18T22:07:11.522176+0000","last_fullsized":"2024-08-18T22:07:11.522176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:53.492613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523594+0000","last_change":"2024-08-18T22:05:20.292836+0000","last_active":"2024-08-18T22:07:11.523594+0000","last_peered":"2024-08-18T22:07:11.523594+0000","last_clean":"2024-08-18T22:07:11.523594+0000","last_became_active":"2024-08-18T22:05:20.292456+0000","last_became_peered":"2024-08-18T22:05:20.292456+0000","last_unstale":"2024-08-18T22:07:11.523594+0000","last_undegraded":"2024-08-18T22:07:11.523594+0000","last_fullsized":"2024-08-18T22:07:11.523594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:19.525037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524433+0000","last_change":"2024-08-18T22:05:29.012439+0000","last_active":"2024-08-18T22:07:11.524433+0000","last_peered":"2024-08-18T22:07:11.524433+0000","last_clean":"2024-08-18T22:07:11.524433+0000","last_became_active":"2024-08-18T22:05:29.011860+0000","last_became_peered":"2024-08-18T22:05:29.011860+0000","last_unstale":"2024-08-18T22:07:11.524433+0000","last_undegraded":"2024-08-18T22:07:11.524433+0000","last_fullsized":"2024-08-18T22:07:11.524433+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:03.432217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522230+0000","last_change":"2024-08-18T22:05:21.855598+0000","last_active":"2024-08-18T22:07:11.522230+0000","last_peered":"2024-08-18T22:07:11.522230+0000","last_clean":"2024-08-18T22:07:11.522230+0000","last_became_active":"2024-08-18T22:05:21.855228+0000","last_became_peered":"2024-08-18T22:05:21.855228+0000","last_unstale":"2024-08-18T22:07:11.522230+0000","last_undegraded":"2024-08-18T22:07:11.522230+0000","last_fullsized":"2024-08-18T22:07:11.522230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:33.762700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527786+0000","last_change":"2024-08-18T22:05:19.844638+0000","last_active":"2024-08-18T22:07:11.527786+0000","last_peered":"2024-08-18T22:07:11.527786+0000","last_clean":"2024-08-18T22:07:11.527786+0000","last_became_active":"2024-08-18T22:05:19.844333+0000","last_became_peered":"2024-08-18T22:05:19.844333+0000","last_unstale":"2024-08-18T22:07:11.527786+0000","last_undegraded":"2024-08-18T22:07:11.527786+0000","last_fullsized":"2024-08-18T22:07:11.527786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:26.947512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570807+0000","last_change":"2024-08-18T22:05:28.919965+0000","last_active":"2024-08-18T22:07:11.570807+0000","last_peered":"2024-08-18T22:07:11.570807+0000","last_clean":"2024-08-18T22:07:11.570807+0000","last_became_active":"2024-08-18T22:05:28.919546+0000","last_became_peered":"2024-08-18T22:05:28.919546+0000","last_unstale":"2024-08-18T22:07:11.570807+0000","last_undegraded":"2024-08-18T22:07:11.570807+0000","last_fullsized":"2024-08-18T22:07:11.570807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:49.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528844+0000","last_change":"2024-08-18T22:05:21.857867+0000","last_active":"2024-08-18T22:07:11.528844+0000","last_peered":"2024-08-18T22:07:11.528844+0000","last_clean":"2024-08-18T22:07:11.528844+0000","last_became_active":"2024-08-18T22:05:21.857515+0000","last_became_peered":"2024-08-18T22:05:21.857515+0000","last_unstale":"2024-08-18T22:07:11.528844+0000","last_undegraded":"2024-08-18T22:07:11.528844+0000","last_fullsized":"2024-08-18T22:07:11.528844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:51.148321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":164,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:56.635663+0000","last_change":"2024-08-18T22:05:20.290924+0000","last_active":"2024-08-18T22:07:56.635663+0000","last_peered":"2024-08-18T22:07:56.635663+0000","last_clean":"2024-08-18T22:07:56.635663+0000","last_became_active":"2024-08-18T22:05:20.290587+0000","last_became_peered":"2024-08-18T22:05:20.290587+0000","last_unstale":"2024-08-18T22:07:56.635663+0000","last_undegraded":"2024-08-18T22:07:56.635663+0000","last_fullsized":"2024-08-18T22:07:56.635663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:35.029634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570655+0000","last_change":"2024-08-18T22:05:29.012876+0000","last_active":"2024-08-18T22:07:11.570655+0000","last_peered":"2024-08-18T22:07:11.570655+0000","last_clean":"2024-08-18T22:07:11.570655+0000","last_became_active":"2024-08-18T22:05:29.011930+0000","last_became_peered":"2024-08-18T22:05:29.011930+0000","last_unstale":"2024-08-18T22:07:11.570655+0000","last_undegraded":"2024-08-18T22:07:11.570655+0000","last_fullsized":"2024-08-18T22:07:11.570655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:22:35.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570198+0000","last_change":"2024-08-18T22:05:21.860798+0000","last_active":"2024-08-18T22:07:11.570198+0000","last_peered":"2024-08-18T22:07:11.570198+0000","last_clean":"2024-08-18T22:07:11.570198+0000","last_became_active":"2024-08-18T22:05:21.856968+0000","last_became_peered":"2024-08-18T22:05:21.856968+0000","last_unstale":"2024-08-18T22:07:11.570198+0000","last_undegraded":"2024-08-18T22:07:11.570198+0000","last_fullsized":"2024-08-18T22:07:11.570198+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:54.934400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527098+0000","last_change":"2024-08-18T22:05:19.844775+0000","last_active":"2024-08-18T22:07:11.527098+0000","last_peered":"2024-08-18T22:07:11.527098+0000","last_clean":"2024-08-18T22:07:11.527098+0000","last_became_active":"2024-08-18T22:05:19.844465+0000","last_became_peered":"2024-08-18T22:05:19.844465+0000","last_unstale":"2024-08-18T22:07:11.527098+0000","last_undegraded":"2024-08-18T22:07:11.527098+0000","last_fullsized":"2024-08-18T22:07:11.527098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.042335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528645+0000","last_change":"2024-08-18T22:05:29.013275+0000","last_active":"2024-08-18T22:07:11.528645+0000","last_peered":"2024-08-18T22:07:11.528645+0000","last_clean":"2024-08-18T22:07:11.528645+0000","last_became_active":"2024-08-18T22:05:29.012537+0000","last_became_peered":"2024-08-18T22:05:29.012537+0000","last_unstale":"2024-08-18T22:07:11.528645+0000","last_undegraded":"2024-08-18T22:07:11.528645+0000","last_fullsized":"2024-08-18T22:07:11.528645+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:15:39.775360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572574+0000","last_change":"2024-08-18T22:05:21.853358+0000","last_active":"2024-08-18T22:07:11.572574+0000","last_peered":"2024-08-18T22:07:11.572574+0000","last_clean":"2024-08-18T22:07:11.572574+0000","last_became_active":"2024-08-18T22:05:21.853071+0000","last_became_peered":"2024-08-18T22:05:21.853071+0000","last_unstale":"2024-08-18T22:07:11.572574+0000","last_undegraded":"2024-08-18T22:07:11.572574+0000","last_fullsized":"2024-08-18T22:07:11.572574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:23.755263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573411+0000","last_change":"2024-08-18T22:05:19.846922+0000","last_active":"2024-08-18T22:07:11.573411+0000","last_peered":"2024-08-18T22:07:11.573411+0000","last_clean":"2024-08-18T22:07:11.573411+0000","last_became_active":"2024-08-18T22:05:19.846619+0000","last_became_peered":"2024-08-18T22:05:19.846619+0000","last_unstale":"2024-08-18T22:07:11.573411+0000","last_undegraded":"2024-08-18T22:07:11.573411+0000","last_fullsized":"2024-08-18T22:07:11.573411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:36:16.232344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":357,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527160+0000","last_change":"2024-08-18T22:04:11.878703+0000","last_active":"2024-08-18T22:07:11.527160+0000","last_peered":"2024-08-18T22:07:11.527160+0000","last_clean":"2024-08-18T22:07:11.527160+0000","last_became_active":"2024-08-18T22:04:11.878157+0000","last_became_peered":"2024-08-18T22:04:11.878157+0000","last_unstale":"2024-08-18T22:07:11.527160+0000","last_undegraded":"2024-08-18T22:07:11.527160+0000","last_fullsized":"2024-08-18T22:07:11.527160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:01:09.551264+0000","last_clean_scrub_stamp":"2024-08-18T22:01:09.551264+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:24:07.391758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527387+0000","last_change":"2024-08-18T22:05:28.928882+0000","last_active":"2024-08-18T22:07:11.527387+0000","last_peered":"2024-08-18T22:07:11.527387+0000","last_clean":"2024-08-18T22:07:11.527387+0000","last_became_active":"2024-08-18T22:05:28.928482+0000","last_became_peered":"2024-08-18T22:05:28.928482+0000","last_unstale":"2024-08-18T22:07:11.527387+0000","last_undegraded":"2024-08-18T22:07:11.527387+0000","last_fullsized":"2024-08-18T22:07:11.527387+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:41.739482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527496+0000","last_change":"2024-08-18T22:05:21.863045+0000","last_active":"2024-08-18T22:07:11.527496+0000","last_peered":"2024-08-18T22:07:11.527496+0000","last_clean":"2024-08-18T22:07:11.527496+0000","last_became_active":"2024-08-18T22:05:21.862758+0000","last_became_peered":"2024-08-18T22:05:21.862758+0000","last_unstale":"2024-08-18T22:07:11.527496+0000","last_undegraded":"2024-08-18T22:07:11.527496+0000","last_fullsized":"2024-08-18T22:07:11.527496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:08:39.111147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531069+0000","last_change":"2024-08-18T22:05:20.291030+0000","last_active":"2024-08-18T22:07:11.531069+0000","last_peered":"2024-08-18T22:07:11.531069+0000","last_clean":"2024-08-18T22:07:11.531069+0000","last_became_active":"2024-08-18T22:05:20.290427+0000","last_became_peered":"2024-08-18T22:05:20.290427+0000","last_unstale":"2024-08-18T22:07:11.531069+0000","last_undegraded":"2024-08-18T22:07:11.531069+0000","last_fullsized":"2024-08-18T22:07:11.531069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:14:42.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528742+0000","last_change":"2024-08-18T22:05:28.923700+0000","last_active":"2024-08-18T22:07:11.528742+0000","last_peered":"2024-08-18T22:07:11.528742+0000","last_clean":"2024-08-18T22:07:11.528742+0000","last_became_active":"2024-08-18T22:05:28.923280+0000","last_became_peered":"2024-08-18T22:05:28.923280+0000","last_unstale":"2024-08-18T22:07:11.528742+0000","last_undegraded":"2024-08-18T22:07:11.528742+0000","last_fullsized":"2024-08-18T22:07:11.528742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:25:45.343542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527521+0000","last_change":"2024-08-18T22:05:21.856107+0000","last_active":"2024-08-18T22:07:11.527521+0000","last_peered":"2024-08-18T22:07:11.527521+0000","last_clean":"2024-08-18T22:07:11.527521+0000","last_became_active":"2024-08-18T22:05:21.853276+0000","last_became_peered":"2024-08-18T22:05:21.853276+0000","last_unstale":"2024-08-18T22:07:11.527521+0000","last_undegraded":"2024-08-18T22:07:11.527521+0000","last_fullsized":"2024-08-18T22:07:11.527521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:58.280375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528926+0000","last_change":"2024-08-18T22:05:19.843445+0000","last_active":"2024-08-18T22:07:11.528926+0000","last_peered":"2024-08-18T22:07:11.528926+0000","last_clean":"2024-08-18T22:07:11.528926+0000","last_became_active":"2024-08-18T22:05:19.843000+0000","last_became_peered":"2024-08-18T22:05:19.843000+0000","last_unstale":"2024-08-18T22:07:11.528926+0000","last_undegraded":"2024-08-18T22:07:11.528926+0000","last_fullsized":"2024-08-18T22:07:11.528926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:23.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623212+0000","last_change":"2024-08-18T22:06:10.515953+0000","last_active":"2024-08-18T22:07:11.623212+0000","last_peered":"2024-08-18T22:07:11.623212+0000","last_clean":"2024-08-18T22:07:11.623212+0000","last_became_active":"2024-08-18T22:06:10.515662+0000","last_became_peered":"2024-08-18T22:06:10.515662+0000","last_unstale":"2024-08-18T22:07:11.623212+0000","last_undegraded":"2024-08-18T22:07:11.623212+0000","last_fullsized":"2024-08-18T22:07:11.623212+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:43.150180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527523+0000","last_change":"2024-08-18T22:05:21.864029+0000","last_active":"2024-08-18T22:07:11.527523+0000","last_peered":"2024-08-18T22:07:11.527523+0000","last_clean":"2024-08-18T22:07:11.527523+0000","last_became_active":"2024-08-18T22:05:21.863509+0000","last_became_peered":"2024-08-18T22:05:21.863509+0000","last_unstale":"2024-08-18T22:07:11.527523+0000","last_undegraded":"2024-08-18T22:07:11.527523+0000","last_fullsized":"2024-08-18T22:07:11.527523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:42.879243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570764+0000","last_change":"2024-08-18T22:05:19.846514+0000","last_active":"2024-08-18T22:07:11.570764+0000","last_peered":"2024-08-18T22:07:11.570764+0000","last_clean":"2024-08-18T22:07:11.570764+0000","last_became_active":"2024-08-18T22:05:19.846190+0000","last_became_peered":"2024-08-18T22:05:19.846190+0000","last_unstale":"2024-08-18T22:07:11.570764+0000","last_undegraded":"2024-08-18T22:07:11.570764+0000","last_fullsized":"2024-08-18T22:07:11.570764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:49:00.317597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528349+0000","last_change":"2024-08-18T22:05:28.923183+0000","last_active":"2024-08-18T22:07:11.528349+0000","last_peered":"2024-08-18T22:07:11.528349+0000","last_clean":"2024-08-18T22:07:11.528349+0000","last_became_active":"2024-08-18T22:05:28.922809+0000","last_became_peered":"2024-08-18T22:05:28.922809+0000","last_unstale":"2024-08-18T22:07:11.528349+0000","last_undegraded":"2024-08-18T22:07:11.528349+0000","last_fullsized":"2024-08-18T22:07:11.528349+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:26.416920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526764+0000","last_change":"2024-08-18T22:05:21.849075+0000","last_active":"2024-08-18T22:07:11.526764+0000","last_peered":"2024-08-18T22:07:11.526764+0000","last_clean":"2024-08-18T22:07:11.526764+0000","last_became_active":"2024-08-18T22:05:21.848759+0000","last_became_peered":"2024-08-18T22:05:21.848759+0000","last_unstale":"2024-08-18T22:07:11.526764+0000","last_undegraded":"2024-08-18T22:07:11.526764+0000","last_fullsized":"2024-08-18T22:07:11.526764+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:26.531534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524964+0000","last_change":"2024-08-18T22:05:19.849210+0000","last_active":"2024-08-18T22:07:11.524964+0000","last_peered":"2024-08-18T22:07:11.524964+0000","last_clean":"2024-08-18T22:07:11.524964+0000","last_became_active":"2024-08-18T22:05:19.848829+0000","last_became_peered":"2024-08-18T22:05:19.848829+0000","last_unstale":"2024-08-18T22:07:11.524964+0000","last_undegraded":"2024-08-18T22:07:11.524964+0000","last_fullsized":"2024-08-18T22:07:11.524964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:19.321686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528709+0000","last_change":"2024-08-18T22:05:28.924577+0000","last_active":"2024-08-18T22:07:11.528709+0000","last_peered":"2024-08-18T22:07:11.528709+0000","last_clean":"2024-08-18T22:07:11.528709+0000","last_became_active":"2024-08-18T22:05:28.924183+0000","last_became_peered":"2024-08-18T22:05:28.924183+0000","last_unstale":"2024-08-18T22:07:11.528709+0000","last_undegraded":"2024-08-18T22:07:11.528709+0000","last_fullsized":"2024-08-18T22:07:11.528709+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:22.702757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523154+0000","last_change":"2024-08-18T22:06:10.513610+0000","last_active":"2024-08-18T22:07:11.523154+0000","last_peered":"2024-08-18T22:07:11.523154+0000","last_clean":"2024-08-18T22:07:11.523154+0000","last_became_active":"2024-08-18T22:06:10.513400+0000","last_became_peered":"2024-08-18T22:06:10.513400+0000","last_unstale":"2024-08-18T22:07:11.523154+0000","last_undegraded":"2024-08-18T22:07:11.523154+0000","last_fullsized":"2024-08-18T22:07:11.523154+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:49.275223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524463+0000","last_change":"2024-08-18T22:05:20.291752+0000","last_active":"2024-08-18T22:07:11.524463+0000","last_peered":"2024-08-18T22:07:11.524463+0000","last_clean":"2024-08-18T22:07:11.524463+0000","last_became_active":"2024-08-18T22:05:20.291431+0000","last_became_peered":"2024-08-18T22:05:20.291431+0000","last_unstale":"2024-08-18T22:07:11.524463+0000","last_undegraded":"2024-08-18T22:07:11.524463+0000","last_fullsized":"2024-08-18T22:07:11.524463+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:34:32.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570669+0000","last_change":"2024-08-18T22:05:28.924121+0000","last_active":"2024-08-18T22:07:11.570669+0000","last_peered":"2024-08-18T22:07:11.570669+0000","last_clean":"2024-08-18T22:07:11.570669+0000","last_became_active":"2024-08-18T22:05:28.923753+0000","last_became_peered":"2024-08-18T22:05:28.923753+0000","last_unstale":"2024-08-18T22:07:11.570669+0000","last_undegraded":"2024-08-18T22:07:11.570669+0000","last_fullsized":"2024-08-18T22:07:11.570669+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:57.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527050+0000","last_change":"2024-08-18T22:05:21.858366+0000","last_active":"2024-08-18T22:07:11.527050+0000","last_peered":"2024-08-18T22:07:11.527050+0000","last_clean":"2024-08-18T22:07:11.527050+0000","last_became_active":"2024-08-18T22:05:21.858021+0000","last_became_peered":"2024-08-18T22:05:21.858021+0000","last_unstale":"2024-08-18T22:07:11.527050+0000","last_undegraded":"2024-08-18T22:07:11.527050+0000","last_fullsized":"2024-08-18T22:07:11.527050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:55.662965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":169,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:57.637609+0000","last_change":"2024-08-18T22:05:19.850013+0000","last_active":"2024-08-18T22:07:57.637609+0000","last_peered":"2024-08-18T22:07:57.637609+0000","last_clean":"2024-08-18T22:07:57.637609+0000","last_became_active":"2024-08-18T22:05:19.849551+0000","last_became_peered":"2024-08-18T22:05:19.849551+0000","last_unstale":"2024-08-18T22:07:57.637609+0000","last_undegraded":"2024-08-18T22:07:57.637609+0000","last_fullsized":"2024-08-18T22:07:57.637609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:15.182999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523736+0000","last_change":"2024-08-18T22:05:28.927318+0000","last_active":"2024-08-18T22:07:11.523736+0000","last_peered":"2024-08-18T22:07:11.523736+0000","last_clean":"2024-08-18T22:07:11.523736+0000","last_became_active":"2024-08-18T22:05:28.926786+0000","last_became_peered":"2024-08-18T22:05:28.926786+0000","last_unstale":"2024-08-18T22:07:11.523736+0000","last_undegraded":"2024-08-18T22:07:11.523736+0000","last_fullsized":"2024-08-18T22:07:11.523736+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:45.798247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527690+0000","last_change":"2024-08-18T22:06:10.511821+0000","last_active":"2024-08-18T22:07:11.527690+0000","last_peered":"2024-08-18T22:07:11.527690+0000","last_clean":"2024-08-18T22:07:11.527690+0000","last_became_active":"2024-08-18T22:06:10.511135+0000","last_became_peered":"2024-08-18T22:06:10.511135+0000","last_unstale":"2024-08-18T22:07:11.527690+0000","last_undegraded":"2024-08-18T22:07:11.527690+0000","last_fullsized":"2024-08-18T22:07:11.527690+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:07.108531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528618+0000","last_change":"2024-08-18T22:05:19.844061+0000","last_active":"2024-08-18T22:07:11.528618+0000","last_peered":"2024-08-18T22:07:11.528618+0000","last_clean":"2024-08-18T22:07:11.528618+0000","last_became_active":"2024-08-18T22:05:19.843513+0000","last_became_peered":"2024-08-18T22:05:19.843513+0000","last_unstale":"2024-08-18T22:07:11.528618+0000","last_undegraded":"2024-08-18T22:07:11.528618+0000","last_fullsized":"2024-08-18T22:07:11.528618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:53.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527054+0000","last_change":"2024-08-18T22:05:28.922986+0000","last_active":"2024-08-18T22:07:11.527054+0000","last_peered":"2024-08-18T22:07:11.527054+0000","last_clean":"2024-08-18T22:07:11.527054+0000","last_became_active":"2024-08-18T22:05:28.922322+0000","last_became_peered":"2024-08-18T22:05:28.922322+0000","last_unstale":"2024-08-18T22:07:11.527054+0000","last_undegraded":"2024-08-18T22:07:11.527054+0000","last_fullsized":"2024-08-18T22:07:11.527054+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:28.168299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570439+0000","last_change":"2024-08-18T22:05:21.853389+0000","last_active":"2024-08-18T22:07:11.570439+0000","last_peered":"2024-08-18T22:07:11.570439+0000","last_clean":"2024-08-18T22:07:11.570439+0000","last_became_active":"2024-08-18T22:05:21.853095+0000","last_became_peered":"2024-08-18T22:05:21.853095+0000","last_unstale":"2024-08-18T22:07:11.570439+0000","last_undegraded":"2024-08-18T22:07:11.570439+0000","last_fullsized":"2024-08-18T22:07:11.570439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:14.126983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531024+0000","last_change":"2024-08-18T22:05:19.846788+0000","last_active":"2024-08-18T22:07:11.531024+0000","last_peered":"2024-08-18T22:07:11.531024+0000","last_clean":"2024-08-18T22:07:11.531024+0000","last_became_active":"2024-08-18T22:05:19.846248+0000","last_became_peered":"2024-08-18T22:05:19.846248+0000","last_unstale":"2024-08-18T22:07:11.531024+0000","last_undegraded":"2024-08-18T22:07:11.531024+0000","last_fullsized":"2024-08-18T22:07:11.531024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:46.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528648+0000","last_change":"2024-08-18T22:05:28.920294+0000","last_active":"2024-08-18T22:07:11.528648+0000","last_peered":"2024-08-18T22:07:11.528648+0000","last_clean":"2024-08-18T22:07:11.528648+0000","last_became_active":"2024-08-18T22:05:28.919351+0000","last_became_peered":"2024-08-18T22:05:28.919351+0000","last_unstale":"2024-08-18T22:07:11.528648+0000","last_undegraded":"2024-08-18T22:07:11.528648+0000","last_fullsized":"2024-08-18T22:07:11.528648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:49.425281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524875+0000","last_change":"2024-08-18T22:05:21.864529+0000","last_active":"2024-08-18T22:07:11.524875+0000","last_peered":"2024-08-18T22:07:11.524875+0000","last_clean":"2024-08-18T22:07:11.524875+0000","last_became_active":"2024-08-18T22:05:21.864062+0000","last_became_peered":"2024-08-18T22:05:21.864062+0000","last_unstale":"2024-08-18T22:07:11.524875+0000","last_undegraded":"2024-08-18T22:07:11.524875+0000","last_fullsized":"2024-08-18T22:07:11.524875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:24:49.037343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'38","reported_seq":350,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:58.691232+0000","last_change":"2024-08-18T22:06:10.522113+0000","last_active":"2024-08-18T22:07:58.691232+0000","last_peered":"2024-08-18T22:07:58.691232+0000","last_clean":"2024-08-18T22:07:58.691232+0000","last_became_active":"2024-08-18T22:06:10.514837+0000","last_became_peered":"2024-08-18T22:06:10.514837+0000","last_unstale":"2024-08-18T22:07:58.691232+0000","last_undegraded":"2024-08-18T22:07:58.691232+0000","last_fullsized":"2024-08-18T22:07:58.691232+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:46.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68585,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":250,"num_read_kb":188,"num_write":39,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523335+0000","last_change":"2024-08-18T22:05:28.926357+0000","last_active":"2024-08-18T22:07:11.523335+0000","last_peered":"2024-08-18T22:07:11.523335+0000","last_clean":"2024-08-18T22:07:11.523335+0000","last_became_active":"2024-08-18T22:05:28.926016+0000","last_became_peered":"2024-08-18T22:05:28.926016+0000","last_unstale":"2024-08-18T22:07:11.523335+0000","last_undegraded":"2024-08-18T22:07:11.523335+0000","last_fullsized":"2024-08-18T22:07:11.523335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:16.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529123+0000","last_change":"2024-08-18T22:05:21.860237+0000","last_active":"2024-08-18T22:07:11.529123+0000","last_peered":"2024-08-18T22:07:11.529123+0000","last_clean":"2024-08-18T22:07:11.529123+0000","last_became_active":"2024-08-18T22:05:21.859919+0000","last_became_peered":"2024-08-18T22:05:21.859919+0000","last_unstale":"2024-08-18T22:07:11.529123+0000","last_undegraded":"2024-08-18T22:07:11.529123+0000","last_fullsized":"2024-08-18T22:07:11.529123+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:21.048413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528892+0000","last_change":"2024-08-18T22:05:20.291233+0000","last_active":"2024-08-18T22:07:11.528892+0000","last_peered":"2024-08-18T22:07:11.528892+0000","last_clean":"2024-08-18T22:07:11.528892+0000","last_became_active":"2024-08-18T22:05:20.290893+0000","last_became_peered":"2024-08-18T22:05:20.290893+0000","last_unstale":"2024-08-18T22:07:11.528892+0000","last_undegraded":"2024-08-18T22:07:11.528892+0000","last_fullsized":"2024-08-18T22:07:11.528892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:36.889561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573103+0000","last_change":"2024-08-18T22:05:28.923076+0000","last_active":"2024-08-18T22:07:11.573103+0000","last_peered":"2024-08-18T22:07:11.573103+0000","last_clean":"2024-08-18T22:07:11.573103+0000","last_became_active":"2024-08-18T22:05:28.922688+0000","last_became_peered":"2024-08-18T22:05:28.922688+0000","last_unstale":"2024-08-18T22:07:11.573103+0000","last_undegraded":"2024-08-18T22:07:11.573103+0000","last_fullsized":"2024-08-18T22:07:11.573103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:34.360540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623665+0000","last_change":"2024-08-18T22:05:21.855174+0000","last_active":"2024-08-18T22:07:11.623665+0000","last_peered":"2024-08-18T22:07:11.623665+0000","last_clean":"2024-08-18T22:07:11.623665+0000","last_became_active":"2024-08-18T22:05:21.854818+0000","last_became_peered":"2024-08-18T22:05:21.854818+0000","last_unstale":"2024-08-18T22:07:11.623665+0000","last_undegraded":"2024-08-18T22:07:11.623665+0000","last_fullsized":"2024-08-18T22:07:11.623665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:48:55.094624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.577365+0000","last_change":"2024-08-18T22:07:11.576894+0000","last_active":"2024-08-18T22:07:11.577365+0000","last_peered":"2024-08-18T22:07:11.577365+0000","last_clean":"2024-08-18T22:07:11.577365+0000","last_became_active":"2024-08-18T22:07:11.574159+0000","last_became_peered":"2024-08-18T22:07:11.574159+0000","last_unstale":"2024-08-18T22:07:11.577365+0000","last_undegraded":"2024-08-18T22:07:11.577365+0000","last_fullsized":"2024-08-18T22:07:11.577365+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:37.993056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523194+0000","last_change":"2024-08-18T22:05:28.921647+0000","last_active":"2024-08-18T22:07:11.523194+0000","last_peered":"2024-08-18T22:07:11.523194+0000","last_clean":"2024-08-18T22:07:11.523194+0000","last_became_active":"2024-08-18T22:05:28.921305+0000","last_became_peered":"2024-08-18T22:05:28.921305+0000","last_unstale":"2024-08-18T22:07:11.523194+0000","last_undegraded":"2024-08-18T22:07:11.523194+0000","last_fullsized":"2024-08-18T22:07:11.523194+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:29.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529467+0000","last_change":"2024-08-18T22:05:21.861151+0000","last_active":"2024-08-18T22:07:11.529467+0000","last_peered":"2024-08-18T22:07:11.529467+0000","last_clean":"2024-08-18T22:07:11.529467+0000","last_became_active":"2024-08-18T22:05:21.860834+0000","last_became_peered":"2024-08-18T22:05:21.860834+0000","last_unstale":"2024-08-18T22:07:11.529467+0000","last_undegraded":"2024-08-18T22:07:11.529467+0000","last_fullsized":"2024-08-18T22:07:11.529467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:32.890750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":164,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:57.637649+0000","last_change":"2024-08-18T22:05:19.846145+0000","last_active":"2024-08-18T22:07:57.637649+0000","last_peered":"2024-08-18T22:07:57.637649+0000","last_clean":"2024-08-18T22:07:57.637649+0000","last_became_active":"2024-08-18T22:05:19.845711+0000","last_became_peered":"2024-08-18T22:05:19.845711+0000","last_unstale":"2024-08-18T22:07:57.637649+0000","last_undegraded":"2024-08-18T22:07:57.637649+0000","last_fullsized":"2024-08-18T22:07:57.637649+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:20.376131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572385+0000","last_change":"2024-08-18T22:05:28.923256+0000","last_active":"2024-08-18T22:07:11.572385+0000","last_peered":"2024-08-18T22:07:11.572385+0000","last_clean":"2024-08-18T22:07:11.572385+0000","last_became_active":"2024-08-18T22:05:28.922845+0000","last_became_peered":"2024-08-18T22:05:28.922845+0000","last_unstale":"2024-08-18T22:07:11.572385+0000","last_undegraded":"2024-08-18T22:07:11.572385+0000","last_fullsized":"2024-08-18T22:07:11.572385+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:41.930937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623447+0000","last_change":"2024-08-18T22:05:28.924743+0000","last_active":"2024-08-18T22:07:11.623447+0000","last_peered":"2024-08-18T22:07:11.623447+0000","last_clean":"2024-08-18T22:07:11.623447+0000","last_became_active":"2024-08-18T22:05:28.923674+0000","last_became_peered":"2024-08-18T22:05:28.923674+0000","last_unstale":"2024-08-18T22:07:11.623447+0000","last_undegraded":"2024-08-18T22:07:11.623447+0000","last_fullsized":"2024-08-18T22:07:11.623447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:19.834998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523308+0000","last_change":"2024-08-18T22:05:21.857194+0000","last_active":"2024-08-18T22:07:11.523308+0000","last_peered":"2024-08-18T22:07:11.523308+0000","last_clean":"2024-08-18T22:07:11.523308+0000","last_became_active":"2024-08-18T22:05:21.856916+0000","last_became_peered":"2024-08-18T22:05:21.856916+0000","last_unstale":"2024-08-18T22:07:11.523308+0000","last_undegraded":"2024-08-18T22:07:11.523308+0000","last_fullsized":"2024-08-18T22:07:11.523308+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:24.759501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529123+0000","last_change":"2024-08-18T22:05:19.844919+0000","last_active":"2024-08-18T22:07:11.529123+0000","last_peered":"2024-08-18T22:07:11.529123+0000","last_clean":"2024-08-18T22:07:11.529123+0000","last_became_active":"2024-08-18T22:05:19.844539+0000","last_became_peered":"2024-08-18T22:05:19.844539+0000","last_unstale":"2024-08-18T22:07:11.529123+0000","last_undegraded":"2024-08-18T22:07:11.529123+0000","last_fullsized":"2024-08-18T22:07:11.529123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:01.598535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526775+0000","last_change":"2024-08-18T22:05:28.923304+0000","last_active":"2024-08-18T22:07:11.526775+0000","last_peered":"2024-08-18T22:07:11.526775+0000","last_clean":"2024-08-18T22:07:11.526775+0000","last_became_active":"2024-08-18T22:05:28.922912+0000","last_became_peered":"2024-08-18T22:05:28.922912+0000","last_unstale":"2024-08-18T22:07:11.526775+0000","last_undegraded":"2024-08-18T22:07:11.526775+0000","last_fullsized":"2024-08-18T22:07:11.526775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:24:47.834354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572444+0000","last_change":"2024-08-18T22:05:21.849448+0000","last_active":"2024-08-18T22:07:11.572444+0000","last_peered":"2024-08-18T22:07:11.572444+0000","last_clean":"2024-08-18T22:07:11.572444+0000","last_became_active":"2024-08-18T22:05:21.849154+0000","last_became_peered":"2024-08-18T22:05:21.849154+0000","last_unstale":"2024-08-18T22:07:11.572444+0000","last_undegraded":"2024-08-18T22:07:11.572444+0000","last_fullsized":"2024-08-18T22:07:11.572444+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:38.583121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570212+0000","last_change":"2024-08-18T22:05:19.848483+0000","last_active":"2024-08-18T22:07:11.570212+0000","last_peered":"2024-08-18T22:07:11.570212+0000","last_clean":"2024-08-18T22:07:11.570212+0000","last_became_active":"2024-08-18T22:05:19.848190+0000","last_became_peered":"2024-08-18T22:05:19.848190+0000","last_unstale":"2024-08-18T22:07:11.570212+0000","last_undegraded":"2024-08-18T22:07:11.570212+0000","last_fullsized":"2024-08-18T22:07:11.570212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:01.719565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522263+0000","last_change":"2024-08-18T22:05:19.843796+0000","last_active":"2024-08-18T22:07:11.522263+0000","last_peered":"2024-08-18T22:07:11.522263+0000","last_clean":"2024-08-18T22:07:11.522263+0000","last_became_active":"2024-08-18T22:05:19.843495+0000","last_became_peered":"2024-08-18T22:05:19.843495+0000","last_unstale":"2024-08-18T22:07:11.522263+0000","last_undegraded":"2024-08-18T22:07:11.522263+0000","last_fullsized":"2024-08-18T22:07:11.522263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:21.583561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528757+0000","last_change":"2024-08-18T22:05:21.856370+0000","last_active":"2024-08-18T22:07:11.528757+0000","last_peered":"2024-08-18T22:07:11.528757+0000","last_clean":"2024-08-18T22:07:11.528757+0000","last_became_active":"2024-08-18T22:05:21.855954+0000","last_became_peered":"2024-08-18T22:05:21.855954+0000","last_unstale":"2024-08-18T22:07:11.528757+0000","last_undegraded":"2024-08-18T22:07:11.528757+0000","last_fullsized":"2024-08-18T22:07:11.528757+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:30.828305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530467+0000","last_change":"2024-08-18T22:06:10.516344+0000","last_active":"2024-08-18T22:07:11.530467+0000","last_peered":"2024-08-18T22:07:11.530467+0000","last_clean":"2024-08-18T22:07:11.530467+0000","last_became_active":"2024-08-18T22:06:10.515925+0000","last_became_peered":"2024-08-18T22:06:10.515925+0000","last_unstale":"2024-08-18T22:07:11.530467+0000","last_undegraded":"2024-08-18T22:07:11.530467+0000","last_fullsized":"2024-08-18T22:07:11.530467+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:41:07.585521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":167,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:53.632703+0000","last_change":"2024-08-18T22:05:19.846860+0000","last_active":"2024-08-18T22:07:53.632703+0000","last_peered":"2024-08-18T22:07:53.632703+0000","last_clean":"2024-08-18T22:07:53.632703+0000","last_became_active":"2024-08-18T22:05:19.846496+0000","last_became_peered":"2024-08-18T22:05:19.846496+0000","last_unstale":"2024-08-18T22:07:53.632703+0000","last_undegraded":"2024-08-18T22:07:53.632703+0000","last_fullsized":"2024-08-18T22:07:53.632703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:18.821185+0000","last_clean_scrub_stamp":"2024-08-18T22:05:18.821185+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:16.555137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524517+0000","last_change":"2024-08-18T22:05:21.849058+0000","last_active":"2024-08-18T22:07:11.524517+0000","last_peered":"2024-08-18T22:07:11.524517+0000","last_clean":"2024-08-18T22:07:11.524517+0000","last_became_active":"2024-08-18T22:05:21.848703+0000","last_became_peered":"2024-08-18T22:05:21.848703+0000","last_unstale":"2024-08-18T22:07:11.524517+0000","last_undegraded":"2024-08-18T22:07:11.524517+0000","last_fullsized":"2024-08-18T22:07:11.524517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:10.024156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531015+0000","last_change":"2024-08-18T22:05:28.922968+0000","last_active":"2024-08-18T22:07:11.531015+0000","last_peered":"2024-08-18T22:07:11.531015+0000","last_clean":"2024-08-18T22:07:11.531015+0000","last_became_active":"2024-08-18T22:05:28.922378+0000","last_became_peered":"2024-08-18T22:05:28.922378+0000","last_unstale":"2024-08-18T22:07:11.531015+0000","last_undegraded":"2024-08-18T22:07:11.531015+0000","last_fullsized":"2024-08-18T22:07:11.531015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:27.891686+0000","last_clean_scrub_stamp":"2024-08-18T22:05:27.891686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:23:07.241028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526268+0000","last_change":"2024-08-18T22:05:21.858572+0000","last_active":"2024-08-18T22:07:11.526268+0000","last_peered":"2024-08-18T22:07:11.526268+0000","last_clean":"2024-08-18T22:07:11.526268+0000","last_became_active":"2024-08-18T22:05:21.858254+0000","last_became_peered":"2024-08-18T22:05:21.858254+0000","last_unstale":"2024-08-18T22:07:11.526268+0000","last_undegraded":"2024-08-18T22:07:11.526268+0000","last_fullsized":"2024-08-18T22:07:11.526268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:52.456087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531122+0000","last_change":"2024-08-18T22:05:21.856710+0000","last_active":"2024-08-18T22:07:11.531122+0000","last_peered":"2024-08-18T22:07:11.531122+0000","last_clean":"2024-08-18T22:07:11.531122+0000","last_became_active":"2024-08-18T22:05:21.855399+0000","last_became_peered":"2024-08-18T22:05:21.855399+0000","last_unstale":"2024-08-18T22:07:11.531122+0000","last_undegraded":"2024-08-18T22:07:11.531122+0000","last_fullsized":"2024-08-18T22:07:11.531122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:36.039953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.530382+0000","last_change":"2024-08-18T22:05:21.856085+0000","last_active":"2024-08-18T22:07:11.530382+0000","last_peered":"2024-08-18T22:07:11.530382+0000","last_clean":"2024-08-18T22:07:11.530382+0000","last_became_active":"2024-08-18T22:05:21.855263+0000","last_became_peered":"2024-08-18T22:05:21.855263+0000","last_unstale":"2024-08-18T22:07:11.530382+0000","last_undegraded":"2024-08-18T22:07:11.530382+0000","last_fullsized":"2024-08-18T22:07:11.530382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:31.534216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623250+0000","last_change":"2024-08-18T22:05:21.855385+0000","last_active":"2024-08-18T22:07:11.623250+0000","last_peered":"2024-08-18T22:07:11.623250+0000","last_clean":"2024-08-18T22:07:11.623250+0000","last_became_active":"2024-08-18T22:05:21.854829+0000","last_became_peered":"2024-08-18T22:05:21.854829+0000","last_unstale":"2024-08-18T22:07:11.623250+0000","last_undegraded":"2024-08-18T22:07:11.623250+0000","last_fullsized":"2024-08-18T22:07:11.623250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:59.704154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570888+0000","last_change":"2024-08-18T22:06:10.510370+0000","last_active":"2024-08-18T22:07:11.570888+0000","last_peered":"2024-08-18T22:07:11.570888+0000","last_clean":"2024-08-18T22:07:11.570888+0000","last_became_active":"2024-08-18T22:06:10.509829+0000","last_became_peered":"2024-08-18T22:06:10.509829+0000","last_unstale":"2024-08-18T22:07:11.570888+0000","last_undegraded":"2024-08-18T22:07:11.570888+0000","last_fullsized":"2024-08-18T22:07:11.570888+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:20.171834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526688+0000","last_change":"2024-08-18T22:05:21.856137+0000","last_active":"2024-08-18T22:07:11.526688+0000","last_peered":"2024-08-18T22:07:11.526688+0000","last_clean":"2024-08-18T22:07:11.526688+0000","last_became_active":"2024-08-18T22:05:21.855425+0000","last_became_peered":"2024-08-18T22:05:21.855425+0000","last_unstale":"2024-08-18T22:07:11.526688+0000","last_undegraded":"2024-08-18T22:07:11.526688+0000","last_fullsized":"2024-08-18T22:07:11.526688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:37.514710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531196+0000","last_change":"2024-08-18T22:05:21.856084+0000","last_active":"2024-08-18T22:07:11.531196+0000","last_peered":"2024-08-18T22:07:11.531196+0000","last_clean":"2024-08-18T22:07:11.531196+0000","last_became_active":"2024-08-18T22:05:21.855779+0000","last_became_peered":"2024-08-18T22:05:21.855779+0000","last_unstale":"2024-08-18T22:07:11.531196+0000","last_undegraded":"2024-08-18T22:07:11.531196+0000","last_fullsized":"2024-08-18T22:07:11.531196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:02:47.833634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572883+0000","last_change":"2024-08-18T22:05:21.856729+0000","last_active":"2024-08-18T22:07:11.572883+0000","last_peered":"2024-08-18T22:07:11.572883+0000","last_clean":"2024-08-18T22:07:11.572883+0000","last_became_active":"2024-08-18T22:05:21.856446+0000","last_became_peered":"2024-08-18T22:05:21.856446+0000","last_unstale":"2024-08-18T22:07:11.572883+0000","last_undegraded":"2024-08-18T22:07:11.572883+0000","last_fullsized":"2024-08-18T22:07:11.572883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:12:31.482225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528910+0000","last_change":"2024-08-18T22:05:21.851772+0000","last_active":"2024-08-18T22:07:11.528910+0000","last_peered":"2024-08-18T22:07:11.528910+0000","last_clean":"2024-08-18T22:07:11.528910+0000","last_became_active":"2024-08-18T22:05:21.851417+0000","last_became_peered":"2024-08-18T22:05:21.851417+0000","last_unstale":"2024-08-18T22:07:11.528910+0000","last_undegraded":"2024-08-18T22:07:11.528910+0000","last_fullsized":"2024-08-18T22:07:11.528910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:32.509318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572470+0000","last_change":"2024-08-18T22:05:21.857887+0000","last_active":"2024-08-18T22:07:11.572470+0000","last_peered":"2024-08-18T22:07:11.572470+0000","last_clean":"2024-08-18T22:07:11.572470+0000","last_became_active":"2024-08-18T22:05:21.857585+0000","last_became_peered":"2024-08-18T22:05:21.857585+0000","last_unstale":"2024-08-18T22:07:11.572470+0000","last_undegraded":"2024-08-18T22:07:11.572470+0000","last_fullsized":"2024-08-18T22:07:11.572470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:23.299033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528948+0000","last_change":"2024-08-18T22:05:21.854626+0000","last_active":"2024-08-18T22:07:11.528948+0000","last_peered":"2024-08-18T22:07:11.528948+0000","last_clean":"2024-08-18T22:07:11.528948+0000","last_became_active":"2024-08-18T22:05:21.854290+0000","last_became_peered":"2024-08-18T22:05:21.854290+0000","last_unstale":"2024-08-18T22:07:11.528948+0000","last_undegraded":"2024-08-18T22:07:11.528948+0000","last_fullsized":"2024-08-18T22:07:11.528948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:45:24.988669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570558+0000","last_change":"2024-08-18T22:05:21.865863+0000","last_active":"2024-08-18T22:07:11.570558+0000","last_peered":"2024-08-18T22:07:11.570558+0000","last_clean":"2024-08-18T22:07:11.570558+0000","last_became_active":"2024-08-18T22:05:21.864634+0000","last_became_peered":"2024-08-18T22:05:21.864634+0000","last_unstale":"2024-08-18T22:07:11.570558+0000","last_undegraded":"2024-08-18T22:07:11.570558+0000","last_fullsized":"2024-08-18T22:07:11.570558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:34.051147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527095+0000","last_change":"2024-08-18T22:05:21.860193+0000","last_active":"2024-08-18T22:07:11.527095+0000","last_peered":"2024-08-18T22:07:11.527095+0000","last_clean":"2024-08-18T22:07:11.527095+0000","last_became_active":"2024-08-18T22:05:21.859761+0000","last_became_peered":"2024-08-18T22:05:21.859761+0000","last_unstale":"2024-08-18T22:07:11.527095+0000","last_undegraded":"2024-08-18T22:07:11.527095+0000","last_fullsized":"2024-08-18T22:07:11.527095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:18.465913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.531192+0000","last_change":"2024-08-18T22:05:21.860569+0000","last_active":"2024-08-18T22:07:11.531192+0000","last_peered":"2024-08-18T22:07:11.531192+0000","last_clean":"2024-08-18T22:07:11.531192+0000","last_became_active":"2024-08-18T22:05:21.860250+0000","last_became_peered":"2024-08-18T22:05:21.860250+0000","last_unstale":"2024-08-18T22:07:11.531192+0000","last_undegraded":"2024-08-18T22:07:11.531192+0000","last_fullsized":"2024-08-18T22:07:11.531192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:52.097840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.523697+0000","last_change":"2024-08-18T22:05:21.858271+0000","last_active":"2024-08-18T22:07:11.523697+0000","last_peered":"2024-08-18T22:07:11.523697+0000","last_clean":"2024-08-18T22:07:11.523697+0000","last_became_active":"2024-08-18T22:05:21.857968+0000","last_became_peered":"2024-08-18T22:05:21.857968+0000","last_unstale":"2024-08-18T22:07:11.523697+0000","last_undegraded":"2024-08-18T22:07:11.523697+0000","last_fullsized":"2024-08-18T22:07:11.523697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:24.023136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526949+0000","last_change":"2024-08-18T22:05:21.853799+0000","last_active":"2024-08-18T22:07:11.526949+0000","last_peered":"2024-08-18T22:07:11.526949+0000","last_clean":"2024-08-18T22:07:11.526949+0000","last_became_active":"2024-08-18T22:05:21.853432+0000","last_became_peered":"2024-08-18T22:05:21.853432+0000","last_unstale":"2024-08-18T22:07:11.526949+0000","last_undegraded":"2024-08-18T22:07:11.526949+0000","last_fullsized":"2024-08-18T22:07:11.526949+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:07.429169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.528548+0000","last_change":"2024-08-18T22:05:21.855117+0000","last_active":"2024-08-18T22:07:11.528548+0000","last_peered":"2024-08-18T22:07:11.528548+0000","last_clean":"2024-08-18T22:07:11.528548+0000","last_became_active":"2024-08-18T22:05:21.854041+0000","last_became_peered":"2024-08-18T22:05:21.854041+0000","last_unstale":"2024-08-18T22:07:11.528548+0000","last_undegraded":"2024-08-18T22:07:11.528548+0000","last_fullsized":"2024-08-18T22:07:11.528548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:17.222658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623177+0000","last_change":"2024-08-18T22:05:21.861745+0000","last_active":"2024-08-18T22:07:11.623177+0000","last_peered":"2024-08-18T22:07:11.623177+0000","last_clean":"2024-08-18T22:07:11.623177+0000","last_became_active":"2024-08-18T22:05:21.861427+0000","last_became_peered":"2024-08-18T22:05:21.861427+0000","last_unstale":"2024-08-18T22:07:11.623177+0000","last_undegraded":"2024-08-18T22:07:11.623177+0000","last_fullsized":"2024-08-18T22:07:11.623177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:17.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623245+0000","last_change":"2024-08-18T22:05:21.860046+0000","last_active":"2024-08-18T22:07:11.623245+0000","last_peered":"2024-08-18T22:07:11.623245+0000","last_clean":"2024-08-18T22:07:11.623245+0000","last_became_active":"2024-08-18T22:05:21.859674+0000","last_became_peered":"2024-08-18T22:05:21.859674+0000","last_unstale":"2024-08-18T22:07:11.623245+0000","last_undegraded":"2024-08-18T22:07:11.623245+0000","last_fullsized":"2024-08-18T22:07:11.623245+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:44.615270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.570548+0000","last_change":"2024-08-18T22:05:21.847647+0000","last_active":"2024-08-18T22:07:11.570548+0000","last_peered":"2024-08-18T22:07:11.570548+0000","last_clean":"2024-08-18T22:07:11.570548+0000","last_became_active":"2024-08-18T22:05:21.847367+0000","last_became_peered":"2024-08-18T22:05:21.847367+0000","last_unstale":"2024-08-18T22:07:11.570548+0000","last_undegraded":"2024-08-18T22:07:11.570548+0000","last_fullsized":"2024-08-18T22:07:11.570548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:33.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573513+0000","last_change":"2024-08-18T22:05:21.861326+0000","last_active":"2024-08-18T22:07:11.573513+0000","last_peered":"2024-08-18T22:07:11.573513+0000","last_clean":"2024-08-18T22:07:11.573513+0000","last_became_active":"2024-08-18T22:05:21.860968+0000","last_became_peered":"2024-08-18T22:05:21.860968+0000","last_unstale":"2024-08-18T22:07:11.573513+0000","last_undegraded":"2024-08-18T22:07:11.573513+0000","last_fullsized":"2024-08-18T22:07:11.573513+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:49.150670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527532+0000","last_change":"2024-08-18T22:05:21.852618+0000","last_active":"2024-08-18T22:07:11.527532+0000","last_peered":"2024-08-18T22:07:11.527532+0000","last_clean":"2024-08-18T22:07:11.527532+0000","last_became_active":"2024-08-18T22:05:21.852318+0000","last_became_peered":"2024-08-18T22:05:21.852318+0000","last_unstale":"2024-08-18T22:07:11.527532+0000","last_undegraded":"2024-08-18T22:07:11.527532+0000","last_fullsized":"2024-08-18T22:07:11.527532+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:06:49.085150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522585+0000","last_change":"2024-08-18T22:05:21.860108+0000","last_active":"2024-08-18T22:07:11.522585+0000","last_peered":"2024-08-18T22:07:11.522585+0000","last_clean":"2024-08-18T22:07:11.522585+0000","last_became_active":"2024-08-18T22:05:21.859794+0000","last_became_peered":"2024-08-18T22:05:21.859794+0000","last_unstale":"2024-08-18T22:07:11.522585+0000","last_undegraded":"2024-08-18T22:07:11.522585+0000","last_fullsized":"2024-08-18T22:07:11.522585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:01.974202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.529519+0000","last_change":"2024-08-18T22:05:21.856404+0000","last_active":"2024-08-18T22:07:11.529519+0000","last_peered":"2024-08-18T22:07:11.529519+0000","last_clean":"2024-08-18T22:07:11.529519+0000","last_became_active":"2024-08-18T22:05:21.855800+0000","last_became_peered":"2024-08-18T22:05:21.855800+0000","last_unstale":"2024-08-18T22:07:11.529519+0000","last_undegraded":"2024-08-18T22:07:11.529519+0000","last_fullsized":"2024-08-18T22:07:11.529519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:09.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.572403+0000","last_change":"2024-08-18T22:05:21.859891+0000","last_active":"2024-08-18T22:07:11.572403+0000","last_peered":"2024-08-18T22:07:11.572403+0000","last_clean":"2024-08-18T22:07:11.572403+0000","last_became_active":"2024-08-18T22:05:21.859407+0000","last_became_peered":"2024-08-18T22:05:21.859407+0000","last_unstale":"2024-08-18T22:07:11.572403+0000","last_undegraded":"2024-08-18T22:07:11.572403+0000","last_fullsized":"2024-08-18T22:07:11.572403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:59.285627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.527094+0000","last_change":"2024-08-18T22:05:21.856428+0000","last_active":"2024-08-18T22:07:11.527094+0000","last_peered":"2024-08-18T22:07:11.527094+0000","last_clean":"2024-08-18T22:07:11.527094+0000","last_became_active":"2024-08-18T22:05:21.853374+0000","last_became_peered":"2024-08-18T22:05:21.853374+0000","last_unstale":"2024-08-18T22:07:11.527094+0000","last_undegraded":"2024-08-18T22:07:11.527094+0000","last_fullsized":"2024-08-18T22:07:11.527094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:07.087171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.522091+0000","last_change":"2024-08-18T22:05:21.852688+0000","last_active":"2024-08-18T22:07:11.522091+0000","last_peered":"2024-08-18T22:07:11.522091+0000","last_clean":"2024-08-18T22:07:11.522091+0000","last_became_active":"2024-08-18T22:05:21.851107+0000","last_became_peered":"2024-08-18T22:05:21.851107+0000","last_unstale":"2024-08-18T22:07:11.522091+0000","last_undegraded":"2024-08-18T22:07:11.522091+0000","last_fullsized":"2024-08-18T22:07:11.522091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:48.267166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.524601+0000","last_change":"2024-08-18T22:05:21.850809+0000","last_active":"2024-08-18T22:07:11.524601+0000","last_peered":"2024-08-18T22:07:11.524601+0000","last_clean":"2024-08-18T22:07:11.524601+0000","last_became_active":"2024-08-18T22:05:21.850510+0000","last_became_peered":"2024-08-18T22:05:21.850510+0000","last_unstale":"2024-08-18T22:07:11.524601+0000","last_undegraded":"2024-08-18T22:07:11.524601+0000","last_fullsized":"2024-08-18T22:07:11.524601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:39.338051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.573466+0000","last_change":"2024-08-18T22:05:21.856156+0000","last_active":"2024-08-18T22:07:11.573466+0000","last_peered":"2024-08-18T22:07:11.573466+0000","last_clean":"2024-08-18T22:07:11.573466+0000","last_became_active":"2024-08-18T22:05:21.855830+0000","last_became_peered":"2024-08-18T22:05:21.855830+0000","last_unstale":"2024-08-18T22:07:11.573466+0000","last_undegraded":"2024-08-18T22:07:11.573466+0000","last_fullsized":"2024-08-18T22:07:11.573466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:10.670405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623466+0000","last_change":"2024-08-18T22:05:21.865162+0000","last_active":"2024-08-18T22:07:11.623466+0000","last_peered":"2024-08-18T22:07:11.623466+0000","last_clean":"2024-08-18T22:07:11.623466+0000","last_became_active":"2024-08-18T22:05:21.864842+0000","last_became_peered":"2024-08-18T22:05:21.864842+0000","last_unstale":"2024-08-18T22:07:11.623466+0000","last_undegraded":"2024-08-18T22:07:11.623466+0000","last_fullsized":"2024-08-18T22:07:11.623466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:21.388638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.623496+0000","last_change":"2024-08-18T22:05:21.859227+0000","last_active":"2024-08-18T22:07:11.623496+0000","last_peered":"2024-08-18T22:07:11.623496+0000","last_clean":"2024-08-18T22:07:11.623496+0000","last_became_active":"2024-08-18T22:05:21.858886+0000","last_became_peered":"2024-08-18T22:05:21.858886+0000","last_unstale":"2024-08-18T22:07:11.623496+0000","last_undegraded":"2024-08-18T22:07:11.623496+0000","last_fullsized":"2024-08-18T22:07:11.623496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:08.710772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-18T22:07:11.526871+0000","last_change":"2024-08-18T22:05:21.854864+0000","last_active":"2024-08-18T22:07:11.526871+0000","last_peered":"2024-08-18T22:07:11.526871+0000","last_clean":"2024-08-18T22:07:11.526871+0000","last_became_active":"2024-08-18T22:05:21.854522+0000","last_became_peered":"2024-08-18T22:05:21.854522+0000","last_unstale":"2024-08-18T22:07:11.526871+0000","last_undegraded":"2024-08-18T22:07:11.526871+0000","last_fullsized":"2024-08-18T22:07:11.526871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:05:20.832621+0000","last_clean_scrub_stamp":"2024-08-18T22:05:20.832621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:32.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73257,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":750,"num_read_kb":450,"num_write":181,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":49092,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":219771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514539,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1052672,"data_stored":523218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743474,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37048,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708104,"statfs":{"total":95995035648,"available":95957098496,"internally_reserved":0,"allocated":1753088,"data_stored":1183698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906998,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":523454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168635,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1069056,"data_stored":523374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397566,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36968,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708184,"statfs":{"total":95995035648,"available":95957180416,"internally_reserved":0,"allocated":1662976,"data_stored":1119954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561092,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":518630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790023,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28656,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716496,"statfs":{"total":95995035648,"available":95965691904,"internally_reserved":0,"allocated":1671168,"data_stored":1115011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953549,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36448,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708704,"statfs":{"total":95995035648,"available":95957712896,"internally_reserved":0,"allocated":1138688,"data_stored":592396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182480,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1060864,"data_stored":518824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":520421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":587125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1073152,"data_stored":520018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:08:00.570 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:08:00.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:00 smithi130 ceph-mon[21698]: pgmap v347: 129 pgs: 129 active+clean; 648 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-18T22:08:00.822 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:00.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:00 smithi183 ceph-mon[22097]: pgmap v347: 129 pgs: 129 active+clean; 648 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-18T22:08:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.352+0000 7f6dc634d640 1 -- 172.21.15.123:0/134309532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc0102250 msgr2=0x7f6dc010e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.352+0000 7f6dc634d640 1 --2- 172.21.15.123:0/134309532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc0102250 0x7f6dc010e780 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009cd0 tx=0x7f6db802a8e0 comp rx=0 tx=0).stop 2024-08-18T22:08:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.352+0000 7f6dc634d640 1 -- 172.21.15.123:0/134309532 shutdown_connections 2024-08-18T22:08:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.352+0000 7f6dc634d640 1 --2- 172.21.15.123:0/134309532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc0102250 0x7f6dc010e780 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.352+0000 7f6dc634d640 1 --2- 172.21.15.123:0/134309532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6dc01018b0 0x7f6dc0101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.352+0000 7f6dc634d640 1 --2- 172.21.15.123:0/134309532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc01078b0 0x7f6dc0107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:01.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.352+0000 7f6dc634d640 1 -- 172.21.15.123:0/134309532 >> 172.21.15.123:0/134309532 conn(0x7f6dc00fd5f0 msgr2=0x7f6dc00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:01.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.352+0000 7f6dc634d640 1 -- 172.21.15.123:0/134309532 shutdown_connections 2024-08-18T22:08:01.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.352+0000 7f6dc634d640 1 -- 172.21.15.123:0/134309532 wait complete. 2024-08-18T22:08:01.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.353+0000 7f6dc634d640 1 Processor -- start 2024-08-18T22:08:01.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.353+0000 7f6dc634d640 1 -- start start 2024-08-18T22:08:01.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.353+0000 7f6dc634d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc01018b0 0x7f6dc019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:01.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.353+0000 7f6dc634d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6dc0102250 0x7f6dc019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:01.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.353+0000 7f6dc634d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc01078b0 0x7f6dc019ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:01.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.353+0000 7f6dc634d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0111cb0 con 0x7f6dc01078b0 2024-08-18T22:08:01.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.353+0000 7f6dc634d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0111b30 con 0x7f6dc0102250 2024-08-18T22:08:01.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.353+0000 7f6dc634d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0111e30 con 0x7f6dc01018b0 2024-08-18T22:08:01.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.353+0000 7f6dc48ea640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc01078b0 0x7f6dc019ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:01.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.353+0000 7f6dc48ea640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc01078b0 0x7f6dc019ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46458/0 (socket says 172.21.15.123:46458) 2024-08-18T22:08:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.353+0000 7f6dc48ea640 1 -- 172.21.15.123:0/907736014 learned_addr learned my addr 172.21.15.123:0/907736014 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.353+0000 7f6dbf7fe640 1 --2- 172.21.15.123:0/907736014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6dc0102250 0x7f6dc019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.353+0000 7f6dbffff640 1 --2- 172.21.15.123:0/907736014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc01018b0 0x7f6dc019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.354+0000 7f6dc48ea640 1 -- 172.21.15.123:0/907736014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc01018b0 msgr2=0x7f6dc019a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.354+0000 7f6dc48ea640 1 --2- 172.21.15.123:0/907736014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc01018b0 0x7f6dc019a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.354+0000 7f6dc48ea640 1 -- 172.21.15.123:0/907736014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6dc0102250 msgr2=0x7f6dc019a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.354+0000 7f6dc48ea640 1 --2- 172.21.15.123:0/907736014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6dc0102250 0x7f6dc019a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.354+0000 7f6dc48ea640 1 -- 172.21.15.123:0/907736014 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc019f350 con 0x7f6dc01078b0 2024-08-18T22:08:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.354+0000 7f6dbffff640 1 --2- 172.21.15.123:0/907736014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc01018b0 0x7f6dc019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:01.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.354+0000 7f6dc48ea640 1 --2- 172.21.15.123:0/907736014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc01078b0 0x7f6dc019ec70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6db8005cc0 tx=0x7f6db8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:01.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.354+0000 7f6dbd7fa640 1 -- 172.21.15.123:0/907736014 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8004040 con 0x7f6dc01078b0 2024-08-18T22:08:01.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.354+0000 7f6dbd7fa640 1 -- 172.21.15.123:0/907736014 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6db80046c0 con 0x7f6dc01078b0 2024-08-18T22:08:01.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.354+0000 7f6dc634d640 1 -- 172.21.15.123:0/907736014 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc019f5e0 con 0x7f6dc01078b0 2024-08-18T22:08:01.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.354+0000 7f6dbd7fa640 1 -- 172.21.15.123:0/907736014 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8046480 con 0x7f6dc01078b0 2024-08-18T22:08:01.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.354+0000 7f6dc634d640 1 -- 172.21.15.123:0/907736014 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc01a6f20 con 0x7f6dc01078b0 2024-08-18T22:08:01.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.355+0000 7f6dc634d640 1 -- 172.21.15.123:0/907736014 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc0101d10 con 0x7f6dc01078b0 2024-08-18T22:08:01.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.356+0000 7f6dbd7fa640 1 -- 172.21.15.123:0/907736014 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f6db80305a0 con 0x7f6dc01078b0 2024-08-18T22:08:01.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.357+0000 7f6dbd7fa640 1 --2- 172.21.15.123:0/907736014 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6dac0a2b80 0x7f6dac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:01.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.357+0000 7f6dbffff640 1 --2- 172.21.15.123:0/907736014 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6dac0a2b80 0x7f6dac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:01.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.357+0000 7f6dbd7fa640 1 -- 172.21.15.123:0/907736014 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f6db802e030 con 0x7f6dc01078b0 2024-08-18T22:08:01.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.357+0000 7f6dbffff640 1 --2- 172.21.15.123:0/907736014 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6dac0a2b80 0x7f6dac0a5040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6db0005d70 tx=0x7f6db0005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:01.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.360+0000 7f6dbd7fa640 1 -- 172.21.15.123:0/907736014 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6db804b060 con 0x7f6dc01078b0 2024-08-18T22:08:01.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.564+0000 7f6dc634d640 1 -- 172.21.15.123:0/907736014 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6dc01a7150 con 0x7f6dc01078b0 2024-08-18T22:08:01.565 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:01 smithi123 ceph-mon[18462]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:08:01.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.565+0000 7f6dbd7fa640 1 -- 172.21.15.123:0/907736014 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7f6db80bd920 con 0x7f6dc01078b0 2024-08-18T22:08:01.566 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:08:01.567 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"btime":"2024-08-18T22:07:46:492460+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:07:45.601053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:08:01.567 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 26 2024-08-18T22:08:01.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.567+0000 7f6dc634d640 1 -- 172.21.15.123:0/907736014 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6dac0a2b80 msgr2=0x7f6dac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:01.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.567+0000 7f6dc634d640 1 --2- 172.21.15.123:0/907736014 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6dac0a2b80 0x7f6dac0a5040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6db0005d70 tx=0x7f6db0005d00 comp rx=0 tx=0).stop 2024-08-18T22:08:01.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.567+0000 7f6dc634d640 1 -- 172.21.15.123:0/907736014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc01078b0 msgr2=0x7f6dc019ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:01.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.567+0000 7f6dc634d640 1 --2- 172.21.15.123:0/907736014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc01078b0 0x7f6dc019ec70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6db8005cc0 tx=0x7f6db8003970 comp rx=0 tx=0).stop 2024-08-18T22:08:01.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.567+0000 7f6dc634d640 1 -- 172.21.15.123:0/907736014 shutdown_connections 2024-08-18T22:08:01.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.567+0000 7f6dc634d640 1 --2- 172.21.15.123:0/907736014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc01078b0 0x7f6dc019ec70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:01.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.567+0000 7f6dc634d640 1 --2- 172.21.15.123:0/907736014 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6dac0a2b80 0x7f6dac0a5040 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:01.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.567+0000 7f6dc634d640 1 --2- 172.21.15.123:0/907736014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6dc0102250 0x7f6dc019a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:01.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.567+0000 7f6dc634d640 1 --2- 172.21.15.123:0/907736014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc01018b0 0x7f6dc019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:01.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.567+0000 7f6dc634d640 1 -- 172.21.15.123:0/907736014 >> 172.21.15.123:0/907736014 conn(0x7f6dc00fd5f0 msgr2=0x7f6dc010cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:01.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.567+0000 7f6dc634d640 1 -- 172.21.15.123:0/907736014 shutdown_connections 2024-08-18T22:08:01.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:01.567+0000 7f6dc634d640 1 -- 172.21.15.123:0/907736014 wait complete. 2024-08-18T22:08:01.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:01 smithi130 ceph-mon[21698]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:08:01.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:01 smithi183 ceph-mon[22097]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:08:02.271 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:08:02.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:02 smithi123 ceph-mon[18462]: pgmap v348: 129 pgs: 129 active+clean; 648 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-18T22:08:02.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:02 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/907736014' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:08:02.522 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:02.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:02 smithi130 ceph-mon[21698]: pgmap v348: 129 pgs: 129 active+clean; 648 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-18T22:08:02.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:02 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/907736014' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:08:02.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:02 smithi183 ceph-mon[22097]: pgmap v348: 129 pgs: 129 active+clean; 648 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-18T22:08:02.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:02 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/907736014' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:08:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.015+0000 7ff7db18c640 1 -- 172.21.15.123:0/4217215530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d4101150 msgr2=0x7ff7d410d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.015+0000 7ff7db18c640 1 --2- 172.21.15.123:0/4217215530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d4101150 0x7ff7d410d680 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009cd0 tx=0x7ff7cc02a8e0 comp rx=0 tx=0).stop 2024-08-18T22:08:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.015+0000 7ff7db18c640 1 -- 172.21.15.123:0/4217215530 shutdown_connections 2024-08-18T22:08:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.015+0000 7ff7db18c640 1 --2- 172.21.15.123:0/4217215530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d4101150 0x7ff7d410d680 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.015+0000 7ff7db18c640 1 --2- 172.21.15.123:0/4217215530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7d41007b0 0x7ff7d4100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.015+0000 7ff7db18c640 1 --2- 172.21.15.123:0/4217215530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7d41067b0 0x7ff7d4106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.015+0000 7ff7db18c640 1 -- 172.21.15.123:0/4217215530 >> 172.21.15.123:0/4217215530 conn(0x7ff7d40fc4d0 msgr2=0x7ff7d40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.016+0000 7ff7db18c640 1 -- 172.21.15.123:0/4217215530 shutdown_connections 2024-08-18T22:08:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.016+0000 7ff7db18c640 1 -- 172.21.15.123:0/4217215530 wait complete. 2024-08-18T22:08:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.016+0000 7ff7db18c640 1 Processor -- start 2024-08-18T22:08:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.016+0000 7ff7db18c640 1 -- start start 2024-08-18T22:08:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.016+0000 7ff7db18c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7d41007b0 0x7ff7d40fcb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.016+0000 7ff7db18c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d4101150 0x7ff7d40fd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.016+0000 7ff7db18c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7d41067b0 0x7ff7d40fd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.016+0000 7ff7db18c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d4110c50 con 0x7ff7d4101150 2024-08-18T22:08:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.016+0000 7ff7db18c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d4110ad0 con 0x7ff7d41007b0 2024-08-18T22:08:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.016+0000 7ff7db18c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d4110dd0 con 0x7ff7d41067b0 2024-08-18T22:08:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.016+0000 7ff7d3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d4101150 0x7ff7d40fd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7d3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d4101150 0x7ff7d40fd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44124/0 (socket says 172.21.15.123:44124) 2024-08-18T22:08:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7d3fff640 1 -- 172.21.15.123:0/3499018465 learned_addr learned my addr 172.21.15.123:0/3499018465 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7d9729640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7d41067b0 0x7ff7d40fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7d8f28640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7d41007b0 0x7ff7d40fcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:03.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7d3fff640 1 -- 172.21.15.123:0/3499018465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7d41067b0 msgr2=0x7ff7d40fd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7d3fff640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7d41067b0 0x7ff7d40fd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7d3fff640 1 -- 172.21.15.123:0/3499018465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7d41007b0 msgr2=0x7ff7d40fcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7d3fff640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7d41007b0 0x7ff7d40fcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7d3fff640 1 -- 172.21.15.123:0/3499018465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d41a6720 con 0x7ff7d4101150 2024-08-18T22:08:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7d8f28640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7d41007b0 0x7ff7d40fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7d9729640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7d41067b0 0x7ff7d40fd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7d3fff640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d4101150 0x7ff7d40fd0c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800b4a0 tx=0x7ff7c800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7d1ffb640 1 -- 172.21.15.123:0/3499018465 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8014070 con 0x7ff7d4101150 2024-08-18T22:08:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7d1ffb640 1 -- 172.21.15.123:0/3499018465 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7c8010af0 con 0x7ff7d4101150 2024-08-18T22:08:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7db18c640 1 -- 172.21.15.123:0/3499018465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7d41a6a10 con 0x7ff7d4101150 2024-08-18T22:08:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7d1ffb640 1 -- 172.21.15.123:0/3499018465 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8017d10 con 0x7ff7d4101150 2024-08-18T22:08:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.017+0000 7ff7db18c640 1 -- 172.21.15.123:0/3499018465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d41a6f50 con 0x7ff7d4101150 2024-08-18T22:08:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.018+0000 7ff7db18c640 1 -- 172.21.15.123:0/3499018465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7d4100c90 con 0x7ff7d4101150 2024-08-18T22:08:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.019+0000 7ff7d1ffb640 1 -- 172.21.15.123:0/3499018465 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7ff7c8017070 con 0x7ff7d4101150 2024-08-18T22:08:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.020+0000 7ff7d1ffb640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff7bc0a2b80 0x7ff7bc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.020+0000 7ff7d8f28640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff7bc0a2b80 0x7ff7bc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.020+0000 7ff7d1ffb640 1 -- 172.21.15.123:0/3499018465 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ff7c80ce850 con 0x7ff7d4101150 2024-08-18T22:08:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.020+0000 7ff7d8f28640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff7bc0a2b80 0x7ff7bc0a5040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009930 tx=0x7ff7c4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.024+0000 7ff7d1ffb640 1 -- 172.21.15.123:0/3499018465 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff7c809b420 con 0x7ff7d4101150 2024-08-18T22:08:03.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.224+0000 7ff7db18c640 1 -- 172.21.15.123:0/3499018465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7d4109d50 con 0x7ff7d4101150 2024-08-18T22:08:03.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.224+0000 7ff7d1ffb640 1 -- 172.21.15.123:0/3499018465 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7ff7c809ad20 con 0x7ff7d4101150 2024-08-18T22:08:03.226 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:08:03.226 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"btime":"2024-08-18T22:07:46:492460+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:07:45.601053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:08:03.226 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 26 2024-08-18T22:08:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.227+0000 7ff7db18c640 1 -- 172.21.15.123:0/3499018465 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff7bc0a2b80 msgr2=0x7ff7bc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.227+0000 7ff7db18c640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff7bc0a2b80 0x7ff7bc0a5040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009930 tx=0x7ff7c4008040 comp rx=0 tx=0).stop 2024-08-18T22:08:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.227+0000 7ff7db18c640 1 -- 172.21.15.123:0/3499018465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d4101150 msgr2=0x7ff7d40fd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.227+0000 7ff7db18c640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d4101150 0x7ff7d40fd0c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800b4a0 tx=0x7ff7c800b960 comp rx=0 tx=0).stop 2024-08-18T22:08:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.227+0000 7ff7db18c640 1 -- 172.21.15.123:0/3499018465 shutdown_connections 2024-08-18T22:08:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.227+0000 7ff7db18c640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7d41067b0 0x7ff7d40fd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.227+0000 7ff7db18c640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d4101150 0x7ff7d40fd0c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.227+0000 7ff7db18c640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff7bc0a2b80 0x7ff7bc0a5040 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.227+0000 7ff7db18c640 1 --2- 172.21.15.123:0/3499018465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7d41007b0 0x7ff7d40fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.227+0000 7ff7db18c640 1 -- 172.21.15.123:0/3499018465 >> 172.21.15.123:0/3499018465 conn(0x7ff7d40fc4d0 msgr2=0x7ff7d406a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.227+0000 7ff7db18c640 1 -- 172.21.15.123:0/3499018465 shutdown_connections 2024-08-18T22:08:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:03.227+0000 7ff7db18c640 1 -- 172.21.15.123:0/3499018465 wait complete. 2024-08-18T22:08:03.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:03 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3499018465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:08:03.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:03 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3499018465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:08:03.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:03 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3499018465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:08:03.945 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:08:04.193 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:04.596 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:04 smithi123 ceph-mon[18462]: pgmap v349: 129 pgs: 129 active+clean; 648 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-18T22:08:04.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.674+0000 7f974f91a640 1 -- 172.21.15.123:0/266248006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97481078b0 msgr2=0x7f9748107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:04.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.674+0000 7f974f91a640 1 --2- 172.21.15.123:0/266248006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97481078b0 0x7f9748107c90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9744009930 tx=0x7f974402a420 comp rx=0 tx=0).stop 2024-08-18T22:08:04.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.674+0000 7f974f91a640 1 -- 172.21.15.123:0/266248006 shutdown_connections 2024-08-18T22:08:04.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.674+0000 7f974f91a640 1 --2- 172.21.15.123:0/266248006 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9748102250 0x7f974810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:04.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.674+0000 7f974f91a640 1 --2- 172.21.15.123:0/266248006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97481018b0 0x7f9748101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:04.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.674+0000 7f974f91a640 1 --2- 172.21.15.123:0/266248006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97481078b0 0x7f9748107c90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:04.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.674+0000 7f974f91a640 1 -- 172.21.15.123:0/266248006 >> 172.21.15.123:0/266248006 conn(0x7f97480fd5f0 msgr2=0x7f97480ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:04.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.674+0000 7f974f91a640 1 -- 172.21.15.123:0/266248006 shutdown_connections 2024-08-18T22:08:04.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.674+0000 7f974f91a640 1 -- 172.21.15.123:0/266248006 wait complete. 2024-08-18T22:08:04.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.674+0000 7f974f91a640 1 Processor -- start 2024-08-18T22:08:04.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.674+0000 7f974f91a640 1 -- start start 2024-08-18T22:08:04.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.674+0000 7f974f91a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97481018b0 0x7f9748198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:04.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.674+0000 7f974f91a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9748102250 0x7f9748198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:04.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.674+0000 7f974f91a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97481078b0 0x7f974819ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:04.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974f91a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9748111cb0 con 0x7f97481078b0 2024-08-18T22:08:04.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974f91a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9748111b30 con 0x7f9748102250 2024-08-18T22:08:04.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974f91a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9748111e30 con 0x7f97481018b0 2024-08-18T22:08:04.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974deb7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97481078b0 0x7f974819ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:04.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974deb7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97481078b0 0x7f974819ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44146/0 (socket says 172.21.15.123:44146) 2024-08-18T22:08:04.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974deb7640 1 -- 172.21.15.123:0/1594831797 learned_addr learned my addr 172.21.15.123:0/1594831797 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:04.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974d6b6640 1 --2- 172.21.15.123:0/1594831797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97481018b0 0x7f9748198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:04.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974ceb5640 1 --2- 172.21.15.123:0/1594831797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9748102250 0x7f9748198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:04.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974deb7640 1 -- 172.21.15.123:0/1594831797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97481018b0 msgr2=0x7f9748198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:04.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974deb7640 1 --2- 172.21.15.123:0/1594831797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97481018b0 0x7f9748198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:04.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974deb7640 1 -- 172.21.15.123:0/1594831797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9748102250 msgr2=0x7f9748198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974deb7640 1 --2- 172.21.15.123:0/1594831797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9748102250 0x7f9748198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974deb7640 1 -- 172.21.15.123:0/1594831797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974819d0e0 con 0x7f97481078b0 2024-08-18T22:08:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974deb7640 1 --2- 172.21.15.123:0/1594831797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97481078b0 0x7f974819ca00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f974000eaa0 tx=0x7f974000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f973e7fc640 1 -- 172.21.15.123:0/1594831797 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974000cdb0 con 0x7f97481078b0 2024-08-18T22:08:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974f91a640 1 -- 172.21.15.123:0/1594831797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974819d3d0 con 0x7f97481078b0 2024-08-18T22:08:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f973e7fc640 1 -- 172.21.15.123:0/1594831797 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9740005020 con 0x7f97481078b0 2024-08-18T22:08:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f973e7fc640 1 -- 172.21.15.123:0/1594831797 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97400116b0 con 0x7f97481078b0 2024-08-18T22:08:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.675+0000 7f974f91a640 1 -- 172.21.15.123:0/1594831797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97481a4cb0 con 0x7f97481078b0 2024-08-18T22:08:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.676+0000 7f974f91a640 1 -- 172.21.15.123:0/1594831797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9748101d10 con 0x7f97481078b0 2024-08-18T22:08:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.677+0000 7f973e7fc640 1 -- 172.21.15.123:0/1594831797 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f9740005560 con 0x7f97481078b0 2024-08-18T22:08:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.678+0000 7f973e7fc640 1 --2- 172.21.15.123:0/1594831797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f97340a2b80 0x7f97340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.678+0000 7f974d6b6640 1 --2- 172.21.15.123:0/1594831797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f97340a2b80 0x7f97340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.678+0000 7f973e7fc640 1 -- 172.21.15.123:0/1594831797 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f97400cf500 con 0x7f97481078b0 2024-08-18T22:08:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.679+0000 7f974d6b6640 1 --2- 172.21.15.123:0/1594831797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f97340a2b80 0x7f97340a5040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9744009900 tx=0x7f97440058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:04.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.682+0000 7f973e7fc640 1 -- 172.21.15.123:0/1594831797 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9740016030 con 0x7f97481078b0 2024-08-18T22:08:04.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:04 smithi130 ceph-mon[21698]: pgmap v349: 129 pgs: 129 active+clean; 648 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-18T22:08:04.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.849+0000 7f974f91a640 1 -- 172.21.15.123:0/1594831797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9748109890 con 0x7f97481078b0 2024-08-18T22:08:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.851+0000 7f973e7fc640 1 -- 172.21.15.123:0/1594831797 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24810 (secure 0 0 0) 0x7f974009ba80 con 0x7f97481078b0 2024-08-18T22:08:04.853 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:08:04.853 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":92,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:07:11.513362+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:05:18.077632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:05:20.808463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:05:27.136662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:08:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.853+0000 7f974f91a640 1 -- 172.21.15.123:0/1594831797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f97340a2b80 msgr2=0x7f97340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.853+0000 7f974f91a640 1 --2- 172.21.15.123:0/1594831797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f97340a2b80 0x7f97340a5040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9744009900 tx=0x7f97440058d0 comp rx=0 tx=0).stop 2024-08-18T22:08:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.853+0000 7f974f91a640 1 -- 172.21.15.123:0/1594831797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97481078b0 msgr2=0x7f974819ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.853+0000 7f974f91a640 1 --2- 172.21.15.123:0/1594831797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97481078b0 0x7f974819ca00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f974000eaa0 tx=0x7f974000ef60 comp rx=0 tx=0).stop 2024-08-18T22:08:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.853+0000 7f974f91a640 1 -- 172.21.15.123:0/1594831797 shutdown_connections 2024-08-18T22:08:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.853+0000 7f974f91a640 1 --2- 172.21.15.123:0/1594831797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97481078b0 0x7f974819ca00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.853+0000 7f974f91a640 1 --2- 172.21.15.123:0/1594831797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f97340a2b80 0x7f97340a5040 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:04.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.853+0000 7f974f91a640 1 --2- 172.21.15.123:0/1594831797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9748102250 0x7f9748198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:04.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.853+0000 7f974f91a640 1 --2- 172.21.15.123:0/1594831797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97481018b0 0x7f9748198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:04.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.853+0000 7f974f91a640 1 -- 172.21.15.123:0/1594831797 >> 172.21.15.123:0/1594831797 conn(0x7f97480fd5f0 msgr2=0x7f97480fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:04.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.853+0000 7f974f91a640 1 -- 172.21.15.123:0/1594831797 shutdown_connections 2024-08-18T22:08:04.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:04.853+0000 7f974f91a640 1 -- 172.21.15.123:0/1594831797 wait complete. 2024-08-18T22:08:04.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:04 smithi183 ceph-mon[22097]: pgmap v349: 129 pgs: 129 active+clean; 648 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-18T22:08:05.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:05 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1594831797' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:08:05.538 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-08-18T22:08:05.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:05 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1594831797' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:08:05.787 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:05.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:05 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1594831797' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:08:06.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:06 smithi123 ceph-mon[18462]: pgmap v350: 129 pgs: 129 active+clean; 648 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-08-18T22:08:06.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:06 smithi130 ceph-mon[21698]: pgmap v350: 129 pgs: 129 active+clean; 648 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-08-18T22:08:06.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:06 smithi183 ceph-mon[22097]: pgmap v350: 129 pgs: 129 active+clean; 648 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-08-18T22:08:07.012 INFO:teuthology.orchestra.run.smithi123.stdout:{"run_dir":"/var/run/ceph"} 2024-08-18T22:08:07.012 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-08-18T22:08:07.013 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1664 2024-08-18T22:08:07.013 DEBUG:tasks.quiescer:Yielding 2024-08-18T22:08:07.013 INFO:teuthology.run_tasks:Running task workunit... 2024-08-18T22:08:07.028 INFO:tasks.workunit:Pulling workunits from ref 78215f5a1cf5eaf321d506a66539942e12851f34 2024-08-18T22:08:07.029 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-18T22:08:07.029 INFO:tasks.workunit:timeout=3h 2024-08-18T22:08:07.029 INFO:tasks.workunit:cleanup=True 2024-08-18T22:08:07.029 DEBUG:teuthology.orchestra.run.smithi123:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-18T22:08:07.030 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:08:07.046 INFO:teuthology.orchestra.run.smithi123.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-18T22:08:07.046 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-08-18T22:08:07.046 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 79h/121d Inode: 1099511628283 Links: 2 2024-08-18T22:08:07.046 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:08:07.046 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-08-18T22:08:07.046 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-08-18 22:06:07.381822873 +0000 2024-08-18T22:08:07.046 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-08-18 22:06:07.381822873 +0000 2024-08-18T22:08:07.047 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-08-18 22:07:44.940007907 +0000 2024-08-18T22:08:07.047 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-08-18 22:06:07.381822873 +0000 2024-08-18T22:08:07.047 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-18T22:08:07.047 DEBUG:teuthology.orchestra.run.smithi123:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-18T22:08:07.121 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 78215f5a1cf5eaf321d506a66539942e12851f34 2024-08-18T22:08:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.120+0000 7f0e978ef640 1 -- 172.21.15.123:0/3783955345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e90102bd0 msgr2=0x7f0e90103050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.120+0000 7f0e978ef640 1 --2- 172.21.15.123:0/3783955345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e90102bd0 0x7f0e90103050 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0e80009900 tx=0x7f0e8002a410 comp rx=0 tx=0).stop 2024-08-18T22:08:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.120+0000 7f0e978ef640 1 -- 172.21.15.123:0/3783955345 shutdown_connections 2024-08-18T22:08:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.120+0000 7f0e978ef640 1 --2- 172.21.15.123:0/3783955345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e90103590 0x7f0e90109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.120+0000 7f0e978ef640 1 --2- 172.21.15.123:0/3783955345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e90102bd0 0x7f0e90103050 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.120+0000 7f0e978ef640 1 --2- 172.21.15.123:0/3783955345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e900ffb60 0x7f0e900fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.120+0000 7f0e978ef640 1 -- 172.21.15.123:0/3783955345 >> 172.21.15.123:0/3783955345 conn(0x7f0e900fb660 msgr2=0x7f0e900fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.120+0000 7f0e978ef640 1 -- 172.21.15.123:0/3783955345 shutdown_connections 2024-08-18T22:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.120+0000 7f0e978ef640 1 -- 172.21.15.123:0/3783955345 wait complete. 2024-08-18T22:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e978ef640 1 Processor -- start 2024-08-18T22:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e978ef640 1 -- start start 2024-08-18T22:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e978ef640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e900ffb60 0x7f0e90197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e978ef640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e90102bd0 0x7f0e90198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e978ef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e90103590 0x7f0e9019f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e978ef640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9010d540 con 0x7f0e90103590 2024-08-18T22:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e978ef640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9010d3c0 con 0x7f0e900ffb60 2024-08-18T22:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e978ef640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9010d6c0 con 0x7f0e90102bd0 2024-08-18T22:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e95e8c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e90103590 0x7f0e9019f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e95e8c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e90103590 0x7f0e9019f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44156/0 (socket says 172.21.15.123:44156) 2024-08-18T22:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e95e8c640 1 -- 172.21.15.123:0/159536331 learned_addr learned my addr 172.21.15.123:0/159536331 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e94e8a640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e90102bd0 0x7f0e90198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e9568b640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e900ffb60 0x7f0e90197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e95e8c640 1 -- 172.21.15.123:0/159536331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e90102bd0 msgr2=0x7f0e90198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e95e8c640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e90102bd0 0x7f0e90198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e95e8c640 1 -- 172.21.15.123:0/159536331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e900ffb60 msgr2=0x7f0e90197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e95e8c640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e900ffb60 0x7f0e90197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e95e8c640 1 -- 172.21.15.123:0/159536331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9019f730 con 0x7f0e90103590 2024-08-18T22:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e9568b640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e900ffb60 0x7f0e90197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e94e8a640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e90102bd0 0x7f0e90198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.121+0000 7f0e95e8c640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e90103590 0x7f0e9019f0c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800eb10 tx=0x7f0e8800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.122+0000 7f0e867fc640 1 -- 172.21.15.123:0/159536331 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88004b20 con 0x7f0e90103590 2024-08-18T22:08:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.122+0000 7f0e978ef640 1 -- 172.21.15.123:0/159536331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e9019fa20 con 0x7f0e90103590 2024-08-18T22:08:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.122+0000 7f0e867fc640 1 -- 172.21.15.123:0/159536331 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e88004cc0 con 0x7f0e90103590 2024-08-18T22:08:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.122+0000 7f0e867fc640 1 -- 172.21.15.123:0/159536331 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88010760 con 0x7f0e90103590 2024-08-18T22:08:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.122+0000 7f0e978ef640 1 -- 172.21.15.123:0/159536331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e9019fef0 con 0x7f0e90103590 2024-08-18T22:08:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.124+0000 7f0e9a6a3740 1 Processor -- start 2024-08-18T22:08:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.124+0000 7f0e867fc640 1 -- 172.21.15.123:0/159536331 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f0e88005020 con 0x7f0e90103590 2024-08-18T22:08:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9a6a3740 1 -- start start 2024-08-18T22:08:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9a6a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a12a90 0x5629a4a12e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9a6a3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a133d0 0x5629a4a17e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9a6a3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a18460 0x5629a4a1a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9a6a3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5629a49719d0 con 0x5629a4a133d0 2024-08-18T22:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9a6a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5629a4919820 con 0x5629a4a12a90 2024-08-18T22:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9a6a3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5629a496d990 con 0x5629a4a18460 2024-08-18T22:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9568b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a133d0 0x5629a4a17e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9568b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a133d0 0x5629a4a17e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44166/0 (socket says 172.21.15.123:44166) 2024-08-18T22:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9568b640 1 -- 172.21.15.123:0/3354661446 learned_addr learned my addr 172.21.15.123:0/3354661446 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e94e8a640 1 --2- 172.21.15.123:0/3354661446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a12a90 0x5629a4a12e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e94e8a640 1 --2- 172.21.15.123:0/3354661446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a18460 0x5629a4a1a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9568b640 1 -- 172.21.15.123:0/3354661446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a18460 msgr2=0x5629a4a1a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9568b640 1 --2- 172.21.15.123:0/3354661446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a18460 0x5629a4a1a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9568b640 1 -- 172.21.15.123:0/3354661446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a12a90 msgr2=0x5629a4a12e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9568b640 1 --2- 172.21.15.123:0/3354661446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a12a90 0x5629a4a12e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9568b640 1 -- 172.21.15.123:0/3354661446 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629a4685210 con 0x5629a4a133d0 2024-08-18T22:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.125+0000 7f0e9568b640 1 --2- 172.21.15.123:0/3354661446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a133d0 0x5629a4a17e90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009cd0 tx=0x7f0e8c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de40217a0faed160 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.126+0000 7f0e867fc640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0e7c0a2c30 0x7f0e7c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.126+0000 7f0e7b7fe640 1 -- 172.21.15.123:0/3354661446 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c012450 con 0x5629a4a133d0 2024-08-18T22:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.126+0000 7f0e94e8a640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0e7c0a2c30 0x7f0e7c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.126+0000 7f0e7b7fe640 1 -- 172.21.15.123:0/3354661446 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e8c012ad0 con 0x5629a4a133d0 2024-08-18T22:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.126+0000 7f0e7b7fe640 1 -- 172.21.15.123:0/3354661446 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00fcc0 con 0x5629a4a133d0 2024-08-18T22:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.126+0000 7f0e867fc640 1 -- 172.21.15.123:0/159536331 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0e880cfab0 con 0x7f0e90103590 2024-08-18T22:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.127+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/3354661446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a133d0 msgr2=0x5629a4a17e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.127+0000 7f0e94e8a640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0e7c0a2c30 0x7f0e7c0a50f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0e80006010 tx=0x7f0e80000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.127+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/3354661446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a133d0 0x5629a4a17e90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009cd0 tx=0x7f0e8c0117b0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.127+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/3354661446 shutdown_connections 2024-08-18T22:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.127+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/3354661446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a18460 0x5629a4a1a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.127+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/3354661446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a133d0 0x5629a4a17e90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.127+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/3354661446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a12a90 0x5629a4a12e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.127+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/3354661446 >> 172.21.15.123:0/3354661446 conn(0x5629a4a09cf0 msgr2=0x5629a4a0a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.127+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/3354661446 shutdown_connections 2024-08-18T22:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.127+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/3354661446 wait complete. 2024-08-18T22:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.127+0000 7f0e9a6a3740 1 -- start start 2024-08-18T22:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.127+0000 7f0e9a6a3740 1 Processor -- start 2024-08-18T22:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e9a6a3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a12a90 0x5629a4a1cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e9a6a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a133d0 0x5629a4a1d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e9a6a3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a18460 0x5629a4a24130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e9a6a3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5629a4a1b430 con 0x5629a4a18460 2024-08-18T22:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e9a6a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5629a492d520 con 0x5629a4a133d0 2024-08-18T22:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e9a6a3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5629a4a1b5b0 con 0x5629a4a12a90 2024-08-18T22:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e9a6a3740 10 client.0 _ll_register_callbacks cb 0x5629a4684a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e95e8c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a18460 0x5629a4a24130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e95e8c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a18460 0x5629a4a24130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44180/0 (socket says 172.21.15.123:44180) 2024-08-18T22:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e95e8c640 1 -- 172.21.15.123:0/486306537 learned_addr learned my addr 172.21.15.123:0/486306537 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e94e8a640 1 --2- 172.21.15.123:0/486306537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a133d0 0x5629a4a1d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e9568b640 1 --2- 172.21.15.123:0/486306537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a12a90 0x5629a4a1cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e95e8c640 1 -- 172.21.15.123:0/486306537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a12a90 msgr2=0x5629a4a1cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e95e8c640 1 --2- 172.21.15.123:0/486306537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a12a90 0x5629a4a1cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e95e8c640 1 -- 172.21.15.123:0/486306537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a133d0 msgr2=0x5629a4a1d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e95e8c640 1 --2- 172.21.15.123:0/486306537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a133d0 0x5629a4a1d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e95e8c640 1 -- 172.21.15.123:0/486306537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629a4751620 con 0x5629a4a18460 2024-08-18T22:08:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e9568b640 1 --2- 172.21.15.123:0/486306537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a12a90 0x5629a4a1cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e94e8a640 1 --2- 172.21.15.123:0/486306537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a133d0 0x5629a4a1d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e95e8c640 1 --2- 172.21.15.123:0/486306537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a18460 0x5629a4a24130 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0e880a46c0 tx=0x7f0e8809b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8cc0bd71530c04 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.128+0000 7f0e78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.129+0000 7f0e78ff9640 1 -- 172.21.15.123:0/486306537 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e880a4960 con 0x5629a4a18460 2024-08-18T22:08:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.129+0000 7f0e78ff9640 1 -- 172.21.15.123:0/486306537 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0e880babc0 con 0x5629a4a18460 2024-08-18T22:08:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.129+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/486306537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e8c012ad0 con 0x5629a4a18460 2024-08-18T22:08:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.129+0000 7f0e78ff9640 1 -- 172.21.15.123:0/486306537 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0e880a0330 con 0x5629a4a18460 2024-08-18T22:08:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.129+0000 7f0e9a6a3740 10 client.15381 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.129+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/486306537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5629a4a26ff0 con 0x5629a4a18460 2024-08-18T22:08:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.129+0000 7f0e78ff9640 1 -- 172.21.15.123:0/486306537 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e880b6020 con 0x5629a4a18460 2024-08-18T22:08:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.129+0000 7f0e78ff9640 1 -- 172.21.15.123:0/486306537 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f0e8809b3d0 con 0x5629a4a18460 2024-08-18T22:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.129+0000 7f0e9a6a3740 10 client.15381 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.129+0000 7f0e9a6a3740 10 client.15381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.129+0000 7f0e9a6a3740 20 client.15381 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.129+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/486306537 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5629a4a286e0 0x5629a4a2aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.129+0000 7f0e9a6a3740 4 client.15381 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.129+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/486306537 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629a497f100 con 0x5629a4a286e0 2024-08-18T22:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.130+0000 7f0e9568b640 1 --2- 172.21.15.123:0/486306537 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5629a4a286e0 0x5629a4a2aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.130+0000 7f0e78ff9640 10 client.15381 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.130+0000 7f0e9568b640 1 --2- 172.21.15.123:0/486306537 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5629a4a286e0 0x5629a4a2aaf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64f194004c9277c9 server_cookie=8d5fe23b6e7e3442 in_seq=0 out_seq=0 2024-08-18T22:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.131+0000 7f0e78ff9640 1 -- 172.21.15.123:0/486306537 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5629a497f100 con 0x5629a4a286e0 2024-08-18T22:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.131+0000 7f0e78ff9640 10 client.15381 handle_command_reply: tid=0 2024-08-18T22:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.131+0000 7f0e9a6a3740 1 client.15381 shutdown 2024-08-18T22:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.131+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/486306537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a18460 msgr2=0x5629a4a24130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.131+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/486306537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a18460 0x5629a4a24130 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0e880a46c0 tx=0x7f0e8809b9a0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.131+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/486306537 shutdown_connections 2024-08-18T22:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.131+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/486306537 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5629a4a286e0 0x5629a4a2aaf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.131+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/486306537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a18460 0x5629a4a24130 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.131+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/486306537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a133d0 0x5629a4a1d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.131+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/486306537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a12a90 0x5629a4a1cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.131+0000 7f0e78ff9640 0 client.15381 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.131+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/486306537 >> 172.21.15.123:0/486306537 conn(0x5629a4a09cf0 msgr2=0x5629a4a0b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.131+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/486306537 shutdown_connections 2024-08-18T22:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.131+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/486306537 wait complete. 2024-08-18T22:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.131+0000 7f0e9a6a3740 20 client.15381 trim_cache size 0 max 16384 2024-08-18T22:08:07.141 INFO:tasks.workunit.client.0.smithi123.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-18T22:08:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.146+0000 7f0e9a6a3740 1 Processor -- start 2024-08-18T22:08:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.146+0000 7f0e9a6a3740 1 -- start start 2024-08-18T22:08:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.146+0000 7f0e9a6a3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a12a90 0x5629a4a08d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.146+0000 7f0e9a6a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a133d0 0x5629a4a240f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.146+0000 7f0e9a6a3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a18460 0x5629a4a2f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.146+0000 7f0e9a6a3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0e901aaad0 con 0x5629a4a18460 2024-08-18T22:08:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.146+0000 7f0e9a6a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0e901a83a0 con 0x5629a4a133d0 2024-08-18T22:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.146+0000 7f0e9a6a3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0e901a61f0 con 0x5629a4a12a90 2024-08-18T22:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.146+0000 7f0e95e8c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a18460 0x5629a4a2f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.146+0000 7f0e95e8c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a18460 0x5629a4a2f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44192/0 (socket says 172.21.15.123:44192) 2024-08-18T22:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.146+0000 7f0e9568b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a12a90 0x5629a4a08d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.146+0000 7f0e95e8c640 1 -- 172.21.15.123:0/662756153 learned_addr learned my addr 172.21.15.123:0/662756153 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.147+0000 7f0e94e8a640 1 --2- 172.21.15.123:0/662756153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a133d0 0x5629a4a240f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.147+0000 7f0e9568b640 1 -- 172.21.15.123:0/662756153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a133d0 msgr2=0x5629a4a240f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.147+0000 7f0e9568b640 1 --2- 172.21.15.123:0/662756153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a133d0 0x5629a4a240f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.147+0000 7f0e9568b640 1 -- 172.21.15.123:0/662756153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a18460 msgr2=0x5629a4a2f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.147+0000 7f0e9568b640 1 --2- 172.21.15.123:0/662756153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a18460 0x5629a4a2f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.147+0000 7f0e9568b640 1 -- 172.21.15.123:0/662756153 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629a4a09b10 con 0x5629a4a12a90 2024-08-18T22:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.147+0000 7f0e94e8a640 1 --2- 172.21.15.123:0/662756153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a133d0 0x5629a4a240f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.147+0000 7f0e95e8c640 1 --2- 172.21.15.123:0/662756153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a18460 0x5629a4a2f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.147+0000 7f0e9568b640 1 --2- 172.21.15.123:0/662756153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a12a90 0x5629a4a08d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x5629a4a1c180 tx=0x7f0e8c005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8ef0329a3b8e790 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.147+0000 7f0e7affd640 1 -- 172.21.15.123:0/662756153 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c012450 con 0x5629a4a12a90 2024-08-18T22:08:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.147+0000 7f0e7affd640 1 -- 172.21.15.123:0/662756153 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e8c00f910 con 0x5629a4a12a90 2024-08-18T22:08:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.147+0000 7f0e7affd640 1 -- 172.21.15.123:0/662756153 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c005310 con 0x5629a4a12a90 2024-08-18T22:08:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.148+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/662756153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a12a90 msgr2=0x5629a4a08d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.148+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/662756153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a12a90 0x5629a4a08d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x5629a4a1c180 tx=0x7f0e8c005040 comp rx=0 tx=0).stop 2024-08-18T22:08:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.148+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/662756153 shutdown_connections 2024-08-18T22:08:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.148+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/662756153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a18460 0x5629a4a2f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.148+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/662756153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a133d0 0x5629a4a240f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.148+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/662756153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a12a90 0x5629a4a08d90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.148+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/662756153 >> 172.21.15.123:0/662756153 conn(0x5629a4a09cf0 msgr2=0x5629a4a08680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.148+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/662756153 shutdown_connections 2024-08-18T22:08:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.148+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/662756153 wait complete. 2024-08-18T22:08:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.148+0000 7f0e9a6a3740 1 -- start start 2024-08-18T22:08:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.148+0000 7f0e9a6a3740 1 Processor -- start 2024-08-18T22:08:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e9a6a3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a12a90 0x5629a4a21340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e9a6a3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a133d0 0x5629a4a21880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e9a6a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a18460 0x5629a4a22890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e9a6a3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0e901a6860 con 0x5629a4a12a90 2024-08-18T22:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e9a6a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0e901a7cd0 con 0x5629a4a18460 2024-08-18T22:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e9a6a3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0e901a6f30 con 0x5629a4a133d0 2024-08-18T22:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e9a6a3740 10 client.0 _ll_register_callbacks cb 0x7f0e8809bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e9568b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a12a90 0x5629a4a21340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e9568b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a12a90 0x5629a4a21340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44200/0 (socket says 172.21.15.123:44200) 2024-08-18T22:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e9568b640 1 -- 172.21.15.123:0/4274939452 learned_addr learned my addr 172.21.15.123:0/4274939452 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e94e8a640 1 --2- 172.21.15.123:0/4274939452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a133d0 0x5629a4a21880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e95e8c640 1 --2- 172.21.15.123:0/4274939452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a18460 0x5629a4a22890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e9568b640 1 -- 172.21.15.123:0/4274939452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a133d0 msgr2=0x5629a4a21880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e9568b640 1 --2- 172.21.15.123:0/4274939452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a133d0 0x5629a4a21880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e9568b640 1 -- 172.21.15.123:0/4274939452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a18460 msgr2=0x5629a4a22890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e9568b640 1 --2- 172.21.15.123:0/4274939452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a18460 0x5629a4a22890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e9568b640 1 -- 172.21.15.123:0/4274939452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629a4a22ea0 con 0x5629a4a12a90 2024-08-18T22:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.149+0000 7f0e95e8c640 1 --2- 172.21.15.123:0/4274939452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a18460 0x5629a4a22890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e9568b640 1 --2- 172.21.15.123:0/4274939452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a12a90 0x5629a4a21340 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009bf0 tx=0x7f0e8c009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456e338ef63e6227 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e78ff9640 1 -- 172.21.15.123:0/4274939452 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c036070 con 0x5629a4a12a90 2024-08-18T22:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e78ff9640 1 -- 172.21.15.123:0/4274939452 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0e8c00fcd0 con 0x5629a4a12a90 2024-08-18T22:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/4274939452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e8c00f910 con 0x5629a4a12a90 2024-08-18T22:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e78ff9640 1 -- 172.21.15.123:0/4274939452 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0e8c041050 con 0x5629a4a12a90 2024-08-18T22:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e9a6a3740 10 client.15387 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/4274939452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5629a4a24120 con 0x5629a4a12a90 2024-08-18T22:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e78ff9640 1 -- 172.21.15.123:0/4274939452 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e8c00f910 con 0x5629a4a12a90 2024-08-18T22:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e78ff9640 1 -- 172.21.15.123:0/4274939452 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f0e8c0035f0 con 0x5629a4a12a90 2024-08-18T22:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e9a6a3740 10 client.15387 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e9a6a3740 10 client.15387 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e9a6a3740 20 client.15387 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/4274939452 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5629a4a935e0 0x5629a4a959d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e9a6a3740 4 client.15387 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:08:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.150+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/4274939452 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5629a4979450 con 0x5629a4a935e0 2024-08-18T22:08:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.151+0000 7f0e94e8a640 1 --2- 172.21.15.123:0/4274939452 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5629a4a935e0 0x5629a4a959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.151+0000 7f0e78ff9640 10 client.15387 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.151+0000 7f0e94e8a640 1 --2- 172.21.15.123:0/4274939452 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5629a4a935e0 0x5629a4a959d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4efa35aade03437 server_cookie=eaccc68c28cecb73 in_seq=0 out_seq=0 2024-08-18T22:08:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.163+0000 7f0e78ff9640 1 -- 172.21.15.123:0/4274939452 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5629a4979450 con 0x5629a4a935e0 2024-08-18T22:08:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.163+0000 7f0e78ff9640 10 client.15387 handle_command_reply: tid=0 2024-08-18T22:08:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.163+0000 7f0e9a6a3740 1 client.15387 shutdown 2024-08-18T22:08:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.163+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/4274939452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a12a90 msgr2=0x5629a4a21340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.163+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/4274939452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a12a90 0x5629a4a21340 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009bf0 tx=0x7f0e8c009390 comp rx=0 tx=0).stop 2024-08-18T22:08:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.163+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/4274939452 shutdown_connections 2024-08-18T22:08:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.163+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/4274939452 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5629a4a935e0 0x5629a4a959d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.163+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/4274939452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a4a18460 0x5629a4a22890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.163+0000 7f0e78ff9640 0 client.15387 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.163+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/4274939452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5629a4a133d0 0x5629a4a21880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.163+0000 7f0e9a6a3740 1 --2- 172.21.15.123:0/4274939452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5629a4a12a90 0x5629a4a21340 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.163+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/4274939452 >> 172.21.15.123:0/4274939452 conn(0x5629a4a09cf0 msgr2=0x5629a4a08680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.164+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/4274939452 shutdown_connections 2024-08-18T22:08:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.164+0000 7f0e9a6a3740 1 -- 172.21.15.123:0/4274939452 wait complete. 2024-08-18T22:08:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.164+0000 7f0e9a6a3740 20 client.15387 trim_cache size 0 max 16384 2024-08-18T22:08:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:08:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:08:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:08:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:08:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.164+0000 7f0e978ef640 1 -- 172.21.15.123:0/159536331 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0e7c0a2c30 msgr2=0x7f0e7c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.164+0000 7f0e978ef640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0e7c0a2c30 0x7f0e7c0a50f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0e80006010 tx=0x7f0e80000bc0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.164+0000 7f0e978ef640 1 -- 172.21.15.123:0/159536331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e90103590 msgr2=0x7f0e9019f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.164+0000 7f0e978ef640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e90103590 0x7f0e9019f0c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800eb10 tx=0x7f0e8800c2d0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.164+0000 7f0e978ef640 1 -- 172.21.15.123:0/159536331 shutdown_connections 2024-08-18T22:08:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.164+0000 7f0e978ef640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e90103590 0x7f0e9019f0c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.164+0000 7f0e978ef640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e90102bd0 0x7f0e90198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.164+0000 7f0e978ef640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0e7c0a2c30 0x7f0e7c0a50f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.164+0000 7f0e978ef640 1 --2- 172.21.15.123:0/159536331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e900ffb60 0x7f0e90197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.164+0000 7f0e978ef640 1 -- 172.21.15.123:0/159536331 >> 172.21.15.123:0/159536331 conn(0x7f0e900fb660 msgr2=0x7f0e90105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.164+0000 7f0e978ef640 1 -- 172.21.15.123:0/159536331 shutdown_connections 2024-08-18T22:08:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:07.164+0000 7f0e978ef640 1 -- 172.21.15.123:0/159536331 wait complete. 2024-08-18T22:08:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:07.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.960+0000 7fe295850640 1 -- 172.21.15.123:0/3749365322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2901022a0 msgr2=0x7fe2901026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:07.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.960+0000 7fe295850640 1 --2- 172.21.15.123:0/3749365322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2901022a0 0x7fe2901026e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe284009900 tx=0x7fe28402a480 comp rx=0 tx=0).stop 2024-08-18T22:08:07.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.960+0000 7fe295850640 1 -- 172.21.15.123:0/3749365322 shutdown_connections 2024-08-18T22:08:07.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.960+0000 7fe295850640 1 --2- 172.21.15.123:0/3749365322 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe290102c20 0x7fe29010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.960+0000 7fe295850640 1 --2- 172.21.15.123:0/3749365322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2901022a0 0x7fe2901026e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.960+0000 7fe295850640 1 --2- 172.21.15.123:0/3749365322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe290100b50 0x7fe290100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.960+0000 7fe295850640 1 -- 172.21.15.123:0/3749365322 >> 172.21.15.123:0/3749365322 conn(0x7fe2900fc500 msgr2=0x7fe2900fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:07.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.960+0000 7fe295850640 1 -- 172.21.15.123:0/3749365322 shutdown_connections 2024-08-18T22:08:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.960+0000 7fe295850640 1 -- 172.21.15.123:0/3749365322 wait complete. 2024-08-18T22:08:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.960+0000 7fe295850640 1 Processor -- start 2024-08-18T22:08:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.960+0000 7fe295850640 1 -- start start 2024-08-18T22:08:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe295850640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe290100b50 0x7fe290198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe295850640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2901022a0 0x7fe2901987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe295850640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe290102c20 0x7fe29019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe295850640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe290111df0 con 0x7fe290102c20 2024-08-18T22:08:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe295850640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe290111c70 con 0x7fe290100b50 2024-08-18T22:08:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe295850640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe290111f70 con 0x7fe2901022a0 2024-08-18T22:08:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe28f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe290102c20 0x7fe29019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe28f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe290102c20 0x7fe29019cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44228/0 (socket says 172.21.15.123:44228) 2024-08-18T22:08:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe28f7fe640 1 -- 172.21.15.123:0/3563576749 learned_addr learned my addr 172.21.15.123:0/3563576749 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe28e7fc640 1 --2- 172.21.15.123:0/3563576749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2901022a0 0x7fe2901987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe28effd640 1 --2- 172.21.15.123:0/3563576749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe290100b50 0x7fe290198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe28f7fe640 1 -- 172.21.15.123:0/3563576749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2901022a0 msgr2=0x7fe2901987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe28f7fe640 1 --2- 172.21.15.123:0/3563576749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2901022a0 0x7fe2901987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe28f7fe640 1 -- 172.21.15.123:0/3563576749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe290100b50 msgr2=0x7fe290198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe28f7fe640 1 --2- 172.21.15.123:0/3563576749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe290100b50 0x7fe290198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe28f7fe640 1 -- 172.21.15.123:0/3563576749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29019d240 con 0x7fe290102c20 2024-08-18T22:08:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe28f7fe640 1 --2- 172.21.15.123:0/3563576749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe290102c20 0x7fe29019cb60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe28800b970 tx=0x7fe28800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.961+0000 7fe29484e640 1 -- 172.21.15.123:0/3563576749 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe288019070 con 0x7fe290102c20 2024-08-18T22:08:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.962+0000 7fe29484e640 1 -- 172.21.15.123:0/3563576749 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe28800cb40 con 0x7fe290102c20 2024-08-18T22:08:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.962+0000 7fe29484e640 1 -- 172.21.15.123:0/3563576749 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe288007650 con 0x7fe290102c20 2024-08-18T22:08:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.962+0000 7fe295850640 1 -- 172.21.15.123:0/3563576749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe29019d530 con 0x7fe290102c20 2024-08-18T22:08:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.962+0000 7fe295850640 1 -- 172.21.15.123:0/3563576749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2901a4e10 con 0x7fe290102c20 2024-08-18T22:08:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.963+0000 7fe295850640 1 -- 172.21.15.123:0/3563576749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe290100f30 con 0x7fe290102c20 2024-08-18T22:08:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.964+0000 7fe29484e640 1 -- 172.21.15.123:0/3563576749 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fe28801c070 con 0x7fe290102c20 2024-08-18T22:08:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.964+0000 7fe29484e640 1 --2- 172.21.15.123:0/3563576749 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe2780a2c00 0x7fe2780a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.965+0000 7fe28effd640 1 --2- 172.21.15.123:0/3563576749 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe2780a2c00 0x7fe2780a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.965+0000 7fe29484e640 1 -- 172.21.15.123:0/3563576749 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe2880cedc0 con 0x7fe290102c20 2024-08-18T22:08:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.965+0000 7fe28effd640 1 --2- 172.21.15.123:0/3563576749 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe2780a2c00 0x7fe2780a50c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe280005fd0 tx=0x7fe280005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:07.968+0000 7fe29484e640 1 -- 172.21.15.123:0/3563576749 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe28809b340 con 0x7fe290102c20 2024-08-18T22:08:08.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:08.169+0000 7fe295850640 1 -- 172.21.15.123:0/3563576749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe290108dc0 con 0x7fe290102c20 2024-08-18T22:08:08.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:08.169+0000 7fe29484e640 1 -- 172.21.15.123:0/3563576749 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7fe28809f640 con 0x7fe290102c20 2024-08-18T22:08:08.171 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:08:08.171 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"btime":"2024-08-18T22:07:46:492460+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:07:45.601053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:08:08.171 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 26 2024-08-18T22:08:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:08.172+0000 7fe295850640 1 -- 172.21.15.123:0/3563576749 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe2780a2c00 msgr2=0x7fe2780a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:08.172+0000 7fe295850640 1 --2- 172.21.15.123:0/3563576749 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe2780a2c00 0x7fe2780a50c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe280005fd0 tx=0x7fe280005850 comp rx=0 tx=0).stop 2024-08-18T22:08:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:08.172+0000 7fe295850640 1 -- 172.21.15.123:0/3563576749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe290102c20 msgr2=0x7fe29019cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:08.172+0000 7fe295850640 1 --2- 172.21.15.123:0/3563576749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe290102c20 0x7fe29019cb60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe28800b970 tx=0x7fe28800be30 comp rx=0 tx=0).stop 2024-08-18T22:08:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:08.172+0000 7fe295850640 1 -- 172.21.15.123:0/3563576749 shutdown_connections 2024-08-18T22:08:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:08.172+0000 7fe295850640 1 --2- 172.21.15.123:0/3563576749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe290102c20 0x7fe29019cb60 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:08.172+0000 7fe295850640 1 --2- 172.21.15.123:0/3563576749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2901022a0 0x7fe2901987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:08.172+0000 7fe295850640 1 --2- 172.21.15.123:0/3563576749 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe2780a2c00 0x7fe2780a50c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:08.172+0000 7fe295850640 1 --2- 172.21.15.123:0/3563576749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe290100b50 0x7fe290198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:08.172+0000 7fe295850640 1 -- 172.21.15.123:0/3563576749 >> 172.21.15.123:0/3563576749 conn(0x7fe2900fc500 msgr2=0x7fe2900fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:08.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:08.172+0000 7fe295850640 1 -- 172.21.15.123:0/3563576749 shutdown_connections 2024-08-18T22:08:08.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:08.172+0000 7fe295850640 1 -- 172.21.15.123:0/3563576749 wait complete. 2024-08-18T22:08:08.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:08 smithi123 ceph-mon[18462]: pgmap v351: 129 pgs: 129 active+clean; 648 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-18T22:08:08.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:08 smithi123 ceph-mon[18462]: scrub summary: idle 2024-08-18T22:08:08.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:08 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3563576749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:08:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:08 smithi130 ceph-mon[21698]: pgmap v351: 129 pgs: 129 active+clean; 648 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-18T22:08:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:08 smithi130 ceph-mon[21698]: scrub summary: idle 2024-08-18T22:08:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:08 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3563576749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:08:08.806 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-18T22:05:22.597053+0000', 'modified': '2024-08-18T22:07:45.601053+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24466, 'mds_1': 24458, 'mds_2': 24448}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24422': {'gid': 24422, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6835/579024659', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6834', 'nonce': 579024659}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 579024659}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6837/29028326', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6836', 'nonce': 29028326}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 29028326}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.183:6835/1138667446', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6834', 'nonce': 1138667446}, {'type': 'v1', 'addr': '172.21.15.183:6835', 'nonce': 1138667446}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.183:6837/1468802140', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6836', 'nonce': 1468802140}, {'type': 'v1', 'addr': '172.21.15.183:6837', 'nonce': 1468802140}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'b', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.130:6839/991946562', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6838', 'nonce': 991946562}, {'type': 'v1', 'addr': '172.21.15.130:6839', 'nonce': 991946562}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.183:6839/1902275683', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6838', 'nonce': 1902275683}, {'type': 'v1', 'addr': '172.21.15.183:6839', 'nonce': 1902275683}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24466, 'qdb_cluster': [24466, 24458, 24448]} 2024-08-18T22:08:08.806 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-18T22:08:08.806 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.c status 2024-08-18T22:08:08.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:08 smithi183 ceph-mon[22097]: pgmap v351: 129 pgs: 129 active+clean; 648 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-18T22:08:08.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:08 smithi183 ceph-mon[22097]: scrub summary: idle 2024-08-18T22:08:08.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:08 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3563576749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:08:09.098 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:09.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.576+0000 7f85fcb65640 1 -- 172.21.15.123:0/129677998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f81007b0 msgr2=0x7f85f8100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:09.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.576+0000 7f85fcb65640 1 --2- 172.21.15.123:0/129677998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f81007b0 0x7f85f8100c10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f85ec009930 tx=0x7f85ec02a420 comp rx=0 tx=0).stop 2024-08-18T22:08:09.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.576+0000 7f85fcb65640 1 -- 172.21.15.123:0/129677998 shutdown_connections 2024-08-18T22:08:09.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.576+0000 7f85fcb65640 1 --2- 172.21.15.123:0/129677998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85f8101150 0x7f85f810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.576+0000 7f85fcb65640 1 --2- 172.21.15.123:0/129677998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f81007b0 0x7f85f8100c10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.576+0000 7f85fcb65640 1 --2- 172.21.15.123:0/129677998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f81067b0 0x7f85f8106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.576+0000 7f85fcb65640 1 -- 172.21.15.123:0/129677998 >> 172.21.15.123:0/129677998 conn(0x7f85f80fc4d0 msgr2=0x7f85f80fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.576+0000 7f85fcb65640 1 -- 172.21.15.123:0/129677998 shutdown_connections 2024-08-18T22:08:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.576+0000 7f85fcb65640 1 -- 172.21.15.123:0/129677998 wait complete. 2024-08-18T22:08:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.577+0000 7f85fcb65640 1 Processor -- start 2024-08-18T22:08:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.577+0000 7f85fcb65640 1 -- start start 2024-08-18T22:08:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.577+0000 7f85fcb65640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f81007b0 0x7f85f8198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.577+0000 7f85fcb65640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85f8101150 0x7f85f81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.577+0000 7f85fcb65640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f81067b0 0x7f85f819c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.577+0000 7f85fcb65640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f85f8110bb0 con 0x7f85f81007b0 2024-08-18T22:08:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.577+0000 7f85fcb65640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f85f8110a30 con 0x7f85f8101150 2024-08-18T22:08:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.577+0000 7f85fcb65640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f85f8110d30 con 0x7f85f81067b0 2024-08-18T22:08:09.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.577+0000 7f85f659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f81007b0 0x7f85f8198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.577+0000 7f85f659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f81007b0 0x7f85f8198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44256/0 (socket says 172.21.15.123:44256) 2024-08-18T22:08:09.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.577+0000 7f85f659c640 1 -- 172.21.15.123:0/3330741527 learned_addr learned my addr 172.21.15.123:0/3330741527 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:09.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.577+0000 7f85f6d9d640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f81067b0 0x7f85f819c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.578+0000 7f85f659c640 1 -- 172.21.15.123:0/3330741527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f81067b0 msgr2=0x7f85f819c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:09.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.578+0000 7f85f5d9b640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85f8101150 0x7f85f81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.578+0000 7f85f659c640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f81067b0 0x7f85f819c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.578+0000 7f85f659c640 1 -- 172.21.15.123:0/3330741527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85f8101150 msgr2=0x7f85f81985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:09.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.578+0000 7f85f659c640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85f8101150 0x7f85f81985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.578+0000 7f85f659c640 1 -- 172.21.15.123:0/3330741527 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f819d020 con 0x7f85f81007b0 2024-08-18T22:08:09.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.578+0000 7f85f6d9d640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f81067b0 0x7f85f819c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:09.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.578+0000 7f85f5d9b640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85f8101150 0x7f85f81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:09.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.578+0000 7f85f659c640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f81007b0 0x7f85f8198070 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f85e800c920 tx=0x7f85e800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:09.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.578+0000 7f85e77fe640 1 -- 172.21.15.123:0/3330741527 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8007c70 con 0x7f85f81007b0 2024-08-18T22:08:09.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.578+0000 7f85fcb65640 1 -- 172.21.15.123:0/3330741527 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f819d310 con 0x7f85f81007b0 2024-08-18T22:08:09.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.578+0000 7f85e77fe640 1 -- 172.21.15.123:0/3330741527 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85e8007e10 con 0x7f85f81007b0 2024-08-18T22:08:09.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.578+0000 7f85e77fe640 1 -- 172.21.15.123:0/3330741527 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8018890 con 0x7f85f81007b0 2024-08-18T22:08:09.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.578+0000 7f85fcb65640 1 -- 172.21.15.123:0/3330741527 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f81a4bf0 con 0x7f85f81007b0 2024-08-18T22:08:09.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.580+0000 7f85e77fe640 1 -- 172.21.15.123:0/3330741527 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f85e8018a70 con 0x7f85f81007b0 2024-08-18T22:08:09.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.581+0000 7f85fef63740 1 Processor -- start 2024-08-18T22:08:09.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.581+0000 7f85fef63740 1 -- start start 2024-08-18T22:08:09.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.581+0000 7f85fef63740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 0x562495948a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.581+0000 7f85fef63740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495948f50 0x5624959532d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.581+0000 7f85fef63740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495953810 0x562495955c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.581+0000 7f85fef63740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5624958ad710 con 0x562495948f50 2024-08-18T22:08:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.581+0000 7f85fef63740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562495845770 con 0x562495953810 2024-08-18T22:08:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.581+0000 7f85fef63740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5624958a96d0 con 0x562495948630 2024-08-18T22:08:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.581+0000 7f85f659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495948f50 0x5624959532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.581+0000 7f85f659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495948f50 0x5624959532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44262/0 (socket says 172.21.15.123:44262) 2024-08-18T22:08:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.581+0000 7f85f659c640 1 -- 172.21.15.123:0/2715147237 learned_addr learned my addr 172.21.15.123:0/2715147237 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.581+0000 7f85e77fe640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f85e00a2b80 0x7f85e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.581+0000 7f85f6d9d640 1 --2- 172.21.15.123:0/2715147237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 0x562495948a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.581+0000 7f85f5d9b640 1 --2- 172.21.15.123:0/2715147237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495953810 0x562495955c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.582+0000 7f85f659c640 1 -- 172.21.15.123:0/2715147237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 msgr2=0x562495948a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.582+0000 7f85f659c640 1 --2- 172.21.15.123:0/2715147237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 0x562495948a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.582+0000 7f85f659c640 1 -- 172.21.15.123:0/2715147237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495953810 msgr2=0x562495955c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.582+0000 7f85f659c640 1 --2- 172.21.15.123:0/2715147237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495953810 0x562495955c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.582+0000 7f85f659c640 1 -- 172.21.15.123:0/2715147237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56249584c3e0 con 0x562495948f50 2024-08-18T22:08:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.582+0000 7f85f6d9d640 1 --2- 172.21.15.123:0/2715147237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 0x562495948a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.582+0000 7f85f5d9b640 1 --2- 172.21.15.123:0/2715147237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495953810 0x562495955c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.582+0000 7f85f6d9d640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f85e00a2b80 0x7f85e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.582+0000 7f85e77fe640 1 -- 172.21.15.123:0/3330741527 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f85e80cf550 con 0x7f85f81007b0 2024-08-18T22:08:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.582+0000 7f85f659c640 1 --2- 172.21.15.123:0/2715147237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495948f50 0x5624959532d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f85e80197a0 tx=0x7f85e8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203ea24bdf2830b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.582+0000 7f85e4ff9640 1 -- 172.21.15.123:0/2715147237 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e809b380 con 0x562495948f50 2024-08-18T22:08:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.582+0000 7f85f6d9d640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f85e00a2b80 0x7f85e00a5040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f85f0007ee0 tx=0x7f85f0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.582+0000 7f85e4ff9640 1 -- 172.21.15.123:0/2715147237 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85e8019a00 con 0x562495948f50 2024-08-18T22:08:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.582+0000 7f85e4ff9640 1 -- 172.21.15.123:0/2715147237 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8019800 con 0x562495948f50 2024-08-18T22:08:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.583+0000 7f85fef63740 1 -- 172.21.15.123:0/2715147237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495948f50 msgr2=0x5624959532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.583+0000 7f85fef63740 1 --2- 172.21.15.123:0/2715147237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495948f50 0x5624959532d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f85e80197a0 tx=0x7f85e8020000 comp rx=0 tx=0).stop 2024-08-18T22:08:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.583+0000 7f85fef63740 1 -- 172.21.15.123:0/2715147237 shutdown_connections 2024-08-18T22:08:09.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.583+0000 7f85fef63740 1 --2- 172.21.15.123:0/2715147237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495953810 0x562495955c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.583+0000 7f85fef63740 1 --2- 172.21.15.123:0/2715147237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495948f50 0x5624959532d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.583+0000 7f85fef63740 1 --2- 172.21.15.123:0/2715147237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 0x562495948a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.583+0000 7f85fef63740 1 -- 172.21.15.123:0/2715147237 >> 172.21.15.123:0/2715147237 conn(0x562495944bc0 msgr2=0x562495944fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:09.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.583+0000 7f85fef63740 1 -- 172.21.15.123:0/2715147237 shutdown_connections 2024-08-18T22:08:09.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.583+0000 7f85fef63740 1 -- 172.21.15.123:0/2715147237 wait complete. 2024-08-18T22:08:09.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.583+0000 7f85fef63740 1 -- start start 2024-08-18T22:08:09.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.583+0000 7f85fef63740 1 Processor -- start 2024-08-18T22:08:09.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85fef63740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 0x5624959532c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85fef63740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495948f50 0x562495950610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85fef63740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495953810 0x562495950da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85fef63740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5624959563e0 con 0x562495948f50 2024-08-18T22:08:09.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85fef63740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562495868970 con 0x562495953810 2024-08-18T22:08:09.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85fef63740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562495956560 con 0x562495948630 2024-08-18T22:08:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85fef63740 10 client.0 _ll_register_callbacks cb 0x5624955bc7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85f5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495948f50 0x562495950610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85f5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495948f50 0x562495950610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44278/0 (socket says 172.21.15.123:44278) 2024-08-18T22:08:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85f5d9b640 1 -- 172.21.15.123:0/3288016485 learned_addr learned my addr 172.21.15.123:0/3288016485 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85f659c640 1 --2- 172.21.15.123:0/3288016485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 0x5624959532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85f5d9b640 1 -- 172.21.15.123:0/3288016485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 msgr2=0x5624959532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85f5d9b640 1 --2- 172.21.15.123:0/3288016485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 0x5624959532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85f5d9b640 1 -- 172.21.15.123:0/3288016485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495953810 msgr2=0x562495950da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85f5d9b640 1 --2- 172.21.15.123:0/3288016485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495953810 0x562495950da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85f5d9b640 1 -- 172.21.15.123:0/3288016485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56249561f2b0 con 0x562495948f50 2024-08-18T22:08:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85f5d9b640 1 --2- 172.21.15.123:0/3288016485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495948f50 0x562495950610 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f85ec000c00 tx=0x7f85ec031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea7b71eaf323a3f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.584+0000 7f85ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.585+0000 7f85ddffb640 1 -- 172.21.15.123:0/3288016485 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ec03f070 con 0x562495948f50 2024-08-18T22:08:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.585+0000 7f85ddffb640 1 -- 172.21.15.123:0/3288016485 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f85ec004240 con 0x562495948f50 2024-08-18T22:08:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.585+0000 7f85fef63740 1 -- 172.21.15.123:0/3288016485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5624958bac80 con 0x562495948f50 2024-08-18T22:08:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.585+0000 7f85ddffb640 1 -- 172.21.15.123:0/3288016485 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f85ec04b050 con 0x562495948f50 2024-08-18T22:08:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.585+0000 7f85fef63740 10 client.15405 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.585+0000 7f85fef63740 1 -- 172.21.15.123:0/3288016485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562495961e80 con 0x562495948f50 2024-08-18T22:08:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.585+0000 7f85ddffb640 1 -- 172.21.15.123:0/3288016485 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5624958bac80 con 0x562495948f50 2024-08-18T22:08:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.585+0000 7f85ddffb640 1 -- 172.21.15.123:0/3288016485 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f85ec004a50 con 0x562495948f50 2024-08-18T22:08:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.585+0000 7f85fef63740 10 client.15405 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.585+0000 7f85fef63740 10 client.15405 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:08:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.585+0000 7f85fef63740 20 client.15405 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.585+0000 7f85fef63740 1 --2- 172.21.15.123:0/3288016485 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x562495964500 0x562495965970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.585+0000 7f85fef63740 4 client.15405 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:08:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.585+0000 7f85fef63740 1 -- 172.21.15.123:0/3288016485 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624958b5190 con 0x562495964500 2024-08-18T22:08:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.586+0000 7f85f659c640 1 --2- 172.21.15.123:0/3288016485 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x562495964500 0x562495965970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.586+0000 7f85f659c640 1 --2- 172.21.15.123:0/3288016485 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x562495964500 0x562495965970 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=372fb7a75ec688d3 server_cookie=193938be92943e17 in_seq=0 out_seq=0 2024-08-18T22:08:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.586+0000 7f85ddffb640 10 client.15405 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:08:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.587+0000 7f85ddffb640 1 -- 172.21.15.123:0/3288016485 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5624958b5190 con 0x562495964500 2024-08-18T22:08:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.587+0000 7f85ddffb640 10 client.15405 handle_command_reply: tid=0 2024-08-18T22:08:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.587+0000 7f85fef63740 1 client.15405 shutdown 2024-08-18T22:08:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.587+0000 7f85fef63740 1 -- 172.21.15.123:0/3288016485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495948f50 msgr2=0x562495950610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.587+0000 7f85fef63740 1 --2- 172.21.15.123:0/3288016485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495948f50 0x562495950610 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f85ec000c00 tx=0x7f85ec031630 comp rx=0 tx=0).stop 2024-08-18T22:08:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.587+0000 7f85fef63740 1 -- 172.21.15.123:0/3288016485 shutdown_connections 2024-08-18T22:08:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.587+0000 7f85fef63740 1 --2- 172.21.15.123:0/3288016485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495953810 0x562495950da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.587+0000 7f85fef63740 1 --2- 172.21.15.123:0/3288016485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495948f50 0x562495950610 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.587+0000 7f85fef63740 1 --2- 172.21.15.123:0/3288016485 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x562495964500 0x562495965970 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.587+0000 7f85fef63740 1 --2- 172.21.15.123:0/3288016485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 0x5624959532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.587+0000 7f85ddffb640 0 client.15405 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:08:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.587+0000 7f85fef63740 1 -- 172.21.15.123:0/3288016485 >> 172.21.15.123:0/3288016485 conn(0x562495944bc0 msgr2=0x56249594a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.587+0000 7f85fef63740 1 -- 172.21.15.123:0/3288016485 shutdown_connections 2024-08-18T22:08:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.587+0000 7f85fef63740 1 -- 172.21.15.123:0/3288016485 wait complete. 2024-08-18T22:08:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.588+0000 7f85fef63740 20 client.15405 trim_cache size 0 max 16384 2024-08-18T22:08:09.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85fef63740 1 Processor -- start 2024-08-18T22:08:09.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85fef63740 1 -- start start 2024-08-18T22:08:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85fef63740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495948630 0x562495965970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85fef63740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948f50 0x56249594b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85fef63740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495953810 0x56249596e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85fef63740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562495963cb0 con 0x562495953810 2024-08-18T22:08:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85fef63740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562495964380 con 0x562495948630 2024-08-18T22:08:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85fef63740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562495964a50 con 0x562495948f50 2024-08-18T22:08:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85f6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495953810 0x56249596e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85f6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495953810 0x56249596e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44280/0 (socket says 172.21.15.123:44280) 2024-08-18T22:08:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85f6d9d640 1 -- 172.21.15.123:0/1180580169 learned_addr learned my addr 172.21.15.123:0/1180580169 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85f6d9d640 1 -- 172.21.15.123:0/1180580169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948f50 msgr2=0x56249594b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85f659c640 1 --2- 172.21.15.123:0/1180580169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495948630 0x562495965970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85f5d9b640 1 --2- 172.21.15.123:0/1180580169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948f50 0x56249594b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85f6d9d640 1 --2- 172.21.15.123:0/1180580169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948f50 0x56249594b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85f6d9d640 1 -- 172.21.15.123:0/1180580169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495948630 msgr2=0x562495965970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:09.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85f6d9d640 1 --2- 172.21.15.123:0/1180580169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495948630 0x562495965970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85f6d9d640 1 -- 172.21.15.123:0/1180580169 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624959449f0 con 0x562495953810 2024-08-18T22:08:09.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.605+0000 7f85f6d9d640 1 --2- 172.21.15.123:0/1180580169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495953810 0x56249596e040 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f85f0010780 tx=0x7f85f0012070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d83ce75bac0d282 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:09.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.606+0000 7f85dffff640 1 -- 172.21.15.123:0/1180580169 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f0025420 con 0x562495953810 2024-08-18T22:08:09.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.606+0000 7f85dffff640 1 -- 172.21.15.123:0/1180580169 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85f0020030 con 0x562495953810 2024-08-18T22:08:09.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.606+0000 7f85dffff640 1 -- 172.21.15.123:0/1180580169 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f001c8d0 con 0x562495953810 2024-08-18T22:08:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.606+0000 7f85fef63740 1 -- 172.21.15.123:0/1180580169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495953810 msgr2=0x56249596e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.606+0000 7f85fef63740 1 --2- 172.21.15.123:0/1180580169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495953810 0x56249596e040 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f85f0010780 tx=0x7f85f0012070 comp rx=0 tx=0).stop 2024-08-18T22:08:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.606+0000 7f85fef63740 1 -- 172.21.15.123:0/1180580169 shutdown_connections 2024-08-18T22:08:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.606+0000 7f85fef63740 1 --2- 172.21.15.123:0/1180580169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495953810 0x56249596e040 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.606+0000 7f85fef63740 1 --2- 172.21.15.123:0/1180580169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948f50 0x56249594b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.606+0000 7f85fef63740 1 --2- 172.21.15.123:0/1180580169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495948630 0x562495965970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.606+0000 7f85fef63740 1 -- 172.21.15.123:0/1180580169 >> 172.21.15.123:0/1180580169 conn(0x562495944bc0 msgr2=0x56249594b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.606+0000 7f85fef63740 1 -- 172.21.15.123:0/1180580169 shutdown_connections 2024-08-18T22:08:09.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.606+0000 7f85fef63740 1 -- 172.21.15.123:0/1180580169 wait complete. 2024-08-18T22:08:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85fef63740 1 -- start start 2024-08-18T22:08:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85fef63740 1 Processor -- start 2024-08-18T22:08:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85fef63740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 0x56249594c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85fef63740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495948f50 0x56249594cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85fef63740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495953810 0x56249594d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85fef63740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5624959657f0 con 0x562495953810 2024-08-18T22:08:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85fef63740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562495965120 con 0x562495948f50 2024-08-18T22:08:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85fef63740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562495965ec0 con 0x562495948630 2024-08-18T22:08:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85fef63740 10 client.0 _ll_register_callbacks cb 0x7f85ec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85f6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495953810 0x56249594d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85f6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495953810 0x56249594d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44290/0 (socket says 172.21.15.123:44290) 2024-08-18T22:08:09.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85f6d9d640 1 -- 172.21.15.123:0/2997537716 learned_addr learned my addr 172.21.15.123:0/2997537716 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85f659c640 1 --2- 172.21.15.123:0/2997537716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 0x56249594c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85f5d9b640 1 --2- 172.21.15.123:0/2997537716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495948f50 0x56249594cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85f6d9d640 1 -- 172.21.15.123:0/2997537716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 msgr2=0x56249594c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85f6d9d640 1 --2- 172.21.15.123:0/2997537716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 0x56249594c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85f6d9d640 1 -- 172.21.15.123:0/2997537716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495948f50 msgr2=0x56249594cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85f6d9d640 1 --2- 172.21.15.123:0/2997537716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495948f50 0x56249594cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.607+0000 7f85f6d9d640 1 -- 172.21.15.123:0/2997537716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562495940130 con 0x562495953810 2024-08-18T22:08:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.608+0000 7f85f6d9d640 1 --2- 172.21.15.123:0/2997537716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495953810 0x56249594d320 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f85f001c450 tx=0x7f85f001ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3eaa63594ff607 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.608+0000 7f85ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.608+0000 7f85ddffb640 1 -- 172.21.15.123:0/2997537716 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f001c650 con 0x562495953810 2024-08-18T22:08:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.608+0000 7f85ddffb640 1 -- 172.21.15.123:0/2997537716 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f85f001c7f0 con 0x562495953810 2024-08-18T22:08:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.608+0000 7f85fef63740 1 -- 172.21.15.123:0/2997537716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85f0020030 con 0x562495953810 2024-08-18T22:08:09.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.608+0000 7f85ddffb640 1 -- 172.21.15.123:0/2997537716 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f85f0039050 con 0x562495953810 2024-08-18T22:08:09.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.608+0000 7f85fef63740 10 client.15411 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:09.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.608+0000 7f85fef63740 1 -- 172.21.15.123:0/2997537716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5624959d2d40 con 0x562495953810 2024-08-18T22:08:09.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.608+0000 7f85ddffb640 1 -- 172.21.15.123:0/2997537716 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85f0020030 con 0x562495953810 2024-08-18T22:08:09.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.608+0000 7f85ddffb640 1 -- 172.21.15.123:0/2997537716 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f85f0030650 con 0x562495953810 2024-08-18T22:08:09.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.608+0000 7f85fef63740 10 client.15411 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:09.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.608+0000 7f85fef63740 10 client.15411 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:08:09.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.608+0000 7f85fef63740 20 client.15411 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:09.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.609+0000 7f85fef63740 1 --2- 172.21.15.123:0/2997537716 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x562495964500 0x5624959d61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:09.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.609+0000 7f85fef63740 4 client.15411 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:08:09.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.609+0000 7f85fef63740 1 -- 172.21.15.123:0/2997537716 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "status"}) -- 0x5624958320e0 con 0x562495964500 2024-08-18T22:08:09.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.609+0000 7f85f659c640 1 --2- 172.21.15.123:0/2997537716 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x562495964500 0x5624959d61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:09.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.609+0000 7f85f659c640 1 --2- 172.21.15.123:0/2997537716 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x562495964500 0x5624959d61e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c7b55d5a8935a900 server_cookie=57398a52286b936b in_seq=0 out_seq=0 2024-08-18T22:08:09.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.609+0000 7f85ddffb640 10 client.15411 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:08:09.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.609+0000 7f85ddffb640 1 -- 172.21.15.123:0/2997537716 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5624958320e0 con 0x562495964500 2024-08-18T22:08:09.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.609+0000 7f85ddffb640 10 client.15411 handle_command_reply: tid=0 2024-08-18T22:08:09.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.609+0000 7f85fef63740 1 client.15411 shutdown 2024-08-18T22:08:09.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.609+0000 7f85fef63740 1 -- 172.21.15.123:0/2997537716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495953810 msgr2=0x56249594d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:09.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.609+0000 7f85fef63740 1 --2- 172.21.15.123:0/2997537716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495953810 0x56249594d320 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f85f001c450 tx=0x7f85f001ba50 comp rx=0 tx=0).stop 2024-08-18T22:08:09.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.609+0000 7f85fef63740 1 -- 172.21.15.123:0/2997537716 shutdown_connections 2024-08-18T22:08:09.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fef63740 1 --2- 172.21.15.123:0/2997537716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562495953810 0x56249594d320 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fef63740 1 --2- 172.21.15.123:0/2997537716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562495948f50 0x56249594cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fef63740 1 --2- 172.21.15.123:0/2997537716 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x562495964500 0x5624959d61e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fef63740 1 --2- 172.21.15.123:0/2997537716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562495948630 0x56249594c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fef63740 1 -- 172.21.15.123:0/2997537716 >> 172.21.15.123:0/2997537716 conn(0x562495944bc0 msgr2=0x56249594eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:09.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85ddffb640 0 client.15411 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:08:09.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fef63740 1 -- 172.21.15.123:0/2997537716 shutdown_connections 2024-08-18T22:08:09.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fef63740 1 -- 172.21.15.123:0/2997537716 wait complete. 2024-08-18T22:08:09.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fef63740 20 client.15411 trim_cache size 0 max 16384 2024-08-18T22:08:09.617 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:08:09.617 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "dfa1db70-5dac-11ef-bccf-c7b262605968", 2024-08-18T22:08:09.617 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 2, 2024-08-18T22:08:09.617 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24448, 2024-08-18T22:08:09.617 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-08-18T22:08:09.617 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-08-18T22:08:09.617 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-08-18T22:08:09.617 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 132.163412497, 2024-08-18T22:08:09.617 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 26, 2024-08-18T22:08:09.617 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 92, 2024-08-18T22:08:09.618 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 92, 2024-08-18T22:08:09.618 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 192.26991163100001 2024-08-18T22:08:09.618 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:08:09.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fcb65640 1 -- 172.21.15.123:0/3330741527 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f85e00a2b80 msgr2=0x7f85e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fcb65640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f85e00a2b80 0x7f85e00a5040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f85f0007ee0 tx=0x7f85f0004a40 comp rx=0 tx=0).stop 2024-08-18T22:08:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fcb65640 1 -- 172.21.15.123:0/3330741527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f81007b0 msgr2=0x7f85f8198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fcb65640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f81007b0 0x7f85f8198070 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f85e800c920 tx=0x7f85e800cde0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fcb65640 1 -- 172.21.15.123:0/3330741527 shutdown_connections 2024-08-18T22:08:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fcb65640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f81067b0 0x7f85f819c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fcb65640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f85e00a2b80 0x7f85e00a5040 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fcb65640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85f8101150 0x7f85f81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fcb65640 1 --2- 172.21.15.123:0/3330741527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f81007b0 0x7f85f8198070 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fcb65640 1 -- 172.21.15.123:0/3330741527 >> 172.21.15.123:0/3330741527 conn(0x7f85f80fc4d0 msgr2=0x7f85f81044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fcb65640 1 -- 172.21.15.123:0/3330741527 shutdown_connections 2024-08-18T22:08:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:09.610+0000 7f85fcb65640 1 -- 172.21.15.123:0/3330741527 wait complete. 2024-08-18T22:08:10.337 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.b status 2024-08-18T22:08:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:10 smithi123 ceph-mon[18462]: pgmap v352: 129 pgs: 129 active+clean; 657 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-18T22:08:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:10 smithi130 ceph-mon[21698]: pgmap v352: 129 pgs: 129 active+clean; 657 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-18T22:08:10.774 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:10 smithi183 ceph-mon[22097]: pgmap v352: 129 pgs: 129 active+clean; 657 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-18T22:08:11.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.243+0000 7fa00ba27640 1 -- 172.21.15.123:0/3259626702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa004102a70 msgr2=0x7fa004102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:11.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.243+0000 7fa00ba27640 1 --2- 172.21.15.123:0/3259626702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa004102a70 0x7fa004102e50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009900 tx=0x7f9ff402a480 comp rx=0 tx=0).stop 2024-08-18T22:08:11.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.243+0000 7fa00ba27640 1 -- 172.21.15.123:0/3259626702 shutdown_connections 2024-08-18T22:08:11.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.243+0000 7fa00ba27640 1 --2- 172.21.15.123:0/3259626702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa00410bea0 0x7fa00410e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.243+0000 7fa00ba27640 1 --2- 172.21.15.123:0/3259626702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa004103390 0x7fa00410b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.243+0000 7fa00ba27640 1 --2- 172.21.15.123:0/3259626702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa004102a70 0x7fa004102e50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.243+0000 7fa00ba27640 1 -- 172.21.15.123:0/3259626702 >> 172.21.15.123:0/3259626702 conn(0x7fa0040fc4d0 msgr2=0x7fa0040fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.243+0000 7fa00ba27640 1 -- 172.21.15.123:0/3259626702 shutdown_connections 2024-08-18T22:08:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.243+0000 7fa00ba27640 1 -- 172.21.15.123:0/3259626702 wait complete. 2024-08-18T22:08:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.244+0000 7fa00ba27640 1 Processor -- start 2024-08-18T22:08:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.244+0000 7fa00ba27640 1 -- start start 2024-08-18T22:08:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.244+0000 7fa00ba27640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa004102a70 0x7fa0041006d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.244+0000 7fa00ba27640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa004103390 0x7fa004100c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.244+0000 7fa00ba27640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa00410bea0 0x7fa004101150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.244+0000 7fa00ba27640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa004111ca0 con 0x7fa004102a70 2024-08-18T22:08:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.244+0000 7fa00ba27640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa004111b20 con 0x7fa00410bea0 2024-08-18T22:08:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.244+0000 7fa00ba27640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa004111e20 con 0x7fa004103390 2024-08-18T22:08:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.244+0000 7fa0097c3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa004102a70 0x7fa0041006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.244+0000 7fa0097c3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa004102a70 0x7fa0041006d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44314/0 (socket says 172.21.15.123:44314) 2024-08-18T22:08:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.244+0000 7fa0097c3640 1 -- 172.21.15.123:0/2269777020 learned_addr learned my addr 172.21.15.123:0/2269777020 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.244+0000 7fa008fc2640 1 --2- 172.21.15.123:0/2269777020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa004103390 0x7fa004100c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.244+0000 7fa009fc4640 1 --2- 172.21.15.123:0/2269777020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa00410bea0 0x7fa004101150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.245+0000 7fa0097c3640 1 -- 172.21.15.123:0/2269777020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa004103390 msgr2=0x7fa004100c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.245+0000 7fa0097c3640 1 --2- 172.21.15.123:0/2269777020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa004103390 0x7fa004100c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.245+0000 7fa0097c3640 1 -- 172.21.15.123:0/2269777020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa00410bea0 msgr2=0x7fa004101150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.245+0000 7fa0097c3640 1 --2- 172.21.15.123:0/2269777020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa00410bea0 0x7fa004101150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.245+0000 7fa0097c3640 1 -- 172.21.15.123:0/2269777020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0041a66e0 con 0x7fa004102a70 2024-08-18T22:08:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.245+0000 7fa009fc4640 1 --2- 172.21.15.123:0/2269777020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa00410bea0 0x7fa004101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.245+0000 7fa0097c3640 1 --2- 172.21.15.123:0/2269777020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa004102a70 0x7fa0041006d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4006010 tx=0x7f9ff40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.245+0000 7fa0027fc640 1 -- 172.21.15.123:0/2269777020 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff403f030 con 0x7fa004102a70 2024-08-18T22:08:11.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.245+0000 7fa0027fc640 1 -- 172.21.15.123:0/2269777020 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ff4003ce0 con 0x7fa004102a70 2024-08-18T22:08:11.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.245+0000 7fa00ba27640 1 -- 172.21.15.123:0/2269777020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0041a6970 con 0x7fa004102a70 2024-08-18T22:08:11.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.245+0000 7fa0027fc640 1 -- 172.21.15.123:0/2269777020 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4035070 con 0x7fa004102a70 2024-08-18T22:08:11.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.245+0000 7fa00ba27640 1 -- 172.21.15.123:0/2269777020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0041a6ea0 con 0x7fa004102a70 2024-08-18T22:08:11.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.247+0000 7fa0027fc640 1 -- 172.21.15.123:0/2269777020 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f9ff4042030 con 0x7fa004102a70 2024-08-18T22:08:11.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa00de25740 1 Processor -- start 2024-08-18T22:08:11.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa00de25740 1 -- start start 2024-08-18T22:08:11.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa00de25740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593630 0x55d215593a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa00de25740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593f50 0x55d21559e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa00de25740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 0x55d2155a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa00de25740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d2154f8710 con 0x55d215593630 2024-08-18T22:08:11.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa00de25740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d215490770 con 0x55d21559e810 2024-08-18T22:08:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa00de25740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d2154f46d0 con 0x55d215593f50 2024-08-18T22:08:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa009fc4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593630 0x55d215593a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa009fc4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593630 0x55d215593a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44320/0 (socket says 172.21.15.123:44320) 2024-08-18T22:08:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa009fc4640 1 -- 172.21.15.123:0/1460709389 learned_addr learned my addr 172.21.15.123:0/1460709389 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa008fc2640 1 --2- 172.21.15.123:0/1460709389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 0x55d2155a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa0097c3640 1 --2- 172.21.15.123:0/1460709389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593f50 0x55d21559e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa0027fc640 1 --2- 172.21.15.123:0/2269777020 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9fec0a2c00 0x7f9fec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa009fc4640 1 -- 172.21.15.123:0/1460709389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593f50 msgr2=0x55d21559e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa009fc4640 1 --2- 172.21.15.123:0/1460709389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593f50 0x55d21559e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa009fc4640 1 -- 172.21.15.123:0/1460709389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 msgr2=0x55d2155a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa009fc4640 1 --2- 172.21.15.123:0/1460709389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 0x55d2155a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa009fc4640 1 -- 172.21.15.123:0/1460709389 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2154973e0 con 0x55d215593630 2024-08-18T22:08:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa008fc2640 1 --2- 172.21.15.123:0/1460709389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 0x55d2155a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.248+0000 7fa0097c3640 1 --2- 172.21.15.123:0/1460709389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593f50 0x55d21559e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.249+0000 7fa0027fc640 1 -- 172.21.15.123:0/2269777020 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f9ff40ef890 con 0x7fa004102a70 2024-08-18T22:08:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.249+0000 7fa009fc4640 1 --2- 172.21.15.123:0/1460709389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593630 0x55d215593a10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009f30 tx=0x7f9ffc010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9169a6bb18df08c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.249+0000 7fa009fc4640 1 --2- 172.21.15.123:0/2269777020 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9fec0a2c00 0x7f9fec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.249+0000 7f9feb7fe640 1 -- 172.21.15.123:0/1460709389 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc016070 con 0x55d215593630 2024-08-18T22:08:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.249+0000 7f9feb7fe640 1 -- 172.21.15.123:0/1460709389 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ffc012450 con 0x55d215593630 2024-08-18T22:08:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.249+0000 7f9feb7fe640 1 -- 172.21.15.123:0/1460709389 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc0116c0 con 0x55d215593630 2024-08-18T22:08:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.249+0000 7fa00de25740 1 -- 172.21.15.123:0/1460709389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593630 msgr2=0x55d215593a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.249+0000 7fa009fc4640 1 --2- 172.21.15.123:0/2269777020 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9fec0a2c00 0x7f9fec0a50c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc011010 tx=0x7f9ffc011de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.249+0000 7fa00de25740 1 --2- 172.21.15.123:0/1460709389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593630 0x55d215593a10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009f30 tx=0x7f9ffc010800 comp rx=0 tx=0).stop 2024-08-18T22:08:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 1 -- 172.21.15.123:0/1460709389 shutdown_connections 2024-08-18T22:08:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 1 --2- 172.21.15.123:0/1460709389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 0x55d2155a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 1 --2- 172.21.15.123:0/1460709389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593f50 0x55d21559e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 1 --2- 172.21.15.123:0/1460709389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593630 0x55d215593a10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 1 -- 172.21.15.123:0/1460709389 >> 172.21.15.123:0/1460709389 conn(0x55d21558fbc0 msgr2=0x55d21558ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 1 -- 172.21.15.123:0/1460709389 shutdown_connections 2024-08-18T22:08:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 1 -- 172.21.15.123:0/1460709389 wait complete. 2024-08-18T22:08:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 1 -- start start 2024-08-18T22:08:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 1 Processor -- start 2024-08-18T22:08:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593630 0x55d21559b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593f50 0x55d21559bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 0x55d21559c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d2155a13e0 con 0x55d215593f50 2024-08-18T22:08:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d2154b3970 con 0x55d21559e810 2024-08-18T22:08:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d2155a1560 con 0x55d215593630 2024-08-18T22:08:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.250+0000 7fa00de25740 10 client.0 _ll_register_callbacks cb 0x55d2152077b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa008fc2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593f50 0x55d21559bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa008fc2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593f50 0x55d21559bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44334/0 (socket says 172.21.15.123:44334) 2024-08-18T22:08:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa008fc2640 1 -- 172.21.15.123:0/2093846373 learned_addr learned my addr 172.21.15.123:0/2093846373 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa0097c3640 1 --2- 172.21.15.123:0/2093846373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593630 0x55d21559b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa009fc4640 1 --2- 172.21.15.123:0/2093846373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 0x55d21559c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa008fc2640 1 -- 172.21.15.123:0/2093846373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593630 msgr2=0x55d21559b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa008fc2640 1 --2- 172.21.15.123:0/2093846373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593630 0x55d21559b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa008fc2640 1 -- 172.21.15.123:0/2093846373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 msgr2=0x55d21559c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa008fc2640 1 --2- 172.21.15.123:0/2093846373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 0x55d21559c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa008fc2640 1 -- 172.21.15.123:0/2093846373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d21526a2b0 con 0x55d215593f50 2024-08-18T22:08:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa0097c3640 1 --2- 172.21.15.123:0/2093846373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593630 0x55d21559b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa009fc4640 1 --2- 172.21.15.123:0/2093846373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 0x55d21559c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa008fc2640 1 --2- 172.21.15.123:0/2093846373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593f50 0x55d21559bb80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800ba60 tx=0x7f9ff800bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9cdc8716318308 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7f9fe8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7f9fe8ff9640 1 -- 172.21.15.123:0/2093846373 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff801b640 con 0x55d215593f50 2024-08-18T22:08:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7f9fe8ff9640 1 -- 172.21.15.123:0/2093846373 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f9ff801b7e0 con 0x55d215593f50 2024-08-18T22:08:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa00de25740 1 -- 172.21.15.123:0/2093846373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ffc012450 con 0x55d215593f50 2024-08-18T22:08:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7f9fe8ff9640 1 -- 172.21.15.123:0/2093846373 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9ff8024050 con 0x55d215593f50 2024-08-18T22:08:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa00de25740 10 client.15423 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7fa00de25740 1 -- 172.21.15.123:0/2093846373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d2155acf30 con 0x55d215593f50 2024-08-18T22:08:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.251+0000 7f9fe8ff9640 1 -- 172.21.15.123:0/2093846373 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ffc012450 con 0x55d215593f50 2024-08-18T22:08:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.252+0000 7f9fe8ff9640 1 -- 172.21.15.123:0/2093846373 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f9ff8019020 con 0x55d215593f50 2024-08-18T22:08:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.252+0000 7fa00de25740 10 client.15423 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.252+0000 7fa00de25740 10 client.15423 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-18T22:08:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.252+0000 7fa00de25740 20 client.15423 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.252+0000 7fa00de25740 1 --2- 172.21.15.123:0/2093846373 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55d2155af5a0 0x55d2155b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.252+0000 7fa00de25740 4 client.15423 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:08:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.252+0000 7fa00de25740 1 -- 172.21.15.123:0/2093846373 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d215505c80 con 0x55d2155af5a0 2024-08-18T22:08:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.252+0000 7fa0097c3640 1 --2- 172.21.15.123:0/2093846373 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55d2155af5a0 0x55d2155b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.253+0000 7fa0097c3640 1 --2- 172.21.15.123:0/2093846373 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55d2155af5a0 0x55d2155b0a10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b74924d0e8fe609c server_cookie=47d2457adc57152d in_seq=0 out_seq=0 2024-08-18T22:08:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.253+0000 7f9fe8ff9640 10 client.15423 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:08:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.253+0000 7f9fe8ff9640 1 -- 172.21.15.123:0/2093846373 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d215505c80 con 0x55d2155af5a0 2024-08-18T22:08:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.253+0000 7f9fe8ff9640 10 client.15423 handle_command_reply: tid=0 2024-08-18T22:08:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.253+0000 7fa00de25740 1 client.15423 shutdown 2024-08-18T22:08:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.254+0000 7fa00de25740 1 -- 172.21.15.123:0/2093846373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593f50 msgr2=0x55d21559bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.254+0000 7fa00de25740 1 --2- 172.21.15.123:0/2093846373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593f50 0x55d21559bb80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800ba60 tx=0x7f9ff800bf20 comp rx=0 tx=0).stop 2024-08-18T22:08:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.254+0000 7fa00de25740 1 -- 172.21.15.123:0/2093846373 shutdown_connections 2024-08-18T22:08:11.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.254+0000 7fa00de25740 1 --2- 172.21.15.123:0/2093846373 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55d2155af5a0 0x55d2155b0a10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.254+0000 7fa00de25740 1 --2- 172.21.15.123:0/2093846373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 0x55d21559c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.254+0000 7fa00de25740 1 --2- 172.21.15.123:0/2093846373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593f50 0x55d21559bb80 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.254+0000 7fa00de25740 1 --2- 172.21.15.123:0/2093846373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593630 0x55d21559b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.254+0000 7f9fe8ff9640 0 client.15423 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:08:11.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.254+0000 7fa00de25740 1 -- 172.21.15.123:0/2093846373 >> 172.21.15.123:0/2093846373 conn(0x55d21558fbc0 msgr2=0x55d21558ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:11.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.254+0000 7fa00de25740 1 -- 172.21.15.123:0/2093846373 shutdown_connections 2024-08-18T22:08:11.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.254+0000 7fa00de25740 1 -- 172.21.15.123:0/2093846373 wait complete. 2024-08-18T22:08:11.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.254+0000 7fa00de25740 20 client.15423 trim_cache size 0 max 16384 2024-08-18T22:08:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.272+0000 7fa00de25740 1 Processor -- start 2024-08-18T22:08:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.272+0000 7fa00de25740 1 -- start start 2024-08-18T22:08:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.272+0000 7fa00de25740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593630 0x55d2155b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.272+0000 7fa00de25740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593f50 0x55d215596090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.272+0000 7fa00de25740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 0x55d21559bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.272+0000 7fa00de25740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d2155aed50 con 0x55d215593630 2024-08-18T22:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.272+0000 7fa00de25740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d2155af420 con 0x55d21559e810 2024-08-18T22:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.272+0000 7fa00de25740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d2155afaf0 con 0x55d215593f50 2024-08-18T22:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.272+0000 7fa0097c3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593630 0x55d2155b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.272+0000 7fa0097c3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593630 0x55d2155b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44350/0 (socket says 172.21.15.123:44350) 2024-08-18T22:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.272+0000 7fa0097c3640 1 -- 172.21.15.123:0/2069072352 learned_addr learned my addr 172.21.15.123:0/2069072352 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.273+0000 7fa008fc2640 1 --2- 172.21.15.123:0/2069072352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593f50 0x55d215596090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.273+0000 7fa009fc4640 1 --2- 172.21.15.123:0/2069072352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 0x55d21559bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.273+0000 7fa0097c3640 1 -- 172.21.15.123:0/2069072352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593f50 msgr2=0x55d215596090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.273+0000 7fa0097c3640 1 --2- 172.21.15.123:0/2069072352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593f50 0x55d215596090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.273+0000 7fa0097c3640 1 -- 172.21.15.123:0/2069072352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 msgr2=0x55d21559bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.273+0000 7fa0097c3640 1 --2- 172.21.15.123:0/2069072352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 0x55d21559bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.273+0000 7fa0097c3640 1 -- 172.21.15.123:0/2069072352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d215590770 con 0x55d215593630 2024-08-18T22:08:11.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.273+0000 7fa0097c3640 1 --2- 172.21.15.123:0/2069072352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593630 0x55d2155b0340 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40b87f0 tx=0x7f9ff402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba1f9273f53550b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:11.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.273+0000 7f9feaffd640 1 -- 172.21.15.123:0/2069072352 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4049040 con 0x55d215593630 2024-08-18T22:08:11.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.273+0000 7f9feaffd640 1 -- 172.21.15.123:0/2069072352 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ff40bc520 con 0x55d215593630 2024-08-18T22:08:11.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.273+0000 7f9feaffd640 1 -- 172.21.15.123:0/2069072352 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40b8490 con 0x55d215593630 2024-08-18T22:08:11.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.274+0000 7fa00de25740 1 -- 172.21.15.123:0/2069072352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593630 msgr2=0x55d2155b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:11.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.274+0000 7fa00de25740 1 --2- 172.21.15.123:0/2069072352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593630 0x55d2155b0340 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40b87f0 tx=0x7f9ff402a480 comp rx=0 tx=0).stop 2024-08-18T22:08:11.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.274+0000 7fa00de25740 1 -- 172.21.15.123:0/2069072352 shutdown_connections 2024-08-18T22:08:11.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.274+0000 7fa00de25740 1 --2- 172.21.15.123:0/2069072352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d21559e810 0x55d21559bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.274+0000 7fa00de25740 1 --2- 172.21.15.123:0/2069072352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d215593f50 0x55d215596090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.274+0000 7fa00de25740 1 --2- 172.21.15.123:0/2069072352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593630 0x55d2155b0340 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.274+0000 7fa00de25740 1 -- 172.21.15.123:0/2069072352 >> 172.21.15.123:0/2069072352 conn(0x55d21558fbc0 msgr2=0x55d215599f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:11.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.274+0000 7fa00de25740 1 -- 172.21.15.123:0/2069072352 shutdown_connections 2024-08-18T22:08:11.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.274+0000 7fa00de25740 1 -- 172.21.15.123:0/2069072352 wait complete. 2024-08-18T22:08:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.274+0000 7fa00de25740 1 -- start start 2024-08-18T22:08:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.274+0000 7fa00de25740 1 Processor -- start 2024-08-18T22:08:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa00de25740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593f50 0x55d2155b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa00de25740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d21559e810 0x55d2155b9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa00de25740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2155b2310 0x55d2155b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa00de25740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d2155b0890 con 0x55d215593f50 2024-08-18T22:08:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa00de25740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d2155b01c0 con 0x55d2155b2310 2024-08-18T22:08:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa00de25740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d2155b0f60 con 0x55d21559e810 2024-08-18T22:08:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa00de25740 10 client.0 _ll_register_callbacks cb 0x7f9ff8004080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa0097c3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593f50 0x55d2155b8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa0097c3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593f50 0x55d2155b8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44356/0 (socket says 172.21.15.123:44356) 2024-08-18T22:08:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa0097c3640 1 -- 172.21.15.123:0/1811864964 learned_addr learned my addr 172.21.15.123:0/1811864964 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa008fc2640 1 --2- 172.21.15.123:0/1811864964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d21559e810 0x55d2155b9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa009fc4640 1 --2- 172.21.15.123:0/1811864964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2155b2310 0x55d2155b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa0097c3640 1 -- 172.21.15.123:0/1811864964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d21559e810 msgr2=0x55d2155b9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa0097c3640 1 --2- 172.21.15.123:0/1811864964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d21559e810 0x55d2155b9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa0097c3640 1 -- 172.21.15.123:0/1811864964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2155b2310 msgr2=0x55d2155b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa0097c3640 1 --2- 172.21.15.123:0/1811864964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2155b2310 0x55d2155b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa0097c3640 1 -- 172.21.15.123:0/1811864964 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2155b2f70 con 0x55d215593f50 2024-08-18T22:08:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7fa0097c3640 1 --2- 172.21.15.123:0/1811864964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593f50 0x55d2155b8fe0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40b8280 tx=0x7f9ff40ba070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546e4c24d8dad24 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.275+0000 7f9fe8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.276+0000 7f9fe8ff9640 1 -- 172.21.15.123:0/1811864964 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40ab060 con 0x55d215593f50 2024-08-18T22:08:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.276+0000 7f9fe8ff9640 1 -- 172.21.15.123:0/1811864964 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f9ff40b8490 con 0x55d215593f50 2024-08-18T22:08:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.276+0000 7fa00de25740 1 -- 172.21.15.123:0/1811864964 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ff40bc520 con 0x55d215593f50 2024-08-18T22:08:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.276+0000 7f9fe8ff9640 1 -- 172.21.15.123:0/1811864964 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9ff40d8070 con 0x55d215593f50 2024-08-18T22:08:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.276+0000 7fa00de25740 10 client.15429 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.276+0000 7fa00de25740 1 -- 172.21.15.123:0/1811864964 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d215619cb0 con 0x55d215593f50 2024-08-18T22:08:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.276+0000 7f9fe8ff9640 1 -- 172.21.15.123:0/1811864964 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ff40bc520 con 0x55d215593f50 2024-08-18T22:08:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.276+0000 7f9fe8ff9640 1 -- 172.21.15.123:0/1811864964 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f9ff40bb270 con 0x55d215593f50 2024-08-18T22:08:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.276+0000 7fa00de25740 10 client.15429 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.276+0000 7fa00de25740 10 client.15429 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-18T22:08:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.276+0000 7fa00de25740 20 client.15429 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.276+0000 7fa00de25740 1 --2- 172.21.15.123:0/1811864964 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55d21561e740 0x55d21561d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.276+0000 7fa00de25740 4 client.15429 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:08:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.276+0000 7fa00de25740 1 -- 172.21.15.123:0/1811864964 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "status"}) -- 0x55d215500190 con 0x55d21561e740 2024-08-18T22:08:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.277+0000 7fa008fc2640 1 --2- 172.21.15.123:0/1811864964 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55d21561e740 0x55d21561d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.277+0000 7fa008fc2640 1 --2- 172.21.15.123:0/1811864964 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55d21561e740 0x55d21561d450 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f2dcb2a6a33aa2e1 server_cookie=fa30d03a4cadf32e in_seq=0 out_seq=0 2024-08-18T22:08:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.277+0000 7f9fe8ff9640 10 client.15429 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:08:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.277+0000 7f9fe8ff9640 1 -- 172.21.15.123:0/1811864964 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d215500190 con 0x55d21561e740 2024-08-18T22:08:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.277+0000 7f9fe8ff9640 10 client.15429 handle_command_reply: tid=0 2024-08-18T22:08:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.277+0000 7fa00de25740 1 client.15429 shutdown 2024-08-18T22:08:11.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.277+0000 7fa00de25740 1 -- 172.21.15.123:0/1811864964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593f50 msgr2=0x55d2155b8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:11.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.277+0000 7fa00de25740 1 --2- 172.21.15.123:0/1811864964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593f50 0x55d2155b8fe0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40b8280 tx=0x7f9ff40ba070 comp rx=0 tx=0).stop 2024-08-18T22:08:11.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.277+0000 7fa00de25740 1 -- 172.21.15.123:0/1811864964 shutdown_connections 2024-08-18T22:08:11.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.277+0000 7fa00de25740 1 --2- 172.21.15.123:0/1811864964 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55d21561e740 0x55d21561d450 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.277+0000 7fa00de25740 1 --2- 172.21.15.123:0/1811864964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2155b2310 0x55d2155b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.277+0000 7fa00de25740 1 --2- 172.21.15.123:0/1811864964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d21559e810 0x55d2155b9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.277+0000 7f9fe8ff9640 0 client.15429 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:08:11.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.277+0000 7fa00de25740 1 --2- 172.21.15.123:0/1811864964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d215593f50 0x55d2155b8fe0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.277+0000 7fa00de25740 1 -- 172.21.15.123:0/1811864964 >> 172.21.15.123:0/1811864964 conn(0x55d21558fbc0 msgr2=0x55d21559a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:11.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.278+0000 7fa00de25740 1 -- 172.21.15.123:0/1811864964 shutdown_connections 2024-08-18T22:08:11.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.278+0000 7fa00de25740 1 -- 172.21.15.123:0/1811864964 wait complete. 2024-08-18T22:08:11.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.278+0000 7fa00de25740 20 client.15429 trim_cache size 0 max 16384 2024-08-18T22:08:11.285 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:08:11.285 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "dfa1db70-5dac-11ef-bccf-c7b262605968", 2024-08-18T22:08:11.285 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 1, 2024-08-18T22:08:11.285 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24458, 2024-08-18T22:08:11.285 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-08-18T22:08:11.285 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-08-18T22:08:11.286 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-08-18T22:08:11.286 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 134.84000135400001, 2024-08-18T22:08:11.286 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 26, 2024-08-18T22:08:11.286 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 92, 2024-08-18T22:08:11.286 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 92, 2024-08-18T22:08:11.286 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 179.629547035 2024-08-18T22:08:11.286 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:08:11.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.278+0000 7fa00ba27640 1 -- 172.21.15.123:0/2269777020 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9fec0a2c00 msgr2=0x7f9fec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:11.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.278+0000 7fa00ba27640 1 --2- 172.21.15.123:0/2269777020 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9fec0a2c00 0x7f9fec0a50c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc011010 tx=0x7f9ffc011de0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.278+0000 7fa00ba27640 1 -- 172.21.15.123:0/2269777020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa004102a70 msgr2=0x7fa0041006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:11.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.278+0000 7fa00ba27640 1 --2- 172.21.15.123:0/2269777020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa004102a70 0x7fa0041006d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4006010 tx=0x7f9ff40042f0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.278+0000 7fa00ba27640 1 -- 172.21.15.123:0/2269777020 shutdown_connections 2024-08-18T22:08:11.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.278+0000 7fa00ba27640 1 --2- 172.21.15.123:0/2269777020 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9fec0a2c00 0x7f9fec0a50c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.278+0000 7fa00ba27640 1 --2- 172.21.15.123:0/2269777020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa00410bea0 0x7fa004101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.278+0000 7fa00ba27640 1 --2- 172.21.15.123:0/2269777020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa004103390 0x7fa004100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.278+0000 7fa00ba27640 1 --2- 172.21.15.123:0/2269777020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa004102a70 0x7fa0041006d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:11.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.278+0000 7fa00ba27640 1 -- 172.21.15.123:0/2269777020 >> 172.21.15.123:0/2269777020 conn(0x7fa0040fc4d0 msgr2=0x7fa0040fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:11.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.278+0000 7fa00ba27640 1 -- 172.21.15.123:0/2269777020 shutdown_connections 2024-08-18T22:08:11.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:11.279+0000 7fa00ba27640 1 -- 172.21.15.123:0/2269777020 wait complete. 2024-08-18T22:08:11.999 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.i status 2024-08-18T22:08:12.247 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:12.633 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:12 smithi123 ceph-mon[18462]: pgmap v353: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-18T22:08:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.713+0000 7f40954ce640 1 -- 172.21.15.123:0/718980296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40901078b0 msgr2=0x7f4090107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.713+0000 7f40954ce640 1 --2- 172.21.15.123:0/718980296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40901078b0 0x7f4090107c90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4080009930 tx=0x7f408002a420 comp rx=0 tx=0).stop 2024-08-18T22:08:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.713+0000 7f40954ce640 1 -- 172.21.15.123:0/718980296 shutdown_connections 2024-08-18T22:08:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.713+0000 7f40954ce640 1 --2- 172.21.15.123:0/718980296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4090102250 0x7f409010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.713+0000 7f40954ce640 1 --2- 172.21.15.123:0/718980296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40901018b0 0x7f4090101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.713+0000 7f40954ce640 1 --2- 172.21.15.123:0/718980296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40901078b0 0x7f4090107c90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.713+0000 7f40954ce640 1 -- 172.21.15.123:0/718980296 >> 172.21.15.123:0/718980296 conn(0x7f40900fd5f0 msgr2=0x7f40900ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.713+0000 7f40954ce640 1 -- 172.21.15.123:0/718980296 shutdown_connections 2024-08-18T22:08:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.713+0000 7f40954ce640 1 -- 172.21.15.123:0/718980296 wait complete. 2024-08-18T22:08:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.713+0000 7f40954ce640 1 Processor -- start 2024-08-18T22:08:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f40954ce640 1 -- start start 2024-08-18T22:08:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f40954ce640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40901018b0 0x7f40901981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f40954ce640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4090102250 0x7f40901986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f40954ce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40901078b0 0x7f409019ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f40954ce640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4090111cb0 con 0x7f40901078b0 2024-08-18T22:08:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f40954ce640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4090111b30 con 0x7f40901018b0 2024-08-18T22:08:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f40954ce640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4090111e30 con 0x7f4090102250 2024-08-18T22:08:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f408f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40901078b0 0x7f409019ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f408f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40901078b0 0x7f409019ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44366/0 (socket says 172.21.15.123:44366) 2024-08-18T22:08:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f408f7fe640 1 -- 172.21.15.123:0/929718147 learned_addr learned my addr 172.21.15.123:0/929718147 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f40867fc640 1 --2- 172.21.15.123:0/929718147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4090102250 0x7f40901986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f408effd640 1 --2- 172.21.15.123:0/929718147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40901018b0 0x7f40901981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f408f7fe640 1 -- 172.21.15.123:0/929718147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4090102250 msgr2=0x7f40901986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f408f7fe640 1 --2- 172.21.15.123:0/929718147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4090102250 0x7f40901986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f408f7fe640 1 -- 172.21.15.123:0/929718147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40901018b0 msgr2=0x7f40901981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f408f7fe640 1 --2- 172.21.15.123:0/929718147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40901018b0 0x7f40901981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.714+0000 7f408f7fe640 1 -- 172.21.15.123:0/929718147 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409019d160 con 0x7f40901078b0 2024-08-18T22:08:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.715+0000 7f408f7fe640 1 --2- 172.21.15.123:0/929718147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40901078b0 0x7f409019ca80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f408800eaa0 tx=0x7f408800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.715+0000 7f408cff9640 1 -- 172.21.15.123:0/929718147 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408800cdb0 con 0x7f40901078b0 2024-08-18T22:08:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.715+0000 7f408cff9640 1 -- 172.21.15.123:0/929718147 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4088005020 con 0x7f40901078b0 2024-08-18T22:08:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.715+0000 7f40954ce640 1 -- 172.21.15.123:0/929718147 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f409019d450 con 0x7f40901078b0 2024-08-18T22:08:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.715+0000 7f408cff9640 1 -- 172.21.15.123:0/929718147 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40880116b0 con 0x7f40901078b0 2024-08-18T22:08:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.715+0000 7f40954ce640 1 -- 172.21.15.123:0/929718147 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40901a4d30 con 0x7f40901078b0 2024-08-18T22:08:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.717+0000 7f408cff9640 1 -- 172.21.15.123:0/929718147 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f4088005560 con 0x7f40901078b0 2024-08-18T22:08:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.717+0000 7f40978cc740 1 Processor -- start 2024-08-18T22:08:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.717+0000 7f40978cc740 1 -- start start 2024-08-18T22:08:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f40978cc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 0x555d0b4e8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f40978cc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f40978cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f40978cc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555d0b44d710 con 0x555d0b4e8f50 2024-08-18T22:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f40978cc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555d0b3e5770 con 0x555d0b4f3810 2024-08-18T22:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f40978cc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555d0b4496d0 con 0x555d0b4e8630 2024-08-18T22:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f408effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f408effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4f32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44380/0 (socket says 172.21.15.123:44380) 2024-08-18T22:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f408effd640 1 -- 172.21.15.123:0/235441109 learned_addr learned my addr 172.21.15.123:0/235441109 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f408cff9640 1 --2- 172.21.15.123:0/929718147 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f407c0a2b80 0x7f407c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f40867fc640 1 --2- 172.21.15.123:0/235441109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 0x555d0b4e8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f40867fc640 1 --2- 172.21.15.123:0/235441109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f408effd640 1 -- 172.21.15.123:0/235441109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 msgr2=0x555d0b4e8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f408f7fe640 1 --2- 172.21.15.123:0/929718147 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f407c0a2b80 0x7f407c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f408effd640 1 --2- 172.21.15.123:0/235441109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 0x555d0b4e8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f408effd640 1 -- 172.21.15.123:0/235441109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 msgr2=0x555d0b4f5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f408effd640 1 --2- 172.21.15.123:0/235441109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4f5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f408effd640 1 -- 172.21.15.123:0/235441109 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0b3ec3e0 con 0x555d0b4e8f50 2024-08-18T22:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.718+0000 7f408effd640 1 --2- 172.21.15.123:0/235441109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4f32d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f408002a940 tx=0x7f4080005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2910689346a161 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.719+0000 7f408cff9640 1 -- 172.21.15.123:0/929718147 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f40880cf510 con 0x7f40901078b0 2024-08-18T22:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.719+0000 7f40857fa640 1 -- 172.21.15.123:0/235441109 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080040070 con 0x555d0b4e8f50 2024-08-18T22:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.719+0000 7f40857fa640 1 -- 172.21.15.123:0/235441109 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40800319f0 con 0x555d0b4e8f50 2024-08-18T22:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.719+0000 7f40857fa640 1 -- 172.21.15.123:0/235441109 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080035040 con 0x555d0b4e8f50 2024-08-18T22:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.719+0000 7f40978cc740 1 -- 172.21.15.123:0/235441109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 msgr2=0x555d0b4f32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.719+0000 7f408f7fe640 1 --2- 172.21.15.123:0/929718147 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f407c0a2b80 0x7f407c0a5040 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4088097ef0 tx=0x7f4088097610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.719+0000 7f40978cc740 1 --2- 172.21.15.123:0/235441109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4f32d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f408002a940 tx=0x7f4080005c00 comp rx=0 tx=0).stop 2024-08-18T22:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 1 -- 172.21.15.123:0/235441109 shutdown_connections 2024-08-18T22:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 1 --2- 172.21.15.123:0/235441109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4f5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 1 --2- 172.21.15.123:0/235441109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4f32d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 1 --2- 172.21.15.123:0/235441109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 0x555d0b4e8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 1 -- 172.21.15.123:0/235441109 >> 172.21.15.123:0/235441109 conn(0x555d0b4e4bc0 msgr2=0x555d0b4e4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 1 -- 172.21.15.123:0/235441109 shutdown_connections 2024-08-18T22:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 1 -- 172.21.15.123:0/235441109 wait complete. 2024-08-18T22:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 1 -- start start 2024-08-18T22:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 1 Processor -- start 2024-08-18T22:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8630 0x555d0b4f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8f50 0x555d0b4f0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555d0b4f63e0 con 0x555d0b4e8630 2024-08-18T22:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555d0b408970 con 0x555d0b4f3810 2024-08-18T22:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555d0b4f6560 con 0x555d0b4e8f50 2024-08-18T22:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40978cc740 10 client.0 _ll_register_callbacks cb 0x555d0b15c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40867fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8630 0x555d0b4f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40867fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8630 0x555d0b4f32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44386/0 (socket says 172.21.15.123:44386) 2024-08-18T22:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f40867fc640 1 -- 172.21.15.123:0/3200328323 learned_addr learned my addr 172.21.15.123:0/3200328323 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.720+0000 7f408effd640 1 --2- 172.21.15.123:0/3200328323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8f50 0x555d0b4f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40867fc640 1 -- 172.21.15.123:0/3200328323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8f50 msgr2=0x555d0b4f0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40867fc640 1 --2- 172.21.15.123:0/3200328323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8f50 0x555d0b4f0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40867fc640 1 -- 172.21.15.123:0/3200328323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 msgr2=0x555d0b4f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40867fc640 1 --2- 172.21.15.123:0/3200328323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40867fc640 1 -- 172.21.15.123:0/3200328323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d0b1bf2b0 con 0x555d0b4e8630 2024-08-18T22:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40867fc640 1 --2- 172.21.15.123:0/3200328323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8630 0x555d0b4f32c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4078010630 tx=0x7f4078010af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca6cd51834b7078 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40767fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40767fc640 1 -- 172.21.15.123:0/3200328323 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40780042f0 con 0x555d0b4e8630 2024-08-18T22:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40767fc640 1 -- 172.21.15.123:0/3200328323 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f4078005020 con 0x555d0b4e8630 2024-08-18T22:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40978cc740 1 -- 172.21.15.123:0/3200328323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40800319f0 con 0x555d0b4e8630 2024-08-18T22:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40767fc640 1 -- 172.21.15.123:0/3200328323 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4078026050 con 0x555d0b4e8630 2024-08-18T22:08:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40978cc740 10 client.15441 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40978cc740 1 -- 172.21.15.123:0/3200328323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555d0b501f70 con 0x555d0b4e8630 2024-08-18T22:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40767fc640 1 -- 172.21.15.123:0/3200328323 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40800319f0 con 0x555d0b4e8630 2024-08-18T22:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40767fc640 1 -- 172.21.15.123:0/3200328323 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4078012720 con 0x555d0b4e8630 2024-08-18T22:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40978cc740 10 client.15441 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40978cc740 10 client.15441 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-18T22:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40978cc740 20 client.15441 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.721+0000 7f40978cc740 1 --2- 172.21.15.123:0/3200328323 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x555d0b504590 0x555d0b505a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.722+0000 7f40978cc740 4 client.15441 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.722+0000 7f40978cc740 1 -- 172.21.15.123:0/3200328323 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d0b45ac80 con 0x555d0b504590 2024-08-18T22:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.722+0000 7f408effd640 1 --2- 172.21.15.123:0/3200328323 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x555d0b504590 0x555d0b505a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.722+0000 7f40767fc640 10 client.15441 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.722+0000 7f408effd640 1 --2- 172.21.15.123:0/3200328323 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x555d0b504590 0x555d0b505a00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbe357864584405c server_cookie=906b16148b433f1b in_seq=0 out_seq=0 2024-08-18T22:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.723+0000 7f40767fc640 1 -- 172.21.15.123:0/3200328323 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d0b45ac80 con 0x555d0b504590 2024-08-18T22:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.723+0000 7f40767fc640 10 client.15441 handle_command_reply: tid=0 2024-08-18T22:08:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.723+0000 7f40978cc740 1 client.15441 shutdown 2024-08-18T22:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.723+0000 7f40978cc740 1 -- 172.21.15.123:0/3200328323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8630 msgr2=0x555d0b4f32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.723+0000 7f40978cc740 1 --2- 172.21.15.123:0/3200328323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8630 0x555d0b4f32c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4078010630 tx=0x7f4078010af0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.723+0000 7f40978cc740 1 -- 172.21.15.123:0/3200328323 shutdown_connections 2024-08-18T22:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.723+0000 7f40978cc740 1 --2- 172.21.15.123:0/3200328323 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x555d0b504590 0x555d0b505a00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.723+0000 7f40978cc740 1 --2- 172.21.15.123:0/3200328323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.723+0000 7f40978cc740 1 --2- 172.21.15.123:0/3200328323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8f50 0x555d0b4f0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.723+0000 7f40978cc740 1 --2- 172.21.15.123:0/3200328323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8630 0x555d0b4f32c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.723+0000 7f40767fc640 0 client.15441 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.723+0000 7f40978cc740 1 -- 172.21.15.123:0/3200328323 >> 172.21.15.123:0/3200328323 conn(0x555d0b4e4bc0 msgr2=0x555d0b4e3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.723+0000 7f40978cc740 1 -- 172.21.15.123:0/3200328323 shutdown_connections 2024-08-18T22:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.723+0000 7f40978cc740 1 -- 172.21.15.123:0/3200328323 wait complete. 2024-08-18T22:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.723+0000 7f40978cc740 20 client.15441 trim_cache size 0 max 16384 2024-08-18T22:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f40978cc740 1 Processor -- start 2024-08-18T22:08:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f40978cc740 1 -- start start 2024-08-18T22:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f40978cc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 0x555d0b505330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f40978cc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4efde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f40978cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f40978cc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555d0b503d40 con 0x555d0b4e8f50 2024-08-18T22:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f40978cc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555d0b504410 con 0x555d0b4f3810 2024-08-18T22:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f40978cc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555d0b504ae0 con 0x555d0b4e8630 2024-08-18T22:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f408effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f408effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4efde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57686/0 (socket says 172.21.15.123:57686) 2024-08-18T22:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f408effd640 1 -- 172.21.15.123:0/732438201 learned_addr learned my addr 172.21.15.123:0/732438201 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f40867fc640 1 --2- 172.21.15.123:0/732438201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f40867fc640 1 --2- 172.21.15.123:0/732438201 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 0x555d0b505330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f408effd640 1 -- 172.21.15.123:0/732438201 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 msgr2=0x555d0b505330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f408effd640 1 --2- 172.21.15.123:0/732438201 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 0x555d0b505330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f408effd640 1 -- 172.21.15.123:0/732438201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 msgr2=0x555d0b4f2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f408effd640 1 --2- 172.21.15.123:0/732438201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4f2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.741+0000 7f408effd640 1 -- 172.21.15.123:0/732438201 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0b4e49f0 con 0x555d0b4e8f50 2024-08-18T22:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.742+0000 7f40867fc640 1 --2- 172.21.15.123:0/732438201 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 0x555d0b505330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.742+0000 7f408effd640 1 --2- 172.21.15.123:0/732438201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4efde0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4080009930 tx=0x7f4080000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00f68de07215014 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.742+0000 7f4084ff9640 1 -- 172.21.15.123:0/732438201 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080040040 con 0x555d0b4e8f50 2024-08-18T22:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.742+0000 7f4084ff9640 1 -- 172.21.15.123:0/732438201 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40800319b0 con 0x555d0b4e8f50 2024-08-18T22:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.742+0000 7f4084ff9640 1 -- 172.21.15.123:0/732438201 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080035040 con 0x555d0b4e8f50 2024-08-18T22:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.742+0000 7f40978cc740 1 -- 172.21.15.123:0/732438201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 msgr2=0x555d0b4efde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.742+0000 7f40978cc740 1 --2- 172.21.15.123:0/732438201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4efde0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4080009930 tx=0x7f4080000bc0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 1 -- 172.21.15.123:0/732438201 shutdown_connections 2024-08-18T22:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 1 --2- 172.21.15.123:0/732438201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 1 --2- 172.21.15.123:0/732438201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4efde0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 1 --2- 172.21.15.123:0/732438201 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 0x555d0b505330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 1 -- 172.21.15.123:0/732438201 >> 172.21.15.123:0/732438201 conn(0x555d0b4e4bc0 msgr2=0x555d0b4fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 1 -- 172.21.15.123:0/732438201 shutdown_connections 2024-08-18T22:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 1 -- 172.21.15.123:0/732438201 wait complete. 2024-08-18T22:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 1 -- start start 2024-08-18T22:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 1 Processor -- start 2024-08-18T22:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 0x555d0b4ed670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4edbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555d0b505880 con 0x555d0b4e8f50 2024-08-18T22:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555d0b5051b0 con 0x555d0b4f3810 2024-08-18T22:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555d0b505f50 con 0x555d0b4e8630 2024-08-18T22:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f40978cc740 10 client.0 _ll_register_callbacks cb 0x7f407800beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f408effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4edbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f408effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4edbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57692/0 (socket says 172.21.15.123:57692) 2024-08-18T22:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.743+0000 7f408effd640 1 -- 172.21.15.123:0/2263678857 learned_addr learned my addr 172.21.15.123:0/2263678857 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f40867fc640 1 --2- 172.21.15.123:0/2263678857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 0x555d0b4ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f40867fc640 1 --2- 172.21.15.123:0/2263678857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f408effd640 1 -- 172.21.15.123:0/2263678857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 msgr2=0x555d0b4ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f408effd640 1 --2- 172.21.15.123:0/2263678857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 0x555d0b4ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f408effd640 1 -- 172.21.15.123:0/2263678857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 msgr2=0x555d0b4ee0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f408effd640 1 --2- 172.21.15.123:0/2263678857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4ee0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f408effd640 1 -- 172.21.15.123:0/2263678857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d0b4e0130 con 0x555d0b4e8f50 2024-08-18T22:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f40867fc640 1 --2- 172.21.15.123:0/2263678857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4ee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f408effd640 1 --2- 172.21.15.123:0/2263678857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4edbb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f408002a940 tx=0x7f40800316c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c47b2825d12bfe2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f40767fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f40767fc640 1 -- 172.21.15.123:0/2263678857 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408005d060 con 0x555d0b4e8f50 2024-08-18T22:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f40978cc740 1 -- 172.21.15.123:0/2263678857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40800319b0 con 0x555d0b4e8f50 2024-08-18T22:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f40767fc640 1 -- 172.21.15.123:0/2263678857 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f4080005040 con 0x555d0b4e8f50 2024-08-18T22:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f40767fc640 1 -- 172.21.15.123:0/2263678857 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4080064050 con 0x555d0b4e8f50 2024-08-18T22:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f40978cc740 10 client.15447 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f40978cc740 1 -- 172.21.15.123:0/2263678857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555d0b56ed00 con 0x555d0b4e8f50 2024-08-18T22:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.744+0000 7f40767fc640 1 -- 172.21.15.123:0/2263678857 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40800319b0 con 0x555d0b4e8f50 2024-08-18T22:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.745+0000 7f40767fc640 1 -- 172.21.15.123:0/2263678857 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4080003ce0 con 0x555d0b4e8f50 2024-08-18T22:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.745+0000 7f40978cc740 10 client.15447 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.745+0000 7f40978cc740 10 client.15447 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-18T22:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.745+0000 7f40978cc740 20 client.15447 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.745+0000 7f40978cc740 1 --2- 172.21.15.123:0/2263678857 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x555d0b573220 0x555d0b571f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.745+0000 7f40978cc740 4 client.15447 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.745+0000 7f40978cc740 1 -- 172.21.15.123:0/2263678857 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "status"}) -- 0x555d0b455190 con 0x555d0b573220 2024-08-18T22:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.745+0000 7f40867fc640 1 --2- 172.21.15.123:0/2263678857 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x555d0b573220 0x555d0b571f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40867fc640 1 --2- 172.21.15.123:0/2263678857 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x555d0b573220 0x555d0b571f30 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a00287178bdec49d server_cookie=15e5670838097a12 in_seq=0 out_seq=0 2024-08-18T22:08:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40767fc640 10 client.15447 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40767fc640 1 -- 172.21.15.123:0/2263678857 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x555d0b455190 con 0x555d0b573220 2024-08-18T22:08:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40767fc640 10 client.15447 handle_command_reply: tid=0 2024-08-18T22:08:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40978cc740 1 client.15447 shutdown 2024-08-18T22:08:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40978cc740 1 -- 172.21.15.123:0/2263678857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 msgr2=0x555d0b4edbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40978cc740 1 --2- 172.21.15.123:0/2263678857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4edbb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f408002a940 tx=0x7f40800316c0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40978cc740 1 -- 172.21.15.123:0/2263678857 shutdown_connections 2024-08-18T22:08:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40978cc740 1 --2- 172.21.15.123:0/2263678857 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x555d0b573220 0x555d0b571f30 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40978cc740 1 --2- 172.21.15.123:0/2263678857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d0b4f3810 0x555d0b4ee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40978cc740 1 --2- 172.21.15.123:0/2263678857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d0b4e8f50 0x555d0b4edbb0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40978cc740 1 --2- 172.21.15.123:0/2263678857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d0b4e8630 0x555d0b4ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40978cc740 1 -- 172.21.15.123:0/2263678857 >> 172.21.15.123:0/2263678857 conn(0x555d0b4e4bc0 msgr2=0x555d0b4e3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:12.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40767fc640 0 client.15447 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:12.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40978cc740 1 -- 172.21.15.123:0/2263678857 shutdown_connections 2024-08-18T22:08:12.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40978cc740 1 -- 172.21.15.123:0/2263678857 wait complete. 2024-08-18T22:08:12.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.746+0000 7f40978cc740 20 client.15447 trim_cache size 0 max 16384 2024-08-18T22:08:12.763 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:08:12.763 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "dfa1db70-5dac-11ef-bccf-c7b262605968", 2024-08-18T22:08:12.763 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-08-18T22:08:12.763 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24466, 2024-08-18T22:08:12.763 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-08-18T22:08:12.763 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-08-18T22:08:12.763 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-08-18T22:08:12.764 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 169.885314988, 2024-08-18T22:08:12.764 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 26, 2024-08-18T22:08:12.764 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 92, 2024-08-18T22:08:12.764 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 92, 2024-08-18T22:08:12.764 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 190.10898197 2024-08-18T22:08:12.764 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:08:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.747+0000 7f40954ce640 1 -- 172.21.15.123:0/929718147 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f407c0a2b80 msgr2=0x7f407c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.747+0000 7f40954ce640 1 --2- 172.21.15.123:0/929718147 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f407c0a2b80 0x7f407c0a5040 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4088097ef0 tx=0x7f4088097610 comp rx=0 tx=0).stop 2024-08-18T22:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.747+0000 7f40954ce640 1 -- 172.21.15.123:0/929718147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40901078b0 msgr2=0x7f409019ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.747+0000 7f40954ce640 1 --2- 172.21.15.123:0/929718147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40901078b0 0x7f409019ca80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f408800eaa0 tx=0x7f408800ef60 comp rx=0 tx=0).stop 2024-08-18T22:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.747+0000 7f40954ce640 1 -- 172.21.15.123:0/929718147 shutdown_connections 2024-08-18T22:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.747+0000 7f40954ce640 1 --2- 172.21.15.123:0/929718147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40901078b0 0x7f409019ca80 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.747+0000 7f40954ce640 1 --2- 172.21.15.123:0/929718147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4090102250 0x7f40901986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.747+0000 7f40954ce640 1 --2- 172.21.15.123:0/929718147 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f407c0a2b80 0x7f407c0a5040 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.747+0000 7f40954ce640 1 --2- 172.21.15.123:0/929718147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40901018b0 0x7f40901981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.747+0000 7f40954ce640 1 -- 172.21.15.123:0/929718147 >> 172.21.15.123:0/929718147 conn(0x7f40900fd5f0 msgr2=0x7f40900fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.747+0000 7f40954ce640 1 -- 172.21.15.123:0/929718147 shutdown_connections 2024-08-18T22:08:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:12.747+0000 7f40954ce640 1 -- 172.21.15.123:0/929718147 wait complete. 2024-08-18T22:08:12.766 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:12 smithi130 ceph-mon[21698]: pgmap v353: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-18T22:08:12.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:12 smithi183 ceph-mon[22097]: pgmap v353: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-18T22:08:13.551 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-08-18T22:08:14.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:14 smithi123 ceph-mon[18462]: pgmap v354: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-08-18T22:08:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:14 smithi130 ceph-mon[21698]: pgmap v354: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-08-18T22:08:14.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:14 smithi183 ceph-mon[22097]: pgmap v354: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-08-18T22:08:16.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:16 smithi123 ceph-mon[18462]: pgmap v355: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-08-18T22:08:16.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:16 smithi130 ceph-mon[21698]: pgmap v355: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-08-18T22:08:16.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:16 smithi183 ceph-mon[22097]: pgmap v355: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-08-18T22:08:18.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:18 smithi123 ceph-mon[18462]: pgmap v356: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-08-18T22:08:18.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:18 smithi130 ceph-mon[21698]: pgmap v356: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-08-18T22:08:18.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:18 smithi183 ceph-mon[22097]: pgmap v356: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-08-18T22:08:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.258+0000 7fd0553d8640 1 -- 172.21.15.123:0/3838442424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd050104c50 msgr2=0x7fd050107040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.258+0000 7fd0553d8640 1 --2- 172.21.15.123:0/3838442424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd050104c50 0x7fd050107040 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd044009900 tx=0x7fd04402a410 comp rx=0 tx=0).stop 2024-08-18T22:08:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.259+0000 7fd0553d8640 1 -- 172.21.15.123:0/3838442424 shutdown_connections 2024-08-18T22:08:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.259+0000 7fd0553d8640 1 --2- 172.21.15.123:0/3838442424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd050107580 0x7fd0501099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.259+0000 7fd0553d8640 1 --2- 172.21.15.123:0/3838442424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd050104c50 0x7fd050107040 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.259+0000 7fd0553d8640 1 --2- 172.21.15.123:0/3838442424 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd050102320 0x7fd050104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.259+0000 7fd0553d8640 1 -- 172.21.15.123:0/3838442424 >> 172.21.15.123:0/3838442424 conn(0x7fd0500fbf20 msgr2=0x7fd0500fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.259+0000 7fd0553d8640 1 -- 172.21.15.123:0/3838442424 shutdown_connections 2024-08-18T22:08:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.259+0000 7fd0553d8640 1 -- 172.21.15.123:0/3838442424 wait complete. 2024-08-18T22:08:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.259+0000 7fd0553d8640 1 Processor -- start 2024-08-18T22:08:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.259+0000 7fd0553d8640 1 -- start start 2024-08-18T22:08:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd0553d8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd050102320 0x7fd050197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd0553d8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd050104c50 0x7fd050198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd0553d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd050107580 0x7fd05019f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd0553d8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd05010d550 con 0x7fd050104c50 2024-08-18T22:08:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd0553d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd05010d3d0 con 0x7fd050107580 2024-08-18T22:08:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd0553d8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd05010d6d0 con 0x7fd050102320 2024-08-18T22:08:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd04e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd050104c50 0x7fd050198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd04e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd050104c50 0x7fd050198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57712/0 (socket says 172.21.15.123:57712) 2024-08-18T22:08:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd04e7fc640 1 -- 172.21.15.123:0/4251958384 learned_addr learned my addr 172.21.15.123:0/4251958384 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd04f7fe640 1 --2- 172.21.15.123:0/4251958384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd050107580 0x7fd05019f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd04effd640 1 --2- 172.21.15.123:0/4251958384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd050102320 0x7fd050197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd04e7fc640 1 -- 172.21.15.123:0/4251958384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd050102320 msgr2=0x7fd050197c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd04e7fc640 1 --2- 172.21.15.123:0/4251958384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd050102320 0x7fd050197c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd04e7fc640 1 -- 172.21.15.123:0/4251958384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd050107580 msgr2=0x7fd05019f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd04e7fc640 1 --2- 172.21.15.123:0/4251958384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd050107580 0x7fd05019f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd04e7fc640 1 -- 172.21.15.123:0/4251958384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05019f840 con 0x7fd050104c50 2024-08-18T22:08:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd04e7fc640 1 --2- 172.21.15.123:0/4251958384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd050104c50 0x7fd050198170 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd044006010 tx=0x7fd044031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd037fff640 1 -- 172.21.15.123:0/4251958384 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04403f030 con 0x7fd050104c50 2024-08-18T22:08:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd0553d8640 1 -- 172.21.15.123:0/4251958384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05019fad0 con 0x7fd050104c50 2024-08-18T22:08:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd037fff640 1 -- 172.21.15.123:0/4251958384 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0440044a0 con 0x7fd050104c50 2024-08-18T22:08:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.260+0000 7fd037fff640 1 -- 172.21.15.123:0/4251958384 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044035070 con 0x7fd050104c50 2024-08-18T22:08:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.261+0000 7fd0553d8640 1 -- 172.21.15.123:0/4251958384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0501a0010 con 0x7fd050104c50 2024-08-18T22:08:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.263+0000 7fd037fff640 1 -- 172.21.15.123:0/4251958384 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fd044042030 con 0x7fd050104c50 2024-08-18T22:08:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.263+0000 7fd058276740 1 Processor -- start 2024-08-18T22:08:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.263+0000 7fd058276740 1 -- start start 2024-08-18T22:08:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.263+0000 7fd058276740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6680 0x55e3310e6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.263+0000 7fd058276740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6fc0 0x55e3310eba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.263+0000 7fd058276740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310ec050 0x55e3310ee510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.263+0000 7fd058276740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e3310499d0 con 0x55e3310e6680 2024-08-18T22:08:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.263+0000 7fd058276740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e330ff1820 con 0x55e3310e6fc0 2024-08-18T22:08:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.263+0000 7fd058276740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e331045990 con 0x55e3310ec050 2024-08-18T22:08:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd04f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6680 0x55e3310e6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd04f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6680 0x55e3310e6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57720/0 (socket says 172.21.15.123:57720) 2024-08-18T22:08:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd04f7fe640 1 -- 172.21.15.123:0/2489423436 learned_addr learned my addr 172.21.15.123:0/2489423436 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd04e7fc640 1 --2- 172.21.15.123:0/2489423436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310ec050 0x55e3310ee510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd04effd640 1 --2- 172.21.15.123:0/2489423436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6fc0 0x55e3310eba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd04f7fe640 1 -- 172.21.15.123:0/2489423436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310ec050 msgr2=0x55e3310ee510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd04f7fe640 1 --2- 172.21.15.123:0/2489423436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310ec050 0x55e3310ee510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd04f7fe640 1 -- 172.21.15.123:0/2489423436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6fc0 msgr2=0x55e3310eba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd04f7fe640 1 --2- 172.21.15.123:0/2489423436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6fc0 0x55e3310eba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd04f7fe640 1 -- 172.21.15.123:0/2489423436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e330d5d210 con 0x55e3310e6680 2024-08-18T22:08:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd037fff640 1 --2- 172.21.15.123:0/4251958384 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd0380a2cb0 0x7fd0380a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd04effd640 1 --2- 172.21.15.123:0/2489423436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6fc0 0x55e3310eba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd04e7fc640 1 --2- 172.21.15.123:0/2489423436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310ec050 0x55e3310ee510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd04f7fe640 1 --2- 172.21.15.123:0/2489423436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6680 0x55e3310e6a80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd04800b680 tx=0x7fd04800bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff0609dfcee9326 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd04effd640 1 --2- 172.21.15.123:0/4251958384 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd0380a2cb0 0x7fd0380a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd037fff640 1 -- 172.21.15.123:0/4251958384 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fd0440ef8f0 con 0x7fd050104c50 2024-08-18T22:08:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd0357fa640 1 -- 172.21.15.123:0/2489423436 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048003bd0 con 0x55e3310e6680 2024-08-18T22:08:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd0357fa640 1 -- 172.21.15.123:0/2489423436 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd048015070 con 0x55e3310e6680 2024-08-18T22:08:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.264+0000 7fd0357fa640 1 -- 172.21.15.123:0/2489423436 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0480106a0 con 0x55e3310e6680 2024-08-18T22:08:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.265+0000 7fd058276740 1 -- 172.21.15.123:0/2489423436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6680 msgr2=0x55e3310e6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.265+0000 7fd04effd640 1 --2- 172.21.15.123:0/4251958384 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd0380a2cb0 0x7fd0380a5170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55e3310e79f0 tx=0x7fd040009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.265+0000 7fd058276740 1 --2- 172.21.15.123:0/2489423436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6680 0x55e3310e6a80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd04800b680 tx=0x7fd04800bb40 comp rx=0 tx=0).stop 2024-08-18T22:08:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.265+0000 7fd058276740 1 -- 172.21.15.123:0/2489423436 shutdown_connections 2024-08-18T22:08:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.265+0000 7fd058276740 1 --2- 172.21.15.123:0/2489423436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310ec050 0x55e3310ee510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.265+0000 7fd058276740 1 --2- 172.21.15.123:0/2489423436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6fc0 0x55e3310eba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.265+0000 7fd058276740 1 --2- 172.21.15.123:0/2489423436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6680 0x55e3310e6a80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.265+0000 7fd058276740 1 -- 172.21.15.123:0/2489423436 >> 172.21.15.123:0/2489423436 conn(0x55e3310e1cf0 msgr2=0x55e3310e20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.265+0000 7fd058276740 1 -- 172.21.15.123:0/2489423436 shutdown_connections 2024-08-18T22:08:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.265+0000 7fd058276740 1 -- 172.21.15.123:0/2489423436 wait complete. 2024-08-18T22:08:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.265+0000 7fd058276740 1 -- start start 2024-08-18T22:08:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.265+0000 7fd058276740 1 Processor -- start 2024-08-18T22:08:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd058276740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6680 0x55e3310f0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd058276740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6fc0 0x55e3310f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd058276740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310ec050 0x55e3310f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd058276740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e3310ef020 con 0x55e3310e6fc0 2024-08-18T22:08:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd058276740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e331005520 con 0x55e3310e6680 2024-08-18T22:08:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd058276740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e3310ef1a0 con 0x55e3310ec050 2024-08-18T22:08:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd058276740 10 client.0 _ll_register_callbacks cb 0x55e330d5ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd04e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6fc0 0x55e3310f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd04effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6680 0x55e3310f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd04e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6fc0 0x55e3310f0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57724/0 (socket says 172.21.15.123:57724) 2024-08-18T22:08:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd04e7fc640 1 -- 172.21.15.123:0/2516487298 learned_addr learned my addr 172.21.15.123:0/2516487298 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd04f7fe640 1 --2- 172.21.15.123:0/2516487298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310ec050 0x55e3310f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd04e7fc640 1 -- 172.21.15.123:0/2516487298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310ec050 msgr2=0x55e3310f7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd04e7fc640 1 --2- 172.21.15.123:0/2516487298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310ec050 0x55e3310f7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd04e7fc640 1 -- 172.21.15.123:0/2516487298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6680 msgr2=0x55e3310f0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd04e7fc640 1 --2- 172.21.15.123:0/2516487298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6680 0x55e3310f0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd04e7fc640 1 -- 172.21.15.123:0/2516487298 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e330e29620 con 0x55e3310e6fc0 2024-08-18T22:08:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd04e7fc640 1 --2- 172.21.15.123:0/2516487298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6fc0 0x55e3310f0d70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd0440c4500 tx=0x7fd044009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9e96220aacd8a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd032ff5640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd032ff5640 1 -- 172.21.15.123:0/2516487298 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044049040 con 0x55e3310e6fc0 2024-08-18T22:08:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd032ff5640 1 -- 172.21.15.123:0/2516487298 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fd04403b460 con 0x55e3310e6fc0 2024-08-18T22:08:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.266+0000 7fd058276740 1 -- 172.21.15.123:0/2516487298 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd048015070 con 0x55e3310e6fc0 2024-08-18T22:08:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.267+0000 7fd032ff5640 1 -- 172.21.15.123:0/2516487298 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd0440bb9b0 con 0x55e3310e6fc0 2024-08-18T22:08:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.267+0000 7fd058276740 10 client.15459 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.267+0000 7fd058276740 1 -- 172.21.15.123:0/2516487298 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e3310fab10 con 0x55e3310e6fc0 2024-08-18T22:08:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.267+0000 7fd032ff5640 1 -- 172.21.15.123:0/2516487298 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd048015070 con 0x55e3310e6fc0 2024-08-18T22:08:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.267+0000 7fd032ff5640 1 -- 172.21.15.123:0/2516487298 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd0440bc160 con 0x55e3310e6fc0 2024-08-18T22:08:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.267+0000 7fd058276740 10 client.15459 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.267+0000 7fd058276740 10 client.15459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.267+0000 7fd058276740 20 client.15459 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.267+0000 7fd058276740 1 --2- 172.21.15.123:0/2516487298 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e3310fc150 0x55e3310fe590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.267+0000 7fd058276740 4 client.15459 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:08:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.267+0000 7fd058276740 1 -- 172.21.15.123:0/2516487298 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e331057100 con 0x55e3310fc150 2024-08-18T22:08:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.267+0000 7fd04effd640 1 --2- 172.21.15.123:0/2516487298 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e3310fc150 0x55e3310fe590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.268+0000 7fd032ff5640 10 client.15459 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.268+0000 7fd04effd640 1 --2- 172.21.15.123:0/2516487298 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e3310fc150 0x55e3310fe590 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e038e35beeed6e server_cookie=8a8db71e91b0f7d in_seq=0 out_seq=0 2024-08-18T22:08:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.268+0000 7fd032ff5640 1 -- 172.21.15.123:0/2516487298 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e331057100 con 0x55e3310fc150 2024-08-18T22:08:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.268+0000 7fd032ff5640 10 client.15459 handle_command_reply: tid=0 2024-08-18T22:08:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.268+0000 7fd058276740 1 client.15459 shutdown 2024-08-18T22:08:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.269+0000 7fd058276740 1 -- 172.21.15.123:0/2516487298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6fc0 msgr2=0x55e3310f0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.269+0000 7fd058276740 1 --2- 172.21.15.123:0/2516487298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6fc0 0x55e3310f0d70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd0440c4500 tx=0x7fd044009630 comp rx=0 tx=0).stop 2024-08-18T22:08:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.269+0000 7fd058276740 1 -- 172.21.15.123:0/2516487298 shutdown_connections 2024-08-18T22:08:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.269+0000 7fd058276740 1 --2- 172.21.15.123:0/2516487298 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e3310fc150 0x55e3310fe590 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.269+0000 7fd058276740 1 --2- 172.21.15.123:0/2516487298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310ec050 0x55e3310f7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.269+0000 7fd058276740 1 --2- 172.21.15.123:0/2516487298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6fc0 0x55e3310f0d70 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.269+0000 7fd058276740 1 --2- 172.21.15.123:0/2516487298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6680 0x55e3310f0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.269+0000 7fd032ff5640 0 client.15459 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:20.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.269+0000 7fd058276740 1 -- 172.21.15.123:0/2516487298 >> 172.21.15.123:0/2516487298 conn(0x55e3310e1cf0 msgr2=0x55e3310e3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:20.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.269+0000 7fd058276740 1 -- 172.21.15.123:0/2516487298 shutdown_connections 2024-08-18T22:08:20.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.269+0000 7fd058276740 1 -- 172.21.15.123:0/2516487298 wait complete. 2024-08-18T22:08:20.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.269+0000 7fd058276740 20 client.15459 trim_cache size 0 max 16384 2024-08-18T22:08:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.283+0000 7fd058276740 1 Processor -- start 2024-08-18T22:08:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.283+0000 7fd058276740 1 -- start start 2024-08-18T22:08:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.283+0000 7fd058276740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6680 0x55e3310dc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.283+0000 7fd058276740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310e6fc0 0x55e3310f7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.283+0000 7fd058276740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310ec050 0x55e3310e0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.283+0000 7fd058276740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd0501ace00 con 0x55e3310e6680 2024-08-18T22:08:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.283+0000 7fd058276740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd0501aa6d0 con 0x55e3310ec050 2024-08-18T22:08:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.283+0000 7fd058276740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd0501a8520 con 0x55e3310e6fc0 2024-08-18T22:08:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd04effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6680 0x55e3310dc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd04effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6680 0x55e3310dc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57736/0 (socket says 172.21.15.123:57736) 2024-08-18T22:08:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd04effd640 1 -- 172.21.15.123:0/2825575963 learned_addr learned my addr 172.21.15.123:0/2825575963 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd04e7fc640 1 --2- 172.21.15.123:0/2825575963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310e6fc0 0x55e3310f7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd04effd640 1 -- 172.21.15.123:0/2825575963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310e6fc0 msgr2=0x55e3310f7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd04f7fe640 1 --2- 172.21.15.123:0/2825575963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310ec050 0x55e3310e0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd04effd640 1 --2- 172.21.15.123:0/2825575963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310e6fc0 0x55e3310f7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd04effd640 1 -- 172.21.15.123:0/2825575963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310ec050 msgr2=0x55e3310e0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd04effd640 1 --2- 172.21.15.123:0/2825575963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310ec050 0x55e3310e0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd04effd640 1 -- 172.21.15.123:0/2825575963 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3310e74a0 con 0x55e3310e6680 2024-08-18T22:08:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd04e7fc640 1 --2- 172.21.15.123:0/2825575963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310e6fc0 0x55e3310f7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd04f7fe640 1 --2- 172.21.15.123:0/2825575963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310ec050 0x55e3310e0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd04effd640 1 --2- 172.21.15.123:0/2825575963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6680 0x55e3310dc920 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x55e3310e2b70 tx=0x7fd040014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92faed8ce451568 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd034ff9640 1 -- 172.21.15.123:0/2825575963 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04002d070 con 0x55e3310e6680 2024-08-18T22:08:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd034ff9640 1 -- 172.21.15.123:0/2825575963 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd04001fd50 con 0x55e3310e6680 2024-08-18T22:08:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.284+0000 7fd034ff9640 1 -- 172.21.15.123:0/2825575963 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040004680 con 0x55e3310e6680 2024-08-18T22:08:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 -- 172.21.15.123:0/2825575963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6680 msgr2=0x55e3310dc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 --2- 172.21.15.123:0/2825575963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6680 0x55e3310dc920 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x55e3310e2b70 tx=0x7fd040014000 comp rx=0 tx=0).stop 2024-08-18T22:08:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 -- 172.21.15.123:0/2825575963 shutdown_connections 2024-08-18T22:08:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 --2- 172.21.15.123:0/2825575963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310ec050 0x55e3310e0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 --2- 172.21.15.123:0/2825575963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310e6fc0 0x55e3310f7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 --2- 172.21.15.123:0/2825575963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310e6680 0x55e3310dc920 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 -- 172.21.15.123:0/2825575963 >> 172.21.15.123:0/2825575963 conn(0x55e3310e1cf0 msgr2=0x55e3310e0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 -- 172.21.15.123:0/2825575963 shutdown_connections 2024-08-18T22:08:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 -- 172.21.15.123:0/2825575963 wait complete. 2024-08-18T22:08:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 -- start start 2024-08-18T22:08:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 Processor -- start 2024-08-18T22:08:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310e6680 0x55e3310f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6fc0 0x55e3310f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310ec050 0x55e3310f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd0501a8b90 con 0x55e3310ec050 2024-08-18T22:08:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd0501aa000 con 0x55e3310e6fc0 2024-08-18T22:08:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd0501a9260 con 0x55e3310e6680 2024-08-18T22:08:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd058276740 10 client.0 _ll_register_callbacks cb 0x7fd044005780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.285+0000 7fd04f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310ec050 0x55e3310f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd04f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310ec050 0x55e3310f70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57750/0 (socket says 172.21.15.123:57750) 2024-08-18T22:08:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd04f7fe640 1 -- 172.21.15.123:0/3526898988 learned_addr learned my addr 172.21.15.123:0/3526898988 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd04effd640 1 --2- 172.21.15.123:0/3526898988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310e6680 0x55e3310f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd04e7fc640 1 --2- 172.21.15.123:0/3526898988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6fc0 0x55e3310f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd04f7fe640 1 -- 172.21.15.123:0/3526898988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310e6680 msgr2=0x55e3310f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd04f7fe640 1 --2- 172.21.15.123:0/3526898988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310e6680 0x55e3310f5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd04f7fe640 1 -- 172.21.15.123:0/3526898988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6fc0 msgr2=0x55e3310f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd04f7fe640 1 --2- 172.21.15.123:0/3526898988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6fc0 0x55e3310f60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd04f7fe640 1 -- 172.21.15.123:0/3526898988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3310f76f0 con 0x55e3310ec050 2024-08-18T22:08:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd04e7fc640 1 --2- 172.21.15.123:0/3526898988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6fc0 0x55e3310f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd04f7fe640 1 --2- 172.21.15.123:0/3526898988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310ec050 0x55e3310f70e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd048006010 tx=0x7fd04800bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3da997299b95c65 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd032ff5640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd032ff5640 1 -- 172.21.15.123:0/3526898988 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04802a060 con 0x55e3310ec050 2024-08-18T22:08:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd032ff5640 1 -- 172.21.15.123:0/3526898988 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fd04801a670 con 0x55e3310ec050 2024-08-18T22:08:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd058276740 1 -- 172.21.15.123:0/3526898988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd04001fd50 con 0x55e3310ec050 2024-08-18T22:08:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd032ff5640 1 -- 172.21.15.123:0/3526898988 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd048031050 con 0x55e3310ec050 2024-08-18T22:08:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd058276740 10 client.15465 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd058276740 1 -- 172.21.15.123:0/3526898988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e331167500 con 0x55e3310ec050 2024-08-18T22:08:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.286+0000 7fd032ff5640 1 -- 172.21.15.123:0/3526898988 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd04001fd50 con 0x55e3310ec050 2024-08-18T22:08:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.287+0000 7fd032ff5640 1 -- 172.21.15.123:0/3526898988 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd048011b60 con 0x55e3310ec050 2024-08-18T22:08:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.287+0000 7fd058276740 10 client.15465 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.287+0000 7fd058276740 10 client.15465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.287+0000 7fd058276740 20 client.15465 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.287+0000 7fd058276740 1 --2- 172.21.15.123:0/3526898988 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e331167cf0 0x55e33116a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.287+0000 7fd058276740 4 client.15465 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:08:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.287+0000 7fd058276740 1 -- 172.21.15.123:0/3526898988 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e331051450 con 0x55e331167cf0 2024-08-18T22:08:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.287+0000 7fd04effd640 1 --2- 172.21.15.123:0/3526898988 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e331167cf0 0x55e33116a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.287+0000 7fd032ff5640 10 client.15465 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.287+0000 7fd04effd640 1 --2- 172.21.15.123:0/3526898988 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e331167cf0 0x55e33116a110 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a95899404a0ac765 server_cookie=1ff783bee5f734a7 in_seq=0 out_seq=0 2024-08-18T22:08:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.293+0000 7fd032ff5640 1 -- 172.21.15.123:0/3526898988 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e331051450 con 0x55e331167cf0 2024-08-18T22:08:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.293+0000 7fd032ff5640 10 client.15465 handle_command_reply: tid=0 2024-08-18T22:08:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.293+0000 7fd058276740 1 client.15465 shutdown 2024-08-18T22:08:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd058276740 1 -- 172.21.15.123:0/3526898988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310ec050 msgr2=0x55e3310f70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd058276740 1 --2- 172.21.15.123:0/3526898988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310ec050 0x55e3310f70e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd048006010 tx=0x7fd04800bfc0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd058276740 1 -- 172.21.15.123:0/3526898988 shutdown_connections 2024-08-18T22:08:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd058276740 1 --2- 172.21.15.123:0/3526898988 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e331167cf0 0x55e33116a110 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd058276740 1 --2- 172.21.15.123:0/3526898988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e3310ec050 0x55e3310f70e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd058276740 1 --2- 172.21.15.123:0/3526898988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3310e6fc0 0x55e3310f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd032ff5640 0 client.15465 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd058276740 1 --2- 172.21.15.123:0/3526898988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3310e6680 0x55e3310f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd058276740 1 -- 172.21.15.123:0/3526898988 >> 172.21.15.123:0/3526898988 conn(0x55e3310e1cf0 msgr2=0x55e3310e0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd058276740 1 -- 172.21.15.123:0/3526898988 shutdown_connections 2024-08-18T22:08:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd058276740 1 -- 172.21.15.123:0/3526898988 wait complete. 2024-08-18T22:08:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd058276740 20 client.15465 trim_cache size 0 max 16384 2024-08-18T22:08:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:08:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:08:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:08:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:08:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd0553d8640 1 -- 172.21.15.123:0/4251958384 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd0380a2cb0 msgr2=0x7fd0380a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd0553d8640 1 --2- 172.21.15.123:0/4251958384 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd0380a2cb0 0x7fd0380a5170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55e3310e79f0 tx=0x7fd040009680 comp rx=0 tx=0).stop 2024-08-18T22:08:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd0553d8640 1 -- 172.21.15.123:0/4251958384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd050104c50 msgr2=0x7fd050198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd0553d8640 1 --2- 172.21.15.123:0/4251958384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd050104c50 0x7fd050198170 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd044006010 tx=0x7fd044031b60 comp rx=0 tx=0).stop 2024-08-18T22:08:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd0553d8640 1 -- 172.21.15.123:0/4251958384 shutdown_connections 2024-08-18T22:08:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd0553d8640 1 --2- 172.21.15.123:0/4251958384 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fd0380a2cb0 0x7fd0380a5170 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd0553d8640 1 --2- 172.21.15.123:0/4251958384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd050107580 0x7fd05019f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd0553d8640 1 --2- 172.21.15.123:0/4251958384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd050104c50 0x7fd050198170 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd0553d8640 1 --2- 172.21.15.123:0/4251958384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd050102320 0x7fd050197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.294+0000 7fd0553d8640 1 -- 172.21.15.123:0/4251958384 >> 172.21.15.123:0/4251958384 conn(0x7fd0500fbf20 msgr2=0x7fd050102d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.295+0000 7fd0553d8640 1 -- 172.21.15.123:0/4251958384 shutdown_connections 2024-08-18T22:08:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:20.295+0000 7fd0553d8640 1 -- 172.21.15.123:0/4251958384 wait complete. 2024-08-18T22:08:20.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:20 smithi123 ceph-mon[18462]: pgmap v357: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-08-18T22:08:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:20 smithi130 ceph-mon[21698]: pgmap v357: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-08-18T22:08:20.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:20 smithi183 ceph-mon[22097]: pgmap v357: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-08-18T22:08:22.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:22 smithi123 ceph-mon[18462]: pgmap v358: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-18T22:08:22.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:22 smithi130 ceph-mon[21698]: pgmap v358: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-18T22:08:22.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:22 smithi183 ceph-mon[22097]: pgmap v358: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-18T22:08:24.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:24 smithi123 ceph-mon[18462]: pgmap v359: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-18T22:08:24.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:24 smithi130 ceph-mon[21698]: pgmap v359: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-18T22:08:24.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:24 smithi183 ceph-mon[22097]: pgmap v359: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-18T22:08:26.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:26 smithi123 ceph-mon[18462]: pgmap v360: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-18T22:08:26.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:26 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:08:26.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:26 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:08:26.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:26 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:08:26.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:26 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:08:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:26 smithi130 ceph-mon[21698]: pgmap v360: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-18T22:08:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:26 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:08:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:26 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:08:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:26 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:08:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:26 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:08:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:26 smithi183 ceph-mon[22097]: pgmap v360: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-18T22:08:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:26 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:08:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:26 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:08:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:26 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:08:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:26 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:08:28.552 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 34.7 2024-08-18T22:08:28.553 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:28 smithi123 ceph-mon[18462]: pgmap v361: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-18T22:08:28.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:28 smithi130 ceph-mon[21698]: pgmap v361: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-18T22:08:28.830 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:28.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:28 smithi183 ceph-mon[22097]: pgmap v361: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-18T22:08:29.130 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-18T22:08:30.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:30 smithi123 ceph-mon[18462]: pgmap v362: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-18T22:08:30.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:30 smithi130 ceph-mon[21698]: pgmap v362: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-18T22:08:30.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:30 smithi183 ceph-mon[22097]: pgmap v362: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-18T22:08:31.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.045+0000 7f0b4d363640 1 -- 172.21.15.123:0/1298739037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b48102b00 msgr2=0x7f0b48102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:31.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.045+0000 7f0b4d363640 1 --2- 172.21.15.123:0/1298739037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b48102b00 0x7f0b48102ee0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009930 tx=0x7f0b3802a420 comp rx=0 tx=0).stop 2024-08-18T22:08:31.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.045+0000 7f0b4d363640 1 -- 172.21.15.123:0/1298739037 shutdown_connections 2024-08-18T22:08:31.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.045+0000 7f0b4d363640 1 --2- 172.21.15.123:0/1298739037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b48108030 0x7f0b4810e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:31.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.045+0000 7f0b4d363640 1 --2- 172.21.15.123:0/1298739037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b481034b0 0x7f0b481078f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:31.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.045+0000 7f0b4d363640 1 --2- 172.21.15.123:0/1298739037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b48102b00 0x7f0b48102ee0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:31.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.045+0000 7f0b4d363640 1 -- 172.21.15.123:0/1298739037 >> 172.21.15.123:0/1298739037 conn(0x7f0b480fc500 msgr2=0x7f0b480fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:31.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.045+0000 7f0b4d363640 1 -- 172.21.15.123:0/1298739037 shutdown_connections 2024-08-18T22:08:31.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.045+0000 7f0b4d363640 1 -- 172.21.15.123:0/1298739037 wait complete. 2024-08-18T22:08:31.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.046+0000 7f0b4d363640 1 Processor -- start 2024-08-18T22:08:31.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.046+0000 7f0b4d363640 1 -- start start 2024-08-18T22:08:31.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.046+0000 7f0b4d363640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b48102b00 0x7f0b48198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:31.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.046+0000 7f0b4d363640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b481034b0 0x7f0b481988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:31.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.046+0000 7f0b4d363640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b48108030 0x7f0b4819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:31.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.046+0000 7f0b4d363640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0b48111e40 con 0x7f0b481034b0 2024-08-18T22:08:31.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.046+0000 7f0b4d363640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b48111cc0 con 0x7f0b48108030 2024-08-18T22:08:31.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.046+0000 7f0b4d363640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0b48111fc0 con 0x7f0b48102b00 2024-08-18T22:08:31.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.046+0000 7f0b467fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b481034b0 0x7f0b481988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:31.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.046+0000 7f0b467fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b481034b0 0x7f0b481988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58028/0 (socket says 172.21.15.123:58028) 2024-08-18T22:08:31.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.046+0000 7f0b467fc640 1 -- 172.21.15.123:0/2074512693 learned_addr learned my addr 172.21.15.123:0/2074512693 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:31.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.047+0000 7f0b46ffd640 1 --2- 172.21.15.123:0/2074512693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b48102b00 0x7f0b48198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:31.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.047+0000 7f0b477fe640 1 --2- 172.21.15.123:0/2074512693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b48108030 0x7f0b4819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:31.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.047+0000 7f0b467fc640 1 -- 172.21.15.123:0/2074512693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b48102b00 msgr2=0x7f0b48198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:31.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.047+0000 7f0b467fc640 1 --2- 172.21.15.123:0/2074512693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b48102b00 0x7f0b48198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:31.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.047+0000 7f0b467fc640 1 -- 172.21.15.123:0/2074512693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b48108030 msgr2=0x7f0b4819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:31.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.047+0000 7f0b467fc640 1 --2- 172.21.15.123:0/2074512693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b48108030 0x7f0b4819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:31.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.047+0000 7f0b467fc640 1 -- 172.21.15.123:0/2074512693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4819d310 con 0x7f0b481034b0 2024-08-18T22:08:31.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.047+0000 7f0b467fc640 1 --2- 172.21.15.123:0/2074512693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b481034b0 0x7f0b481988a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00d740 tx=0x7f0b3c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:31.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.047+0000 7f0b2ffff640 1 -- 172.21.15.123:0/2074512693 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c017070 con 0x7f0b481034b0 2024-08-18T22:08:31.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.047+0000 7f0b4d363640 1 -- 172.21.15.123:0/2074512693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4819d600 con 0x7f0b481034b0 2024-08-18T22:08:31.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.047+0000 7f0b2ffff640 1 -- 172.21.15.123:0/2074512693 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b3c00de50 con 0x7f0b481034b0 2024-08-18T22:08:31.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.047+0000 7f0b2ffff640 1 -- 172.21.15.123:0/2074512693 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c00f6b0 con 0x7f0b481034b0 2024-08-18T22:08:31.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.047+0000 7f0b4d363640 1 -- 172.21.15.123:0/2074512693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b481a4ee0 con 0x7f0b481034b0 2024-08-18T22:08:31.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.048+0000 7f0b4d363640 1 -- 172.21.15.123:0/2074512693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b4806a4e0 con 0x7f0b481034b0 2024-08-18T22:08:31.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.050+0000 7f0b2ffff640 1 -- 172.21.15.123:0/2074512693 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f0b3c01a070 con 0x7f0b481034b0 2024-08-18T22:08:31.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.051+0000 7f0b2ffff640 1 --2- 172.21.15.123:0/2074512693 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0b300a2b80 0x7f0b300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:31.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.051+0000 7f0b2ffff640 1 -- 172.21.15.123:0/2074512693 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0b3c0cf130 con 0x7f0b481034b0 2024-08-18T22:08:31.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.051+0000 7f0b46ffd640 1 --2- 172.21.15.123:0/2074512693 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0b300a2b80 0x7f0b300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:31.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.051+0000 7f0b46ffd640 1 --2- 172.21.15.123:0/2074512693 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0b300a2b80 0x7f0b300a5040 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009900 tx=0x7f0b380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:31.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.055+0000 7f0b2ffff640 1 -- 172.21.15.123:0/2074512693 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0b3c09bd00 con 0x7f0b481034b0 2024-08-18T22:08:31.251 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:31.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.284+0000 7f0b4d363640 1 -- 172.21.15.123:0/2074512693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b48102ee0 con 0x7f0b481034b0 2024-08-18T22:08:31.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.285+0000 7f0b2ffff640 1 -- 172.21.15.123:0/2074512693 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7f0b48102ee0 con 0x7f0b481034b0 2024-08-18T22:08:31.288 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:08:31.288 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"btime":"2024-08-18T22:07:46:492460+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:07:45.601053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:08:31.288 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 26 2024-08-18T22:08:31.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.288+0000 7f0b4d363640 1 -- 172.21.15.123:0/2074512693 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0b300a2b80 msgr2=0x7f0b300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:31.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.288+0000 7f0b4d363640 1 --2- 172.21.15.123:0/2074512693 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0b300a2b80 0x7f0b300a5040 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009900 tx=0x7f0b380058d0 comp rx=0 tx=0).stop 2024-08-18T22:08:31.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.288+0000 7f0b4d363640 1 -- 172.21.15.123:0/2074512693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b481034b0 msgr2=0x7f0b481988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:31.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.288+0000 7f0b4d363640 1 --2- 172.21.15.123:0/2074512693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b481034b0 0x7f0b481988a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00d740 tx=0x7f0b3c00dc00 comp rx=0 tx=0).stop 2024-08-18T22:08:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.288+0000 7f0b4d363640 1 -- 172.21.15.123:0/2074512693 shutdown_connections 2024-08-18T22:08:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.288+0000 7f0b4d363640 1 --2- 172.21.15.123:0/2074512693 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0b300a2b80 0x7f0b300a5040 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.288+0000 7f0b4d363640 1 --2- 172.21.15.123:0/2074512693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b48108030 0x7f0b4819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.288+0000 7f0b4d363640 1 --2- 172.21.15.123:0/2074512693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b481034b0 0x7f0b481988a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.288+0000 7f0b4d363640 1 --2- 172.21.15.123:0/2074512693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b48102b00 0x7f0b48198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.288+0000 7f0b4d363640 1 -- 172.21.15.123:0/2074512693 >> 172.21.15.123:0/2074512693 conn(0x7f0b480fc500 msgr2=0x7f0b48105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.288+0000 7f0b4d363640 1 -- 172.21.15.123:0/2074512693 shutdown_connections 2024-08-18T22:08:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:31.288+0000 7f0b4d363640 1 -- 172.21.15.123:0/2074512693 wait complete. 2024-08-18T22:08:31.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:31 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2074512693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:08:31.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:31 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2074512693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:08:31.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:31 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2074512693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:08:32.347 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db / --timeout 90 --expiration 154.7 --await-for 45.0' 2024-08-18T22:08:32.348 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24466 quiesce db / --timeout 90 --expiration 154.7 --await-for 45.0 2024-08-18T22:08:32.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.554+0000 7fdefd6e6640 1 -- 172.21.15.123:0/4146873589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdef810aac0 msgr2=0x7fdef8116f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:32.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.554+0000 7fdefd6e6640 1 --2- 172.21.15.123:0/4146873589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdef810aac0 0x7fdef8116f50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009ca0 tx=0x7fdef002a950 comp rx=0 tx=0).stop 2024-08-18T22:08:32.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.554+0000 7fdefd6e6640 1 -- 172.21.15.123:0/4146873589 shutdown_connections 2024-08-18T22:08:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.554+0000 7fdefd6e6640 1 --2- 172.21.15.123:0/4146873589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdef810aac0 0x7fdef8116f50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.554+0000 7fdefd6e6640 1 --2- 172.21.15.123:0/4146873589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdef810a140 0x7fdef810a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.554+0000 7fdefd6e6640 1 --2- 172.21.15.123:0/4146873589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdef81101a0 0x7fdef8110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.554+0000 7fdefd6e6640 1 -- 172.21.15.123:0/4146873589 >> 172.21.15.123:0/4146873589 conn(0x7fdef8071360 msgr2=0x7fdef8073780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.555+0000 7fdefd6e6640 1 -- 172.21.15.123:0/4146873589 shutdown_connections 2024-08-18T22:08:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.555+0000 7fdefd6e6640 1 -- 172.21.15.123:0/4146873589 wait complete. 2024-08-18T22:08:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.555+0000 7fdefd6e6640 1 Processor -- start 2024-08-18T22:08:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.555+0000 7fdefd6e6640 1 -- start start 2024-08-18T22:08:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdefd6e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdef810a140 0x7fdef806b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdefd6e6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdef810aac0 0x7fdef806bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdefd6e6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdef81101a0 0x7fdef806c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdefd6e6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdef811a5b0 con 0x7fdef810a140 2024-08-18T22:08:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdefd6e6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdef811a430 con 0x7fdef810aac0 2024-08-18T22:08:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdefd6e6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdef811a730 con 0x7fdef81101a0 2024-08-18T22:08:32.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdef6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdef810a140 0x7fdef806b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdef6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdef810a140 0x7fdef806b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58052/0 (socket says 172.21.15.123:58052) 2024-08-18T22:08:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdef6ffd640 1 -- 172.21.15.123:0/2734984107 learned_addr learned my addr 172.21.15.123:0/2734984107 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdef67fc640 1 --2- 172.21.15.123:0/2734984107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdef810aac0 0x7fdef806bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdef77fe640 1 --2- 172.21.15.123:0/2734984107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdef81101a0 0x7fdef806c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdef6ffd640 1 -- 172.21.15.123:0/2734984107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdef81101a0 msgr2=0x7fdef806c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdef6ffd640 1 --2- 172.21.15.123:0/2734984107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdef81101a0 0x7fdef806c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdef6ffd640 1 -- 172.21.15.123:0/2734984107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdef810aac0 msgr2=0x7fdef806bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdef6ffd640 1 --2- 172.21.15.123:0/2734984107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdef810aac0 0x7fdef806bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.556+0000 7fdef6ffd640 1 -- 172.21.15.123:0/2734984107 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef81b3440 con 0x7fdef810a140 2024-08-18T22:08:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.557+0000 7fdef6ffd640 1 --2- 172.21.15.123:0/2734984107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdef810a140 0x7fdef806b6a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdee800b4a0 tx=0x7fdee800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.557+0000 7fdedffff640 1 -- 172.21.15.123:0/2734984107 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8015020 con 0x7fdef810a140 2024-08-18T22:08:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.557+0000 7fdefd6e6640 1 -- 172.21.15.123:0/2734984107 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef81b3670 con 0x7fdef810a140 2024-08-18T22:08:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.557+0000 7fdefd6e6640 1 -- 172.21.15.123:0/2734984107 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef81b3c00 con 0x7fdef810a140 2024-08-18T22:08:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.557+0000 7fdedffff640 1 -- 172.21.15.123:0/2734984107 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdee8011d10 con 0x7fdef810a140 2024-08-18T22:08:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.557+0000 7fdedffff640 1 -- 172.21.15.123:0/2734984107 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8015020 con 0x7fdef810a140 2024-08-18T22:08:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.560+0000 7fdedffff640 1 -- 172.21.15.123:0/2734984107 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fdee8018020 con 0x7fdef810a140 2024-08-18T22:08:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.560+0000 7fdeffae4740 1 Processor -- start 2024-08-18T22:08:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.560+0000 7fdeffae4740 1 -- start start 2024-08-18T22:08:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.560+0000 7fdeffae4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654a9210 0x55af654a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.560+0000 7fdeffae4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9b30 0x55af654b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.560+0000 7fdeffae4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654b43f0 0x55af654b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.560+0000 7fdeffae4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55af6540e980 con 0x55af654b43f0 2024-08-18T22:08:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.560+0000 7fdeffae4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55af653a6a70 con 0x55af654a9210 2024-08-18T22:08:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.560+0000 7fdeffae4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55af6540a940 con 0x55af654a9b30 2024-08-18T22:08:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.560+0000 7fdef67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654b43f0 0x55af654b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.560+0000 7fdef67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654b43f0 0x55af654b67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58054/0 (socket says 172.21.15.123:58054) 2024-08-18T22:08:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.560+0000 7fdef67fc640 1 -- 172.21.15.123:0/2867810614 learned_addr learned my addr 172.21.15.123:0/2867810614 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:32.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.560+0000 7fdef6ffd640 1 --2- 172.21.15.123:0/2867810614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9b30 0x55af654b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.560+0000 7fdef77fe640 1 --2- 172.21.15.123:0/2867810614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654a9210 0x55af654a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.561+0000 7fdedffff640 1 --2- 172.21.15.123:0/2734984107 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdee00a2f90 0x7fdee00a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.561+0000 7fdef67fc640 1 -- 172.21.15.123:0/2867810614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9b30 msgr2=0x55af654b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.561+0000 7fdef67fc640 1 --2- 172.21.15.123:0/2867810614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9b30 0x55af654b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.561+0000 7fdef67fc640 1 -- 172.21.15.123:0/2867810614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654a9210 msgr2=0x55af654a95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.561+0000 7fdef67fc640 1 --2- 172.21.15.123:0/2867810614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654a9210 0x55af654a95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.561+0000 7fdef67fc640 1 -- 172.21.15.123:0/2867810614 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af654096e0 con 0x55af654b43f0 2024-08-18T22:08:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.561+0000 7fdedffff640 1 -- 172.21.15.123:0/2734984107 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fdee8011630 con 0x7fdef810a140 2024-08-18T22:08:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.561+0000 7fdef77fe640 1 --2- 172.21.15.123:0/2734984107 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdee00a2f90 0x7fdee00a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.561+0000 7fdef67fc640 1 --2- 172.21.15.123:0/2867810614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654b43f0 0x55af654b67e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0099d0 tx=0x7fdeec009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a269a52b02ade1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.561+0000 7fdedd7fa640 1 -- 172.21.15.123:0/2867810614 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec017070 con 0x55af654b43f0 2024-08-18T22:08:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.561+0000 7fdedd7fa640 1 -- 172.21.15.123:0/2867810614 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdeec013470 con 0x55af654b43f0 2024-08-18T22:08:32.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.561+0000 7fdedd7fa640 1 -- 172.21.15.123:0/2867810614 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec012610 con 0x55af654b43f0 2024-08-18T22:08:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.562+0000 7fdeffae4740 1 -- 172.21.15.123:0/2867810614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654b43f0 msgr2=0x55af654b67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.562+0000 7fdef77fe640 1 --2- 172.21.15.123:0/2734984107 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdee00a2f90 0x7fdee00a5450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009430 tx=0x7fdef003e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.562+0000 7fdeffae4740 1 --2- 172.21.15.123:0/2867810614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654b43f0 0x55af654b67e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0099d0 tx=0x7fdeec009e90 comp rx=0 tx=0).stop 2024-08-18T22:08:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.562+0000 7fdeffae4740 1 -- 172.21.15.123:0/2867810614 shutdown_connections 2024-08-18T22:08:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.562+0000 7fdeffae4740 1 --2- 172.21.15.123:0/2867810614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654b43f0 0x55af654b67e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.562+0000 7fdeffae4740 1 --2- 172.21.15.123:0/2867810614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9b30 0x55af654b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.562+0000 7fdeffae4740 1 --2- 172.21.15.123:0/2867810614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654a9210 0x55af654a95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.562+0000 7fdeffae4740 1 -- 172.21.15.123:0/2867810614 >> 172.21.15.123:0/2867810614 conn(0x55af654a57a0 msgr2=0x55af654a5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.562+0000 7fdeffae4740 1 -- 172.21.15.123:0/2867810614 shutdown_connections 2024-08-18T22:08:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.562+0000 7fdeffae4740 1 -- 172.21.15.123:0/2867810614 wait complete. 2024-08-18T22:08:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.562+0000 7fdeffae4740 1 -- start start 2024-08-18T22:08:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.562+0000 7fdeffae4740 1 Processor -- start 2024-08-18T22:08:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdeffae4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9210 0x55af654b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdeffae4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654a9b30 0x55af654b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdeffae4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654b43f0 0x55af654b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdeffae4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55af654b6fc0 con 0x55af654a9b30 2024-08-18T22:08:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdeffae4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55af653c9aa0 con 0x55af654b43f0 2024-08-18T22:08:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdeffae4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55af654b7140 con 0x55af654a9210 2024-08-18T22:08:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdeffae4740 10 client.0 _ll_register_callbacks cb 0x55af653b8e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdef67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654a9b30 0x55af654b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdef67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654a9b30 0x55af654b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58056/0 (socket says 172.21.15.123:58056) 2024-08-18T22:08:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdef67fc640 1 -- 172.21.15.123:0/3070370860 learned_addr learned my addr 172.21.15.123:0/3070370860 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdef77fe640 1 --2- 172.21.15.123:0/3070370860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654b43f0 0x55af654b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdef6ffd640 1 --2- 172.21.15.123:0/3070370860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9210 0x55af654b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdef67fc640 1 -- 172.21.15.123:0/3070370860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9210 msgr2=0x55af654b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdef67fc640 1 --2- 172.21.15.123:0/3070370860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9210 0x55af654b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdef67fc640 1 -- 172.21.15.123:0/3070370860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654b43f0 msgr2=0x55af654b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdef67fc640 1 --2- 172.21.15.123:0/3070370860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654b43f0 0x55af654b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdef67fc640 1 -- 172.21.15.123:0/3070370860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af653ad650 con 0x55af654a9b30 2024-08-18T22:08:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdef67fc640 1 --2- 172.21.15.123:0/3070370860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654a9b30 0x55af654b1750 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdeec013bb0 tx=0x7fdeec0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5dce09fd8e1342 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.563+0000 7fdedaff5640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.564+0000 7fdedaff5640 1 -- 172.21.15.123:0/3070370860 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec029060 con 0x55af654a9b30 2024-08-18T22:08:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.564+0000 7fdedaff5640 1 -- 172.21.15.123:0/3070370860 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fdeec013830 con 0x55af654a9b30 2024-08-18T22:08:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.564+0000 7fdeffae4740 1 -- 172.21.15.123:0/3070370860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdeec013470 con 0x55af654a9b30 2024-08-18T22:08:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.564+0000 7fdedaff5640 1 -- 172.21.15.123:0/3070370860 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdeec030050 con 0x55af654a9b30 2024-08-18T22:08:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.564+0000 7fdeffae4740 10 client.15483 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.564+0000 7fdeffae4740 1 -- 172.21.15.123:0/3070370860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55af651803c0 con 0x55af654a9b30 2024-08-18T22:08:32.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.564+0000 7fdedaff5640 1 -- 172.21.15.123:0/3070370860 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdeec013470 con 0x55af654a9b30 2024-08-18T22:08:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.564+0000 7fdedaff5640 1 -- 172.21.15.123:0/3070370860 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdeec024510 con 0x55af654a9b30 2024-08-18T22:08:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.564+0000 7fdeffae4740 10 client.15483 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.564+0000 7fdeffae4740 10 client.15483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.564+0000 7fdeffae4740 20 client.15483 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.564+0000 7fdeffae4740 1 --2- 172.21.15.123:0/3070370860 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55af654c3cf0 0x55af654c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.564+0000 7fdeffae4740 4 client.15483 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:08:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.564+0000 7fdeffae4740 1 -- 172.21.15.123:0/3070370860 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af6541bef0 con 0x55af654c3cf0 2024-08-18T22:08:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.564+0000 7fdef6ffd640 1 --2- 172.21.15.123:0/3070370860 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55af654c3cf0 0x55af654c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.565+0000 7fdef6ffd640 1 --2- 172.21.15.123:0/3070370860 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55af654c3cf0 0x55af654c60e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8dc5be8b2bd972a server_cookie=3b5f592af43187a1 in_seq=0 out_seq=0 2024-08-18T22:08:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.565+0000 7fdedaff5640 10 client.15483 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.565+0000 7fdedaff5640 1 -- 172.21.15.123:0/3070370860 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55af6541bef0 con 0x55af654c3cf0 2024-08-18T22:08:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.565+0000 7fdedaff5640 10 client.15483 handle_command_reply: tid=0 2024-08-18T22:08:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.566+0000 7fdeffae4740 1 client.15483 shutdown 2024-08-18T22:08:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.566+0000 7fdeffae4740 1 -- 172.21.15.123:0/3070370860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654a9b30 msgr2=0x55af654b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.566+0000 7fdeffae4740 1 --2- 172.21.15.123:0/3070370860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654a9b30 0x55af654b1750 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdeec013bb0 tx=0x7fdeec0047d0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.566+0000 7fdeffae4740 1 -- 172.21.15.123:0/3070370860 shutdown_connections 2024-08-18T22:08:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.566+0000 7fdeffae4740 1 --2- 172.21.15.123:0/3070370860 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55af654c3cf0 0x55af654c60e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.566+0000 7fdeffae4740 1 --2- 172.21.15.123:0/3070370860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654b43f0 0x55af654b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.566+0000 7fdeffae4740 1 --2- 172.21.15.123:0/3070370860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654a9b30 0x55af654b1750 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.566+0000 7fdedaff5640 0 client.15483 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.566+0000 7fdeffae4740 1 --2- 172.21.15.123:0/3070370860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9210 0x55af654b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.566+0000 7fdeffae4740 1 -- 172.21.15.123:0/3070370860 >> 172.21.15.123:0/3070370860 conn(0x55af654a57a0 msgr2=0x55af654ab480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.566+0000 7fdeffae4740 1 -- 172.21.15.123:0/3070370860 shutdown_connections 2024-08-18T22:08:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.566+0000 7fdeffae4740 1 -- 172.21.15.123:0/3070370860 wait complete. 2024-08-18T22:08:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.566+0000 7fdeffae4740 20 client.15483 trim_cache size 0 max 16384 2024-08-18T22:08:32.580 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:32 smithi123 ceph-mon[18462]: pgmap v363: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-18T22:08:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.583+0000 7fdeffae4740 1 Processor -- start 2024-08-18T22:08:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdeffae4740 1 -- start start 2024-08-18T22:08:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdeffae4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654a9210 0x55af654cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdeffae4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9b30 0x55af654cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdeffae4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654b43f0 0x55af654a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdeffae4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4012460 con 0x55af654a9210 2024-08-18T22:08:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdeffae4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdee400fd30 con 0x55af654b43f0 2024-08-18T22:08:32.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdeffae4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdee400db80 con 0x55af654a9b30 2024-08-18T22:08:32.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdef6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654a9210 0x55af654cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdef67fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9b30 0x55af654cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdef6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654a9210 0x55af654cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58060/0 (socket says 172.21.15.123:58060) 2024-08-18T22:08:32.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdef6ffd640 1 -- 172.21.15.123:0/848061317 learned_addr learned my addr 172.21.15.123:0/848061317 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:32.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdef77fe640 1 --2- 172.21.15.123:0/848061317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654b43f0 0x55af654a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdef67fc640 1 -- 172.21.15.123:0/848061317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654b43f0 msgr2=0x55af654a40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:32.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdef67fc640 1 --2- 172.21.15.123:0/848061317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654b43f0 0x55af654a40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdef67fc640 1 -- 172.21.15.123:0/848061317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654a9210 msgr2=0x55af654cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdef67fc640 1 --2- 172.21.15.123:0/848061317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654a9210 0x55af654cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.584+0000 7fdef67fc640 1 -- 172.21.15.123:0/848061317 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af654a9960 con 0x55af654a9b30 2024-08-18T22:08:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.585+0000 7fdef67fc640 1 --2- 172.21.15.123:0/848061317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9b30 0x55af654cbd60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0099d0 tx=0x7fdeec006ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b78b66d963f1192 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.585+0000 7fdedcff9640 1 -- 172.21.15.123:0/848061317 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec029050 con 0x55af654a9b30 2024-08-18T22:08:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.585+0000 7fdedcff9640 1 -- 172.21.15.123:0/848061317 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdeec00edf0 con 0x55af654a9b30 2024-08-18T22:08:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.585+0000 7fdedcff9640 1 -- 172.21.15.123:0/848061317 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec017040 con 0x55af654a9b30 2024-08-18T22:08:32.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.586+0000 7fdeffae4740 1 -- 172.21.15.123:0/848061317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9b30 msgr2=0x55af654cbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:32.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.586+0000 7fdeffae4740 1 --2- 172.21.15.123:0/848061317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9b30 0x55af654cbd60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0099d0 tx=0x7fdeec006ec0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.586+0000 7fdeffae4740 1 -- 172.21.15.123:0/848061317 shutdown_connections 2024-08-18T22:08:32.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.586+0000 7fdeffae4740 1 --2- 172.21.15.123:0/848061317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654b43f0 0x55af654a40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.586+0000 7fdeffae4740 1 --2- 172.21.15.123:0/848061317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9b30 0x55af654cbd60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.586+0000 7fdeffae4740 1 --2- 172.21.15.123:0/848061317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654a9210 0x55af654cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.586+0000 7fdeffae4740 1 -- 172.21.15.123:0/848061317 >> 172.21.15.123:0/848061317 conn(0x55af654a57a0 msgr2=0x55af654b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:32.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.586+0000 7fdeffae4740 1 -- 172.21.15.123:0/848061317 shutdown_connections 2024-08-18T22:08:32.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.586+0000 7fdeffae4740 1 -- 172.21.15.123:0/848061317 wait complete. 2024-08-18T22:08:32.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.586+0000 7fdeffae4740 1 -- start start 2024-08-18T22:08:32.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.586+0000 7fdeffae4740 1 Processor -- start 2024-08-18T22:08:32.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.586+0000 7fdeffae4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654a9210 0x55af654b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.586+0000 7fdeffae4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9b30 0x55af654b5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.586+0000 7fdeffae4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654b43f0 0x55af654bb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.586+0000 7fdeffae4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdee400e1f0 con 0x55af654b43f0 2024-08-18T22:08:32.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.587+0000 7fdeffae4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdee400f660 con 0x55af654a9210 2024-08-18T22:08:32.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.587+0000 7fdeffae4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdee400e8c0 con 0x55af654a9b30 2024-08-18T22:08:32.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.587+0000 7fdeffae4740 10 client.0 _ll_register_callbacks cb 0x7fdee80d1e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:32.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.587+0000 7fdef77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654b43f0 0x55af654bb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.587+0000 7fdef77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654b43f0 0x55af654bb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58070/0 (socket says 172.21.15.123:58070) 2024-08-18T22:08:32.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.587+0000 7fdef77fe640 1 -- 172.21.15.123:0/1969938053 learned_addr learned my addr 172.21.15.123:0/1969938053 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:32.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.587+0000 7fdef6ffd640 1 --2- 172.21.15.123:0/1969938053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654a9210 0x55af654b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.587+0000 7fdef77fe640 1 -- 172.21.15.123:0/1969938053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9b30 msgr2=0x55af654b5510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T22:08:32.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.587+0000 7fdef77fe640 1 --2- 172.21.15.123:0/1969938053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9b30 0x55af654b5510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.587+0000 7fdef77fe640 1 -- 172.21.15.123:0/1969938053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654a9210 msgr2=0x55af654b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:32.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.587+0000 7fdef77fe640 1 --2- 172.21.15.123:0/1969938053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654a9210 0x55af654b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.587+0000 7fdef77fe640 1 -- 172.21.15.123:0/1969938053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af654bbae0 con 0x55af654b43f0 2024-08-18T22:08:32.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.587+0000 7fdef6ffd640 1 --2- 172.21.15.123:0/1969938053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654a9210 0x55af654b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:32.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.587+0000 7fdef77fe640 1 --2- 172.21.15.123:0/1969938053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654b43f0 0x55af654bb3f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdef00306c0 tx=0x7fdef002a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9236f29e62fdb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:32.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.587+0000 7fdedaff5640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:32.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.588+0000 7fdedaff5640 1 -- 172.21.15.123:0/1969938053 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0056060 con 0x55af654b43f0 2024-08-18T22:08:32.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.588+0000 7fdedaff5640 1 -- 172.21.15.123:0/1969938053 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fdef0051680 con 0x55af654b43f0 2024-08-18T22:08:32.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.588+0000 7fdeffae4740 1 -- 172.21.15.123:0/1969938053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdeec00edf0 con 0x55af654b43f0 2024-08-18T22:08:32.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.588+0000 7fdedaff5640 1 -- 172.21.15.123:0/1969938053 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdef0034040 con 0x55af654b43f0 2024-08-18T22:08:32.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.588+0000 7fdeffae4740 10 client.15489 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:32.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.588+0000 7fdeffae4740 1 -- 172.21.15.123:0/1969938053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55af654bcdf0 con 0x55af654b43f0 2024-08-18T22:08:32.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.588+0000 7fdedaff5640 1 -- 172.21.15.123:0/1969938053 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdeec00edf0 con 0x55af654b43f0 2024-08-18T22:08:32.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.588+0000 7fdedaff5640 1 -- 172.21.15.123:0/1969938053 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdef00455c0 con 0x55af654b43f0 2024-08-18T22:08:32.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.588+0000 7fdeffae4740 10 client.15489 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:32.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.588+0000 7fdeffae4740 10 client.15489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:32.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.588+0000 7fdeffae4740 20 client.15489 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:32.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.588+0000 7fdeffae4740 1 --2- 172.21.15.123:0/1969938053 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55af6552ebc0 0x55af65531000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:32.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.588+0000 7fdeffae4740 4 client.15489 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:08:32.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.588+0000 7fdeffae4740 1 -- 172.21.15.123:0/1969938053 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55af65416400 con 0x55af6552ebc0 2024-08-18T22:08:32.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.589+0000 7fdef6ffd640 1 --2- 172.21.15.123:0/1969938053 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55af6552ebc0 0x55af65531000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:32.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.589+0000 7fdedaff5640 10 client.15489 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:32.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.589+0000 7fdef6ffd640 1 --2- 172.21.15.123:0/1969938053 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55af6552ebc0 0x55af65531000 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23ae4a29005512c0 server_cookie=4f0cdba8ee205189 in_seq=0 out_seq=0 2024-08-18T22:08:32.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.589+0000 7fdedaff5640 1 -- 172.21.15.123:0/1969938053 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55af65416400 con 0x55af6552ebc0 2024-08-18T22:08:32.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.589+0000 7fdedaff5640 10 client.15489 handle_command_reply: tid=0 2024-08-18T22:08:32.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.589+0000 7fdeffae4740 1 client.15489 shutdown 2024-08-18T22:08:32.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.590+0000 7fdeffae4740 1 -- 172.21.15.123:0/1969938053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654b43f0 msgr2=0x55af654bb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:32.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.590+0000 7fdeffae4740 1 --2- 172.21.15.123:0/1969938053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654b43f0 0x55af654bb3f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdef00306c0 tx=0x7fdef002a950 comp rx=0 tx=0).stop 2024-08-18T22:08:32.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.590+0000 7fdeffae4740 1 -- 172.21.15.123:0/1969938053 shutdown_connections 2024-08-18T22:08:32.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.590+0000 7fdeffae4740 1 --2- 172.21.15.123:0/1969938053 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55af6552ebc0 0x55af65531000 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.590+0000 7fdeffae4740 1 --2- 172.21.15.123:0/1969938053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55af654b43f0 0x55af654bb3f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.590+0000 7fdeffae4740 1 --2- 172.21.15.123:0/1969938053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55af654a9b30 0x55af654b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.590+0000 7fdeffae4740 1 --2- 172.21.15.123:0/1969938053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af654a9210 0x55af654b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.590+0000 7fdedaff5640 0 client.15489 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:32.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.590+0000 7fdeffae4740 1 -- 172.21.15.123:0/1969938053 >> 172.21.15.123:0/1969938053 conn(0x55af654a57a0 msgr2=0x55af654aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:32.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.590+0000 7fdeffae4740 1 -- 172.21.15.123:0/1969938053 shutdown_connections 2024-08-18T22:08:32.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.590+0000 7fdeffae4740 1 -- 172.21.15.123:0/1969938053 wait complete. 2024-08-18T22:08:32.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.590+0000 7fdeffae4740 20 client.15489 trim_cache size 0 max 16384 2024-08-18T22:08:32.598 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:08:32.598 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "no active scrubs running", 2024-08-18T22:08:32.598 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-08-18T22:08:32.598 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:08:32.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.591+0000 7fdefd6e6640 1 -- 172.21.15.123:0/2734984107 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdee00a2f90 msgr2=0x7fdee00a5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:32.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.591+0000 7fdefd6e6640 1 --2- 172.21.15.123:0/2734984107 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdee00a2f90 0x7fdee00a5450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009430 tx=0x7fdef003e040 comp rx=0 tx=0).stop 2024-08-18T22:08:32.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.591+0000 7fdefd6e6640 1 -- 172.21.15.123:0/2734984107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdef810a140 msgr2=0x7fdef806b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:32.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.591+0000 7fdefd6e6640 1 --2- 172.21.15.123:0/2734984107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdef810a140 0x7fdef806b6a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdee800b4a0 tx=0x7fdee800b8a0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.591+0000 7fdefd6e6640 1 -- 172.21.15.123:0/2734984107 shutdown_connections 2024-08-18T22:08:32.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.591+0000 7fdefd6e6640 1 --2- 172.21.15.123:0/2734984107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdef81101a0 0x7fdef806c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.591+0000 7fdefd6e6640 1 --2- 172.21.15.123:0/2734984107 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdee00a2f90 0x7fdee00a5450 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.591+0000 7fdefd6e6640 1 --2- 172.21.15.123:0/2734984107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdef810aac0 0x7fdef806bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.591+0000 7fdefd6e6640 1 --2- 172.21.15.123:0/2734984107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdef810a140 0x7fdef806b6a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:32.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.591+0000 7fdefd6e6640 1 -- 172.21.15.123:0/2734984107 >> 172.21.15.123:0/2734984107 conn(0x7fdef8071360 msgr2=0x7fdef8072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:32.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.591+0000 7fdefd6e6640 1 -- 172.21.15.123:0/2734984107 shutdown_connections 2024-08-18T22:08:32.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:32.591+0000 7fdefd6e6640 1 -- 172.21.15.123:0/2734984107 wait complete. 2024-08-18T22:08:32.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:32 smithi130 ceph-mon[21698]: pgmap v363: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-18T22:08:32.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:32 smithi183 ceph-mon[22097]: pgmap v363: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-18T22:08:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.382+0000 7f1da4b4b640 1 -- 172.21.15.123:0/504108447 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da0100770 msgr2=0x7f1da0100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.382+0000 7f1da4b4b640 1 --2- 172.21.15.123:0/504108447 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da0100770 0x7f1da0100b70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009900 tx=0x7f1d9002a410 comp rx=0 tx=0).stop 2024-08-18T22:08:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.382+0000 7f1da4b4b640 1 -- 172.21.15.123:0/504108447 shutdown_connections 2024-08-18T22:08:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.382+0000 7f1da4b4b640 1 --2- 172.21.15.123:0/504108447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1da0102320 0x7f1da0108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.382+0000 7f1da4b4b640 1 --2- 172.21.15.123:0/504108447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da0101960 0x7f1da0101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.382+0000 7f1da4b4b640 1 --2- 172.21.15.123:0/504108447 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da0100770 0x7f1da0100b70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.382+0000 7f1da4b4b640 1 -- 172.21.15.123:0/504108447 >> 172.21.15.123:0/504108447 conn(0x7f1da00fbf10 msgr2=0x7f1da00fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.382+0000 7f1da4b4b640 1 -- 172.21.15.123:0/504108447 shutdown_connections 2024-08-18T22:08:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.382+0000 7f1da4b4b640 1 -- 172.21.15.123:0/504108447 wait complete. 2024-08-18T22:08:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.384+0000 7f1da4b4b640 1 Processor -- start 2024-08-18T22:08:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.384+0000 7f1da4b4b640 1 -- start start 2024-08-18T22:08:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.384+0000 7f1da4b4b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da0100770 0x7f1da0196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.384+0000 7f1da4b4b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1da0101960 0x7f1da0196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.384+0000 7f1da4b4b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da0102320 0x7f1da019dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.384+0000 7f1da4b4b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1da010c3d0 con 0x7f1da0100770 2024-08-18T22:08:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.384+0000 7f1da4b4b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1da010c250 con 0x7f1da0102320 2024-08-18T22:08:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.384+0000 7f1da4b4b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1da010c550 con 0x7f1da0101960 2024-08-18T22:08:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.385+0000 7f1d9e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da0100770 0x7f1da0196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.385+0000 7f1d9e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da0100770 0x7f1da0196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44582/0 (socket says 172.21.15.123:44582) 2024-08-18T22:08:33.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.385+0000 7f1d9e59c640 1 -- 172.21.15.123:0/1538081342 learned_addr learned my addr 172.21.15.123:0/1538081342 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:33.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.385+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/1538081342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da0102320 0x7f1da019dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.385+0000 7f1d9dd9b640 1 --2- 172.21.15.123:0/1538081342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1da0101960 0x7f1da0196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.385+0000 7f1d9e59c640 1 -- 172.21.15.123:0/1538081342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1da0101960 msgr2=0x7f1da0196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.385+0000 7f1d9e59c640 1 --2- 172.21.15.123:0/1538081342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1da0101960 0x7f1da0196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.385+0000 7f1d9e59c640 1 -- 172.21.15.123:0/1538081342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da0102320 msgr2=0x7f1da019dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.385+0000 7f1d9e59c640 1 --2- 172.21.15.123:0/1538081342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da0102320 0x7f1da019dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.385+0000 7f1d9e59c640 1 -- 172.21.15.123:0/1538081342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da019e640 con 0x7f1da0100770 2024-08-18T22:08:33.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.385+0000 7f1d9e59c640 1 --2- 172.21.15.123:0/1538081342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da0100770 0x7f1da0196a20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1d90031610 tx=0x7f1d900043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:33.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.386+0000 7f1d8f7fe640 1 -- 172.21.15.123:0/1538081342 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9003f030 con 0x7f1da0100770 2024-08-18T22:08:33.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.386+0000 7f1da4b4b640 1 -- 172.21.15.123:0/1538081342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da00695d0 con 0x7f1da0100770 2024-08-18T22:08:33.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.386+0000 7f1da4b4b640 1 -- 172.21.15.123:0/1538081342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da0069b10 con 0x7f1da0100770 2024-08-18T22:08:33.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.386+0000 7f1d8f7fe640 1 -- 172.21.15.123:0/1538081342 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d90003ce0 con 0x7f1da0100770 2024-08-18T22:08:33.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.386+0000 7f1d8f7fe640 1 -- 172.21.15.123:0/1538081342 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d90049060 con 0x7f1da0100770 2024-08-18T22:08:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.389+0000 7f1da79e0740 1 Processor -- start 2024-08-18T22:08:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.389+0000 7f1d8f7fe640 1 -- 172.21.15.123:0/1538081342 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f1d90042030 con 0x7f1da0100770 2024-08-18T22:08:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.389+0000 7f1da79e0740 1 -- start start 2024-08-18T22:08:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.389+0000 7f1da79e0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41934a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.389+0000 7f1da79e0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934fc0 0x562d41939a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.389+0000 7f1da79e0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d4193a050 0x562d4193c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.389+0000 7f1da79e0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562d418979d0 con 0x562d41934680 2024-08-18T22:08:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.389+0000 7f1da79e0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562d4183f820 con 0x562d41934fc0 2024-08-18T22:08:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.389+0000 7f1da79e0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562d41893990 con 0x562d4193a050 2024-08-18T22:08:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d9ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41934a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d9ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41934a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44596/0 (socket says 172.21.15.123:44596) 2024-08-18T22:08:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/2773556708 learned_addr learned my addr 172.21.15.123:0/2773556708 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d9e59c640 1 --2- 172.21.15.123:0/2773556708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934fc0 0x562d41939a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d9dd9b640 1 --2- 172.21.15.123:0/2773556708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d4193a050 0x562d4193c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/2773556708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d4193a050 msgr2=0x562d4193c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/2773556708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d4193a050 0x562d4193c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/2773556708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934fc0 msgr2=0x562d41939a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/2773556708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934fc0 0x562d41939a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/2773556708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d415ab210 con 0x562d41934680 2024-08-18T22:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d9e59c640 1 --2- 172.21.15.123:0/2773556708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934fc0 0x562d41939a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d9dd9b640 1 --2- 172.21.15.123:0/2773556708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d4193a050 0x562d4193c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d8f7fe640 1 --2- 172.21.15.123:0/1538081342 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d880a2c30 0x7f1d880a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/2773556708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41934a80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800cf60 tx=0x7f1d9800c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68002aae26160e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d8f7fe640 1 -- 172.21.15.123:0/1538081342 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f1d900ef5f0 con 0x7f1da0100770 2024-08-18T22:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d9e59c640 1 --2- 172.21.15.123:0/1538081342 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d880a2c30 0x7f1d880a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d8cff9640 1 -- 172.21.15.123:0/2773556708 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98003970 con 0x562d41934680 2024-08-18T22:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d8cff9640 1 -- 172.21.15.123:0/2773556708 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d98004020 con 0x562d41934680 2024-08-18T22:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.390+0000 7f1d8cff9640 1 -- 172.21.15.123:0/2773556708 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d980157e0 con 0x562d41934680 2024-08-18T22:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.391+0000 7f1da79e0740 1 -- 172.21.15.123:0/2773556708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 msgr2=0x562d41934a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.391+0000 7f1d9e59c640 1 --2- 172.21.15.123:0/1538081342 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d880a2c30 0x7f1d880a50f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1d900ed0d0 tx=0x7f1d9002a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.391+0000 7f1da79e0740 1 --2- 172.21.15.123:0/2773556708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41934a80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800cf60 tx=0x7f1d9800c6e0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.391+0000 7f1da79e0740 1 -- 172.21.15.123:0/2773556708 shutdown_connections 2024-08-18T22:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.391+0000 7f1da79e0740 1 --2- 172.21.15.123:0/2773556708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d4193a050 0x562d4193c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.391+0000 7f1da79e0740 1 --2- 172.21.15.123:0/2773556708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934fc0 0x562d41939a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.391+0000 7f1da79e0740 1 --2- 172.21.15.123:0/2773556708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41934a80 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.391+0000 7f1da79e0740 1 -- 172.21.15.123:0/2773556708 >> 172.21.15.123:0/2773556708 conn(0x562d4192fcf0 msgr2=0x562d419300f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.391+0000 7f1da79e0740 1 -- 172.21.15.123:0/2773556708 shutdown_connections 2024-08-18T22:08:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.391+0000 7f1da79e0740 1 -- 172.21.15.123:0/2773556708 wait complete. 2024-08-18T22:08:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1da79e0740 1 -- start start 2024-08-18T22:08:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1da79e0740 1 Processor -- start 2024-08-18T22:08:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1da79e0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934680 0x562d41942c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1da79e0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d41934fc0 0x562d41943180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1da79e0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d4193a050 0x562d4194a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1da79e0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562d41941430 con 0x562d4193a050 2024-08-18T22:08:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1da79e0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562d41853520 con 0x562d41934680 2024-08-18T22:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1da79e0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562d419415b0 con 0x562d41934fc0 2024-08-18T22:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1da79e0740 10 client.0 _ll_register_callbacks cb 0x562d415aaa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1d9ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d4193a050 0x562d4194a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1d9ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d4193a050 0x562d4194a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44604/0 (socket says 172.21.15.123:44604) 2024-08-18T22:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/1294663582 learned_addr learned my addr 172.21.15.123:0/1294663582 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1d9dd9b640 1 --2- 172.21.15.123:0/1294663582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d41934fc0 0x562d41943180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/1294663582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934680 0x562d41942c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/1294663582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d41934fc0 msgr2=0x562d41943180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/1294663582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d41934fc0 0x562d41943180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/1294663582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934680 msgr2=0x562d41942c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/1294663582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934680 0x562d41942c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.392+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/1294663582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d41677620 con 0x562d4193a050 2024-08-18T22:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.393+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/1294663582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d4193a050 0x562d4194a1c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800cd40 tx=0x7f1d9800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83df2df6d30abf90 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.393+0000 7f1d85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.393+0000 7f1d85ffb640 1 -- 172.21.15.123:0/1294663582 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98029060 con 0x562d4193a050 2024-08-18T22:08:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.393+0000 7f1da79e0740 1 -- 172.21.15.123:0/1294663582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d98004020 con 0x562d4193a050 2024-08-18T22:08:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.393+0000 7f1d85ffb640 1 -- 172.21.15.123:0/1294663582 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f1d98003d80 con 0x562d4193a050 2024-08-18T22:08:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.393+0000 7f1d85ffb640 1 -- 172.21.15.123:0/1294663582 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1d98030050 con 0x562d4193a050 2024-08-18T22:08:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.394+0000 7f1da79e0740 10 client.15501 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.394+0000 7f1da79e0740 1 -- 172.21.15.123:0/1294663582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562d4194cf70 con 0x562d4193a050 2024-08-18T22:08:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.394+0000 7f1d85ffb640 1 -- 172.21.15.123:0/1294663582 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d98004020 con 0x562d4193a050 2024-08-18T22:08:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.394+0000 7f1d85ffb640 1 -- 172.21.15.123:0/1294663582 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f1d98015cc0 con 0x562d4193a050 2024-08-18T22:08:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.395+0000 7f1da79e0740 10 client.15501 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.395+0000 7f1da79e0740 10 client.15501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.395+0000 7f1da79e0740 20 client.15501 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.395+0000 7f1da79e0740 1 --2- 172.21.15.123:0/1294663582 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x562d4194ea20 0x562d41950e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.395+0000 7f1da79e0740 4 client.15501 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:08:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.395+0000 7f1da79e0740 1 -- 172.21.15.123:0/1294663582 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d418a5100 con 0x562d4194ea20 2024-08-18T22:08:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.395+0000 7f1d9dd9b640 1 --2- 172.21.15.123:0/1294663582 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x562d4194ea20 0x562d41950e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.395+0000 7f1d9dd9b640 1 --2- 172.21.15.123:0/1294663582 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x562d4194ea20 0x562d41950e40 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6719b53e752f1191 server_cookie=c8752bce674cb34d in_seq=0 out_seq=0 2024-08-18T22:08:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.395+0000 7f1d85ffb640 10 client.15501 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.396+0000 7f1d85ffb640 1 -- 172.21.15.123:0/1294663582 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d418a5100 con 0x562d4194ea20 2024-08-18T22:08:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.396+0000 7f1d85ffb640 10 client.15501 handle_command_reply: tid=0 2024-08-18T22:08:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.396+0000 7f1da79e0740 1 client.15501 shutdown 2024-08-18T22:08:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.396+0000 7f1da79e0740 1 -- 172.21.15.123:0/1294663582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d4193a050 msgr2=0x562d4194a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.396+0000 7f1da79e0740 1 --2- 172.21.15.123:0/1294663582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d4193a050 0x562d4194a1c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800cd40 tx=0x7f1d9800cf90 comp rx=0 tx=0).stop 2024-08-18T22:08:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.396+0000 7f1da79e0740 1 -- 172.21.15.123:0/1294663582 shutdown_connections 2024-08-18T22:08:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.396+0000 7f1da79e0740 1 --2- 172.21.15.123:0/1294663582 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x562d4194ea20 0x562d41950e40 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.396+0000 7f1da79e0740 1 --2- 172.21.15.123:0/1294663582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d4193a050 0x562d4194a1c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.396+0000 7f1d85ffb640 0 client.15501 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.396+0000 7f1da79e0740 1 --2- 172.21.15.123:0/1294663582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d41934fc0 0x562d41943180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.396+0000 7f1da79e0740 1 --2- 172.21.15.123:0/1294663582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934680 0x562d41942c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.396+0000 7f1da79e0740 1 -- 172.21.15.123:0/1294663582 >> 172.21.15.123:0/1294663582 conn(0x562d4192fcf0 msgr2=0x562d41931500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.396+0000 7f1da79e0740 1 -- 172.21.15.123:0/1294663582 shutdown_connections 2024-08-18T22:08:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.396+0000 7f1da79e0740 1 -- 172.21.15.123:0/1294663582 wait complete. 2024-08-18T22:08:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.396+0000 7f1da79e0740 20 client.15501 trim_cache size 0 max 16384 2024-08-18T22:08:33.411 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:33.414 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.412+0000 7f1da79e0740 1 Processor -- start 2024-08-18T22:08:33.414 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.412+0000 7f1da79e0740 1 -- start start 2024-08-18T22:08:33.414 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.412+0000 7f1da79e0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41936200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.414 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.412+0000 7f1da79e0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934fc0 0x562d4194a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.414 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1da79e0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d4193a050 0x562d41936740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1da79e0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1da01aab50 con 0x562d41934680 2024-08-18T22:08:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1da79e0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1da01a8420 con 0x562d41934fc0 2024-08-18T22:08:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1da79e0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1da01a6270 con 0x562d4193a050 2024-08-18T22:08:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1d9ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41936200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1d9ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41936200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44612/0 (socket says 172.21.15.123:44612) 2024-08-18T22:08:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/3076938868 learned_addr learned my addr 172.21.15.123:0/3076938868 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/3076938868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d4193a050 0x562d41936740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1d9dd9b640 1 --2- 172.21.15.123:0/3076938868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934fc0 0x562d4194a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/3076938868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d4193a050 msgr2=0x562d41936740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/3076938868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d4193a050 0x562d41936740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/3076938868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934fc0 msgr2=0x562d4194a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/3076938868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934fc0 0x562d4194a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/3076938868 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d41941cb0 con 0x562d41934680 2024-08-18T22:08:33.416 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1d9dd9b640 1 --2- 172.21.15.123:0/3076938868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934fc0 0x562d4194a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:33.416 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.413+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/3076938868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41936200 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1d98005370 tx=0x7f1d9800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde739aeb760dbc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.414+0000 7f1d87fff640 1 -- 172.21.15.123:0/3076938868 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98029040 con 0x562d41934680 2024-08-18T22:08:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.414+0000 7f1d87fff640 1 -- 172.21.15.123:0/3076938868 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d98005d90 con 0x562d41934680 2024-08-18T22:08:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.414+0000 7f1d87fff640 1 -- 172.21.15.123:0/3076938868 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98003fe0 con 0x562d41934680 2024-08-18T22:08:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.414+0000 7f1da79e0740 1 -- 172.21.15.123:0/3076938868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 msgr2=0x562d41936200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.414+0000 7f1da79e0740 1 --2- 172.21.15.123:0/3076938868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41936200 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1d98005370 tx=0x7f1d9800cb60 comp rx=0 tx=0).stop 2024-08-18T22:08:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 1 -- 172.21.15.123:0/3076938868 shutdown_connections 2024-08-18T22:08:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 1 --2- 172.21.15.123:0/3076938868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d4193a050 0x562d41936740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 1 --2- 172.21.15.123:0/3076938868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d41934fc0 0x562d4194a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 1 --2- 172.21.15.123:0/3076938868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41936200 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 1 -- 172.21.15.123:0/3076938868 >> 172.21.15.123:0/3076938868 conn(0x562d4192fcf0 msgr2=0x562d419300d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 1 -- 172.21.15.123:0/3076938868 shutdown_connections 2024-08-18T22:08:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 1 -- 172.21.15.123:0/3076938868 wait complete. 2024-08-18T22:08:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 1 -- start start 2024-08-18T22:08:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 1 Processor -- start 2024-08-18T22:08:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41949fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d41934fc0 0x562d41946a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d4193a050 0x562d41946fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1da01a68e0 con 0x562d41934680 2024-08-18T22:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1da01a7d50 con 0x562d4193a050 2024-08-18T22:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1da01a6fb0 con 0x562d41934fc0 2024-08-18T22:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.415+0000 7f1da79e0740 10 client.0 _ll_register_callbacks cb 0x7f1d9800ce30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.416+0000 7f1d9ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41949fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.416+0000 7f1d9dd9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d41934fc0 0x562d41946a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.416+0000 7f1d9ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41949fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44614/0 (socket says 172.21.15.123:44614) 2024-08-18T22:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.416+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/897438294 learned_addr learned my addr 172.21.15.123:0/897438294 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.416+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/897438294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d4193a050 0x562d41946fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.416+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/897438294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d41934fc0 msgr2=0x562d41946a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.416+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/897438294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d41934fc0 0x562d41946a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.416+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/897438294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d4193a050 msgr2=0x562d41946fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.416+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/897438294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d4193a050 0x562d41946fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.416+0000 7f1d9ed9d640 1 -- 172.21.15.123:0/897438294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d419b7710 con 0x562d41934680 2024-08-18T22:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.416+0000 7f1d9ed9d640 1 --2- 172.21.15.123:0/897438294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41949fc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1d98005b40 tx=0x7f1d9800af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a686a6fb0db96d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.416+0000 7f1d85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.416+0000 7f1d85ffb640 1 -- 172.21.15.123:0/897438294 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98004030 con 0x562d41934680 2024-08-18T22:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.417+0000 7f1d85ffb640 1 -- 172.21.15.123:0/897438294 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f1d98004c10 con 0x562d41934680 2024-08-18T22:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.417+0000 7f1da79e0740 1 -- 172.21.15.123:0/897438294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d98005d90 con 0x562d41934680 2024-08-18T22:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.417+0000 7f1d85ffb640 1 -- 172.21.15.123:0/897438294 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1d980056f0 con 0x562d41934680 2024-08-18T22:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.417+0000 7f1da79e0740 10 client.15507 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.417+0000 7f1da79e0740 1 -- 172.21.15.123:0/897438294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562d419b8960 con 0x562d41934680 2024-08-18T22:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.417+0000 7f1d85ffb640 1 -- 172.21.15.123:0/897438294 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d98005d90 con 0x562d41934680 2024-08-18T22:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.417+0000 7f1d85ffb640 1 -- 172.21.15.123:0/897438294 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f1d98022cd0 con 0x562d41934680 2024-08-18T22:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.417+0000 7f1da79e0740 10 client.15507 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.417+0000 7f1da79e0740 10 client.15507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.417+0000 7f1da79e0740 20 client.15507 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.417+0000 7f1da79e0740 1 --2- 172.21.15.123:0/897438294 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x562d4194ea20 0x562d419bb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.417+0000 7f1da79e0740 4 client.15507 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:08:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.417+0000 7f1da79e0740 1 -- 172.21.15.123:0/897438294 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562d4189f450 con 0x562d4194ea20 2024-08-18T22:08:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.418+0000 7f1d9dd9b640 1 --2- 172.21.15.123:0/897438294 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x562d4194ea20 0x562d419bb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.418+0000 7f1d85ffb640 10 client.15507 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.418+0000 7f1d9dd9b640 1 --2- 172.21.15.123:0/897438294 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x562d4194ea20 0x562d419bb0d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcbd85a3ca2f0052 server_cookie=8a1c0d69c6fb3634 in_seq=0 out_seq=0 2024-08-18T22:08:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.422+0000 7f1d85ffb640 1 -- 172.21.15.123:0/897438294 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562d4189f450 con 0x562d4194ea20 2024-08-18T22:08:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.422+0000 7f1d85ffb640 10 client.15507 handle_command_reply: tid=0 2024-08-18T22:08:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.422+0000 7f1da79e0740 1 client.15507 shutdown 2024-08-18T22:08:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.422+0000 7f1da79e0740 1 -- 172.21.15.123:0/897438294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 msgr2=0x562d41949fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.422+0000 7f1da79e0740 1 --2- 172.21.15.123:0/897438294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41949fc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1d98005b40 tx=0x7f1d9800af90 comp rx=0 tx=0).stop 2024-08-18T22:08:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.422+0000 7f1da79e0740 1 -- 172.21.15.123:0/897438294 shutdown_connections 2024-08-18T22:08:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.422+0000 7f1da79e0740 1 --2- 172.21.15.123:0/897438294 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x562d4194ea20 0x562d419bb0d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.422+0000 7f1da79e0740 1 --2- 172.21.15.123:0/897438294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d4193a050 0x562d41946fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.423+0000 7f1d85ffb640 0 client.15507 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.423+0000 7f1da79e0740 1 --2- 172.21.15.123:0/897438294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562d41934fc0 0x562d41946a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.423+0000 7f1da79e0740 1 --2- 172.21.15.123:0/897438294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562d41934680 0x562d41949fc0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.423+0000 7f1da79e0740 1 -- 172.21.15.123:0/897438294 >> 172.21.15.123:0/897438294 conn(0x562d4192fcf0 msgr2=0x562d41936200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.423+0000 7f1da79e0740 1 -- 172.21.15.123:0/897438294 shutdown_connections 2024-08-18T22:08:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.423+0000 7f1da79e0740 1 -- 172.21.15.123:0/897438294 wait complete. 2024-08-18T22:08:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.423+0000 7f1da79e0740 20 client.15507 trim_cache size 0 max 16384 2024-08-18T22:08:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:08:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:08:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:08:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.423+0000 7f1da4b4b640 1 -- 172.21.15.123:0/1538081342 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d880a2c30 msgr2=0x7f1d880a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.423+0000 7f1da4b4b640 1 --2- 172.21.15.123:0/1538081342 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d880a2c30 0x7f1d880a50f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1d900ed0d0 tx=0x7f1d9002a410 comp rx=0 tx=0).stop 2024-08-18T22:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.423+0000 7f1da4b4b640 1 -- 172.21.15.123:0/1538081342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da0100770 msgr2=0x7f1da0196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.423+0000 7f1da4b4b640 1 --2- 172.21.15.123:0/1538081342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da0100770 0x7f1da0196a20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1d90031610 tx=0x7f1d900043b0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.424+0000 7f1da4b4b640 1 -- 172.21.15.123:0/1538081342 shutdown_connections 2024-08-18T22:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.424+0000 7f1da4b4b640 1 --2- 172.21.15.123:0/1538081342 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1d880a2c30 0x7f1d880a50f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.424+0000 7f1da4b4b640 1 --2- 172.21.15.123:0/1538081342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da0102320 0x7f1da019dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.424+0000 7f1da4b4b640 1 --2- 172.21.15.123:0/1538081342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1da0101960 0x7f1da0196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.424+0000 7f1da4b4b640 1 --2- 172.21.15.123:0/1538081342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da0100770 0x7f1da0196a20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.424+0000 7f1da4b4b640 1 -- 172.21.15.123:0/1538081342 >> 172.21.15.123:0/1538081342 conn(0x7f1da00fbf10 msgr2=0x7f1da0104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.424+0000 7f1da4b4b640 1 -- 172.21.15.123:0/1538081342 shutdown_connections 2024-08-18T22:08:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:33.424+0000 7f1da4b4b640 1 -- 172.21.15.123:0/1538081342 wait complete. 2024-08-18T22:08:33.430 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-18T22:08:33.430 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:08:33.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.922+0000 7f8f7760b640 1 -- 172.21.15.123:0/641578890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f70102260 msgr2=0x7f8f7010e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.922+0000 7f8f7760b640 1 --2- 172.21.15.123:0/641578890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f70102260 0x7f8f7010e790 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009cd0 tx=0x7f8f6802a8e0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.922+0000 7f8f7760b640 1 -- 172.21.15.123:0/641578890 shutdown_connections 2024-08-18T22:08:33.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.922+0000 7f8f7760b640 1 --2- 172.21.15.123:0/641578890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f70102260 0x7f8f7010e790 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.922+0000 7f8f7760b640 1 --2- 172.21.15.123:0/641578890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f701018c0 0x7f8f70101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.922+0000 7f8f7760b640 1 --2- 172.21.15.123:0/641578890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f701078c0 0x7f8f70107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.922+0000 7f8f7760b640 1 -- 172.21.15.123:0/641578890 >> 172.21.15.123:0/641578890 conn(0x7f8f700fd620 msgr2=0x7f8f700ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:33.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.922+0000 7f8f7760b640 1 -- 172.21.15.123:0/641578890 shutdown_connections 2024-08-18T22:08:33.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.922+0000 7f8f7760b640 1 -- 172.21.15.123:0/641578890 wait complete. 2024-08-18T22:08:33.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.922+0000 7f8f7760b640 1 Processor -- start 2024-08-18T22:08:33.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f7760b640 1 -- start start 2024-08-18T22:08:33.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f7760b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f701018c0 0x7f8f70074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f7760b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f70102260 0x7f8f70074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f7760b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f701078c0 0x7f8f70074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f7760b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8f70111cc0 con 0x7f8f701078c0 2024-08-18T22:08:33.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f7760b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8f70111b40 con 0x7f8f701018c0 2024-08-18T22:08:33.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f7760b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8f70111e40 con 0x7f8f70102260 2024-08-18T22:08:33.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f75ba8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f701078c0 0x7f8f70074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f753a7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f701018c0 0x7f8f70074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f75ba8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f701078c0 0x7f8f70074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44638/0 (socket says 172.21.15.123:44638) 2024-08-18T22:08:33.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f75ba8640 1 -- 172.21.15.123:0/2440349870 learned_addr learned my addr 172.21.15.123:0/2440349870 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:33.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/2440349870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f70102260 0x7f8f70074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f75ba8640 1 -- 172.21.15.123:0/2440349870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f70102260 msgr2=0x7f8f70074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f75ba8640 1 --2- 172.21.15.123:0/2440349870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f70102260 0x7f8f70074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f75ba8640 1 -- 172.21.15.123:0/2440349870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f701018c0 msgr2=0x7f8f70074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f75ba8640 1 --2- 172.21.15.123:0/2440349870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f701018c0 0x7f8f70074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f75ba8640 1 -- 172.21.15.123:0/2440349870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f701a65e0 con 0x7f8f701078c0 2024-08-18T22:08:33.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.923+0000 7f8f75ba8640 1 --2- 172.21.15.123:0/2440349870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f701078c0 0x7f8f70074ca0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8f68005cc0 tx=0x7f8f68003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:33.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.924+0000 7f8f667fc640 1 -- 172.21.15.123:0/2440349870 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f68004040 con 0x7f8f701078c0 2024-08-18T22:08:33.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.924+0000 7f8f667fc640 1 -- 172.21.15.123:0/2440349870 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f680046c0 con 0x7f8f701078c0 2024-08-18T22:08:33.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.924+0000 7f8f7760b640 1 -- 172.21.15.123:0/2440349870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f701a6870 con 0x7f8f701078c0 2024-08-18T22:08:33.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.924+0000 7f8f667fc640 1 -- 172.21.15.123:0/2440349870 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f68046480 con 0x7f8f701078c0 2024-08-18T22:08:33.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.924+0000 7f8f7760b640 1 -- 172.21.15.123:0/2440349870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f701a6db0 con 0x7f8f701078c0 2024-08-18T22:08:33.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.927+0000 7f8f667fc640 1 -- 172.21.15.123:0/2440349870 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f8f680305a0 con 0x7f8f701078c0 2024-08-18T22:08:33.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.927+0000 7f8f79a09740 1 Processor -- start 2024-08-18T22:08:33.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.927+0000 7f8f79a09740 1 -- start start 2024-08-18T22:08:33.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.927+0000 7f8f79a09740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bf130 0x560db22bf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.927+0000 7f8f79a09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22bfa50 0x560db22c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.927+0000 7f8f79a09740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22ca310 0x560db22cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.927+0000 7f8f79a09740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x560db2224a70 con 0x560db22ca310 2024-08-18T22:08:33.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.927+0000 7f8f79a09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560db21bc780 con 0x560db22bfa50 2024-08-18T22:08:33.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.927+0000 7f8f79a09740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560db2220a30 con 0x560db22bf130 2024-08-18T22:08:33.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.927+0000 7f8f74ba6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22ca310 0x560db22cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.927+0000 7f8f74ba6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22ca310 0x560db22cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44644/0 (socket says 172.21.15.123:44644) 2024-08-18T22:08:33.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.927+0000 7f8f74ba6640 1 -- 172.21.15.123:0/4005762316 learned_addr learned my addr 172.21.15.123:0/4005762316 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:33.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.927+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/4005762316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bf130 0x560db22bf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.928+0000 7f8f753a7640 1 --2- 172.21.15.123:0/4005762316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22bfa50 0x560db22c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.928+0000 7f8f667fc640 1 --2- 172.21.15.123:0/2440349870 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f5c0a2b80 0x7f8f5c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.928+0000 7f8f74ba6640 1 -- 172.21.15.123:0/4005762316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bf130 msgr2=0x560db22bf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.928+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/4005762316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bf130 0x560db22bf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.928+0000 7f8f74ba6640 1 -- 172.21.15.123:0/4005762316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22bfa50 msgr2=0x560db22c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.928+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/4005762316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22bfa50 0x560db22c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.928+0000 7f8f74ba6640 1 -- 172.21.15.123:0/4005762316 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db1f96b90 con 0x560db22ca310 2024-08-18T22:08:33.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.928+0000 7f8f75ba8640 1 --2- 172.21.15.123:0/2440349870 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f5c0a2b80 0x7f8f5c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.928+0000 7f8f667fc640 1 -- 172.21.15.123:0/2440349870 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8f6802e030 con 0x7f8f701078c0 2024-08-18T22:08:33.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.928+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/4005762316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22ca310 0x560db22cc700 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8f600127c0 tx=0x7f8f6000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22cfb41559317413 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:33.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.928+0000 7f8f5b7fe640 1 -- 172.21.15.123:0/4005762316 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f60012e00 con 0x560db22ca310 2024-08-18T22:08:33.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.928+0000 7f8f5b7fe640 1 -- 172.21.15.123:0/4005762316 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f60010c50 con 0x560db22ca310 2024-08-18T22:08:33.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.928+0000 7f8f5b7fe640 1 -- 172.21.15.123:0/4005762316 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6001ec20 con 0x560db22ca310 2024-08-18T22:08:33.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.929+0000 7f8f79a09740 1 -- 172.21.15.123:0/4005762316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22ca310 msgr2=0x560db22cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.929+0000 7f8f75ba8640 1 --2- 172.21.15.123:0/2440349870 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f5c0a2b80 0x7f8f5c0a5040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8f680095e0 tx=0x7f8f68087ca0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:33.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.929+0000 7f8f79a09740 1 --2- 172.21.15.123:0/4005762316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22ca310 0x560db22cc700 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8f600127c0 tx=0x7f8f6000b7c0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.929+0000 7f8f79a09740 1 -- 172.21.15.123:0/4005762316 shutdown_connections 2024-08-18T22:08:33.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.929+0000 7f8f79a09740 1 --2- 172.21.15.123:0/4005762316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22ca310 0x560db22cc700 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.929+0000 7f8f79a09740 1 --2- 172.21.15.123:0/4005762316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22bfa50 0x560db22c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.929+0000 7f8f79a09740 1 --2- 172.21.15.123:0/4005762316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bf130 0x560db22bf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.929+0000 7f8f79a09740 1 -- 172.21.15.123:0/4005762316 >> 172.21.15.123:0/4005762316 conn(0x560db22bb6c0 msgr2=0x560db22bbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:33.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.929+0000 7f8f79a09740 1 -- 172.21.15.123:0/4005762316 shutdown_connections 2024-08-18T22:08:33.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.929+0000 7f8f79a09740 1 -- 172.21.15.123:0/4005762316 wait complete. 2024-08-18T22:08:33.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.930+0000 7f8f79a09740 1 -- start start 2024-08-18T22:08:33.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.930+0000 7f8f79a09740 1 Processor -- start 2024-08-18T22:08:33.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.930+0000 7f8f79a09740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bf130 0x560db22c7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.930+0000 7f8f79a09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22bfa50 0x560db22c7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.930+0000 7f8f79a09740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22ca310 0x560db22c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.931+0000 7f8f79a09740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x560db22ccee0 con 0x560db22ca310 2024-08-18T22:08:33.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.931+0000 7f8f79a09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560db21df990 con 0x560db22bfa50 2024-08-18T22:08:33.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.931+0000 7f8f79a09740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560db22cd060 con 0x560db22bf130 2024-08-18T22:08:33.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.931+0000 7f8f753a7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22bfa50 0x560db22c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.931+0000 7f8f753a7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22bfa50 0x560db22c7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:46810/0 (socket says 172.21.15.123:46810) 2024-08-18T22:08:33.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.931+0000 7f8f753a7640 1 -- 172.21.15.123:0/2634513860 learned_addr learned my addr 172.21.15.123:0/2634513860 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:33.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.931+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/2634513860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bf130 0x560db22c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.931+0000 7f8f79a09740 10 client.0 _ll_register_callbacks cb 0x560db1f34090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:33.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.931+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/2634513860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22ca310 0x560db22c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.931+0000 7f8f753a7640 1 -- 172.21.15.123:0/2634513860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bf130 msgr2=0x560db22c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.931+0000 7f8f753a7640 1 --2- 172.21.15.123:0/2634513860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bf130 0x560db22c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.931+0000 7f8f753a7640 1 -- 172.21.15.123:0/2634513860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22ca310 msgr2=0x560db22c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.931+0000 7f8f753a7640 1 --2- 172.21.15.123:0/2634513860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22ca310 0x560db22c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.931+0000 7f8f753a7640 1 -- 172.21.15.123:0/2634513860 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560db21de6c0 con 0x560db22bfa50 2024-08-18T22:08:33.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.931+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/2634513860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22ca310 0x560db22c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:33.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.932+0000 7f8f753a7640 1 --2- 172.21.15.123:0/2634513860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22bfa50 0x560db22c7750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00b970 tx=0x7f8f6c00be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=530d555fd48f3d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:33.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.932+0000 7f8f58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:08:33.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.932+0000 7f8f58ff9640 1 -- 172.21.15.123:0/2634513860 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c01b440 con 0x560db22bfa50 2024-08-18T22:08:33.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.932+0000 7f8f79a09740 1 -- 172.21.15.123:0/2634513860 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f60010c50 con 0x560db22bfa50 2024-08-18T22:08:33.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.932+0000 7f8f58ff9640 1 -- 172.21.15.123:0/2634513860 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8f6c011440 con 0x560db22bfa50 2024-08-18T22:08:33.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.932+0000 7f8f58ff9640 1 -- 172.21.15.123:0/2634513860 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8f6c011640 con 0x560db22bfa50 2024-08-18T22:08:33.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.932+0000 7f8f79a09740 10 client.25016 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:33.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.932+0000 7f8f79a09740 1 -- 172.21.15.123:0/2634513860 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560db22d8c40 con 0x560db22bfa50 2024-08-18T22:08:33.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.933+0000 7f8f58ff9640 1 -- 172.21.15.123:0/2634513860 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f60010c50 con 0x560db22bfa50 2024-08-18T22:08:33.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.933+0000 7f8f58ff9640 1 -- 172.21.15.123:0/2634513860 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8f6c019020 con 0x560db22bfa50 2024-08-18T22:08:33.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.933+0000 7f8f79a09740 10 client.25016 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:33.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.933+0000 7f8f79a09740 10 client.25016 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:08:33.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.933+0000 7f8f79a09740 20 client.25016 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:33.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.933+0000 7f8f79a09740 1 --2- 172.21.15.123:0/2634513860 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560db22da0a0 0x560db22dc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.933+0000 7f8f79a09740 4 client.25016 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:08:33.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.933+0000 7f8f79a09740 1 -- 172.21.15.123:0/2634513860 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560db22321a0 con 0x560db22da0a0 2024-08-18T22:08:33.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.933+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/2634513860 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560db22da0a0 0x560db22dc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.934+0000 7f8f58ff9640 10 client.25016 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:33.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.934+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/2634513860 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560db22da0a0 0x560db22dc4e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39c2b9cfd75fe4ac server_cookie=ff4948324b248e18 in_seq=0 out_seq=0 2024-08-18T22:08:33.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.935+0000 7f8f58ff9640 1 -- 172.21.15.123:0/2634513860 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560db22321a0 con 0x560db22da0a0 2024-08-18T22:08:33.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.935+0000 7f8f58ff9640 10 client.25016 handle_command_reply: tid=0 2024-08-18T22:08:33.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.935+0000 7f8f79a09740 1 client.25016 shutdown 2024-08-18T22:08:33.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.935+0000 7f8f79a09740 1 -- 172.21.15.123:0/2634513860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22bfa50 msgr2=0x560db22c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.935+0000 7f8f79a09740 1 --2- 172.21.15.123:0/2634513860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22bfa50 0x560db22c7750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00b970 tx=0x7f8f6c00be30 comp rx=0 tx=0).stop 2024-08-18T22:08:33.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.935+0000 7f8f79a09740 1 -- 172.21.15.123:0/2634513860 shutdown_connections 2024-08-18T22:08:33.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.935+0000 7f8f79a09740 1 --2- 172.21.15.123:0/2634513860 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560db22da0a0 0x560db22dc4e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.935+0000 7f8f58ff9640 0 client.25016 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:33.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.935+0000 7f8f79a09740 1 --2- 172.21.15.123:0/2634513860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22ca310 0x560db22c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.935+0000 7f8f79a09740 1 --2- 172.21.15.123:0/2634513860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22bfa50 0x560db22c7750 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.935+0000 7f8f79a09740 1 --2- 172.21.15.123:0/2634513860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bf130 0x560db22c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.935+0000 7f8f79a09740 1 -- 172.21.15.123:0/2634513860 >> 172.21.15.123:0/2634513860 conn(0x560db22bb6c0 msgr2=0x560db22c13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:33.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.935+0000 7f8f79a09740 1 -- 172.21.15.123:0/2634513860 shutdown_connections 2024-08-18T22:08:33.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.935+0000 7f8f79a09740 1 -- 172.21.15.123:0/2634513860 wait complete. 2024-08-18T22:08:33.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.935+0000 7f8f79a09740 20 client.25016 trim_cache size 0 max 16384 2024-08-18T22:08:33.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.960+0000 7f8f79a09740 1 Processor -- start 2024-08-18T22:08:33.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.960+0000 7f8f79a09740 1 -- start start 2024-08-18T22:08:33.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.961+0000 7f8f79a09740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22bf130 0x560db22c1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.961+0000 7f8f79a09740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bfa50 0x560db22e1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.961+0000 7f8f79a09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22ca310 0x560db22e22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.961+0000 7f8f79a09740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8f701b34c0 con 0x560db22bf130 2024-08-18T22:08:33.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.961+0000 7f8f79a09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8f701b0d90 con 0x560db22ca310 2024-08-18T22:08:33.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.961+0000 7f8f79a09740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8f701aebe0 con 0x560db22bfa50 2024-08-18T22:08:33.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.961+0000 7f8f753a7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bfa50 0x560db22e1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.961+0000 7f8f753a7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bfa50 0x560db22e1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:55392/0 (socket says 172.21.15.123:55392) 2024-08-18T22:08:33.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.961+0000 7f8f753a7640 1 -- 172.21.15.123:0/1693501259 learned_addr learned my addr 172.21.15.123:0/1693501259 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:33.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.961+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/1693501259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22ca310 0x560db22e22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.961+0000 7f8f753a7640 1 -- 172.21.15.123:0/1693501259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22ca310 msgr2=0x560db22e22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.961+0000 7f8f753a7640 1 --2- 172.21.15.123:0/1693501259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22ca310 0x560db22e22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.961+0000 7f8f753a7640 1 -- 172.21.15.123:0/1693501259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22bf130 msgr2=0x560db22c1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.961+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/1693501259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22bf130 0x560db22c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.962+0000 7f8f753a7640 1 --2- 172.21.15.123:0/1693501259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22bf130 0x560db22c1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.962+0000 7f8f753a7640 1 -- 172.21.15.123:0/1693501259 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db22b9c70 con 0x560db22bfa50 2024-08-18T22:08:33.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.962+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/1693501259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22bf130 0x560db22c1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:33.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.962+0000 7f8f753a7640 1 --2- 172.21.15.123:0/1693501259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bfa50 0x560db22e1db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c01be20 tx=0x7f8f6c005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9afc4a636700d5c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:33.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.962+0000 7f8f5affd640 1 -- 172.21.15.123:0/1693501259 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c02c020 con 0x560db22bfa50 2024-08-18T22:08:33.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.962+0000 7f8f5affd640 1 -- 172.21.15.123:0/1693501259 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f6c003e40 con 0x560db22bfa50 2024-08-18T22:08:33.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.962+0000 7f8f5affd640 1 -- 172.21.15.123:0/1693501259 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c0117e0 con 0x560db22bfa50 2024-08-18T22:08:33.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.963+0000 7f8f79a09740 1 -- 172.21.15.123:0/1693501259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bfa50 msgr2=0x560db22e1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.963+0000 7f8f79a09740 1 --2- 172.21.15.123:0/1693501259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bfa50 0x560db22e1db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c01be20 tx=0x7f8f6c005970 comp rx=0 tx=0).stop 2024-08-18T22:08:33.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.963+0000 7f8f79a09740 1 -- 172.21.15.123:0/1693501259 shutdown_connections 2024-08-18T22:08:33.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.963+0000 7f8f79a09740 1 --2- 172.21.15.123:0/1693501259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22ca310 0x560db22e22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.963+0000 7f8f79a09740 1 --2- 172.21.15.123:0/1693501259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bfa50 0x560db22e1db0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.963+0000 7f8f79a09740 1 --2- 172.21.15.123:0/1693501259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22bf130 0x560db22c1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.963+0000 7f8f79a09740 1 -- 172.21.15.123:0/1693501259 >> 172.21.15.123:0/1693501259 conn(0x560db22bb6c0 msgr2=0x560db22c0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:33.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.963+0000 7f8f79a09740 1 -- 172.21.15.123:0/1693501259 shutdown_connections 2024-08-18T22:08:33.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.963+0000 7f8f79a09740 1 -- 172.21.15.123:0/1693501259 wait complete. 2024-08-18T22:08:33.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.964+0000 7f8f79a09740 1 -- start start 2024-08-18T22:08:33.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.964+0000 7f8f79a09740 1 Processor -- start 2024-08-18T22:08:33.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f79a09740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bf130 0x560db22ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f79a09740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22bfa50 0x560db22ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f79a09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22ca310 0x560db2343d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f79a09740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8f701af250 con 0x560db22bfa50 2024-08-18T22:08:33.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f79a09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8f701b06c0 con 0x560db22ca310 2024-08-18T22:08:33.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f79a09740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8f701af920 con 0x560db22bf130 2024-08-18T22:08:33.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f79a09740 10 client.0 _ll_register_callbacks cb 0x7f8f6c004100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:33.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f753a7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22bfa50 0x560db22ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f753a7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22bfa50 0x560db22ceda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44672/0 (socket says 172.21.15.123:44672) 2024-08-18T22:08:33.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f753a7640 1 -- 172.21.15.123:0/4007021744 learned_addr learned my addr 172.21.15.123:0/4007021744 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:33.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/4007021744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bf130 0x560db22ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/4007021744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22ca310 0x560db2343d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f753a7640 1 -- 172.21.15.123:0/4007021744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bf130 msgr2=0x560db22ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f753a7640 1 --2- 172.21.15.123:0/4007021744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bf130 0x560db22ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f753a7640 1 -- 172.21.15.123:0/4007021744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22ca310 msgr2=0x560db2343d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:33.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f753a7640 1 --2- 172.21.15.123:0/4007021744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22ca310 0x560db2343d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f753a7640 1 -- 172.21.15.123:0/4007021744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560db23443c0 con 0x560db22bfa50 2024-08-18T22:08:33.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f753a7640 1 --2- 172.21.15.123:0/4007021744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22bfa50 0x560db22ceda0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c01bcb0 tx=0x7f8f6c005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64946a0b05595b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:33.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.965+0000 7f8f58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:33.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.966+0000 7f8f58ff9640 1 -- 172.21.15.123:0/4007021744 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c02c030 con 0x560db22bfa50 2024-08-18T22:08:33.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.966+0000 7f8f58ff9640 1 -- 172.21.15.123:0/4007021744 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8f6c01b9e0 con 0x560db22bfa50 2024-08-18T22:08:33.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.966+0000 7f8f79a09740 1 -- 172.21.15.123:0/4007021744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f6c003e40 con 0x560db22bfa50 2024-08-18T22:08:33.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.966+0000 7f8f58ff9640 1 -- 172.21.15.123:0/4007021744 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8f6c0117e0 con 0x560db22bfa50 2024-08-18T22:08:33.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.966+0000 7f8f79a09740 10 client.15522 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:33.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.966+0000 7f8f79a09740 1 -- 172.21.15.123:0/4007021744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560db23455f0 con 0x560db22bfa50 2024-08-18T22:08:33.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.966+0000 7f8f58ff9640 1 -- 172.21.15.123:0/4007021744 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f6c036020 con 0x560db22bfa50 2024-08-18T22:08:33.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.966+0000 7f8f58ff9640 1 -- 172.21.15.123:0/4007021744 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8f6c019070 con 0x560db22bfa50 2024-08-18T22:08:33.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.966+0000 7f8f79a09740 10 client.15522 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:33.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.966+0000 7f8f79a09740 10 client.15522 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:08:33.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.966+0000 7f8f79a09740 20 client.15522 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:33.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.966+0000 7f8f79a09740 1 --2- 172.21.15.123:0/4007021744 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560db22da0a0 0x560db2347e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:33.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.966+0000 7f8f79a09740 4 client.15522 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 154.7, "await_for": 45.0}] 2024-08-18T22:08:33.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.966+0000 7f8f79a09740 1 -- 172.21.15.123:0/4007021744 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 154.7, "await_for": 45.0}) -- 0x7f8f6c003e40 con 0x560db22da0a0 2024-08-18T22:08:33.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.967+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/4007021744 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560db22da0a0 0x560db2347e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:33.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.967+0000 7f8f58ff9640 10 client.15522 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:33.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.967+0000 7f8f74ba6640 1 --2- 172.21.15.123:0/4007021744 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560db22da0a0 0x560db2347e90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=790f298a40a5a5f5 server_cookie=c291211d81e90318 in_seq=0 out_seq=0 2024-08-18T22:08:33.978 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.977+0000 7f8f58ff9640 1 -- 172.21.15.123:0/4007021744 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f8f6c003e40 con 0x560db22da0a0 2024-08-18T22:08:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.977+0000 7f8f58ff9640 10 client.15522 handle_command_reply: tid=0 2024-08-18T22:08:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.977+0000 7f8f79a09740 1 client.15522 shutdown 2024-08-18T22:08:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.977+0000 7f8f79a09740 1 -- 172.21.15.123:0/4007021744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22bfa50 msgr2=0x560db22ceda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.977+0000 7f8f79a09740 1 --2- 172.21.15.123:0/4007021744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22bfa50 0x560db22ceda0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c01bcb0 tx=0x7f8f6c005770 comp rx=0 tx=0).stop 2024-08-18T22:08:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.977+0000 7f8f79a09740 1 -- 172.21.15.123:0/4007021744 shutdown_connections 2024-08-18T22:08:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.977+0000 7f8f79a09740 1 --2- 172.21.15.123:0/4007021744 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560db22da0a0 0x560db2347e90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.977+0000 7f8f79a09740 1 --2- 172.21.15.123:0/4007021744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560db22ca310 0x560db2343d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.977+0000 7f8f58ff9640 0 client.15522 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.977+0000 7f8f79a09740 1 --2- 172.21.15.123:0/4007021744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560db22bfa50 0x560db22ceda0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.977+0000 7f8f79a09740 1 --2- 172.21.15.123:0/4007021744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560db22bf130 0x560db22ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.977+0000 7f8f79a09740 1 -- 172.21.15.123:0/4007021744 >> 172.21.15.123:0/4007021744 conn(0x560db22bb6c0 msgr2=0x560db22c79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.977+0000 7f8f79a09740 1 -- 172.21.15.123:0/4007021744 shutdown_connections 2024-08-18T22:08:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.977+0000 7f8f79a09740 1 -- 172.21.15.123:0/4007021744 wait complete. 2024-08-18T22:08:33.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.977+0000 7f8f79a09740 20 client.15522 trim_cache size 0 max 16384 2024-08-18T22:08:33.980 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:08:33.980 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 26, 2024-08-18T22:08:33.980 INFO:teuthology.orchestra.run.smithi123.stdout: "leader": 24466, 2024-08-18T22:08:33.980 INFO:teuthology.orchestra.run.smithi123.stdout: "set_version": 2, 2024-08-18T22:08:33.980 INFO:teuthology.orchestra.run.smithi123.stdout: "sets": { 2024-08-18T22:08:33.980 INFO:teuthology.orchestra.run.smithi123.stdout: "22343c18": { 2024-08-18T22:08:33.980 INFO:teuthology.orchestra.run.smithi123.stdout: "version": 2, 2024-08-18T22:08:33.980 INFO:teuthology.orchestra.run.smithi123.stdout: "age_ref": 0.0, 2024-08-18T22:08:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:08:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "QUIESCED", 2024-08-18T22:08:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:08:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:08:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: "timeout": 90.0, 2024-08-18T22:08:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: "expiration": 154.7, 2024-08-18T22:08:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: "members": { 2024-08-18T22:08:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: "file:/": { 2024-08-18T22:08:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: "excluded": false, 2024-08-18T22:08:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:08:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "QUIESCED", 2024-08-18T22:08:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:08:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:08:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:08:33.982 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:08:33.982 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:08:33.982 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:08:33.982 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:08:33.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.978+0000 7f8f7760b640 1 -- 172.21.15.123:0/2440349870 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f5c0a2b80 msgr2=0x7f8f5c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.978+0000 7f8f7760b640 1 --2- 172.21.15.123:0/2440349870 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f5c0a2b80 0x7f8f5c0a5040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8f680095e0 tx=0x7f8f68087ca0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.978+0000 7f8f7760b640 1 -- 172.21.15.123:0/2440349870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f701078c0 msgr2=0x7f8f70074ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.978+0000 7f8f7760b640 1 --2- 172.21.15.123:0/2440349870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f701078c0 0x7f8f70074ca0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8f68005cc0 tx=0x7f8f68003970 comp rx=0 tx=0).stop 2024-08-18T22:08:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.978+0000 7f8f7760b640 1 -- 172.21.15.123:0/2440349870 shutdown_connections 2024-08-18T22:08:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.978+0000 7f8f7760b640 1 --2- 172.21.15.123:0/2440349870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f701078c0 0x7f8f70074ca0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.978+0000 7f8f7760b640 1 --2- 172.21.15.123:0/2440349870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f70102260 0x7f8f70074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.978+0000 7f8f7760b640 1 --2- 172.21.15.123:0/2440349870 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8f5c0a2b80 0x7f8f5c0a5040 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.978+0000 7f8f7760b640 1 --2- 172.21.15.123:0/2440349870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f701018c0 0x7f8f70074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.978+0000 7f8f7760b640 1 -- 172.21.15.123:0/2440349870 >> 172.21.15.123:0/2440349870 conn(0x7f8f700fd620 msgr2=0x7f8f700fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.978+0000 7f8f7760b640 1 -- 172.21.15.123:0/2440349870 shutdown_connections 2024-08-18T22:08:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:33.978+0000 7f8f7760b640 1 -- 172.21.15.123:0/2440349870 wait complete. 2024-08-18T22:08:34.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:34 smithi123 ceph-mon[18462]: pgmap v364: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-18T22:08:34.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:34 smithi130 ceph-mon[21698]: pgmap v364: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-18T22:08:34.831 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '22343c18', quiesce took 6.3 seconds. Will release after: 28.400000000000002 2024-08-18T22:08:34.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:34 smithi183 ceph-mon[22097]: pgmap v364: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-18T22:08:35.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.394+0000 7ff9e4997640 1 -- 172.21.15.123:0/2008563695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9e0100b50 msgr2=0x7ff9e0100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:35.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.394+0000 7ff9e4997640 1 --2- 172.21.15.123:0/2008563695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9e0100b50 0x7ff9e0100f30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009900 tx=0x7ff9d002a480 comp rx=0 tx=0).stop 2024-08-18T22:08:35.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.394+0000 7ff9e4997640 1 -- 172.21.15.123:0/2008563695 shutdown_connections 2024-08-18T22:08:35.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.394+0000 7ff9e4997640 1 --2- 172.21.15.123:0/2008563695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e0102c20 0x7ff9e010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:35.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.394+0000 7ff9e4997640 1 --2- 172.21.15.123:0/2008563695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e01022a0 0x7ff9e01026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:35.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.394+0000 7ff9e4997640 1 --2- 172.21.15.123:0/2008563695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9e0100b50 0x7ff9e0100f30 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:35.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.394+0000 7ff9e4997640 1 -- 172.21.15.123:0/2008563695 >> 172.21.15.123:0/2008563695 conn(0x7ff9e00fc500 msgr2=0x7ff9e00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:35.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.394+0000 7ff9e4997640 1 -- 172.21.15.123:0/2008563695 shutdown_connections 2024-08-18T22:08:35.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.394+0000 7ff9e4997640 1 -- 172.21.15.123:0/2008563695 wait complete. 2024-08-18T22:08:35.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.395+0000 7ff9e4997640 1 Processor -- start 2024-08-18T22:08:35.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.395+0000 7ff9e4997640 1 -- start start 2024-08-18T22:08:35.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.395+0000 7ff9e4997640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9e0100b50 0x7ff9e0196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:35.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9de59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9e0100b50 0x7ff9e0196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:35.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9de59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9e0100b50 0x7ff9e0196e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44686/0 (socket says 172.21.15.123:44686) 2024-08-18T22:08:35.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9e4997640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e01022a0 0x7ff9e01973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:35.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9de59c640 1 -- 172.21.15.123:0/2061627877 learned_addr learned my addr 172.21.15.123:0/2061627877 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:35.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9e4997640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0102c20 0x7ff9e019bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:35.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9e4997640 1 -- 172.21.15.123:0/2061627877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e0110cf0 con 0x7ff9e0100b50 2024-08-18T22:08:35.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9e4997640 1 -- 172.21.15.123:0/2061627877 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e0110b70 con 0x7ff9e0102c20 2024-08-18T22:08:35.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9e4997640 1 -- 172.21.15.123:0/2061627877 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e0110e70 con 0x7ff9e01022a0 2024-08-18T22:08:35.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9ddd9b640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e01022a0 0x7ff9e01973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:35.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9ded9d640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0102c20 0x7ff9e019bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:35.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9de59c640 1 -- 172.21.15.123:0/2061627877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e01022a0 msgr2=0x7ff9e01973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:35.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9de59c640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e01022a0 0x7ff9e01973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:35.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9de59c640 1 -- 172.21.15.123:0/2061627877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0102c20 msgr2=0x7ff9e019bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:35.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9de59c640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0102c20 0x7ff9e019bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:35.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9de59c640 1 -- 172.21.15.123:0/2061627877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e019c410 con 0x7ff9e0100b50 2024-08-18T22:08:35.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.396+0000 7ff9ded9d640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0102c20 0x7ff9e019bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:35.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.397+0000 7ff9de59c640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9e0100b50 0x7ff9e0196e80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0006010 tx=0x7ff9d0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:35.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.397+0000 7ff9cf7fe640 1 -- 172.21.15.123:0/2061627877 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d003f070 con 0x7ff9e0100b50 2024-08-18T22:08:35.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.397+0000 7ff9cf7fe640 1 -- 172.21.15.123:0/2061627877 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9d0031c30 con 0x7ff9e0100b50 2024-08-18T22:08:35.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.397+0000 7ff9cf7fe640 1 -- 172.21.15.123:0/2061627877 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0035030 con 0x7ff9e0100b50 2024-08-18T22:08:35.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.397+0000 7ff9e4997640 1 -- 172.21.15.123:0/2061627877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e019c6a0 con 0x7ff9e0100b50 2024-08-18T22:08:35.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.398+0000 7ff9e4997640 1 -- 172.21.15.123:0/2061627877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e019cb30 con 0x7ff9e0100b50 2024-08-18T22:08:35.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.399+0000 7ff9e4997640 1 -- 172.21.15.123:0/2061627877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e0101ee0 con 0x7ff9e0100b50 2024-08-18T22:08:35.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.401+0000 7ff9cf7fe640 1 -- 172.21.15.123:0/2061627877 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7ff9d0042070 con 0x7ff9e0100b50 2024-08-18T22:08:35.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.402+0000 7ff9cf7fe640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9c80a2c00 0x7ff9c80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:35.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.402+0000 7ff9ddd9b640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9c80a2c00 0x7ff9c80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:35.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.402+0000 7ff9cf7fe640 1 -- 172.21.15.123:0/2061627877 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ff9d00f04a0 con 0x7ff9e0100b50 2024-08-18T22:08:35.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.403+0000 7ff9ddd9b640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9c80a2c00 0x7ff9c80a50c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff9e006a830 tx=0x7ff9d4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:35.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.408+0000 7ff9cf7fe640 1 -- 172.21.15.123:0/2061627877 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff9d0049030 con 0x7ff9e0100b50 2024-08-18T22:08:35.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.759+0000 7ff9e4997640 1 -- 172.21.15.123:0/2061627877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9e006a2d0 con 0x7ff9e0100b50 2024-08-18T22:08:35.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.761+0000 7ff9cf7fe640 1 -- 172.21.15.123:0/2061627877 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7ff9d003a3c0 con 0x7ff9e0100b50 2024-08-18T22:08:35.762 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:08:35.762 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"btime":"2024-08-18T22:07:46:492460+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:07:45.601053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:08:35.762 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 26 2024-08-18T22:08:35.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.764+0000 7ff9e4997640 1 -- 172.21.15.123:0/2061627877 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9c80a2c00 msgr2=0x7ff9c80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:35.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.764+0000 7ff9e4997640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9c80a2c00 0x7ff9c80a50c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff9e006a830 tx=0x7ff9d4008040 comp rx=0 tx=0).stop 2024-08-18T22:08:35.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.764+0000 7ff9e4997640 1 -- 172.21.15.123:0/2061627877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9e0100b50 msgr2=0x7ff9e0196e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:35.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.764+0000 7ff9e4997640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9e0100b50 0x7ff9e0196e80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0006010 tx=0x7ff9d0003c10 comp rx=0 tx=0).stop 2024-08-18T22:08:35.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.764+0000 7ff9e4997640 1 -- 172.21.15.123:0/2061627877 shutdown_connections 2024-08-18T22:08:35.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.764+0000 7ff9e4997640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff9c80a2c00 0x7ff9c80a50c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:35.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.764+0000 7ff9e4997640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0102c20 0x7ff9e019bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:35.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.764+0000 7ff9e4997640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e01022a0 0x7ff9e01973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:35.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.764+0000 7ff9e4997640 1 --2- 172.21.15.123:0/2061627877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9e0100b50 0x7ff9e0196e80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:35.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.764+0000 7ff9e4997640 1 -- 172.21.15.123:0/2061627877 >> 172.21.15.123:0/2061627877 conn(0x7ff9e00fc500 msgr2=0x7ff9e00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:35.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.764+0000 7ff9e4997640 1 -- 172.21.15.123:0/2061627877 shutdown_connections 2024-08-18T22:08:35.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:35.764+0000 7ff9e4997640 1 -- 172.21.15.123:0/2061627877 wait complete. 2024-08-18T22:08:36.518 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-18T22:08:36.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:36 smithi123 ceph-mon[18462]: pgmap v365: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-08-18T22:08:36.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:36 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2061627877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:08:36.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:36 smithi130 ceph-mon[21698]: pgmap v365: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-08-18T22:08:36.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:36 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2061627877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:08:36.785 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:36.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:36 smithi183 ceph-mon[22097]: pgmap v365: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-08-18T22:08:36.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:36 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2061627877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:08:37.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.267+0000 7fc5ce76e640 1 -- 172.21.15.123:0/784618772 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5c8102c20 msgr2=0x7fc5c810d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:37.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.267+0000 7fc5ce76e640 1 --2- 172.21.15.123:0/784618772 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5c8102c20 0x7fc5c810d770 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009ca0 tx=0x7fc5c002a950 comp rx=0 tx=0).stop 2024-08-18T22:08:37.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.267+0000 7fc5ce76e640 1 -- 172.21.15.123:0/784618772 shutdown_connections 2024-08-18T22:08:37.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.267+0000 7fc5ce76e640 1 --2- 172.21.15.123:0/784618772 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5c8102c20 0x7fc5c810d770 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.267+0000 7fc5ce76e640 1 --2- 172.21.15.123:0/784618772 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5c81022a0 0x7fc5c81026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.267+0000 7fc5ce76e640 1 --2- 172.21.15.123:0/784618772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5c8100b50 0x7fc5c8100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.267+0000 7fc5ce76e640 1 -- 172.21.15.123:0/784618772 >> 172.21.15.123:0/784618772 conn(0x7fc5c80fc500 msgr2=0x7fc5c80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:37.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.267+0000 7fc5ce76e640 1 -- 172.21.15.123:0/784618772 shutdown_connections 2024-08-18T22:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.267+0000 7fc5ce76e640 1 -- 172.21.15.123:0/784618772 wait complete. 2024-08-18T22:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.268+0000 7fc5ce76e640 1 Processor -- start 2024-08-18T22:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.268+0000 7fc5ce76e640 1 -- start start 2024-08-18T22:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.268+0000 7fc5ce76e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5c8100b50 0x7fc5c8198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.268+0000 7fc5ce76e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5c81022a0 0x7fc5c8198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.268+0000 7fc5ce76e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5c8102c20 0x7fc5c819c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.268+0000 7fc5ce76e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c8110cb0 con 0x7fc5c81022a0 2024-08-18T22:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.268+0000 7fc5ce76e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c8110b30 con 0x7fc5c8102c20 2024-08-18T22:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.268+0000 7fc5ce76e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c8110e30 con 0x7fc5c8100b50 2024-08-18T22:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.269+0000 7fc5c77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5c81022a0 0x7fc5c8198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.269+0000 7fc5c77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5c81022a0 0x7fc5c8198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44716/0 (socket says 172.21.15.123:44716) 2024-08-18T22:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.269+0000 7fc5c77fe640 1 -- 172.21.15.123:0/2661386601 learned_addr learned my addr 172.21.15.123:0/2661386601 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.269+0000 7fc5c7fff640 1 --2- 172.21.15.123:0/2661386601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5c8100b50 0x7fc5c8198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.269+0000 7fc5ccd0b640 1 --2- 172.21.15.123:0/2661386601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5c8102c20 0x7fc5c819c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.269+0000 7fc5c77fe640 1 -- 172.21.15.123:0/2661386601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5c8100b50 msgr2=0x7fc5c8198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.269+0000 7fc5c77fe640 1 --2- 172.21.15.123:0/2661386601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5c8100b50 0x7fc5c8198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.269+0000 7fc5c77fe640 1 -- 172.21.15.123:0/2661386601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5c8102c20 msgr2=0x7fc5c819c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.269+0000 7fc5c77fe640 1 --2- 172.21.15.123:0/2661386601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5c8102c20 0x7fc5c819c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.269+0000 7fc5c77fe640 1 -- 172.21.15.123:0/2661386601 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c819d0b0 con 0x7fc5c81022a0 2024-08-18T22:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.269+0000 7fc5ccd0b640 1 --2- 172.21.15.123:0/2661386601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5c8102c20 0x7fc5c819c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.269+0000 7fc5c77fe640 1 --2- 172.21.15.123:0/2661386601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5c81022a0 0x7fc5c8198640 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00bec0 tx=0x7fc5bc00dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.269+0000 7fc5c57fa640 1 -- 172.21.15.123:0/2661386601 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc018070 con 0x7fc5c81022a0 2024-08-18T22:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.269+0000 7fc5c57fa640 1 -- 172.21.15.123:0/2661386601 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5bc016070 con 0x7fc5c81022a0 2024-08-18T22:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.270+0000 7fc5ce76e640 1 -- 172.21.15.123:0/2661386601 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c819d3a0 con 0x7fc5c81022a0 2024-08-18T22:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.270+0000 7fc5c57fa640 1 -- 172.21.15.123:0/2661386601 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc005650 con 0x7fc5c81022a0 2024-08-18T22:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.270+0000 7fc5ce76e640 1 -- 172.21.15.123:0/2661386601 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c80fc8e0 con 0x7fc5c81022a0 2024-08-18T22:08:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.273+0000 7fc5c57fa640 1 -- 172.21.15.123:0/2661386601 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fc5bc004020 con 0x7fc5c81022a0 2024-08-18T22:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5c57fa640 1 --2- 172.21.15.123:0/2661386601 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc5b00a2c00 0x7fc5b00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5d0b6c740 1 Processor -- start 2024-08-18T22:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5c57fa640 1 -- 172.21.15.123:0/2661386601 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fc5bc0d27c0 con 0x7fc5c81022a0 2024-08-18T22:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5c7fff640 1 --2- 172.21.15.123:0/2661386601 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc5b00a2c00 0x7fc5b00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5d0b6c740 1 -- start start 2024-08-18T22:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5d0b6c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e63211ff0 0x563e632123d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5d0b6c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 0x563e6321cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5d0b6c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e6321d1d0 0x563e6321f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5d0b6c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x563e63177a40 con 0x563e63211ff0 2024-08-18T22:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5d0b6c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563e6310f9d0 con 0x563e6321d1d0 2024-08-18T22:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5d0b6c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563e63173a00 con 0x563e63212910 2024-08-18T22:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e63211ff0 0x563e632123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e63211ff0 0x563e632123d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44722/0 (socket says 172.21.15.123:44722) 2024-08-18T22:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5c7fff640 1 -- 172.21.15.123:0/3659325760 learned_addr learned my addr 172.21.15.123:0/3659325760 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5c77fe640 1 --2- 172.21.15.123:0/3659325760 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 0x563e6321cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.274+0000 7fc5c7fff640 1 --2- 172.21.15.123:0/2661386601 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc5b00a2c00 0x7fc5b00a50c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800abe0 tx=0x7fc5b800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.275+0000 7fc5ccd0b640 1 --2- 172.21.15.123:0/3659325760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e6321d1d0 0x563e6321f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.275+0000 7fc5c7fff640 1 -- 172.21.15.123:0/3659325760 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 msgr2=0x563e6321cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.275+0000 7fc5c7fff640 1 --2- 172.21.15.123:0/3659325760 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 0x563e6321cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.275+0000 7fc5c7fff640 1 -- 172.21.15.123:0/3659325760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e6321d1d0 msgr2=0x563e6321f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.275+0000 7fc5c7fff640 1 --2- 172.21.15.123:0/3659325760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e6321d1d0 0x563e6321f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.275+0000 7fc5c7fff640 1 -- 172.21.15.123:0/3659325760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e63116650 con 0x563e63211ff0 2024-08-18T22:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.275+0000 7fc5c77fe640 1 --2- 172.21.15.123:0/3659325760 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 0x563e6321cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.275+0000 7fc5c7fff640 1 --2- 172.21.15.123:0/3659325760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e63211ff0 0x563e632123d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800fff0 tx=0x7fc5b8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b3d1cf325d30b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.275+0000 7fc5ae7fc640 1 -- 172.21.15.123:0/3659325760 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8016070 con 0x563e63211ff0 2024-08-18T22:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.275+0000 7fc5ae7fc640 1 -- 172.21.15.123:0/3659325760 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5b8025b50 con 0x563e63211ff0 2024-08-18T22:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.275+0000 7fc5ae7fc640 1 -- 172.21.15.123:0/3659325760 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b801cd80 con 0x563e63211ff0 2024-08-18T22:08:37.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.276+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/3659325760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e63211ff0 msgr2=0x563e632123d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.276+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/3659325760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e63211ff0 0x563e632123d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800fff0 tx=0x7fc5b8012000 comp rx=0 tx=0).stop 2024-08-18T22:08:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.277+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/3659325760 shutdown_connections 2024-08-18T22:08:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.277+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/3659325760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e6321d1d0 0x563e6321f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.277+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/3659325760 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 0x563e6321cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.277+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/3659325760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e63211ff0 0x563e632123d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.277+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/3659325760 >> 172.21.15.123:0/3659325760 conn(0x563e6320e580 msgr2=0x563e6320e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.277+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/3659325760 shutdown_connections 2024-08-18T22:08:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.277+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/3659325760 wait complete. 2024-08-18T22:08:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.277+0000 7fc5d0b6c740 1 -- start start 2024-08-18T22:08:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.277+0000 7fc5d0b6c740 1 Processor -- start 2024-08-18T22:08:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5d0b6c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e63211ff0 0x563e6321a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5d0b6c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 0x563e6321a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5d0b6c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e6321d1d0 0x563e6321ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5d0b6c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x563e6321fda0 con 0x563e6321d1d0 2024-08-18T22:08:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5d0b6c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563e63132b20 con 0x563e63211ff0 2024-08-18T22:08:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5d0b6c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563e6321ff20 con 0x563e63212910 2024-08-18T22:08:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5d0b6c740 10 client.0 _ll_register_callbacks cb 0x563e63130bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5ccd0b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e6321d1d0 0x563e6321ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5ccd0b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e6321d1d0 0x563e6321ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44736/0 (socket says 172.21.15.123:44736) 2024-08-18T22:08:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5ccd0b640 1 -- 172.21.15.123:0/3462060562 learned_addr learned my addr 172.21.15.123:0/3462060562 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5c77fe640 1 --2- 172.21.15.123:0/3462060562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 0x563e6321a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5ccd0b640 1 -- 172.21.15.123:0/3462060562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 msgr2=0x563e6321a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5ccd0b640 1 --2- 172.21.15.123:0/3462060562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 0x563e6321a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5ccd0b640 1 -- 172.21.15.123:0/3462060562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e63211ff0 msgr2=0x563e6321a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5c7fff640 1 --2- 172.21.15.123:0/3462060562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e63211ff0 0x563e6321a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5ccd0b640 1 --2- 172.21.15.123:0/3462060562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e63211ff0 0x563e6321a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.278+0000 7fc5ccd0b640 1 -- 172.21.15.123:0/3462060562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e62ee93c0 con 0x563e6321d1d0 2024-08-18T22:08:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.279+0000 7fc5ccd0b640 1 --2- 172.21.15.123:0/3462060562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e6321d1d0 0x563e6321ab20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc5c002fd80 tx=0x7fc5c002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f5d5df7d8498f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.279+0000 7fc5a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.279+0000 7fc5a77fe640 1 -- 172.21.15.123:0/3462060562 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0034040 con 0x563e6321d1d0 2024-08-18T22:08:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.279+0000 7fc5a77fe640 1 -- 172.21.15.123:0/3462060562 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fc5c0003b80 con 0x563e6321d1d0 2024-08-18T22:08:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.279+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/3462060562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5b8025b50 con 0x563e6321d1d0 2024-08-18T22:08:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.279+0000 7fc5a77fe640 1 -- 172.21.15.123:0/3462060562 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc5c004f050 con 0x563e6321d1d0 2024-08-18T22:08:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.279+0000 7fc5d0b6c740 10 client.15540 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.279+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/3462060562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563e6322b9a0 con 0x563e6321d1d0 2024-08-18T22:08:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.280+0000 7fc5a77fe640 1 -- 172.21.15.123:0/3462060562 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5c0003dc0 con 0x563e6321d1d0 2024-08-18T22:08:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.280+0000 7fc5a77fe640 1 -- 172.21.15.123:0/3462060562 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc5c0030520 con 0x563e6321d1d0 2024-08-18T22:08:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.280+0000 7fc5d0b6c740 10 client.15540 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.280+0000 7fc5d0b6c740 10 client.15540 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-18T22:08:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.280+0000 7fc5d0b6c740 20 client.15540 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:37.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.280+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/3462060562 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x563e6322ce60 0x563e6322f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.281+0000 7fc5d0b6c740 4 client.15540 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:08:37.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.281+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/3462060562 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc5b8025b50 con 0x563e6322ce60 2024-08-18T22:08:37.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.281+0000 7fc5c7fff640 1 --2- 172.21.15.123:0/3462060562 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x563e6322ce60 0x563e6322f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.281+0000 7fc5a77fe640 10 client.15540 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:08:37.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.281+0000 7fc5c7fff640 1 --2- 172.21.15.123:0/3462060562 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x563e6322ce60 0x563e6322f290 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5387f2d93692dba7 server_cookie=ad06d968053dcebc in_seq=0 out_seq=0 2024-08-18T22:08:37.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.282+0000 7fc5a77fe640 1 -- 172.21.15.123:0/3462060562 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc5b8025b50 con 0x563e6322ce60 2024-08-18T22:08:37.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.282+0000 7fc5a77fe640 10 client.15540 handle_command_reply: tid=0 2024-08-18T22:08:37.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.282+0000 7fc5d0b6c740 1 client.15540 shutdown 2024-08-18T22:08:37.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.282+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/3462060562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e6321d1d0 msgr2=0x563e6321ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:37.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.282+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/3462060562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e6321d1d0 0x563e6321ab20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc5c002fd80 tx=0x7fc5c002f5d0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.282+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/3462060562 shutdown_connections 2024-08-18T22:08:37.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.282+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/3462060562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e6321d1d0 0x563e6321ab20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.282+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/3462060562 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x563e6322ce60 0x563e6322f290 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.282+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/3462060562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 0x563e6321a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.282+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/3462060562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e63211ff0 0x563e6321a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.282+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/3462060562 >> 172.21.15.123:0/3462060562 conn(0x563e6320e580 msgr2=0x563e63214260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:37.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.282+0000 7fc5a77fe640 0 client.15540 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:08:37.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.283+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/3462060562 shutdown_connections 2024-08-18T22:08:37.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.283+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/3462060562 wait complete. 2024-08-18T22:08:37.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.283+0000 7fc5d0b6c740 20 client.15540 trim_cache size 0 max 16384 2024-08-18T22:08:37.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.307+0000 7fc5d0b6c740 1 Processor -- start 2024-08-18T22:08:37.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.307+0000 7fc5d0b6c740 1 -- start start 2024-08-18T22:08:37.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.307+0000 7fc5d0b6c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63211ff0 0x563e63214a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.307+0000 7fc5d0b6c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e63212910 0x563e63219980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.307+0000 7fc5d0b6c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e6321d1d0 0x563e6321bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.307+0000 7fc5d0b6c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c81aeeb0 con 0x563e63212910 2024-08-18T22:08:37.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.307+0000 7fc5d0b6c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c81ac780 con 0x563e6321d1d0 2024-08-18T22:08:37.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.307+0000 7fc5d0b6c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c81aa6d0 con 0x563e63211ff0 2024-08-18T22:08:37.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.307+0000 7fc5c77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e63212910 0x563e63219980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.307+0000 7fc5c77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e63212910 0x563e63219980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44750/0 (socket says 172.21.15.123:44750) 2024-08-18T22:08:37.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.307+0000 7fc5c77fe640 1 -- 172.21.15.123:0/829586942 learned_addr learned my addr 172.21.15.123:0/829586942 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:37.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.308+0000 7fc5c77fe640 1 -- 172.21.15.123:0/829586942 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63211ff0 msgr2=0x563e63214a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:37.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.308+0000 7fc5c77fe640 1 --2- 172.21.15.123:0/829586942 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63211ff0 0x563e63214a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.308+0000 7fc5c77fe640 1 -- 172.21.15.123:0/829586942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e6321d1d0 msgr2=0x563e6321bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:37.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.308+0000 7fc5c77fe640 1 --2- 172.21.15.123:0/829586942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e6321d1d0 0x563e6321bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.308+0000 7fc5c77fe640 1 -- 172.21.15.123:0/829586942 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e63212740 con 0x563e63212910 2024-08-18T22:08:37.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.308+0000 7fc5c77fe640 1 --2- 172.21.15.123:0/829586942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e63212910 0x563e63219980 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009610 tx=0x7fc5bc0d2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74790d769ce34778 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:37.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.308+0000 7fc5adffb640 1 -- 172.21.15.123:0/829586942 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc021050 con 0x563e63212910 2024-08-18T22:08:37.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.308+0000 7fc5adffb640 1 -- 172.21.15.123:0/829586942 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5bc09cd30 con 0x563e63212910 2024-08-18T22:08:37.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.308+0000 7fc5adffb640 1 -- 172.21.15.123:0/829586942 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc09e0e0 con 0x563e63212910 2024-08-18T22:08:37.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.309+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/829586942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e63212910 msgr2=0x563e63219980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:37.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.309+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/829586942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e63212910 0x563e63219980 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009610 tx=0x7fc5bc0d2040 comp rx=0 tx=0).stop 2024-08-18T22:08:37.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.309+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/829586942 shutdown_connections 2024-08-18T22:08:37.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.309+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/829586942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e6321d1d0 0x563e6321bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.309+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/829586942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e63212910 0x563e63219980 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.309+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/829586942 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63211ff0 0x563e63214a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.309+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/829586942 >> 172.21.15.123:0/829586942 conn(0x563e6320e580 msgr2=0x563e6321b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.309+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/829586942 shutdown_connections 2024-08-18T22:08:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.309+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/829586942 wait complete. 2024-08-18T22:08:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.309+0000 7fc5d0b6c740 1 -- start start 2024-08-18T22:08:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.310+0000 7fc5d0b6c740 1 Processor -- start 2024-08-18T22:08:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.310+0000 7fc5d0b6c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e63211ff0 0x563e63220130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.310+0000 7fc5d0b6c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 0x563e63220670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.310+0000 7fc5d0b6c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e6321d1d0 0x563e63220bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.310+0000 7fc5d0b6c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c81aac90 con 0x563e6321d1d0 2024-08-18T22:08:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.310+0000 7fc5d0b6c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c81ac0b0 con 0x563e63211ff0 2024-08-18T22:08:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.310+0000 7fc5d0b6c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c81ab310 con 0x563e63212910 2024-08-18T22:08:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.310+0000 7fc5d0b6c740 10 client.0 _ll_register_callbacks cb 0x7fc5c0009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.310+0000 7fc5ccd0b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e6321d1d0 0x563e63220bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.310+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e63211ff0 0x563e63220130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.310+0000 7fc5ccd0b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e6321d1d0 0x563e63220bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44762/0 (socket says 172.21.15.123:44762) 2024-08-18T22:08:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.310+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e63211ff0 0x563e63220130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:46890/0 (socket says 172.21.15.123:46890) 2024-08-18T22:08:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.310+0000 7fc5ccd0b640 1 -- 172.21.15.123:0/1714238376 learned_addr learned my addr 172.21.15.123:0/1714238376 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.310+0000 7fc5c77fe640 1 --2- 172.21.15.123:0/1714238376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 0x563e63220670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.311+0000 7fc5ccd0b640 1 -- 172.21.15.123:0/1714238376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 msgr2=0x563e63220670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.311+0000 7fc5ccd0b640 1 --2- 172.21.15.123:0/1714238376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 0x563e63220670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.311+0000 7fc5ccd0b640 1 -- 172.21.15.123:0/1714238376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e63211ff0 msgr2=0x563e63220130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.311+0000 7fc5ccd0b640 1 --2- 172.21.15.123:0/1714238376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e63211ff0 0x563e63220130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.311+0000 7fc5ccd0b640 1 -- 172.21.15.123:0/1714238376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e63295d90 con 0x563e6321d1d0 2024-08-18T22:08:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.311+0000 7fc5c7fff640 1 --2- 172.21.15.123:0/1714238376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e63211ff0 0x563e63220130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.311+0000 7fc5ccd0b640 1 --2- 172.21.15.123:0/1714238376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e6321d1d0 0x563e63220bb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc5c002ae70 tx=0x7fc5c002f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf87b4ac6eb1e4ba server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.311+0000 7fc5a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.311+0000 7fc5a77fe640 1 -- 172.21.15.123:0/1714238376 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0058060 con 0x563e6321d1d0 2024-08-18T22:08:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.311+0000 7fc5a77fe640 1 -- 172.21.15.123:0/1714238376 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fc5c0030440 con 0x563e6321d1d0 2024-08-18T22:08:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.311+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/1714238376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5bc09cd30 con 0x563e6321d1d0 2024-08-18T22:08:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.311+0000 7fc5a77fe640 1 -- 172.21.15.123:0/1714238376 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc5c0034030 con 0x563e6321d1d0 2024-08-18T22:08:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.311+0000 7fc5d0b6c740 10 client.15546 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.311+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/1714238376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563e63297070 con 0x563e6321d1d0 2024-08-18T22:08:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.312+0000 7fc5a77fe640 1 -- 172.21.15.123:0/1714238376 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5bc09cd30 con 0x563e6321d1d0 2024-08-18T22:08:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.312+0000 7fc5a77fe640 1 -- 172.21.15.123:0/1714238376 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc5c0053c10 con 0x563e6321d1d0 2024-08-18T22:08:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.312+0000 7fc5d0b6c740 10 client.15546 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.312+0000 7fc5d0b6c740 10 client.15546 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-18T22:08:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.312+0000 7fc5d0b6c740 20 client.15546 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.312+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/1714238376 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x563e63297790 0x563e63299b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.312+0000 7fc5d0b6c740 4 client.15546 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:08:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.312+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/1714238376 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563e63184fb0 con 0x563e63297790 2024-08-18T22:08:37.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.312+0000 7fc5c7fff640 1 --2- 172.21.15.123:0/1714238376 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x563e63297790 0x563e63299b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5c7fff640 1 --2- 172.21.15.123:0/1714238376 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x563e63297790 0x563e63299b80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1c7afc31aa9adb52 server_cookie=33d4490e1cc00082 in_seq=0 out_seq=0 2024-08-18T22:08:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5a77fe640 10 client.15546 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:08:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5a77fe640 1 -- 172.21.15.123:0/1714238376 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563e63184fb0 con 0x563e63297790 2024-08-18T22:08:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5a77fe640 10 client.15546 handle_command_reply: tid=0 2024-08-18T22:08:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5d0b6c740 1 client.15546 shutdown 2024-08-18T22:08:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/1714238376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e6321d1d0 msgr2=0x563e63220bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/1714238376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e6321d1d0 0x563e63220bb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc5c002ae70 tx=0x7fc5c002f7e0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/1714238376 shutdown_connections 2024-08-18T22:08:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/1714238376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e6321d1d0 0x563e63220bb0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/1714238376 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x563e63297790 0x563e63299b80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/1714238376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e63212910 0x563e63220670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5d0b6c740 1 --2- 172.21.15.123:0/1714238376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e63211ff0 0x563e63220130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5a77fe640 0 client.15546 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:08:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/1714238376 >> 172.21.15.123:0/1714238376 conn(0x563e6320e580 msgr2=0x563e6321a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/1714238376 shutdown_connections 2024-08-18T22:08:37.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.313+0000 7fc5d0b6c740 1 -- 172.21.15.123:0/1714238376 wait complete. 2024-08-18T22:08:37.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.314+0000 7fc5d0b6c740 20 client.15546 trim_cache size 0 max 16384 2024-08-18T22:08:37.319 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:08:37.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.314+0000 7fc5ce76e640 1 -- 172.21.15.123:0/2661386601 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc5b00a2c00 msgr2=0x7fc5b00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.314+0000 7fc5ce76e640 1 --2- 172.21.15.123:0/2661386601 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc5b00a2c00 0x7fc5b00a50c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800abe0 tx=0x7fc5b800a2d0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.314+0000 7fc5ce76e640 1 -- 172.21.15.123:0/2661386601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5c81022a0 msgr2=0x7fc5c8198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.314+0000 7fc5ce76e640 1 --2- 172.21.15.123:0/2661386601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5c81022a0 0x7fc5c8198640 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00bec0 tx=0x7fc5bc00dd20 comp rx=0 tx=0).stop 2024-08-18T22:08:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.314+0000 7fc5ce76e640 1 -- 172.21.15.123:0/2661386601 shutdown_connections 2024-08-18T22:08:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.314+0000 7fc5ce76e640 1 --2- 172.21.15.123:0/2661386601 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc5b00a2c00 0x7fc5b00a50c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.314+0000 7fc5ce76e640 1 --2- 172.21.15.123:0/2661386601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5c8102c20 0x7fc5c819c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.314+0000 7fc5ce76e640 1 --2- 172.21.15.123:0/2661386601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5c81022a0 0x7fc5c8198640 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.314+0000 7fc5ce76e640 1 --2- 172.21.15.123:0/2661386601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5c8100b50 0x7fc5c8198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.314+0000 7fc5ce76e640 1 -- 172.21.15.123:0/2661386601 >> 172.21.15.123:0/2661386601 conn(0x7fc5c80fc500 msgr2=0x7fc5c8069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.315+0000 7fc5ce76e640 1 -- 172.21.15.123:0/2661386601 shutdown_connections 2024-08-18T22:08:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:37.315+0000 7fc5ce76e640 1 -- 172.21.15.123:0/2661386601 wait complete. 2024-08-18T22:08:38.149 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-18T22:08:38.415 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:38 smithi123 ceph-mon[18462]: pgmap v366: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 5 op/s 2024-08-18T22:08:38.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:38 smithi130 ceph-mon[21698]: pgmap v366: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 5 op/s 2024-08-18T22:08:38.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:38 smithi183 ceph-mon[22097]: pgmap v366: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 5 op/s 2024-08-18T22:08:38.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.916+0000 7f8cb02f2640 1 -- 172.21.15.123:0/1621975142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ca81022a0 msgr2=0x7f8ca81026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:38.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.916+0000 7f8cb02f2640 1 --2- 172.21.15.123:0/1621975142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ca81022a0 0x7f8ca81026e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009900 tx=0x7f8c9802a480 comp rx=0 tx=0).stop 2024-08-18T22:08:38.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.916+0000 7f8cb02f2640 1 -- 172.21.15.123:0/1621975142 shutdown_connections 2024-08-18T22:08:38.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.916+0000 7f8cb02f2640 1 --2- 172.21.15.123:0/1621975142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ca8102c20 0x7f8ca810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.916+0000 7f8cb02f2640 1 --2- 172.21.15.123:0/1621975142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ca81022a0 0x7f8ca81026e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.916+0000 7f8cb02f2640 1 --2- 172.21.15.123:0/1621975142 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca8100b50 0x7f8ca8100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.916+0000 7f8cb02f2640 1 -- 172.21.15.123:0/1621975142 >> 172.21.15.123:0/1621975142 conn(0x7f8ca80fc500 msgr2=0x7f8ca80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:38.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.916+0000 7f8cb02f2640 1 -- 172.21.15.123:0/1621975142 shutdown_connections 2024-08-18T22:08:38.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.916+0000 7f8cb02f2640 1 -- 172.21.15.123:0/1621975142 wait complete. 2024-08-18T22:08:38.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.917+0000 7f8cb02f2640 1 Processor -- start 2024-08-18T22:08:38.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.917+0000 7f8cb02f2640 1 -- start start 2024-08-18T22:08:38.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.917+0000 7f8cb02f2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca8100b50 0x7f8ca819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.917+0000 7f8cb02f2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ca81022a0 0x7f8ca819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.917+0000 7f8cb02f2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ca8102c20 0x7f8ca819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.917+0000 7f8cb02f2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca8110c70 con 0x7f8ca81022a0 2024-08-18T22:08:38.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.917+0000 7f8cb02f2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca8110af0 con 0x7f8ca8100b50 2024-08-18T22:08:38.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.917+0000 7f8cb02f2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca8110df0 con 0x7f8ca8102c20 2024-08-18T22:08:38.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.918+0000 7f8cae08e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca8100b50 0x7f8ca819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.918+0000 7f8cae08e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca8100b50 0x7f8ca819a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:46906/0 (socket says 172.21.15.123:46906) 2024-08-18T22:08:38.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.918+0000 7f8cae08e640 1 -- 172.21.15.123:0/493089826 learned_addr learned my addr 172.21.15.123:0/493089826 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:38.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.918+0000 7f8cae88f640 1 --2- 172.21.15.123:0/493089826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ca8102c20 0x7f8ca819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.918+0000 7f8cae08e640 1 -- 172.21.15.123:0/493089826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ca8102c20 msgr2=0x7f8ca819eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:38.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.918+0000 7f8cae08e640 1 --2- 172.21.15.123:0/493089826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ca8102c20 0x7f8ca819eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.918+0000 7f8cae08e640 1 -- 172.21.15.123:0/493089826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ca81022a0 msgr2=0x7f8ca819aa10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:08:38.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.918+0000 7f8cae08e640 1 --2- 172.21.15.123:0/493089826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ca81022a0 0x7f8ca819aa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.918+0000 7f8cae08e640 1 -- 172.21.15.123:0/493089826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca819f480 con 0x7f8ca8100b50 2024-08-18T22:08:38.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.918+0000 7f8cae88f640 1 --2- 172.21.15.123:0/493089826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ca8102c20 0x7f8ca819eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:38.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.918+0000 7f8cae08e640 1 --2- 172.21.15.123:0/493089826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca8100b50 0x7f8ca819a4d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400d950 tx=0x7f8ca400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:38.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.918+0000 7f8c9f7fe640 1 -- 172.21.15.123:0/493089826 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4017070 con 0x7f8ca8100b50 2024-08-18T22:08:38.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.919+0000 7f8c9f7fe640 1 -- 172.21.15.123:0/493089826 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ca4009c30 con 0x7f8ca8100b50 2024-08-18T22:08:38.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.919+0000 7f8c9f7fe640 1 -- 172.21.15.123:0/493089826 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca400f6b0 con 0x7f8ca8100b50 2024-08-18T22:08:38.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.919+0000 7f8cb02f2640 1 -- 172.21.15.123:0/493089826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca819f770 con 0x7f8ca8100b50 2024-08-18T22:08:38.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.919+0000 7f8cb02f2640 1 -- 172.21.15.123:0/493089826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca81a7050 con 0x7f8ca8100b50 2024-08-18T22:08:38.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.922+0000 7f8c9f7fe640 1 -- 172.21.15.123:0/493089826 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f8ca400f850 con 0x7f8ca8100b50 2024-08-18T22:08:38.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.922+0000 7f8cb26f0740 1 Processor -- start 2024-08-18T22:08:38.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.923+0000 7f8cb26f0740 1 -- start start 2024-08-18T22:08:38.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.923+0000 7f8cb26f0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c8316d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.923+0000 7f8cb26f0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83177c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.923+0000 7f8cb26f0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c8317a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.923+0000 7f8cb26f0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x564c830d2a40 con 0x564c8316d910 2024-08-18T22:08:38.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.923+0000 7f8cb26f0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564c8306a9d0 con 0x564c8316cff0 2024-08-18T22:08:38.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.923+0000 7f8cb26f0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564c830cea00 con 0x564c831781d0 2024-08-18T22:08:38.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.923+0000 7f8cae08e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83177c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.923+0000 7f8cae08e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83177c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44782/0 (socket says 172.21.15.123:44782) 2024-08-18T22:08:38.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.923+0000 7f8cae08e640 1 -- 172.21.15.123:0/3422300650 learned_addr learned my addr 172.21.15.123:0/3422300650 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:38.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.923+0000 7f8cae88f640 1 --2- 172.21.15.123:0/3422300650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c8316d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.923+0000 7f8cad88d640 1 --2- 172.21.15.123:0/3422300650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c8317a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.924+0000 7f8cad88d640 1 -- 172.21.15.123:0/3422300650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 msgr2=0x564c8316d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:38.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.924+0000 7f8cad88d640 1 --2- 172.21.15.123:0/3422300650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c8316d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.924+0000 7f8cad88d640 1 -- 172.21.15.123:0/3422300650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 msgr2=0x564c83177c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:38.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.924+0000 7f8cad88d640 1 --2- 172.21.15.123:0/3422300650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83177c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.924+0000 7f8cad88d640 1 -- 172.21.15.123:0/3422300650 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c83071650 con 0x564c831781d0 2024-08-18T22:08:38.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.924+0000 7f8cae08e640 1 --2- 172.21.15.123:0/3422300650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83177c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:38.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.924+0000 7f8cad88d640 1 --2- 172.21.15.123:0/3422300650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c8317a5c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c9802a9a0 tx=0x7f8c980095d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4a68d11f257c3b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:38.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.924+0000 7f8c9cdea640 1 -- 172.21.15.123:0/3422300650 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9803e030 con 0x564c831781d0 2024-08-18T22:08:38.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.925+0000 7f8c9cdea640 1 -- 172.21.15.123:0/3422300650 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c980035f0 con 0x564c831781d0 2024-08-18T22:08:38.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.925+0000 7f8c9cdea640 1 -- 172.21.15.123:0/3422300650 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98035040 con 0x564c831781d0 2024-08-18T22:08:38.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.925+0000 7f8c9f7fe640 1 --2- 172.21.15.123:0/493089826 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8c940a2a50 0x7f8c940a4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.925+0000 7f8cae88f640 1 --2- 172.21.15.123:0/493089826 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8c940a2a50 0x7f8c940a4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.925+0000 7f8c9f7fe640 1 -- 172.21.15.123:0/493089826 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8ca40cedf0 con 0x7f8ca8100b50 2024-08-18T22:08:38.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.925+0000 7f8cb26f0740 1 -- 172.21.15.123:0/3422300650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 msgr2=0x564c8317a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:38.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.925+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/3422300650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c8317a5c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c9802a9a0 tx=0x7f8c980095d0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.926+0000 7f8cae88f640 1 --2- 172.21.15.123:0/493089826 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8c940a2a50 0x7f8c940a4f10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000af00 tx=0x7f8ca000a6b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:38.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.926+0000 7f8cb26f0740 1 -- 172.21.15.123:0/3422300650 shutdown_connections 2024-08-18T22:08:38.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.926+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/3422300650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c8317a5c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.926+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/3422300650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83177c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.926+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/3422300650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c8316d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.926+0000 7f8cb26f0740 1 -- 172.21.15.123:0/3422300650 >> 172.21.15.123:0/3422300650 conn(0x564c83169580 msgr2=0x564c83169960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:38.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.926+0000 7f8cb26f0740 1 -- 172.21.15.123:0/3422300650 shutdown_connections 2024-08-18T22:08:38.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.926+0000 7f8cb26f0740 1 -- 172.21.15.123:0/3422300650 wait complete. 2024-08-18T22:08:38.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.926+0000 7f8cb26f0740 1 -- start start 2024-08-18T22:08:38.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.926+0000 7f8cb26f0740 1 Processor -- start 2024-08-18T22:08:38.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cb26f0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c83175010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cb26f0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83175550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cad88d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83175550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cae08e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c83175010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cad88d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83175550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44788/0 (socket says 172.21.15.123:44788) 2024-08-18T22:08:38.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cad88d640 1 -- 172.21.15.123:0/433440561 learned_addr learned my addr 172.21.15.123:0/433440561 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:38.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/433440561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c83175a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cb26f0740 1 -- 172.21.15.123:0/433440561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x564c8317ada0 con 0x564c8316d910 2024-08-18T22:08:38.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cb26f0740 1 -- 172.21.15.123:0/433440561 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564c8308db20 con 0x564c8316cff0 2024-08-18T22:08:38.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cb26f0740 1 -- 172.21.15.123:0/433440561 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564c8317af20 con 0x564c831781d0 2024-08-18T22:08:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cb26f0740 10 client.0 _ll_register_callbacks cb 0x564c8308bbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cad88d640 1 -- 172.21.15.123:0/433440561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 msgr2=0x564c83175a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cad88d640 1 --2- 172.21.15.123:0/433440561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c83175a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cad88d640 1 -- 172.21.15.123:0/433440561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 msgr2=0x564c83175010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cad88d640 1 --2- 172.21.15.123:0/433440561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c83175010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cad88d640 1 -- 172.21.15.123:0/433440561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c82e443c0 con 0x564c8316d910 2024-08-18T22:08:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.927+0000 7f8cae08e640 1 --2- 172.21.15.123:0/433440561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c83175010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.928+0000 7f8cad88d640 1 --2- 172.21.15.123:0/433440561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83175550 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8c98004470 tx=0x7f8c980044a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab86e8ad1e128624 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.928+0000 7f8c91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.928+0000 7f8c91ffb640 1 -- 172.21.15.123:0/433440561 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98035050 con 0x564c8316d910 2024-08-18T22:08:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.928+0000 7f8c91ffb640 1 -- 172.21.15.123:0/433440561 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8c98003b20 con 0x564c8316d910 2024-08-18T22:08:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.928+0000 7f8cb26f0740 1 -- 172.21.15.123:0/433440561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c980035f0 con 0x564c8316d910 2024-08-18T22:08:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.928+0000 7f8c91ffb640 1 -- 172.21.15.123:0/433440561 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8c98054050 con 0x564c8316d910 2024-08-18T22:08:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.928+0000 7f8cb26f0740 10 client.15555 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.928+0000 7f8cb26f0740 1 -- 172.21.15.123:0/433440561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564c83186950 con 0x564c8316d910 2024-08-18T22:08:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.928+0000 7f8c91ffb640 1 -- 172.21.15.123:0/433440561 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c980035f0 con 0x564c8316d910 2024-08-18T22:08:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.928+0000 7f8c91ffb640 1 -- 172.21.15.123:0/433440561 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8c98043530 con 0x564c8316d910 2024-08-18T22:08:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.929+0000 7f8cb26f0740 10 client.15555 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.929+0000 7f8cb26f0740 10 client.15555 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-18T22:08:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.929+0000 7f8cb26f0740 20 client.15555 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.929+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/433440561 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x564c83187ca0 0x564c8318a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.929+0000 7f8cb26f0740 4 client.15555 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:08:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.929+0000 7f8cb26f0740 1 -- 172.21.15.123:0/433440561 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c830dffb0 con 0x564c83187ca0 2024-08-18T22:08:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.929+0000 7f8cae08e640 1 --2- 172.21.15.123:0/433440561 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x564c83187ca0 0x564c8318a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.930+0000 7f8cae08e640 1 --2- 172.21.15.123:0/433440561 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x564c83187ca0 0x564c8318a090 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3031020202324f4f server_cookie=7a172611232dbb0a in_seq=0 out_seq=0 2024-08-18T22:08:38.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.930+0000 7f8c91ffb640 10 client.15555 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:08:38.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.930+0000 7f8c91ffb640 1 -- 172.21.15.123:0/433440561 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f8ca40aae80 con 0x564c83187ca0 2024-08-18T22:08:38.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.930+0000 7f8c91ffb640 10 client.15555 handle_command_reply: tid=0 2024-08-18T22:08:38.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.930+0000 7f8cb26f0740 1 client.15555 shutdown 2024-08-18T22:08:38.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.931+0000 7f8cb26f0740 1 -- 172.21.15.123:0/433440561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 msgr2=0x564c83175550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:38.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.931+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/433440561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83175550 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8c98004470 tx=0x7f8c980044a0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.931+0000 7f8cb26f0740 1 -- 172.21.15.123:0/433440561 shutdown_connections 2024-08-18T22:08:38.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.931+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/433440561 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x564c83187ca0 0x564c8318a090 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.931+0000 7f8c91ffb640 0 client.15555 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:08:38.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.931+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/433440561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c83175a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.931+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/433440561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83175550 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.931+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/433440561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c83175010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.931+0000 7f8cb26f0740 1 -- 172.21.15.123:0/433440561 >> 172.21.15.123:0/433440561 conn(0x564c83169580 msgr2=0x564c8316f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:38.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.931+0000 7f8cb26f0740 1 -- 172.21.15.123:0/433440561 shutdown_connections 2024-08-18T22:08:38.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.931+0000 7f8cb26f0740 1 -- 172.21.15.123:0/433440561 wait complete. 2024-08-18T22:08:38.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.931+0000 7f8cb26f0740 20 client.15555 trim_cache size 0 max 16384 2024-08-18T22:08:38.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.955+0000 7f8cb26f0740 1 Processor -- start 2024-08-18T22:08:38.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.955+0000 7f8cb26f0740 1 -- start start 2024-08-18T22:08:38.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cb26f0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c83184310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cb26f0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c8318f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cb26f0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c8318fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cb26f0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81aee00 con 0x564c8316d910 2024-08-18T22:08:38.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cb26f0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81ac6d0 con 0x564c8316cff0 2024-08-18T22:08:38.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cb26f0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81aa540 con 0x564c831781d0 2024-08-18T22:08:38.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cad88d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c8318f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cad88d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c8318f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44794/0 (socket says 172.21.15.123:44794) 2024-08-18T22:08:38.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cad88d640 1 -- 172.21.15.123:0/2557111296 learned_addr learned my addr 172.21.15.123:0/2557111296 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:38.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cae88f640 1 --2- 172.21.15.123:0/2557111296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c8318fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cae08e640 1 --2- 172.21.15.123:0/2557111296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c83184310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cae88f640 1 -- 172.21.15.123:0/2557111296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 msgr2=0x564c83184310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:38.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cae88f640 1 --2- 172.21.15.123:0/2557111296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c83184310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cae88f640 1 -- 172.21.15.123:0/2557111296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 msgr2=0x564c8318f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:38.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cae88f640 1 --2- 172.21.15.123:0/2557111296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c8318f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.956+0000 7f8cae88f640 1 -- 172.21.15.123:0/2557111296 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c83184060 con 0x564c831781d0 2024-08-18T22:08:38.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.957+0000 7f8cae88f640 1 --2- 172.21.15.123:0/2557111296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c8318fc50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000e4b0 tx=0x7f8ca0013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ac2f8c361a9464c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:38.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.957+0000 7f8cad88d640 1 --2- 172.21.15.123:0/2557111296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c8318f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:38.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.957+0000 7f8cae08e640 1 --2- 172.21.15.123:0/2557111296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c83184310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:38.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.957+0000 7f8c93fff640 1 -- 172.21.15.123:0/2557111296 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0004d20 con 0x564c831781d0 2024-08-18T22:08:38.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.957+0000 7f8c93fff640 1 -- 172.21.15.123:0/2557111296 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ca0005020 con 0x564c831781d0 2024-08-18T22:08:38.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.957+0000 7f8c93fff640 1 -- 172.21.15.123:0/2557111296 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00266e0 con 0x564c831781d0 2024-08-18T22:08:38.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.958+0000 7f8cb26f0740 1 -- 172.21.15.123:0/2557111296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 msgr2=0x564c8318fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:38.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.958+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/2557111296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c8318fc50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000e4b0 tx=0x7f8ca0013040 comp rx=0 tx=0).stop 2024-08-18T22:08:38.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.958+0000 7f8cb26f0740 1 -- 172.21.15.123:0/2557111296 shutdown_connections 2024-08-18T22:08:38.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.958+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/2557111296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c8318fc50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.958+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/2557111296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c8318f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.958+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/2557111296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c83184310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.958+0000 7f8cb26f0740 1 -- 172.21.15.123:0/2557111296 >> 172.21.15.123:0/2557111296 conn(0x564c83169580 msgr2=0x564c831641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:38.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.958+0000 7f8cb26f0740 1 -- 172.21.15.123:0/2557111296 shutdown_connections 2024-08-18T22:08:38.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.958+0000 7f8cb26f0740 1 -- 172.21.15.123:0/2557111296 wait complete. 2024-08-18T22:08:38.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.958+0000 7f8cb26f0740 1 -- start start 2024-08-18T22:08:38.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.958+0000 7f8cb26f0740 1 Processor -- start 2024-08-18T22:08:38.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.959+0000 7f8cb26f0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c831785f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.959+0000 7f8cb26f0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83178b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.959+0000 7f8cb26f0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c83179070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.959+0000 7f8cb26f0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81aab90 con 0x564c8316d910 2024-08-18T22:08:38.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.959+0000 7f8cb26f0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81ac000 con 0x564c8316cff0 2024-08-18T22:08:38.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.959+0000 7f8cae08e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c831785f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.959+0000 7f8cb26f0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81ab260 con 0x564c831781d0 2024-08-18T22:08:38.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.959+0000 7f8cae08e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c831785f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:46942/0 (socket says 172.21.15.123:46942) 2024-08-18T22:08:38.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.959+0000 7f8cae08e640 1 -- 172.21.15.123:0/2938958403 learned_addr learned my addr 172.21.15.123:0/2938958403 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:38.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.959+0000 7f8cad88d640 1 --2- 172.21.15.123:0/2938958403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83178b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.959+0000 7f8cb26f0740 10 client.0 _ll_register_callbacks cb 0x7f8ca40d27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.959+0000 7f8cae88f640 1 --2- 172.21.15.123:0/2938958403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c83179070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.960+0000 7f8cad88d640 1 -- 172.21.15.123:0/2938958403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 msgr2=0x564c83179070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.960+0000 7f8cad88d640 1 --2- 172.21.15.123:0/2938958403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c83179070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.960+0000 7f8cad88d640 1 -- 172.21.15.123:0/2938958403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 msgr2=0x564c831785f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.960+0000 7f8cad88d640 1 --2- 172.21.15.123:0/2938958403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c831785f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.960+0000 7f8cad88d640 1 -- 172.21.15.123:0/2938958403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c8317f330 con 0x564c8316d910 2024-08-18T22:08:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.960+0000 7f8cad88d640 1 --2- 172.21.15.123:0/2938958403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83178b30 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8c98000c00 tx=0x7f8c98005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4412dd1354cdd45 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.960+0000 7f8c91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.960+0000 7f8c91ffb640 1 -- 172.21.15.123:0/2938958403 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98035040 con 0x564c8316d910 2024-08-18T22:08:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.960+0000 7f8c91ffb640 1 -- 172.21.15.123:0/2938958403 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8c98005020 con 0x564c8316d910 2024-08-18T22:08:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.960+0000 7f8cb26f0740 1 -- 172.21.15.123:0/2938958403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ca0005020 con 0x564c8316d910 2024-08-18T22:08:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.960+0000 7f8c91ffb640 1 -- 172.21.15.123:0/2938958403 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8c9803e040 con 0x564c8316d910 2024-08-18T22:08:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.960+0000 7f8cb26f0740 10 client.15561 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.961+0000 7f8cb26f0740 1 -- 172.21.15.123:0/2938958403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564c83180610 con 0x564c8316d910 2024-08-18T22:08:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.961+0000 7f8c91ffb640 1 -- 172.21.15.123:0/2938958403 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ca0005020 con 0x564c8316d910 2024-08-18T22:08:38.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.961+0000 7f8c91ffb640 1 -- 172.21.15.123:0/2938958403 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8c98031540 con 0x564c8316d910 2024-08-18T22:08:38.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.961+0000 7f8cb26f0740 10 client.15561 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:38.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.961+0000 7f8cb26f0740 10 client.15561 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-18T22:08:38.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.961+0000 7f8cb26f0740 20 client.15561 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:38.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.961+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/2938958403 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x564c831f26e0 0x564c831f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:38.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.961+0000 7f8cb26f0740 4 client.15561 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:08:38.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.961+0000 7f8cb26f0740 1 -- 172.21.15.123:0/2938958403 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564c830da4c0 con 0x564c831f26e0 2024-08-18T22:08:38.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.961+0000 7f8cae08e640 1 --2- 172.21.15.123:0/2938958403 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x564c831f26e0 0x564c831f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:38.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8cae08e640 1 --2- 172.21.15.123:0/2938958403 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x564c831f26e0 0x564c831f4ad0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=88083e688a53dac9 server_cookie=5fc14577146ba3dd in_seq=0 out_seq=0 2024-08-18T22:08:38.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8c91ffb640 10 client.15561 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:08:38.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8c91ffb640 1 -- 172.21.15.123:0/2938958403 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564c830da4c0 con 0x564c831f26e0 2024-08-18T22:08:38.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8c91ffb640 10 client.15561 handle_command_reply: tid=0 2024-08-18T22:08:38.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8cb26f0740 1 client.15561 shutdown 2024-08-18T22:08:38.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8cb26f0740 1 -- 172.21.15.123:0/2938958403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 msgr2=0x564c83178b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:38.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/2938958403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83178b30 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8c98000c00 tx=0x7f8c98005990 comp rx=0 tx=0).stop 2024-08-18T22:08:38.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8cb26f0740 1 -- 172.21.15.123:0/2938958403 shutdown_connections 2024-08-18T22:08:38.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/2938958403 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x564c831f26e0 0x564c831f4ad0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/2938958403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564c831781d0 0x564c83179070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/2938958403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c8316d910 0x564c83178b30 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8cb26f0740 1 --2- 172.21.15.123:0/2938958403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c8316cff0 0x564c831785f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8cb26f0740 1 -- 172.21.15.123:0/2938958403 >> 172.21.15.123:0/2938958403 conn(0x564c83169580 msgr2=0x564c831738e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:38.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8c91ffb640 0 client.15561 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:08:38.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8cb26f0740 1 -- 172.21.15.123:0/2938958403 shutdown_connections 2024-08-18T22:08:38.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.962+0000 7f8cb26f0740 1 -- 172.21.15.123:0/2938958403 wait complete. 2024-08-18T22:08:38.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.963+0000 7f8cb26f0740 20 client.15561 trim_cache size 0 max 16384 2024-08-18T22:08:38.970 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:08:38.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.963+0000 7f8cb02f2640 1 -- 172.21.15.123:0/493089826 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8c940a2a50 msgr2=0x7f8c940a4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:38.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.963+0000 7f8cb02f2640 1 --2- 172.21.15.123:0/493089826 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8c940a2a50 0x7f8c940a4f10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000af00 tx=0x7f8ca000a6b0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.963+0000 7f8cb02f2640 1 -- 172.21.15.123:0/493089826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca8100b50 msgr2=0x7f8ca819a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:38.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.963+0000 7f8cb02f2640 1 --2- 172.21.15.123:0/493089826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca8100b50 0x7f8ca819a4d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400d950 tx=0x7f8ca400de10 comp rx=0 tx=0).stop 2024-08-18T22:08:38.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.963+0000 7f8cb02f2640 1 -- 172.21.15.123:0/493089826 shutdown_connections 2024-08-18T22:08:38.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.963+0000 7f8cb02f2640 1 --2- 172.21.15.123:0/493089826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ca8102c20 0x7f8ca819eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.963+0000 7f8cb02f2640 1 --2- 172.21.15.123:0/493089826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ca81022a0 0x7f8ca819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.963+0000 7f8cb02f2640 1 --2- 172.21.15.123:0/493089826 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8c940a2a50 0x7f8c940a4f10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.963+0000 7f8cb02f2640 1 --2- 172.21.15.123:0/493089826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca8100b50 0x7f8ca819a4d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:38.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.963+0000 7f8cb02f2640 1 -- 172.21.15.123:0/493089826 >> 172.21.15.123:0/493089826 conn(0x7f8ca80fc500 msgr2=0x7f8ca806a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:38.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.964+0000 7f8cb02f2640 1 -- 172.21.15.123:0/493089826 shutdown_connections 2024-08-18T22:08:38.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:38.964+0000 7f8cb02f2640 1 -- 172.21.15.123:0/493089826 wait complete. 2024-08-18T22:08:39.807 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-18T22:08:40.090 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:40.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.603+0000 7f8ee29cf640 1 -- 172.21.15.123:0/35639307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc103410 msgr2=0x7f8edc1078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:40.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.603+0000 7f8ee29cf640 1 --2- 172.21.15.123:0/35639307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc103410 0x7f8edc1078c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009930 tx=0x7f8ed002a420 comp rx=0 tx=0).stop 2024-08-18T22:08:40.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.603+0000 7f8ee29cf640 1 -- 172.21.15.123:0/35639307 shutdown_connections 2024-08-18T22:08:40.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.603+0000 7f8ee29cf640 1 --2- 172.21.15.123:0/35639307 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8edc107fd0 0x7f8edc10e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.603+0000 7f8ee29cf640 1 --2- 172.21.15.123:0/35639307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc103410 0x7f8edc1078c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.603+0000 7f8ee29cf640 1 --2- 172.21.15.123:0/35639307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8edc102a60 0x7f8edc102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.603+0000 7f8ee29cf640 1 -- 172.21.15.123:0/35639307 >> 172.21.15.123:0/35639307 conn(0x7f8edc0fc500 msgr2=0x7f8edc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:40.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.605+0000 7f8ee29cf640 1 -- 172.21.15.123:0/35639307 shutdown_connections 2024-08-18T22:08:40.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.605+0000 7f8ee29cf640 1 -- 172.21.15.123:0/35639307 wait complete. 2024-08-18T22:08:40.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.605+0000 7f8ee29cf640 1 Processor -- start 2024-08-18T22:08:40.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.605+0000 7f8ee29cf640 1 -- start start 2024-08-18T22:08:40.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8ee29cf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc102a60 0x7f8edc198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8ee29cf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8edc103410 0x7f8edc1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8ee29cf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8edc107fd0 0x7f8edc19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8edbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc102a60 0x7f8edc198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:40.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8edbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc102a60 0x7f8edc198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44818/0 (socket says 172.21.15.123:44818) 2024-08-18T22:08:40.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8edbfff640 1 -- 172.21.15.123:0/532779542 learned_addr learned my addr 172.21.15.123:0/532779542 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:40.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8ee29cf640 1 -- 172.21.15.123:0/532779542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc111dd0 con 0x7f8edc102a60 2024-08-18T22:08:40.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8ee29cf640 1 -- 172.21.15.123:0/532779542 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc111c50 con 0x7f8edc107fd0 2024-08-18T22:08:40.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8ee29cf640 1 -- 172.21.15.123:0/532779542 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc111f50 con 0x7f8edc103410 2024-08-18T22:08:40.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8edb7fe640 1 --2- 172.21.15.123:0/532779542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8edc103410 0x7f8edc1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:40.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/532779542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8edc107fd0 0x7f8edc19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:40.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8edbfff640 1 -- 172.21.15.123:0/532779542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8edc103410 msgr2=0x7f8edc1988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:40.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8edbfff640 1 --2- 172.21.15.123:0/532779542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8edc103410 0x7f8edc1988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8edbfff640 1 -- 172.21.15.123:0/532779542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8edc107fd0 msgr2=0x7f8edc19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:40.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8edbfff640 1 --2- 172.21.15.123:0/532779542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8edc107fd0 0x7f8edc19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8edbfff640 1 -- 172.21.15.123:0/532779542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc19d320 con 0x7f8edc102a60 2024-08-18T22:08:40.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.606+0000 7f8edbfff640 1 --2- 172.21.15.123:0/532779542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc102a60 0x7f8edc198370 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00d950 tx=0x7f8ecc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:40.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.607+0000 7f8ed97fa640 1 -- 172.21.15.123:0/532779542 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc017070 con 0x7f8edc102a60 2024-08-18T22:08:40.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.607+0000 7f8ee29cf640 1 -- 172.21.15.123:0/532779542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8edc19d610 con 0x7f8edc102a60 2024-08-18T22:08:40.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.607+0000 7f8ee29cf640 1 -- 172.21.15.123:0/532779542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8edc1a4ef0 con 0x7f8edc102a60 2024-08-18T22:08:40.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.607+0000 7f8ed97fa640 1 -- 172.21.15.123:0/532779542 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ecc009c30 con 0x7f8edc102a60 2024-08-18T22:08:40.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.607+0000 7f8ed97fa640 1 -- 172.21.15.123:0/532779542 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc00f6b0 con 0x7f8edc102a60 2024-08-18T22:08:40.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.610+0000 7f8ee4dcd740 1 Processor -- start 2024-08-18T22:08:40.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.610+0000 7f8ee4dcd740 1 -- start start 2024-08-18T22:08:40.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.610+0000 7f8ed97fa640 1 -- 172.21.15.123:0/532779542 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f8ecc0109d0 con 0x7f8edc102a60 2024-08-18T22:08:40.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.610+0000 7f8ee4dcd740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb453d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.610+0000 7f8ee4dcd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb45910 0x5565eeb4fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.610+0000 7f8ee4dcd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb501d0 0x5565eeb525c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.610+0000 7f8ee4dcd740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5565eeaaaa40 con 0x5565eeb44ff0 2024-08-18T22:08:40.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.610+0000 7f8ee4dcd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5565eea429d0 con 0x5565eeb45910 2024-08-18T22:08:40.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.610+0000 7f8ee4dcd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5565eeaa6a00 con 0x5565eeb501d0 2024-08-18T22:08:40.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.610+0000 7f8ee0f6c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:40.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.610+0000 7f8ee0f6c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb453d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44832/0 (socket says 172.21.15.123:44832) 2024-08-18T22:08:40.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.610+0000 7f8ee0f6c640 1 -- 172.21.15.123:0/1814897562 learned_addr learned my addr 172.21.15.123:0/1814897562 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:40.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.611+0000 7f8ee0f6c640 1 -- 172.21.15.123:0/1814897562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb501d0 msgr2=0x5565eeb525c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T22:08:40.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.611+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/1814897562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb501d0 0x5565eeb525c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.611+0000 7f8ee0f6c640 1 -- 172.21.15.123:0/1814897562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb45910 msgr2=0x5565eeb4fc90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T22:08:40.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.611+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/1814897562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb45910 0x5565eeb4fc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.611+0000 7f8ee0f6c640 1 -- 172.21.15.123:0/1814897562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565eea49650 con 0x5565eeb44ff0 2024-08-18T22:08:40.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.611+0000 7f8ed97fa640 1 --2- 172.21.15.123:0/532779542 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8ec40a6f90 0x7f8ec40a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.611+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/1814897562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb453d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009f70 tx=0x7f8ed4010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608c98e0dae0bdac server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:40.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.611+0000 7f8ed97fa640 1 -- 172.21.15.123:0/532779542 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8ecc0cf2a0 con 0x7f8edc102a60 2024-08-18T22:08:40.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.611+0000 7f8ec27fc640 1 -- 172.21.15.123:0/1814897562 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4016070 con 0x5565eeb44ff0 2024-08-18T22:08:40.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.611+0000 7f8ec27fc640 1 -- 172.21.15.123:0/1814897562 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ed4004d20 con 0x5565eeb44ff0 2024-08-18T22:08:40.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.611+0000 7f8ec27fc640 1 -- 172.21.15.123:0/1814897562 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4012950 con 0x5565eeb44ff0 2024-08-18T22:08:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.611+0000 7f8edbfff640 1 --2- 172.21.15.123:0/532779542 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8ec40a6f90 0x7f8ec40a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.612+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1814897562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 msgr2=0x5565eeb453d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.612+0000 7f8edbfff640 1 --2- 172.21.15.123:0/532779542 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8ec40a6f90 0x7f8ec40a9450 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc097c80 tx=0x7f8ecc00bf60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.612+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/1814897562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb453d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009f70 tx=0x7f8ed4010800 comp rx=0 tx=0).stop 2024-08-18T22:08:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.612+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1814897562 shutdown_connections 2024-08-18T22:08:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.612+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/1814897562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb501d0 0x5565eeb525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.612+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/1814897562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb45910 0x5565eeb4fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.612+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/1814897562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb453d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.612+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1814897562 >> 172.21.15.123:0/1814897562 conn(0x5565eeb41580 msgr2=0x5565eeb41960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.613+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1814897562 shutdown_connections 2024-08-18T22:08:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.613+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1814897562 wait complete. 2024-08-18T22:08:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.613+0000 7f8ee4dcd740 1 -- start start 2024-08-18T22:08:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.613+0000 7f8ee4dcd740 1 Processor -- start 2024-08-18T22:08:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.613+0000 7f8ee4dcd740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb4d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.613+0000 7f8ee4dcd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb45910 0x5565eeb4d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.614+0000 7f8ee4dcd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb501d0 0x5565eeb4db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.614+0000 7f8ee4dcd740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5565eeb52da0 con 0x5565eeb44ff0 2024-08-18T22:08:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.614+0000 7f8ee0f6c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb4d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.614+0000 7f8ee4dcd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5565eea65b20 con 0x5565eeb45910 2024-08-18T22:08:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.614+0000 7f8ee0f6c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb4d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44836/0 (socket says 172.21.15.123:44836) 2024-08-18T22:08:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.614+0000 7f8ee0f6c640 1 -- 172.21.15.123:0/1711014125 learned_addr learned my addr 172.21.15.123:0/1711014125 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.614+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1711014125 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5565eeb52f20 con 0x5565eeb501d0 2024-08-18T22:08:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.614+0000 7f8ee4dcd740 10 client.0 _ll_register_callbacks cb 0x5565eea63bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.614+0000 7f8edb7fe640 1 --2- 172.21.15.123:0/1711014125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb45910 0x5565eeb4d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.614+0000 7f8ee0f6c640 1 -- 172.21.15.123:0/1711014125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb501d0 msgr2=0x5565eeb4db80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T22:08:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.614+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/1711014125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb501d0 0x5565eeb4db80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.614+0000 7f8ee0f6c640 1 -- 172.21.15.123:0/1711014125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb45910 msgr2=0x5565eeb4d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:40.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.614+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/1711014125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb45910 0x5565eeb4d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.614+0000 7f8ee0f6c640 1 -- 172.21.15.123:0/1711014125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565ee81c3c0 con 0x5565eeb44ff0 2024-08-18T22:08:40.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.615+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/1711014125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb4d100 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4011010 tx=0x7f8ed4012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267eac65f2d6b245 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:40.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.615+0000 7f8ebb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:40.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.615+0000 7f8ebb7fe640 1 -- 172.21.15.123:0/1711014125 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4016070 con 0x5565eeb44ff0 2024-08-18T22:08:40.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.615+0000 7f8ebb7fe640 1 -- 172.21.15.123:0/1711014125 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8ed4012a00 con 0x5565eeb44ff0 2024-08-18T22:08:40.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.615+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1711014125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ed4004d20 con 0x5565eeb44ff0 2024-08-18T22:08:40.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.615+0000 7f8ebb7fe640 1 -- 172.21.15.123:0/1711014125 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8ed4012c00 con 0x5565eeb44ff0 2024-08-18T22:08:40.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.615+0000 7f8ee4dcd740 10 client.15573 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:40.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.615+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1711014125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5565eeb5e9e0 con 0x5565eeb44ff0 2024-08-18T22:08:40.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.615+0000 7f8ebb7fe640 1 -- 172.21.15.123:0/1711014125 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ed4004d20 con 0x5565eeb44ff0 2024-08-18T22:08:40.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.615+0000 7f8ebb7fe640 1 -- 172.21.15.123:0/1711014125 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8ed400f040 con 0x5565eeb44ff0 2024-08-18T22:08:40.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.616+0000 7f8ee4dcd740 10 client.15573 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:40.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.616+0000 7f8ee4dcd740 10 client.15573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.616+0000 7f8ee4dcd740 20 client.15573 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.616+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/1711014125 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5565eeb5fdf0 0x5565eeb621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.616+0000 7f8ee4dcd740 4 client.15573 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:08:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.616+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1711014125 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565eeab7fb0 con 0x5565eeb5fdf0 2024-08-18T22:08:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.616+0000 7f8edb7fe640 1 --2- 172.21.15.123:0/1711014125 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5565eeb5fdf0 0x5565eeb621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.616+0000 7f8edb7fe640 1 --2- 172.21.15.123:0/1711014125 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5565eeb5fdf0 0x5565eeb621e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5be7a33e19a6496 server_cookie=21f5cf529a25cb7b in_seq=0 out_seq=0 2024-08-18T22:08:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.616+0000 7f8ebb7fe640 10 client.15573 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.617+0000 7f8ebb7fe640 1 -- 172.21.15.123:0/1711014125 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565eeab7fb0 con 0x5565eeb5fdf0 2024-08-18T22:08:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.617+0000 7f8ebb7fe640 10 client.15573 handle_command_reply: tid=0 2024-08-18T22:08:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.617+0000 7f8ee4dcd740 1 client.15573 shutdown 2024-08-18T22:08:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.617+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1711014125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 msgr2=0x5565eeb4d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.617+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/1711014125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb4d100 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4011010 tx=0x7f8ed4012690 comp rx=0 tx=0).stop 2024-08-18T22:08:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.617+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1711014125 shutdown_connections 2024-08-18T22:08:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.617+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/1711014125 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5565eeb5fdf0 0x5565eeb621e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.617+0000 7f8ebb7fe640 0 client.15573 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.617+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/1711014125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb501d0 0x5565eeb4db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.617+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/1711014125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb45910 0x5565eeb4d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.618+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/1711014125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb4d100 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.618+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1711014125 >> 172.21.15.123:0/1711014125 conn(0x5565eeb41580 msgr2=0x5565eeb472b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.618+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1711014125 shutdown_connections 2024-08-18T22:08:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.618+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1711014125 wait complete. 2024-08-18T22:08:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.618+0000 7f8ee4dcd740 20 client.15573 trim_cache size 0 max 16384 2024-08-18T22:08:40.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.631+0000 7f8ee4dcd740 1 Processor -- start 2024-08-18T22:08:40.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.631+0000 7f8ee4dcd740 1 -- start start 2024-08-18T22:08:40.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.631+0000 7f8ee4dcd740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb47aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.631+0000 7f8ee4dcd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb45910 0x5565eeb4ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.631+0000 7f8ee4dcd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb501d0 0x5565eeb678d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.631+0000 7f8ee4dcd740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc1af250 con 0x5565eeb44ff0 2024-08-18T22:08:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.631+0000 7f8ee4dcd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc1acb20 con 0x5565eeb501d0 2024-08-18T22:08:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.631+0000 7f8ee4dcd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc1aa970 con 0x5565eeb45910 2024-08-18T22:08:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.631+0000 7f8ee0f6c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb47aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.631+0000 7f8ee0f6c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb47aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44852/0 (socket says 172.21.15.123:44852) 2024-08-18T22:08:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.631+0000 7f8ee0f6c640 1 -- 172.21.15.123:0/1957733288 learned_addr learned my addr 172.21.15.123:0/1957733288 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.631+0000 7f8edb7fe640 1 --2- 172.21.15.123:0/1957733288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb45910 0x5565eeb4ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.631+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/1957733288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb501d0 0x5565eeb678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.632+0000 7f8ee0f6c640 1 -- 172.21.15.123:0/1957733288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb45910 msgr2=0x5565eeb4ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.632+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/1957733288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb45910 0x5565eeb4ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.632+0000 7f8ee0f6c640 1 -- 172.21.15.123:0/1957733288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb501d0 msgr2=0x5565eeb678d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.632+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/1957733288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb501d0 0x5565eeb678d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.632+0000 7f8ee0f6c640 1 -- 172.21.15.123:0/1957733288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565eeb42210 con 0x5565eeb44ff0 2024-08-18T22:08:40.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.632+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/1957733288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb47aa0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40254a0 tx=0x7f8ed4010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e2be9ee31ba22 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:40.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.632+0000 7f8ec1ffb640 1 -- 172.21.15.123:0/1957733288 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4016070 con 0x5565eeb44ff0 2024-08-18T22:08:40.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.632+0000 7f8ec1ffb640 1 -- 172.21.15.123:0/1957733288 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ed4003e50 con 0x5565eeb44ff0 2024-08-18T22:08:40.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.632+0000 7f8ec1ffb640 1 -- 172.21.15.123:0/1957733288 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4004470 con 0x5565eeb44ff0 2024-08-18T22:08:40.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.633+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1957733288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 msgr2=0x5565eeb47aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:40.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.633+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/1957733288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb47aa0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40254a0 tx=0x7f8ed4010800 comp rx=0 tx=0).stop 2024-08-18T22:08:40.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.633+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1957733288 shutdown_connections 2024-08-18T22:08:40.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.633+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/1957733288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb501d0 0x5565eeb678d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.633+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/1957733288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb45910 0x5565eeb4ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.633+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/1957733288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb44ff0 0x5565eeb47aa0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.633+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1957733288 >> 172.21.15.123:0/1957733288 conn(0x5565eeb41580 msgr2=0x5565eeb4e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:40.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.633+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1957733288 shutdown_connections 2024-08-18T22:08:40.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.633+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/1957733288 wait complete. 2024-08-18T22:08:40.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.634+0000 7f8ee4dcd740 1 -- start start 2024-08-18T22:08:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.634+0000 7f8ee4dcd740 1 Processor -- start 2024-08-18T22:08:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.634+0000 7f8ee4dcd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb44ff0 0x5565eeb58170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.634+0000 7f8ee4dcd740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb45910 0x5565eeb586b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8ee4dcd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb501d0 0x5565eeb49790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8ee4dcd740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc1aafe0 con 0x5565eeb45910 2024-08-18T22:08:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8edb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb45910 0x5565eeb586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8ee4dcd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc1ac450 con 0x5565eeb44ff0 2024-08-18T22:08:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8ee4dcd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc1ab6b0 con 0x5565eeb501d0 2024-08-18T22:08:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8edb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb45910 0x5565eeb586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44866/0 (socket says 172.21.15.123:44866) 2024-08-18T22:08:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8edb7fe640 1 -- 172.21.15.123:0/3809134500 learned_addr learned my addr 172.21.15.123:0/3809134500 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8ee4dcd740 10 client.0 _ll_register_callbacks cb 0x7f8ed4009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/3809134500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb44ff0 0x5565eeb58170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/3809134500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb501d0 0x5565eeb49790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8edb7fe640 1 -- 172.21.15.123:0/3809134500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb501d0 msgr2=0x5565eeb49790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8edb7fe640 1 --2- 172.21.15.123:0/3809134500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb501d0 0x5565eeb49790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8edb7fe640 1 -- 172.21.15.123:0/3809134500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb44ff0 msgr2=0x5565eeb58170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8edb7fe640 1 --2- 172.21.15.123:0/3809134500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb44ff0 0x5565eeb58170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8edb7fe640 1 -- 172.21.15.123:0/3809134500 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565eeb49d50 con 0x5565eeb45910 2024-08-18T22:08:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/3809134500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb501d0 0x5565eeb49790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8edb7fe640 1 --2- 172.21.15.123:0/3809134500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb45910 0x5565eeb586b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0005940 tx=0x7f8ed0004370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447a494f5eddeaac server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.635+0000 7f8ebb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.636+0000 7f8ebb7fe640 1 -- 172.21.15.123:0/3809134500 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0035040 con 0x5565eeb45910 2024-08-18T22:08:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.636+0000 7f8ebb7fe640 1 -- 172.21.15.123:0/3809134500 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8ed0005450 con 0x5565eeb45910 2024-08-18T22:08:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.636+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/3809134500 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ed4003e50 con 0x5565eeb45910 2024-08-18T22:08:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.636+0000 7f8ebb7fe640 1 -- 172.21.15.123:0/3809134500 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8ed0052050 con 0x5565eeb45910 2024-08-18T22:08:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.636+0000 7f8ee4dcd740 10 client.15579 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.636+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/3809134500 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5565eebca160 con 0x5565eeb45910 2024-08-18T22:08:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.636+0000 7f8ebb7fe640 1 -- 172.21.15.123:0/3809134500 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ed4003e50 con 0x5565eeb45910 2024-08-18T22:08:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.636+0000 7f8ebb7fe640 1 -- 172.21.15.123:0/3809134500 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8ed0003920 con 0x5565eeb45910 2024-08-18T22:08:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.637+0000 7f8ee4dcd740 10 client.15579 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.637+0000 7f8ee4dcd740 10 client.15579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.637+0000 7f8ee4dcd740 20 client.15579 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.637+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/3809134500 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5565eeb5fdf0 0x5565eebcc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.637+0000 7f8ee4dcd740 4 client.15579 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:08:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.637+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/3809134500 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5565eeab24c0 con 0x5565eeb5fdf0 2024-08-18T22:08:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.637+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/3809134500 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5565eeb5fdf0 0x5565eebcc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.637+0000 7f8ebb7fe640 10 client.15579 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.637+0000 7f8ee0f6c640 1 --2- 172.21.15.123:0/3809134500 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5565eeb5fdf0 0x5565eebcc950 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc5a0fed483295ab server_cookie=e51b3fcdab8a570b in_seq=0 out_seq=0 2024-08-18T22:08:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.638+0000 7f8ebb7fe640 1 -- 172.21.15.123:0/3809134500 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5565eeab24c0 con 0x5565eeb5fdf0 2024-08-18T22:08:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.638+0000 7f8ebb7fe640 10 client.15579 handle_command_reply: tid=0 2024-08-18T22:08:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.638+0000 7f8ee4dcd740 1 client.15579 shutdown 2024-08-18T22:08:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.638+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/3809134500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb45910 msgr2=0x5565eeb586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.638+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/3809134500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb45910 0x5565eeb586b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0005940 tx=0x7f8ed0004370 comp rx=0 tx=0).stop 2024-08-18T22:08:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.638+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/3809134500 shutdown_connections 2024-08-18T22:08:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.638+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/3809134500 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5565eeb5fdf0 0x5565eebcc950 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.638+0000 7f8ebb7fe640 0 client.15579 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.638+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/3809134500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565eeb501d0 0x5565eeb49790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.638+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/3809134500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565eeb45910 0x5565eeb586b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.638+0000 7f8ee4dcd740 1 --2- 172.21.15.123:0/3809134500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565eeb44ff0 0x5565eeb58170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.638+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/3809134500 >> 172.21.15.123:0/3809134500 conn(0x5565eeb41580 msgr2=0x5565eeb4d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.638+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/3809134500 shutdown_connections 2024-08-18T22:08:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.638+0000 7f8ee4dcd740 1 -- 172.21.15.123:0/3809134500 wait complete. 2024-08-18T22:08:40.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.638+0000 7f8ee4dcd740 20 client.15579 trim_cache size 0 max 16384 2024-08-18T22:08:40.643 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:08:40.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.639+0000 7f8ee29cf640 1 -- 172.21.15.123:0/532779542 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8ec40a6f90 msgr2=0x7f8ec40a9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.639+0000 7f8ee29cf640 1 --2- 172.21.15.123:0/532779542 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8ec40a6f90 0x7f8ec40a9450 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc097c80 tx=0x7f8ecc00bf60 comp rx=0 tx=0).stop 2024-08-18T22:08:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.639+0000 7f8ee29cf640 1 -- 172.21.15.123:0/532779542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc102a60 msgr2=0x7f8edc198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.639+0000 7f8ee29cf640 1 --2- 172.21.15.123:0/532779542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc102a60 0x7f8edc198370 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00d950 tx=0x7f8ecc00de10 comp rx=0 tx=0).stop 2024-08-18T22:08:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.639+0000 7f8ee29cf640 1 -- 172.21.15.123:0/532779542 shutdown_connections 2024-08-18T22:08:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.639+0000 7f8ee29cf640 1 --2- 172.21.15.123:0/532779542 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8ec40a6f90 0x7f8ec40a9450 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.639+0000 7f8ee29cf640 1 --2- 172.21.15.123:0/532779542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8edc107fd0 0x7f8edc19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.639+0000 7f8ee29cf640 1 --2- 172.21.15.123:0/532779542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8edc103410 0x7f8edc1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.639+0000 7f8ee29cf640 1 --2- 172.21.15.123:0/532779542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc102a60 0x7f8edc198370 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.639+0000 7f8ee29cf640 1 -- 172.21.15.123:0/532779542 >> 172.21.15.123:0/532779542 conn(0x7f8edc0fc500 msgr2=0x7f8edc1060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.639+0000 7f8ee29cf640 1 -- 172.21.15.123:0/532779542 shutdown_connections 2024-08-18T22:08:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:40.639+0000 7f8ee29cf640 1 -- 172.21.15.123:0/532779542 wait complete. 2024-08-18T22:08:40.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:40 smithi130 ceph-mon[21698]: pgmap v367: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-18T22:08:40.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:40 smithi183 ceph-mon[22097]: pgmap v367: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-18T22:08:41.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:40 smithi123 ceph-mon[18462]: pgmap v367: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-18T22:08:42.517 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-18T22:08:42.517 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-18T22:08:42.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:42 smithi130 ceph-mon[21698]: pgmap v368: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-08-18T22:08:42.806 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:42.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:42 smithi183 ceph-mon[22097]: pgmap v368: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-08-18T22:08:42.937 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:42 smithi123 ceph-mon[18462]: pgmap v368: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-08-18T22:08:43.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.351+0000 7f0a7d30e640 1 -- 172.21.15.123:0/3009084914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a78102c20 msgr2=0x7f0a7810d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:43.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.351+0000 7f0a7d30e640 1 --2- 172.21.15.123:0/3009084914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a78102c20 0x7f0a7810d770 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009ca0 tx=0x7f0a7002a950 comp rx=0 tx=0).stop 2024-08-18T22:08:43.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.351+0000 7f0a7d30e640 1 -- 172.21.15.123:0/3009084914 shutdown_connections 2024-08-18T22:08:43.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.351+0000 7f0a7d30e640 1 --2- 172.21.15.123:0/3009084914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a78102c20 0x7f0a7810d770 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.351+0000 7f0a7d30e640 1 --2- 172.21.15.123:0/3009084914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a781022a0 0x7f0a781026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.351+0000 7f0a7d30e640 1 --2- 172.21.15.123:0/3009084914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a78100b50 0x7f0a78100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.351+0000 7f0a7d30e640 1 -- 172.21.15.123:0/3009084914 >> 172.21.15.123:0/3009084914 conn(0x7f0a780fc500 msgr2=0x7f0a780fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:43.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.351+0000 7f0a7d30e640 1 -- 172.21.15.123:0/3009084914 shutdown_connections 2024-08-18T22:08:43.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.351+0000 7f0a7d30e640 1 -- 172.21.15.123:0/3009084914 wait complete. 2024-08-18T22:08:43.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.352+0000 7f0a7d30e640 1 Processor -- start 2024-08-18T22:08:43.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.352+0000 7f0a7d30e640 1 -- start start 2024-08-18T22:08:43.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.353+0000 7f0a7d30e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a78100b50 0x7f0a78195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.353+0000 7f0a7d30e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a781022a0 0x7f0a781964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.353+0000 7f0a7d30e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a78102c20 0x7f0a7819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.353+0000 7f0a7d30e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7810fbb0 con 0x7f0a78100b50 2024-08-18T22:08:43.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.353+0000 7f0a7d30e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7810fa30 con 0x7f0a781022a0 2024-08-18T22:08:43.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.353+0000 7f0a7d30e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7810fd30 con 0x7f0a78102c20 2024-08-18T22:08:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.353+0000 7f0a76ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a78100b50 0x7f0a78195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.353+0000 7f0a76ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a78100b50 0x7f0a78195f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40236/0 (socket says 172.21.15.123:40236) 2024-08-18T22:08:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.353+0000 7f0a76ffd640 1 -- 172.21.15.123:0/2956460794 learned_addr learned my addr 172.21.15.123:0/2956460794 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.353+0000 7f0a767fc640 1 --2- 172.21.15.123:0/2956460794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a781022a0 0x7f0a781964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.353+0000 7f0a777fe640 1 --2- 172.21.15.123:0/2956460794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a78102c20 0x7f0a7819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.353+0000 7f0a76ffd640 1 -- 172.21.15.123:0/2956460794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a78102c20 msgr2=0x7f0a7819a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.353+0000 7f0a76ffd640 1 --2- 172.21.15.123:0/2956460794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a78102c20 0x7f0a7819a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.353+0000 7f0a76ffd640 1 -- 172.21.15.123:0/2956460794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a781022a0 msgr2=0x7f0a781964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.354+0000 7f0a76ffd640 1 --2- 172.21.15.123:0/2956460794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a781022a0 0x7f0a781964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.354+0000 7f0a76ffd640 1 -- 172.21.15.123:0/2956460794 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7819af30 con 0x7f0a78100b50 2024-08-18T22:08:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.354+0000 7f0a767fc640 1 --2- 172.21.15.123:0/2956460794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a781022a0 0x7f0a781964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.354+0000 7f0a76ffd640 1 --2- 172.21.15.123:0/2956460794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a78100b50 0x7f0a78195f80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800e9f0 tx=0x7f0a6800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.354+0000 7f0a5ffff640 1 -- 172.21.15.123:0/2956460794 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6800cd80 con 0x7f0a78100b50 2024-08-18T22:08:43.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.354+0000 7f0a5ffff640 1 -- 172.21.15.123:0/2956460794 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a68010910 con 0x7f0a78100b50 2024-08-18T22:08:43.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.354+0000 7f0a7d30e640 1 -- 172.21.15.123:0/2956460794 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7819b220 con 0x7f0a78100b50 2024-08-18T22:08:43.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.354+0000 7f0a5ffff640 1 -- 172.21.15.123:0/2956460794 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a680188f0 con 0x7f0a78100b50 2024-08-18T22:08:43.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.354+0000 7f0a7d30e640 1 -- 172.21.15.123:0/2956460794 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a781a2b00 con 0x7f0a78100b50 2024-08-18T22:08:43.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.357+0000 7f0a7f70c740 1 Processor -- start 2024-08-18T22:08:43.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.357+0000 7f0a7f70c740 1 -- start start 2024-08-18T22:08:43.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.357+0000 7f0a5ffff640 1 -- 172.21.15.123:0/2956460794 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f0a68018b50 con 0x7f0a78100b50 2024-08-18T22:08:43.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.358+0000 7f0a7f70c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230100 0x55ee0a2304e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.358+0000 7f0a7f70c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a230a20 0x55ee0a23f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.358+0000 7f0a7f70c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a23f7f0 0x55ee0a241be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.358+0000 7f0a7f70c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ee0a1f3e40 con 0x55ee0a230a20 2024-08-18T22:08:43.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.358+0000 7f0a7f70c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee0a1957f0 con 0x55ee0a23f7f0 2024-08-18T22:08:43.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.358+0000 7f0a7f70c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ee0a13cfb0 con 0x55ee0a230100 2024-08-18T22:08:43.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.358+0000 7f0a777fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230100 0x55ee0a2304e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.358+0000 7f0a777fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230100 0x55ee0a2304e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:43254/0 (socket says 172.21.15.123:43254) 2024-08-18T22:08:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.358+0000 7f0a777fe640 1 -- 172.21.15.123:0/2216327313 learned_addr learned my addr 172.21.15.123:0/2216327313 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.358+0000 7f0a76ffd640 1 --2- 172.21.15.123:0/2216327313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a230a20 0x55ee0a23f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.358+0000 7f0a767fc640 1 --2- 172.21.15.123:0/2216327313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a23f7f0 0x55ee0a241be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.359+0000 7f0a767fc640 1 -- 172.21.15.123:0/2216327313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230100 msgr2=0x55ee0a2304e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.359+0000 7f0a767fc640 1 --2- 172.21.15.123:0/2216327313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230100 0x55ee0a2304e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.359+0000 7f0a767fc640 1 -- 172.21.15.123:0/2216327313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a230a20 msgr2=0x55ee0a23f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.359+0000 7f0a767fc640 1 --2- 172.21.15.123:0/2216327313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a230a20 0x55ee0a23f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.359+0000 7f0a767fc640 1 -- 172.21.15.123:0/2216327313 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee09f076a0 con 0x55ee0a23f7f0 2024-08-18T22:08:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.359+0000 7f0a777fe640 1 --2- 172.21.15.123:0/2216327313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230100 0x55ee0a2304e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:43.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.359+0000 7f0a5ffff640 1 --2- 172.21.15.123:0/2956460794 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0a600a2c00 0x7f0a600a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.359+0000 7f0a767fc640 1 --2- 172.21.15.123:0/2216327313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a23f7f0 0x55ee0a241be0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c005d00 tx=0x7f0a6c009850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=367e5c1a69a8ea5b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:43.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.359+0000 7f0a5ffff640 1 -- 172.21.15.123:0/2956460794 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0a680cf780 con 0x7f0a78100b50 2024-08-18T22:08:43.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.359+0000 7f0a777fe640 1 --2- 172.21.15.123:0/2956460794 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0a600a2c00 0x7f0a600a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.359+0000 7f0a5d7fa640 1 -- 172.21.15.123:0/2216327313 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c0157d0 con 0x55ee0a23f7f0 2024-08-18T22:08:43.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.359+0000 7f0a5d7fa640 1 -- 172.21.15.123:0/2216327313 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a6c01c070 con 0x55ee0a23f7f0 2024-08-18T22:08:43.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.359+0000 7f0a5d7fa640 1 -- 172.21.15.123:0/2216327313 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c017d80 con 0x55ee0a23f7f0 2024-08-18T22:08:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.361+0000 7f0a777fe640 1 --2- 172.21.15.123:0/2956460794 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0a600a2c00 0x7f0a600a50c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0a70030040 tx=0x7f0a70005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.361+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2216327313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a23f7f0 msgr2=0x55ee0a241be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.361+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2216327313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a23f7f0 0x55ee0a241be0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c005d00 tx=0x7f0a6c009850 comp rx=0 tx=0).stop 2024-08-18T22:08:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.361+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2216327313 shutdown_connections 2024-08-18T22:08:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.361+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2216327313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a23f7f0 0x55ee0a241be0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.361+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2216327313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a230a20 0x55ee0a23f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.361+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2216327313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230100 0x55ee0a2304e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.361+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2216327313 >> 172.21.15.123:0/2216327313 conn(0x55ee0a22c790 msgr2=0x55ee0a22cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.361+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2216327313 shutdown_connections 2024-08-18T22:08:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.361+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2216327313 wait complete. 2024-08-18T22:08:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.362+0000 7f0a7f70c740 1 -- start start 2024-08-18T22:08:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.362+0000 7f0a7f70c740 1 Processor -- start 2024-08-18T22:08:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.362+0000 7f0a7f70c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a230100 0x55ee0a23c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.362+0000 7f0a7f70c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230a20 0x55ee0a23cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.362+0000 7f0a7f70c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a23f7f0 0x55ee0a23d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.362+0000 7f0a7f70c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ee0a150cb0 con 0x55ee0a23f7f0 2024-08-18T22:08:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.362+0000 7f0a7f70c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee0a1917b0 con 0x55ee0a230100 2024-08-18T22:08:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.362+0000 7f0a7f70c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ee0a242420 con 0x55ee0a230a20 2024-08-18T22:08:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.362+0000 7f0a7f70c740 10 client.0 _ll_register_callbacks cb 0x55ee09ea4ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.363+0000 7f0a767fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230a20 0x55ee0a23cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.363+0000 7f0a76ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a230100 0x55ee0a23c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.363+0000 7f0a76ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a230100 0x55ee0a23c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:55100/0 (socket says 172.21.15.123:55100) 2024-08-18T22:08:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.363+0000 7f0a76ffd640 1 -- 172.21.15.123:0/1826526636 learned_addr learned my addr 172.21.15.123:0/1826526636 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.363+0000 7f0a777fe640 1 --2- 172.21.15.123:0/1826526636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a23f7f0 0x55ee0a23d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.363+0000 7f0a76ffd640 1 -- 172.21.15.123:0/1826526636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230a20 msgr2=0x55ee0a23cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.363+0000 7f0a76ffd640 1 --2- 172.21.15.123:0/1826526636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230a20 0x55ee0a23cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.363+0000 7f0a76ffd640 1 -- 172.21.15.123:0/1826526636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a23f7f0 msgr2=0x55ee0a23d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.363+0000 7f0a76ffd640 1 --2- 172.21.15.123:0/1826526636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a23f7f0 0x55ee0a23d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.363+0000 7f0a76ffd640 1 -- 172.21.15.123:0/1826526636 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee0a14fbc0 con 0x55ee0a230100 2024-08-18T22:08:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.363+0000 7f0a777fe640 1 --2- 172.21.15.123:0/1826526636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a23f7f0 0x55ee0a23d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.363+0000 7f0a76ffd640 1 --2- 172.21.15.123:0/1826526636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a230100 0x55ee0a23c750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0a6809b950 tx=0x7f0a68097fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=633d22bff875f98a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.363+0000 7f0a5aff5640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:08:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.363+0000 7f0a5aff5640 1 -- 172.21.15.123:0/1826526636 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6809c350 con 0x55ee0a230100 2024-08-18T22:08:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.363+0000 7f0a5aff5640 1 -- 172.21.15.123:0/1826526636 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0a680982c0 con 0x55ee0a230100 2024-08-18T22:08:43.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.364+0000 7f0a7f70c740 1 -- 172.21.15.123:0/1826526636 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a6c01c070 con 0x55ee0a230100 2024-08-18T22:08:43.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.364+0000 7f0a5aff5640 1 -- 172.21.15.123:0/1826526636 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0a6809bc50 con 0x55ee0a230100 2024-08-18T22:08:43.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.364+0000 7f0a7f70c740 10 client.25070 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:43.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.364+0000 7f0a7f70c740 1 -- 172.21.15.123:0/1826526636 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ee0a24e400 con 0x55ee0a230100 2024-08-18T22:08:43.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.364+0000 7f0a5aff5640 1 -- 172.21.15.123:0/1826526636 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a6c01c070 con 0x55ee0a230100 2024-08-18T22:08:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.364+0000 7f0a5aff5640 1 -- 172.21.15.123:0/1826526636 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f0a680979a0 con 0x55ee0a230100 2024-08-18T22:08:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.364+0000 7f0a7f70c740 10 client.25070 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.364+0000 7f0a7f70c740 10 client.25070 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.364+0000 7f0a7f70c740 20 client.25070 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.364+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/1826526636 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a24f8c0 0x55ee0a251d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.364+0000 7f0a7f70c740 4 client.25070 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:08:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.364+0000 7f0a7f70c740 1 -- 172.21.15.123:0/1826526636 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee0a1a2d60 con 0x55ee0a24f8c0 2024-08-18T22:08:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.365+0000 7f0a767fc640 1 --2- 172.21.15.123:0/1826526636 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a24f8c0 0x55ee0a251d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.365+0000 7f0a5aff5640 10 client.25070 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.365+0000 7f0a767fc640 1 --2- 172.21.15.123:0/1826526636 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a24f8c0 0x55ee0a251d10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23baefb17cb1c5c2 server_cookie=2fed100fa9bf4770 in_seq=0 out_seq=0 2024-08-18T22:08:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.366+0000 7f0a5aff5640 1 -- 172.21.15.123:0/1826526636 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee0a1a2d60 con 0x55ee0a24f8c0 2024-08-18T22:08:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.366+0000 7f0a5aff5640 10 client.25070 handle_command_reply: tid=0 2024-08-18T22:08:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.366+0000 7f0a7f70c740 1 client.25070 shutdown 2024-08-18T22:08:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.366+0000 7f0a7f70c740 1 -- 172.21.15.123:0/1826526636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a230100 msgr2=0x55ee0a23c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.366+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/1826526636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a230100 0x55ee0a23c750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0a6809b950 tx=0x7f0a68097fb0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.366+0000 7f0a7f70c740 1 -- 172.21.15.123:0/1826526636 shutdown_connections 2024-08-18T22:08:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.366+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/1826526636 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a24f8c0 0x55ee0a251d10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.366+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/1826526636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a23f7f0 0x55ee0a23d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.366+0000 7f0a5aff5640 0 client.25070 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.366+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/1826526636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230a20 0x55ee0a23cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.366+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/1826526636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a230100 0x55ee0a23c750 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.366+0000 7f0a7f70c740 1 -- 172.21.15.123:0/1826526636 >> 172.21.15.123:0/1826526636 conn(0x55ee0a22c790 msgr2=0x55ee0a2324f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.366+0000 7f0a7f70c740 1 -- 172.21.15.123:0/1826526636 shutdown_connections 2024-08-18T22:08:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.366+0000 7f0a7f70c740 1 -- 172.21.15.123:0/1826526636 wait complete. 2024-08-18T22:08:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.366+0000 7f0a7f70c740 20 client.25070 trim_cache size 0 max 16384 2024-08-18T22:08:43.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a7f70c740 1 Processor -- start 2024-08-18T22:08:43.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a7f70c740 1 -- start start 2024-08-18T22:08:43.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a7f70c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230100 0x55ee0a23b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a7f70c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a230a20 0x55ee0a2575e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a7f70c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a23f7f0 0x55ee0a257b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a7f70c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0a781af080 con 0x55ee0a23f7f0 2024-08-18T22:08:43.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a7f70c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0a781ac950 con 0x55ee0a230a20 2024-08-18T22:08:43.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a7f70c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0a781aa7a0 con 0x55ee0a230100 2024-08-18T22:08:43.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a777fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a23f7f0 0x55ee0a257b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a777fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a23f7f0 0x55ee0a257b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40266/0 (socket says 172.21.15.123:40266) 2024-08-18T22:08:43.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a777fe640 1 -- 172.21.15.123:0/2202833356 learned_addr learned my addr 172.21.15.123:0/2202833356 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:43.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a767fc640 1 --2- 172.21.15.123:0/2202833356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a230a20 0x55ee0a2575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a76ffd640 1 --2- 172.21.15.123:0/2202833356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230100 0x55ee0a23b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a777fe640 1 -- 172.21.15.123:0/2202833356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230100 msgr2=0x55ee0a23b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:43.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a777fe640 1 --2- 172.21.15.123:0/2202833356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230100 0x55ee0a23b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a777fe640 1 -- 172.21.15.123:0/2202833356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a230a20 msgr2=0x55ee0a2575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:43.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a777fe640 1 --2- 172.21.15.123:0/2202833356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a230a20 0x55ee0a2575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.400+0000 7f0a777fe640 1 -- 172.21.15.123:0/2202833356 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee0a23aca0 con 0x55ee0a23f7f0 2024-08-18T22:08:43.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.401+0000 7f0a777fe640 1 --2- 172.21.15.123:0/2202833356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a23f7f0 0x55ee0a257b20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0a70006010 tx=0x7f0a70040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346b329001dd06b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:43.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.401+0000 7f0a5cff9640 1 -- 172.21.15.123:0/2202833356 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70034040 con 0x55ee0a23f7f0 2024-08-18T22:08:43.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.401+0000 7f0a5cff9640 1 -- 172.21.15.123:0/2202833356 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a70003e50 con 0x55ee0a23f7f0 2024-08-18T22:08:43.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.401+0000 7f0a5cff9640 1 -- 172.21.15.123:0/2202833356 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a700306a0 con 0x55ee0a23f7f0 2024-08-18T22:08:43.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.402+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2202833356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a23f7f0 msgr2=0x55ee0a257b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:43.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.402+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2202833356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a23f7f0 0x55ee0a257b20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0a70006010 tx=0x7f0a70040000 comp rx=0 tx=0).stop 2024-08-18T22:08:43.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.402+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2202833356 shutdown_connections 2024-08-18T22:08:43.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.402+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2202833356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a23f7f0 0x55ee0a257b20 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.402+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2202833356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a230a20 0x55ee0a2575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.402+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2202833356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230100 0x55ee0a23b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.402+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2202833356 >> 172.21.15.123:0/2202833356 conn(0x55ee0a22c790 msgr2=0x55ee0a23b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:43.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.402+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2202833356 shutdown_connections 2024-08-18T22:08:43.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.402+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2202833356 wait complete. 2024-08-18T22:08:43.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.402+0000 7f0a7f70c740 1 -- start start 2024-08-18T22:08:43.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.403+0000 7f0a7f70c740 1 Processor -- start 2024-08-18T22:08:43.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.403+0000 7f0a7f70c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a230100 0x55ee0a233210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.403+0000 7f0a76ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a230100 0x55ee0a233210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.403+0000 7f0a76ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a230100 0x55ee0a233210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40270/0 (socket says 172.21.15.123:40270) 2024-08-18T22:08:43.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.403+0000 7f0a76ffd640 1 -- 172.21.15.123:0/2573450561 learned_addr learned my addr 172.21.15.123:0/2573450561 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:43.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.403+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2573450561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230a20 0x55ee0a233750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.403+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2573450561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a23f7f0 0x55ee0a233c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.403+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2573450561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0a781aae10 con 0x55ee0a230100 2024-08-18T22:08:43.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.403+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2573450561 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0a781ac280 con 0x55ee0a23f7f0 2024-08-18T22:08:43.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.403+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2573450561 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0a781ab4e0 con 0x55ee0a230a20 2024-08-18T22:08:43.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.403+0000 7f0a7f70c740 10 client.0 _ll_register_callbacks cb 0x7f0a680d5240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:43.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.403+0000 7f0a767fc640 1 --2- 172.21.15.123:0/2573450561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230a20 0x55ee0a233750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.404+0000 7f0a76ffd640 1 -- 172.21.15.123:0/2573450561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230a20 msgr2=0x55ee0a233750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:43.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.404+0000 7f0a76ffd640 1 --2- 172.21.15.123:0/2573450561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230a20 0x55ee0a233750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.404+0000 7f0a76ffd640 1 -- 172.21.15.123:0/2573450561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a23f7f0 msgr2=0x55ee0a233c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:43.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.404+0000 7f0a76ffd640 1 --2- 172.21.15.123:0/2573450561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a23f7f0 0x55ee0a233c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.404+0000 7f0a76ffd640 1 -- 172.21.15.123:0/2573450561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee0a2466a0 con 0x55ee0a230100 2024-08-18T22:08:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.404+0000 7f0a76ffd640 1 --2- 172.21.15.123:0/2573450561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a230100 0x55ee0a233210 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0a68005b60 tx=0x7f0a6809a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6aec7483e94b22 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.404+0000 7f0a5aff5640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.404+0000 7f0a5aff5640 1 -- 172.21.15.123:0/2573450561 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a680b1070 con 0x55ee0a230100 2024-08-18T22:08:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.404+0000 7f0a5aff5640 1 -- 172.21.15.123:0/2573450561 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0a6809b2a0 con 0x55ee0a230100 2024-08-18T22:08:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.404+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2573450561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a70003e50 con 0x55ee0a230100 2024-08-18T22:08:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.404+0000 7f0a5aff5640 1 -- 172.21.15.123:0/2573450561 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0a6809c350 con 0x55ee0a230100 2024-08-18T22:08:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.404+0000 7f0a7f70c740 10 client.15594 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.404+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2573450561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ee0a2478b0 con 0x55ee0a230100 2024-08-18T22:08:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.405+0000 7f0a5aff5640 1 -- 172.21.15.123:0/2573450561 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a70003e50 con 0x55ee0a230100 2024-08-18T22:08:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.405+0000 7f0a5aff5640 1 -- 172.21.15.123:0/2573450561 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f0a6809ab10 con 0x55ee0a230100 2024-08-18T22:08:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.405+0000 7f0a7f70c740 10 client.15594 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.405+0000 7f0a7f70c740 10 client.15594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.405+0000 7f0a7f70c740 20 client.15594 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:43.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.405+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2573450561 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a24f8c0 0x55ee0a247fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:43.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.405+0000 7f0a7f70c740 4 client.15594 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-18T22:08:43.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.405+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2573450561 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ee0a19d270 con 0x55ee0a24f8c0 2024-08-18T22:08:43.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.405+0000 7f0a767fc640 1 --2- 172.21.15.123:0/2573450561 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a24f8c0 0x55ee0a247fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:43.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.405+0000 7f0a767fc640 1 --2- 172.21.15.123:0/2573450561 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a24f8c0 0x55ee0a247fd0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46db2c75a31c49be server_cookie=76bfc5aa759724d6 in_seq=0 out_seq=0 2024-08-18T22:08:43.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.406+0000 7f0a5aff5640 10 client.15594 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:43.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.407+0000 7f0a5aff5640 1 -- 172.21.15.123:0/2573450561 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ee0a19d270 con 0x55ee0a24f8c0 2024-08-18T22:08:43.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.407+0000 7f0a5aff5640 10 client.15594 handle_command_reply: tid=0 2024-08-18T22:08:43.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.407+0000 7f0a7f70c740 1 client.15594 shutdown 2024-08-18T22:08:43.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.407+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2573450561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a230100 msgr2=0x55ee0a233210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:43.414 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:08:43.414 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-08-18T22:08:43.414 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "fecf0fc9-277a-42ef-8926-8ee6ff5fdf4b", 2024-08-18T22:08:43.414 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-08-18T22:08:43.414 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:08:43.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.407+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2573450561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a230100 0x55ee0a233210 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0a68005b60 tx=0x7f0a6809a160 comp rx=0 tx=0).stop 2024-08-18T22:08:43.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.407+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2573450561 shutdown_connections 2024-08-18T22:08:43.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.407+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2573450561 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a24f8c0 0x55ee0a247fd0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.408+0000 7f0a5aff5640 0 client.15594 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:43.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.408+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2573450561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a23f7f0 0x55ee0a233c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.408+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2573450561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a230a20 0x55ee0a233750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.408+0000 7f0a7f70c740 1 --2- 172.21.15.123:0/2573450561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a230100 0x55ee0a233210 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.408+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2573450561 >> 172.21.15.123:0/2573450561 conn(0x55ee0a22c790 msgr2=0x55ee0a23b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.408+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2573450561 shutdown_connections 2024-08-18T22:08:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.408+0000 7f0a7f70c740 1 -- 172.21.15.123:0/2573450561 wait complete. 2024-08-18T22:08:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.408+0000 7f0a7f70c740 20 client.15594 trim_cache size 0 max 16384 2024-08-18T22:08:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.410+0000 7f0a7d30e640 1 -- 172.21.15.123:0/2956460794 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0a600a2c00 msgr2=0x7f0a600a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.410+0000 7f0a7d30e640 1 --2- 172.21.15.123:0/2956460794 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0a600a2c00 0x7f0a600a50c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0a70030040 tx=0x7f0a70005c30 comp rx=0 tx=0).stop 2024-08-18T22:08:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.410+0000 7f0a7d30e640 1 -- 172.21.15.123:0/2956460794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a78100b50 msgr2=0x7f0a78195f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.410+0000 7f0a7d30e640 1 --2- 172.21.15.123:0/2956460794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a78100b50 0x7f0a78195f80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800e9f0 tx=0x7f0a6800eeb0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.410+0000 7f0a7d30e640 1 -- 172.21.15.123:0/2956460794 shutdown_connections 2024-08-18T22:08:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.410+0000 7f0a7d30e640 1 --2- 172.21.15.123:0/2956460794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a78102c20 0x7f0a7819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.410+0000 7f0a7d30e640 1 --2- 172.21.15.123:0/2956460794 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0a600a2c00 0x7f0a600a50c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.410+0000 7f0a7d30e640 1 --2- 172.21.15.123:0/2956460794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a781022a0 0x7f0a781964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.410+0000 7f0a7d30e640 1 --2- 172.21.15.123:0/2956460794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a78100b50 0x7f0a78195f80 secure :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800e9f0 tx=0x7f0a6800eeb0 comp rx=0 tx=0).stop 2024-08-18T22:08:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.410+0000 7f0a7d30e640 1 -- 172.21.15.123:0/2956460794 >> 172.21.15.123:0/2956460794 conn(0x7f0a780fc500 msgr2=0x7f0a780fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.410+0000 7f0a7d30e640 1 -- 172.21.15.123:0/2956460794 shutdown_connections 2024-08-18T22:08:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:43.410+0000 7f0a7d30e640 1 -- 172.21.15.123:0/2956460794 wait complete. 2024-08-18T22:08:44.323 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-18T22:08:44.597 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:08:44.720 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:44 smithi123 ceph-mon[18462]: pgmap v369: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-08-18T22:08:44.720 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:44 smithi123 ceph-mon[18462]: scrub queued for path: / 2024-08-18T22:08:44.720 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:44 smithi123 ceph-mon[18462]: scrub summary: idle+waiting paths [/] 2024-08-18T22:08:44.721 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:44 smithi123 ceph-mon[18462]: scrub summary: active paths [/] 2024-08-18T22:08:44.721 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:44 smithi123 ceph-mon[18462]: scrub summary: idle+waiting paths [/] 2024-08-18T22:08:44.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:44 smithi183 ceph-mon[22097]: pgmap v369: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-08-18T22:08:44.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:44 smithi183 ceph-mon[22097]: scrub queued for path: / 2024-08-18T22:08:44.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:44 smithi183 ceph-mon[22097]: scrub summary: idle+waiting paths [/] 2024-08-18T22:08:44.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:44 smithi183 ceph-mon[22097]: scrub summary: active paths [/] 2024-08-18T22:08:44.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:44 smithi183 ceph-mon[22097]: scrub summary: idle+waiting paths [/] 2024-08-18T22:08:45.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:44 smithi130 ceph-mon[21698]: pgmap v369: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-08-18T22:08:45.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:44 smithi130 ceph-mon[21698]: scrub queued for path: / 2024-08-18T22:08:45.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:44 smithi130 ceph-mon[21698]: scrub summary: idle+waiting paths [/] 2024-08-18T22:08:45.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:44 smithi130 ceph-mon[21698]: scrub summary: active paths [/] 2024-08-18T22:08:45.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:44 smithi130 ceph-mon[21698]: scrub summary: idle+waiting paths [/] 2024-08-18T22:08:45.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.173+0000 7f552f7fe640 1 -- 172.21.15.123:0/1149915202 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552802c040 con 0x7f5530102c20 2024-08-18T22:08:45.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.174+0000 7f5536e37640 1 -- 172.21.15.123:0/1149915202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5530102c20 msgr2=0x7f553010d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:45.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.174+0000 7f5536e37640 1 --2- 172.21.15.123:0/1149915202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5530102c20 0x7f553010d770 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5528009ca0 tx=0x7f552802a950 comp rx=0 tx=0).stop 2024-08-18T22:08:45.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.175+0000 7f5536e37640 1 -- 172.21.15.123:0/1149915202 shutdown_connections 2024-08-18T22:08:45.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.175+0000 7f5536e37640 1 --2- 172.21.15.123:0/1149915202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5530102c20 0x7f553010d770 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.175+0000 7f5536e37640 1 --2- 172.21.15.123:0/1149915202 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55301022a0 0x7f55301026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.175+0000 7f5536e37640 1 --2- 172.21.15.123:0/1149915202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5530100b50 0x7f5530100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.175+0000 7f5536e37640 1 -- 172.21.15.123:0/1149915202 >> 172.21.15.123:0/1149915202 conn(0x7f55300fc500 msgr2=0x7f55300fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:45.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.175+0000 7f5536e37640 1 -- 172.21.15.123:0/1149915202 shutdown_connections 2024-08-18T22:08:45.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.175+0000 7f5536e37640 1 -- 172.21.15.123:0/1149915202 wait complete. 2024-08-18T22:08:45.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.176+0000 7f5536e37640 1 Processor -- start 2024-08-18T22:08:45.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.176+0000 7f5536e37640 1 -- start start 2024-08-18T22:08:45.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.176+0000 7f5536e37640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5530100b50 0x7f5530198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.177+0000 7f5536e37640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55301022a0 0x7f5530198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.177+0000 7f5536e37640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5530102c20 0x7f553019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.177+0000 7f552ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55301022a0 0x7f5530198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.177+0000 7f5536e37640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5530111db0 con 0x7f55301022a0 2024-08-18T22:08:45.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.177+0000 7f552ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55301022a0 0x7f5530198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40288/0 (socket says 172.21.15.123:40288) 2024-08-18T22:08:45.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.177+0000 7f552ffff640 1 -- 172.21.15.123:0/1988892218 learned_addr learned my addr 172.21.15.123:0/1988892218 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:45.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.177+0000 7f5536e37640 1 -- 172.21.15.123:0/1988892218 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5530111c30 con 0x7f5530102c20 2024-08-18T22:08:45.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.177+0000 7f5536e37640 1 -- 172.21.15.123:0/1988892218 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5530111f30 con 0x7f5530100b50 2024-08-18T22:08:45.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.177+0000 7f5534bd3640 1 --2- 172.21.15.123:0/1988892218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5530100b50 0x7f5530198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.177+0000 7f55353d4640 1 --2- 172.21.15.123:0/1988892218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5530102c20 0x7f553019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.177+0000 7f55353d4640 1 -- 172.21.15.123:0/1988892218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5530100b50 msgr2=0x7f5530198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:45.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.177+0000 7f55353d4640 1 --2- 172.21.15.123:0/1988892218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5530100b50 0x7f5530198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.177+0000 7f55353d4640 1 -- 172.21.15.123:0/1988892218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55301022a0 msgr2=0x7f5530198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:45.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.177+0000 7f55353d4640 1 --2- 172.21.15.123:0/1988892218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55301022a0 0x7f5530198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.177+0000 7f55353d4640 1 -- 172.21.15.123:0/1988892218 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553019d1c0 con 0x7f5530102c20 2024-08-18T22:08:45.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.178+0000 7f552ffff640 1 --2- 172.21.15.123:0/1988892218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55301022a0 0x7f5530198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:45.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.178+0000 7f55353d4640 1 --2- 172.21.15.123:0/1988892218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5530102c20 0x7f553019cae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5528005cc0 tx=0x7f552802f3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:45.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.178+0000 7f552dffb640 1 -- 172.21.15.123:0/1988892218 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528034040 con 0x7f5530102c20 2024-08-18T22:08:45.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.178+0000 7f552dffb640 1 -- 172.21.15.123:0/1988892218 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5528030920 con 0x7f5530102c20 2024-08-18T22:08:45.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.178+0000 7f552dffb640 1 -- 172.21.15.123:0/1988892218 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552803edb0 con 0x7f5530102c20 2024-08-18T22:08:45.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.178+0000 7f5536e37640 1 -- 172.21.15.123:0/1988892218 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553019d450 con 0x7f5530102c20 2024-08-18T22:08:45.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.179+0000 7f5536e37640 1 -- 172.21.15.123:0/1988892218 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553019d820 con 0x7f5530102c20 2024-08-18T22:08:45.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.181+0000 7f552dffb640 1 -- 172.21.15.123:0/1988892218 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f5528037020 con 0x7f5530102c20 2024-08-18T22:08:45.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.182+0000 7f5539235740 1 Processor -- start 2024-08-18T22:08:45.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.182+0000 7f5539235740 1 -- start start 2024-08-18T22:08:45.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.183+0000 7f5539235740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea6f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.183+0000 7f552dffb640 1 --2- 172.21.15.123:0/1988892218 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f55200a2c00 0x7f55200a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.183+0000 7f5539235740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea6fb30 0x55e75ea79eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.183+0000 7f5539235740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 0x55e75ea7c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.183+0000 7f5539235740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e75e9d4980 con 0x55e75ea6f210 2024-08-18T22:08:45.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.183+0000 7f5539235740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e75e96ca70 con 0x55e75ea7a3f0 2024-08-18T22:08:45.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.183+0000 7f5539235740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e75e9d0940 con 0x55e75ea6fb30 2024-08-18T22:08:45.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.183+0000 7f552ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea6f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.183+0000 7f552ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea6f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40290/0 (socket says 172.21.15.123:40290) 2024-08-18T22:08:45.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.183+0000 7f552ffff640 1 -- 172.21.15.123:0/3472875047 learned_addr learned my addr 172.21.15.123:0/3472875047 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:45.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.183+0000 7f5534bd3640 1 --2- 172.21.15.123:0/1988892218 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f55200a2c00 0x7f55200a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.183+0000 7f552dffb640 1 -- 172.21.15.123:0/1988892218 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f55280f4570 con 0x7f5530102c20 2024-08-18T22:08:45.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.183+0000 7f55353d4640 1 --2- 172.21.15.123:0/3472875047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 0x55e75ea7c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.184+0000 7f55353d4640 1 -- 172.21.15.123:0/3472875047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea6fb30 msgr2=0x55e75ea79eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T22:08:45.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.184+0000 7f55353d4640 1 --2- 172.21.15.123:0/3472875047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea6fb30 0x55e75ea79eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.184+0000 7f55353d4640 1 -- 172.21.15.123:0/3472875047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 msgr2=0x55e75ea6f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:45.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.184+0000 7f55353d4640 1 --2- 172.21.15.123:0/3472875047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea6f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.184+0000 7f5534bd3640 1 --2- 172.21.15.123:0/1988892218 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f55200a2c00 0x7f55200a50c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5524009b60 tx=0x7f5524005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:45.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.184+0000 7f55353d4640 1 -- 172.21.15.123:0/3472875047 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e75e9cf6e0 con 0x55e75ea7a3f0 2024-08-18T22:08:45.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.184+0000 7f552ffff640 1 --2- 172.21.15.123:0/3472875047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea6f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:45.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.184+0000 7f55353d4640 1 --2- 172.21.15.123:0/3472875047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 0x55e75ea7c7e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5528005e30 tx=0x7f552803ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=668aca1fa98e3d08 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:45.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.184+0000 7f551affd640 1 -- 172.21.15.123:0/3472875047 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552802c040 con 0x55e75ea7a3f0 2024-08-18T22:08:45.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.184+0000 7f551affd640 1 -- 172.21.15.123:0/3472875047 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55280c4df0 con 0x55e75ea7a3f0 2024-08-18T22:08:45.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.185+0000 7f5539235740 1 -- 172.21.15.123:0/3472875047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 msgr2=0x55e75ea7c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:45.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.185+0000 7f5539235740 1 --2- 172.21.15.123:0/3472875047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 0x55e75ea7c7e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5528005e30 tx=0x7f552803ef90 comp rx=0 tx=0).stop 2024-08-18T22:08:45.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.185+0000 7f5539235740 1 -- 172.21.15.123:0/3472875047 shutdown_connections 2024-08-18T22:08:45.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.185+0000 7f5539235740 1 --2- 172.21.15.123:0/3472875047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 0x55e75ea7c7e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.185+0000 7f5539235740 1 --2- 172.21.15.123:0/3472875047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea6fb30 0x55e75ea79eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.185+0000 7f5539235740 1 --2- 172.21.15.123:0/3472875047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea6f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.185+0000 7f5539235740 1 -- 172.21.15.123:0/3472875047 >> 172.21.15.123:0/3472875047 conn(0x55e75ea6b7a0 msgr2=0x55e75ea6bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:45.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.185+0000 7f5539235740 1 -- 172.21.15.123:0/3472875047 shutdown_connections 2024-08-18T22:08:45.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.185+0000 7f5539235740 1 -- 172.21.15.123:0/3472875047 wait complete. 2024-08-18T22:08:45.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.186+0000 7f5539235740 1 -- start start 2024-08-18T22:08:45.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.186+0000 7f5539235740 1 Processor -- start 2024-08-18T22:08:45.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.186+0000 7f5539235740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea6f210 0x55e75ea77390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.186+0000 7f5539235740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6fb30 0x55e75ea778d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.187+0000 7f552ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6fb30 0x55e75ea778d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.187+0000 7f552ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6fb30 0x55e75ea778d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40302/0 (socket says 172.21.15.123:40302) 2024-08-18T22:08:45.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.187+0000 7f552ffff640 1 -- 172.21.15.123:0/1068257866 learned_addr learned my addr 172.21.15.123:0/1068257866 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:45.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.187+0000 7f5539235740 1 --2- 172.21.15.123:0/1068257866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 0x55e75ea77e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.187+0000 7f5534bd3640 1 --2- 172.21.15.123:0/1068257866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea6f210 0x55e75ea77390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.187+0000 7f5539235740 1 -- 172.21.15.123:0/1068257866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e75ea7cd80 con 0x55e75ea6fb30 2024-08-18T22:08:45.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.187+0000 7f5539235740 1 -- 172.21.15.123:0/1068257866 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e75e98faa0 con 0x55e75ea7a3f0 2024-08-18T22:08:45.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.187+0000 7f5539235740 1 -- 172.21.15.123:0/1068257866 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e75ea7cf00 con 0x55e75ea6f210 2024-08-18T22:08:45.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.187+0000 7f55353d4640 1 --2- 172.21.15.123:0/1068257866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 0x55e75ea77e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.187+0000 7f552ffff640 1 -- 172.21.15.123:0/1068257866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea6f210 msgr2=0x55e75ea77390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:45.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.187+0000 7f552ffff640 1 --2- 172.21.15.123:0/1068257866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea6f210 0x55e75ea77390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.187+0000 7f552ffff640 1 -- 172.21.15.123:0/1068257866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 msgr2=0x55e75ea77e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:45.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.187+0000 7f552ffff640 1 --2- 172.21.15.123:0/1068257866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 0x55e75ea77e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.187+0000 7f552ffff640 1 -- 172.21.15.123:0/1068257866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e75e973650 con 0x55e75ea6fb30 2024-08-18T22:08:45.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.188+0000 7f552ffff640 1 --2- 172.21.15.123:0/1068257866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6fb30 0x55e75ea778d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f551c012bd0 tx=0x7f551c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f652c2838f380b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:45.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.188+0000 7f550ffff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:45.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.188+0000 7f550ffff640 1 -- 172.21.15.123:0/1068257866 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551c005020 con 0x55e75ea6fb30 2024-08-18T22:08:45.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.188+0000 7f550ffff640 1 -- 172.21.15.123:0/1068257866 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f551c0051c0 con 0x55e75ea6fb30 2024-08-18T22:08:45.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.188+0000 7f550ffff640 10 client.0 inactive, discarding osd_map(92..92 src has 1..92) 2024-08-18T22:08:45.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.188+0000 7f5539235740 10 client.0 _ll_register_callbacks cb 0x55e75e97ee60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:45.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.188+0000 7f5539235740 1 -- 172.21.15.123:0/1068257866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e75e9e1ef0 con 0x55e75ea6fb30 2024-08-18T22:08:45.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.188+0000 7f550ffff640 1 -- 172.21.15.123:0/1068257866 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f551c0053c0 con 0x55e75ea6fb30 2024-08-18T22:08:45.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.188+0000 7f5539235740 10 client.15606 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:45.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.188+0000 7f5539235740 1 -- 172.21.15.123:0/1068257866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55e75e7463c0 con 0x55e75ea6fb30 2024-08-18T22:08:45.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.189+0000 7f550ffff640 1 -- 172.21.15.123:0/1068257866 <== mon.0 v2:172.21.15.123:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f551c0047a0 con 0x55e75ea6fb30 2024-08-18T22:08:45.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.189+0000 7f5539235740 10 client.15606 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:45.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.189+0000 7f5539235740 10 client.15606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:45.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.189+0000 7f5539235740 20 client.15606 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:45.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.189+0000 7f5539235740 1 --2- 172.21.15.123:0/1068257866 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e75ea92220 0x55e75ea94650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.189+0000 7f5539235740 4 client.15606 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:08:45.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.189+0000 7f5539235740 1 -- 172.21.15.123:0/1068257866 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e75e9e1ef0 con 0x55e75ea92220 2024-08-18T22:08:45.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.189+0000 7f5534bd3640 1 --2- 172.21.15.123:0/1068257866 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e75ea92220 0x55e75ea94650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.190+0000 7f5534bd3640 1 --2- 172.21.15.123:0/1068257866 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e75ea92220 0x55e75ea94650 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c0f3408440676ed server_cookie=89c4066aa1f4b324 in_seq=0 out_seq=0 2024-08-18T22:08:45.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.190+0000 7f550ffff640 10 client.15606 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:45.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.190+0000 7f550ffff640 1 -- 172.21.15.123:0/1068257866 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e75e9e1ef0 con 0x55e75ea92220 2024-08-18T22:08:45.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.190+0000 7f550ffff640 10 client.15606 handle_command_reply: tid=0 2024-08-18T22:08:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.191+0000 7f5539235740 1 client.15606 shutdown 2024-08-18T22:08:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.191+0000 7f5539235740 1 -- 172.21.15.123:0/1068257866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6fb30 msgr2=0x55e75ea778d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.191+0000 7f5539235740 1 --2- 172.21.15.123:0/1068257866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6fb30 0x55e75ea778d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f551c012bd0 tx=0x7f551c00f790 comp rx=0 tx=0).stop 2024-08-18T22:08:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.191+0000 7f5539235740 1 -- 172.21.15.123:0/1068257866 shutdown_connections 2024-08-18T22:08:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.191+0000 7f5539235740 1 --2- 172.21.15.123:0/1068257866 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e75ea92220 0x55e75ea94650 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.191+0000 7f5539235740 1 --2- 172.21.15.123:0/1068257866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 0x55e75ea77e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.191+0000 7f5539235740 1 --2- 172.21.15.123:0/1068257866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6fb30 0x55e75ea778d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.191+0000 7f550ffff640 0 client.15606 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.191+0000 7f5539235740 1 --2- 172.21.15.123:0/1068257866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea6f210 0x55e75ea77390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.191+0000 7f5539235740 1 -- 172.21.15.123:0/1068257866 >> 172.21.15.123:0/1068257866 conn(0x55e75ea6b7a0 msgr2=0x55e75ea71500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.191+0000 7f5539235740 1 -- 172.21.15.123:0/1068257866 shutdown_connections 2024-08-18T22:08:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.191+0000 7f5539235740 1 -- 172.21.15.123:0/1068257866 wait complete. 2024-08-18T22:08:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.191+0000 7f5539235740 20 client.15606 trim_cache size 0 max 16384 2024-08-18T22:08:45.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.225+0000 7f5539235740 1 Processor -- start 2024-08-18T22:08:45.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.225+0000 7f5539235740 1 -- start start 2024-08-18T22:08:45.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.225+0000 7f5539235740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea77c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.225+0000 7f5539235740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea6fb30 0x55e75ea99f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.225+0000 7f5539235740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 0x55e75ea9a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.225+0000 7f5539235740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f55301af0b0 con 0x55e75ea6f210 2024-08-18T22:08:45.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.225+0000 7f5539235740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f55301ac980 con 0x55e75ea7a3f0 2024-08-18T22:08:45.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.225+0000 7f5539235740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f55301aa7d0 con 0x55e75ea6fb30 2024-08-18T22:08:45.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.225+0000 7f5534bd3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea77c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.225+0000 7f5534bd3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea77c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40310/0 (socket says 172.21.15.123:40310) 2024-08-18T22:08:45.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.225+0000 7f5534bd3640 1 -- 172.21.15.123:0/2632515885 learned_addr learned my addr 172.21.15.123:0/2632515885 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:45.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.226+0000 7f55353d4640 1 --2- 172.21.15.123:0/2632515885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 0x55e75ea9a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.226+0000 7f552ffff640 1 --2- 172.21.15.123:0/2632515885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea6fb30 0x55e75ea99f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.226+0000 7f55353d4640 1 -- 172.21.15.123:0/2632515885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea6fb30 msgr2=0x55e75ea99f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:45.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.226+0000 7f55353d4640 1 --2- 172.21.15.123:0/2632515885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea6fb30 0x55e75ea99f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.226+0000 7f55353d4640 1 -- 172.21.15.123:0/2632515885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 msgr2=0x55e75ea77c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:45.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.226+0000 7f55353d4640 1 --2- 172.21.15.123:0/2632515885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea77c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.226+0000 7f55353d4640 1 -- 172.21.15.123:0/2632515885 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e75ea78760 con 0x55e75ea7a3f0 2024-08-18T22:08:45.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.226+0000 7f5534bd3640 1 --2- 172.21.15.123:0/2632515885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea77c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:45.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.226+0000 7f55353d4640 1 --2- 172.21.15.123:0/2632515885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 0x55e75ea9a4a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f55280c0c00 tx=0x7f55280b0040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20d67bd93f607cb5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:45.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.226+0000 7f551a7fc640 1 -- 172.21.15.123:0/2632515885 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552802c040 con 0x55e75ea7a3f0 2024-08-18T22:08:45.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.226+0000 7f551a7fc640 1 -- 172.21.15.123:0/2632515885 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55280c96b0 con 0x55e75ea7a3f0 2024-08-18T22:08:45.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.226+0000 7f551a7fc640 1 -- 172.21.15.123:0/2632515885 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55280903d0 con 0x55e75ea7a3f0 2024-08-18T22:08:45.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.227+0000 7f5539235740 1 -- 172.21.15.123:0/2632515885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 msgr2=0x55e75ea9a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:45.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.227+0000 7f5539235740 1 --2- 172.21.15.123:0/2632515885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 0x55e75ea9a4a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f55280c0c00 tx=0x7f55280b0040 comp rx=0 tx=0).stop 2024-08-18T22:08:45.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.227+0000 7f5539235740 1 -- 172.21.15.123:0/2632515885 shutdown_connections 2024-08-18T22:08:45.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.227+0000 7f5539235740 1 --2- 172.21.15.123:0/2632515885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea7a3f0 0x55e75ea9a4a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.227+0000 7f5539235740 1 --2- 172.21.15.123:0/2632515885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea6fb30 0x55e75ea99f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.227+0000 7f5539235740 1 --2- 172.21.15.123:0/2632515885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea77c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.227+0000 7f5539235740 1 -- 172.21.15.123:0/2632515885 >> 172.21.15.123:0/2632515885 conn(0x55e75ea6b7a0 msgr2=0x55e75ea79300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:45.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.228+0000 7f5539235740 1 -- 172.21.15.123:0/2632515885 shutdown_connections 2024-08-18T22:08:45.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.228+0000 7f5539235740 1 -- 172.21.15.123:0/2632515885 wait complete. 2024-08-18T22:08:45.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.228+0000 7f5539235740 1 -- start start 2024-08-18T22:08:45.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.228+0000 7f5539235740 1 Processor -- start 2024-08-18T22:08:45.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.229+0000 7f5539235740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea8b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.229+0000 7f5539235740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea6fb30 0x55e75ea863b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.229+0000 7f5534bd3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea8b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.229+0000 7f5534bd3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea8b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40312/0 (socket says 172.21.15.123:40312) 2024-08-18T22:08:45.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.230+0000 7f5534bd3640 1 -- 172.21.15.123:0/1362926608 learned_addr learned my addr 172.21.15.123:0/1362926608 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:45.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.230+0000 7f552ffff640 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea6fb30 0x55e75ea863b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.230+0000 7f5539235740 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea7a3f0 0x55e75ea868f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.230+0000 7f5539235740 1 -- 172.21.15.123:0/1362926608 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f55301aae40 con 0x55e75ea6f210 2024-08-18T22:08:45.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.230+0000 7f5539235740 1 -- 172.21.15.123:0/1362926608 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f55301ac2b0 con 0x55e75ea6fb30 2024-08-18T22:08:45.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.230+0000 7f5539235740 1 -- 172.21.15.123:0/1362926608 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f55301ab510 con 0x55e75ea7a3f0 2024-08-18T22:08:45.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.230+0000 7f55353d4640 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea7a3f0 0x55e75ea868f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.231+0000 7f5539235740 10 client.0 _ll_register_callbacks cb 0x7f551c009da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:45.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.231+0000 7f552ffff640 1 -- 172.21.15.123:0/1362926608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea7a3f0 msgr2=0x55e75ea868f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:45.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.231+0000 7f552ffff640 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea7a3f0 0x55e75ea868f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.231+0000 7f552ffff640 1 -- 172.21.15.123:0/1362926608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 msgr2=0x55e75ea8b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:45.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.231+0000 7f552ffff640 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea8b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.231+0000 7f552ffff640 1 -- 172.21.15.123:0/1362926608 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e75ea87120 con 0x55e75ea6fb30 2024-08-18T22:08:45.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.231+0000 7f5534bd3640 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea8b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:45.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.231+0000 7f55353d4640 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea7a3f0 0x55e75ea868f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:45.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.231+0000 7f552ffff640 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea6fb30 0x55e75ea863b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f551c012ba0 tx=0x7f551c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5a5f9d910d79ef4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:45.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.231+0000 7f550ffff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:08:45.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.232+0000 7f550ffff640 1 -- 172.21.15.123:0/1362926608 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551c01c470 con 0x55e75ea6fb30 2024-08-18T22:08:45.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.232+0000 7f550ffff640 1 -- 172.21.15.123:0/1362926608 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f551c01c610 con 0x55e75ea6fb30 2024-08-18T22:08:45.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.232+0000 7f5539235740 1 -- 172.21.15.123:0/1362926608 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55280c96b0 con 0x55e75ea6fb30 2024-08-18T22:08:45.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.232+0000 7f550ffff640 1 -- 172.21.15.123:0/1362926608 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f551c01c830 con 0x55e75ea6fb30 2024-08-18T22:08:45.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.232+0000 7f5539235740 10 client.25091 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:45.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.232+0000 7f5539235740 1 -- 172.21.15.123:0/1362926608 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e75eafcf30 con 0x55e75ea6fb30 2024-08-18T22:08:45.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.232+0000 7f550ffff640 1 -- 172.21.15.123:0/1362926608 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55280c96b0 con 0x55e75ea6fb30 2024-08-18T22:08:45.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.233+0000 7f550ffff640 1 -- 172.21.15.123:0/1362926608 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f551c01c9d0 con 0x55e75ea6fb30 2024-08-18T22:08:45.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.234+0000 7f5539235740 10 client.25091 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:45.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.234+0000 7f5539235740 10 client.25091 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:45.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.234+0000 7f5539235740 20 client.25091 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:45.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.234+0000 7f5539235740 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e75ea92220 0x55e75eaff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:45.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.234+0000 7f5539235740 4 client.25091 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:08:45.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.234+0000 7f5539235740 1 -- 172.21.15.123:0/1362926608 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e75e9dc400 con 0x55e75ea92220 2024-08-18T22:08:45.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.234+0000 7f5534bd3640 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e75ea92220 0x55e75eaff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:45.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.234+0000 7f550ffff640 10 client.25091 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:45.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.234+0000 7f5534bd3640 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e75ea92220 0x55e75eaff6b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aff4151fc3603ced server_cookie=fc36105391ff8920 in_seq=0 out_seq=0 2024-08-18T22:08:45.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.235+0000 7f550ffff640 1 -- 172.21.15.123:0/1362926608 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e75e9dc400 con 0x55e75ea92220 2024-08-18T22:08:45.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.235+0000 7f550ffff640 10 client.25091 handle_command_reply: tid=0 2024-08-18T22:08:45.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.235+0000 7f5539235740 1 client.25091 shutdown 2024-08-18T22:08:45.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.235+0000 7f5539235740 1 -- 172.21.15.123:0/1362926608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea6fb30 msgr2=0x55e75ea863b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:45.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.235+0000 7f5539235740 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea6fb30 0x55e75ea863b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f551c012ba0 tx=0x7f551c0046c0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.235+0000 7f5539235740 1 -- 172.21.15.123:0/1362926608 shutdown_connections 2024-08-18T22:08:45.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.235+0000 7f5539235740 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e75ea92220 0x55e75eaff6b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.235+0000 7f5539235740 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e75ea7a3f0 0x55e75ea868f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.235+0000 7f5539235740 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e75ea6fb30 0x55e75ea863b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.235+0000 7f5539235740 1 --2- 172.21.15.123:0/1362926608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e75ea6f210 0x55e75ea8b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.235+0000 7f5539235740 1 -- 172.21.15.123:0/1362926608 >> 172.21.15.123:0/1362926608 conn(0x55e75ea6b7a0 msgr2=0x55e75ea78a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:45.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.235+0000 7f550ffff640 0 client.25091 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:45.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.236+0000 7f5539235740 1 -- 172.21.15.123:0/1362926608 shutdown_connections 2024-08-18T22:08:45.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.236+0000 7f5539235740 1 -- 172.21.15.123:0/1362926608 wait complete. 2024-08-18T22:08:45.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.236+0000 7f5539235740 20 client.25091 trim_cache size 0 max 16384 2024-08-18T22:08:45.239 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:08:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-18T22:08:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": { 2024-08-18T22:08:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "fecf0fc9-277a-42ef-8926-8ee6ff5fdf4b": { 2024-08-18T22:08:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/", 2024-08-18T22:08:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "fecf0fc9-277a-42ef-8926-8ee6ff5fdf4b", 2024-08-18T22:08:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "recursive,force" 2024-08-18T22:08:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:08:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:08:45.239 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:08:45.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.236+0000 7f5536e37640 1 -- 172.21.15.123:0/1988892218 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f55200a2c00 msgr2=0x7f55200a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:45.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.236+0000 7f5536e37640 1 --2- 172.21.15.123:0/1988892218 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f55200a2c00 0x7f55200a50c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5524009b60 tx=0x7f5524005f90 comp rx=0 tx=0).stop 2024-08-18T22:08:45.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.237+0000 7f5536e37640 1 -- 172.21.15.123:0/1988892218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5530102c20 msgr2=0x7f553019cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:45.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.237+0000 7f5536e37640 1 --2- 172.21.15.123:0/1988892218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5530102c20 0x7f553019cae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5528005cc0 tx=0x7f552802f3a0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.237+0000 7f5536e37640 1 -- 172.21.15.123:0/1988892218 shutdown_connections 2024-08-18T22:08:45.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.237+0000 7f5536e37640 1 --2- 172.21.15.123:0/1988892218 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f55200a2c00 0x7f55200a50c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.237+0000 7f5536e37640 1 --2- 172.21.15.123:0/1988892218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5530102c20 0x7f553019cae0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.237+0000 7f5536e37640 1 --2- 172.21.15.123:0/1988892218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55301022a0 0x7f5530198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.237+0000 7f5536e37640 1 --2- 172.21.15.123:0/1988892218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5530100b50 0x7f5530198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:45.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.237+0000 7f5536e37640 1 -- 172.21.15.123:0/1988892218 >> 172.21.15.123:0/1988892218 conn(0x7f55300fc500 msgr2=0x7f55301065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:45.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.237+0000 7f5536e37640 1 -- 172.21.15.123:0/1988892218 shutdown_connections 2024-08-18T22:08:45.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:08:45.237+0000 7f5536e37640 1 -- 172.21.15.123:0/1988892218 wait complete. 2024-08-18T22:08:46.088 INFO:tasks.cephfs.filesystem:scrub status for tag:fecf0fc9-277a-42ef-8926-8ee6ff5fdf4b - {'path': '/', 'tag': 'fecf0fc9-277a-42ef-8926-8ee6ff5fdf4b', 'options': 'recursive,force'} 2024-08-18T22:08:46.553 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.552+0000 7f0256042640 1 -- 172.21.15.123:0/2412300549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0250102320 msgr2=0x7f0250108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:46.553 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.552+0000 7f0256042640 1 --2- 172.21.15.123:0/2412300549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0250102320 0x7f0250108bb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0248009ca0 tx=0x7f024802a8c0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.552+0000 7f0256042640 1 -- 172.21.15.123:0/2412300549 shutdown_connections 2024-08-18T22:08:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.552+0000 7f0256042640 1 --2- 172.21.15.123:0/2412300549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0250102320 0x7f0250108bb0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.552+0000 7f0256042640 1 --2- 172.21.15.123:0/2412300549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0250101960 0x7f0250101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.552+0000 7f0256042640 1 --2- 172.21.15.123:0/2412300549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0250100770 0x7f0250100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.552+0000 7f0256042640 1 -- 172.21.15.123:0/2412300549 >> 172.21.15.123:0/2412300549 conn(0x7f02500fbf10 msgr2=0x7f02500fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.552+0000 7f0256042640 1 -- 172.21.15.123:0/2412300549 shutdown_connections 2024-08-18T22:08:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.552+0000 7f0256042640 1 -- 172.21.15.123:0/2412300549 wait complete. 2024-08-18T22:08:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.553+0000 7f0256042640 1 Processor -- start 2024-08-18T22:08:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.553+0000 7f0256042640 1 -- start start 2024-08-18T22:08:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.553+0000 7f0256042640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0250100770 0x7f0250104700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.553+0000 7f0256042640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0250101960 0x7f0250102d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.553+0000 7f0256042640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0250102320 0x7f0250103280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.553+0000 7f0256042640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f025010c3f0 con 0x7f0250102320 2024-08-18T22:08:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.553+0000 7f0256042640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f025010c270 con 0x7f0250100770 2024-08-18T22:08:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.553+0000 7f0256042640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f025010c570 con 0x7f0250101960 2024-08-18T22:08:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.553+0000 7f024ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0250102320 0x7f0250103280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.553+0000 7f024ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0250102320 0x7f0250103280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40332/0 (socket says 172.21.15.123:40332) 2024-08-18T22:08:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.553+0000 7f024ffff640 1 -- 172.21.15.123:0/481725053 learned_addr learned my addr 172.21.15.123:0/481725053 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.553+0000 7f024effd640 1 --2- 172.21.15.123:0/481725053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0250101960 0x7f0250102d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.553+0000 7f024f7fe640 1 --2- 172.21.15.123:0/481725053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0250100770 0x7f0250104700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.553+0000 7f024ffff640 1 -- 172.21.15.123:0/481725053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0250101960 msgr2=0x7f0250102d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.553+0000 7f024ffff640 1 --2- 172.21.15.123:0/481725053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0250101960 0x7f0250102d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.554+0000 7f024ffff640 1 -- 172.21.15.123:0/481725053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0250100770 msgr2=0x7f0250104700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.554+0000 7f024ffff640 1 --2- 172.21.15.123:0/481725053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0250100770 0x7f0250104700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.554+0000 7f024ffff640 1 -- 172.21.15.123:0/481725053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0250103b10 con 0x7f0250102320 2024-08-18T22:08:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.554+0000 7f024f7fe640 1 --2- 172.21.15.123:0/481725053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0250100770 0x7f0250104700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.554+0000 7f024ffff640 1 --2- 172.21.15.123:0/481725053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0250102320 0x7f0250103280 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f024802f540 tx=0x7f024802f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.554+0000 7f024cff9640 1 -- 172.21.15.123:0/481725053 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024802fc40 con 0x7f0250102320 2024-08-18T22:08:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.554+0000 7f0256042640 1 -- 172.21.15.123:0/481725053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02501a1a00 con 0x7f0250102320 2024-08-18T22:08:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.554+0000 7f024cff9640 1 -- 172.21.15.123:0/481725053 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0248003e50 con 0x7f0250102320 2024-08-18T22:08:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.554+0000 7f024cff9640 1 -- 172.21.15.123:0/481725053 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02480305c0 con 0x7f0250102320 2024-08-18T22:08:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.554+0000 7f0256042640 1 -- 172.21.15.123:0/481725053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02501a1fa0 con 0x7f0250102320 2024-08-18T22:08:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.557+0000 7f024cff9640 1 -- 172.21.15.123:0/481725053 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f0248003970 con 0x7f0250102320 2024-08-18T22:08:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.558+0000 7f0258e00740 1 Processor -- start 2024-08-18T22:08:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.558+0000 7f0258e00740 1 -- start start 2024-08-18T22:08:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.558+0000 7f0258e00740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9ac680 0x55f38f9aca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.558+0000 7f0258e00740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.558+0000 7f0258e00740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9b2050 0x55f38f9b4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.558+0000 7f0258e00740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f38f90f9d0 con 0x55f38f9acfc0 2024-08-18T22:08:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.558+0000 7f0258e00740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f38f8b7820 con 0x55f38f9ac680 2024-08-18T22:08:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.558+0000 7f0258e00740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f38f90b990 con 0x55f38f9b2050 2024-08-18T22:08:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.558+0000 7f024cff9640 1 --2- 172.21.15.123:0/481725053 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f02380a2cb0 0x7f02380a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.559+0000 7f024cff9640 1 -- 172.21.15.123:0/481725053 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f02480f0780 con 0x7f0250102320 2024-08-18T22:08:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.559+0000 7f024ffff640 1 --2- 172.21.15.123:0/481725053 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f02380a2cb0 0x7f02380a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.559+0000 7f024f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.559+0000 7f024f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40336/0 (socket says 172.21.15.123:40336) 2024-08-18T22:08:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.559+0000 7f024f7fe640 1 -- 172.21.15.123:0/253288993 learned_addr learned my addr 172.21.15.123:0/253288993 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:46.561 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.559+0000 7f024effd640 1 --2- 172.21.15.123:0/253288993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9ac680 0x55f38f9aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.561 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.559+0000 7f024effd640 1 --2- 172.21.15.123:0/253288993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9b2050 0x55f38f9b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.561 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.559+0000 7f024ffff640 1 --2- 172.21.15.123:0/481725053 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f02380a2cb0 0x7f02380a5170 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f024802f890 tx=0x7f024803d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:46.561 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.559+0000 7f024f7fe640 1 -- 172.21.15.123:0/253288993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9b2050 msgr2=0x55f38f9b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:46.562 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.559+0000 7f024f7fe640 1 --2- 172.21.15.123:0/253288993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9b2050 0x55f38f9b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.562 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.559+0000 7f024f7fe640 1 -- 172.21.15.123:0/253288993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9ac680 msgr2=0x55f38f9aca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:46.562 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.559+0000 7f024f7fe640 1 --2- 172.21.15.123:0/253288993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9ac680 0x55f38f9aca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.562 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.559+0000 7f024f7fe640 1 -- 172.21.15.123:0/253288993 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f38f623210 con 0x55f38f9acfc0 2024-08-18T22:08:46.562 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.560+0000 7f024f7fe640 1 --2- 172.21.15.123:0/253288993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9b1a80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f024000bd80 tx=0x7f024000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7acba43fb3ec00b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:46.562 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.560+0000 7f0235ffb640 1 -- 172.21.15.123:0/253288993 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240015070 con 0x55f38f9acfc0 2024-08-18T22:08:46.562 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.560+0000 7f0235ffb640 1 -- 172.21.15.123:0/253288993 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0240011920 con 0x55f38f9acfc0 2024-08-18T22:08:46.562 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.560+0000 7f0235ffb640 1 -- 172.21.15.123:0/253288993 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240010a30 con 0x55f38f9acfc0 2024-08-18T22:08:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.561+0000 7f0258e00740 1 -- 172.21.15.123:0/253288993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 msgr2=0x55f38f9b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.561+0000 7f0258e00740 1 --2- 172.21.15.123:0/253288993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9b1a80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f024000bd80 tx=0x7f024000f730 comp rx=0 tx=0).stop 2024-08-18T22:08:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.561+0000 7f0258e00740 1 -- 172.21.15.123:0/253288993 shutdown_connections 2024-08-18T22:08:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.561+0000 7f0258e00740 1 --2- 172.21.15.123:0/253288993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9b2050 0x55f38f9b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.561+0000 7f0258e00740 1 --2- 172.21.15.123:0/253288993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9b1a80 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.561+0000 7f0258e00740 1 --2- 172.21.15.123:0/253288993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9ac680 0x55f38f9aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.561+0000 7f0258e00740 1 -- 172.21.15.123:0/253288993 >> 172.21.15.123:0/253288993 conn(0x55f38f9a7cf0 msgr2=0x55f38f9a80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.561+0000 7f0258e00740 1 -- 172.21.15.123:0/253288993 shutdown_connections 2024-08-18T22:08:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.561+0000 7f0258e00740 1 -- 172.21.15.123:0/253288993 wait complete. 2024-08-18T22:08:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.561+0000 7f0258e00740 1 -- start start 2024-08-18T22:08:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f0258e00740 1 Processor -- start 2024-08-18T22:08:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f0258e00740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9ac680 0x55f38f9b68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f0258e00740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f0258e00740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9b2050 0x55f38f9bde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f0258e00740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f38f9b5020 con 0x55f38f9acfc0 2024-08-18T22:08:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f0258e00740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f38f8cb520 con 0x55f38f9b2050 2024-08-18T22:08:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f0258e00740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f38f9b51a0 con 0x55f38f9ac680 2024-08-18T22:08:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f024effd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9ac680 0x55f38f9b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f0258e00740 10 client.0 _ll_register_callbacks cb 0x55f38f622a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f024effd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9ac680 0x55f38f9b68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:43394/0 (socket says 172.21.15.123:43394) 2024-08-18T22:08:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f024effd640 1 -- 172.21.15.123:0/303968116 learned_addr learned my addr 172.21.15.123:0/303968116 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f024f7fe640 1 --2- 172.21.15.123:0/303968116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f024effd640 1 --2- 172.21.15.123:0/303968116 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9b2050 0x55f38f9bde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f024effd640 1 -- 172.21.15.123:0/303968116 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9b2050 msgr2=0x55f38f9bde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f024effd640 1 --2- 172.21.15.123:0/303968116 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9b2050 0x55f38f9bde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f024effd640 1 -- 172.21.15.123:0/303968116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 msgr2=0x55f38f9b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f024effd640 1 --2- 172.21.15.123:0/303968116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9b6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f024effd640 1 -- 172.21.15.123:0/303968116 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f38f6ef620 con 0x55f38f9ac680 2024-08-18T22:08:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.562+0000 7f024f7fe640 1 --2- 172.21.15.123:0/303968116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.563+0000 7f024effd640 1 --2- 172.21.15.123:0/303968116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9ac680 0x55f38f9b68f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0244004640 tx=0x7f0244014040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d62afa17e66c8fa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.563+0000 7f022effd640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-08-18T22:08:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.563+0000 7f022effd640 1 -- 172.21.15.123:0/303968116 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02440128d0 con 0x55f38f9ac680 2024-08-18T22:08:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.563+0000 7f0258e00740 1 -- 172.21.15.123:0/303968116 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0240011920 con 0x55f38f9ac680 2024-08-18T22:08:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.563+0000 7f022effd640 1 -- 172.21.15.123:0/303968116 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0244012a70 con 0x55f38f9ac680 2024-08-18T22:08:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.563+0000 7f022effd640 1 -- 172.21.15.123:0/303968116 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f024402a050 con 0x55f38f9ac680 2024-08-18T22:08:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.563+0000 7f0258e00740 10 client.25105 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.563+0000 7f0258e00740 1 -- 172.21.15.123:0/303968116 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f38f9c0d80 con 0x55f38f9ac680 2024-08-18T22:08:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.563+0000 7f022effd640 1 -- 172.21.15.123:0/303968116 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0240011920 con 0x55f38f9ac680 2024-08-18T22:08:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.563+0000 7f022effd640 1 -- 172.21.15.123:0/303968116 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f024400f3f0 con 0x55f38f9ac680 2024-08-18T22:08:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.564+0000 7f0258e00740 10 client.25105 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.564+0000 7f0258e00740 10 client.25105 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.564+0000 7f0258e00740 20 client.25105 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.564+0000 7f0258e00740 1 --2- 172.21.15.123:0/303968116 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f38f9c2370 0x55f38f9c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.564+0000 7f0258e00740 4 client.25105 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:08:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.564+0000 7f0258e00740 1 -- 172.21.15.123:0/303968116 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f38f91d100 con 0x55f38f9c2370 2024-08-18T22:08:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.564+0000 7f024f7fe640 1 --2- 172.21.15.123:0/303968116 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f38f9c2370 0x55f38f9c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.564+0000 7f022effd640 10 client.25105 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.564+0000 7f024f7fe640 1 --2- 172.21.15.123:0/303968116 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f38f9c2370 0x55f38f9c47a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=136b145068596657 server_cookie=5b5cf3fef9bb6906 in_seq=0 out_seq=0 2024-08-18T22:08:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.565+0000 7f022effd640 1 -- 172.21.15.123:0/303968116 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f38f91d100 con 0x55f38f9c2370 2024-08-18T22:08:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.565+0000 7f022effd640 10 client.25105 handle_command_reply: tid=0 2024-08-18T22:08:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.565+0000 7f0258e00740 1 client.25105 shutdown 2024-08-18T22:08:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.565+0000 7f0258e00740 1 -- 172.21.15.123:0/303968116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9ac680 msgr2=0x55f38f9b68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.565+0000 7f0258e00740 1 --2- 172.21.15.123:0/303968116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9ac680 0x55f38f9b68f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0244004640 tx=0x7f0244014040 comp rx=0 tx=0).stop 2024-08-18T22:08:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.565+0000 7f0258e00740 1 -- 172.21.15.123:0/303968116 shutdown_connections 2024-08-18T22:08:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.565+0000 7f0258e00740 1 --2- 172.21.15.123:0/303968116 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f38f9c2370 0x55f38f9c47a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.565+0000 7f022effd640 0 client.25105 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.565+0000 7f0258e00740 1 --2- 172.21.15.123:0/303968116 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9b2050 0x55f38f9bde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.565+0000 7f0258e00740 1 --2- 172.21.15.123:0/303968116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.565+0000 7f0258e00740 1 --2- 172.21.15.123:0/303968116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9ac680 0x55f38f9b68f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.565+0000 7f0258e00740 1 -- 172.21.15.123:0/303968116 >> 172.21.15.123:0/303968116 conn(0x55f38f9a7cf0 msgr2=0x55f38f9a9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.565+0000 7f0258e00740 1 -- 172.21.15.123:0/303968116 shutdown_connections 2024-08-18T22:08:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.565+0000 7f0258e00740 1 -- 172.21.15.123:0/303968116 wait complete. 2024-08-18T22:08:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.565+0000 7f0258e00740 20 client.25105 trim_cache size 0 max 16384 2024-08-18T22:08:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f0258e00740 1 Processor -- start 2024-08-18T22:08:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f0258e00740 1 -- start start 2024-08-18T22:08:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f0258e00740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9ac680 0x55f38f9a8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f0258e00740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f0258e00740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9b2050 0x55f38f9a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f0258e00740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f02501aab50 con 0x55f38f9acfc0 2024-08-18T22:08:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f0258e00740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f02501a8420 con 0x55f38f9ac680 2024-08-18T22:08:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f0258e00740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f02501a6270 con 0x55f38f9b2050 2024-08-18T22:08:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f024f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f024f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9bdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40358/0 (socket says 172.21.15.123:40358) 2024-08-18T22:08:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f024f7fe640 1 -- 172.21.15.123:0/3636903797 learned_addr learned my addr 172.21.15.123:0/3636903797 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f024effd640 1 --2- 172.21.15.123:0/3636903797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9ac680 0x55f38f9a8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f024effd640 1 --2- 172.21.15.123:0/3636903797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9b2050 0x55f38f9a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f024f7fe640 1 -- 172.21.15.123:0/3636903797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9b2050 msgr2=0x55f38f9a90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f024f7fe640 1 --2- 172.21.15.123:0/3636903797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9b2050 0x55f38f9a90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f024f7fe640 1 -- 172.21.15.123:0/3636903797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9ac680 msgr2=0x55f38f9a8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f024f7fe640 1 --2- 172.21.15.123:0/3636903797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9ac680 0x55f38f9a8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.580+0000 7f024f7fe640 1 -- 172.21.15.123:0/3636903797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f38f9a7b10 con 0x55f38f9acfc0 2024-08-18T22:08:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.581+0000 7f024f7fe640 1 --2- 172.21.15.123:0/3636903797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9bdd90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f024000bd50 tx=0x7f0240000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51b4fe9d3cc9e9a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.581+0000 7f02357fa640 1 -- 172.21.15.123:0/3636903797 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240015040 con 0x55f38f9acfc0 2024-08-18T22:08:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.581+0000 7f02357fa640 1 -- 172.21.15.123:0/3636903797 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f024003b030 con 0x55f38f9acfc0 2024-08-18T22:08:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.581+0000 7f02357fa640 1 -- 172.21.15.123:0/3636903797 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240004660 con 0x55f38f9acfc0 2024-08-18T22:08:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.582+0000 7f0258e00740 1 -- 172.21.15.123:0/3636903797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 msgr2=0x55f38f9bdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.582+0000 7f0258e00740 1 --2- 172.21.15.123:0/3636903797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9bdd90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f024000bd50 tx=0x7f0240000bc0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.582+0000 7f0258e00740 1 -- 172.21.15.123:0/3636903797 shutdown_connections 2024-08-18T22:08:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.582+0000 7f0258e00740 1 --2- 172.21.15.123:0/3636903797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9b2050 0x55f38f9a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.582+0000 7f0258e00740 1 --2- 172.21.15.123:0/3636903797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9acfc0 0x55f38f9bdd90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.582+0000 7f0258e00740 1 --2- 172.21.15.123:0/3636903797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9ac680 0x55f38f9a8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.582+0000 7f0258e00740 1 -- 172.21.15.123:0/3636903797 >> 172.21.15.123:0/3636903797 conn(0x55f38f9a7cf0 msgr2=0x55f38f9b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.582+0000 7f0258e00740 1 -- 172.21.15.123:0/3636903797 shutdown_connections 2024-08-18T22:08:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.582+0000 7f0258e00740 1 -- 172.21.15.123:0/3636903797 wait complete. 2024-08-18T22:08:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.582+0000 7f0258e00740 1 -- start start 2024-08-18T22:08:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.582+0000 7f0258e00740 1 Processor -- start 2024-08-18T22:08:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.582+0000 7f0258e00740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9ac680 0x55f38f9bb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f0258e00740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9acfc0 0x55f38f9bb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f0258e00740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9b2050 0x55f38f9bc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f0258e00740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f02501a68e0 con 0x55f38f9b2050 2024-08-18T22:08:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f0258e00740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f02501a7d50 con 0x55f38f9ac680 2024-08-18T22:08:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f0258e00740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f02501a6fb0 con 0x55f38f9acfc0 2024-08-18T22:08:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f0258e00740 10 client.0 _ll_register_callbacks cb 0x7f024400bd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f024effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9b2050 0x55f38f9bc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f024effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9b2050 0x55f38f9bc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40374/0 (socket says 172.21.15.123:40374) 2024-08-18T22:08:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f024effd640 1 -- 172.21.15.123:0/75779259 learned_addr learned my addr 172.21.15.123:0/75779259 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f024effd640 1 --2- 172.21.15.123:0/75779259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9ac680 0x55f38f9bb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f024f7fe640 1 --2- 172.21.15.123:0/75779259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9acfc0 0x55f38f9bb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f024effd640 1 -- 172.21.15.123:0/75779259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9acfc0 msgr2=0x55f38f9bb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f024effd640 1 --2- 172.21.15.123:0/75779259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9acfc0 0x55f38f9bb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f024effd640 1 -- 172.21.15.123:0/75779259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9ac680 msgr2=0x55f38f9bb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f024effd640 1 --2- 172.21.15.123:0/75779259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9ac680 0x55f38f9bb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f024effd640 1 -- 172.21.15.123:0/75779259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f38f9bcdc0 con 0x55f38f9b2050 2024-08-18T22:08:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f024effd640 1 --2- 172.21.15.123:0/75779259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9b2050 0x55f38f9bc7b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x55f38f9ba830 tx=0x7f024400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70116f66d10da3f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f022effd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.583+0000 7f022effd640 1 -- 172.21.15.123:0/75779259 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02440041f0 con 0x55f38f9b2050 2024-08-18T22:08:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.584+0000 7f022effd640 1 -- 172.21.15.123:0/75779259 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f024400fb50 con 0x55f38f9b2050 2024-08-18T22:08:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.584+0000 7f0258e00740 1 -- 172.21.15.123:0/75779259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f024003b030 con 0x55f38f9b2050 2024-08-18T22:08:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.584+0000 7f022effd640 1 -- 172.21.15.123:0/75779259 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f024400f620 con 0x55f38f9b2050 2024-08-18T22:08:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.584+0000 7f0258e00740 10 client.15630 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.584+0000 7f0258e00740 1 -- 172.21.15.123:0/75779259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f38f9be0d0 con 0x55f38f9b2050 2024-08-18T22:08:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.584+0000 7f022effd640 1 -- 172.21.15.123:0/75779259 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f024003b030 con 0x55f38f9b2050 2024-08-18T22:08:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.584+0000 7f022effd640 1 -- 172.21.15.123:0/75779259 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f024402e730 con 0x55f38f9b2050 2024-08-18T22:08:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.584+0000 7f0258e00740 10 client.15630 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.584+0000 7f0258e00740 10 client.15630 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.584+0000 7f0258e00740 20 client.15630 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.584+0000 7f0258e00740 1 --2- 172.21.15.123:0/75779259 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f38f9c2370 0x55f38fa2f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.585+0000 7f0258e00740 4 client.15630 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:08:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.585+0000 7f0258e00740 1 -- 172.21.15.123:0/75779259 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f38f917450 con 0x55f38f9c2370 2024-08-18T22:08:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.585+0000 7f024f7fe640 1 --2- 172.21.15.123:0/75779259 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f38f9c2370 0x55f38fa2f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.585+0000 7f022effd640 10 client.15630 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.585+0000 7f024f7fe640 1 --2- 172.21.15.123:0/75779259 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f38f9c2370 0x55f38fa2f770 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95c116d49881bc14 server_cookie=f77b521724ab9149 in_seq=0 out_seq=0 2024-08-18T22:08:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.592+0000 7f022effd640 1 -- 172.21.15.123:0/75779259 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f38f917450 con 0x55f38f9c2370 2024-08-18T22:08:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.592+0000 7f022effd640 10 client.15630 handle_command_reply: tid=0 2024-08-18T22:08:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.592+0000 7f0258e00740 1 client.15630 shutdown 2024-08-18T22:08:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.593+0000 7f0258e00740 1 -- 172.21.15.123:0/75779259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9b2050 msgr2=0x55f38f9bc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.593+0000 7f0258e00740 1 --2- 172.21.15.123:0/75779259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9b2050 0x55f38f9bc7b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x55f38f9ba830 tx=0x7f024400b390 comp rx=0 tx=0).stop 2024-08-18T22:08:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.593+0000 7f0258e00740 1 -- 172.21.15.123:0/75779259 shutdown_connections 2024-08-18T22:08:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.593+0000 7f0258e00740 1 --2- 172.21.15.123:0/75779259 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f38f9c2370 0x55f38fa2f770 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.593+0000 7f022effd640 0 client.15630 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.593+0000 7f0258e00740 1 --2- 172.21.15.123:0/75779259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f38f9b2050 0x55f38f9bc7b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.593+0000 7f0258e00740 1 --2- 172.21.15.123:0/75779259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f38f9acfc0 0x55f38f9bb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.593+0000 7f0258e00740 1 --2- 172.21.15.123:0/75779259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f38f9ac680 0x55f38f9bb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.593+0000 7f0258e00740 1 -- 172.21.15.123:0/75779259 >> 172.21.15.123:0/75779259 conn(0x55f38f9a7cf0 msgr2=0x55f38f9a6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.593+0000 7f0258e00740 1 -- 172.21.15.123:0/75779259 shutdown_connections 2024-08-18T22:08:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.593+0000 7f0258e00740 1 -- 172.21.15.123:0/75779259 wait complete. 2024-08-18T22:08:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.593+0000 7f0258e00740 20 client.15630 trim_cache size 0 max 16384 2024-08-18T22:08:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:08:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:08:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:08:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:08:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.594+0000 7f0256042640 1 -- 172.21.15.123:0/481725053 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f02380a2cb0 msgr2=0x7f02380a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.594+0000 7f0256042640 1 --2- 172.21.15.123:0/481725053 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f02380a2cb0 0x7f02380a5170 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f024802f890 tx=0x7f024803d040 comp rx=0 tx=0).stop 2024-08-18T22:08:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.594+0000 7f0256042640 1 -- 172.21.15.123:0/481725053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0250102320 msgr2=0x7f0250103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.594+0000 7f0256042640 1 --2- 172.21.15.123:0/481725053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0250102320 0x7f0250103280 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f024802f540 tx=0x7f024802f820 comp rx=0 tx=0).stop 2024-08-18T22:08:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.594+0000 7f0256042640 1 -- 172.21.15.123:0/481725053 shutdown_connections 2024-08-18T22:08:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.594+0000 7f0256042640 1 --2- 172.21.15.123:0/481725053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0250102320 0x7f0250103280 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.594+0000 7f0256042640 1 --2- 172.21.15.123:0/481725053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0250101960 0x7f0250102d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.594+0000 7f0256042640 1 --2- 172.21.15.123:0/481725053 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f02380a2cb0 0x7f02380a5170 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.594+0000 7f0256042640 1 --2- 172.21.15.123:0/481725053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0250100770 0x7f0250104700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.594+0000 7f0256042640 1 -- 172.21.15.123:0/481725053 >> 172.21.15.123:0/481725053 conn(0x7f02500fbf10 msgr2=0x7f02500ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.594+0000 7f0256042640 1 -- 172.21.15.123:0/481725053 shutdown_connections 2024-08-18T22:08:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:46.594+0000 7f0256042640 1 -- 172.21.15.123:0/481725053 wait complete. 2024-08-18T22:08:46.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:46 smithi183 ceph-mon[22097]: pgmap v370: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 8 op/s 2024-08-18T22:08:47.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:46 smithi123 ceph-mon[18462]: pgmap v370: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 8 op/s 2024-08-18T22:08:47.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:46 smithi130 ceph-mon[21698]: pgmap v370: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 8 op/s 2024-08-18T22:08:48.816 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:48 smithi130 ceph-mon[21698]: pgmap v371: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-18T22:08:48.816 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:48 smithi130 ceph-mon[21698]: scrub summary: idle 2024-08-18T22:08:48.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:48 smithi183 ceph-mon[22097]: pgmap v371: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-18T22:08:48.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:48 smithi183 ceph-mon[22097]: scrub summary: idle 2024-08-18T22:08:49.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:48 smithi123 ceph-mon[18462]: pgmap v371: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-18T22:08:49.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:48 smithi123 ceph-mon[18462]: scrub summary: idle 2024-08-18T22:08:50.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:50 smithi183 ceph-mon[22097]: pgmap v372: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 853 B/s wr, 10 op/s 2024-08-18T22:08:51.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:50 smithi123 ceph-mon[18462]: pgmap v372: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 853 B/s wr, 10 op/s 2024-08-18T22:08:51.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:50 smithi130 ceph-mon[21698]: pgmap v372: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 853 B/s wr, 10 op/s 2024-08-18T22:08:52.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:52 smithi183 ceph-mon[22097]: pgmap v373: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 8 op/s 2024-08-18T22:08:53.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:52 smithi123 ceph-mon[18462]: pgmap v373: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 8 op/s 2024-08-18T22:08:53.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:52 smithi130 ceph-mon[21698]: pgmap v373: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 8 op/s 2024-08-18T22:08:54.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:54 smithi183 ceph-mon[22097]: pgmap v374: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-18T22:08:55.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:54 smithi123 ceph-mon[18462]: pgmap v374: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-18T22:08:55.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:54 smithi130 ceph-mon[21698]: pgmap v374: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-18T22:08:56.812 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:56 smithi123 ceph-mon[18462]: pgmap v375: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-18T22:08:56.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:56 smithi183 ceph-mon[22097]: pgmap v375: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-18T22:08:57.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:56 smithi130 ceph-mon[21698]: pgmap v375: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-18T22:08:58.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:08:58 smithi123 ceph-mon[18462]: pgmap v376: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-18T22:08:58.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:08:58 smithi183 ceph-mon[22097]: pgmap v376: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-18T22:08:59.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:08:58 smithi130 ceph-mon[21698]: pgmap v376: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-18T22:08:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.712+0000 7f881c36a640 1 -- 172.21.15.123:0/588577817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8814102320 msgr2=0x7f8814108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.712+0000 7f881c36a640 1 --2- 172.21.15.123:0/588577817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8814102320 0x7f8814108bb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f880c009ca0 tx=0x7f880c02a8c0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.713+0000 7f881c36a640 1 -- 172.21.15.123:0/588577817 shutdown_connections 2024-08-18T22:08:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.713+0000 7f881c36a640 1 --2- 172.21.15.123:0/588577817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8814102320 0x7f8814108bb0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.713+0000 7f881c36a640 1 --2- 172.21.15.123:0/588577817 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8814101960 0x7f8814101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.713+0000 7f881c36a640 1 --2- 172.21.15.123:0/588577817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8814100770 0x7f8814100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.713+0000 7f881c36a640 1 -- 172.21.15.123:0/588577817 >> 172.21.15.123:0/588577817 conn(0x7f88140fbf10 msgr2=0x7f88140fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.713+0000 7f881c36a640 1 -- 172.21.15.123:0/588577817 shutdown_connections 2024-08-18T22:08:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.713+0000 7f881c36a640 1 -- 172.21.15.123:0/588577817 wait complete. 2024-08-18T22:08:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.713+0000 7f881c36a640 1 Processor -- start 2024-08-18T22:08:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.713+0000 7f881c36a640 1 -- start start 2024-08-18T22:08:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.713+0000 7f881c36a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8814100770 0x7f8814104690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881c36a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8814101960 0x7f8814102d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881c36a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8814102320 0x7f8814103280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881c36a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f881410c3f0 con 0x7f8814100770 2024-08-18T22:08:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881c36a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f881410c270 con 0x7f8814101960 2024-08-18T22:08:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881c36a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f881410c570 con 0x7f8814102320 2024-08-18T22:08:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881a106640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8814100770 0x7f8814104690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881a106640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8814100770 0x7f8814104690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54244/0 (socket says 172.21.15.123:54244) 2024-08-18T22:08:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881a106640 1 -- 172.21.15.123:0/1636161469 learned_addr learned my addr 172.21.15.123:0/1636161469 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f8819905640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8814101960 0x7f8814102d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881a907640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8814102320 0x7f8814103280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881a106640 1 -- 172.21.15.123:0/1636161469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8814102320 msgr2=0x7f8814103280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881a106640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8814102320 0x7f8814103280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881a106640 1 -- 172.21.15.123:0/1636161469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8814101960 msgr2=0x7f8814102d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881a106640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8814101960 0x7f8814102d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881a106640 1 -- 172.21.15.123:0/1636161469 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8814103aa0 con 0x7f8814100770 2024-08-18T22:08:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881a907640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8814102320 0x7f8814103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f8819905640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8814101960 0x7f8814102d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:08:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881a106640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8814100770 0x7f8814104690 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f881000e9c0 tx=0x7f881000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f880b7fe640 1 -- 172.21.15.123:0/1636161469 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881000cd80 con 0x7f8814100770 2024-08-18T22:08:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.714+0000 7f881c36a640 1 -- 172.21.15.123:0/1636161469 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88141a1c00 con 0x7f8814100770 2024-08-18T22:08:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.715+0000 7f880b7fe640 1 -- 172.21.15.123:0/1636161469 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88100035f0 con 0x7f8814100770 2024-08-18T22:08:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.715+0000 7f880b7fe640 1 -- 172.21.15.123:0/1636161469 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881000cd80 con 0x7f8814100770 2024-08-18T22:08:59.719 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.715+0000 7f881c36a640 1 -- 172.21.15.123:0/1636161469 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88141a21a0 con 0x7f8814100770 2024-08-18T22:08:59.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.717+0000 7f881f1ff740 1 Processor -- start 2024-08-18T22:08:59.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.717+0000 7f881f1ff740 1 -- start start 2024-08-18T22:08:59.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.718+0000 7f881f1ff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9680 0x55f23d8d9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.718+0000 7f881f1ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8d9fc0 0x55f23d8dea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.718+0000 7f881f1ff740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8df050 0x55f23d8e1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.718+0000 7f881f1ff740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f23d83c9d0 con 0x55f23d8df050 2024-08-18T22:08:59.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.718+0000 7f881f1ff740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f23d7e4820 con 0x55f23d8d9fc0 2024-08-18T22:08:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.718+0000 7f881f1ff740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f23d838990 con 0x55f23d8d9680 2024-08-18T22:08:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.718+0000 7f8819905640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8df050 0x55f23d8e1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.718+0000 7f8819905640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8df050 0x55f23d8e1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54254/0 (socket says 172.21.15.123:54254) 2024-08-18T22:08:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.718+0000 7f8819905640 1 -- 172.21.15.123:0/415976545 learned_addr learned my addr 172.21.15.123:0/415976545 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.718+0000 7f881a907640 1 --2- 172.21.15.123:0/415976545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9680 0x55f23d8d9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.718+0000 7f8819905640 1 -- 172.21.15.123:0/415976545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9680 msgr2=0x55f23d8d9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.718+0000 7f8819905640 1 --2- 172.21.15.123:0/415976545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9680 0x55f23d8d9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.718+0000 7f8819905640 1 -- 172.21.15.123:0/415976545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8d9fc0 msgr2=0x55f23d8dea80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T22:08:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.718+0000 7f8819905640 1 --2- 172.21.15.123:0/415976545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8d9fc0 0x55f23d8dea80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.718+0000 7f8819905640 1 -- 172.21.15.123:0/415976545 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f23d550210 con 0x55f23d8df050 2024-08-18T22:08:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.719+0000 7f8819905640 1 --2- 172.21.15.123:0/415976545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8df050 0x55f23d8e1510 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8804009ce0 tx=0x7f88040117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e562492399da0c30 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.719+0000 7f880b7fe640 1 -- 172.21.15.123:0/1636161469 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f88100037a0 con 0x7f8814100770 2024-08-18T22:08:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.719+0000 7f8808bfe640 1 -- 172.21.15.123:0/415976545 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8804012450 con 0x55f23d8df050 2024-08-18T22:08:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.719+0000 7f8808bfe640 1 -- 172.21.15.123:0/415976545 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8804012ad0 con 0x55f23d8df050 2024-08-18T22:08:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.719+0000 7f8808bfe640 1 -- 172.21.15.123:0/415976545 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880400fc30 con 0x55f23d8df050 2024-08-18T22:08:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.720+0000 7f881f1ff740 1 -- 172.21.15.123:0/415976545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8df050 msgr2=0x55f23d8e1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.720+0000 7f881f1ff740 1 --2- 172.21.15.123:0/415976545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8df050 0x55f23d8e1510 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8804009ce0 tx=0x7f88040117b0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.720+0000 7f880b7fe640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f88000a2e40 0x7f88000a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.720+0000 7f880b7fe640 1 -- 172.21.15.123:0/1636161469 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f88100cf4a0 con 0x7f8814100770 2024-08-18T22:08:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.720+0000 7f881a907640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f88000a2e40 0x7f88000a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.720+0000 7f881f1ff740 1 -- 172.21.15.123:0/415976545 shutdown_connections 2024-08-18T22:08:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.720+0000 7f881f1ff740 1 --2- 172.21.15.123:0/415976545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8df050 0x55f23d8e1510 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.720+0000 7f881f1ff740 1 --2- 172.21.15.123:0/415976545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8d9fc0 0x55f23d8dea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.720+0000 7f881f1ff740 1 --2- 172.21.15.123:0/415976545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9680 0x55f23d8d9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.720+0000 7f881f1ff740 1 -- 172.21.15.123:0/415976545 >> 172.21.15.123:0/415976545 conn(0x55f23d8d4cf0 msgr2=0x55f23d8d50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.720+0000 7f881f1ff740 1 -- 172.21.15.123:0/415976545 shutdown_connections 2024-08-18T22:08:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.721+0000 7f881f1ff740 1 -- 172.21.15.123:0/415976545 wait complete. 2024-08-18T22:08:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.721+0000 7f881a907640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f88000a2e40 0x7f88000a5300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f880c006010 tx=0x7f880c005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.721+0000 7f881f1ff740 1 -- start start 2024-08-18T22:08:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.721+0000 7f881f1ff740 1 Processor -- start 2024-08-18T22:08:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.721+0000 7f881f1ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8d9680 0x55f23d8e38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.721+0000 7f881f1ff740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8d9fc0 0x55f23d8e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.721+0000 7f881f1ff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8df050 0x55f23d8eae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.721+0000 7f881f1ff740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f23d8e2020 con 0x55f23d8d9fc0 2024-08-18T22:08:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.721+0000 7f881f1ff740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f23d7f8520 con 0x55f23d8d9680 2024-08-18T22:08:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.721+0000 7f881f1ff740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f23d8e21a0 con 0x55f23d8df050 2024-08-18T22:08:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.722+0000 7f881f1ff740 10 client.0 _ll_register_callbacks cb 0x55f23d54fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.722+0000 7f8819905640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8d9fc0 0x55f23d8e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.722+0000 7f8819905640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8d9fc0 0x55f23d8e3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54266/0 (socket says 172.21.15.123:54266) 2024-08-18T22:08:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.722+0000 7f8819905640 1 -- 172.21.15.123:0/816551709 learned_addr learned my addr 172.21.15.123:0/816551709 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.722+0000 7f881a907640 1 --2- 172.21.15.123:0/816551709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8df050 0x55f23d8eae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.722+0000 7f8819905640 1 -- 172.21.15.123:0/816551709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8df050 msgr2=0x55f23d8eae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.722+0000 7f8819905640 1 --2- 172.21.15.123:0/816551709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8df050 0x55f23d8eae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.722+0000 7f8819905640 1 -- 172.21.15.123:0/816551709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8d9680 msgr2=0x55f23d8e38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.722+0000 7f881a106640 1 --2- 172.21.15.123:0/816551709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8d9680 0x55f23d8e38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.722+0000 7f8819905640 1 --2- 172.21.15.123:0/816551709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8d9680 0x55f23d8e38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.722+0000 7f8819905640 1 -- 172.21.15.123:0/816551709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f23d61c620 con 0x55f23d8d9fc0 2024-08-18T22:08:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.722+0000 7f8819905640 1 --2- 172.21.15.123:0/816551709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8d9fc0 0x55f23d8e3e10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f880401c040 tx=0x7f880400f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c45dab24b1ca8e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.722+0000 7f87fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:08:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.723+0000 7f87fdffb640 1 -- 172.21.15.123:0/816551709 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8804029020 con 0x55f23d8d9fc0 2024-08-18T22:08:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.723+0000 7f87fdffb640 1 -- 172.21.15.123:0/816551709 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f88040127a0 con 0x55f23d8d9fc0 2024-08-18T22:08:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.723+0000 7f881f1ff740 1 -- 172.21.15.123:0/816551709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8804012ad0 con 0x55f23d8d9fc0 2024-08-18T22:08:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.723+0000 7f87fdffb640 1 -- 172.21.15.123:0/816551709 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8804034050 con 0x55f23d8d9fc0 2024-08-18T22:08:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.723+0000 7f881f1ff740 10 client.15642 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.723+0000 7f881f1ff740 1 -- 172.21.15.123:0/816551709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f23d8edc40 con 0x55f23d8d9fc0 2024-08-18T22:08:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.723+0000 7f87fdffb640 1 -- 172.21.15.123:0/816551709 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8804012ad0 con 0x55f23d8d9fc0 2024-08-18T22:08:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.724+0000 7f87fdffb640 1 -- 172.21.15.123:0/816551709 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f88040046c0 con 0x55f23d8d9fc0 2024-08-18T22:08:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.724+0000 7f881f1ff740 10 client.15642 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.724+0000 7f881f1ff740 10 client.15642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.724+0000 7f881f1ff740 20 client.15642 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.724+0000 7f881f1ff740 1 --2- 172.21.15.123:0/816551709 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f23d8ef720 0x55f23d8f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.724+0000 7f881f1ff740 4 client.15642 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:08:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.724+0000 7f881f1ff740 1 -- 172.21.15.123:0/816551709 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f23d84a100 con 0x55f23d8ef720 2024-08-18T22:08:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.724+0000 7f881a106640 1 --2- 172.21.15.123:0/816551709 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f23d8ef720 0x55f23d8f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.724+0000 7f87fdffb640 10 client.15642 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.724+0000 7f881a106640 1 --2- 172.21.15.123:0/816551709 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f23d8ef720 0x55f23d8f1b80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9998d0f99947023 server_cookie=306eb4aba674b10d in_seq=0 out_seq=0 2024-08-18T22:08:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.725+0000 7f87fdffb640 1 -- 172.21.15.123:0/816551709 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f23d84a100 con 0x55f23d8ef720 2024-08-18T22:08:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.725+0000 7f87fdffb640 10 client.15642 handle_command_reply: tid=0 2024-08-18T22:08:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.725+0000 7f881f1ff740 1 client.15642 shutdown 2024-08-18T22:08:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.725+0000 7f881f1ff740 1 -- 172.21.15.123:0/816551709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8d9fc0 msgr2=0x55f23d8e3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.725+0000 7f881f1ff740 1 --2- 172.21.15.123:0/816551709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8d9fc0 0x55f23d8e3e10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f880401c040 tx=0x7f880400f650 comp rx=0 tx=0).stop 2024-08-18T22:08:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.725+0000 7f881f1ff740 1 -- 172.21.15.123:0/816551709 shutdown_connections 2024-08-18T22:08:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.725+0000 7f881f1ff740 1 --2- 172.21.15.123:0/816551709 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f23d8ef720 0x55f23d8f1b80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.725+0000 7f881f1ff740 1 --2- 172.21.15.123:0/816551709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8df050 0x55f23d8eae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.725+0000 7f881f1ff740 1 --2- 172.21.15.123:0/816551709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8d9fc0 0x55f23d8e3e10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.725+0000 7f87fdffb640 0 client.15642 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.725+0000 7f881f1ff740 1 --2- 172.21.15.123:0/816551709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8d9680 0x55f23d8e38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.725+0000 7f881f1ff740 1 -- 172.21.15.123:0/816551709 >> 172.21.15.123:0/816551709 conn(0x55f23d8d4cf0 msgr2=0x55f23d8d6500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.725+0000 7f881f1ff740 1 -- 172.21.15.123:0/816551709 shutdown_connections 2024-08-18T22:08:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.725+0000 7f881f1ff740 1 -- 172.21.15.123:0/816551709 wait complete. 2024-08-18T22:08:59.732 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.725+0000 7f881f1ff740 20 client.15642 trim_cache size 0 max 16384 2024-08-18T22:08:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.740+0000 7f881f1ff740 1 Processor -- start 2024-08-18T22:08:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.740+0000 7f881f1ff740 1 -- start start 2024-08-18T22:08:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.740+0000 7f881f1ff740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8d9680 0x55f23d8d3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.740+0000 7f881f1ff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9fc0 0x55f23d8eae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.740+0000 7f881f1ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8df050 0x55f23d8d60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.740+0000 7f881f1ff740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f88141af000 con 0x55f23d8d9680 2024-08-18T22:08:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.740+0000 7f881f1ff740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f88141ac8d0 con 0x55f23d8df050 2024-08-18T22:08:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.740+0000 7f881f1ff740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f88141aa720 con 0x55f23d8d9fc0 2024-08-18T22:08:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.740+0000 7f881a106640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8d9680 0x55f23d8d3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.740+0000 7f881a106640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8d9680 0x55f23d8d3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54278/0 (socket says 172.21.15.123:54278) 2024-08-18T22:08:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.740+0000 7f881a106640 1 -- 172.21.15.123:0/3557605964 learned_addr learned my addr 172.21.15.123:0/3557605964 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.740+0000 7f8819905640 1 --2- 172.21.15.123:0/3557605964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9fc0 0x55f23d8eae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.740+0000 7f881a907640 1 --2- 172.21.15.123:0/3557605964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8df050 0x55f23d8d60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.741+0000 7f881a106640 1 -- 172.21.15.123:0/3557605964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9fc0 msgr2=0x55f23d8eae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.741+0000 7f881a106640 1 --2- 172.21.15.123:0/3557605964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9fc0 0x55f23d8eae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.741+0000 7f881a106640 1 -- 172.21.15.123:0/3557605964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8df050 msgr2=0x55f23d8d60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.741+0000 7f881a106640 1 --2- 172.21.15.123:0/3557605964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8df050 0x55f23d8d60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.741+0000 7f881a106640 1 -- 172.21.15.123:0/3557605964 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f23d8e2230 con 0x55f23d8d9680 2024-08-18T22:08:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.741+0000 7f881a106640 1 --2- 172.21.15.123:0/3557605964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8d9680 0x55f23d8d3d90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8810097dd0 tx=0x7f88100ccae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b07e26a995da02 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.741+0000 7f87fffff640 1 -- 172.21.15.123:0/3557605964 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88100b3070 con 0x55f23d8d9680 2024-08-18T22:08:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.741+0000 7f87fffff640 1 -- 172.21.15.123:0/3557605964 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88100a45e0 con 0x55f23d8d9680 2024-08-18T22:08:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.741+0000 7f87fffff640 1 -- 172.21.15.123:0/3557605964 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88100cf1b0 con 0x55f23d8d9680 2024-08-18T22:08:59.748 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.742+0000 7f881f1ff740 1 -- 172.21.15.123:0/3557605964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8d9680 msgr2=0x55f23d8d3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:59.748 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.742+0000 7f881f1ff740 1 --2- 172.21.15.123:0/3557605964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8d9680 0x55f23d8d3d90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8810097dd0 tx=0x7f88100ccae0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.748 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.742+0000 7f881f1ff740 1 -- 172.21.15.123:0/3557605964 shutdown_connections 2024-08-18T22:08:59.748 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.742+0000 7f881f1ff740 1 --2- 172.21.15.123:0/3557605964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8df050 0x55f23d8d60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.748 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.742+0000 7f881f1ff740 1 --2- 172.21.15.123:0/3557605964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9fc0 0x55f23d8eae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.748 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.742+0000 7f881f1ff740 1 --2- 172.21.15.123:0/3557605964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8d9680 0x55f23d8d3d90 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.748 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.742+0000 7f881f1ff740 1 -- 172.21.15.123:0/3557605964 >> 172.21.15.123:0/3557605964 conn(0x55f23d8d4cf0 msgr2=0x55f23d8d3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:59.748 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.742+0000 7f881f1ff740 1 -- 172.21.15.123:0/3557605964 shutdown_connections 2024-08-18T22:08:59.748 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.742+0000 7f881f1ff740 1 -- 172.21.15.123:0/3557605964 wait complete. 2024-08-18T22:08:59.748 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.742+0000 7f881f1ff740 1 -- start start 2024-08-18T22:08:59.748 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.743+0000 7f881f1ff740 1 Processor -- start 2024-08-18T22:08:59.748 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.743+0000 7f881f1ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8d9680 0x55f23d8e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.743+0000 7f881f1ff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9fc0 0x55f23d8e7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.743+0000 7f881f1ff740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8df050 0x55f23d958450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.743+0000 7f881f1ff740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f88141aad90 con 0x55f23d8df050 2024-08-18T22:08:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.743+0000 7f881a907640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8df050 0x55f23d958450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.743+0000 7f881a907640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8df050 0x55f23d958450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54290/0 (socket says 172.21.15.123:54290) 2024-08-18T22:08:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.743+0000 7f881a907640 1 -- 172.21.15.123:0/772091759 learned_addr learned my addr 172.21.15.123:0/772091759 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:08:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.743+0000 7f881f1ff740 1 -- 172.21.15.123:0/772091759 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f88141ac200 con 0x55f23d8d9680 2024-08-18T22:08:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.743+0000 7f881f1ff740 1 -- 172.21.15.123:0/772091759 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f88141ab460 con 0x55f23d8d9fc0 2024-08-18T22:08:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.743+0000 7f881a106640 1 --2- 172.21.15.123:0/772091759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8d9680 0x55f23d8e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.743+0000 7f881f1ff740 10 client.0 _ll_register_callbacks cb 0x7f8810005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:08:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.743+0000 7f881a106640 1 -- 172.21.15.123:0/772091759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9fc0 msgr2=0x55f23d8e7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.743+0000 7f8819905640 1 --2- 172.21.15.123:0/772091759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9fc0 0x55f23d8e7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.744+0000 7f881a106640 1 --2- 172.21.15.123:0/772091759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9fc0 0x55f23d8e7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.744+0000 7f881a106640 1 -- 172.21.15.123:0/772091759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8df050 msgr2=0x55f23d958450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:08:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.744+0000 7f881a106640 1 --2- 172.21.15.123:0/772091759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8df050 0x55f23d958450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.744+0000 7f881a106640 1 -- 172.21.15.123:0/772091759 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f23d8eb060 con 0x55f23d8d9680 2024-08-18T22:08:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.744+0000 7f8819905640 1 --2- 172.21.15.123:0/772091759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9fc0 0x55f23d8e7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:08:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.744+0000 7f881a907640 1 --2- 172.21.15.123:0/772091759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8df050 0x55f23d958450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:08:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.744+0000 7f881a106640 1 --2- 172.21.15.123:0/772091759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8d9680 0x55f23d8e7aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8810019000 tx=0x7f8810003e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed5542ffbbf1e1ef server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:08:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.744+0000 7f87fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:08:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.744+0000 7f87fdffb640 1 -- 172.21.15.123:0/772091759 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88100b8070 con 0x55f23d8d9680 2024-08-18T22:08:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.744+0000 7f881f1ff740 1 -- 172.21.15.123:0/772091759 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88100a45e0 con 0x55f23d8d9680 2024-08-18T22:08:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.744+0000 7f87fdffb640 1 -- 172.21.15.123:0/772091759 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f88100ba2c0 con 0x55f23d8d9680 2024-08-18T22:08:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.744+0000 7f87fdffb640 1 -- 172.21.15.123:0/772091759 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f88100b3040 con 0x55f23d8d9680 2024-08-18T22:08:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.744+0000 7f881f1ff740 10 client.25121 fetch_fsmap learned FSMap version 26 2024-08-18T22:08:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.744+0000 7f881f1ff740 1 -- 172.21.15.123:0/772091759 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f23d959890 con 0x55f23d8d9680 2024-08-18T22:08:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.744+0000 7f87fdffb640 1 -- 172.21.15.123:0/772091759 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88100a45e0 con 0x55f23d8d9680 2024-08-18T22:08:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.745+0000 7f87fdffb640 1 -- 172.21.15.123:0/772091759 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f88100b4c00 con 0x55f23d8d9680 2024-08-18T22:08:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.745+0000 7f881f1ff740 10 client.25121 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:08:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.745+0000 7f881f1ff740 10 client.25121 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:08:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.745+0000 7f881f1ff740 20 client.25121 populate_metadata read hostname 'smithi123' 2024-08-18T22:08:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.745+0000 7f881f1ff740 1 --2- 172.21.15.123:0/772091759 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f23d95a0b0 0x55f23d95c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:08:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.745+0000 7f881f1ff740 4 client.25121 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:08:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.745+0000 7f881f1ff740 1 -- 172.21.15.123:0/772091759 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f23d844450 con 0x55f23d95a0b0 2024-08-18T22:08:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.745+0000 7f8819905640 1 --2- 172.21.15.123:0/772091759 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f23d95a0b0 0x55f23d95c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:08:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.746+0000 7f87fdffb640 10 client.25121 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.746+0000 7f8819905640 1 --2- 172.21.15.123:0/772091759 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f23d95a0b0 0x55f23d95c4d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bc937ab1fa748a4 server_cookie=2b231365eb117d08 in_seq=0 out_seq=0 2024-08-18T22:08:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.750+0000 7f87fdffb640 1 -- 172.21.15.123:0/772091759 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f23d844450 con 0x55f23d95a0b0 2024-08-18T22:08:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.750+0000 7f87fdffb640 10 client.25121 handle_command_reply: tid=0 2024-08-18T22:08:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.750+0000 7f881f1ff740 1 client.25121 shutdown 2024-08-18T22:08:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.750+0000 7f881f1ff740 1 -- 172.21.15.123:0/772091759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8d9680 msgr2=0x55f23d8e7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.750+0000 7f881f1ff740 1 --2- 172.21.15.123:0/772091759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8d9680 0x55f23d8e7aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8810019000 tx=0x7f8810003e50 comp rx=0 tx=0).stop 2024-08-18T22:08:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.750+0000 7f881f1ff740 1 -- 172.21.15.123:0/772091759 shutdown_connections 2024-08-18T22:08:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.750+0000 7f881f1ff740 1 --2- 172.21.15.123:0/772091759 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f23d95a0b0 0x55f23d95c4d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.750+0000 7f881f1ff740 1 --2- 172.21.15.123:0/772091759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f23d8df050 0x55f23d958450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.750+0000 7f881f1ff740 1 --2- 172.21.15.123:0/772091759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f23d8d9fc0 0x55f23d8e7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.750+0000 7f881f1ff740 1 --2- 172.21.15.123:0/772091759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f23d8d9680 0x55f23d8e7aa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.750+0000 7f881f1ff740 1 -- 172.21.15.123:0/772091759 >> 172.21.15.123:0/772091759 conn(0x55f23d8d4cf0 msgr2=0x55f23d8d3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.750+0000 7f87fdffb640 0 client.25121 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:08:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.750+0000 7f881f1ff740 1 -- 172.21.15.123:0/772091759 shutdown_connections 2024-08-18T22:08:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.750+0000 7f881f1ff740 1 -- 172.21.15.123:0/772091759 wait complete. 2024-08-18T22:08:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.750+0000 7f881f1ff740 20 client.25121 trim_cache size 0 max 16384 2024-08-18T22:08:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:08:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:08:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:08:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:08:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.751+0000 7f881c36a640 1 -- 172.21.15.123:0/1636161469 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f88000a2e40 msgr2=0x7f88000a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.751+0000 7f881c36a640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f88000a2e40 0x7f88000a5300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f880c006010 tx=0x7f880c005c50 comp rx=0 tx=0).stop 2024-08-18T22:08:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.751+0000 7f881c36a640 1 -- 172.21.15.123:0/1636161469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8814100770 msgr2=0x7f8814104690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:08:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.751+0000 7f881c36a640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8814100770 0x7f8814104690 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f881000e9c0 tx=0x7f881000ee80 comp rx=0 tx=0).stop 2024-08-18T22:08:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.751+0000 7f881c36a640 1 -- 172.21.15.123:0/1636161469 shutdown_connections 2024-08-18T22:08:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.751+0000 7f881c36a640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8814102320 0x7f8814103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.751+0000 7f881c36a640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f88000a2e40 0x7f88000a5300 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.751+0000 7f881c36a640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8814101960 0x7f8814102d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.751+0000 7f881c36a640 1 --2- 172.21.15.123:0/1636161469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8814100770 0x7f8814104690 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:08:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.751+0000 7f881c36a640 1 -- 172.21.15.123:0/1636161469 >> 172.21.15.123:0/1636161469 conn(0x7f88140fbf10 msgr2=0x7f88140fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:08:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.751+0000 7f881c36a640 1 -- 172.21.15.123:0/1636161469 shutdown_connections 2024-08-18T22:08:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:08:59.751+0000 7f881c36a640 1 -- 172.21.15.123:0/1636161469 wait complete. 2024-08-18T22:09:00.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:00 smithi183 ceph-mon[22097]: pgmap v377: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-18T22:09:01.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:00 smithi123 ceph-mon[18462]: pgmap v377: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-18T22:09:01.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:00 smithi130 ceph-mon[21698]: pgmap v377: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-18T22:09:02.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:02 smithi183 ceph-mon[22097]: pgmap v378: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:09:03.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:02 smithi123 ceph-mon[18462]: pgmap v378: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:09:03.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:02 smithi130 ceph-mon[21698]: pgmap v378: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:09:03.233 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:09:03.499 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:09:03.829 INFO:tasks.workunit.client.0.smithi123.stderr:Updating files: 97% (12502/12849) Updating files: 98% (12593/12849) Updating files: 99% (12721/12849) Updating files: 100% (12849/12849) Updating files: 100% (12849/12849), done. 2024-08-18T22:09:03.854 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:03 smithi123 ceph-mon[18462]: pgmap v379: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-08-18T22:09:03.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:03 smithi183 ceph-mon[22097]: pgmap v379: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-08-18T22:09:04.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:03 smithi130 ceph-mon[21698]: pgmap v379: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-08-18T22:09:04.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.081+0000 7fa57cf10640 1 -- 172.21.15.123:0/158193126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa578103490 msgr2=0x7fa5781078d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:04.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.081+0000 7fa57cf10640 1 --2- 172.21.15.123:0/158193126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa578103490 0x7fa5781078d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa568009930 tx=0x7fa56802a420 comp rx=0 tx=0).stop 2024-08-18T22:09:04.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.081+0000 7fa57cf10640 1 -- 172.21.15.123:0/158193126 shutdown_connections 2024-08-18T22:09:04.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.081+0000 7fa57cf10640 1 --2- 172.21.15.123:0/158193126 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa578108010 0x7fa57810e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:04.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.081+0000 7fa57cf10640 1 --2- 172.21.15.123:0/158193126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa578103490 0x7fa5781078d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:04.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.081+0000 7fa57cf10640 1 --2- 172.21.15.123:0/158193126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa578102ae0 0x7fa578102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:04.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.081+0000 7fa57cf10640 1 -- 172.21.15.123:0/158193126 >> 172.21.15.123:0/158193126 conn(0x7fa5780fc500 msgr2=0x7fa5780fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:04.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.081+0000 7fa57cf10640 1 -- 172.21.15.123:0/158193126 shutdown_connections 2024-08-18T22:09:04.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.081+0000 7fa57cf10640 1 -- 172.21.15.123:0/158193126 wait complete. 2024-08-18T22:09:04.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa57cf10640 1 Processor -- start 2024-08-18T22:09:04.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa57cf10640 1 -- start start 2024-08-18T22:09:04.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa57cf10640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa578102ae0 0x7fa578100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa57cf10640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa578103490 0x7fa578100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa57cf10640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa578108010 0x7fa5781011c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa57cf10640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa578111de0 con 0x7fa578108010 2024-08-18T22:09:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa57cf10640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa578111c60 con 0x7fa578102ae0 2024-08-18T22:09:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa57cf10640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa578111f60 con 0x7fa578103490 2024-08-18T22:09:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa576d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa578108010 0x7fa5781011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa576d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa578108010 0x7fa5781011c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51180/0 (socket says 172.21.15.123:51180) 2024-08-18T22:09:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa576d9d640 1 -- 172.21.15.123:0/2399598877 learned_addr learned my addr 172.21.15.123:0/2399598877 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa57659c640 1 --2- 172.21.15.123:0/2399598877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa578102ae0 0x7fa578100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa575d9b640 1 --2- 172.21.15.123:0/2399598877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa578103490 0x7fa578100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa576d9d640 1 -- 172.21.15.123:0/2399598877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa578103490 msgr2=0x7fa578100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa576d9d640 1 --2- 172.21.15.123:0/2399598877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa578103490 0x7fa578100c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa576d9d640 1 -- 172.21.15.123:0/2399598877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa578102ae0 msgr2=0x7fa578100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa576d9d640 1 --2- 172.21.15.123:0/2399598877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa578102ae0 0x7fa578100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.082+0000 7fa576d9d640 1 -- 172.21.15.123:0/2399598877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5781a6790 con 0x7fa578108010 2024-08-18T22:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.083+0000 7fa576d9d640 1 --2- 172.21.15.123:0/2399598877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa578108010 0x7fa5781011c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa57000eaa0 tx=0x7fa57000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.083+0000 7fa5677fe640 1 -- 172.21.15.123:0/2399598877 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57000cdb0 con 0x7fa578108010 2024-08-18T22:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.083+0000 7fa57cf10640 1 -- 172.21.15.123:0/2399598877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5781a6a80 con 0x7fa578108010 2024-08-18T22:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.083+0000 7fa5677fe640 1 -- 172.21.15.123:0/2399598877 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa570005020 con 0x7fa578108010 2024-08-18T22:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.083+0000 7fa5677fe640 1 -- 172.21.15.123:0/2399598877 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5700116b0 con 0x7fa578108010 2024-08-18T22:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.083+0000 7fa57cf10640 1 -- 172.21.15.123:0/2399598877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5781a6fe0 con 0x7fa578108010 2024-08-18T22:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.084+0000 7fa57cf10640 1 -- 172.21.15.123:0/2399598877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa578102ec0 con 0x7fa578108010 2024-08-18T22:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.085+0000 7fa5677fe640 1 -- 172.21.15.123:0/2399598877 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fa570005560 con 0x7fa578108010 2024-08-18T22:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.086+0000 7fa5677fe640 1 --2- 172.21.15.123:0/2399598877 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa5600a2c00 0x7fa5600a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.086+0000 7fa57659c640 1 --2- 172.21.15.123:0/2399598877 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa5600a2c00 0x7fa5600a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.086+0000 7fa5677fe640 1 -- 172.21.15.123:0/2399598877 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fa5700cf460 con 0x7fa578108010 2024-08-18T22:09:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.086+0000 7fa57659c640 1 --2- 172.21.15.123:0/2399598877 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa5600a2c00 0x7fa5600a50c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0058c0 tx=0x7fa56c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.090+0000 7fa5677fe640 1 -- 172.21.15.123:0/2399598877 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa570016030 con 0x7fa578108010 2024-08-18T22:09:04.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.319+0000 7fa57cf10640 1 -- 172.21.15.123:0/2399598877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa578109ff0 con 0x7fa578108010 2024-08-18T22:09:04.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.320+0000 7fa5677fe640 1 -- 172.21.15.123:0/2399598877 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7fa57009b9e0 con 0x7fa578108010 2024-08-18T22:09:04.321 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:09:04.321 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"btime":"2024-08-18T22:07:46:492460+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:07:45.601053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:09:04.322 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 26 2024-08-18T22:09:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.322+0000 7fa57cf10640 1 -- 172.21.15.123:0/2399598877 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa5600a2c00 msgr2=0x7fa5600a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.322+0000 7fa57cf10640 1 --2- 172.21.15.123:0/2399598877 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa5600a2c00 0x7fa5600a50c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0058c0 tx=0x7fa56c00a2d0 comp rx=0 tx=0).stop 2024-08-18T22:09:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.322+0000 7fa57cf10640 1 -- 172.21.15.123:0/2399598877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa578108010 msgr2=0x7fa5781011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.322+0000 7fa57cf10640 1 --2- 172.21.15.123:0/2399598877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa578108010 0x7fa5781011c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa57000eaa0 tx=0x7fa57000ef60 comp rx=0 tx=0).stop 2024-08-18T22:09:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.322+0000 7fa57cf10640 1 -- 172.21.15.123:0/2399598877 shutdown_connections 2024-08-18T22:09:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.322+0000 7fa57cf10640 1 --2- 172.21.15.123:0/2399598877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa578108010 0x7fa5781011c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.322+0000 7fa57cf10640 1 --2- 172.21.15.123:0/2399598877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa578103490 0x7fa578100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.322+0000 7fa57cf10640 1 --2- 172.21.15.123:0/2399598877 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa5600a2c00 0x7fa5600a50c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.322+0000 7fa57cf10640 1 --2- 172.21.15.123:0/2399598877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa578102ae0 0x7fa578100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.322+0000 7fa57cf10640 1 -- 172.21.15.123:0/2399598877 >> 172.21.15.123:0/2399598877 conn(0x7fa5780fc500 msgr2=0x7fa578105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.322+0000 7fa57cf10640 1 -- 172.21.15.123:0/2399598877 shutdown_connections 2024-08-18T22:09:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:04.322+0000 7fa57cf10640 1 -- 172.21.15.123:0/2399598877 wait complete. 2024-08-18T22:09:04.742 INFO:tasks.workunit.client.0.smithi123.stderr:Note: switching to '78215f5a1cf5eaf321d506a66539942e12851f34'. 2024-08-18T22:09:04.742 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-08-18T22:09:04.742 INFO:tasks.workunit.client.0.smithi123.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-18T22:09:04.742 INFO:tasks.workunit.client.0.smithi123.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-18T22:09:04.742 INFO:tasks.workunit.client.0.smithi123.stderr:state without impacting any branches by switching back to a branch. 2024-08-18T22:09:04.742 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-08-18T22:09:04.742 INFO:tasks.workunit.client.0.smithi123.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-18T22:09:04.742 INFO:tasks.workunit.client.0.smithi123.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-18T22:09:04.742 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-08-18T22:09:04.742 INFO:tasks.workunit.client.0.smithi123.stderr: git switch -c 2024-08-18T22:09:04.743 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-08-18T22:09:04.743 INFO:tasks.workunit.client.0.smithi123.stderr:Or undo this operation with: 2024-08-18T22:09:04.743 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-08-18T22:09:04.743 INFO:tasks.workunit.client.0.smithi123.stderr: git switch - 2024-08-18T22:09:04.743 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-08-18T22:09:04.743 INFO:tasks.workunit.client.0.smithi123.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-18T22:09:04.743 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-08-18T22:09:04.743 INFO:tasks.workunit.client.0.smithi123.stderr:HEAD is now at 78215f5a1cf Merge pull request #59291 from zdover23/wip-doc-2024-08-19-backport-59290-to-squid 2024-08-18T22:09:04.747 DEBUG:teuthology.orchestra.run.smithi123:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-18T22:09:04.808 INFO:tasks.workunit.client.0.smithi123.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-18T22:09:04.810 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-18T22:09:04.810 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-18T22:09:04.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:04 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2399598877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:09:05.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:04 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2399598877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:09:05.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:04 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2399598877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:09:05.171 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db --set-id 22343c18 --release --await' 2024-08-18T22:09:05.171 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24466 quiesce db --set-id 22343c18 --release --await 2024-08-18T22:09:05.422 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:09:05.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:05 smithi123 ceph-mon[18462]: pgmap v380: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-18T22:09:05.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:05 smithi183 ceph-mon[22097]: pgmap v380: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-18T22:09:06.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:05 smithi130 ceph-mon[21698]: pgmap v380: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-18T22:09:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.959+0000 7fbc2a665640 1 -- 172.21.15.123:0/3491164624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc241007b0 msgr2=0x7fbc24100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.959+0000 7fbc2a665640 1 --2- 172.21.15.123:0/3491164624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc241007b0 0x7fbc24100c10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009930 tx=0x7fbc1802a420 comp rx=0 tx=0).stop 2024-08-18T22:09:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.959+0000 7fbc2a665640 1 -- 172.21.15.123:0/3491164624 shutdown_connections 2024-08-18T22:09:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.959+0000 7fbc2a665640 1 --2- 172.21.15.123:0/3491164624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc24101150 0x7fbc2410d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.959+0000 7fbc2a665640 1 --2- 172.21.15.123:0/3491164624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc241007b0 0x7fbc24100c10 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.959+0000 7fbc2a665640 1 --2- 172.21.15.123:0/3491164624 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc241067b0 0x7fbc24106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.959+0000 7fbc2a665640 1 -- 172.21.15.123:0/3491164624 >> 172.21.15.123:0/3491164624 conn(0x7fbc240fc4d0 msgr2=0x7fbc240fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.959+0000 7fbc2a665640 1 -- 172.21.15.123:0/3491164624 shutdown_connections 2024-08-18T22:09:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.959+0000 7fbc2a665640 1 -- 172.21.15.123:0/3491164624 wait complete. 2024-08-18T22:09:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.960+0000 7fbc2a665640 1 Processor -- start 2024-08-18T22:09:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.960+0000 7fbc2a665640 1 -- start start 2024-08-18T22:09:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.960+0000 7fbc2a665640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc241007b0 0x7fbc24198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.960+0000 7fbc2a665640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc24101150 0x7fbc24199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.960+0000 7fbc2a665640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc241067b0 0x7fbc241a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.960+0000 7fbc2a665640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbc24110b70 con 0x7fbc241007b0 2024-08-18T22:09:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.960+0000 7fbc2a665640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbc241109f0 con 0x7fbc24101150 2024-08-18T22:09:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.960+0000 7fbc2a665640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbc24110cf0 con 0x7fbc241067b0 2024-08-18T22:09:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.960+0000 7fbc23fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc241007b0 0x7fbc24198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.960+0000 7fbc23fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc241007b0 0x7fbc24198fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51206/0 (socket says 172.21.15.123:51206) 2024-08-18T22:09:06.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.960+0000 7fbc23fff640 1 -- 172.21.15.123:0/471033797 learned_addr learned my addr 172.21.15.123:0/471033797 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:06.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.961+0000 7fbc237fe640 1 --2- 172.21.15.123:0/471033797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc24101150 0x7fbc24199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.961+0000 7fbc28c02640 1 --2- 172.21.15.123:0/471033797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc241067b0 0x7fbc241a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.961+0000 7fbc23fff640 1 -- 172.21.15.123:0/471033797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc241067b0 msgr2=0x7fbc241a4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:06.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.961+0000 7fbc23fff640 1 --2- 172.21.15.123:0/471033797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc241067b0 0x7fbc241a4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.961+0000 7fbc23fff640 1 -- 172.21.15.123:0/471033797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc24101150 msgr2=0x7fbc24199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:06.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.961+0000 7fbc23fff640 1 --2- 172.21.15.123:0/471033797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc24101150 0x7fbc24199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.961+0000 7fbc23fff640 1 -- 172.21.15.123:0/471033797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc241a45a0 con 0x7fbc241007b0 2024-08-18T22:09:06.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.961+0000 7fbc23fff640 1 --2- 172.21.15.123:0/471033797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc241007b0 0x7fbc24198fe0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400c890 tx=0x7fbc1400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:06.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.961+0000 7fbc217fa640 1 -- 172.21.15.123:0/471033797 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc14004220 con 0x7fbc241007b0 2024-08-18T22:09:06.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.961+0000 7fbc217fa640 1 -- 172.21.15.123:0/471033797 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc140043c0 con 0x7fbc241007b0 2024-08-18T22:09:06.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.961+0000 7fbc217fa640 1 -- 172.21.15.123:0/471033797 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc140049e0 con 0x7fbc241007b0 2024-08-18T22:09:06.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.961+0000 7fbc2a665640 1 -- 172.21.15.123:0/471033797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc241a4770 con 0x7fbc241007b0 2024-08-18T22:09:06.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.961+0000 7fbc2a665640 1 -- 172.21.15.123:0/471033797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc241a4c80 con 0x7fbc241007b0 2024-08-18T22:09:06.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.963+0000 7fbc217fa640 1 -- 172.21.15.123:0/471033797 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fbc140079b0 con 0x7fbc241007b0 2024-08-18T22:09:06.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.963+0000 7fbc2ca63740 1 Processor -- start 2024-08-18T22:09:06.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc2ca63740 1 -- start start 2024-08-18T22:09:06.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc2ca63740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011d8cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc2ca63740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d8d190 0x559011d9ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc2ca63740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d9bf80 0x559011d9e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc2ca63740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559011cf2c60 con 0x559011d8c870 2024-08-18T22:09:06.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc2ca63740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559011c8ab90 con 0x559011d8d190 2024-08-18T22:09:06.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc2ca63740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x559011ceec20 con 0x559011d9bf80 2024-08-18T22:09:06.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc217fa640 1 --2- 172.21.15.123:0/471033797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbc0c0a2c00 0x7fbc0c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc28c02640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011d8cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc28c02640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011d8cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51222/0 (socket says 172.21.15.123:51222) 2024-08-18T22:09:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc28c02640 1 -- 172.21.15.123:0/888000437 learned_addr learned my addr 172.21.15.123:0/888000437 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc28c02640 1 --2- 172.21.15.123:0/471033797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbc0c0a2c00 0x7fbc0c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc23fff640 1 --2- 172.21.15.123:0/888000437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d8d190 0x559011d9ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc217fa640 1 -- 172.21.15.123:0/471033797 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fbc140cf380 con 0x7fbc241007b0 2024-08-18T22:09:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc237fe640 1 --2- 172.21.15.123:0/888000437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d9bf80 0x559011d9e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc28c02640 1 -- 172.21.15.123:0/888000437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d9bf80 msgr2=0x559011d9e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc28c02640 1 --2- 172.21.15.123:0/888000437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d9bf80 0x559011d9e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc28c02640 1 -- 172.21.15.123:0/888000437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d8d190 msgr2=0x559011d9ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc28c02640 1 --2- 172.21.15.123:0/888000437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d8d190 0x559011d9ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.964+0000 7fbc28c02640 1 -- 172.21.15.123:0/888000437 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559011a02580 con 0x559011d8c870 2024-08-18T22:09:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.965+0000 7fbc28c02640 1 --2- 172.21.15.123:0/888000437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011d8cc50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c012d00 tx=0x7fbc1c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791a2206e0f92f7d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.965+0000 7fbc28c02640 1 --2- 172.21.15.123:0/471033797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbc0c0a2c00 0x7fbc0c0a50c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009fd0 tx=0x7fbc1c017000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.965+0000 7fbc0a7fc640 1 -- 172.21.15.123:0/888000437 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c022070 con 0x559011d8c870 2024-08-18T22:09:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.965+0000 7fbc0a7fc640 1 -- 172.21.15.123:0/888000437 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc1c0124f0 con 0x559011d8c870 2024-08-18T22:09:06.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.965+0000 7fbc0a7fc640 1 -- 172.21.15.123:0/888000437 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c005020 con 0x559011d8c870 2024-08-18T22:09:06.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.965+0000 7fbc2ca63740 1 -- 172.21.15.123:0/888000437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 msgr2=0x559011d8cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:06.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.965+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/888000437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011d8cc50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c012d00 tx=0x7fbc1c010740 comp rx=0 tx=0).stop 2024-08-18T22:09:06.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.966+0000 7fbc2ca63740 1 -- 172.21.15.123:0/888000437 shutdown_connections 2024-08-18T22:09:06.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.966+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/888000437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d9bf80 0x559011d9e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.966+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/888000437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d8d190 0x559011d9ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.966+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/888000437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011d8cc50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.966+0000 7fbc2ca63740 1 -- 172.21.15.123:0/888000437 >> 172.21.15.123:0/888000437 conn(0x559011d88f20 msgr2=0x559011d89300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:06.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.966+0000 7fbc2ca63740 1 -- 172.21.15.123:0/888000437 shutdown_connections 2024-08-18T22:09:06.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.966+0000 7fbc2ca63740 1 -- 172.21.15.123:0/888000437 wait complete. 2024-08-18T22:09:06.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.966+0000 7fbc2ca63740 1 -- start start 2024-08-18T22:09:06.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.966+0000 7fbc2ca63740 1 Processor -- start 2024-08-18T22:09:06.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc2ca63740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d8c870 0x559011d98f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc2ca63740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8d190 0x559011d99480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc2ca63740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d9bf80 0x559011d999c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc2ca63740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559011d9eb50 con 0x559011d8d190 2024-08-18T22:09:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc2ca63740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559011c907c0 con 0x559011d8c870 2024-08-18T22:09:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc2ca63740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x559011d9ecd0 con 0x559011d9bf80 2024-08-18T22:09:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc2ca63740 10 client.0 _ll_register_callbacks cb 0x559011c99f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:09:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc237fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8d190 0x559011d99480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc237fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8d190 0x559011d99480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51236/0 (socket says 172.21.15.123:51236) 2024-08-18T22:09:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc237fe640 1 -- 172.21.15.123:0/3287128953 learned_addr learned my addr 172.21.15.123:0/3287128953 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc28c02640 1 --2- 172.21.15.123:0/3287128953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d9bf80 0x559011d999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc23fff640 1 --2- 172.21.15.123:0/3287128953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d8c870 0x559011d98f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc237fe640 1 -- 172.21.15.123:0/3287128953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d9bf80 msgr2=0x559011d999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc237fe640 1 --2- 172.21.15.123:0/3287128953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d9bf80 0x559011d999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc237fe640 1 -- 172.21.15.123:0/3287128953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d8c870 msgr2=0x559011d98f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc237fe640 1 --2- 172.21.15.123:0/3287128953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d8c870 0x559011d98f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc237fe640 1 -- 172.21.15.123:0/3287128953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559011acc960 con 0x559011d8d190 2024-08-18T22:09:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc237fe640 1 --2- 172.21.15.123:0/3287128953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8d190 0x559011d99480 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009930 tx=0x7fbc180319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9359c8938b4619 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc037fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:09:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc037fe640 1 -- 172.21.15.123:0/3287128953 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc18035040 con 0x559011d8d190 2024-08-18T22:09:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc037fe640 1 -- 172.21.15.123:0/3287128953 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fbc18004240 con 0x559011d8d190 2024-08-18T22:09:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3287128953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc1c0124f0 con 0x559011d8d190 2024-08-18T22:09:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc037fe640 1 -- 172.21.15.123:0/3287128953 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbc1804e050 con 0x559011d8d190 2024-08-18T22:09:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc2ca63740 10 client.15666 fetch_fsmap learned FSMap version 26 2024-08-18T22:09:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.967+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3287128953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559011daac80 con 0x559011d8d190 2024-08-18T22:09:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.968+0000 7fbc037fe640 1 -- 172.21.15.123:0/3287128953 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc1c0124f0 con 0x559011d8d190 2024-08-18T22:09:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.968+0000 7fbc037fe640 1 -- 172.21.15.123:0/3287128953 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fbc18004a90 con 0x559011d8d190 2024-08-18T22:09:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.968+0000 7fbc2ca63740 10 client.15666 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:09:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.968+0000 7fbc2ca63740 10 client.15666 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:09:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.968+0000 7fbc2ca63740 20 client.15666 populate_metadata read hostname 'smithi123' 2024-08-18T22:09:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.968+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/3287128953 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559011dac140 0x559011dae550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.968+0000 7fbc2ca63740 4 client.15666 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:09:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.968+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3287128953 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559011d001d0 con 0x559011dac140 2024-08-18T22:09:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.968+0000 7fbc23fff640 1 --2- 172.21.15.123:0/3287128953 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559011dac140 0x559011dae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.968+0000 7fbc23fff640 1 --2- 172.21.15.123:0/3287128953 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559011dac140 0x559011dae550 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46d106deeef168b3 server_cookie=a460dedd160e38af in_seq=0 out_seq=0 2024-08-18T22:09:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.968+0000 7fbc037fe640 10 client.15666 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.969+0000 7fbc037fe640 1 -- 172.21.15.123:0/3287128953 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559011d001d0 con 0x559011dac140 2024-08-18T22:09:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.969+0000 7fbc037fe640 10 client.15666 handle_command_reply: tid=0 2024-08-18T22:09:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.969+0000 7fbc2ca63740 1 client.15666 shutdown 2024-08-18T22:09:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.969+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3287128953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8d190 msgr2=0x559011d99480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.969+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/3287128953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8d190 0x559011d99480 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009930 tx=0x7fbc180319b0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.969+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3287128953 shutdown_connections 2024-08-18T22:09:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.969+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/3287128953 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559011dac140 0x559011dae550 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.969+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/3287128953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d9bf80 0x559011d999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.969+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/3287128953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8d190 0x559011d99480 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.969+0000 7fbc037fe640 0 client.15666 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.969+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/3287128953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d8c870 0x559011d98f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.969+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3287128953 >> 172.21.15.123:0/3287128953 conn(0x559011d88f20 msgr2=0x559011d8ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.970+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3287128953 shutdown_connections 2024-08-18T22:09:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.970+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3287128953 wait complete. 2024-08-18T22:09:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.970+0000 7fbc2ca63740 20 client.15666 trim_cache size 0 max 16384 2024-08-18T22:09:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.986+0000 7fbc2ca63740 1 Processor -- start 2024-08-18T22:09:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.986+0000 7fbc2ca63740 1 -- start start 2024-08-18T22:09:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.986+0000 7fbc2ca63740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011db3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.986+0000 7fbc2ca63740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d8d190 0x559011db43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.986+0000 7fbc2ca63740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d9bf80 0x559011d961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.986+0000 7fbc2ca63740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbc241af0b0 con 0x559011d8c870 2024-08-18T22:09:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.987+0000 7fbc2ca63740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbc241ac980 con 0x559011d8d190 2024-08-18T22:09:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.987+0000 7fbc2ca63740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbc241aa7d0 con 0x559011d9bf80 2024-08-18T22:09:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.987+0000 7fbc23fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011db3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.987+0000 7fbc23fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011db3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51242/0 (socket says 172.21.15.123:51242) 2024-08-18T22:09:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.987+0000 7fbc23fff640 1 -- 172.21.15.123:0/106757265 learned_addr learned my addr 172.21.15.123:0/106757265 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.987+0000 7fbc23fff640 1 -- 172.21.15.123:0/106757265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d9bf80 msgr2=0x559011d961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.987+0000 7fbc23fff640 1 --2- 172.21.15.123:0/106757265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d9bf80 0x559011d961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.987+0000 7fbc23fff640 1 -- 172.21.15.123:0/106757265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d8d190 msgr2=0x559011db43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.987+0000 7fbc23fff640 1 --2- 172.21.15.123:0/106757265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d8d190 0x559011db43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.987+0000 7fbc23fff640 1 -- 172.21.15.123:0/106757265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559011d97ef0 con 0x559011d8c870 2024-08-18T22:09:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.987+0000 7fbc23fff640 1 --2- 172.21.15.123:0/106757265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011db3e60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbc14005fd0 tx=0x7fbc140cca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f07e1b1c0efe42 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.987+0000 7fbc09ffb640 1 -- 172.21.15.123:0/106757265 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1401d040 con 0x559011d8c870 2024-08-18T22:09:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.987+0000 7fbc09ffb640 1 -- 172.21.15.123:0/106757265 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc1409fca0 con 0x559011d8c870 2024-08-18T22:09:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.987+0000 7fbc09ffb640 1 -- 172.21.15.123:0/106757265 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc14097f60 con 0x559011d8c870 2024-08-18T22:09:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.988+0000 7fbc2ca63740 1 -- 172.21.15.123:0/106757265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 msgr2=0x559011db3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.988+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/106757265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011db3e60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbc14005fd0 tx=0x7fbc140cca60 comp rx=0 tx=0).stop 2024-08-18T22:09:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.988+0000 7fbc2ca63740 1 -- 172.21.15.123:0/106757265 shutdown_connections 2024-08-18T22:09:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.988+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/106757265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d9bf80 0x559011d961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.988+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/106757265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d8d190 0x559011db43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.988+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/106757265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011db3e60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.988+0000 7fbc2ca63740 1 -- 172.21.15.123:0/106757265 >> 172.21.15.123:0/106757265 conn(0x559011d88f20 msgr2=0x559011d9afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.988+0000 7fbc2ca63740 1 -- 172.21.15.123:0/106757265 shutdown_connections 2024-08-18T22:09:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.988+0000 7fbc2ca63740 1 -- 172.21.15.123:0/106757265 wait complete. 2024-08-18T22:09:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.988+0000 7fbc2ca63740 1 -- start start 2024-08-18T22:09:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.988+0000 7fbc2ca63740 1 Processor -- start 2024-08-18T22:09:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.988+0000 7fbc2ca63740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011da3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.988+0000 7fbc2ca63740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d8d190 0x559011da44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.988+0000 7fbc2ca63740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d9bf80 0x559011da0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc2ca63740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbc241aae40 con 0x559011d8c870 2024-08-18T22:09:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc2ca63740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbc241ac2b0 con 0x559011d9bf80 2024-08-18T22:09:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc2ca63740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbc241ab510 con 0x559011d8d190 2024-08-18T22:09:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc2ca63740 10 client.0 _ll_register_callbacks cb 0x7fbc18031640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:09:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc23fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011da3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc23fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011da3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51254/0 (socket says 172.21.15.123:51254) 2024-08-18T22:09:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc23fff640 1 -- 172.21.15.123:0/3949134248 learned_addr learned my addr 172.21.15.123:0/3949134248 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc28c02640 1 --2- 172.21.15.123:0/3949134248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d9bf80 0x559011da0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc237fe640 1 --2- 172.21.15.123:0/3949134248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d8d190 0x559011da44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc23fff640 1 -- 172.21.15.123:0/3949134248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d8d190 msgr2=0x559011da44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc23fff640 1 --2- 172.21.15.123:0/3949134248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d8d190 0x559011da44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc23fff640 1 -- 172.21.15.123:0/3949134248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d9bf80 msgr2=0x559011da0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc23fff640 1 --2- 172.21.15.123:0/3949134248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d9bf80 0x559011da0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc23fff640 1 -- 172.21.15.123:0/3949134248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559011da0c20 con 0x559011d8c870 2024-08-18T22:09:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc28c02640 1 --2- 172.21.15.123:0/3949134248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d9bf80 0x559011da0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:09:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc237fe640 1 --2- 172.21.15.123:0/3949134248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d8d190 0x559011da44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:09:06.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc23fff640 1 --2- 172.21.15.123:0/3949134248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011da3f70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbc14096390 tx=0x7fbc140054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc888192fa0394d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:06.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc037fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:09:06.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc037fe640 1 -- 172.21.15.123:0/3949134248 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc140b8020 con 0x559011d8c870 2024-08-18T22:09:06.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc037fe640 1 -- 172.21.15.123:0/3949134248 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fbc14007ca0 con 0x559011d8c870 2024-08-18T22:09:06.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3949134248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc1409fca0 con 0x559011d8c870 2024-08-18T22:09:06.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc037fe640 1 -- 172.21.15.123:0/3949134248 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbc1401d070 con 0x559011d8c870 2024-08-18T22:09:06.058 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:09:06.058 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 26, 2024-08-18T22:09:06.059 INFO:teuthology.orchestra.run.smithi123.stdout: "leader": 24466, 2024-08-18T22:09:06.059 INFO:teuthology.orchestra.run.smithi123.stdout: "set_version": 4, 2024-08-18T22:09:06.059 INFO:teuthology.orchestra.run.smithi123.stdout: "sets": { 2024-08-18T22:09:06.059 INFO:teuthology.orchestra.run.smithi123.stdout: "22343c18": { 2024-08-18T22:09:06.059 INFO:teuthology.orchestra.run.smithi123.stdout: "version": 4, 2024-08-18T22:09:06.059 INFO:teuthology.orchestra.run.smithi123.stdout: "age_ref": 0.0, 2024-08-18T22:09:06.059 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:09:06.059 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RELEASED", 2024-08-18T22:09:06.059 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:09:06.059 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:09:06.059 INFO:teuthology.orchestra.run.smithi123.stdout: "timeout": 90.0, 2024-08-18T22:09:06.059 INFO:teuthology.orchestra.run.smithi123.stdout: "expiration": 154.7, 2024-08-18T22:09:06.059 INFO:teuthology.orchestra.run.smithi123.stdout: "members": { 2024-08-18T22:09:06.059 INFO:teuthology.orchestra.run.smithi123.stdout: "file:/": { 2024-08-18T22:09:06.060 INFO:teuthology.orchestra.run.smithi123.stdout: "excluded": false, 2024-08-18T22:09:06.060 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:09:06.060 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RELEASED", 2024-08-18T22:09:06.060 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:09:06.060 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:09:06.060 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:09:06.060 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:09:06.060 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:09:06.060 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:09:06.060 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:09:06.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc2ca63740 10 client.15672 fetch_fsmap learned FSMap version 26 2024-08-18T22:09:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3949134248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559011e178c0 con 0x559011d8c870 2024-08-18T22:09:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.989+0000 7fbc037fe640 1 -- 172.21.15.123:0/3949134248 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc1409fca0 con 0x559011d8c870 2024-08-18T22:09:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.990+0000 7fbc037fe640 1 -- 172.21.15.123:0/3949134248 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fbc140a40d0 con 0x559011d8c870 2024-08-18T22:09:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.990+0000 7fbc2ca63740 10 client.15672 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:09:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.990+0000 7fbc2ca63740 10 client.15672 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:09:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.990+0000 7fbc2ca63740 20 client.15672 populate_metadata read hostname 'smithi123' 2024-08-18T22:09:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.990+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/3949134248 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559011e17f30 0x559011e1a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.990+0000 7fbc2ca63740 4 client.15672 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "22343c18", "release": true, "await": true}] 2024-08-18T22:09:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.990+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3949134248 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "quiesce db", "set_id": "22343c18", "release": true, "await": true}) -- 0x559011cfa6e0 con 0x559011e17f30 2024-08-18T22:09:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.990+0000 7fbc237fe640 1 --2- 172.21.15.123:0/3949134248 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559011e17f30 0x559011e1a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.990+0000 7fbc037fe640 10 client.15672 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.990+0000 7fbc237fe640 1 --2- 172.21.15.123:0/3949134248 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559011e17f30 0x559011e1a320 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4524410b89c4fd58 server_cookie=dae7a0534e0283ab in_seq=0 out_seq=0 2024-08-18T22:09:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.992+0000 7fbc037fe640 1 -- 172.21.15.123:0/3949134248 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559011cfa6e0 con 0x559011e17f30 2024-08-18T22:09:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.992+0000 7fbc037fe640 10 client.15672 handle_command_reply: tid=0 2024-08-18T22:09:06.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.992+0000 7fbc2ca63740 1 client.15672 shutdown 2024-08-18T22:09:06.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.992+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3949134248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 msgr2=0x559011da3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:06.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.992+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/3949134248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011da3f70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbc14096390 tx=0x7fbc140054a0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.992+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3949134248 shutdown_connections 2024-08-18T22:09:06.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.992+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/3949134248 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559011e17f30 0x559011e1a320 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.992+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/3949134248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559011d9bf80 0x559011da0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.992+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/3949134248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559011d8d190 0x559011da44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.992+0000 7fbc037fe640 0 client.15672 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:06.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.992+0000 7fbc2ca63740 1 --2- 172.21.15.123:0/3949134248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559011d8c870 0x559011da3f70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.992+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3949134248 >> 172.21.15.123:0/3949134248 conn(0x559011d88f20 msgr2=0x559011d98ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:06.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.992+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3949134248 shutdown_connections 2024-08-18T22:09:06.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.992+0000 7fbc2ca63740 1 -- 172.21.15.123:0/3949134248 wait complete. 2024-08-18T22:09:06.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.993+0000 7fbc2ca63740 20 client.15672 trim_cache size 0 max 16384 2024-08-18T22:09:06.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.993+0000 7fbc2a665640 1 -- 172.21.15.123:0/471033797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbc0c0a2c00 msgr2=0x7fbc0c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:06.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.993+0000 7fbc2a665640 1 --2- 172.21.15.123:0/471033797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbc0c0a2c00 0x7fbc0c0a50c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009fd0 tx=0x7fbc1c017000 comp rx=0 tx=0).stop 2024-08-18T22:09:06.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.993+0000 7fbc2a665640 1 -- 172.21.15.123:0/471033797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc241007b0 msgr2=0x7fbc24198fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:06.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.993+0000 7fbc2a665640 1 --2- 172.21.15.123:0/471033797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc241007b0 0x7fbc24198fe0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400c890 tx=0x7fbc1400cd50 comp rx=0 tx=0).stop 2024-08-18T22:09:06.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.993+0000 7fbc2a665640 1 -- 172.21.15.123:0/471033797 shutdown_connections 2024-08-18T22:09:06.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.993+0000 7fbc2a665640 1 --2- 172.21.15.123:0/471033797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc241067b0 0x7fbc241a4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.993+0000 7fbc2a665640 1 --2- 172.21.15.123:0/471033797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbc0c0a2c00 0x7fbc0c0a50c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.993+0000 7fbc2a665640 1 --2- 172.21.15.123:0/471033797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc24101150 0x7fbc24199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.993+0000 7fbc2a665640 1 --2- 172.21.15.123:0/471033797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc241007b0 0x7fbc24198fe0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:06.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.993+0000 7fbc2a665640 1 -- 172.21.15.123:0/471033797 >> 172.21.15.123:0/471033797 conn(0x7fbc240fc4d0 msgr2=0x7fbc240fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:06.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.993+0000 7fbc2a665640 1 -- 172.21.15.123:0/471033797 shutdown_connections 2024-08-18T22:09:06.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:05.993+0000 7fbc2a665640 1 -- 172.21.15.123:0/471033797 wait complete. 2024-08-18T22:09:06.426 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-18T22:09:06.544 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-18T22:09:06.583 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-18T22:09:06.585 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-18T22:09:06.585 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-18T22:09:06.624 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-18T22:09:06.627 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T22:09:06.627 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-18T22:09:06.643 INFO:tasks.workunit:Running workunits matching fs/misc on client.0... 2024-08-18T22:09:06.644 INFO:tasks.workunit:Running workunit fs/misc/acl.sh... 2024-08-18T22:09:06.644 DEBUG:teuthology.orchestra.run.smithi123:workunit test fs/misc/acl.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/acl.sh 2024-08-18T22:09:06.704 INFO:tasks.workunit.client.0.smithi123.stderr:+ set -e 2024-08-18T22:09:06.704 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir -p testdir 2024-08-18T22:09:06.706 INFO:tasks.workunit.client.0.smithi123.stderr:+ cd testdir 2024-08-18T22:09:06.706 INFO:tasks.workunit.client.0.smithi123.stderr:+ set +e 2024-08-18T22:09:06.706 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfacl -d -m u:nobody:rw . 2024-08-18T22:09:06.725 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 0 '!=' 0 2024-08-18T22:09:06.726 INFO:tasks.workunit.client.0.smithi123.stderr:+ set -e 2024-08-18T22:09:06.726 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=0 2024-08-18T22:09:06.726 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 0 -lt 100 ']' 2024-08-18T22:09:06.726 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 0 + 1 2024-08-18T22:09:06.726 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=1 2024-08-18T22:09:06.726 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:06.730 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:06.730 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:06.752 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:06.752 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:06.752 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:06.871 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '22343c18', total seconds elapsed: 38.3 2024-08-18T22:09:07.622 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:07.622 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:07.811 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:07.811 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:07.820 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:07.821 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:07.821 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 1 -lt 100 ']' 2024-08-18T22:09:07.821 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 1 + 1 2024-08-18T22:09:07.846 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=2 2024-08-18T22:09:07.847 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:07.881 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:07.881 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:07.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:07.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:07.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:08.235 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:08.235 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:08.254 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:08.255 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:08.258 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:08.258 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:08.258 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -lt 100 ']' 2024-08-18T22:09:08.258 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 2 + 1 2024-08-18T22:09:08.262 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=3 2024-08-18T22:09:08.262 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:08.267 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:08.267 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:08.268 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:08.269 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:08.269 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:08.352 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:08.353 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:08.369 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:08.369 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:08.372 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:08.372 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:08.372 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 3 -lt 100 ']' 2024-08-18T22:09:08.373 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 3 + 1 2024-08-18T22:09:08.377 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=4 2024-08-18T22:09:08.377 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:08.384 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:08.384 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:08.385 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:08.385 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:08.385 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:08.467 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:08.467 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:08.489 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:08.489 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:08.494 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:08.494 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:08.494 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 4 -lt 100 ']' 2024-08-18T22:09:08.494 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 4 + 1 2024-08-18T22:09:08.496 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=5 2024-08-18T22:09:08.497 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:08.501 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:08.501 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:08.502 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:08.502 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:08.502 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:08.579 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:08.579 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:08.595 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:08.595 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:08.598 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:08.598 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:08.598 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 5 -lt 100 ']' 2024-08-18T22:09:08.598 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 5 + 1 2024-08-18T22:09:08.602 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=6 2024-08-18T22:09:08.602 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:08.606 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:08.606 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:08.607 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:08.607 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:08.607 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:08.673 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:08 smithi123 ceph-mon[18462]: pgmap v381: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-18T22:09:08.681 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:08.682 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:08.696 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:08.696 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:08.699 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:08.699 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:08.699 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 6 -lt 100 ']' 2024-08-18T22:09:08.699 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 6 + 1 2024-08-18T22:09:08.703 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=7 2024-08-18T22:09:08.703 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:08.707 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:08.708 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:08.709 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:08.709 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:08.709 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:08 smithi130 ceph-mon[21698]: pgmap v381: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-18T22:09:08.784 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:08.784 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:08.797 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:08.797 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:08.800 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:08.800 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:08.801 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 7 -lt 100 ']' 2024-08-18T22:09:08.801 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 7 + 1 2024-08-18T22:09:08.805 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=8 2024-08-18T22:09:08.805 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:08.809 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:08.809 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:08.810 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:08.810 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:08.810 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:08.885 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:08.885 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:08.899 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:08.899 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:08.902 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:08.903 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:08.903 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 8 -lt 100 ']' 2024-08-18T22:09:08.903 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 8 + 1 2024-08-18T22:09:08.907 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=9 2024-08-18T22:09:08.908 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:08.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:08 smithi183 ceph-mon[22097]: pgmap v381: 129 pgs: 129 active+clean; 665 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-18T22:09:08.911 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:08.911 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:08.912 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:08.912 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:08.913 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:08.987 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:08.987 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:09.003 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:09.003 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:09.006 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:09.006 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:09.007 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 9 -lt 100 ']' 2024-08-18T22:09:09.007 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 9 + 1 2024-08-18T22:09:09.010 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=10 2024-08-18T22:09:09.011 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:09.014 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:09.015 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:09.016 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:09.016 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:09.016 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:09.097 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:09.097 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:09.110 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:09.110 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:09.114 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:09.114 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:09.114 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 10 -lt 100 ']' 2024-08-18T22:09:09.114 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 10 + 1 2024-08-18T22:09:09.117 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=11 2024-08-18T22:09:09.118 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:09.122 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:09.122 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:09.123 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:09.123 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:09.123 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:09.199 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:09.200 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:09.214 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:09.214 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:09.217 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:09.217 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:09.217 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 11 -lt 100 ']' 2024-08-18T22:09:09.217 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 11 + 1 2024-08-18T22:09:09.221 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=12 2024-08-18T22:09:09.221 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:09.225 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:09.226 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:09.227 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:09.227 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:09.227 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:09.301 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:09.301 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:09.314 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:09.314 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:09.316 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:09.317 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:09.317 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 12 -lt 100 ']' 2024-08-18T22:09:09.317 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 12 + 1 2024-08-18T22:09:09.321 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=13 2024-08-18T22:09:09.321 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:09.325 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:09.325 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:09.326 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:09.326 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:09.326 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:09.473 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:09.473 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:09.607 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:09.607 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:09.619 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:09.620 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:09.620 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 13 -lt 100 ']' 2024-08-18T22:09:09.620 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 13 + 1 2024-08-18T22:09:09.638 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=14 2024-08-18T22:09:09.638 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:09.662 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:09.662 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:09.663 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:09.663 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:09.664 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:09.988 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:09.988 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:10.103 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:10.103 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:10.107 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:10.107 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:10.107 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 14 -lt 100 ']' 2024-08-18T22:09:10.107 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 14 + 1 2024-08-18T22:09:10.111 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=15 2024-08-18T22:09:10.111 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:10.116 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:10.116 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:10.117 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:10.117 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:10.117 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:10.331 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:10.331 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:10.442 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:10.442 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:10.445 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:10.445 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:10.445 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 15 -lt 100 ']' 2024-08-18T22:09:10.446 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 15 + 1 2024-08-18T22:09:10.449 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=16 2024-08-18T22:09:10.450 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:10.471 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:10.471 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:10.472 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:10.472 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:10.472 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:10.712 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:10 smithi123 ceph-mon[18462]: pgmap v382: 129 pgs: 129 active+clean; 683 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-08-18T22:09:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:10 smithi130 ceph-mon[21698]: pgmap v382: 129 pgs: 129 active+clean; 683 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-08-18T22:09:10.822 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:10.822 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:10 smithi183 ceph-mon[22097]: pgmap v382: 129 pgs: 129 active+clean; 683 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-08-18T22:09:10.979 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:10.979 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:10.986 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:10.986 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:10.986 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 16 -lt 100 ']' 2024-08-18T22:09:10.987 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 16 + 1 2024-08-18T22:09:11.012 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=17 2024-08-18T22:09:11.013 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:11.038 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:11.038 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:11.039 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:11.039 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:11.039 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:11.396 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:11.396 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:11.552 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:11.552 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:11.562 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:11.562 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:11.562 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 17 -lt 100 ']' 2024-08-18T22:09:11.562 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 17 + 1 2024-08-18T22:09:11.588 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=18 2024-08-18T22:09:11.588 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:11.637 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:11.637 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:11.639 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:11.639 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:11.639 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:12.038 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:12.038 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:12.179 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:12.179 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:12.186 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:12.186 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:12.186 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 18 -lt 100 ']' 2024-08-18T22:09:12.186 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 18 + 1 2024-08-18T22:09:12.204 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=19 2024-08-18T22:09:12.204 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:12.225 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:12.225 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:12.226 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:12.227 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:12.227 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:12.564 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:12.564 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:12.694 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:12.695 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:12.703 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:12.703 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:12.703 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 19 -lt 100 ']' 2024-08-18T22:09:12.703 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 19 + 1 2024-08-18T22:09:12.729 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=20 2024-08-18T22:09:12.729 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:12.748 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:12.748 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:12.749 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:12.749 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:12.749 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:12 smithi123 ceph-mon[18462]: pgmap v383: 129 pgs: 129 active+clean; 683 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-08-18T22:09:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:12 smithi130 ceph-mon[21698]: pgmap v383: 129 pgs: 129 active+clean; 683 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-08-18T22:09:12.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:12 smithi183 ceph-mon[22097]: pgmap v383: 129 pgs: 129 active+clean; 683 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-08-18T22:09:13.229 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:13.230 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:13.493 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:13.494 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:13.503 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:13.503 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:13.503 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 20 -lt 100 ']' 2024-08-18T22:09:13.503 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 20 + 1 2024-08-18T22:09:13.591 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=21 2024-08-18T22:09:13.591 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:13.635 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:13.635 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:13.636 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:13.636 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:13.636 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:14.364 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:14.365 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:14.652 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:14.652 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:14.678 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:14.678 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:14.679 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 21 -lt 100 ']' 2024-08-18T22:09:14.679 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 21 + 1 2024-08-18T22:09:14.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:14 smithi123 ceph-mon[18462]: pgmap v384: 129 pgs: 129 active+clean; 683 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-08-18T22:09:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:14 smithi130 ceph-mon[21698]: pgmap v384: 129 pgs: 129 active+clean; 683 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-08-18T22:09:14.785 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=22 2024-08-18T22:09:14.785 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:14.827 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:14.827 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:14.828 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:14.828 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:14.828 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:14.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:14 smithi183 ceph-mon[22097]: pgmap v384: 129 pgs: 129 active+clean; 683 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-08-18T22:09:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.339+0000 7fc0796ae640 1 -- 172.21.15.123:0/1905662475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc074104c20 msgr2=0x7fc074107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.339+0000 7fc0796ae640 1 --2- 172.21.15.123:0/1905662475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc074104c20 0x7fc074107010 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc064009900 tx=0x7fc06402a3f0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.339+0000 7fc0796ae640 1 -- 172.21.15.123:0/1905662475 shutdown_connections 2024-08-18T22:09:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.339+0000 7fc0796ae640 1 --2- 172.21.15.123:0/1905662475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc074107550 0x7fc0741099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.339+0000 7fc0796ae640 1 --2- 172.21.15.123:0/1905662475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc074104c20 0x7fc074107010 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.339+0000 7fc0796ae640 1 --2- 172.21.15.123:0/1905662475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0741022f0 0x7fc0741046e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.339+0000 7fc0796ae640 1 -- 172.21.15.123:0/1905662475 >> 172.21.15.123:0/1905662475 conn(0x7fc0740fbf10 msgr2=0x7fc0740fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.339+0000 7fc0796ae640 1 -- 172.21.15.123:0/1905662475 shutdown_connections 2024-08-18T22:09:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.339+0000 7fc0796ae640 1 -- 172.21.15.123:0/1905662475 wait complete. 2024-08-18T22:09:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.341+0000 7fc0796ae640 1 Processor -- start 2024-08-18T22:09:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.341+0000 7fc0796ae640 1 -- start start 2024-08-18T22:09:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc0796ae640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0741022f0 0x7fc074197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc0796ae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc074104c20 0x7fc0741980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc0796ae640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc074107550 0x7fc07419f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc0796ae640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc07410d580 con 0x7fc074104c20 2024-08-18T22:09:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc0796ae640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc07410d400 con 0x7fc0741022f0 2024-08-18T22:09:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc0796ae640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc07410d700 con 0x7fc074107550 2024-08-18T22:09:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc072ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0741022f0 0x7fc074197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc0727fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc074104c20 0x7fc0741980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc072ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0741022f0 0x7fc074197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:46504/0 (socket says 172.21.15.123:46504) 2024-08-18T22:09:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc072ffd640 1 -- 172.21.15.123:0/1801491700 learned_addr learned my addr 172.21.15.123:0/1801491700 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc0737fe640 1 --2- 172.21.15.123:0/1801491700 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc074107550 0x7fc07419f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc072ffd640 1 -- 172.21.15.123:0/1801491700 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc074107550 msgr2=0x7fc07419f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc072ffd640 1 --2- 172.21.15.123:0/1801491700 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc074107550 0x7fc07419f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc072ffd640 1 -- 172.21.15.123:0/1801491700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc074104c20 msgr2=0x7fc0741980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc072ffd640 1 --2- 172.21.15.123:0/1801491700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc074104c20 0x7fc0741980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc072ffd640 1 -- 172.21.15.123:0/1801491700 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07419f7a0 con 0x7fc0741022f0 2024-08-18T22:09:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.342+0000 7fc0727fc640 1 --2- 172.21.15.123:0/1801491700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc074104c20 0x7fc0741980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:09:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.343+0000 7fc072ffd640 1 --2- 172.21.15.123:0/1801491700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0741022f0 0x7fc074197b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00d950 tx=0x7fc05c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.343+0000 7fc06bfff640 1 -- 172.21.15.123:0/1801491700 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c017030 con 0x7fc0741022f0 2024-08-18T22:09:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.343+0000 7fc0796ae640 1 -- 172.21.15.123:0/1801491700 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07419fa90 con 0x7fc0741022f0 2024-08-18T22:09:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.343+0000 7fc06bfff640 1 -- 172.21.15.123:0/1801491700 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc05c004020 con 0x7fc0741022f0 2024-08-18T22:09:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.343+0000 7fc06bfff640 1 -- 172.21.15.123:0/1801491700 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c0047a0 con 0x7fc0741022f0 2024-08-18T22:09:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.343+0000 7fc0796ae640 1 -- 172.21.15.123:0/1801491700 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc07419ffb0 con 0x7fc0741022f0 2024-08-18T22:09:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.346+0000 7fc06bfff640 1 -- 172.21.15.123:0/1801491700 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fc05c0041d0 con 0x7fc0741022f0 2024-08-18T22:09:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.357+0000 7fc06bfff640 1 --2- 172.21.15.123:0/1801491700 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0600a2da0 0x7fc0600a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.357+0000 7fc0727fc640 1 --2- 172.21.15.123:0/1801491700 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0600a2da0 0x7fc0600a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.357+0000 7fc06bfff640 1 -- 172.21.15.123:0/1801491700 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fc05c0cecf0 con 0x7fc0741022f0 2024-08-18T22:09:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.357+0000 7fc0727fc640 1 --2- 172.21.15.123:0/1801491700 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0600a2da0 0x7fc0600a5260 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc06402a9e0 tx=0x7fc0640315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.460+0000 7fc07c469740 1 Processor -- start 2024-08-18T22:09:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.460+0000 7fc07c469740 1 -- start start 2024-08-18T22:09:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.460+0000 7fc07c469740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 0x55ad1b450e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.460+0000 7fc07c469740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b455e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.460+0000 7fc07c469740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b456460 0x55ad1b458920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.460+0000 7fc07c469740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ad1b3af9d0 con 0x55ad1b4513d0 2024-08-18T22:09:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.460+0000 7fc07c469740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ad1b357820 con 0x55ad1b450a90 2024-08-18T22:09:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.460+0000 7fc07c469740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ad1b3ab990 con 0x55ad1b456460 2024-08-18T22:09:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.461+0000 7fc0727fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b455e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.461+0000 7fc0727fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b455e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48424/0 (socket says 172.21.15.123:48424) 2024-08-18T22:09:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.461+0000 7fc0727fc640 1 -- 172.21.15.123:0/210696513 learned_addr learned my addr 172.21.15.123:0/210696513 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.461+0000 7fc072ffd640 1 --2- 172.21.15.123:0/210696513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 0x55ad1b450e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.461+0000 7fc0737fe640 1 --2- 172.21.15.123:0/210696513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b456460 0x55ad1b458920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.461+0000 7fc0727fc640 1 -- 172.21.15.123:0/210696513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b456460 msgr2=0x55ad1b458920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.461+0000 7fc0727fc640 1 --2- 172.21.15.123:0/210696513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b456460 0x55ad1b458920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.461+0000 7fc0727fc640 1 -- 172.21.15.123:0/210696513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 msgr2=0x55ad1b450e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.461+0000 7fc0727fc640 1 --2- 172.21.15.123:0/210696513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 0x55ad1b450e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.461+0000 7fc0727fc640 1 -- 172.21.15.123:0/210696513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad1b0c3210 con 0x55ad1b4513d0 2024-08-18T22:09:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.461+0000 7fc072ffd640 1 --2- 172.21.15.123:0/210696513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 0x55ad1b450e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:09:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.461+0000 7fc0727fc640 1 --2- 172.21.15.123:0/210696513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b455e90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc064009900 tx=0x7fc06403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da08fa039e8bc14c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.462+0000 7fc0697fa640 1 -- 172.21.15.123:0/210696513 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064035040 con 0x55ad1b4513d0 2024-08-18T22:09:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.462+0000 7fc0697fa640 1 -- 172.21.15.123:0/210696513 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc06404e070 con 0x55ad1b4513d0 2024-08-18T22:09:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.462+0000 7fc0697fa640 1 -- 172.21.15.123:0/210696513 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064003850 con 0x55ad1b4513d0 2024-08-18T22:09:15.467 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.463+0000 7fc07c469740 1 -- 172.21.15.123:0/210696513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 msgr2=0x55ad1b455e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:15.467 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.463+0000 7fc07c469740 1 --2- 172.21.15.123:0/210696513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b455e90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc064009900 tx=0x7fc06403d000 comp rx=0 tx=0).stop 2024-08-18T22:09:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.463+0000 7fc07c469740 1 -- 172.21.15.123:0/210696513 shutdown_connections 2024-08-18T22:09:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.463+0000 7fc07c469740 1 --2- 172.21.15.123:0/210696513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b456460 0x55ad1b458920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.463+0000 7fc07c469740 1 --2- 172.21.15.123:0/210696513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b455e90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.463+0000 7fc07c469740 1 --2- 172.21.15.123:0/210696513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 0x55ad1b450e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.463+0000 7fc07c469740 1 -- 172.21.15.123:0/210696513 >> 172.21.15.123:0/210696513 conn(0x55ad1b447cf0 msgr2=0x55ad1b4480f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.463+0000 7fc07c469740 1 -- 172.21.15.123:0/210696513 shutdown_connections 2024-08-18T22:09:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.463+0000 7fc07c469740 1 -- 172.21.15.123:0/210696513 wait complete. 2024-08-18T22:09:15.474 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.473+0000 7fc07c469740 1 -- start start 2024-08-18T22:09:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.478+0000 7fc07c469740 1 Processor -- start 2024-08-18T22:09:15.482 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.479+0000 7fc07c469740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 0x55ad1b45abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.479+0000 7fc07c469740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b45b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.479+0000 7fc07c469740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b456460 0x55ad1b462140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.479+0000 7fc07c469740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ad1b4593d0 con 0x55ad1b4513d0 2024-08-18T22:09:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.479+0000 7fc07c469740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ad1b36b520 con 0x55ad1b450a90 2024-08-18T22:09:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.479+0000 7fc07c469740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ad1b459550 con 0x55ad1b456460 2024-08-18T22:09:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.479+0000 7fc0727fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b45b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.479+0000 7fc0727fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b45b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48436/0 (socket says 172.21.15.123:48436) 2024-08-18T22:09:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.479+0000 7fc0727fc640 1 -- 172.21.15.123:0/2173812877 learned_addr learned my addr 172.21.15.123:0/2173812877 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.479+0000 7fc0737fe640 1 --2- 172.21.15.123:0/2173812877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b456460 0x55ad1b462140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.479+0000 7fc072ffd640 1 --2- 172.21.15.123:0/2173812877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 0x55ad1b45abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.480+0000 7fc0727fc640 1 -- 172.21.15.123:0/2173812877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b456460 msgr2=0x55ad1b462140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.480+0000 7fc0727fc640 1 --2- 172.21.15.123:0/2173812877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b456460 0x55ad1b462140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.480+0000 7fc0727fc640 1 -- 172.21.15.123:0/2173812877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 msgr2=0x55ad1b45abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.480+0000 7fc0727fc640 1 --2- 172.21.15.123:0/2173812877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 0x55ad1b45abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.480+0000 7fc0727fc640 1 -- 172.21.15.123:0/2173812877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad1b18f620 con 0x55ad1b4513d0 2024-08-18T22:09:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.480+0000 7fc0737fe640 1 --2- 172.21.15.123:0/2173812877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b456460 0x55ad1b462140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:09:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.480+0000 7fc0727fc640 1 --2- 172.21.15.123:0/2173812877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b45b100 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc06402a910 tx=0x7fc064032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c392fea6c26dcc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.480+0000 7fc05a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:09:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.480+0000 7fc05a7fc640 1 -- 172.21.15.123:0/2173812877 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064035070 con 0x55ad1b4513d0 2024-08-18T22:09:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.480+0000 7fc05a7fc640 1 -- 172.21.15.123:0/2173812877 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fc064032ab0 con 0x55ad1b4513d0 2024-08-18T22:09:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.484+0000 7fc07c469740 10 client.0 _ll_register_callbacks cb 0x55ad1b0c2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:09:15.490 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.488+0000 7fc07c469740 1 -- 172.21.15.123:0/2173812877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc06404e070 con 0x55ad1b4513d0 2024-08-18T22:09:15.490 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.488+0000 7fc05a7fc640 1 -- 172.21.15.123:0/2173812877 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc064004910 con 0x55ad1b4513d0 2024-08-18T22:09:15.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.488+0000 7fc07c469740 10 client.15684 fetch_fsmap learned FSMap version 26 2024-08-18T22:09:15.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.488+0000 7fc07c469740 1 -- 172.21.15.123:0/2173812877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55ad1b464da0 con 0x55ad1b4513d0 2024-08-18T22:09:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.491+0000 7fc05a7fc640 1 -- 172.21.15.123:0/2173812877 <== mon.0 v2:172.21.15.123:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc064004ab0 con 0x55ad1b4513d0 2024-08-18T22:09:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.491+0000 7fc07c469740 10 client.15684 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:09:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.491+0000 7fc07c469740 10 client.15684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:09:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.491+0000 7fc07c469740 20 client.15684 populate_metadata read hostname 'smithi123' 2024-08-18T22:09:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.491+0000 7fc07c469740 1 --2- 172.21.15.123:0/2173812877 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ad1b4660f0 0x55ad1b4684e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.491+0000 7fc07c469740 4 client.15684 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:09:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.491+0000 7fc07c469740 1 -- 172.21.15.123:0/2173812877 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad1b3bd100 con 0x55ad1b4660f0 2024-08-18T22:09:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.491+0000 7fc072ffd640 1 --2- 172.21.15.123:0/2173812877 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ad1b4660f0 0x55ad1b4684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.492+0000 7fc072ffd640 1 --2- 172.21.15.123:0/2173812877 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ad1b4660f0 0x55ad1b4684e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c224d452f764bb2 server_cookie=64cf441eb3c6fbf7 in_seq=0 out_seq=0 2024-08-18T22:09:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.492+0000 7fc05a7fc640 10 client.15684 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:15.496 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.493+0000 7fc05a7fc640 1 -- 172.21.15.123:0/2173812877 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ad1b3bd100 con 0x55ad1b4660f0 2024-08-18T22:09:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.493+0000 7fc05a7fc640 10 client.15684 handle_command_reply: tid=0 2024-08-18T22:09:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.493+0000 7fc07c469740 1 client.15684 shutdown 2024-08-18T22:09:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.493+0000 7fc07c469740 1 -- 172.21.15.123:0/2173812877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 msgr2=0x55ad1b45b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.493+0000 7fc07c469740 1 --2- 172.21.15.123:0/2173812877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b45b100 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc06402a910 tx=0x7fc064032740 comp rx=0 tx=0).stop 2024-08-18T22:09:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.493+0000 7fc07c469740 1 -- 172.21.15.123:0/2173812877 shutdown_connections 2024-08-18T22:09:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.493+0000 7fc07c469740 1 --2- 172.21.15.123:0/2173812877 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ad1b4660f0 0x55ad1b4684e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.493+0000 7fc07c469740 1 --2- 172.21.15.123:0/2173812877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b456460 0x55ad1b462140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.493+0000 7fc07c469740 1 --2- 172.21.15.123:0/2173812877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b45b100 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.493+0000 7fc05a7fc640 0 client.15684 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.493+0000 7fc07c469740 1 --2- 172.21.15.123:0/2173812877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 0x55ad1b45abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.493+0000 7fc07c469740 1 -- 172.21.15.123:0/2173812877 >> 172.21.15.123:0/2173812877 conn(0x55ad1b447cf0 msgr2=0x55ad1b449500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.493+0000 7fc07c469740 1 -- 172.21.15.123:0/2173812877 shutdown_connections 2024-08-18T22:09:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.493+0000 7fc07c469740 1 -- 172.21.15.123:0/2173812877 wait complete. 2024-08-18T22:09:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.494+0000 7fc07c469740 20 client.15684 trim_cache size 0 max 16384 2024-08-18T22:09:15.526 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.523+0000 7fc07c469740 1 Processor -- start 2024-08-18T22:09:15.526 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.523+0000 7fc07c469740 1 -- start start 2024-08-18T22:09:15.526 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.523+0000 7fc07c469740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 0x55ad1b45b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.523+0000 7fc07c469740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b4513d0 0x55ad1b462100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.523+0000 7fc07c469740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b456460 0x55ad1b446d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.523+0000 7fc07c469740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc0741aaac0 con 0x55ad1b456460 2024-08-18T22:09:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.523+0000 7fc07c469740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc0741a8320 con 0x55ad1b450a90 2024-08-18T22:09:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.523+0000 7fc07c469740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc0741a6170 con 0x55ad1b4513d0 2024-08-18T22:09:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.523+0000 7fc0737fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b456460 0x55ad1b446d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.523+0000 7fc0737fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b456460 0x55ad1b446d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48446/0 (socket says 172.21.15.123:48446) 2024-08-18T22:09:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.523+0000 7fc0737fe640 1 -- 172.21.15.123:0/2111443080 learned_addr learned my addr 172.21.15.123:0/2111443080 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.523+0000 7fc072ffd640 1 --2- 172.21.15.123:0/2111443080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 0x55ad1b45b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.524+0000 7fc0727fc640 1 --2- 172.21.15.123:0/2111443080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b4513d0 0x55ad1b462100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.524+0000 7fc0737fe640 1 -- 172.21.15.123:0/2111443080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b4513d0 msgr2=0x55ad1b462100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.524+0000 7fc0737fe640 1 --2- 172.21.15.123:0/2111443080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b4513d0 0x55ad1b462100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.524+0000 7fc0737fe640 1 -- 172.21.15.123:0/2111443080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 msgr2=0x55ad1b45b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.524+0000 7fc0737fe640 1 --2- 172.21.15.123:0/2111443080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 0x55ad1b45b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.524+0000 7fc0737fe640 1 -- 172.21.15.123:0/2111443080 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad1b459c50 con 0x55ad1b456460 2024-08-18T22:09:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.524+0000 7fc0737fe640 1 --2- 172.21.15.123:0/2111443080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b456460 0x55ad1b446d90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc06c003cc0 tx=0x7fc06c011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9de9c4de48d5c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.524+0000 7fc068ff9640 1 -- 172.21.15.123:0/2111443080 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c011c50 con 0x55ad1b456460 2024-08-18T22:09:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.524+0000 7fc068ff9640 1 -- 172.21.15.123:0/2111443080 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc06c020070 con 0x55ad1b456460 2024-08-18T22:09:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.524+0000 7fc068ff9640 1 -- 172.21.15.123:0/2111443080 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c00f3c0 con 0x55ad1b456460 2024-08-18T22:09:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.525+0000 7fc07c469740 1 -- 172.21.15.123:0/2111443080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b456460 msgr2=0x55ad1b446d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.525+0000 7fc07c469740 1 --2- 172.21.15.123:0/2111443080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b456460 0x55ad1b446d90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc06c003cc0 tx=0x7fc06c011b20 comp rx=0 tx=0).stop 2024-08-18T22:09:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.525+0000 7fc07c469740 1 -- 172.21.15.123:0/2111443080 shutdown_connections 2024-08-18T22:09:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.525+0000 7fc07c469740 1 --2- 172.21.15.123:0/2111443080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b456460 0x55ad1b446d90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.525+0000 7fc07c469740 1 --2- 172.21.15.123:0/2111443080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b4513d0 0x55ad1b462100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.525+0000 7fc07c469740 1 --2- 172.21.15.123:0/2111443080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b450a90 0x55ad1b45b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.525+0000 7fc07c469740 1 -- 172.21.15.123:0/2111443080 >> 172.21.15.123:0/2111443080 conn(0x55ad1b447cf0 msgr2=0x55ad1b446680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.525+0000 7fc07c469740 1 -- 172.21.15.123:0/2111443080 shutdown_connections 2024-08-18T22:09:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.525+0000 7fc07c469740 1 -- 172.21.15.123:0/2111443080 wait complete. 2024-08-18T22:09:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.525+0000 7fc07c469740 1 -- start start 2024-08-18T22:09:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.525+0000 7fc07c469740 1 Processor -- start 2024-08-18T22:09:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc07c469740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b450a90 0x55ad1b45f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc07c469740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b45f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc07c469740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b456460 0x55ad1b460830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc07c469740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc0741a67e0 con 0x55ad1b4513d0 2024-08-18T22:09:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc07c469740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc0741a7c50 con 0x55ad1b456460 2024-08-18T22:09:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc07c469740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc0741a6eb0 con 0x55ad1b450a90 2024-08-18T22:09:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc07c469740 10 client.0 _ll_register_callbacks cb 0x7fc05c005130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:09:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc0727fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b45f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc0727fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b45f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48452/0 (socket says 172.21.15.123:48452) 2024-08-18T22:09:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc0727fc640 1 -- 172.21.15.123:0/2332897594 learned_addr learned my addr 172.21.15.123:0/2332897594 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc0737fe640 1 --2- 172.21.15.123:0/2332897594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b456460 0x55ad1b460830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc072ffd640 1 --2- 172.21.15.123:0/2332897594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b450a90 0x55ad1b45f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc0727fc640 1 -- 172.21.15.123:0/2332897594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b450a90 msgr2=0x55ad1b45f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc0727fc640 1 --2- 172.21.15.123:0/2332897594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b450a90 0x55ad1b45f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc0727fc640 1 -- 172.21.15.123:0/2332897594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b456460 msgr2=0x55ad1b460830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc0727fc640 1 --2- 172.21.15.123:0/2332897594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b456460 0x55ad1b460830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc0727fc640 1 -- 172.21.15.123:0/2332897594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad1b460e40 con 0x55ad1b4513d0 2024-08-18T22:09:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc072ffd640 1 --2- 172.21.15.123:0/2332897594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b450a90 0x55ad1b45f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:09:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc0727fc640 1 --2- 172.21.15.123:0/2332897594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b45f820 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc06402a430 tx=0x7fc064040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf7ff56d15d2acb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.526+0000 7fc05a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:09:15.545 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.527+0000 7fc05a7fc640 1 -- 172.21.15.123:0/2332897594 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064032ad0 con 0x55ad1b4513d0 2024-08-18T22:09:15.545 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.527+0000 7fc05a7fc640 1 -- 172.21.15.123:0/2332897594 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fc064032c70 con 0x55ad1b4513d0 2024-08-18T22:09:15.545 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.527+0000 7fc07c469740 1 -- 172.21.15.123:0/2332897594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc06c020070 con 0x55ad1b4513d0 2024-08-18T22:09:15.545 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.527+0000 7fc05a7fc640 1 -- 172.21.15.123:0/2332897594 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc064077050 con 0x55ad1b4513d0 2024-08-18T22:09:15.545 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.527+0000 7fc07c469740 10 client.15690 fetch_fsmap learned FSMap version 26 2024-08-18T22:09:15.545 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.527+0000 7fc07c469740 1 -- 172.21.15.123:0/2332897594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ad1b462150 con 0x55ad1b4513d0 2024-08-18T22:09:15.545 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.527+0000 7fc05a7fc640 1 -- 172.21.15.123:0/2332897594 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc06c020070 con 0x55ad1b4513d0 2024-08-18T22:09:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.527+0000 7fc05a7fc640 1 -- 172.21.15.123:0/2332897594 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc0640496b0 con 0x55ad1b4513d0 2024-08-18T22:09:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.527+0000 7fc07c469740 10 client.15690 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:09:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.527+0000 7fc07c469740 10 client.15690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:09:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.527+0000 7fc07c469740 20 client.15690 populate_metadata read hostname 'smithi123' 2024-08-18T22:09:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.527+0000 7fc07c469740 1 --2- 172.21.15.123:0/2332897594 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ad1b4d0fd0 0x55ad1b4d33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.527+0000 7fc07c469740 4 client.15690 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:09:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.527+0000 7fc07c469740 1 -- 172.21.15.123:0/2332897594 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ad1b3b7450 con 0x55ad1b4d0fd0 2024-08-18T22:09:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.527+0000 7fc072ffd640 1 --2- 172.21.15.123:0/2332897594 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ad1b4d0fd0 0x55ad1b4d33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.528+0000 7fc072ffd640 1 --2- 172.21.15.123:0/2332897594 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ad1b4d0fd0 0x55ad1b4d33c0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2674b2d8d54126d3 server_cookie=d53a078054a057da in_seq=0 out_seq=0 2024-08-18T22:09:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.528+0000 7fc05a7fc640 10 client.15690 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.545+0000 7fc05a7fc640 1 -- 172.21.15.123:0/2332897594 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ad1b3b7450 con 0x55ad1b4d0fd0 2024-08-18T22:09:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.545+0000 7fc05a7fc640 10 client.15690 handle_command_reply: tid=0 2024-08-18T22:09:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.545+0000 7fc07c469740 1 client.15690 shutdown 2024-08-18T22:09:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.546+0000 7fc07c469740 1 -- 172.21.15.123:0/2332897594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 msgr2=0x55ad1b45f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.546+0000 7fc07c469740 1 --2- 172.21.15.123:0/2332897594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b45f820 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc06402a430 tx=0x7fc064040000 comp rx=0 tx=0).stop 2024-08-18T22:09:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.546+0000 7fc07c469740 1 -- 172.21.15.123:0/2332897594 shutdown_connections 2024-08-18T22:09:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.546+0000 7fc07c469740 1 --2- 172.21.15.123:0/2332897594 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ad1b4d0fd0 0x55ad1b4d33c0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.546+0000 7fc07c469740 1 --2- 172.21.15.123:0/2332897594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad1b456460 0x55ad1b460830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.546+0000 7fc07c469740 1 --2- 172.21.15.123:0/2332897594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ad1b4513d0 0x55ad1b45f820 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.546+0000 7fc07c469740 1 --2- 172.21.15.123:0/2332897594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ad1b450a90 0x55ad1b45f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.546+0000 7fc05a7fc640 0 client.15690 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.546+0000 7fc07c469740 1 -- 172.21.15.123:0/2332897594 >> 172.21.15.123:0/2332897594 conn(0x55ad1b447cf0 msgr2=0x55ad1b446ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.546+0000 7fc07c469740 1 -- 172.21.15.123:0/2332897594 shutdown_connections 2024-08-18T22:09:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.546+0000 7fc07c469740 1 -- 172.21.15.123:0/2332897594 wait complete. 2024-08-18T22:09:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.546+0000 7fc07c469740 20 client.15690 trim_cache size 0 max 16384 2024-08-18T22:09:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:09:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:09:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:09:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:09:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.559+0000 7fc0796ae640 1 -- 172.21.15.123:0/1801491700 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0600a2da0 msgr2=0x7fc0600a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.559+0000 7fc0796ae640 1 --2- 172.21.15.123:0/1801491700 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0600a2da0 0x7fc0600a5260 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc06402a9e0 tx=0x7fc0640315b0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.559+0000 7fc0796ae640 1 -- 172.21.15.123:0/1801491700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0741022f0 msgr2=0x7fc074197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.559+0000 7fc0796ae640 1 --2- 172.21.15.123:0/1801491700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0741022f0 0x7fc074197b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00d950 tx=0x7fc05c00de10 comp rx=0 tx=0).stop 2024-08-18T22:09:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.559+0000 7fc0796ae640 1 -- 172.21.15.123:0/1801491700 shutdown_connections 2024-08-18T22:09:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.559+0000 7fc0796ae640 1 --2- 172.21.15.123:0/1801491700 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc074107550 0x7fc07419f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.559+0000 7fc0796ae640 1 --2- 172.21.15.123:0/1801491700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc074104c20 0x7fc0741980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.559+0000 7fc0796ae640 1 --2- 172.21.15.123:0/1801491700 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0600a2da0 0x7fc0600a5260 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.559+0000 7fc0796ae640 1 --2- 172.21.15.123:0/1801491700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0741022f0 0x7fc074197b80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.559+0000 7fc0796ae640 1 -- 172.21.15.123:0/1801491700 >> 172.21.15.123:0/1801491700 conn(0x7fc0740fbf10 msgr2=0x7fc074102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.559+0000 7fc0796ae640 1 -- 172.21.15.123:0/1801491700 shutdown_connections 2024-08-18T22:09:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:15.559+0000 7fc0796ae640 1 -- 172.21.15.123:0/1801491700 wait complete. 2024-08-18T22:09:15.653 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:15.653 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:15.836 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:15.837 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:15.853 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:15.853 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:15.853 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 22 -lt 100 ']' 2024-08-18T22:09:15.853 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 22 + 1 2024-08-18T22:09:15.879 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=23 2024-08-18T22:09:15.879 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:15.955 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:15.955 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:15.956 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:15.956 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:15.956 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:16.089 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-18T22:09:16.603 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:16.604 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:16.728 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:16.728 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:16.731 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:16.731 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:16.731 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 23 -lt 100 ']' 2024-08-18T22:09:16.731 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 23 + 1 2024-08-18T22:09:16.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:16 smithi123 ceph-mon[18462]: pgmap v385: 129 pgs: 129 active+clean; 822 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-08-18T22:09:16.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:16 smithi130 ceph-mon[21698]: pgmap v385: 129 pgs: 129 active+clean; 822 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-08-18T22:09:16.770 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=24 2024-08-18T22:09:16.770 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:16.838 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:16.839 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:16.839 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:16.839 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:16.840 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:16.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:16 smithi183 ceph-mon[22097]: pgmap v385: 129 pgs: 129 active+clean; 822 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-08-18T22:09:17.346 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:17.347 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:17.481 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:17.481 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:17.519 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:17.520 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:17.520 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 24 -lt 100 ']' 2024-08-18T22:09:17.520 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 24 + 1 2024-08-18T22:09:17.554 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=25 2024-08-18T22:09:17.554 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:17.579 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:17.579 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:17.580 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:17.580 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:17.581 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:18.095 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:18.095 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:18.281 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:18.281 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:18.293 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:18.293 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:18.294 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 25 -lt 100 ']' 2024-08-18T22:09:18.294 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 25 + 1 2024-08-18T22:09:18.354 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=26 2024-08-18T22:09:18.355 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:18.395 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:18.395 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:18.396 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:18.396 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:18.396 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:18.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:18 smithi123 ceph-mon[18462]: pgmap v386: 129 pgs: 129 active+clean; 822 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-08-18T22:09:18.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:18 smithi130 ceph-mon[21698]: pgmap v386: 129 pgs: 129 active+clean; 822 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-08-18T22:09:18.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:18 smithi183 ceph-mon[22097]: pgmap v386: 129 pgs: 129 active+clean; 822 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-08-18T22:09:19.007 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:19.007 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:19.272 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:19.273 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:19.286 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:19.286 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:19.286 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 26 -lt 100 ']' 2024-08-18T22:09:19.286 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 26 + 1 2024-08-18T22:09:19.320 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=27 2024-08-18T22:09:19.320 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:19.361 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:19.361 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:19.362 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:19.362 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:19.363 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:20.186 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:20.186 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:20.347 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:20.347 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:20.370 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:20.370 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:20.370 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 27 -lt 100 ']' 2024-08-18T22:09:20.370 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 27 + 1 2024-08-18T22:09:20.429 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=28 2024-08-18T22:09:20.430 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:20.469 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:20.470 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:20.471 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:20.471 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:20.471 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:20.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:20 smithi123 ceph-mon[18462]: pgmap v387: 129 pgs: 129 active+clean; 900 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-08-18T22:09:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:20 smithi130 ceph-mon[21698]: pgmap v387: 129 pgs: 129 active+clean; 900 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-08-18T22:09:20.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:20 smithi183 ceph-mon[22097]: pgmap v387: 129 pgs: 129 active+clean; 900 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-08-18T22:09:21.186 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:21.186 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:21.402 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:21.402 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:21.513 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:21.513 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:21.513 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 28 -lt 100 ']' 2024-08-18T22:09:21.513 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 28 + 1 2024-08-18T22:09:21.553 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=29 2024-08-18T22:09:21.553 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:21.597 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:21.597 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:21.598 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:21.599 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:21.599 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:22.236 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:22.236 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:22.468 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:22.468 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:22.476 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:22.476 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:22.476 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 29 -lt 100 ']' 2024-08-18T22:09:22.476 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 29 + 1 2024-08-18T22:09:22.526 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=30 2024-08-18T22:09:22.526 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:22.538 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:22.538 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:22.539 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:22.539 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:22.539 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:22.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:22 smithi123 ceph-mon[18462]: pgmap v388: 129 pgs: 129 active+clean; 900 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-08-18T22:09:22.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:22 smithi130 ceph-mon[21698]: pgmap v388: 129 pgs: 129 active+clean; 900 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-08-18T22:09:22.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:22 smithi183 ceph-mon[22097]: pgmap v388: 129 pgs: 129 active+clean; 900 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-08-18T22:09:23.136 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:23.136 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:23.327 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:09:23.355 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:23.356 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:23.376 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:23.376 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:23.376 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 30 -lt 100 ']' 2024-08-18T22:09:23.376 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 30 + 1 2024-08-18T22:09:23.437 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=31 2024-08-18T22:09:23.437 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:23.503 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:23.503 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:23.504 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:23.504 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:23.504 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:24.194 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:24.194 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:24.385 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:24.385 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:24.418 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:24.418 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:24.418 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 31 -lt 100 ']' 2024-08-18T22:09:24.419 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 31 + 1 2024-08-18T22:09:24.465 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=32 2024-08-18T22:09:24.465 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:24.512 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:24.512 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:24.512 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:24.513 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:24.513 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:24.744 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:24 smithi123 ceph-mon[18462]: pgmap v389: 129 pgs: 129 active+clean; 900 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-08-18T22:09:24.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:24 smithi130 ceph-mon[21698]: pgmap v389: 129 pgs: 129 active+clean; 900 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-08-18T22:09:24.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:24 smithi183 ceph-mon[22097]: pgmap v389: 129 pgs: 129 active+clean; 900 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-08-18T22:09:25.685 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:25.685 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:25.800 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:25.800 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:25.818 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:25.819 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:25.819 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 32 -lt 100 ']' 2024-08-18T22:09:25.819 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 32 + 1 2024-08-18T22:09:25.868 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=33 2024-08-18T22:09:25.868 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:25.910 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:25.910 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:25.911 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:25.911 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:25.911 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:26.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:26 smithi123 ceph-mon[18462]: pgmap v390: 129 pgs: 129 active+clean; 968 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-08-18T22:09:26.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:26 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:09:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:26 smithi130 ceph-mon[21698]: pgmap v390: 129 pgs: 129 active+clean; 968 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-08-18T22:09:26.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:26 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:09:26.885 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:26.885 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:26.908 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:26 smithi183 ceph-mon[22097]: pgmap v390: 129 pgs: 129 active+clean; 968 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-08-18T22:09:26.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:26 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:09:27.043 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:27.043 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:27.077 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:27.077 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:27.077 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 33 -lt 100 ']' 2024-08-18T22:09:27.077 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 33 + 1 2024-08-18T22:09:27.151 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=34 2024-08-18T22:09:27.152 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:27.169 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:27.169 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:27.170 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:27.170 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:27.170 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:27.913 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:27.914 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:28.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:27 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:09:28.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:27 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:09:28.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:27 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:09:28.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:27 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:09:28.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:27 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:09:28.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:27 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:09:28.201 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:28.201 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:28.243 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:28.243 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:28.243 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 34 -lt 100 ']' 2024-08-18T22:09:28.243 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 34 + 1 2024-08-18T22:09:28.295 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=35 2024-08-18T22:09:28.295 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:28.337 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:28.337 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:28.338 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:28.338 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:28.338 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:29.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:28 smithi123 ceph-mon[18462]: pgmap v391: 129 pgs: 129 active+clean; 968 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-08-18T22:09:29.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:28 smithi130 ceph-mon[21698]: pgmap v391: 129 pgs: 129 active+clean; 968 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-08-18T22:09:29.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:28 smithi183 ceph-mon[22097]: pgmap v391: 129 pgs: 129 active+clean; 968 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-08-18T22:09:29.301 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:29.302 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:29.801 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:29.801 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:29.818 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:29.818 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:29.818 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 35 -lt 100 ']' 2024-08-18T22:09:29.818 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 35 + 1 2024-08-18T22:09:29.876 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=36 2024-08-18T22:09:29.876 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:29.919 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:29.919 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:29.921 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:29.921 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:29.921 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:30.939 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:30 smithi123 ceph-mon[18462]: pgmap v392: 129 pgs: 129 active+clean; 1015 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-18T22:09:31.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:30 smithi130 ceph-mon[21698]: pgmap v392: 129 pgs: 129 active+clean; 1015 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-18T22:09:31.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:30 smithi183 ceph-mon[22097]: pgmap v392: 129 pgs: 129 active+clean; 1015 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-18T22:09:31.284 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:31.285 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:31.617 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:31.617 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:31.642 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:31.642 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:31.642 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 36 -lt 100 ']' 2024-08-18T22:09:31.642 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 36 + 1 2024-08-18T22:09:31.721 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=37 2024-08-18T22:09:31.721 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:31.767 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:31.767 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:31.768 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:31.769 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:31.769 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:32.659 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:32.659 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:32.778 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:32.778 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:32.800 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:32.800 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:32.800 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 37 -lt 100 ']' 2024-08-18T22:09:32.800 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 37 + 1 2024-08-18T22:09:33.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:32 smithi123 ceph-mon[18462]: pgmap v393: 129 pgs: 129 active+clean; 1015 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-08-18T22:09:33.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:32 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:09:33.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:32 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:09:33.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:32 smithi130 ceph-mon[21698]: pgmap v393: 129 pgs: 129 active+clean; 1015 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-08-18T22:09:33.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:32 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:09:33.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:32 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:09:33.017 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=38 2024-08-18T22:09:33.017 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:33.027 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:33.027 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:33.029 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:33.029 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:33.029 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:33.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:32 smithi183 ceph-mon[22097]: pgmap v393: 129 pgs: 129 active+clean; 1015 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-08-18T22:09:33.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:32 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:09:33.160 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:32 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:09:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.295+0000 7fefd21c9640 1 -- 172.21.15.123:0/3182894117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefcc100b50 msgr2=0x7fefcc100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.295+0000 7fefd21c9640 1 --2- 172.21.15.123:0/3182894117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefcc100b50 0x7fefcc100f30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009900 tx=0x7fefbc02a480 comp rx=0 tx=0).stop 2024-08-18T22:09:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.295+0000 7fefd21c9640 1 -- 172.21.15.123:0/3182894117 shutdown_connections 2024-08-18T22:09:33.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.295+0000 7fefd21c9640 1 --2- 172.21.15.123:0/3182894117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefcc102c20 0x7fefcc10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.295+0000 7fefd21c9640 1 --2- 172.21.15.123:0/3182894117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefcc1022a0 0x7fefcc1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.295+0000 7fefd21c9640 1 --2- 172.21.15.123:0/3182894117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefcc100b50 0x7fefcc100f30 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.295+0000 7fefd21c9640 1 -- 172.21.15.123:0/3182894117 >> 172.21.15.123:0/3182894117 conn(0x7fefcc0fc500 msgr2=0x7fefcc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.295+0000 7fefd21c9640 1 -- 172.21.15.123:0/3182894117 shutdown_connections 2024-08-18T22:09:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.296+0000 7fefd21c9640 1 -- 172.21.15.123:0/3182894117 wait complete. 2024-08-18T22:09:33.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.296+0000 7fefd21c9640 1 Processor -- start 2024-08-18T22:09:33.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.297+0000 7fefd21c9640 1 -- start start 2024-08-18T22:09:33.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.297+0000 7fefd21c9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefcc100b50 0x7fefcc197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.297+0000 7fefd21c9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefcc1022a0 0x7fefcc197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.297+0000 7fefd21c9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefcc102c20 0x7fefcc19b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.297+0000 7fefd21c9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc110cb0 con 0x7fefcc100b50 2024-08-18T22:09:33.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.297+0000 7fefd21c9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc110b30 con 0x7fefcc1022a0 2024-08-18T22:09:33.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.297+0000 7fefd21c9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc110e30 con 0x7fefcc102c20 2024-08-18T22:09:33.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.297+0000 7fefcb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefcc100b50 0x7fefcc197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.297+0000 7fefcb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefcc100b50 0x7fefcc197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55548/0 (socket says 172.21.15.123:55548) 2024-08-18T22:09:33.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.297+0000 7fefcb7fe640 1 -- 172.21.15.123:0/1072074378 learned_addr learned my addr 172.21.15.123:0/1072074378 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:33.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.297+0000 7fefcbfff640 1 --2- 172.21.15.123:0/1072074378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefcc102c20 0x7fefcc19b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.298+0000 7fefcaffd640 1 --2- 172.21.15.123:0/1072074378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefcc1022a0 0x7fefcc197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.298+0000 7fefcbfff640 1 -- 172.21.15.123:0/1072074378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefcc1022a0 msgr2=0x7fefcc197660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:33.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.298+0000 7fefcbfff640 1 --2- 172.21.15.123:0/1072074378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefcc1022a0 0x7fefcc197660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.298+0000 7fefcbfff640 1 -- 172.21.15.123:0/1072074378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefcc100b50 msgr2=0x7fefcc197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:33.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.298+0000 7fefcbfff640 1 --2- 172.21.15.123:0/1072074378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefcc100b50 0x7fefcc197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.298+0000 7fefcbfff640 1 -- 172.21.15.123:0/1072074378 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefcc19c0d0 con 0x7fefcc102c20 2024-08-18T22:09:33.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.298+0000 7fefcb7fe640 1 --2- 172.21.15.123:0/1072074378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefcc100b50 0x7fefcc197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:09:33.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.298+0000 7fefcbfff640 1 --2- 172.21.15.123:0/1072074378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefcc102c20 0x7fefcc19b9f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fefc400da10 tx=0x7fefc400ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:33.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.299+0000 7fefc8ff9640 1 -- 172.21.15.123:0/1072074378 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc4018070 con 0x7fefcc102c20 2024-08-18T22:09:33.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.299+0000 7fefd21c9640 1 -- 172.21.15.123:0/1072074378 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefcc19c3c0 con 0x7fefcc102c20 2024-08-18T22:09:33.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.299+0000 7fefc8ff9640 1 -- 172.21.15.123:0/1072074378 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefc4016070 con 0x7fefcc102c20 2024-08-18T22:09:33.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.299+0000 7fefc8ff9640 1 -- 172.21.15.123:0/1072074378 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc4004030 con 0x7fefcc102c20 2024-08-18T22:09:33.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.299+0000 7fefd21c9640 1 -- 172.21.15.123:0/1072074378 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefcc069ca0 con 0x7fefcc102c20 2024-08-18T22:09:33.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.301+0000 7fefc8ff9640 1 -- 172.21.15.123:0/1072074378 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fefc4003970 con 0x7fefcc102c20 2024-08-18T22:09:33.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.302+0000 7fefc8ff9640 1 --2- 172.21.15.123:0/1072074378 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fefb40a2b80 0x7fefb40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.302+0000 7fefcb7fe640 1 --2- 172.21.15.123:0/1072074378 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fefb40a2b80 0x7fefb40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.302+0000 7fefc8ff9640 1 -- 172.21.15.123:0/1072074378 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fefc40d3210 con 0x7fefcc102c20 2024-08-18T22:09:33.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.303+0000 7fefcb7fe640 1 --2- 172.21.15.123:0/1072074378 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fefb40a2b80 0x7fefb40a5040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0096c0 tx=0x7fefbc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.392+0000 7f01d7361640 1 -- 172.21.15.123:0/1524307157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01d0102320 msgr2=0x7f01d0108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.392+0000 7f01d7361640 1 --2- 172.21.15.123:0/1524307157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01d0102320 0x7f01d0108bb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009ca0 tx=0x7f01c802a8c0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.392+0000 7f01d7361640 1 -- 172.21.15.123:0/1524307157 shutdown_connections 2024-08-18T22:09:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.392+0000 7f01d7361640 1 --2- 172.21.15.123:0/1524307157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01d0102320 0x7f01d0108bb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.392+0000 7f01d7361640 1 --2- 172.21.15.123:0/1524307157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d0101960 0x7f01d0101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.392+0000 7f01d7361640 1 --2- 172.21.15.123:0/1524307157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01d0100770 0x7f01d0100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.392+0000 7f01d7361640 1 -- 172.21.15.123:0/1524307157 >> 172.21.15.123:0/1524307157 conn(0x7f01d00fbf10 msgr2=0x7f01d00fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.392+0000 7f01d7361640 1 -- 172.21.15.123:0/1524307157 shutdown_connections 2024-08-18T22:09:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.392+0000 7f01d7361640 1 -- 172.21.15.123:0/1524307157 wait complete. 2024-08-18T22:09:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.408+0000 7f01d7361640 1 Processor -- start 2024-08-18T22:09:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.408+0000 7f01d7361640 1 -- start start 2024-08-18T22:09:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d7361640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d0100770 0x7f01d0199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d7361640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01d0101960 0x7f01d019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d7361640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01d0102320 0x7f01d01a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d7361640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f01d010c420 con 0x7f01d0102320 2024-08-18T22:09:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d7361640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f01d010c2a0 con 0x7f01d0101960 2024-08-18T22:09:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d7361640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f01d010c5a0 con 0x7f01d0100770 2024-08-18T22:09:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d58fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01d0102320 0x7f01d01a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d58fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01d0102320 0x7f01d01a1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55560/0 (socket says 172.21.15.123:55560) 2024-08-18T22:09:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d58fe640 1 -- 172.21.15.123:0/333075289 learned_addr learned my addr 172.21.15.123:0/333075289 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d48fc640 1 --2- 172.21.15.123:0/333075289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01d0101960 0x7f01d019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d50fd640 1 --2- 172.21.15.123:0/333075289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d0100770 0x7f01d0199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d58fe640 1 -- 172.21.15.123:0/333075289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d0100770 msgr2=0x7f01d0199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d58fe640 1 --2- 172.21.15.123:0/333075289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d0100770 0x7f01d0199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d58fe640 1 -- 172.21.15.123:0/333075289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01d0101960 msgr2=0x7f01d019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d58fe640 1 --2- 172.21.15.123:0/333075289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01d0101960 0x7f01d019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.409+0000 7f01d58fe640 1 -- 172.21.15.123:0/333075289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d01a18f0 con 0x7f01d0102320 2024-08-18T22:09:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.410+0000 7f01d58fe640 1 --2- 172.21.15.123:0/333075289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01d0102320 0x7f01d01a1250 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f01c802f540 tx=0x7f01c8031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.411+0000 7f01c67fc640 1 -- 172.21.15.123:0/333075289 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c8003b70 con 0x7f01d0102320 2024-08-18T22:09:33.413 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.411+0000 7f01c67fc640 1 -- 172.21.15.123:0/333075289 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01c8003d10 con 0x7f01d0102320 2024-08-18T22:09:33.413 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.411+0000 7f01d7361640 1 -- 172.21.15.123:0/333075289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d01a1b80 con 0x7f01d0102320 2024-08-18T22:09:33.413 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.411+0000 7f01c67fc640 1 -- 172.21.15.123:0/333075289 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c802fb50 con 0x7f01d0102320 2024-08-18T22:09:33.414 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.414+0000 7f01c67fc640 1 -- 172.21.15.123:0/333075289 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f01c802fcf0 con 0x7f01d0102320 2024-08-18T22:09:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.414+0000 7f01c67fc640 1 --2- 172.21.15.123:0/333075289 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f01bc0a2da0 0x7f01bc0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.414+0000 7f01d50fd640 1 --2- 172.21.15.123:0/333075289 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f01bc0a2da0 0x7f01bc0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.415+0000 7f01d50fd640 1 --2- 172.21.15.123:0/333075289 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f01bc0a2da0 0x7f01bc0a5260 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f01d019ab80 tx=0x7f01cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:33.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.487+0000 7fefd45c7740 1 Processor -- start 2024-08-18T22:09:33.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.487+0000 7fefd45c7740 1 -- start start 2024-08-18T22:09:33.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefd45c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc66210 0x5608bbc665f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefd45c7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc70eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefd45c7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc713f0 0x5608bbc737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefd45c7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5608bbbcb980 con 0x5608bbc66b30 2024-08-18T22:09:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefd45c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5608bbb63a70 con 0x5608bbc66210 2024-08-18T22:09:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefd45c7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5608bbbc7940 con 0x5608bbc713f0 2024-08-18T22:09:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefcaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc70eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefcaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc70eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55570/0 (socket says 172.21.15.123:55570) 2024-08-18T22:09:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefcaffd640 1 -- 172.21.15.123:0/1834971042 learned_addr learned my addr 172.21.15.123:0/1834971042 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefcbfff640 1 --2- 172.21.15.123:0/1834971042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc713f0 0x5608bbc737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefcb7fe640 1 --2- 172.21.15.123:0/1834971042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc66210 0x5608bbc665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefcaffd640 1 -- 172.21.15.123:0/1834971042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc713f0 msgr2=0x5608bbc737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefcaffd640 1 --2- 172.21.15.123:0/1834971042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc713f0 0x5608bbc737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefcaffd640 1 -- 172.21.15.123:0/1834971042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc66210 msgr2=0x5608bbc665f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefcaffd640 1 --2- 172.21.15.123:0/1834971042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc66210 0x5608bbc665f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.488+0000 7fefcaffd640 1 -- 172.21.15.123:0/1834971042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608bbbc66e0 con 0x5608bbc66b30 2024-08-18T22:09:33.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.489+0000 7fefcaffd640 1 --2- 172.21.15.123:0/1834971042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc70eb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fefc000bc80 tx=0x7fefc000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e98c3da649cb87 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:33.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.489+0000 7fefb1ffb640 1 -- 172.21.15.123:0/1834971042 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0015070 con 0x5608bbc66b30 2024-08-18T22:09:33.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.489+0000 7fefb1ffb640 1 -- 172.21.15.123:0/1834971042 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefc001a940 con 0x5608bbc66b30 2024-08-18T22:09:33.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.489+0000 7fefb1ffb640 1 -- 172.21.15.123:0/1834971042 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc00119b0 con 0x5608bbc66b30 2024-08-18T22:09:33.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.490+0000 7fefd45c7740 1 -- 172.21.15.123:0/1834971042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 msgr2=0x5608bbc70eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:33.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.490+0000 7fefd45c7740 1 --2- 172.21.15.123:0/1834971042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc70eb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fefc000bc80 tx=0x7fefc000f730 comp rx=0 tx=0).stop 2024-08-18T22:09:33.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.490+0000 7fefd45c7740 1 -- 172.21.15.123:0/1834971042 shutdown_connections 2024-08-18T22:09:33.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.490+0000 7fefd45c7740 1 --2- 172.21.15.123:0/1834971042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc713f0 0x5608bbc737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.490+0000 7fefd45c7740 1 --2- 172.21.15.123:0/1834971042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc70eb0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.490+0000 7fefd45c7740 1 --2- 172.21.15.123:0/1834971042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc66210 0x5608bbc665f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.490+0000 7fefd45c7740 1 -- 172.21.15.123:0/1834971042 >> 172.21.15.123:0/1834971042 conn(0x5608bbc627a0 msgr2=0x5608bbc62b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.490+0000 7fefd45c7740 1 -- 172.21.15.123:0/1834971042 shutdown_connections 2024-08-18T22:09:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.490+0000 7fefd45c7740 1 -- 172.21.15.123:0/1834971042 wait complete. 2024-08-18T22:09:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.490+0000 7fefd45c7740 1 -- start start 2024-08-18T22:09:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.491+0000 7fefd45c7740 1 Processor -- start 2024-08-18T22:09:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.491+0000 7fefd45c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc66210 0x5608bbc6e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.491+0000 7fefd45c7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66b30 0x5608bbc6e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.491+0000 7fefd45c7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc713f0 0x5608bbc6ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.491+0000 7fefd45c7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5608bbc73fc0 con 0x5608bbc713f0 2024-08-18T22:09:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.491+0000 7fefd45c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5608bbb86aa0 con 0x5608bbc66210 2024-08-18T22:09:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.491+0000 7fefd45c7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5608bbc74140 con 0x5608bbc66b30 2024-08-18T22:09:33.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.491+0000 7fefd45c7740 10 client.0 _ll_register_callbacks cb 0x5608bbb75e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:09:33.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.491+0000 7fefcbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc713f0 0x5608bbc6ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.491+0000 7fefcbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc713f0 0x5608bbc6ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55572/0 (socket says 172.21.15.123:55572) 2024-08-18T22:09:33.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.491+0000 7fefcbfff640 1 -- 172.21.15.123:0/4075398268 learned_addr learned my addr 172.21.15.123:0/4075398268 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:33.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.491+0000 7fefcb7fe640 1 --2- 172.21.15.123:0/4075398268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc66210 0x5608bbc6e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.491+0000 7fefcaffd640 1 --2- 172.21.15.123:0/4075398268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66b30 0x5608bbc6e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.492+0000 7fefcaffd640 1 -- 172.21.15.123:0/4075398268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc66210 msgr2=0x5608bbc6e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:33.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.492+0000 7fefcaffd640 1 --2- 172.21.15.123:0/4075398268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc66210 0x5608bbc6e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.492+0000 7fefcaffd640 1 -- 172.21.15.123:0/4075398268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc713f0 msgr2=0x5608bbc6ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:33.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.492+0000 7fefcaffd640 1 --2- 172.21.15.123:0/4075398268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc713f0 0x5608bbc6ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.492+0000 7fefcaffd640 1 -- 172.21.15.123:0/4075398268 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608bbb6a650 con 0x5608bbc66b30 2024-08-18T22:09:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.492+0000 7f01d7361640 1 -- 172.21.15.123:0/333075289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d01a20d0 con 0x7f01d0102320 2024-08-18T22:09:33.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.492+0000 7fefcaffd640 1 --2- 172.21.15.123:0/4075398268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66b30 0x5608bbc6e830 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fefc0006010 tx=0x7fefc000bfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea389fb8ae1d5738 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:33.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.492+0000 7fefaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-08-18T22:09:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:33.492+0000 7f01c67fc640 1 -- 172.21.15.123:0/333075289 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f01c80ba920 con 0x7f01d0102320 2024-08-18T22:09:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.492+0000 7fefaaffd640 1 -- 172.21.15.123:0/4075398268 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0015070 con 0x5608bbc66b30 2024-08-18T22:09:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.492+0000 7fefaaffd640 1 -- 172.21.15.123:0/4075398268 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fefc001a730 con 0x5608bbc66b30 2024-08-18T22:09:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.492+0000 7fefd45c7740 1 -- 172.21.15.123:0/4075398268 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefc001a940 con 0x5608bbc66b30 2024-08-18T22:09:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.493+0000 7fefaaffd640 1 -- 172.21.15.123:0/4075398268 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fefc001aaf0 con 0x5608bbc66b30 2024-08-18T22:09:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.493+0000 7fefd45c7740 10 client.25177 fetch_fsmap learned FSMap version 26 2024-08-18T22:09:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.493+0000 7fefd45c7740 1 -- 172.21.15.123:0/4075398268 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5608bb93d3c0 con 0x5608bbc66b30 2024-08-18T22:09:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.493+0000 7fefaaffd640 1 -- 172.21.15.123:0/4075398268 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefc001a940 con 0x5608bbc66b30 2024-08-18T22:09:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.493+0000 7fefaaffd640 1 -- 172.21.15.123:0/4075398268 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fefc0005450 con 0x5608bbc66b30 2024-08-18T22:09:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.493+0000 7fefd45c7740 10 client.25177 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:09:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.493+0000 7fefd45c7740 10 client.25177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:09:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.493+0000 7fefd45c7740 20 client.25177 populate_metadata read hostname 'smithi123' 2024-08-18T22:09:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.493+0000 7fefd45c7740 1 --2- 172.21.15.123:0/4075398268 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5608bbc80e80 0x5608bbc83270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.493+0000 7fefd45c7740 4 client.25177 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:09:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.493+0000 7fefd45c7740 1 -- 172.21.15.123:0/4075398268 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608bbbd8ef0 con 0x5608bbc80e80 2024-08-18T22:09:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.494+0000 7fefcb7fe640 1 --2- 172.21.15.123:0/4075398268 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5608bbc80e80 0x5608bbc83270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.494+0000 7fefaaffd640 10 client.25177 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.494+0000 7fefcb7fe640 1 --2- 172.21.15.123:0/4075398268 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5608bbc80e80 0x5608bbc83270 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42abfa4cc6ccca99 server_cookie=8cca10b098f5807a in_seq=0 out_seq=0 2024-08-18T22:09:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.495+0000 7fefaaffd640 1 -- 172.21.15.123:0/4075398268 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608bbbd8ef0 con 0x5608bbc80e80 2024-08-18T22:09:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.495+0000 7fefaaffd640 10 client.25177 handle_command_reply: tid=0 2024-08-18T22:09:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.495+0000 7fefd45c7740 1 client.25177 shutdown 2024-08-18T22:09:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.495+0000 7fefd45c7740 1 -- 172.21.15.123:0/4075398268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66b30 msgr2=0x5608bbc6e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:33.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.495+0000 7fefd45c7740 1 --2- 172.21.15.123:0/4075398268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66b30 0x5608bbc6e830 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fefc0006010 tx=0x7fefc000bfa0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.495+0000 7fefd45c7740 1 -- 172.21.15.123:0/4075398268 shutdown_connections 2024-08-18T22:09:33.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.495+0000 7fefd45c7740 1 --2- 172.21.15.123:0/4075398268 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5608bbc80e80 0x5608bbc83270 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.495+0000 7fefd45c7740 1 --2- 172.21.15.123:0/4075398268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc713f0 0x5608bbc6ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.495+0000 7fefd45c7740 1 --2- 172.21.15.123:0/4075398268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66b30 0x5608bbc6e830 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.495+0000 7fefaaffd640 0 client.25177 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:33.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.495+0000 7fefd45c7740 1 --2- 172.21.15.123:0/4075398268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc66210 0x5608bbc6e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.495+0000 7fefd45c7740 1 -- 172.21.15.123:0/4075398268 >> 172.21.15.123:0/4075398268 conn(0x5608bbc627a0 msgr2=0x5608bbc684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:33.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.495+0000 7fefd45c7740 1 -- 172.21.15.123:0/4075398268 shutdown_connections 2024-08-18T22:09:33.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.495+0000 7fefd45c7740 1 -- 172.21.15.123:0/4075398268 wait complete. 2024-08-18T22:09:33.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.496+0000 7fefd45c7740 20 client.25177 trim_cache size 0 max 16384 2024-08-18T22:09:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.513+0000 7fefd45c7740 1 Processor -- start 2024-08-18T22:09:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.513+0000 7fefd45c7740 1 -- start start 2024-08-18T22:09:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.513+0000 7fefd45c7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66210 0x5608bbc889e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.513+0000 7fefd45c7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc88f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.513+0000 7fefd45c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc713f0 0x5608bbc610e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.513+0000 7fefd45c7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc1af090 con 0x5608bbc66b30 2024-08-18T22:09:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.513+0000 7fefd45c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc1ac960 con 0x5608bbc713f0 2024-08-18T22:09:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.513+0000 7fefd45c7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc1aa7b0 con 0x5608bbc66210 2024-08-18T22:09:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.513+0000 7fefcaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc88f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.514+0000 7fefcaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc88f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55576/0 (socket says 172.21.15.123:55576) 2024-08-18T22:09:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.514+0000 7fefcaffd640 1 -- 172.21.15.123:0/3981455584 learned_addr learned my addr 172.21.15.123:0/3981455584 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.514+0000 7fefcb7fe640 1 --2- 172.21.15.123:0/3981455584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66210 0x5608bbc889e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.514+0000 7fefcbfff640 1 --2- 172.21.15.123:0/3981455584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc713f0 0x5608bbc610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.514+0000 7fefcaffd640 1 -- 172.21.15.123:0/3981455584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66210 msgr2=0x5608bbc889e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.514+0000 7fefcaffd640 1 --2- 172.21.15.123:0/3981455584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66210 0x5608bbc889e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.514+0000 7fefcaffd640 1 -- 172.21.15.123:0/3981455584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc713f0 msgr2=0x5608bbc610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.514+0000 7fefcaffd640 1 --2- 172.21.15.123:0/3981455584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc713f0 0x5608bbc610e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.514+0000 7fefcaffd640 1 -- 172.21.15.123:0/3981455584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608bbc68c30 con 0x5608bbc66b30 2024-08-18T22:09:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.514+0000 7fefcbfff640 1 --2- 172.21.15.123:0/3981455584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc713f0 0x5608bbc610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:09:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.514+0000 7fefcaffd640 1 --2- 172.21.15.123:0/3981455584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc88f20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fefc00115c0 tx=0x7fefc000bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0186589433e55a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.514+0000 7fefb17fa640 1 -- 172.21.15.123:0/3981455584 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0015070 con 0x5608bbc66b30 2024-08-18T22:09:33.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.514+0000 7fefb17fa640 1 -- 172.21.15.123:0/3981455584 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefc000b7c0 con 0x5608bbc66b30 2024-08-18T22:09:33.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.514+0000 7fefb17fa640 1 -- 172.21.15.123:0/3981455584 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc00052a0 con 0x5608bbc66b30 2024-08-18T22:09:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.515+0000 7fefd45c7740 1 -- 172.21.15.123:0/3981455584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 msgr2=0x5608bbc88f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.515+0000 7fefd45c7740 1 --2- 172.21.15.123:0/3981455584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc88f20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fefc00115c0 tx=0x7fefc000bb00 comp rx=0 tx=0).stop 2024-08-18T22:09:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.515+0000 7fefd45c7740 1 -- 172.21.15.123:0/3981455584 shutdown_connections 2024-08-18T22:09:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.515+0000 7fefd45c7740 1 --2- 172.21.15.123:0/3981455584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc713f0 0x5608bbc610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.515+0000 7fefd45c7740 1 --2- 172.21.15.123:0/3981455584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc88f20 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.515+0000 7fefd45c7740 1 --2- 172.21.15.123:0/3981455584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66210 0x5608bbc889e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.515+0000 7fefd45c7740 1 -- 172.21.15.123:0/3981455584 >> 172.21.15.123:0/3981455584 conn(0x5608bbc627a0 msgr2=0x5608bbc6d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.515+0000 7fefd45c7740 1 -- 172.21.15.123:0/3981455584 shutdown_connections 2024-08-18T22:09:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.515+0000 7fefd45c7740 1 -- 172.21.15.123:0/3981455584 wait complete. 2024-08-18T22:09:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.515+0000 7fefd45c7740 1 -- start start 2024-08-18T22:09:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.516+0000 7fefd45c7740 1 Processor -- start 2024-08-18T22:09:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.516+0000 7fefd45c7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66210 0x5608bbc79390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.516+0000 7fefd45c7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc798d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.516+0000 7fefd45c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc713f0 0x5608bbc6a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.516+0000 7fefd45c7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc1aae20 con 0x5608bbc66b30 2024-08-18T22:09:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.516+0000 7fefd45c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc1ac290 con 0x5608bbc713f0 2024-08-18T22:09:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.516+0000 7fefd45c7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc1ab4f0 con 0x5608bbc66210 2024-08-18T22:09:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.516+0000 7fefd45c7740 10 client.0 _ll_register_callbacks cb 0x7fefc409b200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:09:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.516+0000 7fefcaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc798d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.516+0000 7fefcb7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66210 0x5608bbc79390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.516+0000 7fefcaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc798d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55586/0 (socket says 172.21.15.123:55586) 2024-08-18T22:09:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.516+0000 7fefcaffd640 1 -- 172.21.15.123:0/2762244466 learned_addr learned my addr 172.21.15.123:0/2762244466 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.516+0000 7fefcbfff640 1 --2- 172.21.15.123:0/2762244466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc713f0 0x5608bbc6a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.517+0000 7fefcaffd640 1 -- 172.21.15.123:0/2762244466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66210 msgr2=0x5608bbc79390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.517+0000 7fefcaffd640 1 --2- 172.21.15.123:0/2762244466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66210 0x5608bbc79390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.517+0000 7fefcaffd640 1 -- 172.21.15.123:0/2762244466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc713f0 msgr2=0x5608bbc6a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.517+0000 7fefcaffd640 1 --2- 172.21.15.123:0/2762244466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc713f0 0x5608bbc6a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.517+0000 7fefcaffd640 1 -- 172.21.15.123:0/2762244466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608bbc6aee0 con 0x5608bbc66b30 2024-08-18T22:09:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.517+0000 7fefcb7fe640 1 --2- 172.21.15.123:0/2762244466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66210 0x5608bbc79390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:09:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.517+0000 7fefcbfff640 1 --2- 172.21.15.123:0/2762244466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc713f0 0x5608bbc6a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:09:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.517+0000 7fefcaffd640 1 --2- 172.21.15.123:0/2762244466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc798d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fefc000bc80 tx=0x7fefc0011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae586da3a5b27e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.517+0000 7fefaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:09:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.517+0000 7fefaaffd640 1 -- 172.21.15.123:0/2762244466 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0015040 con 0x5608bbc66b30 2024-08-18T22:09:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.517+0000 7fefaaffd640 1 -- 172.21.15.123:0/2762244466 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fefc0004230 con 0x5608bbc66b30 2024-08-18T22:09:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.517+0000 7fefd45c7740 1 -- 172.21.15.123:0/2762244466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefc000b7c0 con 0x5608bbc66b30 2024-08-18T22:09:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.517+0000 7fefaaffd640 1 -- 172.21.15.123:0/2762244466 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fefc0004430 con 0x5608bbc66b30 2024-08-18T22:09:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.517+0000 7fefd45c7740 10 client.15714 fetch_fsmap learned FSMap version 26 2024-08-18T22:09:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.517+0000 7fefd45c7740 1 -- 172.21.15.123:0/2762244466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5608bbceb1d0 con 0x5608bbc66b30 2024-08-18T22:09:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.518+0000 7fefaaffd640 1 -- 172.21.15.123:0/2762244466 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefc000b7c0 con 0x5608bbc66b30 2024-08-18T22:09:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.518+0000 7fefaaffd640 1 -- 172.21.15.123:0/2762244466 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fefc0004b20 con 0x5608bbc66b30 2024-08-18T22:09:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.518+0000 7fefd45c7740 10 client.15714 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:09:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.518+0000 7fefd45c7740 10 client.15714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:09:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.518+0000 7fefd45c7740 20 client.15714 populate_metadata read hostname 'smithi123' 2024-08-18T22:09:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.518+0000 7fefd45c7740 1 --2- 172.21.15.123:0/2762244466 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5608bbceb940 0x5608bbcedd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.518+0000 7fefd45c7740 4 client.15714 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:09:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.518+0000 7fefd45c7740 1 -- 172.21.15.123:0/2762244466 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5608bbbd3400 con 0x5608bbceb940 2024-08-18T22:09:33.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.518+0000 7fefcb7fe640 1 --2- 172.21.15.123:0/2762244466 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5608bbceb940 0x5608bbcedd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:33.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefaaffd640 10 client.15714 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:33.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.518+0000 7fefcb7fe640 1 --2- 172.21.15.123:0/2762244466 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5608bbceb940 0x5608bbcedd60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbf29713977207d3 server_cookie=b58eac187d511001 in_seq=0 out_seq=0 2024-08-18T22:09:33.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefaaffd640 1 -- 172.21.15.123:0/2762244466 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5608bbbd3400 con 0x5608bbceb940 2024-08-18T22:09:33.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefaaffd640 10 client.15714 handle_command_reply: tid=0 2024-08-18T22:09:33.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefd45c7740 1 client.15714 shutdown 2024-08-18T22:09:33.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefd45c7740 1 -- 172.21.15.123:0/2762244466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 msgr2=0x5608bbc798d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:33.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefd45c7740 1 --2- 172.21.15.123:0/2762244466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc798d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fefc000bc80 tx=0x7fefc0011660 comp rx=0 tx=0).stop 2024-08-18T22:09:33.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefd45c7740 1 -- 172.21.15.123:0/2762244466 shutdown_connections 2024-08-18T22:09:33.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefd45c7740 1 --2- 172.21.15.123:0/2762244466 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5608bbceb940 0x5608bbcedd60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefd45c7740 1 --2- 172.21.15.123:0/2762244466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608bbc713f0 0x5608bbc6a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefd45c7740 1 --2- 172.21.15.123:0/2762244466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608bbc66b30 0x5608bbc798d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefaaffd640 0 client.15714 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:33.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefd45c7740 1 --2- 172.21.15.123:0/2762244466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5608bbc66210 0x5608bbc79390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefd45c7740 1 -- 172.21.15.123:0/2762244466 >> 172.21.15.123:0/2762244466 conn(0x5608bbc627a0 msgr2=0x5608bbc67bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:33.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefd45c7740 1 -- 172.21.15.123:0/2762244466 shutdown_connections 2024-08-18T22:09:33.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefd45c7740 1 -- 172.21.15.123:0/2762244466 wait complete. 2024-08-18T22:09:33.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.519+0000 7fefd45c7740 20 client.15714 trim_cache size 0 max 16384 2024-08-18T22:09:33.525 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:09:33.525 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "no active scrubs running", 2024-08-18T22:09:33.525 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-08-18T22:09:33.525 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:09:33.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.520+0000 7fefd21c9640 1 -- 172.21.15.123:0/1072074378 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fefb40a2b80 msgr2=0x7fefb40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:33.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.520+0000 7fefd21c9640 1 --2- 172.21.15.123:0/1072074378 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fefb40a2b80 0x7fefb40a5040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0096c0 tx=0x7fefbc005a20 comp rx=0 tx=0).stop 2024-08-18T22:09:33.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.520+0000 7fefd21c9640 1 -- 172.21.15.123:0/1072074378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefcc102c20 msgr2=0x7fefcc19b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:33.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.520+0000 7fefd21c9640 1 --2- 172.21.15.123:0/1072074378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefcc102c20 0x7fefcc19b9f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fefc400da10 tx=0x7fefc400ded0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.520+0000 7fefd21c9640 1 -- 172.21.15.123:0/1072074378 shutdown_connections 2024-08-18T22:09:33.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.520+0000 7fefd21c9640 1 --2- 172.21.15.123:0/1072074378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefcc102c20 0x7fefcc19b9f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.520+0000 7fefd21c9640 1 --2- 172.21.15.123:0/1072074378 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fefb40a2b80 0x7fefb40a5040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.520+0000 7fefd21c9640 1 --2- 172.21.15.123:0/1072074378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefcc1022a0 0x7fefcc197660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.520+0000 7fefd21c9640 1 --2- 172.21.15.123:0/1072074378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefcc100b50 0x7fefcc197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:33.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.520+0000 7fefd21c9640 1 -- 172.21.15.123:0/1072074378 >> 172.21.15.123:0/1072074378 conn(0x7fefcc0fc500 msgr2=0x7fefcc0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:33.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.520+0000 7fefd21c9640 1 -- 172.21.15.123:0/1072074378 shutdown_connections 2024-08-18T22:09:33.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:09:33.520+0000 7fefd21c9640 1 -- 172.21.15.123:0/1072074378 wait complete. 2024-08-18T22:09:34.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.704+0000 7f01da1fc740 1 Processor -- start 2024-08-18T22:09:34.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01da1fc740 1 -- start start 2024-08-18T22:09:34.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01da1fc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011680 0x55bc6f011a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:34.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01da1fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011fc0 0x55bc6f016a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:34.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01da1fc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f017050 0x55bc6f019510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:34.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01da1fc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bc6ef749d0 con 0x55bc6f017050 2024-08-18T22:09:34.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01da1fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bc6ef1c820 con 0x55bc6f011fc0 2024-08-18T22:09:34.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01da1fc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bc6ef70990 con 0x55bc6f011680 2024-08-18T22:09:34.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01d58fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f017050 0x55bc6f019510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:34.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01d58fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f017050 0x55bc6f019510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55592/0 (socket says 172.21.15.123:55592) 2024-08-18T22:09:34.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01d58fe640 1 -- 172.21.15.123:0/995464011 learned_addr learned my addr 172.21.15.123:0/995464011 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:34.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01d48fc640 1 --2- 172.21.15.123:0/995464011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011fc0 0x55bc6f016a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:34.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01d50fd640 1 --2- 172.21.15.123:0/995464011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011680 0x55bc6f011a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:34.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01d58fe640 1 -- 172.21.15.123:0/995464011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011680 msgr2=0x55bc6f011a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:34.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01d58fe640 1 --2- 172.21.15.123:0/995464011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011680 0x55bc6f011a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01d58fe640 1 -- 172.21.15.123:0/995464011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011fc0 msgr2=0x55bc6f016a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:34.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01d58fe640 1 --2- 172.21.15.123:0/995464011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011fc0 0x55bc6f016a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01d58fe640 1 -- 172.21.15.123:0/995464011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc6ec88210 con 0x55bc6f017050 2024-08-18T22:09:34.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.705+0000 7f01d50fd640 1 --2- 172.21.15.123:0/995464011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011680 0x55bc6f011a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:09:34.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.706+0000 7f01d58fe640 1 --2- 172.21.15.123:0/995464011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f017050 0x55bc6f019510 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f01c80c4fc0 tx=0x7f01c802f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365f6eef8d5b5acd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:34.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.706+0000 7f01bb7fe640 1 -- 172.21.15.123:0/995464011 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c80bc880 con 0x55bc6f017050 2024-08-18T22:09:34.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.706+0000 7f01bb7fe640 1 -- 172.21.15.123:0/995464011 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01c80d4070 con 0x55bc6f017050 2024-08-18T22:09:34.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.706+0000 7f01bb7fe640 1 -- 172.21.15.123:0/995464011 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c80c5060 con 0x55bc6f017050 2024-08-18T22:09:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.707+0000 7f01da1fc740 1 -- 172.21.15.123:0/995464011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f017050 msgr2=0x55bc6f019510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.707+0000 7f01da1fc740 1 --2- 172.21.15.123:0/995464011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f017050 0x55bc6f019510 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f01c80c4fc0 tx=0x7f01c802f610 comp rx=0 tx=0).stop 2024-08-18T22:09:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.707+0000 7f01da1fc740 1 -- 172.21.15.123:0/995464011 shutdown_connections 2024-08-18T22:09:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.707+0000 7f01da1fc740 1 --2- 172.21.15.123:0/995464011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f017050 0x55bc6f019510 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.707+0000 7f01da1fc740 1 --2- 172.21.15.123:0/995464011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011fc0 0x55bc6f016a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.707+0000 7f01da1fc740 1 --2- 172.21.15.123:0/995464011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011680 0x55bc6f011a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.707+0000 7f01da1fc740 1 -- 172.21.15.123:0/995464011 >> 172.21.15.123:0/995464011 conn(0x55bc6f00ccf0 msgr2=0x55bc6f00d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.707+0000 7f01da1fc740 1 -- 172.21.15.123:0/995464011 shutdown_connections 2024-08-18T22:09:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.707+0000 7f01da1fc740 1 -- 172.21.15.123:0/995464011 wait complete. 2024-08-18T22:09:34.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.752+0000 7f01da1fc740 1 -- start start 2024-08-18T22:09:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.758+0000 7f01da1fc740 1 Processor -- start 2024-08-18T22:09:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.759+0000 7f01da1fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011680 0x55bc6f01b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.759+0000 7f01da1fc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f011fc0 0x55bc6f01b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.759+0000 7f01da1fc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f017050 0x55bc6f022980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.759+0000 7f01da1fc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bc6ef749d0 con 0x55bc6f011fc0 2024-08-18T22:09:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.759+0000 7f01da1fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bc6ef30520 con 0x55bc6f011680 2024-08-18T22:09:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.759+0000 7f01da1fc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bc6f019de0 con 0x55bc6f017050 2024-08-18T22:09:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.759+0000 7f01d48fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f011fc0 0x55bc6f01b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.759+0000 7f01d48fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f011fc0 0x55bc6f01b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55602/0 (socket says 172.21.15.123:55602) 2024-08-18T22:09:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.759+0000 7f01d48fc640 1 -- 172.21.15.123:0/449171724 learned_addr learned my addr 172.21.15.123:0/449171724 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.759+0000 7f01d58fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f017050 0x55bc6f022980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.759+0000 7f01d50fd640 1 --2- 172.21.15.123:0/449171724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011680 0x55bc6f01b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.759+0000 7f01da1fc740 10 client.0 _ll_register_callbacks cb 0x55bc6ec87a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:09:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.760+0000 7f01d48fc640 1 -- 172.21.15.123:0/449171724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f017050 msgr2=0x55bc6f022980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.760+0000 7f01d48fc640 1 --2- 172.21.15.123:0/449171724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f017050 0x55bc6f022980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.760+0000 7f01d48fc640 1 -- 172.21.15.123:0/449171724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011680 msgr2=0x55bc6f01b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.760+0000 7f01d48fc640 1 --2- 172.21.15.123:0/449171724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011680 0x55bc6f01b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.760+0000 7f01d48fc640 1 -- 172.21.15.123:0/449171724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc6ed54620 con 0x55bc6f011fc0 2024-08-18T22:09:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.760+0000 7f01d58fe640 1 --2- 172.21.15.123:0/449171724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f017050 0x55bc6f022980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:09:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.760+0000 7f01d48fc640 1 --2- 172.21.15.123:0/449171724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f011fc0 0x55bc6f01b940 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f01c00126e0 tx=0x7f01c0012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716eff9c96e4b556 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.760+0000 7f01b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:09:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.760+0000 7f01b8ff9640 1 -- 172.21.15.123:0/449171724 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c00120d0 con 0x55bc6f011fc0 2024-08-18T22:09:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.760+0000 7f01b8ff9640 1 -- 172.21.15.123:0/449171724 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f01c000f920 con 0x55bc6f011fc0 2024-08-18T22:09:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.773+0000 7f01da1fc740 1 -- 172.21.15.123:0/449171724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01c80d4070 con 0x55bc6f011fc0 2024-08-18T22:09:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.773+0000 7f01b8ff9640 1 -- 172.21.15.123:0/449171724 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f01c0012270 con 0x55bc6f011fc0 2024-08-18T22:09:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.773+0000 7f01da1fc740 10 client.15720 fetch_fsmap learned FSMap version 26 2024-08-18T22:09:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.773+0000 7f01da1fc740 1 -- 172.21.15.123:0/449171724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55bc6f025740 con 0x55bc6f011fc0 2024-08-18T22:09:34.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.796+0000 7f01b8ff9640 1 -- 172.21.15.123:0/449171724 <== mon.0 v2:172.21.15.123:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f01c000fb20 con 0x55bc6f011fc0 2024-08-18T22:09:34.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.796+0000 7f01da1fc740 10 client.15720 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:09:34.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.796+0000 7f01da1fc740 10 client.15720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:09:34.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.797+0000 7f01da1fc740 20 client.15720 populate_metadata read hostname 'smithi123' 2024-08-18T22:09:34.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.797+0000 7f01da1fc740 1 --2- 172.21.15.123:0/449171724 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bc6f026dd0 0x55bc6f029250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:34.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.797+0000 7f01da1fc740 4 client.15720 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:09:34.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.797+0000 7f01da1fc740 1 -- 172.21.15.123:0/449171724 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc6ef82100 con 0x55bc6f026dd0 2024-08-18T22:09:34.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.797+0000 7f01d50fd640 1 --2- 172.21.15.123:0/449171724 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bc6f026dd0 0x55bc6f029250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:34.799 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.797+0000 7f01b8ff9640 10 client.15720 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:34.799 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.797+0000 7f01d50fd640 1 --2- 172.21.15.123:0/449171724 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bc6f026dd0 0x55bc6f029250 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b86bfd9a920c360 server_cookie=d3aa964a7a3afaa4 in_seq=0 out_seq=0 2024-08-18T22:09:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.798+0000 7f01b8ff9640 1 -- 172.21.15.123:0/449171724 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc6ef82100 con 0x55bc6f026dd0 2024-08-18T22:09:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.798+0000 7f01b8ff9640 10 client.15720 handle_command_reply: tid=0 2024-08-18T22:09:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.798+0000 7f01da1fc740 1 client.15720 shutdown 2024-08-18T22:09:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.798+0000 7f01da1fc740 1 -- 172.21.15.123:0/449171724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f011fc0 msgr2=0x55bc6f01b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.798+0000 7f01da1fc740 1 --2- 172.21.15.123:0/449171724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f011fc0 0x55bc6f01b940 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f01c00126e0 tx=0x7f01c0012ba0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.798+0000 7f01da1fc740 1 -- 172.21.15.123:0/449171724 shutdown_connections 2024-08-18T22:09:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.798+0000 7f01da1fc740 1 --2- 172.21.15.123:0/449171724 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bc6f026dd0 0x55bc6f029250 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.798+0000 7f01da1fc740 1 --2- 172.21.15.123:0/449171724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f017050 0x55bc6f022980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.798+0000 7f01da1fc740 1 --2- 172.21.15.123:0/449171724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f011fc0 0x55bc6f01b940 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.798+0000 7f01da1fc740 1 --2- 172.21.15.123:0/449171724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011680 0x55bc6f01b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.798+0000 7f01b8ff9640 0 client.15720 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.798+0000 7f01da1fc740 1 -- 172.21.15.123:0/449171724 >> 172.21.15.123:0/449171724 conn(0x55bc6f00ccf0 msgr2=0x55bc6f00e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:34.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.799+0000 7f01da1fc740 1 -- 172.21.15.123:0/449171724 shutdown_connections 2024-08-18T22:09:34.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.799+0000 7f01da1fc740 1 -- 172.21.15.123:0/449171724 wait complete. 2024-08-18T22:09:34.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.799+0000 7f01da1fc740 20 client.15720 trim_cache size 0 max 16384 2024-08-18T22:09:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.828+0000 7f01da1fc740 1 Processor -- start 2024-08-18T22:09:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.828+0000 7f01da1fc740 1 -- start start 2024-08-18T22:09:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.828+0000 7f01da1fc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f00ccf0 0x55bc6f00d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.828+0000 7f01da1fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011680 0x55bc6f022940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.828+0000 7f01da1fc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011fc0 0x55bc6f00d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.828+0000 7f01da1fc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f01d01aeee0 con 0x55bc6f00ccf0 2024-08-18T22:09:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.828+0000 7f01da1fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f01d01ac7b0 con 0x55bc6f011680 2024-08-18T22:09:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.828+0000 7f01da1fc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f01d01aa600 con 0x55bc6f011fc0 2024-08-18T22:09:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.828+0000 7f01d50fd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f00ccf0 0x55bc6f00d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.828+0000 7f01d50fd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f00ccf0 0x55bc6f00d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55608/0 (socket says 172.21.15.123:55608) 2024-08-18T22:09:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.828+0000 7f01d50fd640 1 -- 172.21.15.123:0/3603188332 learned_addr learned my addr 172.21.15.123:0/3603188332 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.829+0000 7f01d48fc640 1 --2- 172.21.15.123:0/3603188332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011680 0x55bc6f022940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.829+0000 7f01d58fe640 1 --2- 172.21.15.123:0/3603188332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011fc0 0x55bc6f00d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.829+0000 7f01d50fd640 1 -- 172.21.15.123:0/3603188332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011fc0 msgr2=0x55bc6f00d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.829+0000 7f01d50fd640 1 --2- 172.21.15.123:0/3603188332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011fc0 0x55bc6f00d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.829+0000 7f01d50fd640 1 -- 172.21.15.123:0/3603188332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011680 msgr2=0x55bc6f022940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.829+0000 7f01d50fd640 1 --2- 172.21.15.123:0/3603188332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011680 0x55bc6f022940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.829+0000 7f01d50fd640 1 -- 172.21.15.123:0/3603188332 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc6f0124a0 con 0x55bc6f00ccf0 2024-08-18T22:09:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.829+0000 7f01d50fd640 1 --2- 172.21.15.123:0/3603188332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f00ccf0 0x55bc6f00d0d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009b40 tx=0x7f01cc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d10b1d351e5677 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:34.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.829+0000 7f01baffd640 1 -- 172.21.15.123:0/3603188332 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc003770 con 0x55bc6f00ccf0 2024-08-18T22:09:34.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.829+0000 7f01baffd640 1 -- 172.21.15.123:0/3603188332 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01cc003df0 con 0x55bc6f00ccf0 2024-08-18T22:09:34.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.829+0000 7f01baffd640 1 -- 172.21.15.123:0/3603188332 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc01ee10 con 0x55bc6f00ccf0 2024-08-18T22:09:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.830+0000 7f01da1fc740 1 -- 172.21.15.123:0/3603188332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f00ccf0 msgr2=0x55bc6f00d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.830+0000 7f01da1fc740 1 --2- 172.21.15.123:0/3603188332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f00ccf0 0x55bc6f00d0d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009b40 tx=0x7f01cc014000 comp rx=0 tx=0).stop 2024-08-18T22:09:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.830+0000 7f01da1fc740 1 -- 172.21.15.123:0/3603188332 shutdown_connections 2024-08-18T22:09:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.830+0000 7f01da1fc740 1 --2- 172.21.15.123:0/3603188332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011fc0 0x55bc6f00d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.830+0000 7f01da1fc740 1 --2- 172.21.15.123:0/3603188332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011680 0x55bc6f022940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.830+0000 7f01da1fc740 1 --2- 172.21.15.123:0/3603188332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f00ccf0 0x55bc6f00d0d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.830+0000 7f01da1fc740 1 -- 172.21.15.123:0/3603188332 >> 172.21.15.123:0/3603188332 conn(0x55bc6f016ba0 msgr2=0x55bc6f00bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.830+0000 7f01da1fc740 1 -- 172.21.15.123:0/3603188332 shutdown_connections 2024-08-18T22:09:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.830+0000 7f01da1fc740 1 -- 172.21.15.123:0/3603188332 wait complete. 2024-08-18T22:09:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.831+0000 7f01da1fc740 1 -- start start 2024-08-18T22:09:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.831+0000 7f01da1fc740 1 Processor -- start 2024-08-18T22:09:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.831+0000 7f01da1fc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f00ccf0 0x55bc6f020210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.831+0000 7f01da1fc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011680 0x55bc6f020750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.831+0000 7f01da1fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011fc0 0x55bc6f021760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.831+0000 7f01da1fc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f01d01aac70 con 0x55bc6f00ccf0 2024-08-18T22:09:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.831+0000 7f01da1fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f01d01ac0e0 con 0x55bc6f011fc0 2024-08-18T22:09:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.831+0000 7f01da1fc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f01d01ab340 con 0x55bc6f011680 2024-08-18T22:09:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.831+0000 7f01da1fc740 10 client.0 _ll_register_callbacks cb 0x7f01c0009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:09:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.832+0000 7f01d50fd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f00ccf0 0x55bc6f020210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.832+0000 7f01d50fd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f00ccf0 0x55bc6f020210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55616/0 (socket says 172.21.15.123:55616) 2024-08-18T22:09:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.832+0000 7f01d50fd640 1 -- 172.21.15.123:0/2188358234 learned_addr learned my addr 172.21.15.123:0/2188358234 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.832+0000 7f01d48fc640 1 --2- 172.21.15.123:0/2188358234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011680 0x55bc6f020750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.832+0000 7f01d58fe640 1 --2- 172.21.15.123:0/2188358234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011fc0 0x55bc6f021760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.832+0000 7f01d50fd640 1 -- 172.21.15.123:0/2188358234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011680 msgr2=0x55bc6f020750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.832+0000 7f01d50fd640 1 --2- 172.21.15.123:0/2188358234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011680 0x55bc6f020750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.832+0000 7f01d50fd640 1 -- 172.21.15.123:0/2188358234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011fc0 msgr2=0x55bc6f021760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.832+0000 7f01d50fd640 1 --2- 172.21.15.123:0/2188358234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011fc0 0x55bc6f021760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.832+0000 7f01d50fd640 1 -- 172.21.15.123:0/2188358234 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc6f021d70 con 0x55bc6f00ccf0 2024-08-18T22:09:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.832+0000 7f01d50fd640 1 --2- 172.21.15.123:0/2188358234 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f00ccf0 0x55bc6f020210 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f01cc003fd0 tx=0x7f01cc01e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb44939c3973d6e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.832+0000 7f01b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:09:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.832+0000 7f01b8ff9640 1 -- 172.21.15.123:0/2188358234 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc003770 con 0x55bc6f00ccf0 2024-08-18T22:09:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.832+0000 7f01b8ff9640 1 -- 172.21.15.123:0/2188358234 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f01cc003910 con 0x55bc6f00ccf0 2024-08-18T22:09:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.832+0000 7f01da1fc740 1 -- 172.21.15.123:0/2188358234 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01cc003df0 con 0x55bc6f00ccf0 2024-08-18T22:09:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.833+0000 7f01b8ff9640 1 -- 172.21.15.123:0/2188358234 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f01cc049050 con 0x55bc6f00ccf0 2024-08-18T22:09:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.833+0000 7f01da1fc740 10 client.15726 fetch_fsmap learned FSMap version 26 2024-08-18T22:09:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.833+0000 7f01da1fc740 1 -- 172.21.15.123:0/2188358234 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bc6f091be0 con 0x55bc6f00ccf0 2024-08-18T22:09:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.833+0000 7f01b8ff9640 1 -- 172.21.15.123:0/2188358234 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01cc003df0 con 0x55bc6f00ccf0 2024-08-18T22:09:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.833+0000 7f01b8ff9640 1 -- 172.21.15.123:0/2188358234 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f01cc0404a0 con 0x55bc6f00ccf0 2024-08-18T22:09:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.833+0000 7f01da1fc740 10 client.15726 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:09:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.833+0000 7f01da1fc740 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:09:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.833+0000 7f01da1fc740 20 client.15726 populate_metadata read hostname 'smithi123' 2024-08-18T22:09:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.833+0000 7f01da1fc740 1 --2- 172.21.15.123:0/2188358234 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bc6f017050 0x55bc6f0945a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.833+0000 7f01da1fc740 4 client.15726 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:09:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.833+0000 7f01da1fc740 1 -- 172.21.15.123:0/2188358234 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bc6ef7c450 con 0x55bc6f017050 2024-08-18T22:09:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.833+0000 7f01d48fc640 1 --2- 172.21.15.123:0/2188358234 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bc6f017050 0x55bc6f0945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.834+0000 7f01d48fc640 1 --2- 172.21.15.123:0/2188358234 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bc6f017050 0x55bc6f0945a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bf62df4aeaf1d29 server_cookie=ab5affd2193925a9 in_seq=0 out_seq=0 2024-08-18T22:09:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.834+0000 7f01b8ff9640 10 client.15726 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.849+0000 7f01b8ff9640 1 -- 172.21.15.123:0/2188358234 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bc6ef7c450 con 0x55bc6f017050 2024-08-18T22:09:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.849+0000 7f01b8ff9640 10 client.15726 handle_command_reply: tid=0 2024-08-18T22:09:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.849+0000 7f01da1fc740 1 client.15726 shutdown 2024-08-18T22:09:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.850+0000 7f01da1fc740 1 -- 172.21.15.123:0/2188358234 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f00ccf0 msgr2=0x55bc6f020210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.850+0000 7f01da1fc740 1 --2- 172.21.15.123:0/2188358234 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f00ccf0 0x55bc6f020210 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f01cc003fd0 tx=0x7f01cc01e570 comp rx=0 tx=0).stop 2024-08-18T22:09:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.850+0000 7f01da1fc740 1 -- 172.21.15.123:0/2188358234 shutdown_connections 2024-08-18T22:09:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.850+0000 7f01da1fc740 1 --2- 172.21.15.123:0/2188358234 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55bc6f017050 0x55bc6f0945a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.850+0000 7f01da1fc740 1 --2- 172.21.15.123:0/2188358234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc6f011fc0 0x55bc6f021760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.850+0000 7f01da1fc740 1 --2- 172.21.15.123:0/2188358234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bc6f011680 0x55bc6f020750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.850+0000 7f01da1fc740 1 --2- 172.21.15.123:0/2188358234 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bc6f00ccf0 0x55bc6f020210 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.850+0000 7f01b8ff9640 0 client.15726 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.850+0000 7f01da1fc740 1 -- 172.21.15.123:0/2188358234 >> 172.21.15.123:0/2188358234 conn(0x55bc6f016ba0 msgr2=0x55bc6f01a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.850+0000 7f01da1fc740 1 -- 172.21.15.123:0/2188358234 shutdown_connections 2024-08-18T22:09:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.850+0000 7f01da1fc740 1 -- 172.21.15.123:0/2188358234 wait complete. 2024-08-18T22:09:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.850+0000 7f01da1fc740 20 client.15726 trim_cache size 0 max 16384 2024-08-18T22:09:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:09:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:09:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:09:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:09:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.851+0000 7f01d7361640 1 -- 172.21.15.123:0/333075289 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f01bc0a2da0 msgr2=0x7f01bc0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.851+0000 7f01d7361640 1 --2- 172.21.15.123:0/333075289 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f01bc0a2da0 0x7f01bc0a5260 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f01d019ab80 tx=0x7f01cc005f90 comp rx=0 tx=0).stop 2024-08-18T22:09:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.851+0000 7f01d7361640 1 -- 172.21.15.123:0/333075289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01d0102320 msgr2=0x7f01d01a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.851+0000 7f01d7361640 1 --2- 172.21.15.123:0/333075289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01d0102320 0x7f01d01a1250 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f01c802f540 tx=0x7f01c8031750 comp rx=0 tx=0).stop 2024-08-18T22:09:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.851+0000 7f01d7361640 1 -- 172.21.15.123:0/333075289 shutdown_connections 2024-08-18T22:09:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.851+0000 7f01d7361640 1 --2- 172.21.15.123:0/333075289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01d0102320 0x7f01d01a1250 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.851+0000 7f01d7361640 1 --2- 172.21.15.123:0/333075289 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f01bc0a2da0 0x7f01bc0a5260 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.851+0000 7f01d7361640 1 --2- 172.21.15.123:0/333075289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01d0101960 0x7f01d019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.851+0000 7f01d7361640 1 --2- 172.21.15.123:0/333075289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d0100770 0x7f01d0199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.851+0000 7f01d7361640 1 -- 172.21.15.123:0/333075289 >> 172.21.15.123:0/333075289 conn(0x7f01d00fbf10 msgr2=0x7f01d00fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.851+0000 7f01d7361640 1 -- 172.21.15.123:0/333075289 shutdown_connections 2024-08-18T22:09:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:34.851+0000 7f01d7361640 1 -- 172.21.15.123:0/333075289 wait complete. 2024-08-18T22:09:35.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:34 smithi123 ceph-mon[18462]: pgmap v394: 129 pgs: 129 active+clean; 1015 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-08-18T22:09:35.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:34 smithi130 ceph-mon[21698]: pgmap v394: 129 pgs: 129 active+clean; 1015 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-08-18T22:09:35.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:34 smithi183 ceph-mon[22097]: pgmap v394: 129 pgs: 129 active+clean; 1015 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-08-18T22:09:35.942 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:35.942 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:36.208 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:36.209 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:36.256 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:36.257 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:36.257 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 38 -lt 100 ']' 2024-08-18T22:09:36.257 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 38 + 1 2024-08-18T22:09:36.791 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=39 2024-08-18T22:09:36.791 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:36.992 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:36.992 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:36.993 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:36.993 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:36.993 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:37.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:36 smithi130 ceph-mon[21698]: pgmap v395: 129 pgs: 129 active+clean; 1.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 10 op/s 2024-08-18T22:09:37.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:36 smithi183 ceph-mon[22097]: pgmap v395: 129 pgs: 129 active+clean; 1.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 10 op/s 2024-08-18T22:09:37.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:36 smithi123 ceph-mon[18462]: pgmap v395: 129 pgs: 129 active+clean; 1.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 10 op/s 2024-08-18T22:09:37.992 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:37.992 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:38.233 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:38.233 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:38.249 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:38.249 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:38.249 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 39 -lt 100 ']' 2024-08-18T22:09:38.250 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 39 + 1 2024-08-18T22:09:38.320 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=40 2024-08-18T22:09:38.320 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:38.383 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:38.384 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:38.385 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:38.385 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:38.385 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:39.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:38 smithi183 ceph-mon[22097]: pgmap v396: 129 pgs: 129 active+clean; 1.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.5 KiB/s wr, 10 op/s 2024-08-18T22:09:39.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:38 smithi123 ceph-mon[18462]: pgmap v396: 129 pgs: 129 active+clean; 1.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.5 KiB/s wr, 10 op/s 2024-08-18T22:09:39.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:38 smithi130 ceph-mon[21698]: pgmap v396: 129 pgs: 129 active+clean; 1.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.5 KiB/s wr, 10 op/s 2024-08-18T22:09:39.983 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:39.983 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:40.240 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:40.240 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:40.307 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:40.308 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:40.308 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 40 -lt 100 ']' 2024-08-18T22:09:40.308 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 40 + 1 2024-08-18T22:09:40.358 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=41 2024-08-18T22:09:40.358 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:40.367 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:40.367 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:40.368 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:40.368 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:40.368 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:41.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:40 smithi183 ceph-mon[22097]: pgmap v397: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-08-18T22:09:41.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:40 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:09:41.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:40 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:09:41.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:40 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:09:41.165 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:40 smithi123 ceph-mon[18462]: pgmap v397: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-08-18T22:09:41.165 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:40 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:09:41.165 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:40 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:09:41.166 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:40 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:09:41.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:40 smithi130 ceph-mon[21698]: pgmap v397: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-08-18T22:09:41.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:40 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:09:41.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:40 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:09:41.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:40 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:09:42.116 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:42.116 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:42.499 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:42.499 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:42.515 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:42.516 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:42.516 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 41 -lt 100 ']' 2024-08-18T22:09:42.516 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 41 + 1 2024-08-18T22:09:42.568 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=42 2024-08-18T22:09:42.568 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:42.609 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:42.609 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:42.610 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:42.611 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:42.611 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:43.037 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:42 smithi123 ceph-mon[18462]: pgmap v398: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-08-18T22:09:43.149 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-18T22:09:43.150 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:09:43.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:42 smithi183 ceph-mon[22097]: pgmap v398: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-08-18T22:09:43.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:42 smithi130 ceph-mon[21698]: pgmap v398: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-08-18T22:09:43.791 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:43.791 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:43.860 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:43.860 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:43.866 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:43.866 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:43.866 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 42 -lt 100 ']' 2024-08-18T22:09:43.866 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 42 + 1 2024-08-18T22:09:43.940 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=43 2024-08-18T22:09:43.941 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:43.951 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:43.951 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:43.953 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:43.953 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:43.953 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:44.566 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:44.566 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:44.798 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:44.799 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:44.815 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:44.815 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:44.815 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 43 -lt 100 ']' 2024-08-18T22:09:44.815 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 43 + 1 2024-08-18T22:09:44.858 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=44 2024-08-18T22:09:44.858 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:44.884 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:44.884 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:44.885 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:44.886 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:44.886 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:45.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:44 smithi183 ceph-mon[22097]: pgmap v399: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 12 op/s 2024-08-18T22:09:45.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:44 smithi123 ceph-mon[18462]: pgmap v399: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 12 op/s 2024-08-18T22:09:45.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:44 smithi130 ceph-mon[21698]: pgmap v399: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 12 op/s 2024-08-18T22:09:45.840 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:45.840 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:46.046 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:46.046 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:46.057 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:46.057 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:46.057 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 44 -lt 100 ']' 2024-08-18T22:09:46.058 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 44 + 1 2024-08-18T22:09:46.107 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=45 2024-08-18T22:09:46.107 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:46.151 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:46.151 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:46.152 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:46.152 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:46.152 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:46.962 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:46 smithi123 ceph-mon[18462]: pgmap v400: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-08-18T22:09:47.094 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:47.094 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:47.162 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:46 smithi183 ceph-mon[22097]: pgmap v400: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-08-18T22:09:47.201 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:47.201 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:47.233 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:47.233 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:47.233 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 45 -lt 100 ']' 2024-08-18T22:09:47.233 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 45 + 1 2024-08-18T22:09:47.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:46 smithi130 ceph-mon[21698]: pgmap v400: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-08-18T22:09:47.295 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=46 2024-08-18T22:09:47.296 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:47.326 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:47.326 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:47.327 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:47.327 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:47.327 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:48.590 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:48.590 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:48.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:48.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:48.907 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:48.907 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:48.908 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 46 -lt 100 ']' 2024-08-18T22:09:48.908 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 46 + 1 2024-08-18T22:09:49.014 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=47 2024-08-18T22:09:49.015 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:49.042 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:49.042 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:49.043 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:49.043 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:49.043 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:49.066 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:48 smithi130 ceph-mon[21698]: pgmap v401: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.7 KiB/s wr, 13 op/s 2024-08-18T22:09:49.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:48 smithi183 ceph-mon[22097]: pgmap v401: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.7 KiB/s wr, 13 op/s 2024-08-18T22:09:49.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:48 smithi123 ceph-mon[18462]: pgmap v401: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.7 KiB/s wr, 13 op/s 2024-08-18T22:09:50.431 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:50.431 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:50.909 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:50.909 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:50.949 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:50.949 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:50.949 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 47 -lt 100 ']' 2024-08-18T22:09:50.949 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 47 + 1 2024-08-18T22:09:51.023 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=48 2024-08-18T22:09:51.023 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:51.042 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:51.042 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:51.043 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:51.044 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:51.044 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:51.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:50 smithi123 ceph-mon[18462]: pgmap v402: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-08-18T22:09:51.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:50 smithi130 ceph-mon[21698]: pgmap v402: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-08-18T22:09:51.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:50 smithi183 ceph-mon[22097]: pgmap v402: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-08-18T22:09:52.241 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:51 smithi123 ceph-mon[18462]: pgmap v403: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 7 op/s 2024-08-18T22:09:52.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:51 smithi130 ceph-mon[21698]: pgmap v403: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 7 op/s 2024-08-18T22:09:52.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:51 smithi183 ceph-mon[22097]: pgmap v403: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 7 op/s 2024-08-18T22:09:52.581 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:52.581 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:52.922 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:52.922 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:53.051 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:53.051 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:53.052 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 48 -lt 100 ']' 2024-08-18T22:09:53.052 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 48 + 1 2024-08-18T22:09:53.159 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=49 2024-08-18T22:09:53.159 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:53.331 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:53.331 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:53.332 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:53.332 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:53.332 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:53.373 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.372+0000 7fe92cc10640 1 -- 172.21.15.123:0/3556385126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe928103440 msgr2=0x7fe928109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:53.374 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.372+0000 7fe92cc10640 1 --2- 172.21.15.123:0/3556385126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe928103440 0x7fe928109cd0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe920009ca0 tx=0x7fe92002a8c0 comp rx=0 tx=0).stop 2024-08-18T22:09:53.374 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.372+0000 7fe92cc10640 1 -- 172.21.15.123:0/3556385126 shutdown_connections 2024-08-18T22:09:53.374 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.372+0000 7fe92cc10640 1 --2- 172.21.15.123:0/3556385126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe928103440 0x7fe928109cd0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:53.374 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.372+0000 7fe92cc10640 1 --2- 172.21.15.123:0/3556385126 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe928102a80 0x7fe928102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:53.374 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.372+0000 7fe92cc10640 1 --2- 172.21.15.123:0/3556385126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe928101890 0x7fe928101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:53.374 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.372+0000 7fe92cc10640 1 -- 172.21.15.123:0/3556385126 >> 172.21.15.123:0/3556385126 conn(0x7fe9280fcff0 msgr2=0x7fe9280ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:53.374 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.373+0000 7fe92cc10640 1 -- 172.21.15.123:0/3556385126 shutdown_connections 2024-08-18T22:09:53.374 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.373+0000 7fe92cc10640 1 -- 172.21.15.123:0/3556385126 wait complete. 2024-08-18T22:09:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.574+0000 7fe92cc10640 1 Processor -- start 2024-08-18T22:09:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.574+0000 7fe92cc10640 1 -- start start 2024-08-18T22:09:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe92cc10640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe928101890 0x7fe928199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe92cc10640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe928102a80 0x7fe92819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe92cc10640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe928103440 0x7fe9281a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe92cc10640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe92810d560 con 0x7fe928103440 2024-08-18T22:09:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe92cc10640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe92810d3e0 con 0x7fe928102a80 2024-08-18T22:09:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe92cc10640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe92810d6e0 con 0x7fe928101890 2024-08-18T22:09:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe926d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe928103440 0x7fe9281a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe926d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe928103440 0x7fe9281a12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37588/0 (socket says 172.21.15.123:37588) 2024-08-18T22:09:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe926d9d640 1 -- 172.21.15.123:0/3536420262 learned_addr learned my addr 172.21.15.123:0/3536420262 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe925d9b640 1 --2- 172.21.15.123:0/3536420262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe928102a80 0x7fe92819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe92659c640 1 --2- 172.21.15.123:0/3536420262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe928101890 0x7fe928199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe926d9d640 1 -- 172.21.15.123:0/3536420262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe928101890 msgr2=0x7fe928199d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe926d9d640 1 --2- 172.21.15.123:0/3536420262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe928101890 0x7fe928199d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe926d9d640 1 -- 172.21.15.123:0/3536420262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe928102a80 msgr2=0x7fe92819a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe926d9d640 1 --2- 172.21.15.123:0/3536420262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe928102a80 0x7fe92819a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe926d9d640 1 -- 172.21.15.123:0/3536420262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9281a1940 con 0x7fe928103440 2024-08-18T22:09:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe925d9b640 1 --2- 172.21.15.123:0/3536420262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe928102a80 0x7fe92819a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:09:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.575+0000 7fe926d9d640 1 --2- 172.21.15.123:0/3536420262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe928103440 0x7fe9281a12a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe92002f540 tx=0x7fe920031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.577+0000 7fe9177fe640 1 -- 172.21.15.123:0/3536420262 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920003b70 con 0x7fe928103440 2024-08-18T22:09:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.577+0000 7fe9177fe640 1 -- 172.21.15.123:0/3536420262 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe920003d10 con 0x7fe928103440 2024-08-18T22:09:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.577+0000 7fe92cc10640 1 -- 172.21.15.123:0/3536420262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9281a1bd0 con 0x7fe928103440 2024-08-18T22:09:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.577+0000 7fe9177fe640 1 -- 172.21.15.123:0/3536420262 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92002fb50 con 0x7fe928103440 2024-08-18T22:09:53.580 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.580+0000 7fe9177fe640 1 -- 172.21.15.123:0/3536420262 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fe92002fcf0 con 0x7fe928103440 2024-08-18T22:09:53.581 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.580+0000 7fe9177fe640 1 --2- 172.21.15.123:0/3536420262 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe9100a2da0 0x7fe9100a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:53.581 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.580+0000 7fe92659c640 1 --2- 172.21.15.123:0/3536420262 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe9100a2da0 0x7fe9100a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:53.581 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.581+0000 7fe92659c640 1 --2- 172.21.15.123:0/3536420262 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe9100a2da0 0x7fe9100a5260 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe92819b200 tx=0x7fe918005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.582+0000 7fe92cc10640 1 -- 172.21.15.123:0/3536420262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9281a2120 con 0x7fe928103440 2024-08-18T22:09:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.582+0000 7fe9177fe640 1 -- 172.21.15.123:0/3536420262 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe9200bac10 con 0x7fe928103440 2024-08-18T22:09:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.915+0000 7fe92f9d2740 1 Processor -- start 2024-08-18T22:09:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.915+0000 7fe92f9d2740 1 -- start start 2024-08-18T22:09:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.915+0000 7fe92f9d2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58680 0x561142e58a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.915+0000 7fe92f9d2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58fc0 0x561142e5da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.915+0000 7fe92f9d2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e5e050 0x561142e60510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.915+0000 7fe92f9d2740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x561142dbb9d0 con 0x561142e5e050 2024-08-18T22:09:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.915+0000 7fe92f9d2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561142d63820 con 0x561142e58680 2024-08-18T22:09:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.915+0000 7fe92f9d2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x561142db7990 con 0x561142e58fc0 2024-08-18T22:09:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.915+0000 7fe926d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e5e050 0x561142e60510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.915+0000 7fe926d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e5e050 0x561142e60510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37598/0 (socket says 172.21.15.123:37598) 2024-08-18T22:09:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.916+0000 7fe926d9d640 1 -- 172.21.15.123:0/173790985 learned_addr learned my addr 172.21.15.123:0/173790985 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.916+0000 7fe92659c640 1 --2- 172.21.15.123:0/173790985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58680 0x561142e58a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.916+0000 7fe925d9b640 1 --2- 172.21.15.123:0/173790985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58fc0 0x561142e5da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.916+0000 7fe926d9d640 1 -- 172.21.15.123:0/173790985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58fc0 msgr2=0x561142e5da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.916+0000 7fe926d9d640 1 --2- 172.21.15.123:0/173790985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58fc0 0x561142e5da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.916+0000 7fe926d9d640 1 -- 172.21.15.123:0/173790985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58680 msgr2=0x561142e58a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.916+0000 7fe926d9d640 1 --2- 172.21.15.123:0/173790985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58680 0x561142e58a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.916+0000 7fe926d9d640 1 -- 172.21.15.123:0/173790985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561142acf210 con 0x561142e5e050 2024-08-18T22:09:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.916+0000 7fe92659c640 1 --2- 172.21.15.123:0/173790985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58680 0x561142e58a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:09:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.916+0000 7fe926d9d640 1 --2- 172.21.15.123:0/173790985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e5e050 0x561142e60510 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe9200c5050 tx=0x7fe92002f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bed0f64416f219 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.916+0000 7fe914ff9640 1 -- 172.21.15.123:0/173790985 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9200bd010 con 0x561142e5e050 2024-08-18T22:09:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.916+0000 7fe914ff9640 1 -- 172.21.15.123:0/173790985 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9200d4070 con 0x561142e5e050 2024-08-18T22:09:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.916+0000 7fe914ff9640 1 -- 172.21.15.123:0/173790985 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9200c5350 con 0x561142e5e050 2024-08-18T22:09:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.917+0000 7fe92f9d2740 1 -- 172.21.15.123:0/173790985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e5e050 msgr2=0x561142e60510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.917+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/173790985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e5e050 0x561142e60510 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe9200c5050 tx=0x7fe92002f610 comp rx=0 tx=0).stop 2024-08-18T22:09:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.917+0000 7fe92f9d2740 1 -- 172.21.15.123:0/173790985 shutdown_connections 2024-08-18T22:09:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.917+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/173790985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e5e050 0x561142e60510 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.917+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/173790985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58fc0 0x561142e5da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.917+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/173790985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58680 0x561142e58a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.917+0000 7fe92f9d2740 1 -- 172.21.15.123:0/173790985 >> 172.21.15.123:0/173790985 conn(0x561142e53cf0 msgr2=0x561142e540f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.917+0000 7fe92f9d2740 1 -- 172.21.15.123:0/173790985 shutdown_connections 2024-08-18T22:09:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.917+0000 7fe92f9d2740 1 -- 172.21.15.123:0/173790985 wait complete. 2024-08-18T22:09:53.950 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.949+0000 7fe92f9d2740 1 -- start start 2024-08-18T22:09:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.998+0000 7fe92f9d2740 1 Processor -- start 2024-08-18T22:09:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.998+0000 7fe92f9d2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58680 0x561142e623e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.998+0000 7fe92f9d2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e58fc0 0x561142e62920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.998+0000 7fe92f9d2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e5e050 0x561142e69960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.999+0000 7fe92f9d2740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x561142dbb9d0 con 0x561142e58fc0 2024-08-18T22:09:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.999+0000 7fe92f9d2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561142d77520 con 0x561142e5e050 2024-08-18T22:09:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.999+0000 7fe92f9d2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x561142e60de0 con 0x561142e58680 2024-08-18T22:09:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.999+0000 7fe925d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e58fc0 0x561142e62920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.999+0000 7fe925d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e58fc0 0x561142e62920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37604/0 (socket says 172.21.15.123:37604) 2024-08-18T22:09:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.999+0000 7fe925d9b640 1 -- 172.21.15.123:0/939503871 learned_addr learned my addr 172.21.15.123:0/939503871 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.999+0000 7fe926d9d640 1 --2- 172.21.15.123:0/939503871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e5e050 0x561142e69960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.999+0000 7fe92659c640 1 --2- 172.21.15.123:0/939503871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58680 0x561142e623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.999+0000 7fe925d9b640 1 -- 172.21.15.123:0/939503871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58680 msgr2=0x561142e623e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.999+0000 7fe925d9b640 1 --2- 172.21.15.123:0/939503871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58680 0x561142e623e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.999+0000 7fe925d9b640 1 -- 172.21.15.123:0/939503871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e5e050 msgr2=0x561142e69960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.999+0000 7fe925d9b640 1 --2- 172.21.15.123:0/939503871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e5e050 0x561142e69960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.999+0000 7fe925d9b640 1 -- 172.21.15.123:0/939503871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561142b9b620 con 0x561142e58fc0 2024-08-18T22:09:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.999+0000 7fe925d9b640 1 --2- 172.21.15.123:0/939503871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e58fc0 0x561142e62920 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe91c012b10 tx=0x7fe91c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99863ece92f43c36 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:53.999+0000 7fe90dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:09:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.000+0000 7fe90dffb640 1 -- 172.21.15.123:0/939503871 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c00fb40 con 0x561142e58fc0 2024-08-18T22:09:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.000+0000 7fe90dffb640 1 -- 172.21.15.123:0/939503871 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe91c00fce0 con 0x561142e58fc0 2024-08-18T22:09:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.000+0000 7fe92f9d2740 10 client.0 _ll_register_callbacks cb 0x561142acea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:09:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.001+0000 7fe92f9d2740 1 -- 172.21.15.123:0/939503871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9200d4070 con 0x561142e58fc0 2024-08-18T22:09:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.001+0000 7fe90dffb640 1 -- 172.21.15.123:0/939503871 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe91c004050 con 0x561142e58fc0 2024-08-18T22:09:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.001+0000 7fe92f9d2740 10 client.15738 fetch_fsmap learned FSMap version 26 2024-08-18T22:09:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.001+0000 7fe92f9d2740 1 -- 172.21.15.123:0/939503871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({fsmap=26}) -- 0x561142e6c620 con 0x561142e58fc0 2024-08-18T22:09:54.018 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.015+0000 7fe90dffb640 1 -- 172.21.15.123:0/939503871 <== mon.0 v2:172.21.15.123:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe91c0041f0 con 0x561142e58fc0 2024-08-18T22:09:54.018 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.015+0000 7fe92f9d2740 10 client.15738 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:09:54.018 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.015+0000 7fe92f9d2740 10 client.15738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:09:54.018 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.016+0000 7fe92f9d2740 20 client.15738 populate_metadata read hostname 'smithi123' 2024-08-18T22:09:54.018 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.016+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/939503871 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561142e6dcc0 0x561142e70160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:54.018 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.017+0000 7fe92f9d2740 4 client.15738 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:09:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.017+0000 7fe92f9d2740 1 -- 172.21.15.123:0/939503871 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561142dc9100 con 0x561142e6dcc0 2024-08-18T22:09:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.017+0000 7fe92659c640 1 --2- 172.21.15.123:0/939503871 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561142e6dcc0 0x561142e70160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.017+0000 7fe92659c640 1 --2- 172.21.15.123:0/939503871 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561142e6dcc0 0x561142e70160 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32c48fa9c2563c84 server_cookie=77ac7c57db818ea in_seq=0 out_seq=0 2024-08-18T22:09:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.017+0000 7fe90dffb640 10 client.15738 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.018+0000 7fe90dffb640 1 -- 172.21.15.123:0/939503871 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561142dc9100 con 0x561142e6dcc0 2024-08-18T22:09:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.018+0000 7fe90dffb640 10 client.15738 handle_command_reply: tid=0 2024-08-18T22:09:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.018+0000 7fe92f9d2740 1 client.15738 shutdown 2024-08-18T22:09:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.018+0000 7fe92f9d2740 1 -- 172.21.15.123:0/939503871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e58fc0 msgr2=0x561142e62920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.018+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/939503871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e58fc0 0x561142e62920 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe91c012b10 tx=0x7fe91c00f3c0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.019+0000 7fe92f9d2740 1 -- 172.21.15.123:0/939503871 shutdown_connections 2024-08-18T22:09:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.019+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/939503871 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561142e6dcc0 0x561142e70160 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.019+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/939503871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e5e050 0x561142e69960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.019+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/939503871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e58fc0 0x561142e62920 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.019+0000 7fe90dffb640 0 client.15738 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.019+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/939503871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58680 0x561142e623e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.019+0000 7fe92f9d2740 1 -- 172.21.15.123:0/939503871 >> 172.21.15.123:0/939503871 conn(0x561142e53cf0 msgr2=0x561142e55500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.019+0000 7fe92f9d2740 1 -- 172.21.15.123:0/939503871 shutdown_connections 2024-08-18T22:09:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.019+0000 7fe92f9d2740 1 -- 172.21.15.123:0/939503871 wait complete. 2024-08-18T22:09:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.019+0000 7fe92f9d2740 20 client.15738 trim_cache size 0 max 16384 2024-08-18T22:09:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.058+0000 7fe92f9d2740 1 Processor -- start 2024-08-18T22:09:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.058+0000 7fe92f9d2740 1 -- start start 2024-08-18T22:09:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.058+0000 7fe92f9d2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58680 0x561142e52d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.058+0000 7fe92f9d2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e58fc0 0x561142e69920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.058+0000 7fe92f9d2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e5e050 0x561142e74a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.058+0000 7fe92f9d2740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe9281aeef0 con 0x561142e58fc0 2024-08-18T22:09:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.058+0000 7fe92f9d2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe9281ac750 con 0x561142e58680 2024-08-18T22:09:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.058+0000 7fe92f9d2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe9281aa5a0 con 0x561142e5e050 2024-08-18T22:09:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.058+0000 7fe925d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e58fc0 0x561142e69920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.059+0000 7fe925d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e58fc0 0x561142e69920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37606/0 (socket says 172.21.15.123:37606) 2024-08-18T22:09:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.059+0000 7fe925d9b640 1 -- 172.21.15.123:0/927643545 learned_addr learned my addr 172.21.15.123:0/927643545 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.059+0000 7fe92659c640 1 --2- 172.21.15.123:0/927643545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58680 0x561142e52d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.059+0000 7fe926d9d640 1 --2- 172.21.15.123:0/927643545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e5e050 0x561142e74a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.059+0000 7fe925d9b640 1 -- 172.21.15.123:0/927643545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e5e050 msgr2=0x561142e74a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.059+0000 7fe925d9b640 1 --2- 172.21.15.123:0/927643545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e5e050 0x561142e74a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.059+0000 7fe925d9b640 1 -- 172.21.15.123:0/927643545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58680 msgr2=0x561142e52d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.059+0000 7fe925d9b640 1 --2- 172.21.15.123:0/927643545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58680 0x561142e52d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.059+0000 7fe925d9b640 1 -- 172.21.15.123:0/927643545 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561142e55b80 con 0x561142e58fc0 2024-08-18T22:09:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.059+0000 7fe925d9b640 1 --2- 172.21.15.123:0/927643545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e58fc0 0x561142e69920 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00f400 tx=0x7fe91c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e97e7f073aeb68 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.059+0000 7fe90ffff640 1 -- 172.21.15.123:0/927643545 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0041f0 con 0x561142e58fc0 2024-08-18T22:09:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.059+0000 7fe90ffff640 1 -- 172.21.15.123:0/927643545 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9200d4070 con 0x561142e58fc0 2024-08-18T22:09:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.059+0000 7fe90ffff640 1 -- 172.21.15.123:0/927643545 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c004a00 con 0x561142e58fc0 2024-08-18T22:09:54.065 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.060+0000 7fe92f9d2740 1 -- 172.21.15.123:0/927643545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e58fc0 msgr2=0x561142e69920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:54.065 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.060+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/927643545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e58fc0 0x561142e69920 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00f400 tx=0x7fe91c013000 comp rx=0 tx=0).stop 2024-08-18T22:09:54.065 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.060+0000 7fe92f9d2740 1 -- 172.21.15.123:0/927643545 shutdown_connections 2024-08-18T22:09:54.065 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.060+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/927643545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e5e050 0x561142e74a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.060+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/927643545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e58fc0 0x561142e69920 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.060+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/927643545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58680 0x561142e52d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.060+0000 7fe92f9d2740 1 -- 172.21.15.123:0/927643545 >> 172.21.15.123:0/927643545 conn(0x561142e53cf0 msgr2=0x561142e52680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.060+0000 7fe92f9d2740 1 -- 172.21.15.123:0/927643545 shutdown_connections 2024-08-18T22:09:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.060+0000 7fe92f9d2740 1 -- 172.21.15.123:0/927643545 wait complete. 2024-08-18T22:09:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.061+0000 7fe92f9d2740 1 -- start start 2024-08-18T22:09:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.061+0000 7fe92f9d2740 1 Processor -- start 2024-08-18T22:09:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.061+0000 7fe92f9d2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58680 0x561142e67730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.061+0000 7fe92f9d2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58fc0 0x561142e67c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.061+0000 7fe92f9d2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e5e050 0x561142e68c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.061+0000 7fe92f9d2740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe9281aac10 con 0x561142e5e050 2024-08-18T22:09:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.061+0000 7fe92f9d2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe9281ac080 con 0x561142e58fc0 2024-08-18T22:09:54.067 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.061+0000 7fe92f9d2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe9281ab2e0 con 0x561142e58680 2024-08-18T22:09:54.067 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.061+0000 7fe92f9d2740 10 client.0 _ll_register_callbacks cb 0x7fe91c009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:09:54.067 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.061+0000 7fe926d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e5e050 0x561142e68c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:54.067 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.061+0000 7fe926d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e5e050 0x561142e68c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37610/0 (socket says 172.21.15.123:37610) 2024-08-18T22:09:54.067 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.061+0000 7fe926d9d640 1 -- 172.21.15.123:0/1887635168 learned_addr learned my addr 172.21.15.123:0/1887635168 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:09:54.067 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.061+0000 7fe92659c640 1 --2- 172.21.15.123:0/1887635168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58680 0x561142e67730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:54.067 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.061+0000 7fe925d9b640 1 --2- 172.21.15.123:0/1887635168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58fc0 0x561142e67c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:54.067 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.062+0000 7fe926d9d640 1 -- 172.21.15.123:0/1887635168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58680 msgr2=0x561142e67730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:54.067 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.062+0000 7fe926d9d640 1 --2- 172.21.15.123:0/1887635168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58680 0x561142e67730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.067 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.062+0000 7fe926d9d640 1 -- 172.21.15.123:0/1887635168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58fc0 msgr2=0x561142e67c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:09:54.067 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.062+0000 7fe926d9d640 1 --2- 172.21.15.123:0/1887635168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58fc0 0x561142e67c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.067 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.062+0000 7fe926d9d640 1 -- 172.21.15.123:0/1887635168 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561142e69290 con 0x561142e5e050 2024-08-18T22:09:54.067 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.062+0000 7fe92659c640 1 --2- 172.21.15.123:0/1887635168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58680 0x561142e67730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:09:54.068 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.062+0000 7fe926d9d640 1 --2- 172.21.15.123:0/1887635168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e5e050 0x561142e68c80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe9200b8ce0 tx=0x7fe9200b9120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914f621320247316 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:09:54.068 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.062+0000 7fe90dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:09:54.068 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.062+0000 7fe90dffb640 1 -- 172.21.15.123:0/1887635168 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9200ca060 con 0x561142e5e050 2024-08-18T22:09:54.068 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.062+0000 7fe90dffb640 1 -- 172.21.15.123:0/1887635168 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe9200c52f0 con 0x561142e5e050 2024-08-18T22:09:54.068 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.062+0000 7fe92f9d2740 1 -- 172.21.15.123:0/1887635168 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9200d4070 con 0x561142e5e050 2024-08-18T22:09:54.068 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.062+0000 7fe90dffb640 1 -- 172.21.15.123:0/1887635168 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe9200c5580 con 0x561142e5e050 2024-08-18T22:09:54.068 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.062+0000 7fe92f9d2740 10 client.15744 fetch_fsmap learned FSMap version 26 2024-08-18T22:09:54.068 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.062+0000 7fe92f9d2740 1 -- 172.21.15.123:0/1887635168 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561142ed91c0 con 0x561142e5e050 2024-08-18T22:09:54.068 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.062+0000 7fe90dffb640 1 -- 172.21.15.123:0/1887635168 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9200d4070 con 0x561142e5e050 2024-08-18T22:09:54.068 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.063+0000 7fe90dffb640 1 -- 172.21.15.123:0/1887635168 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe920004b40 con 0x561142e5e050 2024-08-18T22:09:54.068 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.063+0000 7fe92f9d2740 10 client.15744 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:09:54.068 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.063+0000 7fe92f9d2740 10 client.15744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:09:54.068 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.063+0000 7fe92f9d2740 20 client.15744 populate_metadata read hostname 'smithi123' 2024-08-18T22:09:54.069 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.063+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/1887635168 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561142ed9900 0x561142edbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:09:54.069 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.063+0000 7fe92f9d2740 4 client.15744 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:09:54.069 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.063+0000 7fe92f9d2740 1 -- 172.21.15.123:0/1887635168 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561142dc3450 con 0x561142ed9900 2024-08-18T22:09:54.069 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.063+0000 7fe92659c640 1 --2- 172.21.15.123:0/1887635168 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561142ed9900 0x561142edbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:09:54.069 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.064+0000 7fe90dffb640 10 client.15744 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:54.069 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.064+0000 7fe92659c640 1 --2- 172.21.15.123:0/1887635168 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561142ed9900 0x561142edbd20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=939f832acc3d4e66 server_cookie=aa0a1e61d47b684a in_seq=0 out_seq=0 2024-08-18T22:09:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.078+0000 7fe90dffb640 1 -- 172.21.15.123:0/1887635168 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561142dc3450 con 0x561142ed9900 2024-08-18T22:09:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.078+0000 7fe90dffb640 10 client.15744 handle_command_reply: tid=0 2024-08-18T22:09:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.078+0000 7fe92f9d2740 1 client.15744 shutdown 2024-08-18T22:09:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.079+0000 7fe92f9d2740 1 -- 172.21.15.123:0/1887635168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e5e050 msgr2=0x561142e68c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.079+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/1887635168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e5e050 0x561142e68c80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe9200b8ce0 tx=0x7fe9200b9120 comp rx=0 tx=0).stop 2024-08-18T22:09:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.079+0000 7fe92f9d2740 1 -- 172.21.15.123:0/1887635168 shutdown_connections 2024-08-18T22:09:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.079+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/1887635168 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561142ed9900 0x561142edbd20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.079+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/1887635168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561142e5e050 0x561142e68c80 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.079+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/1887635168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561142e58fc0 0x561142e67c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.079+0000 7fe92f9d2740 1 --2- 172.21.15.123:0/1887635168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561142e58680 0x561142e67730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.079+0000 7fe90dffb640 0 client.15744 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:09:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.079+0000 7fe92f9d2740 1 -- 172.21.15.123:0/1887635168 >> 172.21.15.123:0/1887635168 conn(0x561142e53cf0 msgr2=0x561142e55320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.079+0000 7fe92f9d2740 1 -- 172.21.15.123:0/1887635168 shutdown_connections 2024-08-18T22:09:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.079+0000 7fe92f9d2740 1 -- 172.21.15.123:0/1887635168 wait complete. 2024-08-18T22:09:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.079+0000 7fe92f9d2740 20 client.15744 trim_cache size 0 max 16384 2024-08-18T22:09:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:09:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:09:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:09:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:09:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.080+0000 7fe92cc10640 1 -- 172.21.15.123:0/3536420262 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe9100a2da0 msgr2=0x7fe9100a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.080+0000 7fe92cc10640 1 --2- 172.21.15.123:0/3536420262 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe9100a2da0 0x7fe9100a5260 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe92819b200 tx=0x7fe918005f90 comp rx=0 tx=0).stop 2024-08-18T22:09:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.080+0000 7fe92cc10640 1 -- 172.21.15.123:0/3536420262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe928103440 msgr2=0x7fe9281a12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:09:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.080+0000 7fe92cc10640 1 --2- 172.21.15.123:0/3536420262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe928103440 0x7fe9281a12a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe92002f540 tx=0x7fe920031750 comp rx=0 tx=0).stop 2024-08-18T22:09:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.080+0000 7fe92cc10640 1 -- 172.21.15.123:0/3536420262 shutdown_connections 2024-08-18T22:09:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.080+0000 7fe92cc10640 1 --2- 172.21.15.123:0/3536420262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe928103440 0x7fe9281a12a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.084 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.080+0000 7fe92cc10640 1 --2- 172.21.15.123:0/3536420262 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe9100a2da0 0x7fe9100a5260 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.084 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.080+0000 7fe92cc10640 1 --2- 172.21.15.123:0/3536420262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe928102a80 0x7fe92819a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.084 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.080+0000 7fe92cc10640 1 --2- 172.21.15.123:0/3536420262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe928101890 0x7fe928199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:09:54.084 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.080+0000 7fe92cc10640 1 -- 172.21.15.123:0/3536420262 >> 172.21.15.123:0/3536420262 conn(0x7fe9280fcff0 msgr2=0x7fe928074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:09:54.084 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.080+0000 7fe92cc10640 1 -- 172.21.15.123:0/3536420262 shutdown_connections 2024-08-18T22:09:54.084 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:09:54.080+0000 7fe92cc10640 1 -- 172.21.15.123:0/3536420262 wait complete. 2024-08-18T22:09:54.806 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:54.806 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:54.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:54 smithi183 ceph-mon[22097]: pgmap v404: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 KiB/s wr, 7 op/s 2024-08-18T22:09:55.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:54 smithi123 ceph-mon[18462]: pgmap v404: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 KiB/s wr, 7 op/s 2024-08-18T22:09:55.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:54 smithi130 ceph-mon[21698]: pgmap v404: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 KiB/s wr, 7 op/s 2024-08-18T22:09:55.059 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:55.059 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:55.097 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:55.097 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:55.097 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 49 -lt 100 ']' 2024-08-18T22:09:55.097 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 49 + 1 2024-08-18T22:09:55.163 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=50 2024-08-18T22:09:55.163 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:55.207 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:55.207 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:55.208 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:55.208 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:55.208 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:56.364 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:56.364 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:56.696 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:56.697 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:56.713 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:56.713 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:56.713 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 50 -lt 100 ']' 2024-08-18T22:09:56.713 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 50 + 1 2024-08-18T22:09:56.824 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=51 2024-08-18T22:09:56.824 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:56.864 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:56.864 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:56.866 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:56.866 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:56.866 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:56.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:56 smithi183 ceph-mon[22097]: pgmap v405: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-08-18T22:09:57.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:56 smithi123 ceph-mon[18462]: pgmap v405: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-08-18T22:09:57.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:56 smithi130 ceph-mon[21698]: pgmap v405: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-08-18T22:09:57.817 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:57.817 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:58.137 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:58.137 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:58.146 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:58.146 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:58.146 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 51 -lt 100 ']' 2024-08-18T22:09:58.146 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 51 + 1 2024-08-18T22:09:58.221 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=52 2024-08-18T22:09:58.221 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:58.331 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:58.331 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:58.332 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:58.332 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:58.332 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:09:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:09:58.921 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:09:58 smithi123 ceph-mon[18462]: pgmap v406: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-08-18T22:09:59.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:09:58 smithi130 ceph-mon[21698]: pgmap v406: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-08-18T22:09:59.133 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:59.133 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:59.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:09:58 smithi183 ceph-mon[22097]: pgmap v406: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-08-18T22:09:59.471 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:09:59.471 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:09:59.480 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:59.480 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:09:59.480 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 52 -lt 100 ']' 2024-08-18T22:09:59.480 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 52 + 1 2024-08-18T22:09:59.596 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=53 2024-08-18T22:09:59.597 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:09:59.646 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:09:59.647 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:09:59.647 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:09:59.647 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:09:59.648 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:00.863 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:00.863 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:01.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:00 smithi123 ceph-mon[18462]: pgmap v407: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-08-18T22:10:01.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:00 smithi123 ceph-mon[18462]: overall HEALTH_OK 2024-08-18T22:10:01.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:00 smithi130 ceph-mon[21698]: pgmap v407: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-08-18T22:10:01.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:00 smithi130 ceph-mon[21698]: overall HEALTH_OK 2024-08-18T22:10:01.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:00 smithi183 ceph-mon[22097]: pgmap v407: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-08-18T22:10:01.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:00 smithi183 ceph-mon[22097]: overall HEALTH_OK 2024-08-18T22:10:01.196 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:01.196 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:01.230 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:01.231 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:01.231 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 53 -lt 100 ']' 2024-08-18T22:10:01.231 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 53 + 1 2024-08-18T22:10:01.304 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=54 2024-08-18T22:10:01.304 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:01.338 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:01.338 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:01.339 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:01.340 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:01.340 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:02.482 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:02.483 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:02.779 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:02.779 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:02.795 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:02.795 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:02.795 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 54 -lt 100 ']' 2024-08-18T22:10:02.795 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 54 + 1 2024-08-18T22:10:02.837 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=55 2024-08-18T22:10:02.837 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:02.877 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:02.877 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:02.878 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:02.878 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:02.878 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:03.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:02 smithi123 ceph-mon[18462]: pgmap v408: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.7 KiB/s wr, 12 op/s 2024-08-18T22:10:03.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:02 smithi130 ceph-mon[21698]: pgmap v408: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.7 KiB/s wr, 12 op/s 2024-08-18T22:10:03.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:02 smithi183 ceph-mon[22097]: pgmap v408: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.7 KiB/s wr, 12 op/s 2024-08-18T22:10:03.621 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:03.621 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:03.946 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:03.946 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:03.962 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:03.962 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:03.963 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 55 -lt 100 ']' 2024-08-18T22:10:03.963 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 55 + 1 2024-08-18T22:10:04.037 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=56 2024-08-18T22:10:04.037 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:04.099 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:04.099 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:04.099 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:04.099 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:04.099 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.589+0000 7fabcc850640 1 -- 172.21.15.123:0/943446911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc8074240 msgr2=0x7fabc8074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.589+0000 7fabcc850640 1 --2- 172.21.15.123:0/943446911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc8074240 0x7fabc8074620 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009ca0 tx=0x7fabb802a950 comp rx=0 tx=0).stop 2024-08-18T22:10:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.589+0000 7fabcc850640 1 -- 172.21.15.123:0/943446911 shutdown_connections 2024-08-18T22:10:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.589+0000 7fabcc850640 1 --2- 172.21.15.123:0/943446911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fabc810e180 0x7fabc8110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.589+0000 7fabcc850640 1 --2- 172.21.15.123:0/943446911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabc8074b60 0x7fabc810dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.589+0000 7fabcc850640 1 --2- 172.21.15.123:0/943446911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc8074240 0x7fabc8074620 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.589+0000 7fabcc850640 1 -- 172.21.15.123:0/943446911 >> 172.21.15.123:0/943446911 conn(0x7fabc80fd620 msgr2=0x7fabc80ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.589+0000 7fabcc850640 1 -- 172.21.15.123:0/943446911 shutdown_connections 2024-08-18T22:10:04.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.589+0000 7fabcc850640 1 -- 172.21.15.123:0/943446911 wait complete. 2024-08-18T22:10:04.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.590+0000 7fabcc850640 1 Processor -- start 2024-08-18T22:10:04.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.590+0000 7fabcc850640 1 -- start start 2024-08-18T22:10:04.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabcc850640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc8074240 0x7fabc819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:04.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabcc850640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabc8074b60 0x7fabc819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:04.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabcc850640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fabc810e180 0x7fabc819ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:04.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabcc850640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fabc8113eb0 con 0x7fabc8074240 2024-08-18T22:10:04.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabcc850640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fabc8113d30 con 0x7fabc810e180 2024-08-18T22:10:04.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabcc850640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fabc8114030 con 0x7fabc8074b60 2024-08-18T22:10:04.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabc659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc8074240 0x7fabc819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:04.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabc659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc8074240 0x7fabc819a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58092/0 (socket says 172.21.15.123:58092) 2024-08-18T22:10:04.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabc659c640 1 -- 172.21.15.123:0/1620659739 learned_addr learned my addr 172.21.15.123:0/1620659739 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:04.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabc6d9d640 1 --2- 172.21.15.123:0/1620659739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fabc810e180 0x7fabc819ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:04.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabc5d9b640 1 --2- 172.21.15.123:0/1620659739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabc8074b60 0x7fabc819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:04.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabc659c640 1 -- 172.21.15.123:0/1620659739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabc8074b60 msgr2=0x7fabc819a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:04.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabc659c640 1 --2- 172.21.15.123:0/1620659739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabc8074b60 0x7fabc819a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:04.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabc659c640 1 -- 172.21.15.123:0/1620659739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fabc810e180 msgr2=0x7fabc819ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:04.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabc659c640 1 --2- 172.21.15.123:0/1620659739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fabc810e180 0x7fabc819ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:04.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.591+0000 7fabc659c640 1 -- 172.21.15.123:0/1620659739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc819f3c0 con 0x7fabc8074240 2024-08-18T22:10:04.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.592+0000 7fabc659c640 1 --2- 172.21.15.123:0/1620659739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc8074240 0x7fabc819a410 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fabb8005cc0 tx=0x7fabb802f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:04.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.592+0000 7fabbf7fe640 1 -- 172.21.15.123:0/1620659739 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb8034040 con 0x7fabc8074240 2024-08-18T22:10:04.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.592+0000 7fabcc850640 1 -- 172.21.15.123:0/1620659739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc819f650 con 0x7fabc8074240 2024-08-18T22:10:04.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.592+0000 7fabbf7fe640 1 -- 172.21.15.123:0/1620659739 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabb8030920 con 0x7fabc8074240 2024-08-18T22:10:04.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.592+0000 7fabbf7fe640 1 -- 172.21.15.123:0/1620659739 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb8004830 con 0x7fabc8074240 2024-08-18T22:10:04.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.592+0000 7fabcc850640 1 -- 172.21.15.123:0/1620659739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc81a6f90 con 0x7fabc8074240 2024-08-18T22:10:04.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.594+0000 7fabcc850640 1 -- 172.21.15.123:0/1620659739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc8074620 con 0x7fabc8074240 2024-08-18T22:10:04.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.595+0000 7fabbf7fe640 1 -- 172.21.15.123:0/1620659739 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fabb8037020 con 0x7fabc8074240 2024-08-18T22:10:04.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.596+0000 7fabbf7fe640 1 --2- 172.21.15.123:0/1620659739 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fabb40a2c00 0x7fabb40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:04.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.596+0000 7fabc5d9b640 1 --2- 172.21.15.123:0/1620659739 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fabb40a2c00 0x7fabb40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:04.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.596+0000 7fabbf7fe640 1 -- 172.21.15.123:0/1620659739 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fabb80f0290 con 0x7fabc8074240 2024-08-18T22:10:04.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.596+0000 7fabc5d9b640 1 --2- 172.21.15.123:0/1620659739 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fabb40a2c00 0x7fabb40a50c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fabc80ffc90 tx=0x7fabb000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:04.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.600+0000 7fabbf7fe640 1 -- 172.21.15.123:0/1620659739 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fabb80bce60 con 0x7fabc8074240 2024-08-18T22:10:04.754 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:04.754 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:04.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.813+0000 7fabcc850640 1 -- 172.21.15.123:0/1620659739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabc8109300 con 0x7fabc8074240 2024-08-18T22:10:04.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.813+0000 7fabbf7fe640 1 -- 172.21.15.123:0/1620659739 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7fabb80bc760 con 0x7fabc8074240 2024-08-18T22:10:04.815 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:10:04.815 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"btime":"2024-08-18T22:07:46:492460+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:07:45.601053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:10:04.815 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 26 2024-08-18T22:10:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.815+0000 7fabcc850640 1 -- 172.21.15.123:0/1620659739 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fabb40a2c00 msgr2=0x7fabb40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.815+0000 7fabcc850640 1 --2- 172.21.15.123:0/1620659739 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fabb40a2c00 0x7fabb40a50c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fabc80ffc90 tx=0x7fabb000b390 comp rx=0 tx=0).stop 2024-08-18T22:10:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.815+0000 7fabcc850640 1 -- 172.21.15.123:0/1620659739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc8074240 msgr2=0x7fabc819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.815+0000 7fabcc850640 1 --2- 172.21.15.123:0/1620659739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc8074240 0x7fabc819a410 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fabb8005cc0 tx=0x7fabb802f630 comp rx=0 tx=0).stop 2024-08-18T22:10:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.816+0000 7fabcc850640 1 -- 172.21.15.123:0/1620659739 shutdown_connections 2024-08-18T22:10:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.816+0000 7fabcc850640 1 --2- 172.21.15.123:0/1620659739 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fabb40a2c00 0x7fabb40a50c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.816+0000 7fabcc850640 1 --2- 172.21.15.123:0/1620659739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fabc810e180 0x7fabc819ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.816+0000 7fabcc850640 1 --2- 172.21.15.123:0/1620659739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabc8074b60 0x7fabc819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.816+0000 7fabcc850640 1 --2- 172.21.15.123:0/1620659739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabc8074240 0x7fabc819a410 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.816+0000 7fabcc850640 1 -- 172.21.15.123:0/1620659739 >> 172.21.15.123:0/1620659739 conn(0x7fabc80fd620 msgr2=0x7fabc80fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.816+0000 7fabcc850640 1 -- 172.21.15.123:0/1620659739 shutdown_connections 2024-08-18T22:10:04.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:04.816+0000 7fabcc850640 1 -- 172.21.15.123:0/1620659739 wait complete. 2024-08-18T22:10:05.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:04 smithi123 ceph-mon[18462]: pgmap v409: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 13 op/s 2024-08-18T22:10:05.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:04 smithi130 ceph-mon[21698]: pgmap v409: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 13 op/s 2024-08-18T22:10:05.053 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:05.053 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:05.088 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:05.088 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:05.088 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 56 -lt 100 ']' 2024-08-18T22:10:05.088 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 56 + 1 2024-08-18T22:10:05.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:04 smithi183 ceph-mon[22097]: pgmap v409: 129 pgs: 129 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 13 op/s 2024-08-18T22:10:05.171 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=57 2024-08-18T22:10:05.171 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:05.205 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:05.205 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:05.206 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:05.206 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:05.207 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:06.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:05 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1620659739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:10:06.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:05 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1620659739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:10:06.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:05 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1620659739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:10:06.421 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:06.421 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:06.690 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:06.690 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:06.730 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:06.730 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:06.730 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 57 -lt 100 ']' 2024-08-18T22:10:06.730 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 57 + 1 2024-08-18T22:10:06.846 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=58 2024-08-18T22:10:06.846 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:06.890 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:06.890 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:06.892 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:06.892 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:06.892 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:07.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:06 smithi123 ceph-mon[18462]: pgmap v410: 129 pgs: 129 active+clean; 1.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-08-18T22:10:07.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:06 smithi130 ceph-mon[21698]: pgmap v410: 129 pgs: 129 active+clean; 1.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-08-18T22:10:07.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:06 smithi183 ceph-mon[22097]: pgmap v410: 129 pgs: 129 active+clean; 1.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-08-18T22:10:07.940 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:07 smithi123 ceph-mon[18462]: pgmap v411: 129 pgs: 129 active+clean; 1.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 11 op/s 2024-08-18T22:10:08.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:07 smithi130 ceph-mon[21698]: pgmap v411: 129 pgs: 129 active+clean; 1.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 11 op/s 2024-08-18T22:10:08.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-18T22:10:08.155 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:08.155 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:08.158 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:07 smithi183 ceph-mon[22097]: pgmap v411: 129 pgs: 129 active+clean; 1.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 11 op/s 2024-08-18T22:10:08.617 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:08.617 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:08.653 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:08.653 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:08.653 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 58 -lt 100 ']' 2024-08-18T22:10:08.653 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 58 + 1 2024-08-18T22:10:08.695 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=59 2024-08-18T22:10:08.695 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:08.746 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:08.746 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:08.748 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:08.748 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:08.748 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:09.537 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:09.537 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:09.761 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:09.761 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:09.811 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:09.812 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:09.812 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 59 -lt 100 ']' 2024-08-18T22:10:09.812 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 59 + 1 2024-08-18T22:10:09.945 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=60 2024-08-18T22:10:09.946 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:09.973 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:09.973 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:09.974 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:09.974 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:09.975 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:10.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:09 smithi123 ceph-mon[18462]: pgmap v412: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-08-18T22:10:10.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:09 smithi130 ceph-mon[21698]: pgmap v412: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-08-18T22:10:10.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:09 smithi183 ceph-mon[22097]: pgmap v412: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-08-18T22:10:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.978+0000 7f257f67d640 1 -- 172.21.15.123:0/4003683569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2578101890 msgr2=0x7f2578101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.978+0000 7f257f67d640 1 --2- 172.21.15.123:0/4003683569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2578101890 0x7f2578101c90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2568009be0 tx=0x7f256802a6c0 comp rx=0 tx=0).stop 2024-08-18T22:10:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.978+0000 7f257f67d640 1 -- 172.21.15.123:0/4003683569 shutdown_connections 2024-08-18T22:10:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.978+0000 7f257f67d640 1 --2- 172.21.15.123:0/4003683569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2578103440 0x7f2578109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.978+0000 7f257f67d640 1 --2- 172.21.15.123:0/4003683569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2578102a80 0x7f2578102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.978+0000 7f257f67d640 1 --2- 172.21.15.123:0/4003683569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2578101890 0x7f2578101c90 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.978+0000 7f257f67d640 1 -- 172.21.15.123:0/4003683569 >> 172.21.15.123:0/4003683569 conn(0x7f25780fcff0 msgr2=0x7f25780ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.978+0000 7f257f67d640 1 -- 172.21.15.123:0/4003683569 shutdown_connections 2024-08-18T22:10:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.978+0000 7f257f67d640 1 -- 172.21.15.123:0/4003683569 wait complete. 2024-08-18T22:10:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.996+0000 7f257f67d640 1 Processor -- start 2024-08-18T22:10:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.996+0000 7f257f67d640 1 -- start start 2024-08-18T22:10:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.996+0000 7f257f67d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2578101890 0x7f2578197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.996+0000 7f257f67d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2578102a80 0x7f2578198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.996+0000 7f257f67d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2578103440 0x7f257819f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.996+0000 7f257f67d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f257810d510 con 0x7f2578101890 2024-08-18T22:10:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.996+0000 7f257f67d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f257810d390 con 0x7f2578102a80 2024-08-18T22:10:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.996+0000 7f257f67d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f257810d690 con 0x7f2578103440 2024-08-18T22:10:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.996+0000 7f257d419640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2578101890 0x7f2578197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.997+0000 7f257d419640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2578101890 0x7f2578197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58122/0 (socket says 172.21.15.123:58122) 2024-08-18T22:10:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.997+0000 7f257d419640 1 -- 172.21.15.123:0/2359621232 learned_addr learned my addr 172.21.15.123:0/2359621232 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.997+0000 7f257cc18640 1 --2- 172.21.15.123:0/2359621232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2578102a80 0x7f2578198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.997+0000 7f257dc1a640 1 --2- 172.21.15.123:0/2359621232 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2578103440 0x7f257819f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.997+0000 7f257d419640 1 -- 172.21.15.123:0/2359621232 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2578103440 msgr2=0x7f257819f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.997+0000 7f257d419640 1 --2- 172.21.15.123:0/2359621232 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2578103440 0x7f257819f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.997+0000 7f257d419640 1 -- 172.21.15.123:0/2359621232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2578102a80 msgr2=0x7f2578198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.997+0000 7f257d419640 1 --2- 172.21.15.123:0/2359621232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2578102a80 0x7f2578198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.997+0000 7f257d419640 1 -- 172.21.15.123:0/2359621232 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257819f760 con 0x7f2578101890 2024-08-18T22:10:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.997+0000 7f257d419640 1 --2- 172.21.15.123:0/2359621232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2578101890 0x7f2578197b40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f256802acb0 tx=0x7f25680305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.997+0000 7f25767fc640 1 -- 172.21.15.123:0/2359621232 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2568041020 con 0x7f2578101890 2024-08-18T22:10:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.998+0000 7f257f67d640 1 -- 172.21.15.123:0/2359621232 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f257819f9f0 con 0x7f2578101890 2024-08-18T22:10:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.998+0000 7f25767fc640 1 -- 172.21.15.123:0/2359621232 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2568031920 con 0x7f2578101890 2024-08-18T22:10:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:10.998+0000 7f25767fc640 1 -- 172.21.15.123:0/2359621232 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2568036040 con 0x7f2578101890 2024-08-18T22:10:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.000+0000 7f25767fc640 1 -- 172.21.15.123:0/2359621232 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f2568044020 con 0x7f2578101890 2024-08-18T22:10:11.003 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.003+0000 7f25767fc640 1 --2- 172.21.15.123:0/2359621232 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f25600a2c30 0x7f25600a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:11.003 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.003+0000 7f257cc18640 1 --2- 172.21.15.123:0/2359621232 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f25600a2c30 0x7f25600a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.004 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.003+0000 7f257cc18640 1 --2- 172.21.15.123:0/2359621232 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f25600a2c30 0x7f25600a50f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2578199050 tx=0x7f256c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.009+0000 7f257f67d640 1 -- 172.21.15.123:0/2359621232 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f257819fee0 con 0x7f2578101890 2024-08-18T22:10:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.009+0000 7f25767fc640 1 -- 172.21.15.123:0/2359621232 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f25680b9ca0 con 0x7f2578101890 2024-08-18T22:10:11.045 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:11.045 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.177+0000 7f258243b740 1 Processor -- start 2024-08-18T22:10:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.177+0000 7f258243b740 1 -- start start 2024-08-18T22:10:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f258243b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 0x562546309a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f258243b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562546309fc0 0x56254630ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f258243b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56254630f050 0x562546311510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f258243b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56254626c9d0 con 0x562546309fc0 2024-08-18T22:10:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f258243b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562546214820 con 0x56254630f050 2024-08-18T22:10:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f258243b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562546268990 con 0x562546309680 2024-08-18T22:10:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f257cc18640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562546309fc0 0x56254630ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f257cc18640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562546309fc0 0x56254630ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58130/0 (socket says 172.21.15.123:58130) 2024-08-18T22:10:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f257cc18640 1 -- 172.21.15.123:0/762123567 learned_addr learned my addr 172.21.15.123:0/762123567 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f257dc1a640 1 --2- 172.21.15.123:0/762123567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56254630f050 0x562546311510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f257d419640 1 --2- 172.21.15.123:0/762123567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 0x562546309a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f257cc18640 1 -- 172.21.15.123:0/762123567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 msgr2=0x562546309a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f257cc18640 1 --2- 172.21.15.123:0/762123567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 0x562546309a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f257cc18640 1 -- 172.21.15.123:0/762123567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56254630f050 msgr2=0x562546311510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f257cc18640 1 --2- 172.21.15.123:0/762123567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56254630f050 0x562546311510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.178+0000 7f257cc18640 1 -- 172.21.15.123:0/762123567 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562545f80210 con 0x562546309fc0 2024-08-18T22:10:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.179+0000 7f257cc18640 1 --2- 172.21.15.123:0/762123567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562546309fc0 0x56254630ea80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f256c0042c0 tx=0x7f256c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd0e45a993fb43d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.179+0000 7f255f7fe640 1 -- 172.21.15.123:0/762123567 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c005020 con 0x562546309fc0 2024-08-18T22:10:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.179+0000 7f255f7fe640 1 -- 172.21.15.123:0/762123567 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f256c0047a0 con 0x562546309fc0 2024-08-18T22:10:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.179+0000 7f255f7fe640 1 -- 172.21.15.123:0/762123567 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c01e7c0 con 0x562546309fc0 2024-08-18T22:10:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.180+0000 7f258243b740 1 -- 172.21.15.123:0/762123567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562546309fc0 msgr2=0x56254630ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.180+0000 7f258243b740 1 --2- 172.21.15.123:0/762123567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562546309fc0 0x56254630ea80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f256c0042c0 tx=0x7f256c014000 comp rx=0 tx=0).stop 2024-08-18T22:10:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.180+0000 7f258243b740 1 -- 172.21.15.123:0/762123567 shutdown_connections 2024-08-18T22:10:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.180+0000 7f258243b740 1 --2- 172.21.15.123:0/762123567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56254630f050 0x562546311510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.180+0000 7f258243b740 1 --2- 172.21.15.123:0/762123567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562546309fc0 0x56254630ea80 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.180+0000 7f258243b740 1 --2- 172.21.15.123:0/762123567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 0x562546309a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.180+0000 7f258243b740 1 -- 172.21.15.123:0/762123567 >> 172.21.15.123:0/762123567 conn(0x562546304cf0 msgr2=0x5625463050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.180+0000 7f258243b740 1 -- 172.21.15.123:0/762123567 shutdown_connections 2024-08-18T22:10:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.180+0000 7f258243b740 1 -- 172.21.15.123:0/762123567 wait complete. 2024-08-18T22:10:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.206+0000 7f258243b740 1 -- start start 2024-08-18T22:10:11.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.228+0000 7f258243b740 1 Processor -- start 2024-08-18T22:10:11.230 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.229+0000 7f258243b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 0x562546313810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:11.230 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.229+0000 7f258243b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309fc0 0x562546313d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:11.230 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.229+0000 7f258243b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56254630f050 0x56254631ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.229+0000 7f258243b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562546312020 con 0x56254630f050 2024-08-18T22:10:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.229+0000 7f258243b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562546228520 con 0x562546309fc0 2024-08-18T22:10:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.229+0000 7f258243b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5625463121a0 con 0x562546309680 2024-08-18T22:10:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.229+0000 7f257dc1a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56254630f050 0x56254631ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.229+0000 7f257dc1a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56254630f050 0x56254631ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58132/0 (socket says 172.21.15.123:58132) 2024-08-18T22:10:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.229+0000 7f257dc1a640 1 -- 172.21.15.123:0/1374083886 learned_addr learned my addr 172.21.15.123:0/1374083886 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.229+0000 7f257cc18640 1 --2- 172.21.15.123:0/1374083886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309fc0 0x562546313d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.229+0000 7f257d419640 1 --2- 172.21.15.123:0/1374083886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 0x562546313810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.232 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.230+0000 7f257d419640 1 -- 172.21.15.123:0/1374083886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309fc0 msgr2=0x562546313d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:11.232 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.230+0000 7f257d419640 1 --2- 172.21.15.123:0/1374083886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309fc0 0x562546313d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.232 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.230+0000 7f257d419640 1 -- 172.21.15.123:0/1374083886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56254630f050 msgr2=0x56254631ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:11.232 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.230+0000 7f257d419640 1 --2- 172.21.15.123:0/1374083886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56254630f050 0x56254631ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.232 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.230+0000 7f257d419640 1 -- 172.21.15.123:0/1374083886 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56254604c620 con 0x562546309680 2024-08-18T22:10:11.232 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.230+0000 7f257dc1a640 1 --2- 172.21.15.123:0/1374083886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56254630f050 0x56254631ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:10:11.232 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.230+0000 7f257d419640 1 --2- 172.21.15.123:0/1374083886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 0x562546313810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f257819f630 tx=0x7f25680bbb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31f5cc79b8b03fd0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:11.232 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.230+0000 7f255cff9640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-08-18T22:10:11.232 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.230+0000 7f255cff9640 1 -- 172.21.15.123:0/1374083886 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25680bbc00 con 0x562546309680 2024-08-18T22:10:11.232 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.230+0000 7f255cff9640 1 -- 172.21.15.123:0/1374083886 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f25680046b0 con 0x562546309680 2024-08-18T22:10:11.235 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.234+0000 7f258243b740 10 client.0 _ll_register_callbacks cb 0x562545f7fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:10:11.236 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.236+0000 7f258243b740 1 -- 172.21.15.123:0/1374083886 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f256c0047a0 con 0x562546309680 2024-08-18T22:10:11.237 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.236+0000 7f255cff9640 1 -- 172.21.15.123:0/1374083886 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f25680bffb0 con 0x562546309680 2024-08-18T22:10:11.237 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.236+0000 7f258243b740 10 client.25231 fetch_fsmap learned FSMap version 26 2024-08-18T22:10:11.237 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.237+0000 7f258243b740 1 -- 172.21.15.123:0/1374083886 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({fsmap=26}) -- 0x562546312020 con 0x562546309680 2024-08-18T22:10:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.240+0000 7f255cff9640 1 -- 172.21.15.123:0/1374083886 <== mon.1 v2:172.21.15.183:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f25680c43e0 con 0x562546309680 2024-08-18T22:10:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.240+0000 7f258243b740 10 client.25231 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:10:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.240+0000 7f258243b740 10 client.25231 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:10:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.241+0000 7f258243b740 20 client.25231 populate_metadata read hostname 'smithi123' 2024-08-18T22:10:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.241+0000 7f258243b740 1 --2- 172.21.15.123:0/1374083886 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56254631f090 0x562546321550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.241+0000 7f258243b740 4 client.25231 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:10:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.241+0000 7f258243b740 1 -- 172.21.15.123:0/1374083886 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56254627a100 con 0x56254631f090 2024-08-18T22:10:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.241+0000 7f257cc18640 1 --2- 172.21.15.123:0/1374083886 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56254631f090 0x562546321550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.242+0000 7f257cc18640 1 --2- 172.21.15.123:0/1374083886 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56254631f090 0x562546321550 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ec1676cdbd6144d server_cookie=f6e2e9d0fb4158cb in_seq=0 out_seq=0 2024-08-18T22:10:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.242+0000 7f255cff9640 10 client.25231 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:10:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.243+0000 7f255cff9640 1 -- 172.21.15.123:0/1374083886 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56254627a100 con 0x56254631f090 2024-08-18T22:10:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.243+0000 7f255cff9640 10 client.25231 handle_command_reply: tid=0 2024-08-18T22:10:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.243+0000 7f258243b740 1 client.25231 shutdown 2024-08-18T22:10:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.243+0000 7f258243b740 1 -- 172.21.15.123:0/1374083886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 msgr2=0x562546313810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.243+0000 7f258243b740 1 --2- 172.21.15.123:0/1374083886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 0x562546313810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f257819f630 tx=0x7f25680bbb00 comp rx=0 tx=0).stop 2024-08-18T22:10:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.243+0000 7f258243b740 1 -- 172.21.15.123:0/1374083886 shutdown_connections 2024-08-18T22:10:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.243+0000 7f258243b740 1 --2- 172.21.15.123:0/1374083886 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56254631f090 0x562546321550 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.243+0000 7f258243b740 1 --2- 172.21.15.123:0/1374083886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56254630f050 0x56254631ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.243+0000 7f258243b740 1 --2- 172.21.15.123:0/1374083886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309fc0 0x562546313d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.243+0000 7f258243b740 1 --2- 172.21.15.123:0/1374083886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 0x562546313810 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.243+0000 7f255cff9640 0 client.25231 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:10:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.243+0000 7f258243b740 1 -- 172.21.15.123:0/1374083886 >> 172.21.15.123:0/1374083886 conn(0x562546304cf0 msgr2=0x562546306500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.243+0000 7f258243b740 1 -- 172.21.15.123:0/1374083886 shutdown_connections 2024-08-18T22:10:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.243+0000 7f258243b740 1 -- 172.21.15.123:0/1374083886 wait complete. 2024-08-18T22:10:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.243+0000 7f258243b740 20 client.25231 trim_cache size 0 max 16384 2024-08-18T22:10:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.280+0000 7f258243b740 1 Processor -- start 2024-08-18T22:10:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.280+0000 7f258243b740 1 -- start start 2024-08-18T22:10:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.280+0000 7f258243b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 0x5625463135c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.280+0000 7f258243b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309fc0 0x56254631acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.280+0000 7f258243b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56254630f050 0x562546313b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.280+0000 7f258243b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f25781aab70 con 0x56254630f050 2024-08-18T22:10:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.280+0000 7f258243b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f25781a8440 con 0x562546309fc0 2024-08-18T22:10:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.280+0000 7f258243b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f25781a6290 con 0x562546309680 2024-08-18T22:10:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.281+0000 7f257dc1a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56254630f050 0x562546313b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.281+0000 7f257dc1a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56254630f050 0x562546313b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58136/0 (socket says 172.21.15.123:58136) 2024-08-18T22:10:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.281+0000 7f257d419640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 0x5625463135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.281+0000 7f257dc1a640 1 -- 172.21.15.123:0/1917322078 learned_addr learned my addr 172.21.15.123:0/1917322078 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.281+0000 7f257cc18640 1 --2- 172.21.15.123:0/1917322078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309fc0 0x56254631acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.281+0000 7f257d419640 1 -- 172.21.15.123:0/1917322078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309fc0 msgr2=0x56254631acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.281+0000 7f257d419640 1 --2- 172.21.15.123:0/1917322078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309fc0 0x56254631acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.281+0000 7f257d419640 1 -- 172.21.15.123:0/1917322078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56254630f050 msgr2=0x562546313b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.281+0000 7f257d419640 1 --2- 172.21.15.123:0/1917322078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56254630f050 0x562546313b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.281+0000 7f257d419640 1 -- 172.21.15.123:0/1917322078 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56254630ac50 con 0x562546309680 2024-08-18T22:10:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.281+0000 7f257cc18640 1 --2- 172.21.15.123:0/1917322078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309fc0 0x56254631acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:10:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.281+0000 7f257dc1a640 1 --2- 172.21.15.123:0/1917322078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56254630f050 0x562546313b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:10:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.281+0000 7f257d419640 1 --2- 172.21.15.123:0/1917322078 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 0x5625463135c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f25680bb900 tx=0x7f25680d2000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9402c00e3115530f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.282+0000 7f255effd640 1 -- 172.21.15.123:0/1917322078 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25680bb740 con 0x562546309680 2024-08-18T22:10:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.282+0000 7f255effd640 1 -- 172.21.15.123:0/1917322078 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f256c0047a0 con 0x562546309680 2024-08-18T22:10:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.282+0000 7f255effd640 1 -- 172.21.15.123:0/1917322078 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2568004b40 con 0x562546309680 2024-08-18T22:10:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.283+0000 7f258243b740 1 -- 172.21.15.123:0/1917322078 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 msgr2=0x5625463135c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.283+0000 7f258243b740 1 --2- 172.21.15.123:0/1917322078 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 0x5625463135c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f25680bb900 tx=0x7f25680d2000 comp rx=0 tx=0).stop 2024-08-18T22:10:11.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.283+0000 7f258243b740 1 -- 172.21.15.123:0/1917322078 shutdown_connections 2024-08-18T22:10:11.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.283+0000 7f258243b740 1 --2- 172.21.15.123:0/1917322078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56254630f050 0x562546313b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.283+0000 7f258243b740 1 --2- 172.21.15.123:0/1917322078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309fc0 0x56254631acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.283+0000 7f258243b740 1 --2- 172.21.15.123:0/1917322078 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562546309680 0x5625463135c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.283+0000 7f258243b740 1 -- 172.21.15.123:0/1917322078 >> 172.21.15.123:0/1917322078 conn(0x562546304cf0 msgr2=0x56254630b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:11.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.283+0000 7f258243b740 1 -- 172.21.15.123:0/1917322078 shutdown_connections 2024-08-18T22:10:11.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.283+0000 7f258243b740 1 -- 172.21.15.123:0/1917322078 wait complete. 2024-08-18T22:10:11.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.284+0000 7f258243b740 1 -- start start 2024-08-18T22:10:11.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.284+0000 7f258243b740 1 Processor -- start 2024-08-18T22:10:11.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.284+0000 7f258243b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309680 0x5625463181b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:11.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.284+0000 7f258243b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562546309fc0 0x5625463186f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:11.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.284+0000 7f258243b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56254630f050 0x562546319700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f258243b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f25781a6900 con 0x562546309fc0 2024-08-18T22:10:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f258243b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f25781a7d70 con 0x562546309680 2024-08-18T22:10:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f258243b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f25781a6fd0 con 0x56254630f050 2024-08-18T22:10:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f258243b740 10 client.0 _ll_register_callbacks cb 0x7f25680b7f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:10:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f257cc18640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562546309fc0 0x5625463186f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f257cc18640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562546309fc0 0x5625463186f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58152/0 (socket says 172.21.15.123:58152) 2024-08-18T22:10:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f257cc18640 1 -- 172.21.15.123:0/2549454119 learned_addr learned my addr 172.21.15.123:0/2549454119 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f257d419640 1 --2- 172.21.15.123:0/2549454119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309680 0x5625463181b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f257dc1a640 1 --2- 172.21.15.123:0/2549454119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56254630f050 0x562546319700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f257cc18640 1 -- 172.21.15.123:0/2549454119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56254630f050 msgr2=0x562546319700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f257cc18640 1 --2- 172.21.15.123:0/2549454119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56254630f050 0x562546319700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f257cc18640 1 -- 172.21.15.123:0/2549454119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309680 msgr2=0x5625463181b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f257cc18640 1 --2- 172.21.15.123:0/2549454119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309680 0x5625463181b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f257cc18640 1 -- 172.21.15.123:0/2549454119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562546319d10 con 0x562546309fc0 2024-08-18T22:10:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f257d419640 1 --2- 172.21.15.123:0/2549454119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309680 0x5625463181b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:10:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f257cc18640 1 --2- 172.21.15.123:0/2549454119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562546309fc0 0x5625463186f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f256c004260 tx=0x7f256c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea985970c5d22eca server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.285+0000 7f255cff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:10:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.286+0000 7f255cff9640 1 -- 172.21.15.123:0/2549454119 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c01e6f0 con 0x562546309fc0 2024-08-18T22:10:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.286+0000 7f255cff9640 1 -- 172.21.15.123:0/2549454119 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f256c01e890 con 0x562546309fc0 2024-08-18T22:10:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.286+0000 7f258243b740 1 -- 172.21.15.123:0/2549454119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f256c0047a0 con 0x562546309fc0 2024-08-18T22:10:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.286+0000 7f255cff9640 1 -- 172.21.15.123:0/2549454119 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f256c045050 con 0x562546309fc0 2024-08-18T22:10:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.286+0000 7f258243b740 10 client.15768 fetch_fsmap learned FSMap version 26 2024-08-18T22:10:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.286+0000 7f258243b740 1 -- 172.21.15.123:0/2549454119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562546389df0 con 0x562546309fc0 2024-08-18T22:10:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.286+0000 7f255cff9640 1 -- 172.21.15.123:0/2549454119 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f256c0047a0 con 0x562546309fc0 2024-08-18T22:10:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.286+0000 7f255cff9640 1 -- 172.21.15.123:0/2549454119 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f256c033c10 con 0x562546309fc0 2024-08-18T22:10:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.286+0000 7f258243b740 10 client.15768 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:10:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.286+0000 7f258243b740 10 client.15768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:10:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.286+0000 7f258243b740 20 client.15768 populate_metadata read hostname 'smithi123' 2024-08-18T22:10:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.286+0000 7f258243b740 1 --2- 172.21.15.123:0/2549454119 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56254638a3a0 0x56254638c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.286+0000 7f258243b740 4 client.15768 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:10:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.286+0000 7f258243b740 1 -- 172.21.15.123:0/2549454119 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562546274450 con 0x56254638a3a0 2024-08-18T22:10:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.287+0000 7f257d419640 1 --2- 172.21.15.123:0/2549454119 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56254638a3a0 0x56254638c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.287+0000 7f255cff9640 10 client.15768 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:10:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.287+0000 7f257d419640 1 --2- 172.21.15.123:0/2549454119 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56254638a3a0 0x56254638c790 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aff5a6a391668b2 server_cookie=4e5649ffccd0baf4 in_seq=0 out_seq=0 2024-08-18T22:10:11.306 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:11.306 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.305+0000 7f255cff9640 1 -- 172.21.15.123:0/2549454119 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562546274450 con 0x56254638a3a0 2024-08-18T22:10:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.305+0000 7f255cff9640 10 client.15768 handle_command_reply: tid=0 2024-08-18T22:10:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.305+0000 7f258243b740 1 client.15768 shutdown 2024-08-18T22:10:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.306+0000 7f258243b740 1 -- 172.21.15.123:0/2549454119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562546309fc0 msgr2=0x5625463186f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.306+0000 7f258243b740 1 --2- 172.21.15.123:0/2549454119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562546309fc0 0x5625463186f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f256c004260 tx=0x7f256c0043b0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.306+0000 7f258243b740 1 -- 172.21.15.123:0/2549454119 shutdown_connections 2024-08-18T22:10:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.306+0000 7f258243b740 1 --2- 172.21.15.123:0/2549454119 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56254638a3a0 0x56254638c790 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.306+0000 7f258243b740 1 --2- 172.21.15.123:0/2549454119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56254630f050 0x562546319700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.306+0000 7f258243b740 1 --2- 172.21.15.123:0/2549454119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562546309fc0 0x5625463186f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.306+0000 7f258243b740 1 --2- 172.21.15.123:0/2549454119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562546309680 0x5625463181b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.306+0000 7f255cff9640 0 client.15768 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:10:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.306+0000 7f258243b740 1 -- 172.21.15.123:0/2549454119 >> 172.21.15.123:0/2549454119 conn(0x562546304cf0 msgr2=0x5625463135c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.306+0000 7f258243b740 1 -- 172.21.15.123:0/2549454119 shutdown_connections 2024-08-18T22:10:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.306+0000 7f258243b740 1 -- 172.21.15.123:0/2549454119 wait complete. 2024-08-18T22:10:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.306+0000 7f258243b740 20 client.15768 trim_cache size 0 max 16384 2024-08-18T22:10:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:10:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:10:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:10:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:10:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.307+0000 7f257f67d640 1 -- 172.21.15.123:0/2359621232 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f25600a2c30 msgr2=0x7f25600a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.307+0000 7f257f67d640 1 --2- 172.21.15.123:0/2359621232 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f25600a2c30 0x7f25600a50f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2578199050 tx=0x7f256c005f90 comp rx=0 tx=0).stop 2024-08-18T22:10:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.307+0000 7f257f67d640 1 -- 172.21.15.123:0/2359621232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2578101890 msgr2=0x7f2578197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.307+0000 7f257f67d640 1 --2- 172.21.15.123:0/2359621232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2578101890 0x7f2578197b40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f256802acb0 tx=0x7f25680305d0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.307+0000 7f257f67d640 1 -- 172.21.15.123:0/2359621232 shutdown_connections 2024-08-18T22:10:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.307+0000 7f257f67d640 1 --2- 172.21.15.123:0/2359621232 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2578103440 0x7f257819f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.307+0000 7f257f67d640 1 --2- 172.21.15.123:0/2359621232 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f25600a2c30 0x7f25600a50f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.307+0000 7f257f67d640 1 --2- 172.21.15.123:0/2359621232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2578102a80 0x7f2578198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.307+0000 7f257f67d640 1 --2- 172.21.15.123:0/2359621232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2578101890 0x7f2578197b40 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.307+0000 7f257f67d640 1 -- 172.21.15.123:0/2359621232 >> 172.21.15.123:0/2359621232 conn(0x7f25780fcff0 msgr2=0x7f2578105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.307+0000 7f257f67d640 1 -- 172.21.15.123:0/2359621232 shutdown_connections 2024-08-18T22:10:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:11.307+0000 7f257f67d640 1 -- 172.21.15.123:0/2359621232 wait complete. 2024-08-18T22:10:11.315 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-08-18T22:10:11.315 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:10:11.318 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:11.319 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:11.319 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 60 -lt 100 ']' 2024-08-18T22:10:11.319 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 60 + 1 2024-08-18T22:10:11.400 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=61 2024-08-18T22:10:11.400 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:11.466 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:11.466 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:11.467 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:11.467 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:11.467 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:12.545 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:12.545 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:12 smithi123 ceph-mon[18462]: pgmap v413: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 7 op/s 2024-08-18T22:10:12.827 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:12.827 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:12.960 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:12.961 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:12.961 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 61 -lt 100 ']' 2024-08-18T22:10:12.961 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 61 + 1 2024-08-18T22:10:13.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:12 smithi130 ceph-mon[21698]: pgmap v413: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 7 op/s 2024-08-18T22:10:13.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:12 smithi183 ceph-mon[22097]: pgmap v413: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 7 op/s 2024-08-18T22:10:13.171 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=62 2024-08-18T22:10:13.171 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:13.246 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:13.246 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:13.247 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:13.247 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:13.247 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:14.494 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:14.494 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:14.797 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:14.797 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:14.818 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:14.819 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:14.819 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 62 -lt 100 ']' 2024-08-18T22:10:14.819 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 62 + 1 2024-08-18T22:10:14.869 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=63 2024-08-18T22:10:14.869 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:14.902 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:14.902 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:14.903 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:14.903 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:14.903 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:15.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:14 smithi123 ceph-mon[18462]: pgmap v414: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 10 op/s 2024-08-18T22:10:15.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:14 smithi130 ceph-mon[21698]: pgmap v414: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 10 op/s 2024-08-18T22:10:15.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:14 smithi183 ceph-mon[22097]: pgmap v414: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 10 op/s 2024-08-18T22:10:15.919 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:15.919 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:16.110 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:16.110 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:16.135 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:16.135 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:16.135 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 63 -lt 100 ']' 2024-08-18T22:10:16.135 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 63 + 1 2024-08-18T22:10:16.185 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=64 2024-08-18T22:10:16.185 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:16.245 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:16.245 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:16.246 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:16.246 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:16.246 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:17.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:16 smithi123 ceph-mon[18462]: pgmap v415: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-08-18T22:10:17.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:16 smithi130 ceph-mon[21698]: pgmap v415: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-08-18T22:10:17.035 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:17.036 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:17.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:16 smithi183 ceph-mon[22097]: pgmap v415: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-08-18T22:10:17.433 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:17.433 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:17.444 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:17.444 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:17.444 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 64 -lt 100 ']' 2024-08-18T22:10:17.444 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 64 + 1 2024-08-18T22:10:17.511 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=65 2024-08-18T22:10:17.511 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:17.559 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:17.560 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:17.561 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:17.561 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:17.561 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:18.452 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:18.452 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:18.747 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:18.748 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:18.768 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:18.768 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:18.768 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 65 -lt 100 ']' 2024-08-18T22:10:18.768 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 65 + 1 2024-08-18T22:10:18.810 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=66 2024-08-18T22:10:18.810 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:18.878 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:18.878 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:18.879 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:18.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:18.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:19.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:18 smithi123 ceph-mon[18462]: pgmap v416: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-08-18T22:10:19.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:18 smithi130 ceph-mon[21698]: pgmap v416: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-08-18T22:10:19.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:18 smithi183 ceph-mon[22097]: pgmap v416: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-08-18T22:10:19.818 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:19.818 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:20.021 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:20.021 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:20.052 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:20.052 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:20.053 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 66 -lt 100 ']' 2024-08-18T22:10:20.053 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 66 + 1 2024-08-18T22:10:20.102 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=67 2024-08-18T22:10:20.102 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:20.169 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:20.170 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:20.170 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:20.171 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:20.171 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:10:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:10:20.956 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:20 smithi123 ceph-mon[18462]: pgmap v417: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 15 op/s 2024-08-18T22:10:21.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:20 smithi130 ceph-mon[21698]: pgmap v417: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 15 op/s 2024-08-18T22:10:21.127 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:21.127 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:21.159 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:20 smithi183 ceph-mon[22097]: pgmap v417: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 15 op/s 2024-08-18T22:10:21.434 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:21.434 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:21.451 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:21.451 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:21.451 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 67 -lt 100 ']' 2024-08-18T22:10:21.451 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 67 + 1 2024-08-18T22:10:21.484 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=68 2024-08-18T22:10:21.484 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:21.661 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:21.661 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:21.662 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:21.662 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:21.662 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:22.797 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:22 smithi123 ceph-mon[18462]: pgmap v418: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-08-18T22:10:22.911 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:22.911 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:22.961 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:22 smithi183 ceph-mon[22097]: pgmap v418: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-08-18T22:10:23.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:22 smithi130 ceph-mon[21698]: pgmap v418: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-08-18T22:10:23.373 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:23.374 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:23.392 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:23.392 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:23.392 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 68 -lt 100 ']' 2024-08-18T22:10:23.392 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 68 + 1 2024-08-18T22:10:23.527 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=69 2024-08-18T22:10:23.527 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:23.652 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:23.652 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:23.653 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:23.653 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:23.653 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:24.451 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:24.451 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:24.801 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:24.801 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:24.817 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:24.817 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:24.817 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 69 -lt 100 ']' 2024-08-18T22:10:24.817 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 69 + 1 2024-08-18T22:10:24.910 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=70 2024-08-18T22:10:24.911 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:24.951 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:24.951 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:24.952 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:24.953 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:24.953 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:25.011 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:24 smithi123 ceph-mon[18462]: pgmap v419: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-08-18T22:10:25.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:24 smithi130 ceph-mon[21698]: pgmap v419: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-08-18T22:10:25.162 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:24 smithi183 ceph-mon[22097]: pgmap v419: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-08-18T22:10:25.867 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:25.868 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:26.267 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:26.267 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:26.283 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:26.283 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:26.283 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 70 -lt 100 ']' 2024-08-18T22:10:26.283 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 70 + 1 2024-08-18T22:10:26.377 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=71 2024-08-18T22:10:26.377 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:26.393 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:26.393 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:26.395 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:26.395 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:26.395 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:27.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7fe600d32640 1 -- 172.21.15.123:0/108206670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5fc102a60 msgr2=0x7fe5fc102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:27.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7fe600d32640 1 --2- 172.21.15.123:0/108206670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5fc102a60 0x7fe5fc102e40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009cd0 tx=0x7fe5ec02a8e0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7fe600d32640 1 -- 172.21.15.123:0/108206670 shutdown_connections 2024-08-18T22:10:27.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7fe600d32640 1 --2- 172.21.15.123:0/108206670 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5fc107fd0 0x7fe5fc10e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7fe600d32640 1 --2- 172.21.15.123:0/108206670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5fc103410 0x7fe5fc1078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7fe600d32640 1 --2- 172.21.15.123:0/108206670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5fc102a60 0x7fe5fc102e40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7fe600d32640 1 -- 172.21.15.123:0/108206670 >> 172.21.15.123:0/108206670 conn(0x7fe5fc0fc500 msgr2=0x7fe5fc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:27.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7fe600d32640 1 -- 172.21.15.123:0/108206670 shutdown_connections 2024-08-18T22:10:27.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7f7e2e8bf640 1 -- 172.21.15.123:0/2548942379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e281022a0 msgr2=0x7f7e281026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:27.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7f7e2e8bf640 1 --2- 172.21.15.123:0/2548942379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e281022a0 0x7f7e281026e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009900 tx=0x7f7e1c02a480 comp rx=0 tx=0).stop 2024-08-18T22:10:27.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.029+0000 7fe600d32640 1 -- 172.21.15.123:0/108206670 wait complete. 2024-08-18T22:10:27.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7f7e2e8bf640 1 -- 172.21.15.123:0/2548942379 shutdown_connections 2024-08-18T22:10:27.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7f7e2e8bf640 1 --2- 172.21.15.123:0/2548942379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e28102c20 0x7f7e2810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7f7e2e8bf640 1 --2- 172.21.15.123:0/2548942379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e281022a0 0x7f7e281026e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7f7e2e8bf640 1 --2- 172.21.15.123:0/2548942379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e28100b50 0x7f7e28100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7f7e2e8bf640 1 -- 172.21.15.123:0/2548942379 >> 172.21.15.123:0/2548942379 conn(0x7f7e280fc500 msgr2=0x7f7e280fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:27.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.028+0000 7f7e2e8bf640 1 -- 172.21.15.123:0/2548942379 shutdown_connections 2024-08-18T22:10:27.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.029+0000 7f7e2e8bf640 1 -- 172.21.15.123:0/2548942379 wait complete. 2024-08-18T22:10:27.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.029+0000 7f7e2e8bf640 1 Processor -- start 2024-08-18T22:10:27.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7f7e2e8bf640 1 -- start start 2024-08-18T22:10:27.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7fe600d32640 1 Processor -- start 2024-08-18T22:10:27.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7fe600d32640 1 -- start start 2024-08-18T22:10:27.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7fe600d32640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5fc102a60 0x7fe5fc1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7fe600d32640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5fc103410 0x7fe5fc198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7fe600d32640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5fc107fd0 0x7fe5fc19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7fe600d32640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc111dd0 con 0x7fe5fc103410 2024-08-18T22:10:27.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7fe600d32640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc111c50 con 0x7fe5fc107fd0 2024-08-18T22:10:27.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7fe600d32640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc111f50 con 0x7fe5fc102a60 2024-08-18T22:10:27.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7f7e2e8bf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e28100b50 0x7f7e281982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7f7e2e8bf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e281022a0 0x7f7e28198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7fe5fa59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5fc102a60 0x7fe5fc1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7f7e2e8bf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e28102c20 0x7f7e2819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7f7e2e8bf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7e28111e10 con 0x7f7e28100b50 2024-08-18T22:10:27.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7f7e2e8bf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7e28111c90 con 0x7f7e281022a0 2024-08-18T22:10:27.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7f7e2e8bf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7e28111f90 con 0x7f7e28102c20 2024-08-18T22:10:27.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7fe5fa59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5fc102a60 0x7fe5fc1982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:45278/0 (socket says 172.21.15.123:45278) 2024-08-18T22:10:27.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7fe5fa59c640 1 -- 172.21.15.123:0/2561837225 learned_addr learned my addr 172.21.15.123:0/2561837225 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:27.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.030+0000 7fe5fad9d640 1 --2- 172.21.15.123:0/2561837225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5fc107fd0 0x7fe5fc19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7fe5f3fff640 1 --2- 172.21.15.123:0/2561837225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5fc103410 0x7fe5fc198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7f7e277fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e281022a0 0x7f7e28198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7f7e277fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e281022a0 0x7f7e28198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:39854/0 (socket says 172.21.15.123:39854) 2024-08-18T22:10:27.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7f7e277fe640 1 -- 172.21.15.123:0/4262360502 learned_addr learned my addr 172.21.15.123:0/4262360502 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:27.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7f7e27fff640 1 --2- 172.21.15.123:0/4262360502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e28100b50 0x7f7e281982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7f7e2ce5c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e28102c20 0x7f7e2819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7fe5fad9d640 1 -- 172.21.15.123:0/2561837225 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5fc102a60 msgr2=0x7fe5fc1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:27.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7fe5fad9d640 1 --2- 172.21.15.123:0/2561837225 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5fc102a60 0x7fe5fc1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7fe5fad9d640 1 -- 172.21.15.123:0/2561837225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5fc103410 msgr2=0x7fe5fc198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:27.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7fe5fad9d640 1 --2- 172.21.15.123:0/2561837225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5fc103410 0x7fe5fc198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7fe5fad9d640 1 -- 172.21.15.123:0/2561837225 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5fc19d2a0 con 0x7fe5fc107fd0 2024-08-18T22:10:27.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7fe5fa59c640 1 --2- 172.21.15.123:0/2561837225 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5fc102a60 0x7fe5fc1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:10:27.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7fe5fad9d640 1 --2- 172.21.15.123:0/2561837225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5fc107fd0 0x7fe5fc19cbc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400d680 tx=0x7fe5f400db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:27.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7f7e27fff640 1 -- 172.21.15.123:0/4262360502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e28102c20 msgr2=0x7f7e2819cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:27.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7f7e27fff640 1 --2- 172.21.15.123:0/4262360502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e28102c20 0x7f7e2819cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7f7e27fff640 1 -- 172.21.15.123:0/4262360502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e281022a0 msgr2=0x7f7e28198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:27.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7f7e27fff640 1 --2- 172.21.15.123:0/4262360502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e281022a0 0x7f7e28198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7f7e27fff640 1 -- 172.21.15.123:0/4262360502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2819d280 con 0x7f7e28100b50 2024-08-18T22:10:27.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7f7e277fe640 1 --2- 172.21.15.123:0/4262360502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e281022a0 0x7f7e28198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:10:27.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7fe5f37fe640 1 -- 172.21.15.123:0/2561837225 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4017070 con 0x7fe5fc107fd0 2024-08-18T22:10:27.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7f7e27fff640 1 --2- 172.21.15.123:0/4262360502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e28100b50 0x7f7e281982d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009e60 tx=0x7f7e1800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:27.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.031+0000 7fe600d32640 1 -- 172.21.15.123:0/2561837225 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5fc19d590 con 0x7fe5fc107fd0 2024-08-18T22:10:27.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.032+0000 7fe5f37fe640 1 -- 172.21.15.123:0/2561837225 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5f4009820 con 0x7fe5fc107fd0 2024-08-18T22:10:27.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.032+0000 7fe5f37fe640 1 -- 172.21.15.123:0/2561837225 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4004e00 con 0x7fe5fc107fd0 2024-08-18T22:10:27.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.032+0000 7f7e257fa640 1 -- 172.21.15.123:0/4262360502 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e18020070 con 0x7f7e28100b50 2024-08-18T22:10:27.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.032+0000 7fe600d32640 1 -- 172.21.15.123:0/2561837225 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5fc1005f0 con 0x7fe5fc107fd0 2024-08-18T22:10:27.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.032+0000 7f7e257fa640 1 -- 172.21.15.123:0/4262360502 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e1800ccc0 con 0x7f7e28100b50 2024-08-18T22:10:27.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.032+0000 7f7e2e8bf640 1 -- 172.21.15.123:0/4262360502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2819d570 con 0x7f7e28100b50 2024-08-18T22:10:27.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.032+0000 7f7e257fa640 1 -- 172.21.15.123:0/4262360502 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1801bb40 con 0x7f7e28100b50 2024-08-18T22:10:27.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.032+0000 7f7e2e8bf640 1 -- 172.21.15.123:0/4262360502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e2810de30 con 0x7f7e28100b50 2024-08-18T22:10:27.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.034+0000 7fe5f37fe640 1 -- 172.21.15.123:0/2561837225 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fe5f4005220 con 0x7fe5fc107fd0 2024-08-18T22:10:27.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.034+0000 7f7e2e8bf640 1 -- 172.21.15.123:0/4262360502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e28100f30 con 0x7f7e28100b50 2024-08-18T22:10:27.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.035+0000 7f7e257fa640 1 -- 172.21.15.123:0/4262360502 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f7e18023070 con 0x7f7e28100b50 2024-08-18T22:10:27.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.035+0000 7fe5f37fe640 1 --2- 172.21.15.123:0/2561837225 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe5e80a2c00 0x7fe5e80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.035+0000 7fe5fa59c640 1 --2- 172.21.15.123:0/2561837225 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe5e80a2c00 0x7fe5e80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.035+0000 7fe5f37fe640 1 -- 172.21.15.123:0/2561837225 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe5f40ceb20 con 0x7fe5fc107fd0 2024-08-18T22:10:27.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.035+0000 7f7e257fa640 1 --2- 172.21.15.123:0/4262360502 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7e100a2c00 0x7f7e100a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.036+0000 7f7e277fe640 1 --2- 172.21.15.123:0/4262360502 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7e100a2c00 0x7f7e100a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.036+0000 7fe5fa59c640 1 --2- 172.21.15.123:0/2561837225 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe5e80a2c00 0x7fe5e80a50c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec000f80 tx=0x7fe5ec0317e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:27.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.036+0000 7f7e257fa640 1 -- 172.21.15.123:0/4262360502 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f7e180d3420 con 0x7f7e28100b50 2024-08-18T22:10:27.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.036+0000 7f7e277fe640 1 --2- 172.21.15.123:0/4262360502 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7e100a2c00 0x7f7e100a50c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7e280fe9d0 tx=0x7f7e1c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:27.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.040+0000 7f7e257fa640 1 -- 172.21.15.123:0/4262360502 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7e1809f980 con 0x7f7e28100b50 2024-08-18T22:10:27.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.250+0000 7f7e2e8bf640 1 -- 172.21.15.123:0/4262360502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e28108dc0 con 0x7f7e28100b50 2024-08-18T22:10:27.252 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:27 smithi123 ceph-mon[18462]: pgmap v420: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-08-18T22:10:27.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.251+0000 7f7e257fa640 1 -- 172.21.15.123:0/4262360502 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7f7e180a3c80 con 0x7f7e28100b50 2024-08-18T22:10:27.252 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:10:27.253 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 26 2024-08-18T22:10:27.253 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"btime":"2024-08-18T22:07:46:492460+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:07:45.601053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:10:27.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.253+0000 7f7e2e8bf640 1 -- 172.21.15.123:0/4262360502 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7e100a2c00 msgr2=0x7f7e100a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:27.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.253+0000 7f7e2e8bf640 1 --2- 172.21.15.123:0/4262360502 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7e100a2c00 0x7f7e100a50c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7e280fe9d0 tx=0x7f7e1c0046c0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.253+0000 7f7e2e8bf640 1 -- 172.21.15.123:0/4262360502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e28100b50 msgr2=0x7f7e281982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:27.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.253+0000 7f7e2e8bf640 1 --2- 172.21.15.123:0/4262360502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e28100b50 0x7f7e281982d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009e60 tx=0x7f7e1800edc0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.253+0000 7f7e2e8bf640 1 -- 172.21.15.123:0/4262360502 shutdown_connections 2024-08-18T22:10:27.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.253+0000 7f7e2e8bf640 1 --2- 172.21.15.123:0/4262360502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e28102c20 0x7f7e2819cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.253+0000 7f7e2e8bf640 1 --2- 172.21.15.123:0/4262360502 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7e100a2c00 0x7f7e100a50c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.253+0000 7f7e2e8bf640 1 --2- 172.21.15.123:0/4262360502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e281022a0 0x7f7e28198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.253+0000 7f7e2e8bf640 1 --2- 172.21.15.123:0/4262360502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e28100b50 0x7f7e281982d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.253+0000 7f7e2e8bf640 1 -- 172.21.15.123:0/4262360502 >> 172.21.15.123:0/4262360502 conn(0x7f7e280fc500 msgr2=0x7f7e28106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:27.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.253+0000 7f7e2e8bf640 1 -- 172.21.15.123:0/4262360502 shutdown_connections 2024-08-18T22:10:27.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.253+0000 7f7e2e8bf640 1 -- 172.21.15.123:0/4262360502 wait complete. 2024-08-18T22:10:27.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.334+0000 7fe603130740 1 Processor -- start 2024-08-18T22:10:27.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe603130740 1 -- start start 2024-08-18T22:10:27.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe603130740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86deff0 0x5598f86df3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe603130740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86df910 0x5598f86e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe603130740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86ea1d0 0x5598f86ec5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe603130740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5598f8644a40 con 0x5598f86df910 2024-08-18T22:10:27.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe603130740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5598f85dc9d0 con 0x5598f86ea1d0 2024-08-18T22:10:27.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe603130740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5598f8640a00 con 0x5598f86deff0 2024-08-18T22:10:27.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe5f3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86df910 0x5598f86e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe5f3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86df910 0x5598f86e9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39158/0 (socket says 172.21.15.123:39158) 2024-08-18T22:10:27.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe5f3fff640 1 -- 172.21.15.123:0/3093773331 learned_addr learned my addr 172.21.15.123:0/3093773331 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:27.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe5fa59c640 1 --2- 172.21.15.123:0/3093773331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86deff0 0x5598f86df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe5fad9d640 1 --2- 172.21.15.123:0/3093773331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86ea1d0 0x5598f86ec5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe5f3fff640 1 -- 172.21.15.123:0/3093773331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86deff0 msgr2=0x5598f86df3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:27.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe5f3fff640 1 --2- 172.21.15.123:0/3093773331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86deff0 0x5598f86df3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe5f3fff640 1 -- 172.21.15.123:0/3093773331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86ea1d0 msgr2=0x5598f86ec5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:27.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe5f3fff640 1 --2- 172.21.15.123:0/3093773331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86ea1d0 0x5598f86ec5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe5f3fff640 1 -- 172.21.15.123:0/3093773331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598f85e3650 con 0x5598f86df910 2024-08-18T22:10:27.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.335+0000 7fe5fad9d640 1 --2- 172.21.15.123:0/3093773331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86ea1d0 0x5598f86ec5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:10:27.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.336+0000 7fe5f3fff640 1 --2- 172.21.15.123:0/3093773331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86df910 0x5598f86e9c90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400bc60 tx=0x7fe5e40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae34595524e5d6b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:27.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.336+0000 7fe5f0ff9640 1 -- 172.21.15.123:0/3093773331 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e401c480 con 0x5598f86df910 2024-08-18T22:10:27.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.336+0000 7fe5f0ff9640 1 -- 172.21.15.123:0/3093773331 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5e401cb00 con 0x5598f86df910 2024-08-18T22:10:27.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.336+0000 7fe5f0ff9640 1 -- 172.21.15.123:0/3093773331 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4011c50 con 0x5598f86df910 2024-08-18T22:10:27.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 -- 172.21.15.123:0/3093773331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86df910 msgr2=0x5598f86e9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:27.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 --2- 172.21.15.123:0/3093773331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86df910 0x5598f86e9c90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400bc60 tx=0x7fe5e40107a0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 -- 172.21.15.123:0/3093773331 shutdown_connections 2024-08-18T22:10:27.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 --2- 172.21.15.123:0/3093773331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86ea1d0 0x5598f86ec5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 --2- 172.21.15.123:0/3093773331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86df910 0x5598f86e9c90 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 --2- 172.21.15.123:0/3093773331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86deff0 0x5598f86df3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 -- 172.21.15.123:0/3093773331 >> 172.21.15.123:0/3093773331 conn(0x5598f86db580 msgr2=0x5598f86db960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:27.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 -- 172.21.15.123:0/3093773331 shutdown_connections 2024-08-18T22:10:27.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 -- 172.21.15.123:0/3093773331 wait complete. 2024-08-18T22:10:27.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 -- start start 2024-08-18T22:10:27.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 Processor -- start 2024-08-18T22:10:27.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86e7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86df910 0x5598f86e75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86ea1d0 0x5598f86e7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5598f86ecda0 con 0x5598f86deff0 2024-08-18T22:10:27.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5598f85ffb20 con 0x5598f86df910 2024-08-18T22:10:27.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.337+0000 7fe603130740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5598f86ecf20 con 0x5598f86ea1d0 2024-08-18T22:10:27.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe603130740 10 client.0 _ll_register_callbacks cb 0x5598f85fdbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:10:27.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe5fa59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86e7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe5fa59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86e7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39172/0 (socket says 172.21.15.123:39172) 2024-08-18T22:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe5fa59c640 1 -- 172.21.15.123:0/1173030504 learned_addr learned my addr 172.21.15.123:0/1173030504 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe5f3fff640 1 --2- 172.21.15.123:0/1173030504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86df910 0x5598f86e75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe5fad9d640 1 --2- 172.21.15.123:0/1173030504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86ea1d0 0x5598f86e7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe5fa59c640 1 -- 172.21.15.123:0/1173030504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86ea1d0 msgr2=0x5598f86e7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe5fa59c640 1 --2- 172.21.15.123:0/1173030504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86ea1d0 0x5598f86e7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe5fa59c640 1 -- 172.21.15.123:0/1173030504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86df910 msgr2=0x5598f86e75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe5fa59c640 1 --2- 172.21.15.123:0/1173030504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86df910 0x5598f86e75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe5fa59c640 1 -- 172.21.15.123:0/1173030504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598f83b63c0 con 0x5598f86deff0 2024-08-18T22:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe5fa59c640 1 --2- 172.21.15.123:0/1173030504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86e7080 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec02ae00 tx=0x7fe5ec02a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccb93335f2f49f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe5e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe5e1ffb640 1 -- 172.21.15.123:0/1173030504 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0305a0 con 0x5598f86deff0 2024-08-18T22:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe5e1ffb640 1 -- 172.21.15.123:0/1173030504 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe5ec030740 con 0x5598f86deff0 2024-08-18T22:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe603130740 1 -- 172.21.15.123:0/1173030504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5e401cb00 con 0x5598f86deff0 2024-08-18T22:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe5e1ffb640 1 -- 172.21.15.123:0/1173030504 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe5ec030940 con 0x5598f86deff0 2024-08-18T22:10:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe603130740 10 client.15786 fetch_fsmap learned FSMap version 26 2024-08-18T22:10:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.338+0000 7fe603130740 1 -- 172.21.15.123:0/1173030504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5598f86f8970 con 0x5598f86deff0 2024-08-18T22:10:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.339+0000 7fe5e1ffb640 1 -- 172.21.15.123:0/1173030504 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5e401cb00 con 0x5598f86deff0 2024-08-18T22:10:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.339+0000 7fe5e1ffb640 1 -- 172.21.15.123:0/1173030504 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe5ec04f070 con 0x5598f86deff0 2024-08-18T22:10:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.339+0000 7fe603130740 10 client.15786 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:10:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.339+0000 7fe603130740 10 client.15786 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-18T22:10:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.339+0000 7fe603130740 20 client.15786 populate_metadata read hostname 'smithi123' 2024-08-18T22:10:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.339+0000 7fe603130740 1 --2- 172.21.15.123:0/1173030504 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5598f86f9d10 0x5598f86fc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.339+0000 7fe603130740 4 client.15786 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:10:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.339+0000 7fe603130740 1 -- 172.21.15.123:0/1173030504 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598f8651fb0 con 0x5598f86f9d10 2024-08-18T22:10:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.339+0000 7fe5f3fff640 1 --2- 172.21.15.123:0/1173030504 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5598f86f9d10 0x5598f86fc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.340+0000 7fe5f3fff640 1 --2- 172.21.15.123:0/1173030504 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5598f86f9d10 0x5598f86fc1b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=387b8f350e00418e server_cookie=d0ea97f96f980168 in_seq=0 out_seq=0 2024-08-18T22:10:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.340+0000 7fe5e1ffb640 10 client.15786 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:10:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.340+0000 7fe5e1ffb640 1 -- 172.21.15.123:0/1173030504 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5598f8651fb0 con 0x5598f86f9d10 2024-08-18T22:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.340+0000 7fe5e1ffb640 10 client.15786 handle_command_reply: tid=0 2024-08-18T22:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.340+0000 7fe603130740 1 client.15786 shutdown 2024-08-18T22:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.341+0000 7fe603130740 1 -- 172.21.15.123:0/1173030504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 msgr2=0x5598f86e7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.341+0000 7fe603130740 1 --2- 172.21.15.123:0/1173030504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86e7080 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec02ae00 tx=0x7fe5ec02a8e0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.341+0000 7fe603130740 1 -- 172.21.15.123:0/1173030504 shutdown_connections 2024-08-18T22:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.341+0000 7fe603130740 1 --2- 172.21.15.123:0/1173030504 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5598f86f9d10 0x5598f86fc1b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.341+0000 7fe603130740 1 --2- 172.21.15.123:0/1173030504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86ea1d0 0x5598f86e7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.341+0000 7fe603130740 1 --2- 172.21.15.123:0/1173030504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86df910 0x5598f86e75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.341+0000 7fe603130740 1 --2- 172.21.15.123:0/1173030504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86e7080 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.341+0000 7fe5e1ffb640 0 client.15786 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.341+0000 7fe603130740 1 -- 172.21.15.123:0/1173030504 >> 172.21.15.123:0/1173030504 conn(0x5598f86db580 msgr2=0x5598f86e1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.341+0000 7fe603130740 1 -- 172.21.15.123:0/1173030504 shutdown_connections 2024-08-18T22:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.341+0000 7fe603130740 1 -- 172.21.15.123:0/1173030504 wait complete. 2024-08-18T22:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.341+0000 7fe603130740 20 client.15786 trim_cache size 0 max 16384 2024-08-18T22:10:27.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe603130740 1 Processor -- start 2024-08-18T22:10:27.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe603130740 1 -- start start 2024-08-18T22:10:27.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe603130740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86e6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe603130740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86df910 0x5598f86db960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe603130740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86ea1d0 0x5598f8701a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe603130740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc1b3580 con 0x5598f86deff0 2024-08-18T22:10:27.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe603130740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc1b0e50 con 0x5598f86df910 2024-08-18T22:10:27.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe603130740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc1aeca0 con 0x5598f86ea1d0 2024-08-18T22:10:27.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe5fa59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86e6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe5fa59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86e6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39174/0 (socket says 172.21.15.123:39174) 2024-08-18T22:10:27.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe5fa59c640 1 -- 172.21.15.123:0/780543719 learned_addr learned my addr 172.21.15.123:0/780543719 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:27.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe5f3fff640 1 --2- 172.21.15.123:0/780543719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86df910 0x5598f86db960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe5fad9d640 1 --2- 172.21.15.123:0/780543719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86ea1d0 0x5598f8701a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe5fa59c640 1 -- 172.21.15.123:0/780543719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86ea1d0 msgr2=0x5598f8701a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:27.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe5fa59c640 1 --2- 172.21.15.123:0/780543719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86ea1d0 0x5598f8701a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe5fa59c640 1 -- 172.21.15.123:0/780543719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86df910 msgr2=0x5598f86db960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:27.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe5fa59c640 1 --2- 172.21.15.123:0/780543719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86df910 0x5598f86db960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe5fa59c640 1 -- 172.21.15.123:0/780543719 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598f86df740 con 0x5598f86deff0 2024-08-18T22:10:27.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe5fad9d640 1 --2- 172.21.15.123:0/780543719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86ea1d0 0x5598f8701a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:10:27.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.354+0000 7fe5fa59c640 1 --2- 172.21.15.123:0/780543719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86e6960 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec004010 tx=0x7fe5ec004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a893a0e946067875 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:27.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.355+0000 7fe5e3fff640 1 -- 172.21.15.123:0/780543719 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0047a0 con 0x5598f86deff0 2024-08-18T22:10:27.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.355+0000 7fe5e3fff640 1 -- 172.21.15.123:0/780543719 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5ec0305a0 con 0x5598f86deff0 2024-08-18T22:10:27.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.355+0000 7fe5e3fff640 1 -- 172.21.15.123:0/780543719 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec047410 con 0x5598f86deff0 2024-08-18T22:10:27.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.355+0000 7fe603130740 1 -- 172.21.15.123:0/780543719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 msgr2=0x5598f86e6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:27.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.355+0000 7fe603130740 1 --2- 172.21.15.123:0/780543719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86e6960 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec004010 tx=0x7fe5ec004490 comp rx=0 tx=0).stop 2024-08-18T22:10:27.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.355+0000 7fe603130740 1 -- 172.21.15.123:0/780543719 shutdown_connections 2024-08-18T22:10:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.355+0000 7fe603130740 1 --2- 172.21.15.123:0/780543719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86ea1d0 0x5598f8701a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.355+0000 7fe603130740 1 --2- 172.21.15.123:0/780543719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86df910 0x5598f86db960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.355+0000 7fe603130740 1 --2- 172.21.15.123:0/780543719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86e6960 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.355+0000 7fe603130740 1 -- 172.21.15.123:0/780543719 >> 172.21.15.123:0/780543719 conn(0x5598f86db580 msgr2=0x5598f86e8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.355+0000 7fe603130740 1 -- 172.21.15.123:0/780543719 shutdown_connections 2024-08-18T22:10:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.355+0000 7fe603130740 1 -- 172.21.15.123:0/780543719 wait complete. 2024-08-18T22:10:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe603130740 1 -- start start 2024-08-18T22:10:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe603130740 1 Processor -- start 2024-08-18T22:10:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe603130740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe603130740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86df910 0x5598f86edc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe603130740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86ea1d0 0x5598f8762a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe603130740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc1af310 con 0x5598f86deff0 2024-08-18T22:10:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe603130740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc1b0780 con 0x5598f86ea1d0 2024-08-18T22:10:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe603130740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc1af9e0 con 0x5598f86df910 2024-08-18T22:10:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe603130740 10 client.0 _ll_register_callbacks cb 0x7fe5ec009980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:10:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe5fa59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe5fa59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86ed6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39182/0 (socket says 172.21.15.123:39182) 2024-08-18T22:10:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe5fa59c640 1 -- 172.21.15.123:0/1082928487 learned_addr learned my addr 172.21.15.123:0/1082928487 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe5f3fff640 1 --2- 172.21.15.123:0/1082928487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86df910 0x5598f86edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe5fad9d640 1 --2- 172.21.15.123:0/1082928487 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86ea1d0 0x5598f8762a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe5fa59c640 1 -- 172.21.15.123:0/1082928487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86df910 msgr2=0x5598f86edc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe5fa59c640 1 --2- 172.21.15.123:0/1082928487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86df910 0x5598f86edc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe5fa59c640 1 -- 172.21.15.123:0/1082928487 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86ea1d0 msgr2=0x5598f8762a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe5fa59c640 1 --2- 172.21.15.123:0/1082928487 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86ea1d0 0x5598f8762a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.356+0000 7fe5fa59c640 1 -- 172.21.15.123:0/1082928487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598f8763080 con 0x5598f86deff0 2024-08-18T22:10:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe5fa59c640 1 --2- 172.21.15.123:0/1082928487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86ed6d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec051750 tx=0x7fe5ec051b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b793d5873702d92a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe5e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:10:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe5e1ffb640 1 -- 172.21.15.123:0/1082928487 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec064070 con 0x5598f86deff0 2024-08-18T22:10:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe5e1ffb640 1 -- 172.21.15.123:0/1082928487 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe5ec0047a0 con 0x5598f86deff0 2024-08-18T22:10:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe603130740 1 -- 172.21.15.123:0/1082928487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5ec0305a0 con 0x5598f86deff0 2024-08-18T22:10:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe5e1ffb640 1 -- 172.21.15.123:0/1082928487 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe5ec030750 con 0x5598f86deff0 2024-08-18T22:10:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe603130740 10 client.15792 fetch_fsmap learned FSMap version 26 2024-08-18T22:10:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe603130740 1 -- 172.21.15.123:0/1082928487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5598f87642d0 con 0x5598f86deff0 2024-08-18T22:10:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe5e1ffb640 1 -- 172.21.15.123:0/1082928487 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5ec0305a0 con 0x5598f86deff0 2024-08-18T22:10:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe5e1ffb640 1 -- 172.21.15.123:0/1082928487 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe5ec05d070 con 0x5598f86deff0 2024-08-18T22:10:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe603130740 10 client.15792 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:10:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe603130740 10 client.15792 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-18T22:10:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe603130740 20 client.15792 populate_metadata read hostname 'smithi123' 2024-08-18T22:10:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe603130740 1 --2- 172.21.15.123:0/1082928487 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5598f87648e0 0x5598f8766cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe603130740 4 client.15792 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:10:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.357+0000 7fe603130740 1 -- 172.21.15.123:0/1082928487 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5598f864c4c0 con 0x5598f87648e0 2024-08-18T22:10:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.358+0000 7fe5f3fff640 1 --2- 172.21.15.123:0/1082928487 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5598f87648e0 0x5598f8766cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.358+0000 7fe5e1ffb640 10 client.15792 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:10:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.358+0000 7fe5f3fff640 1 --2- 172.21.15.123:0/1082928487 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5598f87648e0 0x5598f8766cd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a81debd3e85660eb server_cookie=a9c31037e3b21383 in_seq=0 out_seq=0 2024-08-18T22:10:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.358+0000 7fe5e1ffb640 1 -- 172.21.15.123:0/1082928487 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5598f864c4c0 con 0x5598f87648e0 2024-08-18T22:10:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.358+0000 7fe5e1ffb640 10 client.15792 handle_command_reply: tid=0 2024-08-18T22:10:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.358+0000 7fe603130740 1 client.15792 shutdown 2024-08-18T22:10:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.358+0000 7fe603130740 1 -- 172.21.15.123:0/1082928487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 msgr2=0x5598f86ed6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.358+0000 7fe603130740 1 --2- 172.21.15.123:0/1082928487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86ed6d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec051750 tx=0x7fe5ec051b60 comp rx=0 tx=0).stop 2024-08-18T22:10:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.358+0000 7fe603130740 1 -- 172.21.15.123:0/1082928487 shutdown_connections 2024-08-18T22:10:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.358+0000 7fe603130740 1 --2- 172.21.15.123:0/1082928487 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598f86ea1d0 0x5598f8762a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.358+0000 7fe603130740 1 --2- 172.21.15.123:0/1082928487 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5598f87648e0 0x5598f8766cd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.358+0000 7fe603130740 1 --2- 172.21.15.123:0/1082928487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5598f86df910 0x5598f86edc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.358+0000 7fe603130740 1 --2- 172.21.15.123:0/1082928487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598f86deff0 0x5598f86ed6d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe603130740 1 -- 172.21.15.123:0/1082928487 >> 172.21.15.123:0/1082928487 conn(0x5598f86db580 msgr2=0x5598f86e8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:27.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.358+0000 7fe5e1ffb640 0 client.15792 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:10:27.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe603130740 1 -- 172.21.15.123:0/1082928487 shutdown_connections 2024-08-18T22:10:27.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe603130740 1 -- 172.21.15.123:0/1082928487 wait complete. 2024-08-18T22:10:27.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe603130740 20 client.15792 trim_cache size 0 max 16384 2024-08-18T22:10:27.366 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:10:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe600d32640 1 -- 172.21.15.123:0/2561837225 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe5e80a2c00 msgr2=0x7fe5e80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe600d32640 1 --2- 172.21.15.123:0/2561837225 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe5e80a2c00 0x7fe5e80a50c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec000f80 tx=0x7fe5ec0317e0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe600d32640 1 -- 172.21.15.123:0/2561837225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5fc107fd0 msgr2=0x7fe5fc19cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe600d32640 1 --2- 172.21.15.123:0/2561837225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5fc107fd0 0x7fe5fc19cbc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400d680 tx=0x7fe5f400db40 comp rx=0 tx=0).stop 2024-08-18T22:10:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe600d32640 1 -- 172.21.15.123:0/2561837225 shutdown_connections 2024-08-18T22:10:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe600d32640 1 --2- 172.21.15.123:0/2561837225 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe5e80a2c00 0x7fe5e80a50c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe600d32640 1 --2- 172.21.15.123:0/2561837225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5fc107fd0 0x7fe5fc19cbc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe600d32640 1 --2- 172.21.15.123:0/2561837225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5fc103410 0x7fe5fc198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe600d32640 1 --2- 172.21.15.123:0/2561837225 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5fc102a60 0x7fe5fc1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:27.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe600d32640 1 -- 172.21.15.123:0/2561837225 >> 172.21.15.123:0/2561837225 conn(0x7fe5fc0fc500 msgr2=0x7fe5fc105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:27.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe600d32640 1 -- 172.21.15.123:0/2561837225 shutdown_connections 2024-08-18T22:10:27.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:10:27.359+0000 7fe600d32640 1 -- 172.21.15.123:0/2561837225 wait complete. 2024-08-18T22:10:27.368 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:27.368 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:27.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:27 smithi183 ceph-mon[22097]: pgmap v420: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-08-18T22:10:27.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:27 smithi130 ceph-mon[21698]: pgmap v420: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-08-18T22:10:27.607 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:27.607 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:27.643 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:27.643 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:27.643 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 71 -lt 100 ']' 2024-08-18T22:10:27.643 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 71 + 1 2024-08-18T22:10:27.835 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=72 2024-08-18T22:10:27.835 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:27.892 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:27.892 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:27.893 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:27.893 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:27.893 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:28.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:28 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/4262360502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:10:28.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:28 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/4262360502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:10:28.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:28 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/4262360502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:10:29.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:29 smithi183 ceph-mon[22097]: pgmap v421: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 KiB/s wr, 7 op/s 2024-08-18T22:10:29.450 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:29.450 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:29.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:29 smithi123 ceph-mon[18462]: pgmap v421: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 KiB/s wr, 7 op/s 2024-08-18T22:10:29.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:29 smithi130 ceph-mon[21698]: pgmap v421: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 KiB/s wr, 7 op/s 2024-08-18T22:10:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.732+0000 7fb33a87d640 1 -- 172.21.15.123:0/1740660605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb334103440 msgr2=0x7fb334109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.732+0000 7fb33a87d640 1 --2- 172.21.15.123:0/1740660605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb334103440 0x7fb334109cd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009ca0 tx=0x7fb32c02a8c0 comp rx=0 tx=0).stop 2024-08-18T22:10:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.732+0000 7fb33a87d640 1 -- 172.21.15.123:0/1740660605 shutdown_connections 2024-08-18T22:10:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.732+0000 7fb33a87d640 1 --2- 172.21.15.123:0/1740660605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb334103440 0x7fb334109cd0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.732+0000 7fb33a87d640 1 --2- 172.21.15.123:0/1740660605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb334102a80 0x7fb334102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.732+0000 7fb33a87d640 1 --2- 172.21.15.123:0/1740660605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb334101890 0x7fb334101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.732+0000 7fb33a87d640 1 -- 172.21.15.123:0/1740660605 >> 172.21.15.123:0/1740660605 conn(0x7fb3340fd010 msgr2=0x7fb3340ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.732+0000 7fb33a87d640 1 -- 172.21.15.123:0/1740660605 shutdown_connections 2024-08-18T22:10:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.732+0000 7fb33a87d640 1 -- 172.21.15.123:0/1740660605 wait complete. 2024-08-18T22:10:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.749+0000 7fb33a87d640 1 Processor -- start 2024-08-18T22:10:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.749+0000 7fb33a87d640 1 -- start start 2024-08-18T22:10:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.749+0000 7fb33a87d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb334101890 0x7fb334197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.749+0000 7fb33a87d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb334102a80 0x7fb334198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.749+0000 7fb33a87d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb334103440 0x7fb33419f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.750+0000 7fb33a87d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb33410d560 con 0x7fb334102a80 2024-08-18T22:10:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.750+0000 7fb33a87d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb33410d3e0 con 0x7fb334101890 2024-08-18T22:10:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.750+0000 7fb33a87d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb33410d6e0 con 0x7fb334103440 2024-08-18T22:10:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.750+0000 7fb3337fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb334102a80 0x7fb334198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.750+0000 7fb3337fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb334102a80 0x7fb334198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39202/0 (socket says 172.21.15.123:39202) 2024-08-18T22:10:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.750+0000 7fb3337fe640 1 -- 172.21.15.123:0/3735750822 learned_addr learned my addr 172.21.15.123:0/3735750822 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.750+0000 7fb338e1a640 1 --2- 172.21.15.123:0/3735750822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb334103440 0x7fb33419f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.750+0000 7fb333fff640 1 --2- 172.21.15.123:0/3735750822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb334101890 0x7fb334197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.750+0000 7fb3337fe640 1 -- 172.21.15.123:0/3735750822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb334103440 msgr2=0x7fb33419f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.750+0000 7fb3337fe640 1 --2- 172.21.15.123:0/3735750822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb334103440 0x7fb33419f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.750+0000 7fb3337fe640 1 -- 172.21.15.123:0/3735750822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb334101890 msgr2=0x7fb334197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.750+0000 7fb3337fe640 1 --2- 172.21.15.123:0/3735750822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb334101890 0x7fb334197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.750+0000 7fb3337fe640 1 -- 172.21.15.123:0/3735750822 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33419f6e0 con 0x7fb334102a80 2024-08-18T22:10:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.750+0000 7fb333fff640 1 --2- 172.21.15.123:0/3735750822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb334101890 0x7fb334197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:10:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.750+0000 7fb3337fe640 1 --2- 172.21.15.123:0/3735750822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb334102a80 0x7fb334198000 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb32800d770 tx=0x7fb32800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:29.754 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.751+0000 7fb3317fa640 1 -- 172.21.15.123:0/3735750822 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb328017070 con 0x7fb334102a80 2024-08-18T22:10:29.754 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.751+0000 7fb3317fa640 1 -- 172.21.15.123:0/3735750822 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb328005500 con 0x7fb334102a80 2024-08-18T22:10:29.754 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.751+0000 7fb3317fa640 1 -- 172.21.15.123:0/3735750822 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb328004e00 con 0x7fb334102a80 2024-08-18T22:10:29.754 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.752+0000 7fb33a87d640 1 -- 172.21.15.123:0/3735750822 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33419f9d0 con 0x7fb334102a80 2024-08-18T22:10:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.754+0000 7fb3317fa640 1 -- 172.21.15.123:0/3735750822 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fb328004fa0 con 0x7fb334102a80 2024-08-18T22:10:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.755+0000 7fb3317fa640 1 --2- 172.21.15.123:0/3735750822 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb31c0a2da0 0x7fb31c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:29.756 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.755+0000 7fb333fff640 1 --2- 172.21.15.123:0/3735750822 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb31c0a2da0 0x7fb31c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:29.756 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.755+0000 7fb333fff640 1 --2- 172.21.15.123:0/3735750822 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb31c0a2da0 0x7fb31c0a5260 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb3341028e0 tx=0x7fb324005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.764+0000 7fb33a87d640 1 -- 172.21.15.123:0/3735750822 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb33419ff20 con 0x7fb334102a80 2024-08-18T22:10:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.765+0000 7fb3317fa640 1 -- 172.21.15.123:0/3735750822 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fb328098790 con 0x7fb334102a80 2024-08-18T22:10:29.933 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:29.933 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:29.951 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:29.951 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:29.951 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 72 -lt 100 ']' 2024-08-18T22:10:29.951 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 72 + 1 2024-08-18T22:10:29.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.982+0000 7fb33d63d740 1 Processor -- start 2024-08-18T22:10:29.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.982+0000 7fb33d63d740 1 -- start start 2024-08-18T22:10:29.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.982+0000 7fb33d63d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85680 0x559881a85a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:29.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.982+0000 7fb33d63d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85fc0 0x559881a8aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.982+0000 7fb33d63d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 0x559881a8d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.982+0000 7fb33d63d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5598819e89d0 con 0x559881a85fc0 2024-08-18T22:10:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.982+0000 7fb33d63d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559881990820 con 0x559881a8b050 2024-08-18T22:10:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.982+0000 7fb33d63d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5598819e4990 con 0x559881a85680 2024-08-18T22:10:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb3337fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85fc0 0x559881a8aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb338e1a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 0x559881a8d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb333fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85680 0x559881a85a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb338e1a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 0x559881a8d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:39900/0 (socket says 172.21.15.123:39900) 2024-08-18T22:10:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb338e1a640 1 -- 172.21.15.123:0/3670145175 learned_addr learned my addr 172.21.15.123:0/3670145175 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb3337fe640 1 -- 172.21.15.123:0/3670145175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85680 msgr2=0x559881a85a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb3337fe640 1 --2- 172.21.15.123:0/3670145175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85680 0x559881a85a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb3337fe640 1 -- 172.21.15.123:0/3670145175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 msgr2=0x559881a8d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb3337fe640 1 --2- 172.21.15.123:0/3670145175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 0x559881a8d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb3337fe640 1 -- 172.21.15.123:0/3670145175 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598816fc210 con 0x559881a85fc0 2024-08-18T22:10:29.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb333fff640 1 --2- 172.21.15.123:0/3670145175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85680 0x559881a85a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:10:29.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb338e1a640 1 --2- 172.21.15.123:0/3670145175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 0x559881a8d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:10:29.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb3337fe640 1 --2- 172.21.15.123:0/3670145175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85fc0 0x559881a8aa80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb33419f5b0 tx=0x7fb3280cb860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44a0901a005b8c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:29.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb31a7fc640 1 -- 172.21.15.123:0/3670145175 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32809a6f0 con 0x559881a85fc0 2024-08-18T22:10:29.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb31a7fc640 1 -- 172.21.15.123:0/3670145175 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb32809eaa0 con 0x559881a85fc0 2024-08-18T22:10:29.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.983+0000 7fb31a7fc640 1 -- 172.21.15.123:0/3670145175 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb328099b40 con 0x559881a85fc0 2024-08-18T22:10:29.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.984+0000 7fb33d63d740 1 -- 172.21.15.123:0/3670145175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85fc0 msgr2=0x559881a8aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:29.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.984+0000 7fb33d63d740 1 --2- 172.21.15.123:0/3670145175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85fc0 0x559881a8aa80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb33419f5b0 tx=0x7fb3280cb860 comp rx=0 tx=0).stop 2024-08-18T22:10:29.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.984+0000 7fb33d63d740 1 -- 172.21.15.123:0/3670145175 shutdown_connections 2024-08-18T22:10:29.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.984+0000 7fb33d63d740 1 --2- 172.21.15.123:0/3670145175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 0x559881a8d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:29.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.984+0000 7fb33d63d740 1 --2- 172.21.15.123:0/3670145175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85fc0 0x559881a8aa80 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:29.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.984+0000 7fb33d63d740 1 --2- 172.21.15.123:0/3670145175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85680 0x559881a85a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:29.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.984+0000 7fb33d63d740 1 -- 172.21.15.123:0/3670145175 >> 172.21.15.123:0/3670145175 conn(0x559881a80cf0 msgr2=0x559881a810f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:29.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.984+0000 7fb33d63d740 1 -- 172.21.15.123:0/3670145175 shutdown_connections 2024-08-18T22:10:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.984+0000 7fb33d63d740 1 -- 172.21.15.123:0/3670145175 wait complete. 2024-08-18T22:10:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:29.988+0000 7fb33d63d740 1 -- start start 2024-08-18T22:10:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.017+0000 7fb33d63d740 1 Processor -- start 2024-08-18T22:10:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.017+0000 7fb33d63d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a8f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.017+0000 7fb33d63d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a85fc0 0x559881a8fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.017+0000 7fb33d63d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a8b050 0x559881a96e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.017+0000 7fb33d63d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559881a8dfc0 con 0x559881a85680 2024-08-18T22:10:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.017+0000 7fb33d63d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5598819a4520 con 0x559881a85fc0 2024-08-18T22:10:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.017+0000 7fb33d63d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x559881a8e140 con 0x559881a8b050 2024-08-18T22:10:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.018+0000 7fb333fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a8f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.018+0000 7fb333fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a8f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39220/0 (socket says 172.21.15.123:39220) 2024-08-18T22:10:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.018+0000 7fb333fff640 1 -- 172.21.15.123:0/3854397690 learned_addr learned my addr 172.21.15.123:0/3854397690 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.018+0000 7fb3337fe640 1 --2- 172.21.15.123:0/3854397690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a85fc0 0x559881a8fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.018+0000 7fb338e1a640 1 --2- 172.21.15.123:0/3854397690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a8b050 0x559881a96e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.018+0000 7fb333fff640 1 -- 172.21.15.123:0/3854397690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a8b050 msgr2=0x559881a96e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.018+0000 7fb333fff640 1 --2- 172.21.15.123:0/3854397690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a8b050 0x559881a96e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.018+0000 7fb333fff640 1 -- 172.21.15.123:0/3854397690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a85fc0 msgr2=0x559881a8fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.018+0000 7fb333fff640 1 --2- 172.21.15.123:0/3854397690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a85fc0 0x559881a8fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.018+0000 7fb333fff640 1 -- 172.21.15.123:0/3854397690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598817c8620 con 0x559881a85680 2024-08-18T22:10:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.018+0000 7fb333fff640 1 --2- 172.21.15.123:0/3854397690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a8f890 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb324012c40 tx=0x7fb324004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e4cbf45c842e0f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.018+0000 7fb3137fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:10:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.019+0000 7fb3137fe640 1 -- 172.21.15.123:0/3854397690 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb324029640 con 0x559881a85680 2024-08-18T22:10:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.019+0000 7fb3137fe640 1 -- 172.21.15.123:0/3854397690 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fb3240283e0 con 0x559881a85680 2024-08-18T22:10:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.020+0000 7fb33d63d740 10 client.0 _ll_register_callbacks cb 0x5598816fba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:10:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.022+0000 7fb33d63d740 1 -- 172.21.15.123:0/3854397690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb32809eaa0 con 0x559881a85680 2024-08-18T22:10:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.022+0000 7fb3137fe640 1 -- 172.21.15.123:0/3854397690 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb3240297e0 con 0x559881a85680 2024-08-18T22:10:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.022+0000 7fb33d63d740 10 client.15804 fetch_fsmap learned FSMap version 26 2024-08-18T22:10:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.022+0000 7fb33d63d740 1 -- 172.21.15.123:0/3854397690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({fsmap=26}) -- 0x559881a99ad0 con 0x559881a85680 2024-08-18T22:10:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.028+0000 7fb3137fe640 1 -- 172.21.15.123:0/3854397690 <== mon.0 v2:172.21.15.123:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb324027070 con 0x559881a85680 2024-08-18T22:10:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.028+0000 7fb33d63d740 10 client.15804 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:10:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.028+0000 7fb33d63d740 10 client.15804 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:10:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.029+0000 7fb33d63d740 20 client.15804 populate_metadata read hostname 'smithi123' 2024-08-18T22:10:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.029+0000 7fb33d63d740 1 --2- 172.21.15.123:0/3854397690 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559881a9b100 0x559881a9d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.029+0000 7fb33d63d740 4 client.15804 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:10:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.029+0000 7fb33d63d740 1 -- 172.21.15.123:0/3854397690 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598819f6100 con 0x559881a9b100 2024-08-18T22:10:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.029+0000 7fb3337fe640 1 --2- 172.21.15.123:0/3854397690 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559881a9b100 0x559881a9d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.030+0000 7fb3137fe640 10 client.15804 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:10:30.032 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.030+0000 7fb3337fe640 1 --2- 172.21.15.123:0/3854397690 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559881a9b100 0x559881a9d590 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62d7a8c86db6cf71 server_cookie=437d345813fb7543 in_seq=0 out_seq=0 2024-08-18T22:10:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.031+0000 7fb3137fe640 1 -- 172.21.15.123:0/3854397690 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5598819f6100 con 0x559881a9b100 2024-08-18T22:10:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.031+0000 7fb3137fe640 10 client.15804 handle_command_reply: tid=0 2024-08-18T22:10:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.031+0000 7fb33d63d740 1 client.15804 shutdown 2024-08-18T22:10:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.031+0000 7fb33d63d740 1 -- 172.21.15.123:0/3854397690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 msgr2=0x559881a8f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.031+0000 7fb33d63d740 1 --2- 172.21.15.123:0/3854397690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a8f890 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb324012c40 tx=0x7fb324004730 comp rx=0 tx=0).stop 2024-08-18T22:10:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.031+0000 7fb33d63d740 1 -- 172.21.15.123:0/3854397690 shutdown_connections 2024-08-18T22:10:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.031+0000 7fb33d63d740 1 --2- 172.21.15.123:0/3854397690 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559881a9b100 0x559881a9d590 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.031+0000 7fb33d63d740 1 --2- 172.21.15.123:0/3854397690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a8b050 0x559881a96e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.031+0000 7fb33d63d740 1 --2- 172.21.15.123:0/3854397690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a85fc0 0x559881a8fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.031+0000 7fb33d63d740 1 --2- 172.21.15.123:0/3854397690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a8f890 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.031+0000 7fb3137fe640 0 client.15804 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:10:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.031+0000 7fb33d63d740 1 -- 172.21.15.123:0/3854397690 >> 172.21.15.123:0/3854397690 conn(0x559881a80cf0 msgr2=0x559881a82500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.031+0000 7fb33d63d740 1 -- 172.21.15.123:0/3854397690 shutdown_connections 2024-08-18T22:10:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.031+0000 7fb33d63d740 1 -- 172.21.15.123:0/3854397690 wait complete. 2024-08-18T22:10:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.031+0000 7fb33d63d740 20 client.15804 trim_cache size 0 max 16384 2024-08-18T22:10:30.066 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=73 2024-08-18T22:10:30.067 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.069+0000 7fb33d63d740 1 Processor -- start 2024-08-18T22:10:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.069+0000 7fb33d63d740 1 -- start start 2024-08-18T22:10:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.069+0000 7fb33d63d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a8fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.069+0000 7fb33d63d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85fc0 0x559881a96d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.069+0000 7fb33d63d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 0x559881a81ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.069+0000 7fb33d63d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341acdc0 con 0x559881a85680 2024-08-18T22:10:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.069+0000 7fb33d63d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341aa620 con 0x559881a8b050 2024-08-18T22:10:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.069+0000 7fb33d63d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341a8470 con 0x559881a85fc0 2024-08-18T22:10:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb333fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a8fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb333fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a8fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39236/0 (socket says 172.21.15.123:39236) 2024-08-18T22:10:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb333fff640 1 -- 172.21.15.123:0/1952129556 learned_addr learned my addr 172.21.15.123:0/1952129556 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb3337fe640 1 --2- 172.21.15.123:0/1952129556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85fc0 0x559881a96d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb338e1a640 1 --2- 172.21.15.123:0/1952129556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 0x559881a81ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb333fff640 1 -- 172.21.15.123:0/1952129556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85fc0 msgr2=0x559881a96d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb333fff640 1 --2- 172.21.15.123:0/1952129556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85fc0 0x559881a96d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb333fff640 1 -- 172.21.15.123:0/1952129556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 msgr2=0x559881a81ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb333fff640 1 --2- 172.21.15.123:0/1952129556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 0x559881a81ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb333fff640 1 -- 172.21.15.123:0/1952129556 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559881a8d440 con 0x559881a85680 2024-08-18T22:10:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb3337fe640 1 --2- 172.21.15.123:0/1952129556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85fc0 0x559881a96d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:10:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb338e1a640 1 --2- 172.21.15.123:0/1952129556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 0x559881a81ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:10:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb333fff640 1 --2- 172.21.15.123:0/1952129556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a8fd50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb3240098a0 tx=0x7fb324022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00c25831ab8a93b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb319ffb640 1 -- 172.21.15.123:0/1952129556 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb324029440 con 0x559881a85680 2024-08-18T22:10:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb319ffb640 1 -- 172.21.15.123:0/1952129556 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb324039030 con 0x559881a85680 2024-08-18T22:10:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.070+0000 7fb319ffb640 1 -- 172.21.15.123:0/1952129556 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb324004730 con 0x559881a85680 2024-08-18T22:10:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.071+0000 7fb33d63d740 1 -- 172.21.15.123:0/1952129556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 msgr2=0x559881a8fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.071+0000 7fb33d63d740 1 --2- 172.21.15.123:0/1952129556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a8fd50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb3240098a0 tx=0x7fb324022040 comp rx=0 tx=0).stop 2024-08-18T22:10:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.071+0000 7fb33d63d740 1 -- 172.21.15.123:0/1952129556 shutdown_connections 2024-08-18T22:10:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.071+0000 7fb33d63d740 1 --2- 172.21.15.123:0/1952129556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 0x559881a81ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.071+0000 7fb33d63d740 1 --2- 172.21.15.123:0/1952129556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85fc0 0x559881a96d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.071+0000 7fb33d63d740 1 --2- 172.21.15.123:0/1952129556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a8fd50 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.071+0000 7fb33d63d740 1 -- 172.21.15.123:0/1952129556 >> 172.21.15.123:0/1952129556 conn(0x559881a80cf0 msgr2=0x559881a8f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.071+0000 7fb33d63d740 1 -- 172.21.15.123:0/1952129556 shutdown_connections 2024-08-18T22:10:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.071+0000 7fb33d63d740 1 -- 172.21.15.123:0/1952129556 wait complete. 2024-08-18T22:10:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.072+0000 7fb33d63d740 1 -- start start 2024-08-18T22:10:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.072+0000 7fb33d63d740 1 Processor -- start 2024-08-18T22:10:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.072+0000 7fb33d63d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a94bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.072+0000 7fb33d63d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85fc0 0x559881a950f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.072+0000 7fb33d63d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 0x559881a96100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.072+0000 7fb33d63d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341a8ae0 con 0x559881a85680 2024-08-18T22:10:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.072+0000 7fb33d63d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341a9f50 con 0x559881a8b050 2024-08-18T22:10:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.072+0000 7fb33d63d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341a91b0 con 0x559881a85fc0 2024-08-18T22:10:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.072+0000 7fb33d63d740 10 client.0 _ll_register_callbacks cb 0x7fb324009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:10:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.072+0000 7fb333fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a94bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb333fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a94bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39246/0 (socket says 172.21.15.123:39246) 2024-08-18T22:10:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb333fff640 1 -- 172.21.15.123:0/1179725835 learned_addr learned my addr 172.21.15.123:0/1179725835 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb3337fe640 1 --2- 172.21.15.123:0/1179725835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85fc0 0x559881a950f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb338e1a640 1 --2- 172.21.15.123:0/1179725835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 0x559881a96100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb333fff640 1 -- 172.21.15.123:0/1179725835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85fc0 msgr2=0x559881a950f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb333fff640 1 --2- 172.21.15.123:0/1179725835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85fc0 0x559881a950f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb333fff640 1 -- 172.21.15.123:0/1179725835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 msgr2=0x559881a96100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb333fff640 1 --2- 172.21.15.123:0/1179725835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 0x559881a96100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb333fff640 1 -- 172.21.15.123:0/1179725835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559881a96710 con 0x559881a85680 2024-08-18T22:10:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb333fff640 1 --2- 172.21.15.123:0/1179725835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a94bb0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb3240059a0 tx=0x7fb324014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253612b66d3575b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb3137fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:10:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb3137fe640 1 -- 172.21.15.123:0/1179725835 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb324029640 con 0x559881a85680 2024-08-18T22:10:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb3137fe640 1 -- 172.21.15.123:0/1179725835 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fb324004020 con 0x559881a85680 2024-08-18T22:10:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb33d63d740 1 -- 172.21.15.123:0/1179725835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb324039030 con 0x559881a85680 2024-08-18T22:10:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb3137fe640 1 -- 172.21.15.123:0/1179725835 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb32404f050 con 0x559881a85680 2024-08-18T22:10:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb33d63d740 10 client.15810 fetch_fsmap learned FSMap version 26 2024-08-18T22:10:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.073+0000 7fb33d63d740 1 -- 172.21.15.123:0/1179725835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559881b063e0 con 0x559881a85680 2024-08-18T22:10:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.074+0000 7fb3137fe640 1 -- 172.21.15.123:0/1179725835 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb324039030 con 0x559881a85680 2024-08-18T22:10:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.074+0000 7fb3137fe640 1 -- 172.21.15.123:0/1179725835 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb324045030 con 0x559881a85680 2024-08-18T22:10:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.074+0000 7fb33d63d740 10 client.15810 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:10:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.074+0000 7fb33d63d740 10 client.15810 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:10:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.074+0000 7fb33d63d740 20 client.15810 populate_metadata read hostname 'smithi123' 2024-08-18T22:10:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.074+0000 7fb33d63d740 1 --2- 172.21.15.123:0/1179725835 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559881b06d60 0x559881b09180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.074+0000 7fb33d63d740 4 client.15810 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:10:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.074+0000 7fb33d63d740 1 -- 172.21.15.123:0/1179725835 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5598819f0450 con 0x559881b06d60 2024-08-18T22:10:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.074+0000 7fb3337fe640 1 --2- 172.21.15.123:0/1179725835 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559881b06d60 0x559881b09180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.075+0000 7fb3137fe640 10 client.15810 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:10:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.075+0000 7fb3337fe640 1 --2- 172.21.15.123:0/1179725835 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559881b06d60 0x559881b09180 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8797a3c34aa475fe server_cookie=73a297ae209fa127 in_seq=0 out_seq=0 2024-08-18T22:10:30.096 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.091+0000 7fb3137fe640 1 -- 172.21.15.123:0/1179725835 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5598819f0450 con 0x559881b06d60 2024-08-18T22:10:30.096 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.091+0000 7fb3137fe640 10 client.15810 handle_command_reply: tid=0 2024-08-18T22:10:30.096 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.091+0000 7fb33d63d740 1 client.15810 shutdown 2024-08-18T22:10:30.096 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.091+0000 7fb33d63d740 1 -- 172.21.15.123:0/1179725835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 msgr2=0x559881a94bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.091+0000 7fb33d63d740 1 --2- 172.21.15.123:0/1179725835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a94bb0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb3240059a0 tx=0x7fb324014000 comp rx=0 tx=0).stop 2024-08-18T22:10:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.091+0000 7fb33d63d740 1 -- 172.21.15.123:0/1179725835 shutdown_connections 2024-08-18T22:10:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.091+0000 7fb33d63d740 1 --2- 172.21.15.123:0/1179725835 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559881b06d60 0x559881b09180 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.091+0000 7fb33d63d740 1 --2- 172.21.15.123:0/1179725835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559881a8b050 0x559881a96100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.091+0000 7fb33d63d740 1 --2- 172.21.15.123:0/1179725835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559881a85fc0 0x559881a950f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.091+0000 7fb3137fe640 0 client.15810 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:10:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.091+0000 7fb33d63d740 1 --2- 172.21.15.123:0/1179725835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559881a85680 0x559881a94bb0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.092+0000 7fb33d63d740 1 -- 172.21.15.123:0/1179725835 >> 172.21.15.123:0/1179725835 conn(0x559881a80cf0 msgr2=0x559881a7f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.092+0000 7fb33d63d740 1 -- 172.21.15.123:0/1179725835 shutdown_connections 2024-08-18T22:10:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.092+0000 7fb33d63d740 1 -- 172.21.15.123:0/1179725835 wait complete. 2024-08-18T22:10:30.099 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.092+0000 7fb33d63d740 20 client.15810 trim_cache size 0 max 16384 2024-08-18T22:10:30.100 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:10:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:10:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:10:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:10:30.102 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:30.102 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:30.102 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.094+0000 7fb33a87d640 1 -- 172.21.15.123:0/3735750822 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb31c0a2da0 msgr2=0x7fb31c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.094+0000 7fb33a87d640 1 --2- 172.21.15.123:0/3735750822 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb31c0a2da0 0x7fb31c0a5260 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb3341028e0 tx=0x7fb324005f90 comp rx=0 tx=0).stop 2024-08-18T22:10:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.094+0000 7fb33a87d640 1 -- 172.21.15.123:0/3735750822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb334102a80 msgr2=0x7fb334198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.094+0000 7fb33a87d640 1 --2- 172.21.15.123:0/3735750822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb334102a80 0x7fb334198000 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb32800d770 tx=0x7fb32800dc30 comp rx=0 tx=0).stop 2024-08-18T22:10:30.105 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.094+0000 7fb33a87d640 1 -- 172.21.15.123:0/3735750822 shutdown_connections 2024-08-18T22:10:30.105 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.094+0000 7fb33a87d640 1 --2- 172.21.15.123:0/3735750822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb334103440 0x7fb33419f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.105 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.094+0000 7fb33a87d640 1 --2- 172.21.15.123:0/3735750822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb334102a80 0x7fb334198000 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.105 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.094+0000 7fb33a87d640 1 --2- 172.21.15.123:0/3735750822 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb31c0a2da0 0x7fb31c0a5260 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.105 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.094+0000 7fb33a87d640 1 --2- 172.21.15.123:0/3735750822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb334101890 0x7fb334197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:30.105 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.094+0000 7fb33a87d640 1 -- 172.21.15.123:0/3735750822 >> 172.21.15.123:0/3735750822 conn(0x7fb3340fd010 msgr2=0x7fb334105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:30.106 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.094+0000 7fb33a87d640 1 -- 172.21.15.123:0/3735750822 shutdown_connections 2024-08-18T22:10:30.106 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:30.094+0000 7fb33a87d640 1 -- 172.21.15.123:0/3735750822 wait complete. 2024-08-18T22:10:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:31 smithi183 ceph-mon[22097]: pgmap v422: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-08-18T22:10:31.500 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:31.500 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:31.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:31 smithi123 ceph-mon[18462]: pgmap v422: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-08-18T22:10:31.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:31 smithi130 ceph-mon[21698]: pgmap v422: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-08-18T22:10:32.036 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:32.036 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:32.073 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:32.073 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:32.074 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 73 -lt 100 ']' 2024-08-18T22:10:32.074 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 73 + 1 2024-08-18T22:10:32.195 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=74 2024-08-18T22:10:32.196 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:32.293 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:32.293 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:32.295 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:32.295 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:32.295 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:33.056 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-08-18T22:10:33.056 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24466 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-08-18T22:10:33.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:33 smithi123 ceph-mon[18462]: pgmap v423: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 KiB/s wr, 9 op/s 2024-08-18T22:10:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:33 smithi183 ceph-mon[22097]: pgmap v423: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 KiB/s wr, 9 op/s 2024-08-18T22:10:33.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:33 smithi130 ceph-mon[21698]: pgmap v423: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 KiB/s wr, 9 op/s 2024-08-18T22:10:33.558 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-18T22:10:33.559 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:33.559 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:33.721 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:33.722 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:33.741 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:33.741 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:33.741 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 74 -lt 100 ']' 2024-08-18T22:10:33.741 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 74 + 1 2024-08-18T22:10:33.799 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=75 2024-08-18T22:10:33.800 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:33.826 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:33.826 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:33.828 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:33.828 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:33.828 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:34.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:34 smithi183 ceph-mon[22097]: pgmap v424: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-08-18T22:10:34.424 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:34 smithi123 ceph-mon[18462]: pgmap v424: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-08-18T22:10:34.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:34 smithi130 ceph-mon[21698]: pgmap v424: 129 pgs: 129 active+clean; 1.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-08-18T22:10:34.591 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:34.591 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:34.818 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:34.818 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:34.850 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:34.850 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:34.850 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 75 -lt 100 ']' 2024-08-18T22:10:34.850 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 75 + 1 2024-08-18T22:10:34.909 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=76 2024-08-18T22:10:34.909 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:35.007 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:35.008 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:35.009 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:35.009 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:35.009 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:35.890 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:35.891 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:36.223 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:36.224 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:36.232 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:36.232 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:36.232 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 76 -lt 100 ']' 2024-08-18T22:10:36.232 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 76 + 1 2024-08-18T22:10:36.324 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=77 2024-08-18T22:10:36.324 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:36.400 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:36.400 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:36.401 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:36.402 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:36.402 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:37.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:36 smithi123 ceph-mon[18462]: pgmap v425: 129 pgs: 129 active+clean; 1.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-08-18T22:10:37.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:36 smithi130 ceph-mon[21698]: pgmap v425: 129 pgs: 129 active+clean; 1.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-08-18T22:10:37.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:36 smithi183 ceph-mon[22097]: pgmap v425: 129 pgs: 129 active+clean; 1.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-08-18T22:10:37.599 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:37.599 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:37.940 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:37.940 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:37.948 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:37.948 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:37.948 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 77 -lt 100 ']' 2024-08-18T22:10:37.948 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 77 + 1 2024-08-18T22:10:38.029 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=78 2024-08-18T22:10:38.030 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:38.058 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:38.058 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:38.059 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:38.060 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:38.060 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:39.070 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:38 smithi123 ceph-mon[18462]: pgmap v426: 129 pgs: 129 active+clean; 1.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-08-18T22:10:39.157 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:39.157 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:39.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:38 smithi130 ceph-mon[21698]: pgmap v426: 129 pgs: 129 active+clean; 1.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-08-18T22:10:39.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:38 smithi183 ceph-mon[22097]: pgmap v426: 129 pgs: 129 active+clean; 1.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-08-18T22:10:39.460 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:39.460 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:39.481 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:39.481 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:39.481 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 78 -lt 100 ']' 2024-08-18T22:10:39.481 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 78 + 1 2024-08-18T22:10:39.585 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=79 2024-08-18T22:10:39.585 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:39.657 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:39.657 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:39.658 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:39.659 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:39.659 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:40.998 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:40.998 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:41.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:40 smithi123 ceph-mon[18462]: pgmap v427: 129 pgs: 129 active+clean; 1.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 15 op/s 2024-08-18T22:10:41.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:40 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:10:41.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:40 smithi130 ceph-mon[21698]: pgmap v427: 129 pgs: 129 active+clean; 1.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 15 op/s 2024-08-18T22:10:41.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:40 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:10:41.358 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:41.359 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:41.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:40 smithi183 ceph-mon[22097]: pgmap v427: 129 pgs: 129 active+clean; 1.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 15 op/s 2024-08-18T22:10:41.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:40 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:10:41.415 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:41.415 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:41.415 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 79 -lt 100 ']' 2024-08-18T22:10:41.416 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 79 + 1 2024-08-18T22:10:41.481 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=80 2024-08-18T22:10:41.482 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:41.490 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:41.491 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:41.492 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:41.492 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:41.492 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:42.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:10:42.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:42 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:10:42.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:42 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:10:42.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:42 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:10:42.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:42 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:10:42.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:42 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:10:43.156 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:43.156 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:43.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:43 smithi183 ceph-mon[22097]: pgmap v428: 129 pgs: 129 active+clean; 1.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-08-18T22:10:43.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:43 smithi123 ceph-mon[18462]: pgmap v428: 129 pgs: 129 active+clean; 1.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-08-18T22:10:43.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:43 smithi130 ceph-mon[21698]: pgmap v428: 129 pgs: 129 active+clean; 1.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-08-18T22:10:43.681 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:43.681 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:43.707 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:43.707 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:43.707 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 80 -lt 100 ']' 2024-08-18T22:10:43.707 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 80 + 1 2024-08-18T22:10:43.824 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=81 2024-08-18T22:10:43.824 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:43.839 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:43.839 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:43.841 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:43.841 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:43.841 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:45.223 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:45.223 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:45.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:45 smithi123 ceph-mon[18462]: pgmap v429: 129 pgs: 129 active+clean; 1.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-08-18T22:10:45.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:45 smithi183 ceph-mon[22097]: pgmap v429: 129 pgs: 129 active+clean; 1.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-08-18T22:10:45.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:45 smithi130 ceph-mon[21698]: pgmap v429: 129 pgs: 129 active+clean; 1.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-08-18T22:10:45.526 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:45.526 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:45.581 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:45.581 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:45.581 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 81 -lt 100 ']' 2024-08-18T22:10:45.581 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 81 + 1 2024-08-18T22:10:45.773 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=82 2024-08-18T22:10:45.773 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:45.835 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:45.836 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:45.837 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:45.837 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:45.837 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.016+0000 7fc892544640 1 -- 172.21.15.123:0/1779949437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc88c101890 msgr2=0x7fc88c101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.016+0000 7fc892544640 1 --2- 172.21.15.123:0/1779949437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc88c101890 0x7fc88c101c90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009860 tx=0x7fc87c02a340 comp rx=0 tx=0).stop 2024-08-18T22:10:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.016+0000 7fc892544640 1 -- 172.21.15.123:0/1779949437 shutdown_connections 2024-08-18T22:10:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.016+0000 7fc892544640 1 --2- 172.21.15.123:0/1779949437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc88c103440 0x7fc88c109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.016+0000 7fc892544640 1 --2- 172.21.15.123:0/1779949437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc88c102a80 0x7fc88c102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.016+0000 7fc892544640 1 --2- 172.21.15.123:0/1779949437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc88c101890 0x7fc88c101c90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.016+0000 7fc892544640 1 -- 172.21.15.123:0/1779949437 >> 172.21.15.123:0/1779949437 conn(0x7fc88c0fcff0 msgr2=0x7fc88c0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.016+0000 7fc892544640 1 -- 172.21.15.123:0/1779949437 shutdown_connections 2024-08-18T22:10:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.016+0000 7fc892544640 1 -- 172.21.15.123:0/1779949437 wait complete. 2024-08-18T22:10:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.028+0000 7fc892544640 1 Processor -- start 2024-08-18T22:10:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.028+0000 7fc892544640 1 -- start start 2024-08-18T22:10:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc892544640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc88c101890 0x7fc88c199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc892544640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc88c102a80 0x7fc88c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc892544640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc88c103440 0x7fc88c1a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc892544640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c10d510 con 0x7fc88c103440 2024-08-18T22:10:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc892544640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c10d390 con 0x7fc88c101890 2024-08-18T22:10:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc892544640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c10d690 con 0x7fc88c102a80 2024-08-18T22:10:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc890ae1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc88c103440 0x7fc88c1a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc890ae1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc88c103440 0x7fc88c1a12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52332/0 (socket says 172.21.15.123:52332) 2024-08-18T22:10:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc890ae1640 1 -- 172.21.15.123:0/3338188774 learned_addr learned my addr 172.21.15.123:0/3338188774 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc883fff640 1 --2- 172.21.15.123:0/3338188774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc88c102a80 0x7fc88c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc88bfff640 1 --2- 172.21.15.123:0/3338188774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc88c101890 0x7fc88c199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc890ae1640 1 -- 172.21.15.123:0/3338188774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc88c102a80 msgr2=0x7fc88c19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc890ae1640 1 --2- 172.21.15.123:0/3338188774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc88c102a80 0x7fc88c19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc890ae1640 1 -- 172.21.15.123:0/3338188774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc88c101890 msgr2=0x7fc88c199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc890ae1640 1 --2- 172.21.15.123:0/3338188774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc88c101890 0x7fc88c199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc890ae1640 1 -- 172.21.15.123:0/3338188774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c1a1950 con 0x7fc88c103440 2024-08-18T22:10:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.029+0000 7fc890ae1640 1 --2- 172.21.15.123:0/3338188774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc88c103440 0x7fc88c1a12b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc88400eb10 tx=0x7fc88400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.030+0000 7fc889ffb640 1 -- 172.21.15.123:0/3338188774 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc884004b20 con 0x7fc88c103440 2024-08-18T22:10:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.031+0000 7fc892544640 1 -- 172.21.15.123:0/3338188774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88c1a1c40 con 0x7fc88c103440 2024-08-18T22:10:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.031+0000 7fc889ffb640 1 -- 172.21.15.123:0/3338188774 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc884004cc0 con 0x7fc88c103440 2024-08-18T22:10:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.031+0000 7fc889ffb640 1 -- 172.21.15.123:0/3338188774 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc884010760 con 0x7fc88c103440 2024-08-18T22:10:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.033+0000 7fc889ffb640 1 -- 172.21.15.123:0/3338188774 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fc884005000 con 0x7fc88c103440 2024-08-18T22:10:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.033+0000 7fc889ffb640 1 --2- 172.21.15.123:0/3338188774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc8780a2da0 0x7fc8780a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.034+0000 7fc88bfff640 1 --2- 172.21.15.123:0/3338188774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc8780a2da0 0x7fc8780a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.034+0000 7fc88bfff640 1 --2- 172.21.15.123:0/3338188774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc8780a2da0 0x7fc8780a5260 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc88c19b210 tx=0x7fc87c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.064+0000 7fc892544640 1 -- 172.21.15.123:0/3338188774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc88c1a2190 con 0x7fc88c103440 2024-08-18T22:10:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.064+0000 7fc889ffb640 1 -- 172.21.15.123:0/3338188774 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fc884099a30 con 0x7fc88c103440 2024-08-18T22:10:47.297 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:47 smithi123 ceph-mon[18462]: pgmap v430: 129 pgs: 129 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-08-18T22:10:47.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:47 smithi183 ceph-mon[22097]: pgmap v430: 129 pgs: 129 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-08-18T22:10:47.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:47 smithi130 ceph-mon[21698]: pgmap v430: 129 pgs: 129 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-08-18T22:10:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.626+0000 7fc8953dc740 1 Processor -- start 2024-08-18T22:10:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.626+0000 7fc8953dc740 1 -- start start 2024-08-18T22:10:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.626+0000 7fc8953dc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301680 0x5644be301a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.626+0000 7fc8953dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be301fc0 0x5644be306a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.626+0000 7fc8953dc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be307050 0x5644be309510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.626+0000 7fc8953dc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5644be2649d0 con 0x5644be307050 2024-08-18T22:10:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.626+0000 7fc8953dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5644be20c820 con 0x5644be301fc0 2024-08-18T22:10:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.626+0000 7fc8953dc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5644be260990 con 0x5644be301680 2024-08-18T22:10:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.626+0000 7fc890ae1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be307050 0x5644be309510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.626+0000 7fc890ae1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be307050 0x5644be309510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52344/0 (socket says 172.21.15.123:52344) 2024-08-18T22:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.626+0000 7fc890ae1640 1 -- 172.21.15.123:0/3089635737 learned_addr learned my addr 172.21.15.123:0/3089635737 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.627+0000 7fc88bfff640 1 --2- 172.21.15.123:0/3089635737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301680 0x5644be301a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.627+0000 7fc883fff640 1 --2- 172.21.15.123:0/3089635737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be301fc0 0x5644be306a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.627+0000 7fc890ae1640 1 -- 172.21.15.123:0/3089635737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301680 msgr2=0x5644be301a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.627+0000 7fc890ae1640 1 --2- 172.21.15.123:0/3089635737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301680 0x5644be301a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.627+0000 7fc890ae1640 1 -- 172.21.15.123:0/3089635737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be301fc0 msgr2=0x5644be306a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.627+0000 7fc890ae1640 1 --2- 172.21.15.123:0/3089635737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be301fc0 0x5644be306a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.627+0000 7fc890ae1640 1 -- 172.21.15.123:0/3089635737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644bdf78210 con 0x5644be307050 2024-08-18T22:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.627+0000 7fc88bfff640 1 --2- 172.21.15.123:0/3089635737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301680 0x5644be301a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.627+0000 7fc890ae1640 1 --2- 172.21.15.123:0/3089635737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be307050 0x5644be309510 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc884004f90 tx=0x7fc8840cc8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcea9845e7e3b37 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.627+0000 7fc8827fc640 1 -- 172.21.15.123:0/3089635737 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8840b8070 con 0x5644be307050 2024-08-18T22:10:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.627+0000 7fc8827fc640 1 -- 172.21.15.123:0/3089635737 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc88409be30 con 0x5644be307050 2024-08-18T22:10:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.627+0000 7fc8827fc640 1 -- 172.21.15.123:0/3089635737 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc884005550 con 0x5644be307050 2024-08-18T22:10:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.628+0000 7fc8953dc740 1 -- 172.21.15.123:0/3089635737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be307050 msgr2=0x5644be309510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.628+0000 7fc8953dc740 1 --2- 172.21.15.123:0/3089635737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be307050 0x5644be309510 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc884004f90 tx=0x7fc8840cc8a0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.628+0000 7fc8953dc740 1 -- 172.21.15.123:0/3089635737 shutdown_connections 2024-08-18T22:10:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.628+0000 7fc8953dc740 1 --2- 172.21.15.123:0/3089635737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be307050 0x5644be309510 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.628+0000 7fc8953dc740 1 --2- 172.21.15.123:0/3089635737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be301fc0 0x5644be306a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.628+0000 7fc8953dc740 1 --2- 172.21.15.123:0/3089635737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301680 0x5644be301a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.628+0000 7fc8953dc740 1 -- 172.21.15.123:0/3089635737 >> 172.21.15.123:0/3089635737 conn(0x5644be2fccf0 msgr2=0x5644be2fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.628+0000 7fc8953dc740 1 -- 172.21.15.123:0/3089635737 shutdown_connections 2024-08-18T22:10:47.633 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.628+0000 7fc8953dc740 1 -- 172.21.15.123:0/3089635737 wait complete. 2024-08-18T22:10:47.664 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:47.664 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:47.702 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.701+0000 7fc8953dc740 1 -- start start 2024-08-18T22:10:47.703 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.703+0000 7fc8953dc740 1 Processor -- start 2024-08-18T22:10:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.703+0000 7fc8953dc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301680 0x5644be30b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.703+0000 7fc8953dc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301fc0 0x5644be30bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.703+0000 7fc8953dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be307050 0x5644be312d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.703+0000 7fc8953dc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5644be309fc0 con 0x5644be301680 2024-08-18T22:10:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.703+0000 7fc8953dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5644be220520 con 0x5644be307050 2024-08-18T22:10:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.703+0000 7fc8953dc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5644be30a140 con 0x5644be301fc0 2024-08-18T22:10:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.703+0000 7fc88bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301680 0x5644be30b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.703+0000 7fc88bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301680 0x5644be30b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52360/0 (socket says 172.21.15.123:52360) 2024-08-18T22:10:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.703+0000 7fc88bfff640 1 -- 172.21.15.123:0/4171915276 learned_addr learned my addr 172.21.15.123:0/4171915276 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.703+0000 7fc883fff640 1 --2- 172.21.15.123:0/4171915276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301fc0 0x5644be30bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.703+0000 7fc890ae1640 1 --2- 172.21.15.123:0/4171915276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be307050 0x5644be312d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.704+0000 7fc88bfff640 1 -- 172.21.15.123:0/4171915276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301fc0 msgr2=0x5644be30bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.704+0000 7fc88bfff640 1 --2- 172.21.15.123:0/4171915276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301fc0 0x5644be30bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.704+0000 7fc88bfff640 1 -- 172.21.15.123:0/4171915276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be307050 msgr2=0x5644be312d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.704+0000 7fc88bfff640 1 --2- 172.21.15.123:0/4171915276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be307050 0x5644be312d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.704+0000 7fc88bfff640 1 -- 172.21.15.123:0/4171915276 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644be044620 con 0x5644be301680 2024-08-18T22:10:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.704+0000 7fc883fff640 1 --2- 172.21.15.123:0/4171915276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301fc0 0x5644be30bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:10:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.704+0000 7fc88bfff640 1 --2- 172.21.15.123:0/4171915276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301680 0x5644be30b7a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009830 tx=0x7fc87c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88825784a878715e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.704+0000 7fc86b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:10:47.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.704+0000 7fc86b7fe640 1 -- 172.21.15.123:0/4171915276 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c037040 con 0x5644be301680 2024-08-18T22:10:47.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.704+0000 7fc86b7fe640 1 -- 172.21.15.123:0/4171915276 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fc87c004240 con 0x5644be301680 2024-08-18T22:10:47.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.704+0000 7fc8953dc740 10 client.0 _ll_register_callbacks cb 0x5644bdf77a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:10:47.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.706+0000 7fc8953dc740 1 -- 172.21.15.123:0/4171915276 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc88409be30 con 0x5644be301680 2024-08-18T22:10:47.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.707+0000 7fc86b7fe640 1 -- 172.21.15.123:0/4171915276 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc87c030d70 con 0x5644be301680 2024-08-18T22:10:47.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.707+0000 7fc8953dc740 10 client.15822 fetch_fsmap learned FSMap version 26 2024-08-18T22:10:47.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.707+0000 7fc8953dc740 1 -- 172.21.15.123:0/4171915276 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5644be3159e0 con 0x5644be301680 2024-08-18T22:10:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.755+0000 7fc86b7fe640 1 -- 172.21.15.123:0/4171915276 <== mon.0 v2:172.21.15.123:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc87c005040 con 0x5644be301680 2024-08-18T22:10:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.755+0000 7fc8953dc740 10 client.15822 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:10:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.755+0000 7fc8953dc740 10 client.15822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:10:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.756+0000 7fc8953dc740 20 client.15822 populate_metadata read hostname 'smithi123' 2024-08-18T22:10:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.756+0000 7fc8953dc740 1 --2- 172.21.15.123:0/4171915276 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5644be3170d0 0x5644be319570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.756+0000 7fc8953dc740 4 client.15822 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:10:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.756+0000 7fc8953dc740 1 -- 172.21.15.123:0/4171915276 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644be272100 con 0x5644be3170d0 2024-08-18T22:10:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.756+0000 7fc883fff640 1 --2- 172.21.15.123:0/4171915276 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5644be3170d0 0x5644be319570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.757+0000 7fc883fff640 1 --2- 172.21.15.123:0/4171915276 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5644be3170d0 0x5644be319570 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a5724f3d51afe35 server_cookie=79488af92e179d46 in_seq=0 out_seq=0 2024-08-18T22:10:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.757+0000 7fc86b7fe640 10 client.15822 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:10:47.759 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.757+0000 7fc86b7fe640 1 -- 172.21.15.123:0/4171915276 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644be272100 con 0x5644be3170d0 2024-08-18T22:10:47.759 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.757+0000 7fc86b7fe640 10 client.15822 handle_command_reply: tid=0 2024-08-18T22:10:47.759 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.757+0000 7fc8953dc740 1 client.15822 shutdown 2024-08-18T22:10:47.759 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.758+0000 7fc8953dc740 1 -- 172.21.15.123:0/4171915276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301680 msgr2=0x5644be30b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:47.759 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.758+0000 7fc8953dc740 1 --2- 172.21.15.123:0/4171915276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301680 0x5644be30b7a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009830 tx=0x7fc87c005f90 comp rx=0 tx=0).stop 2024-08-18T22:10:47.759 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.758+0000 7fc8953dc740 1 -- 172.21.15.123:0/4171915276 shutdown_connections 2024-08-18T22:10:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.758+0000 7fc8953dc740 1 --2- 172.21.15.123:0/4171915276 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5644be3170d0 0x5644be319570 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.758+0000 7fc8953dc740 1 --2- 172.21.15.123:0/4171915276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be307050 0x5644be312d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.758+0000 7fc8953dc740 1 --2- 172.21.15.123:0/4171915276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301fc0 0x5644be30bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.758+0000 7fc86b7fe640 0 client.15822 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:10:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.758+0000 7fc8953dc740 1 --2- 172.21.15.123:0/4171915276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301680 0x5644be30b7a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.758+0000 7fc8953dc740 1 -- 172.21.15.123:0/4171915276 >> 172.21.15.123:0/4171915276 conn(0x5644be2fccf0 msgr2=0x5644be2fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.758+0000 7fc8953dc740 1 -- 172.21.15.123:0/4171915276 shutdown_connections 2024-08-18T22:10:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.758+0000 7fc8953dc740 1 -- 172.21.15.123:0/4171915276 wait complete. 2024-08-18T22:10:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.758+0000 7fc8953dc740 20 client.15822 trim_cache size 0 max 16384 2024-08-18T22:10:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc8953dc740 1 Processor -- start 2024-08-18T22:10:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc8953dc740 1 -- start start 2024-08-18T22:10:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc8953dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be301680 0x5644be30bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc8953dc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301fc0 0x5644be312cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc8953dc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be307050 0x5644be2fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc8953dc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c1aef00 con 0x5644be301fc0 2024-08-18T22:10:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc8953dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c1ac760 con 0x5644be301680 2024-08-18T22:10:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc8953dc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c1aa5b0 con 0x5644be307050 2024-08-18T22:10:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc883fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301fc0 0x5644be312cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc883fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301fc0 0x5644be312cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52368/0 (socket says 172.21.15.123:52368) 2024-08-18T22:10:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc883fff640 1 -- 172.21.15.123:0/2862816301 learned_addr learned my addr 172.21.15.123:0/2862816301 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc88bfff640 1 --2- 172.21.15.123:0/2862816301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be301680 0x5644be30bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc890ae1640 1 --2- 172.21.15.123:0/2862816301 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be307050 0x5644be2fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc883fff640 1 -- 172.21.15.123:0/2862816301 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be307050 msgr2=0x5644be2fbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc883fff640 1 --2- 172.21.15.123:0/2862816301 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be307050 0x5644be2fbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc883fff640 1 -- 172.21.15.123:0/2862816301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be301680 msgr2=0x5644be30bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc883fff640 1 --2- 172.21.15.123:0/2862816301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be301680 0x5644be30bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.783+0000 7fc883fff640 1 -- 172.21.15.123:0/2862816301 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644be319bf0 con 0x5644be301fc0 2024-08-18T22:10:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.784+0000 7fc883fff640 1 --2- 172.21.15.123:0/2862816301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301fc0 0x5644be312cb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc874000c00 tx=0x7fc874009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69b1e1709403654 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.784+0000 7fc881ffb640 1 -- 172.21.15.123:0/2862816301 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc874004020 con 0x5644be301fc0 2024-08-18T22:10:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.784+0000 7fc881ffb640 1 -- 172.21.15.123:0/2862816301 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc87400fdd0 con 0x5644be301fc0 2024-08-18T22:10:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.784+0000 7fc881ffb640 1 -- 172.21.15.123:0/2862816301 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8740055c0 con 0x5644be301fc0 2024-08-18T22:10:47.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.785+0000 7fc8953dc740 1 -- 172.21.15.123:0/2862816301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301fc0 msgr2=0x5644be312cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:47.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.785+0000 7fc8953dc740 1 --2- 172.21.15.123:0/2862816301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301fc0 0x5644be312cb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc874000c00 tx=0x7fc874009260 comp rx=0 tx=0).stop 2024-08-18T22:10:47.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.785+0000 7fc8953dc740 1 -- 172.21.15.123:0/2862816301 shutdown_connections 2024-08-18T22:10:47.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.785+0000 7fc8953dc740 1 --2- 172.21.15.123:0/2862816301 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be307050 0x5644be2fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.785+0000 7fc8953dc740 1 --2- 172.21.15.123:0/2862816301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301fc0 0x5644be312cb0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.785+0000 7fc8953dc740 1 --2- 172.21.15.123:0/2862816301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be301680 0x5644be30bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.791 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.785+0000 7fc8953dc740 1 -- 172.21.15.123:0/2862816301 >> 172.21.15.123:0/2862816301 conn(0x5644be2fccf0 msgr2=0x5644be2fb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:47.791 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.785+0000 7fc8953dc740 1 -- 172.21.15.123:0/2862816301 shutdown_connections 2024-08-18T22:10:47.791 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.785+0000 7fc8953dc740 1 -- 172.21.15.123:0/2862816301 wait complete. 2024-08-18T22:10:47.791 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.785+0000 7fc8953dc740 1 -- start start 2024-08-18T22:10:47.791 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.785+0000 7fc8953dc740 1 Processor -- start 2024-08-18T22:10:47.791 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc8953dc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301680 0x5644be3101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.791 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc8953dc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301fc0 0x5644be310710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.792 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc8953dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be307050 0x5644be311720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.792 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc8953dc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c1aac20 con 0x5644be301680 2024-08-18T22:10:47.792 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc8953dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c1ac090 con 0x5644be307050 2024-08-18T22:10:47.792 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc8953dc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c1ab2f0 con 0x5644be301fc0 2024-08-18T22:10:47.792 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc8953dc740 10 client.0 _ll_register_callbacks cb 0x7fc87c035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:10:47.792 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc88bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301680 0x5644be3101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.792 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc88bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301680 0x5644be3101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52376/0 (socket says 172.21.15.123:52376) 2024-08-18T22:10:47.792 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc88bfff640 1 -- 172.21.15.123:0/952524488 learned_addr learned my addr 172.21.15.123:0/952524488 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:10:47.792 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc883fff640 1 --2- 172.21.15.123:0/952524488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301fc0 0x5644be310710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.792 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc890ae1640 1 --2- 172.21.15.123:0/952524488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be307050 0x5644be311720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.792 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc88bfff640 1 -- 172.21.15.123:0/952524488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301fc0 msgr2=0x5644be310710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:47.792 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc88bfff640 1 --2- 172.21.15.123:0/952524488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301fc0 0x5644be310710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.792 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc88bfff640 1 -- 172.21.15.123:0/952524488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be307050 msgr2=0x5644be311720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:10:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc88bfff640 1 --2- 172.21.15.123:0/952524488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be307050 0x5644be311720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc88bfff640 1 -- 172.21.15.123:0/952524488 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644be311d30 con 0x5644be301680 2024-08-18T22:10:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc890ae1640 1 --2- 172.21.15.123:0/952524488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be307050 0x5644be311720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:10:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc88bfff640 1 --2- 172.21.15.123:0/952524488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301680 0x5644be3101d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc87c02a860 tx=0x7fc87c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7204ce0f6e954b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:10:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.786+0000 7fc86b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:10:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.787+0000 7fc86b7fe640 1 -- 172.21.15.123:0/952524488 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c062060 con 0x5644be301680 2024-08-18T22:10:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.787+0000 7fc86b7fe640 1 -- 172.21.15.123:0/952524488 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fc87c0037f0 con 0x5644be301680 2024-08-18T22:10:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.787+0000 7fc8953dc740 1 -- 172.21.15.123:0/952524488 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc87400fdd0 con 0x5644be301680 2024-08-18T22:10:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.787+0000 7fc86b7fe640 1 -- 172.21.15.123:0/952524488 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc87c069050 con 0x5644be301680 2024-08-18T22:10:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.787+0000 7fc8953dc740 10 client.15828 fetch_fsmap learned FSMap version 26 2024-08-18T22:10:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.787+0000 7fc8953dc740 1 -- 172.21.15.123:0/952524488 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5644be381e50 con 0x5644be301680 2024-08-18T22:10:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.787+0000 7fc86b7fe640 1 -- 172.21.15.123:0/952524488 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc87400fdd0 con 0x5644be301680 2024-08-18T22:10:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.787+0000 7fc86b7fe640 1 -- 172.21.15.123:0/952524488 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc87c03d8c0 con 0x5644be301680 2024-08-18T22:10:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.787+0000 7fc8953dc740 10 client.15828 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:10:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.787+0000 7fc8953dc740 10 client.15828 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:10:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.787+0000 7fc8953dc740 20 client.15828 populate_metadata read hostname 'smithi123' 2024-08-18T22:10:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.787+0000 7fc8953dc740 1 --2- 172.21.15.123:0/952524488 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5644be382710 0x5644be384b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:10:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.787+0000 7fc8953dc740 4 client.15828 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:10:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.787+0000 7fc8953dc740 1 -- 172.21.15.123:0/952524488 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5644be26c450 con 0x5644be382710 2024-08-18T22:10:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.788+0000 7fc883fff640 1 --2- 172.21.15.123:0/952524488 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5644be382710 0x5644be384b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:10:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.788+0000 7fc86b7fe640 10 client.15828 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:10:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.788+0000 7fc883fff640 1 --2- 172.21.15.123:0/952524488 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5644be382710 0x5644be384b30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45fd13463c05b29f server_cookie=81a7915339cfcb87 in_seq=0 out_seq=0 2024-08-18T22:10:47.805 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.804+0000 7fc86b7fe640 1 -- 172.21.15.123:0/952524488 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5644be26c450 con 0x5644be382710 2024-08-18T22:10:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.804+0000 7fc86b7fe640 10 client.15828 handle_command_reply: tid=0 2024-08-18T22:10:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.804+0000 7fc8953dc740 1 client.15828 shutdown 2024-08-18T22:10:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.804+0000 7fc8953dc740 1 -- 172.21.15.123:0/952524488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301680 msgr2=0x5644be3101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.804+0000 7fc8953dc740 1 --2- 172.21.15.123:0/952524488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301680 0x5644be3101d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc87c02a860 tx=0x7fc87c03e000 comp rx=0 tx=0).stop 2024-08-18T22:10:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.804+0000 7fc8953dc740 1 -- 172.21.15.123:0/952524488 shutdown_connections 2024-08-18T22:10:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.804+0000 7fc8953dc740 1 --2- 172.21.15.123:0/952524488 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5644be382710 0x5644be384b30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.804+0000 7fc8953dc740 1 --2- 172.21.15.123:0/952524488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5644be307050 0x5644be311720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.804+0000 7fc8953dc740 1 --2- 172.21.15.123:0/952524488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644be301fc0 0x5644be310710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.804+0000 7fc8953dc740 1 --2- 172.21.15.123:0/952524488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644be301680 0x5644be3101d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.804+0000 7fc86b7fe640 0 client.15828 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:10:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.804+0000 7fc8953dc740 1 -- 172.21.15.123:0/952524488 >> 172.21.15.123:0/952524488 conn(0x5644be2fccf0 msgr2=0x5644be2fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.805+0000 7fc8953dc740 1 -- 172.21.15.123:0/952524488 shutdown_connections 2024-08-18T22:10:47.807 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.805+0000 7fc8953dc740 1 -- 172.21.15.123:0/952524488 wait complete. 2024-08-18T22:10:47.807 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.805+0000 7fc8953dc740 20 client.15828 trim_cache size 0 max 16384 2024-08-18T22:10:47.807 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:10:47.807 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:10:47.807 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:10:47.807 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:10:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.811+0000 7fc892544640 1 -- 172.21.15.123:0/3338188774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc8780a2da0 msgr2=0x7fc8780a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.811+0000 7fc892544640 1 --2- 172.21.15.123:0/3338188774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc8780a2da0 0x7fc8780a5260 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc88c19b210 tx=0x7fc87c000bc0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.811+0000 7fc892544640 1 -- 172.21.15.123:0/3338188774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc88c103440 msgr2=0x7fc88c1a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:10:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.811+0000 7fc892544640 1 --2- 172.21.15.123:0/3338188774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc88c103440 0x7fc88c1a12b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc88400eb10 tx=0x7fc88400c2d0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.811+0000 7fc892544640 1 -- 172.21.15.123:0/3338188774 shutdown_connections 2024-08-18T22:10:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.811+0000 7fc892544640 1 --2- 172.21.15.123:0/3338188774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc88c103440 0x7fc88c1a12b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.811+0000 7fc892544640 1 --2- 172.21.15.123:0/3338188774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc88c102a80 0x7fc88c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.811+0000 7fc892544640 1 --2- 172.21.15.123:0/3338188774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc8780a2da0 0x7fc8780a5260 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.811+0000 7fc892544640 1 --2- 172.21.15.123:0/3338188774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc88c101890 0x7fc88c199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:10:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.811+0000 7fc892544640 1 -- 172.21.15.123:0/3338188774 >> 172.21.15.123:0/3338188774 conn(0x7fc88c0fcff0 msgr2=0x7fc88c074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:10:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.812+0000 7fc892544640 1 -- 172.21.15.123:0/3338188774 shutdown_connections 2024-08-18T22:10:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:10:47.812+0000 7fc892544640 1 -- 172.21.15.123:0/3338188774 wait complete. 2024-08-18T22:10:48.078 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:48.078 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:48.147 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:48.147 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:48.148 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 82 -lt 100 ']' 2024-08-18T22:10:48.148 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 82 + 1 2024-08-18T22:10:48.214 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=83 2024-08-18T22:10:48.214 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:48.349 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:48.350 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:48.350 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:48.351 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:48.351 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:49.493 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:49 smithi123 ceph-mon[18462]: pgmap v431: 129 pgs: 129 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.9 KiB/s wr, 7 op/s 2024-08-18T22:10:49.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:49 smithi130 ceph-mon[21698]: pgmap v431: 129 pgs: 129 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.9 KiB/s wr, 7 op/s 2024-08-18T22:10:49.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:49 smithi183 ceph-mon[22097]: pgmap v431: 129 pgs: 129 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.9 KiB/s wr, 7 op/s 2024-08-18T22:10:50.155 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:50.155 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:50.431 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:50.432 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:50.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:50 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:10:50.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:50 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:10:50.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:50 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:10:50.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:50 smithi123 ceph-mon[18462]: pgmap v432: 129 pgs: 129 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-08-18T22:10:50.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:50 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:10:50.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:50 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:10:50.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:50 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:10:50.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:50 smithi130 ceph-mon[21698]: pgmap v432: 129 pgs: 129 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-08-18T22:10:50.529 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:50.529 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:50.529 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 83 -lt 100 ']' 2024-08-18T22:10:50.529 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 83 + 1 2024-08-18T22:10:50.565 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=84 2024-08-18T22:10:50.566 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:50.573 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:50.573 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:50.574 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:50.574 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:50.574 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:50.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:50 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:10:50.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:50 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:10:50.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:50 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:10:50.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:50 smithi183 ceph-mon[22097]: pgmap v432: 129 pgs: 129 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-08-18T22:10:52.121 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:52.121 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:52.746 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:52.746 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:52.754 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:52.754 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:52.754 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 84 -lt 100 ']' 2024-08-18T22:10:52.754 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 84 + 1 2024-08-18T22:10:52.796 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=85 2024-08-18T22:10:52.797 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:52.898 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:52.898 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:52.899 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:52.899 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:52.899 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:53.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:53 smithi123 ceph-mon[18462]: pgmap v433: 129 pgs: 129 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-08-18T22:10:53.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:53 smithi130 ceph-mon[21698]: pgmap v433: 129 pgs: 129 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-08-18T22:10:53.361 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:53 smithi183 ceph-mon[22097]: pgmap v433: 129 pgs: 129 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-08-18T22:10:53.864 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:53.864 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:54.220 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:54.220 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:54.229 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:54.229 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:54.229 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 85 -lt 100 ']' 2024-08-18T22:10:54.229 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 85 + 1 2024-08-18T22:10:54.296 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=86 2024-08-18T22:10:54.296 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:54.341 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:54.341 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:54.342 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:54.343 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:54.343 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:54.782 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:10:54.782 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:10:55.162 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:55.163 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:55.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:55 smithi123 ceph-mon[18462]: pgmap v434: 129 pgs: 129 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-08-18T22:10:55.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:55 smithi183 ceph-mon[22097]: pgmap v434: 129 pgs: 129 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-08-18T22:10:55.465 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:55.465 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:55.480 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:55.480 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:55.480 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 86 -lt 100 ']' 2024-08-18T22:10:55.481 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 86 + 1 2024-08-18T22:10:55.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:55 smithi130 ceph-mon[21698]: pgmap v434: 129 pgs: 129 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-08-18T22:10:55.531 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=87 2024-08-18T22:10:55.531 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:55.556 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:55.556 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:55.557 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:55.558 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:55.558 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:56.445 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:56.446 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:56.953 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:56.953 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:57.004 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:57.005 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:57.005 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 87 -lt 100 ']' 2024-08-18T22:10:57.005 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 87 + 1 2024-08-18T22:10:57.096 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=88 2024-08-18T22:10:57.097 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:57.170 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:57.170 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:57.171 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:57.171 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:57.171 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:57.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:57 smithi183 ceph-mon[22097]: pgmap v435: 129 pgs: 129 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-08-18T22:10:57.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:57 smithi123 ceph-mon[18462]: pgmap v435: 129 pgs: 129 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-08-18T22:10:57.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:57 smithi130 ceph-mon[21698]: pgmap v435: 129 pgs: 129 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-08-18T22:10:58.437 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:58.437 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:58.770 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:10:58.770 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:10:58.820 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:58.820 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:10:58.820 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 88 -lt 100 ']' 2024-08-18T22:10:58.820 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 88 + 1 2024-08-18T22:10:58.889 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=89 2024-08-18T22:10:58.889 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:10:58.962 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:10:58.963 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:10:58.963 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:10:58.964 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:10:58.964 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:10:59.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:10:59 smithi183 ceph-mon[22097]: pgmap v436: 129 pgs: 129 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.5 KiB/s wr, 13 op/s 2024-08-18T22:10:59.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:10:59 smithi123 ceph-mon[18462]: pgmap v436: 129 pgs: 129 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.5 KiB/s wr, 13 op/s 2024-08-18T22:10:59.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:10:59 smithi130 ceph-mon[21698]: pgmap v436: 129 pgs: 129 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.5 KiB/s wr, 13 op/s 2024-08-18T22:11:00.253 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:00.253 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:00.498 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:11:00.498 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:11:00.511 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:00.511 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:00.511 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 89 -lt 100 ']' 2024-08-18T22:11:00.511 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 89 + 1 2024-08-18T22:11:00.570 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=90 2024-08-18T22:11:00.570 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:11:00.621 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:00.621 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:00.622 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:11:00.623 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:11:00.623 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:11:01.306 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:01 smithi123 ceph-mon[18462]: pgmap v437: 129 pgs: 129 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 15 op/s 2024-08-18T22:11:01.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:01 smithi183 ceph-mon[22097]: pgmap v437: 129 pgs: 129 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 15 op/s 2024-08-18T22:11:01.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:01 smithi130 ceph-mon[21698]: pgmap v437: 129 pgs: 129 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 15 op/s 2024-08-18T22:11:01.811 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:01.811 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:02.269 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:11:02.269 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:11:02.287 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:02.287 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:02.287 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 90 -lt 100 ']' 2024-08-18T22:11:02.287 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 90 + 1 2024-08-18T22:11:02.353 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=91 2024-08-18T22:11:02.353 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:11:02.445 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:02.445 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:02.446 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:11:02.446 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:11:02.446 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:11:03.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:03 smithi123 ceph-mon[18462]: pgmap v438: 129 pgs: 129 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.9 KiB/s wr, 9 op/s 2024-08-18T22:11:03.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:03 smithi183 ceph-mon[22097]: pgmap v438: 129 pgs: 129 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.9 KiB/s wr, 9 op/s 2024-08-18T22:11:03.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:03 smithi130 ceph-mon[21698]: pgmap v438: 129 pgs: 129 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.9 KiB/s wr, 9 op/s 2024-08-18T22:11:04.156 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:04.156 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:04.550 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:11:04.550 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:11:04.579 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:04.580 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:04.580 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 91 -lt 100 ']' 2024-08-18T22:11:04.580 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 91 + 1 2024-08-18T22:11:04.670 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=92 2024-08-18T22:11:04.671 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:11:04.753 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:04.753 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:04.754 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:11:04.754 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:11:04.754 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:11:05.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:05 smithi183 ceph-mon[22097]: pgmap v439: 129 pgs: 129 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 8 op/s 2024-08-18T22:11:05.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:05 smithi123 ceph-mon[18462]: pgmap v439: 129 pgs: 129 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 8 op/s 2024-08-18T22:11:05.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:05 smithi130 ceph-mon[21698]: pgmap v439: 129 pgs: 129 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 8 op/s 2024-08-18T22:11:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.813+0000 7f913c7ff640 1 -- 172.21.15.123:0/2669749790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9134102a70 msgr2=0x7f9134102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.813+0000 7f913c7ff640 1 --2- 172.21.15.123:0/2669749790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9134102a70 0x7f9134102ef0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9124009900 tx=0x7f912402a3f0 comp rx=0 tx=0).stop 2024-08-18T22:11:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.813+0000 7f913c7ff640 1 -- 172.21.15.123:0/2669749790 shutdown_connections 2024-08-18T22:11:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.813+0000 7f913c7ff640 1 --2- 172.21.15.123:0/2669749790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9134103430 0x7f9134109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.813+0000 7f913c7ff640 1 --2- 172.21.15.123:0/2669749790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9134102a70 0x7f9134102ef0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.813+0000 7f913c7ff640 1 --2- 172.21.15.123:0/2669749790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9134101880 0x7f9134101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.813+0000 7f913c7ff640 1 -- 172.21.15.123:0/2669749790 >> 172.21.15.123:0/2669749790 conn(0x7f91340fcfe0 msgr2=0x7f91340ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.813+0000 7f913c7ff640 1 -- 172.21.15.123:0/2669749790 shutdown_connections 2024-08-18T22:11:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.813+0000 7f913c7ff640 1 -- 172.21.15.123:0/2669749790 wait complete. 2024-08-18T22:11:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.838+0000 7f913c7ff640 1 Processor -- start 2024-08-18T22:11:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.900+0000 7f913c7ff640 1 -- start start 2024-08-18T22:11:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913c7ff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9134101880 0x7f9134075cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913c7ff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9134102a70 0x7f9134074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913c7ff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9134103430 0x7f9134074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913c7ff640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f913410d550 con 0x7f9134103430 2024-08-18T22:11:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913c7ff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f913410d3d0 con 0x7f9134102a70 2024-08-18T22:11:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913c7ff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f913410d6d0 con 0x7f9134101880 2024-08-18T22:11:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913ad9c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9134103430 0x7f9134074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913ad9c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9134103430 0x7f9134074850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53294/0 (socket says 172.21.15.123:53294) 2024-08-18T22:11:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913ad9c640 1 -- 172.21.15.123:0/3596171377 learned_addr learned my addr 172.21.15.123:0/3596171377 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f9139d9a640 1 --2- 172.21.15.123:0/3596171377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9134102a70 0x7f9134074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913a59b640 1 --2- 172.21.15.123:0/3596171377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9134101880 0x7f9134075cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913ad9c640 1 -- 172.21.15.123:0/3596171377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9134101880 msgr2=0x7f9134075cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913ad9c640 1 --2- 172.21.15.123:0/3596171377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9134101880 0x7f9134075cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913ad9c640 1 -- 172.21.15.123:0/3596171377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9134102a70 msgr2=0x7f9134074310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913ad9c640 1 --2- 172.21.15.123:0/3596171377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9134102a70 0x7f9134074310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913ad9c640 1 -- 172.21.15.123:0/3596171377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91340750e0 con 0x7f9134103430 2024-08-18T22:11:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.901+0000 7f913ad9c640 1 --2- 172.21.15.123:0/3596171377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9134103430 0x7f9134074850 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f912c00efd0 tx=0x7f912c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.902+0000 7f912b7fe640 1 -- 172.21.15.123:0/3596171377 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c003b70 con 0x7f9134103430 2024-08-18T22:11:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.902+0000 7f912b7fe640 1 -- 172.21.15.123:0/3596171377 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f912c003d10 con 0x7f9134103430 2024-08-18T22:11:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.902+0000 7f913c7ff640 1 -- 172.21.15.123:0/3596171377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91341a1c40 con 0x7f9134103430 2024-08-18T22:11:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.902+0000 7f912b7fe640 1 -- 172.21.15.123:0/3596171377 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c0109f0 con 0x7f9134103430 2024-08-18T22:11:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.904+0000 7f912b7fe640 1 -- 172.21.15.123:0/3596171377 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f912c004000 con 0x7f9134103430 2024-08-18T22:11:05.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.907+0000 7f912b7fe640 1 --2- 172.21.15.123:0/3596171377 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f91200a2c30 0x7f91200a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:05.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.907+0000 7f913a59b640 1 --2- 172.21.15.123:0/3596171377 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f91200a2c30 0x7f91200a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:05.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.908+0000 7f913a59b640 1 --2- 172.21.15.123:0/3596171377 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f91200a2c30 0x7f91200a50f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f91341028d0 tx=0x7f9130005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.916+0000 7f913c7ff640 1 -- 172.21.15.123:0/3596171377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91341a2110 con 0x7f9134103430 2024-08-18T22:11:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:05.917+0000 7f912b7fe640 1 -- 172.21.15.123:0/3596171377 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f912c0995c0 con 0x7f9134103430 2024-08-18T22:11:06.003 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:06.003 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.169+0000 7f913f5c4740 1 Processor -- start 2024-08-18T22:11:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.169+0000 7f913f5c4740 1 -- start start 2024-08-18T22:11:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.169+0000 7f913f5c4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423ca680 0x5650423caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.169+0000 7f913f5c4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423cafc0 0x5650423cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.169+0000 7f913f5c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 0x5650423d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.169+0000 7f913f5c4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56504232d9d0 con 0x5650423cafc0 2024-08-18T22:11:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.169+0000 7f913f5c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5650422d5820 con 0x5650423d0050 2024-08-18T22:11:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.169+0000 7f913f5c4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x565042329990 con 0x5650423ca680 2024-08-18T22:11:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.170+0000 7f9139d9a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423cafc0 0x5650423cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.170+0000 7f9139d9a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423cafc0 0x5650423cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53304/0 (socket says 172.21.15.123:53304) 2024-08-18T22:11:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.170+0000 7f9139d9a640 1 -- 172.21.15.123:0/517057645 learned_addr learned my addr 172.21.15.123:0/517057645 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.170+0000 7f913a59b640 1 --2- 172.21.15.123:0/517057645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423ca680 0x5650423caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.170+0000 7f913ad9c640 1 --2- 172.21.15.123:0/517057645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 0x5650423d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.170+0000 7f9139d9a640 1 -- 172.21.15.123:0/517057645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423ca680 msgr2=0x5650423caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.170+0000 7f9139d9a640 1 --2- 172.21.15.123:0/517057645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423ca680 0x5650423caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.170+0000 7f9139d9a640 1 -- 172.21.15.123:0/517057645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 msgr2=0x5650423d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.170+0000 7f9139d9a640 1 --2- 172.21.15.123:0/517057645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 0x5650423d2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.170+0000 7f9139d9a640 1 -- 172.21.15.123:0/517057645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565042041210 con 0x5650423cafc0 2024-08-18T22:11:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.170+0000 7f913ad9c640 1 --2- 172.21.15.123:0/517057645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 0x5650423d2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.170+0000 7f9139d9a640 1 --2- 172.21.15.123:0/517057645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423cafc0 0x5650423cfa80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9124000c00 tx=0x7f9124004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed064858baec70 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.171+0000 7f9128ff9640 1 -- 172.21.15.123:0/517057645 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124035040 con 0x5650423cafc0 2024-08-18T22:11:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.171+0000 7f9128ff9640 1 -- 172.21.15.123:0/517057645 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9124005520 con 0x5650423cafc0 2024-08-18T22:11:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.171+0000 7f9128ff9640 1 -- 172.21.15.123:0/517057645 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91240316b0 con 0x5650423cafc0 2024-08-18T22:11:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.171+0000 7f913f5c4740 1 -- 172.21.15.123:0/517057645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423cafc0 msgr2=0x5650423cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.171+0000 7f913f5c4740 1 --2- 172.21.15.123:0/517057645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423cafc0 0x5650423cfa80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9124000c00 tx=0x7f9124004040 comp rx=0 tx=0).stop 2024-08-18T22:11:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.172+0000 7f913f5c4740 1 -- 172.21.15.123:0/517057645 shutdown_connections 2024-08-18T22:11:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.172+0000 7f913f5c4740 1 --2- 172.21.15.123:0/517057645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 0x5650423d2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.172+0000 7f913f5c4740 1 --2- 172.21.15.123:0/517057645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423cafc0 0x5650423cfa80 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.172+0000 7f913f5c4740 1 --2- 172.21.15.123:0/517057645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423ca680 0x5650423caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.172+0000 7f913f5c4740 1 -- 172.21.15.123:0/517057645 >> 172.21.15.123:0/517057645 conn(0x5650423c5cf0 msgr2=0x5650423c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.172+0000 7f913f5c4740 1 -- 172.21.15.123:0/517057645 shutdown_connections 2024-08-18T22:11:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.172+0000 7f913f5c4740 1 -- 172.21.15.123:0/517057645 wait complete. 2024-08-18T22:11:06.204 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.203+0000 7f913f5c4740 1 -- start start 2024-08-18T22:11:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.225+0000 7f913f5c4740 1 Processor -- start 2024-08-18T22:11:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.225+0000 7f913f5c4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423ca680 0x5650423d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.225+0000 7f913f5c4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423cafc0 0x5650423d4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.225+0000 7f913f5c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 0x5650423dbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.225+0000 7f913f5c4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5650423d2fc0 con 0x5650423cafc0 2024-08-18T22:11:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.226+0000 7f913f5c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5650422e9520 con 0x5650423d0050 2024-08-18T22:11:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.226+0000 7f913f5c4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5650423d3140 con 0x5650423ca680 2024-08-18T22:11:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.226+0000 7f9139d9a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423cafc0 0x5650423d4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.226+0000 7f9139d9a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423cafc0 0x5650423d4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53312/0 (socket says 172.21.15.123:53312) 2024-08-18T22:11:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.226+0000 7f9139d9a640 1 -- 172.21.15.123:0/3576856290 learned_addr learned my addr 172.21.15.123:0/3576856290 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.226+0000 7f913a59b640 1 --2- 172.21.15.123:0/3576856290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423ca680 0x5650423d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.226+0000 7f913ad9c640 1 --2- 172.21.15.123:0/3576856290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 0x5650423dbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.226+0000 7f9139d9a640 1 -- 172.21.15.123:0/3576856290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423ca680 msgr2=0x5650423d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.226+0000 7f9139d9a640 1 --2- 172.21.15.123:0/3576856290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423ca680 0x5650423d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.226+0000 7f9139d9a640 1 -- 172.21.15.123:0/3576856290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 msgr2=0x5650423dbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.226+0000 7f9139d9a640 1 --2- 172.21.15.123:0/3576856290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 0x5650423dbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.226+0000 7f9139d9a640 1 -- 172.21.15.123:0/3576856290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56504210d620 con 0x5650423cafc0 2024-08-18T22:11:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.226+0000 7f913a59b640 1 --2- 172.21.15.123:0/3576856290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423ca680 0x5650423d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.226+0000 7f9139d9a640 1 --2- 172.21.15.123:0/3576856290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423cafc0 0x5650423d4cf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9124006010 tx=0x7f9124004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca59965a560061f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.226+0000 7f911dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.227+0000 7f911dffb640 1 -- 172.21.15.123:0/3576856290 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124052060 con 0x5650423cafc0 2024-08-18T22:11:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.227+0000 7f911dffb640 1 -- 172.21.15.123:0/3576856290 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f9124004d80 con 0x5650423cafc0 2024-08-18T22:11:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.250+0000 7f913f5c4740 10 client.0 _ll_register_callbacks cb 0x565042040a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.251+0000 7f913f5c4740 1 -- 172.21.15.123:0/3576856290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9124005520 con 0x5650423cafc0 2024-08-18T22:11:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.251+0000 7f911dffb640 1 -- 172.21.15.123:0/3576856290 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9124035050 con 0x5650423cafc0 2024-08-18T22:11:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.251+0000 7f913f5c4740 10 client.15840 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.251+0000 7f913f5c4740 1 -- 172.21.15.123:0/3576856290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5650423de990 con 0x5650423cafc0 2024-08-18T22:11:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.254+0000 7f911dffb640 1 -- 172.21.15.123:0/3576856290 <== mon.0 v2:172.21.15.123:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f9124004f80 con 0x5650423cafc0 2024-08-18T22:11:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.254+0000 7f913f5c4740 10 client.15840 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.254+0000 7f913f5c4740 10 client.15840 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.255+0000 7f913f5c4740 20 client.15840 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.255+0000 7f913f5c4740 1 --2- 172.21.15.123:0/3576856290 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5650423dfce0 0x5650423e20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.255+0000 7f913f5c4740 4 client.15840 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.255+0000 7f913f5c4740 1 -- 172.21.15.123:0/3576856290 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56504233b100 con 0x5650423dfce0 2024-08-18T22:11:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.255+0000 7f913a59b640 1 --2- 172.21.15.123:0/3576856290 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5650423dfce0 0x5650423e20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.256+0000 7f913a59b640 1 --2- 172.21.15.123:0/3576856290 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5650423dfce0 0x5650423e20d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b42000e871bbce4 server_cookie=ceb854c114aaa752 in_seq=0 out_seq=0 2024-08-18T22:11:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.256+0000 7f911dffb640 10 client.15840 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.256+0000 7f911dffb640 1 -- 172.21.15.123:0/3576856290 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56504233b100 con 0x5650423dfce0 2024-08-18T22:11:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.256+0000 7f911dffb640 10 client.15840 handle_command_reply: tid=0 2024-08-18T22:11:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.256+0000 7f913f5c4740 1 client.15840 shutdown 2024-08-18T22:11:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.257+0000 7f913f5c4740 1 -- 172.21.15.123:0/3576856290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423cafc0 msgr2=0x5650423d4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.257+0000 7f913f5c4740 1 --2- 172.21.15.123:0/3576856290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423cafc0 0x5650423d4cf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9124006010 tx=0x7f9124004520 comp rx=0 tx=0).stop 2024-08-18T22:11:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.257+0000 7f913f5c4740 1 -- 172.21.15.123:0/3576856290 shutdown_connections 2024-08-18T22:11:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.257+0000 7f913f5c4740 1 --2- 172.21.15.123:0/3576856290 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5650423dfce0 0x5650423e20d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.257+0000 7f913f5c4740 1 --2- 172.21.15.123:0/3576856290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 0x5650423dbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.257+0000 7f913f5c4740 1 --2- 172.21.15.123:0/3576856290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423cafc0 0x5650423d4cf0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.257+0000 7f911dffb640 0 client.15840 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.257+0000 7f913f5c4740 1 --2- 172.21.15.123:0/3576856290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423ca680 0x5650423d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.257+0000 7f913f5c4740 1 -- 172.21.15.123:0/3576856290 >> 172.21.15.123:0/3576856290 conn(0x5650423c5cf0 msgr2=0x5650423c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.257+0000 7f913f5c4740 1 -- 172.21.15.123:0/3576856290 shutdown_connections 2024-08-18T22:11:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.257+0000 7f913f5c4740 1 -- 172.21.15.123:0/3576856290 wait complete. 2024-08-18T22:11:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.257+0000 7f913f5c4740 20 client.15840 trim_cache size 0 max 16384 2024-08-18T22:11:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.279+0000 7f913f5c4740 1 Processor -- start 2024-08-18T22:11:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.279+0000 7f913f5c4740 1 -- start start 2024-08-18T22:11:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913f5c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423ca680 0x5650423c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913f5c4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423cafc0 0x5650423dbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913f5c4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423d0050 0x5650423c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913f5c4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f91341aef20 con 0x5650423d0050 2024-08-18T22:11:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913f5c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f91341ac780 con 0x5650423ca680 2024-08-18T22:11:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913f5c4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f91341aa5d0 con 0x5650423cafc0 2024-08-18T22:11:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913ad9c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423d0050 0x5650423c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913ad9c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423d0050 0x5650423c70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53324/0 (socket says 172.21.15.123:53324) 2024-08-18T22:11:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913ad9c640 1 -- 172.21.15.123:0/822918293 learned_addr learned my addr 172.21.15.123:0/822918293 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f9139d9a640 1 --2- 172.21.15.123:0/822918293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423cafc0 0x5650423dbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913a59b640 1 --2- 172.21.15.123:0/822918293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423ca680 0x5650423c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913ad9c640 1 -- 172.21.15.123:0/822918293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423cafc0 msgr2=0x5650423dbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913ad9c640 1 --2- 172.21.15.123:0/822918293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423cafc0 0x5650423dbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913ad9c640 1 -- 172.21.15.123:0/822918293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423ca680 msgr2=0x5650423c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913ad9c640 1 --2- 172.21.15.123:0/822918293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423ca680 0x5650423c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913ad9c640 1 -- 172.21.15.123:0/822918293 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650423cb4a0 con 0x5650423d0050 2024-08-18T22:11:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.280+0000 7f913ad9c640 1 --2- 172.21.15.123:0/822918293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423d0050 0x5650423c70e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f912c09b4b0 tx=0x7f912c09b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33577fa39d9c47b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.281+0000 7f911ffff640 1 -- 172.21.15.123:0/822918293 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c09b520 con 0x5650423d0050 2024-08-18T22:11:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.281+0000 7f911ffff640 1 -- 172.21.15.123:0/822918293 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f912c09f8d0 con 0x5650423d0050 2024-08-18T22:11:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.281+0000 7f911ffff640 1 -- 172.21.15.123:0/822918293 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c010b90 con 0x5650423d0050 2024-08-18T22:11:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.281+0000 7f913f5c4740 1 -- 172.21.15.123:0/822918293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423d0050 msgr2=0x5650423c70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.281+0000 7f913f5c4740 1 --2- 172.21.15.123:0/822918293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423d0050 0x5650423c70e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f912c09b4b0 tx=0x7f912c09b0b0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 1 -- 172.21.15.123:0/822918293 shutdown_connections 2024-08-18T22:11:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 1 --2- 172.21.15.123:0/822918293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423d0050 0x5650423c70e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 1 --2- 172.21.15.123:0/822918293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423cafc0 0x5650423dbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 1 --2- 172.21.15.123:0/822918293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423ca680 0x5650423c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 1 -- 172.21.15.123:0/822918293 >> 172.21.15.123:0/822918293 conn(0x5650423c5cf0 msgr2=0x5650423c4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 1 -- 172.21.15.123:0/822918293 shutdown_connections 2024-08-18T22:11:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 1 -- 172.21.15.123:0/822918293 wait complete. 2024-08-18T22:11:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 1 -- start start 2024-08-18T22:11:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 1 Processor -- start 2024-08-18T22:11:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423ca680 0x5650423d92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423cafc0 0x5650423d9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 0x5650423da820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f91341aac40 con 0x5650423ca680 2024-08-18T22:11:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f91341ac0b0 con 0x5650423d0050 2024-08-18T22:11:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f91341ab310 con 0x5650423cafc0 2024-08-18T22:11:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913f5c4740 10 client.0 _ll_register_callbacks cb 0x7f912c003ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913a59b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423ca680 0x5650423d92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913a59b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423ca680 0x5650423d92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53340/0 (socket says 172.21.15.123:53340) 2024-08-18T22:11:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.282+0000 7f913a59b640 1 -- 172.21.15.123:0/2409484941 learned_addr learned my addr 172.21.15.123:0/2409484941 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f913ad9c640 1 --2- 172.21.15.123:0/2409484941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 0x5650423da820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f9139d9a640 1 --2- 172.21.15.123:0/2409484941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423cafc0 0x5650423d9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f913a59b640 1 -- 172.21.15.123:0/2409484941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423cafc0 msgr2=0x5650423d9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f913a59b640 1 --2- 172.21.15.123:0/2409484941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423cafc0 0x5650423d9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f913a59b640 1 -- 172.21.15.123:0/2409484941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 msgr2=0x5650423da820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f913a59b640 1 --2- 172.21.15.123:0/2409484941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 0x5650423da820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f913a59b640 1 -- 172.21.15.123:0/2409484941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650423dae30 con 0x5650423ca680 2024-08-18T22:11:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f9139d9a640 1 --2- 172.21.15.123:0/2409484941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423cafc0 0x5650423d9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f913a59b640 1 --2- 172.21.15.123:0/2409484941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423ca680 0x5650423d92d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9130011920 tx=0x7f9130004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02b80662f4a1161 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f911dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f911dffb640 1 -- 172.21.15.123:0/2409484941 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913002baf0 con 0x5650423ca680 2024-08-18T22:11:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f911dffb640 1 -- 172.21.15.123:0/2409484941 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f9130009040 con 0x5650423ca680 2024-08-18T22:11:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f913f5c4740 1 -- 172.21.15.123:0/2409484941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f912c09f8d0 con 0x5650423ca680 2024-08-18T22:11:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f911dffb640 1 -- 172.21.15.123:0/2409484941 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f913003f050 con 0x5650423ca680 2024-08-18T22:11:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f913f5c4740 10 client.15846 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.283+0000 7f913f5c4740 1 -- 172.21.15.123:0/2409484941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56504244a860 con 0x5650423ca680 2024-08-18T22:11:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.284+0000 7f911dffb640 1 -- 172.21.15.123:0/2409484941 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f912c09f8d0 con 0x5650423ca680 2024-08-18T22:11:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.284+0000 7f911dffb640 1 -- 172.21.15.123:0/2409484941 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f9130003ab0 con 0x5650423ca680 2024-08-18T22:11:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.284+0000 7f913f5c4740 10 client.15846 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.284+0000 7f913f5c4740 10 client.15846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.284+0000 7f913f5c4740 20 client.15846 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.284+0000 7f913f5c4740 1 --2- 172.21.15.123:0/2409484941 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56504244b240 0x56504244d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.284+0000 7f913f5c4740 4 client.15846 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:11:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.284+0000 7f913f5c4740 1 -- 172.21.15.123:0/2409484941 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x565042335450 con 0x56504244b240 2024-08-18T22:11:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.284+0000 7f9139d9a640 1 --2- 172.21.15.123:0/2409484941 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56504244b240 0x56504244d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:06.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.285+0000 7f9139d9a640 1 --2- 172.21.15.123:0/2409484941 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56504244b240 0x56504244d660 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=469cff36c020a5 server_cookie=24f8edf611bef3 in_seq=0 out_seq=0 2024-08-18T22:11:06.292 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.285+0000 7f911dffb640 10 client.15846 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.302+0000 7f911dffb640 1 -- 172.21.15.123:0/2409484941 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x565042335450 con 0x56504244b240 2024-08-18T22:11:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.302+0000 7f911dffb640 10 client.15846 handle_command_reply: tid=0 2024-08-18T22:11:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.302+0000 7f913f5c4740 1 client.15846 shutdown 2024-08-18T22:11:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.302+0000 7f913f5c4740 1 -- 172.21.15.123:0/2409484941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423ca680 msgr2=0x5650423d92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.302+0000 7f913f5c4740 1 --2- 172.21.15.123:0/2409484941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423ca680 0x5650423d92d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9130011920 tx=0x7f9130004730 comp rx=0 tx=0).stop 2024-08-18T22:11:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.302+0000 7f913f5c4740 1 -- 172.21.15.123:0/2409484941 shutdown_connections 2024-08-18T22:11:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.302+0000 7f913f5c4740 1 --2- 172.21.15.123:0/2409484941 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56504244b240 0x56504244d660 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.302+0000 7f913f5c4740 1 --2- 172.21.15.123:0/2409484941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650423d0050 0x5650423da820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.302+0000 7f911dffb640 0 client.15846 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.302+0000 7f913f5c4740 1 --2- 172.21.15.123:0/2409484941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5650423cafc0 0x5650423d9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.302+0000 7f913f5c4740 1 --2- 172.21.15.123:0/2409484941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650423ca680 0x5650423d92d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.302+0000 7f913f5c4740 1 -- 172.21.15.123:0/2409484941 >> 172.21.15.123:0/2409484941 conn(0x5650423c5cf0 msgr2=0x5650423c4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.302+0000 7f913f5c4740 1 -- 172.21.15.123:0/2409484941 shutdown_connections 2024-08-18T22:11:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.302+0000 7f913f5c4740 1 -- 172.21.15.123:0/2409484941 wait complete. 2024-08-18T22:11:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.302+0000 7f913f5c4740 20 client.15846 trim_cache size 0 max 16384 2024-08-18T22:11:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:11:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:11:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:11:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:11:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.303+0000 7f913c7ff640 1 -- 172.21.15.123:0/3596171377 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f91200a2c30 msgr2=0x7f91200a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.303+0000 7f913c7ff640 1 --2- 172.21.15.123:0/3596171377 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f91200a2c30 0x7f91200a50f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f91341028d0 tx=0x7f9130005f90 comp rx=0 tx=0).stop 2024-08-18T22:11:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.303+0000 7f913c7ff640 1 -- 172.21.15.123:0/3596171377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9134103430 msgr2=0x7f9134074850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.303+0000 7f913c7ff640 1 --2- 172.21.15.123:0/3596171377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9134103430 0x7f9134074850 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f912c00efd0 tx=0x7f912c00c6a0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.303+0000 7f913c7ff640 1 -- 172.21.15.123:0/3596171377 shutdown_connections 2024-08-18T22:11:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.303+0000 7f913c7ff640 1 --2- 172.21.15.123:0/3596171377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9134103430 0x7f9134074850 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.303+0000 7f913c7ff640 1 --2- 172.21.15.123:0/3596171377 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f91200a2c30 0x7f91200a50f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.303+0000 7f913c7ff640 1 --2- 172.21.15.123:0/3596171377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9134102a70 0x7f9134074310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.303+0000 7f913c7ff640 1 --2- 172.21.15.123:0/3596171377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9134101880 0x7f9134075cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.303+0000 7f913c7ff640 1 -- 172.21.15.123:0/3596171377 >> 172.21.15.123:0/3596171377 conn(0x7f91340fcfe0 msgr2=0x7f9134105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.303+0000 7f913c7ff640 1 -- 172.21.15.123:0/3596171377 shutdown_connections 2024-08-18T22:11:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:06.303+0000 7f913c7ff640 1 -- 172.21.15.123:0/3596171377 wait complete. 2024-08-18T22:11:06.394 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:11:06.394 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:11:06.418 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:06.419 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:06.419 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 92 -lt 100 ']' 2024-08-18T22:11:06.419 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 92 + 1 2024-08-18T22:11:06.463 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=93 2024-08-18T22:11:06.463 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:11:06.538 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:06.538 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:06.538 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:11:06.539 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:11:06.539 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:11:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7fdbaa3ed640 1 -- 172.21.15.123:0/412836390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdba4100e90 msgr2=0x7fdba41012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7fdbaa3ed640 1 --2- 172.21.15.123:0/412836390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdba4100e90 0x7fdba41012f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009930 tx=0x7fdb9802a420 comp rx=0 tx=0).stop 2024-08-18T22:11:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7fdbaa3ed640 1 -- 172.21.15.123:0/412836390 shutdown_connections 2024-08-18T22:11:07.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7fdbaa3ed640 1 --2- 172.21.15.123:0/412836390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdba4101830 0x7fdba410d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7fdbaa3ed640 1 --2- 172.21.15.123:0/412836390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdba4100e90 0x7fdba41012f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7fdbaa3ed640 1 --2- 172.21.15.123:0/412836390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdba4106830 0x7fdba4106c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7fdbaa3ed640 1 -- 172.21.15.123:0/412836390 >> 172.21.15.123:0/412836390 conn(0x7fdba40fbc10 msgr2=0x7fdba40fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:07.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.247+0000 7fdbaa3ed640 1 -- 172.21.15.123:0/412836390 shutdown_connections 2024-08-18T22:11:07.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.247+0000 7fdbaa3ed640 1 -- 172.21.15.123:0/412836390 wait complete. 2024-08-18T22:11:07.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7feb0d7cf640 1 -- 172.21.15.123:0/1168396495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb0810bea0 msgr2=0x7feb0810e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7feb0d7cf640 1 --2- 172.21.15.123:0/1168396495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb0810bea0 0x7feb0810e340 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009900 tx=0x7feaf802a480 comp rx=0 tx=0).stop 2024-08-18T22:11:07.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7feb0d7cf640 1 -- 172.21.15.123:0/1168396495 shutdown_connections 2024-08-18T22:11:07.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7feb0d7cf640 1 --2- 172.21.15.123:0/1168396495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb0810bea0 0x7feb0810e340 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7feb0d7cf640 1 --2- 172.21.15.123:0/1168396495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb08103390 0x7feb0810b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7feb0d7cf640 1 --2- 172.21.15.123:0/1168396495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb08102a70 0x7feb08102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7feb0d7cf640 1 -- 172.21.15.123:0/1168396495 >> 172.21.15.123:0/1168396495 conn(0x7feb080fc4d0 msgr2=0x7feb080fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:07.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7feb0d7cf640 1 -- 172.21.15.123:0/1168396495 shutdown_connections 2024-08-18T22:11:07.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.246+0000 7feb0d7cf640 1 -- 172.21.15.123:0/1168396495 wait complete. 2024-08-18T22:11:07.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.247+0000 7feb0d7cf640 1 Processor -- start 2024-08-18T22:11:07.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.247+0000 7fdbaa3ed640 1 Processor -- start 2024-08-18T22:11:07.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7fdbaa3ed640 1 -- start start 2024-08-18T22:11:07.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7feb0d7cf640 1 -- start start 2024-08-18T22:11:07.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7feb0d7cf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb08102a70 0x7feb08198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7feb0d7cf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb08103390 0x7feb081986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7feb0d7cf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb0810bea0 0x7feb0819ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7fdbaa3ed640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdba4100e90 0x7fdba4198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7feb0d7cf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feb08111c80 con 0x7feb08103390 2024-08-18T22:11:07.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7feb0d7cf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feb08111b00 con 0x7feb08102a70 2024-08-18T22:11:07.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7feb0d7cf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7feb08111e00 con 0x7feb0810bea0 2024-08-18T22:11:07.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7fdbaa3ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdba4101830 0x7fdba4198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7fdbaa3ed640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdba4106830 0x7fdba419caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7feb067fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb08103390 0x7feb081986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7feb067fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb08103390 0x7feb081986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53380/0 (socket says 172.21.15.123:53380) 2024-08-18T22:11:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7feb067fc640 1 -- 172.21.15.123:0/2110486328 learned_addr learned my addr 172.21.15.123:0/2110486328 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:07.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7fdbaa3ed640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdba4111d90 con 0x7fdba4101830 2024-08-18T22:11:07.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7fdbaa3ed640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdba4111c10 con 0x7fdba4106830 2024-08-18T22:11:07.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.248+0000 7fdbaa3ed640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdba4111f10 con 0x7fdba4100e90 2024-08-18T22:11:07.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.249+0000 7fdba3fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdba4100e90 0x7fdba4198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.249+0000 7fdba3fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdba4100e90 0x7fdba4198220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:54738/0 (socket says 172.21.15.123:54738) 2024-08-18T22:11:07.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.249+0000 7fdba3fff640 1 -- 172.21.15.123:0/2031846950 learned_addr learned my addr 172.21.15.123:0/2031846950 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:07.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.249+0000 7fdba898a640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdba4106830 0x7fdba419caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.249+0000 7fdba37fe640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdba4101830 0x7fdba4198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.249+0000 7feb06ffd640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb08102a70 0x7feb08198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.249+0000 7feb067fc640 1 -- 172.21.15.123:0/2110486328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb0810bea0 msgr2=0x7feb0819ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.249+0000 7feb077fe640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb0810bea0 0x7feb0819ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.249+0000 7feb067fc640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb0810bea0 0x7feb0819ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.249+0000 7feb067fc640 1 -- 172.21.15.123:0/2110486328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb08102a70 msgr2=0x7feb08198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.249+0000 7feb067fc640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb08102a70 0x7feb08198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.249+0000 7feb067fc640 1 -- 172.21.15.123:0/2110486328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0819d140 con 0x7feb08103390 2024-08-18T22:11:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.249+0000 7feb06ffd640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb08102a70 0x7feb08198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:11:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.249+0000 7feb077fe640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb0810bea0 0x7feb0819ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:11:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.249+0000 7feb067fc640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb08103390 0x7feb081986d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7feaf000d750 tx=0x7feaf000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.250+0000 7fdba898a640 1 -- 172.21.15.123:0/2031846950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdba4100e90 msgr2=0x7fdba4198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.250+0000 7fdba898a640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdba4100e90 0x7fdba4198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.250+0000 7fdba898a640 1 -- 172.21.15.123:0/2031846950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdba4101830 msgr2=0x7fdba4198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.250+0000 7fdba898a640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdba4101830 0x7fdba4198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.250+0000 7fdba898a640 1 -- 172.21.15.123:0/2031846950 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba419d1d0 con 0x7fdba4106830 2024-08-18T22:11:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.250+0000 7fdba3fff640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdba4100e90 0x7fdba4198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.250+0000 7fdba37fe640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdba4101830 0x7fdba4198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:07.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.250+0000 7feafffff640 1 -- 172.21.15.123:0/2110486328 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0017070 con 0x7feb08103390 2024-08-18T22:11:07.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.250+0000 7feb0d7cf640 1 -- 172.21.15.123:0/2110486328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb0819d430 con 0x7feb08103390 2024-08-18T22:11:07.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.250+0000 7feb0d7cf640 1 -- 172.21.15.123:0/2110486328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb081a4d10 con 0x7feb08103390 2024-08-18T22:11:07.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.250+0000 7feafffff640 1 -- 172.21.15.123:0/2110486328 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf0005020 con 0x7feb08103390 2024-08-18T22:11:07.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.250+0000 7feafffff640 1 -- 172.21.15.123:0/2110486328 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0004d00 con 0x7feb08103390 2024-08-18T22:11:07.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.250+0000 7fdba898a640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdba4106830 0x7fdba419caf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009fd0 tx=0x7fdb9c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:07.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.250+0000 7fdba17fa640 1 -- 172.21.15.123:0/2031846950 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c00ce20 con 0x7fdba4106830 2024-08-18T22:11:07.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.251+0000 7fdba17fa640 1 -- 172.21.15.123:0/2031846950 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb9c0137d0 con 0x7fdba4106830 2024-08-18T22:11:07.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.251+0000 7fdba17fa640 1 -- 172.21.15.123:0/2031846950 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0055e0 con 0x7fdba4106830 2024-08-18T22:11:07.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.251+0000 7fdbaa3ed640 1 -- 172.21.15.123:0/2031846950 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba419d4c0 con 0x7fdba4106830 2024-08-18T22:11:07.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.251+0000 7fdbaa3ed640 1 -- 172.21.15.123:0/2031846950 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba419d920 con 0x7fdba4106830 2024-08-18T22:11:07.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.254+0000 7feafffff640 1 -- 172.21.15.123:0/2110486328 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7feaf0009a30 con 0x7feb08103390 2024-08-18T22:11:07.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.254+0000 7fdba17fa640 1 -- 172.21.15.123:0/2031846950 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fdb9c013980 con 0x7fdba4106830 2024-08-18T22:11:07.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.254+0000 7feafffff640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feaf40a2c00 0x7feaf40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.255+0000 7feafffff640 1 -- 172.21.15.123:0/2110486328 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7feaf00ce900 con 0x7feb08103390 2024-08-18T22:11:07.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.255+0000 7feb06ffd640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feaf40a2c00 0x7feaf40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.255+0000 7fdba17fa640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdb8c0a2c00 0x7fdb8c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.255+0000 7fdba3fff640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdb8c0a2c00 0x7fdb8c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.255+0000 7fdba17fa640 1 -- 172.21.15.123:0/2031846950 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fdb9c0d3b60 con 0x7fdba4106830 2024-08-18T22:11:07.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.255+0000 7feb06ffd640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feaf40a2c00 0x7feaf40a50c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feb00005fd0 tx=0x7feb00009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:07.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.256+0000 7fdba3fff640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdb8c0a2c00 0x7fdb8c0a50c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdb94005fd0 tx=0x7fdb9400b690 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:07.302 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:07.302 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:07.337 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:07 smithi123 ceph-mon[18462]: pgmap v440: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-08-18T22:11:07.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:07 smithi183 ceph-mon[22097]: pgmap v440: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-08-18T22:11:07.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:07 smithi130 ceph-mon[21698]: pgmap v440: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-08-18T22:11:07.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7fdbac7eb740 1 Processor -- start 2024-08-18T22:11:07.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7feb0fbcd740 1 Processor -- start 2024-08-18T22:11:07.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7fdbac7eb740 1 -- start start 2024-08-18T22:11:07.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7feb0fbcd740 1 -- start start 2024-08-18T22:11:07.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7fdbac7eb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66e9bff0 0x55fa66e9c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7fdbac7eb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 0x55fa66ea6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7fdbac7eb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66ea71d0 0x55fa66ea95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7fdbac7eb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55fa66e01a40 con 0x55fa66ea71d0 2024-08-18T22:11:07.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7fdbac7eb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fa66d999d0 con 0x55fa66e9bff0 2024-08-18T22:11:07.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7fdbac7eb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fa66dfda00 con 0x55fa66e9c910 2024-08-18T22:11:07.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7fdba898a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66ea71d0 0x55fa66ea95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7fdba898a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66ea71d0 0x55fa66ea95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53402/0 (socket says 172.21.15.123:53402) 2024-08-18T22:11:07.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7fdba898a640 1 -- 172.21.15.123:0/3047477969 learned_addr learned my addr 172.21.15.123:0/3047477969 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:07.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7fdba37fe640 1 --2- 172.21.15.123:0/3047477969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 0x55fa66ea6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7fdba3fff640 1 --2- 172.21.15.123:0/3047477969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66e9bff0 0x55fa66e9c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7feb0fbcd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecaff0 0x5564a5ecb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.537+0000 7feb0fbcd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5ecb910 0x5564a5eda1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7feb0fbcd740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5eda720 0x5564a5edcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7feb0fbcd740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5564a5e30a70 con 0x5564a5eda720 2024-08-18T22:11:07.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7feb0fbcd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5564a5dc8780 con 0x5564a5ecb910 2024-08-18T22:11:07.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7feb0fbcd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5564a5e2ca30 con 0x5564a5ecaff0 2024-08-18T22:11:07.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7feb067fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5ecb910 0x5564a5eda1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7feb067fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5ecb910 0x5564a5eda1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:34820/0 (socket says 172.21.15.123:34820) 2024-08-18T22:11:07.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7feb067fc640 1 -- 172.21.15.123:0/2045366188 learned_addr learned my addr 172.21.15.123:0/2045366188 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:07.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7feb06ffd640 1 --2- 172.21.15.123:0/2045366188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecaff0 0x5564a5ecb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7feb077fe640 1 --2- 172.21.15.123:0/2045366188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5eda720 0x5564a5edcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7fdba898a640 1 -- 172.21.15.123:0/3047477969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 msgr2=0x55fa66ea6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7fdba898a640 1 --2- 172.21.15.123:0/3047477969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 0x55fa66ea6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7fdba898a640 1 -- 172.21.15.123:0/3047477969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66e9bff0 msgr2=0x55fa66e9c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7fdba898a640 1 --2- 172.21.15.123:0/3047477969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66e9bff0 0x55fa66e9c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7fdba898a640 1 -- 172.21.15.123:0/3047477969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa66da0650 con 0x55fa66ea71d0 2024-08-18T22:11:07.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7fdba3fff640 1 --2- 172.21.15.123:0/3047477969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66e9bff0 0x55fa66e9c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:07.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7feb067fc640 1 -- 172.21.15.123:0/2045366188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecaff0 msgr2=0x5564a5ecb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7feb067fc640 1 --2- 172.21.15.123:0/2045366188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecaff0 0x5564a5ecb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7feb067fc640 1 -- 172.21.15.123:0/2045366188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5eda720 msgr2=0x5564a5edcb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7feb067fc640 1 --2- 172.21.15.123:0/2045366188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5eda720 0x5564a5edcb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7feb067fc640 1 -- 172.21.15.123:0/2045366188 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564a5ba2b90 con 0x5564a5ecb910 2024-08-18T22:11:07.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7fdba898a640 1 --2- 172.21.15.123:0/3047477969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66ea71d0 0x55fa66ea95c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c09ca00 tx=0x7fdb9c0050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee953be354fd3a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:07.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7feb067fc640 1 --2- 172.21.15.123:0/2045366188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5ecb910 0x5564a5eda1e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feaf009aad0 tx=0x7feaf009a840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db65ef2f94e0256a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:07.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7fdb8a7fc640 1 -- 172.21.15.123:0/3047477969 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0a43e0 con 0x55fa66ea71d0 2024-08-18T22:11:07.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.538+0000 7fdb8a7fc640 1 -- 172.21.15.123:0/3047477969 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb9c0a8ca0 con 0x55fa66ea71d0 2024-08-18T22:11:07.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.539+0000 7fdb8a7fc640 1 -- 172.21.15.123:0/3047477969 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0a8810 con 0x55fa66ea71d0 2024-08-18T22:11:07.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.539+0000 7feafd7fa640 1 -- 172.21.15.123:0/2045366188 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0020040 con 0x5564a5ecb910 2024-08-18T22:11:07.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.539+0000 7feafd7fa640 1 -- 172.21.15.123:0/2045366188 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf0009d20 con 0x5564a5ecb910 2024-08-18T22:11:07.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.539+0000 7feafd7fa640 1 -- 172.21.15.123:0/2045366188 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0099c90 con 0x5564a5ecb910 2024-08-18T22:11:07.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.539+0000 7fdbac7eb740 1 -- 172.21.15.123:0/3047477969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66ea71d0 msgr2=0x55fa66ea95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.539+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/3047477969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66ea71d0 0x55fa66ea95c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c09ca00 tx=0x7fdb9c0050b0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.539+0000 7fdbac7eb740 1 -- 172.21.15.123:0/3047477969 shutdown_connections 2024-08-18T22:11:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.539+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/3047477969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66ea71d0 0x55fa66ea95c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.539+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/3047477969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 0x55fa66ea6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.539+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/3047477969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66e9bff0 0x55fa66e9c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.540+0000 7fdbac7eb740 1 -- 172.21.15.123:0/3047477969 >> 172.21.15.123:0/3047477969 conn(0x55fa66e98580 msgr2=0x55fa66e98960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.540+0000 7fdbac7eb740 1 -- 172.21.15.123:0/3047477969 shutdown_connections 2024-08-18T22:11:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.540+0000 7fdbac7eb740 1 -- 172.21.15.123:0/3047477969 wait complete. 2024-08-18T22:11:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.540+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2045366188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5ecb910 msgr2=0x5564a5eda1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.540+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2045366188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5ecb910 0x5564a5eda1e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feaf009aad0 tx=0x7feaf009a840 comp rx=0 tx=0).stop 2024-08-18T22:11:07.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.540+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2045366188 shutdown_connections 2024-08-18T22:11:07.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.540+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2045366188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5eda720 0x5564a5edcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.540+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2045366188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5ecb910 0x5564a5eda1e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.540+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2045366188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecaff0 0x5564a5ecb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.540+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2045366188 >> 172.21.15.123:0/2045366188 conn(0x5564a5ec76c0 msgr2=0x5564a5ec7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:07.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.540+0000 7fdbac7eb740 1 -- start start 2024-08-18T22:11:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.540+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2045366188 shutdown_connections 2024-08-18T22:11:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.540+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2045366188 wait complete. 2024-08-18T22:11:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.540+0000 7fdbac7eb740 1 Processor -- start 2024-08-18T22:11:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.540+0000 7feb0fbcd740 1 -- start start 2024-08-18T22:11:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7feb0fbcd740 1 Processor -- start 2024-08-18T22:11:07.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7fdbac7eb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66e9bff0 0x55fa66ea4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7fdbac7eb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 0x55fa66ea4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7fdbac7eb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66ea71d0 0x55fa66ea4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7fdbac7eb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55fa66ea9da0 con 0x55fa66e9bff0 2024-08-18T22:11:07.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7fdbac7eb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fa66dbcb20 con 0x55fa66ea71d0 2024-08-18T22:11:07.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7fdbac7eb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fa66ea9f20 con 0x55fa66e9c910 2024-08-18T22:11:07.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7fdbac7eb740 10 client.0 _ll_register_callbacks cb 0x55fa66dbabb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:07.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7feb0fbcd740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5ecaff0 0x5564a5ed7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7fdba3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66e9bff0 0x55fa66ea4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7fdba3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66e9bff0 0x55fa66ea4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53422/0 (socket says 172.21.15.123:53422) 2024-08-18T22:11:07.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7fdba3fff640 1 -- 172.21.15.123:0/2346034102 learned_addr learned my addr 172.21.15.123:0/2346034102 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:07.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7fdba898a640 1 --2- 172.21.15.123:0/2346034102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66ea71d0 0x55fa66ea4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7fdba37fe640 1 --2- 172.21.15.123:0/2346034102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 0x55fa66ea4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7feb0fbcd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecb910 0x5564a5ed7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7feb06ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5ecaff0 0x5564a5ed7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7feb0fbcd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5eda720 0x5564a5ed7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7feb06ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5ecaff0 0x5564a5ed7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53426/0 (socket says 172.21.15.123:53426) 2024-08-18T22:11:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7feb06ffd640 1 -- 172.21.15.123:0/2006852865 learned_addr learned my addr 172.21.15.123:0/2006852865 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2006852865 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5564a5edd2f0 con 0x5564a5ecaff0 2024-08-18T22:11:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2006852865 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5564a5deb990 con 0x5564a5eda720 2024-08-18T22:11:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2006852865 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5564a5edd470 con 0x5564a5ecb910 2024-08-18T22:11:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.541+0000 7feb067fc640 1 --2- 172.21.15.123:0/2006852865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecb910 0x5564a5ed7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7feb0fbcd740 10 client.0 _ll_register_callbacks cb 0x5564a5b40090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7feb077fe640 1 --2- 172.21.15.123:0/2006852865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5eda720 0x5564a5ed7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7fdba898a640 1 -- 172.21.15.123:0/2346034102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 msgr2=0x55fa66ea4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7fdba898a640 1 --2- 172.21.15.123:0/2346034102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 0x55fa66ea4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7fdba898a640 1 -- 172.21.15.123:0/2346034102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66e9bff0 msgr2=0x55fa66ea4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7fdba898a640 1 --2- 172.21.15.123:0/2346034102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66e9bff0 0x55fa66ea4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7fdba898a640 1 -- 172.21.15.123:0/2346034102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa66b733c0 con 0x55fa66ea71d0 2024-08-18T22:11:07.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7feb06ffd640 1 -- 172.21.15.123:0/2006852865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecb910 msgr2=0x5564a5ed7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7feb06ffd640 1 --2- 172.21.15.123:0/2006852865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecb910 0x5564a5ed7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7feb06ffd640 1 -- 172.21.15.123:0/2006852865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5eda720 msgr2=0x5564a5ed7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7feb06ffd640 1 --2- 172.21.15.123:0/2006852865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5eda720 0x5564a5ed7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7feb06ffd640 1 -- 172.21.15.123:0/2006852865 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564a5dea6c0 con 0x5564a5ecaff0 2024-08-18T22:11:07.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7feb067fc640 1 --2- 172.21.15.123:0/2006852865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecb910 0x5564a5ed7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:07.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7fdba3fff640 1 --2- 172.21.15.123:0/2346034102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66e9bff0 0x55fa66ea4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:07.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7fdba37fe640 1 --2- 172.21.15.123:0/2346034102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 0x55fa66ea4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:07.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7fdba898a640 1 --2- 172.21.15.123:0/2346034102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66ea71d0 0x55fa66ea4b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0d1320 tx=0x7fdb9c013ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70cf4b6baf858b88 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:07.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7fdb837fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:11:07.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7feb06ffd640 1 --2- 172.21.15.123:0/2006852865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5ecaff0 0x5564a5ed7560 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7feb00011960 tx=0x7feb00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158cb00cb8c1e284 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:07.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7feaee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:07.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.542+0000 7fdb837fe640 1 -- 172.21.15.123:0/2346034102 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0a43e0 con 0x55fa66ea71d0 2024-08-18T22:11:07.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.543+0000 7fdb837fe640 1 -- 172.21.15.123:0/2346034102 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fdb9c09e330 con 0x55fa66ea71d0 2024-08-18T22:11:07.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.543+0000 7feaee7fc640 1 -- 172.21.15.123:0/2006852865 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb00010d60 con 0x5564a5ecaff0 2024-08-18T22:11:07.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.543+0000 7feaee7fc640 1 -- 172.21.15.123:0/2006852865 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7feb0001f430 con 0x5564a5ecaff0 2024-08-18T22:11:07.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.543+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2006852865 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaf0009d20 con 0x5564a5ecaff0 2024-08-18T22:11:07.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.543+0000 7fdbac7eb740 1 -- 172.21.15.123:0/2346034102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb9c0a8ca0 con 0x55fa66ea71d0 2024-08-18T22:11:07.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.543+0000 7feaee7fc640 1 -- 172.21.15.123:0/2006852865 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feb0001f630 con 0x5564a5ecaff0 2024-08-18T22:11:07.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.543+0000 7feb0fbcd740 10 client.15870 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:07.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.543+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2006852865 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5564a5ee8fb0 con 0x5564a5ecaff0 2024-08-18T22:11:07.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.543+0000 7fdb837fe640 1 -- 172.21.15.123:0/2346034102 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdb9c09aba0 con 0x55fa66ea71d0 2024-08-18T22:11:07.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.543+0000 7fdbac7eb740 10 client.25319 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:07.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.543+0000 7fdbac7eb740 1 -- 172.21.15.123:0/2346034102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fa66eb5a00 con 0x55fa66ea71d0 2024-08-18T22:11:07.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.543+0000 7feaee7fc640 1 -- 172.21.15.123:0/2006852865 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf0009d20 con 0x5564a5ecaff0 2024-08-18T22:11:07.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.543+0000 7feaee7fc640 1 -- 172.21.15.123:0/2006852865 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7feb000288f0 con 0x5564a5ecaff0 2024-08-18T22:11:07.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7fdb837fe640 1 -- 172.21.15.123:0/2346034102 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb9c0a8ca0 con 0x55fa66ea71d0 2024-08-18T22:11:07.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7feb0fbcd740 10 client.15870 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:07.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7feb0fbcd740 10 client.15870 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:11:07.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7feb0fbcd740 20 client.15870 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:07.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7fdb837fe640 1 -- 172.21.15.123:0/2346034102 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdb9c09f480 con 0x55fa66ea71d0 2024-08-18T22:11:07.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7fdbac7eb740 10 client.25319 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:07.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7fdbac7eb740 10 client.25319 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-18T22:11:07.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7fdbac7eb740 20 client.25319 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:07.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/2346034102 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55fa66eb6d50 0x55fa66eb9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7fdbac7eb740 4 client.25319 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:07.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7fdbac7eb740 1 -- 172.21.15.123:0/2346034102 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa66e0efb0 con 0x55fa66eb6d50 2024-08-18T22:11:07.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2006852865 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5564a5eea470 0x5564a5eec910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7feb0fbcd740 4 client.15870 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:07.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2006852865 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564a5e3e1a0 con 0x5564a5eea470 2024-08-18T22:11:07.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7fdba3fff640 1 --2- 172.21.15.123:0/2346034102 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55fa66eb6d50 0x55fa66eb9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.544+0000 7feb067fc640 1 --2- 172.21.15.123:0/2006852865 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5564a5eea470 0x5564a5eec910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.545+0000 7feb067fc640 1 --2- 172.21.15.123:0/2006852865 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5564a5eea470 0x5564a5eec910 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c9e0f7f07a0d37e server_cookie=de5a3d6ff38986f1 in_seq=0 out_seq=0 2024-08-18T22:11:07.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.545+0000 7fdba3fff640 1 --2- 172.21.15.123:0/2346034102 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55fa66eb6d50 0x55fa66eb9140 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d98ec062efb9b55 server_cookie=6ea16cdb155f4207 in_seq=0 out_seq=0 2024-08-18T22:11:07.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.545+0000 7feaee7fc640 10 client.15870 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:07.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.545+0000 7fdb837fe640 10 client.25319 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:11:07.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.545+0000 7feaee7fc640 1 -- 172.21.15.123:0/2006852865 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5564a5e3e1a0 con 0x5564a5eea470 2024-08-18T22:11:07.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.545+0000 7feaee7fc640 10 client.15870 handle_command_reply: tid=0 2024-08-18T22:11:07.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7fdb837fe640 1 -- 172.21.15.123:0/2346034102 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa66e0efb0 con 0x55fa66eb6d50 2024-08-18T22:11:07.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7fdb837fe640 10 client.25319 handle_command_reply: tid=0 2024-08-18T22:11:07.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7feb0fbcd740 1 client.15870 shutdown 2024-08-18T22:11:07.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7fdbac7eb740 1 client.25319 shutdown 2024-08-18T22:11:07.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2006852865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5ecaff0 msgr2=0x5564a5ed7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2006852865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5ecaff0 0x5564a5ed7560 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7feb00011960 tx=0x7feb00004a40 comp rx=0 tx=0).stop 2024-08-18T22:11:07.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2006852865 shutdown_connections 2024-08-18T22:11:07.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2006852865 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5564a5eea470 0x5564a5eec910 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2006852865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5eda720 0x5564a5ed7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2006852865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecb910 0x5564a5ed7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2006852865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5ecaff0 0x5564a5ed7560 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7feaee7fc640 0 client.15870 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:07.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2006852865 >> 172.21.15.123:0/2006852865 conn(0x5564a5ec76c0 msgr2=0x5564a5ecd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:07.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7fdbac7eb740 1 -- 172.21.15.123:0/2346034102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66ea71d0 msgr2=0x55fa66ea4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/2346034102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66ea71d0 0x55fa66ea4b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0d1320 tx=0x7fdb9c013ee0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7fdbac7eb740 1 -- 172.21.15.123:0/2346034102 shutdown_connections 2024-08-18T22:11:07.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/2346034102 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55fa66eb6d50 0x55fa66eb9140 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7fdb837fe640 0 client.25319 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:11:07.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2006852865 shutdown_connections 2024-08-18T22:11:07.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/2346034102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66ea71d0 0x55fa66ea4b90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/2346034102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 0x55fa66ea4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/2346034102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66e9bff0 0x55fa66ea4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.546+0000 7fdbac7eb740 1 -- 172.21.15.123:0/2346034102 >> 172.21.15.123:0/2346034102 conn(0x55fa66e98580 msgr2=0x55fa66e9e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:07.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.547+0000 7fdbac7eb740 1 -- 172.21.15.123:0/2346034102 shutdown_connections 2024-08-18T22:11:07.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.547+0000 7fdbac7eb740 1 -- 172.21.15.123:0/2346034102 wait complete. 2024-08-18T22:11:07.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.547+0000 7fdbac7eb740 20 client.25319 trim_cache size 0 max 16384 2024-08-18T22:11:07.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.547+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2006852865 wait complete. 2024-08-18T22:11:07.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.547+0000 7feb0fbcd740 20 client.15870 trim_cache size 0 max 16384 2024-08-18T22:11:07.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.560+0000 7fdbac7eb740 1 Processor -- start 2024-08-18T22:11:07.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.560+0000 7fdbac7eb740 1 -- start start 2024-08-18T22:11:07.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.560+0000 7fdbac7eb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66e9bff0 0x55fa66e97dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdbac7eb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 0x55fa66ea1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdbac7eb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66ea71d0 0x55fa66ea1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdbac7eb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdba41af190 con 0x55fa66e9bff0 2024-08-18T22:11:07.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdbac7eb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdba41aca60 con 0x55fa66ea71d0 2024-08-18T22:11:07.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdbac7eb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdba41aa8d0 con 0x55fa66e9c910 2024-08-18T22:11:07.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdba3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66e9bff0 0x55fa66e97dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdba3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66e9bff0 0x55fa66e97dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53436/0 (socket says 172.21.15.123:53436) 2024-08-18T22:11:07.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdba3fff640 1 -- 172.21.15.123:0/2696014280 learned_addr learned my addr 172.21.15.123:0/2696014280 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:07.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdba898a640 1 --2- 172.21.15.123:0/2696014280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66ea71d0 0x55fa66ea1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdba37fe640 1 --2- 172.21.15.123:0/2696014280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 0x55fa66ea1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdba3fff640 1 -- 172.21.15.123:0/2696014280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 msgr2=0x55fa66ea1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdba3fff640 1 --2- 172.21.15.123:0/2696014280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 0x55fa66ea1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdba3fff640 1 -- 172.21.15.123:0/2696014280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66ea71d0 msgr2=0x55fa66ea1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdba3fff640 1 --2- 172.21.15.123:0/2696014280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66ea71d0 0x55fa66ea1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdba3fff640 1 -- 172.21.15.123:0/2696014280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa66ea26e0 con 0x55fa66e9bff0 2024-08-18T22:11:07.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.561+0000 7fdba898a640 1 --2- 172.21.15.123:0/2696014280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66ea71d0 0x55fa66ea1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:07.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.562+0000 7fdba3fff640 1 --2- 172.21.15.123:0/2696014280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66e9bff0 0x55fa66e97dc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400bb70 tx=0x7fdb94012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9971c17391194fa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:07.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.562+0000 7fdb89ffb640 1 -- 172.21.15.123:0/2696014280 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb94021190 con 0x55fa66e9bff0 2024-08-18T22:11:07.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.562+0000 7fdb89ffb640 1 -- 172.21.15.123:0/2696014280 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb940035f0 con 0x55fa66e9bff0 2024-08-18T22:11:07.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.562+0000 7fdb89ffb640 1 -- 172.21.15.123:0/2696014280 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb94021730 con 0x55fa66e9bff0 2024-08-18T22:11:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.563+0000 7fdbac7eb740 1 -- 172.21.15.123:0/2696014280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66e9bff0 msgr2=0x55fa66e97dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.563+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/2696014280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66e9bff0 0x55fa66e97dc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400bb70 tx=0x7fdb94012000 comp rx=0 tx=0).stop 2024-08-18T22:11:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.563+0000 7fdbac7eb740 1 -- 172.21.15.123:0/2696014280 shutdown_connections 2024-08-18T22:11:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.563+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/2696014280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66ea71d0 0x55fa66ea1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.563+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/2696014280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9c910 0x55fa66ea1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.563+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/2696014280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66e9bff0 0x55fa66e97dc0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.563+0000 7fdbac7eb740 1 -- 172.21.15.123:0/2696014280 >> 172.21.15.123:0/2696014280 conn(0x55fa66e98580 msgr2=0x55fa66ea2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.563+0000 7fdbac7eb740 1 -- 172.21.15.123:0/2696014280 shutdown_connections 2024-08-18T22:11:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.563+0000 7fdbac7eb740 1 -- 172.21.15.123:0/2696014280 wait complete. 2024-08-18T22:11:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.563+0000 7fdbac7eb740 1 -- start start 2024-08-18T22:11:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.564+0000 7fdbac7eb740 1 Processor -- start 2024-08-18T22:11:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.564+0000 7fdbac7eb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9bff0 0x55fa66eb9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.564+0000 7fdbac7eb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66e9c910 0x55fa66eb9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.564+0000 7fdbac7eb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66ea71d0 0x55fa66f1f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.564+0000 7fdbac7eb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdba41aaf20 con 0x55fa66ea71d0 2024-08-18T22:11:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.564+0000 7fdbac7eb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdba41ac390 con 0x55fa66e9c910 2024-08-18T22:11:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.564+0000 7fdbac7eb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdba41ab5f0 con 0x55fa66e9bff0 2024-08-18T22:11:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.564+0000 7fdbac7eb740 10 client.0 _ll_register_callbacks cb 0x7fdb94015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.564+0000 7fdba898a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66ea71d0 0x55fa66f1f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.564+0000 7fdba37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66e9c910 0x55fa66eb9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.564+0000 7fdba3fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9bff0 0x55fa66eb9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.564+0000 7fdba37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66e9c910 0x55fa66eb9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:34854/0 (socket says 172.21.15.123:34854) 2024-08-18T22:11:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.564+0000 7fdba37fe640 1 -- 172.21.15.123:0/3038677682 learned_addr learned my addr 172.21.15.123:0/3038677682 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.565+0000 7fdba37fe640 1 -- 172.21.15.123:0/3038677682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9bff0 msgr2=0x55fa66eb9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.565+0000 7fdba37fe640 1 --2- 172.21.15.123:0/3038677682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9bff0 0x55fa66eb9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.565+0000 7fdba37fe640 1 -- 172.21.15.123:0/3038677682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66ea71d0 msgr2=0x55fa66f1f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.565+0000 7fdba37fe640 1 --2- 172.21.15.123:0/3038677682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66ea71d0 0x55fa66f1f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.565+0000 7fdba37fe640 1 -- 172.21.15.123:0/3038677682 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa66f1fbf0 con 0x55fa66e9c910 2024-08-18T22:11:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.565+0000 7fdba898a640 1 --2- 172.21.15.123:0/3038677682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66ea71d0 0x55fa66f1f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.565+0000 7fdba37fe640 1 --2- 172.21.15.123:0/3038677682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66e9c910 0x55fa66eb9c40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009930 tx=0x7fdb980044f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=769ea17a767e1ed4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.565+0000 7fdb837fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:11:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.565+0000 7fdb837fe640 1 -- 172.21.15.123:0/3038677682 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9804b060 con 0x55fa66e9c910 2024-08-18T22:11:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.565+0000 7fdb837fe640 1 -- 172.21.15.123:0/3038677682 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fdb98004b70 con 0x55fa66e9c910 2024-08-18T22:11:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.565+0000 7fdbac7eb740 1 -- 172.21.15.123:0/3038677682 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb940035f0 con 0x55fa66e9c910 2024-08-18T22:11:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.565+0000 7fdb837fe640 1 -- 172.21.15.123:0/3038677682 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdb98052050 con 0x55fa66e9c910 2024-08-18T22:11:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.565+0000 7fdbac7eb740 10 client.25328 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.565+0000 7fdbac7eb740 1 -- 172.21.15.123:0/3038677682 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fa66f20f20 con 0x55fa66e9c910 2024-08-18T22:11:07.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.566+0000 7fdb837fe640 1 -- 172.21.15.123:0/3038677682 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb940035f0 con 0x55fa66e9c910 2024-08-18T22:11:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.566+0000 7fdb837fe640 1 -- 172.21.15.123:0/3038677682 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdb980037b0 con 0x55fa66e9c910 2024-08-18T22:11:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.566+0000 7fdbac7eb740 10 client.25328 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.566+0000 7fdbac7eb740 10 client.25328 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-18T22:11:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.566+0000 7fdbac7eb740 20 client.25328 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.566+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/3038677682 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55fa66f21700 0x55fa66f23b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.566+0000 7fdbac7eb740 4 client.25328 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:11:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.566+0000 7fdbac7eb740 1 -- 172.21.15.123:0/3038677682 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fa66e094c0 con 0x55fa66f21700 2024-08-18T22:11:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.566+0000 7fdba3fff640 1 --2- 172.21.15.123:0/3038677682 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55fa66f21700 0x55fa66f23b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.566+0000 7feb0fbcd740 1 Processor -- start 2024-08-18T22:11:07.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.566+0000 7feb0fbcd740 1 -- start start 2024-08-18T22:11:07.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdba3fff640 1 --2- 172.21.15.123:0/3038677682 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55fa66f21700 0x55fa66f23b20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c02044f98ca2f22f server_cookie=b1e86b90dc3d0e98 in_seq=0 out_seq=0 2024-08-18T22:11:07.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdb837fe640 10 client.25328 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:11:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb0fbcd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5ecaff0 0x5564a5ed94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb0fbcd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecb910 0x5564a5ef2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb0fbcd740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5eda720 0x5564a5ef2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb0fbcd740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feae8012460 con 0x5564a5eda720 2024-08-18T22:11:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb0fbcd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feae800fd30 con 0x5564a5ecaff0 2024-08-18T22:11:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb0fbcd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7feae800db80 con 0x5564a5ecb910 2024-08-18T22:11:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdb837fe640 1 -- 172.21.15.123:0/3038677682 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fa66e094c0 con 0x55fa66f21700 2024-08-18T22:11:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdb837fe640 10 client.25328 handle_command_reply: tid=0 2024-08-18T22:11:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdbac7eb740 1 client.25328 shutdown 2024-08-18T22:11:07.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb077fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5eda720 0x5564a5ef2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb077fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5eda720 0x5564a5ef2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53450/0 (socket says 172.21.15.123:53450) 2024-08-18T22:11:07.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb077fe640 1 -- 172.21.15.123:0/167237467 learned_addr learned my addr 172.21.15.123:0/167237467 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:07.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb06ffd640 1 --2- 172.21.15.123:0/167237467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5ecaff0 0x5564a5ed94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb067fc640 1 --2- 172.21.15.123:0/167237467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecb910 0x5564a5ef2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdbac7eb740 1 -- 172.21.15.123:0/3038677682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66e9c910 msgr2=0x55fa66eb9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/3038677682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66e9c910 0x55fa66eb9c40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009930 tx=0x7fdb980044f0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdbac7eb740 1 -- 172.21.15.123:0/3038677682 shutdown_connections 2024-08-18T22:11:07.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/3038677682 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x55fa66f21700 0x55fa66f23b20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/3038677682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fa66ea71d0 0x55fa66f1f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/3038677682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa66e9c910 0x55fa66eb9c40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdbac7eb740 1 --2- 172.21.15.123:0/3038677682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa66e9bff0 0x55fa66eb9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdbac7eb740 1 -- 172.21.15.123:0/3038677682 >> 172.21.15.123:0/3038677682 conn(0x55fa66e98580 msgr2=0x55fa66eb2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:07.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdb837fe640 0 client.25328 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:11:07.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdbac7eb740 1 -- 172.21.15.123:0/3038677682 shutdown_connections 2024-08-18T22:11:07.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7fdbac7eb740 1 -- 172.21.15.123:0/3038677682 wait complete. 2024-08-18T22:11:07.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb077fe640 1 -- 172.21.15.123:0/167237467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecb910 msgr2=0x5564a5ef2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb077fe640 1 --2- 172.21.15.123:0/167237467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecb910 0x5564a5ef2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb077fe640 1 -- 172.21.15.123:0/167237467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5ecaff0 msgr2=0x5564a5ed94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb077fe640 1 --2- 172.21.15.123:0/167237467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5ecaff0 0x5564a5ed94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb077fe640 1 -- 172.21.15.123:0/167237467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564a5ecb740 con 0x5564a5eda720 2024-08-18T22:11:07.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.567+0000 7feb06ffd640 1 --2- 172.21.15.123:0/167237467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5ecaff0 0x5564a5ed94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:07.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.568+0000 7feb067fc640 1 --2- 172.21.15.123:0/167237467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecb910 0x5564a5ef2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:07.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.568+0000 7fdbac7eb740 20 client.25328 trim_cache size 0 max 16384 2024-08-18T22:11:07.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.568+0000 7feb077fe640 1 --2- 172.21.15.123:0/167237467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5eda720 0x5564a5ef2760 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7feaf8006010 tx=0x7feaf8032f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3876dbbd24ce3a7f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:07.584 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:11:07.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.568+0000 7feafcff9640 1 -- 172.21.15.123:0/167237467 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8035040 con 0x5564a5eda720 2024-08-18T22:11:07.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.568+0000 7feafcff9640 1 -- 172.21.15.123:0/167237467 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf8031870 con 0x5564a5eda720 2024-08-18T22:11:07.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.568+0000 7feafcff9640 1 -- 172.21.15.123:0/167237467 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf80046c0 con 0x5564a5eda720 2024-08-18T22:11:07.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.568+0000 7fdbaa3ed640 1 -- 172.21.15.123:0/2031846950 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdb8c0a2c00 msgr2=0x7fdb8c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.568+0000 7fdbaa3ed640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdb8c0a2c00 0x7fdb8c0a50c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdb94005fd0 tx=0x7fdb9400b690 comp rx=0 tx=0).stop 2024-08-18T22:11:07.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.568+0000 7fdbaa3ed640 1 -- 172.21.15.123:0/2031846950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdba4106830 msgr2=0x7fdba419caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.568+0000 7fdbaa3ed640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdba4106830 0x7fdba419caf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009fd0 tx=0x7fdb9c00ef10 comp rx=0 tx=0).stop 2024-08-18T22:11:07.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7fdbaa3ed640 1 -- 172.21.15.123:0/2031846950 shutdown_connections 2024-08-18T22:11:07.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7fdbaa3ed640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdb8c0a2c00 0x7fdb8c0a50c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7fdbaa3ed640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdba4106830 0x7fdba419caf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7fdbaa3ed640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdba4101830 0x7fdba4198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7fdbaa3ed640 1 --2- 172.21.15.123:0/2031846950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdba4100e90 0x7fdba4198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7fdbaa3ed640 1 -- 172.21.15.123:0/2031846950 >> 172.21.15.123:0/2031846950 conn(0x7fdba40fbc10 msgr2=0x7fdba40fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:07.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7fdbaa3ed640 1 -- 172.21.15.123:0/2031846950 shutdown_connections 2024-08-18T22:11:07.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7fdbaa3ed640 1 -- 172.21.15.123:0/2031846950 wait complete. 2024-08-18T22:11:07.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7feb0fbcd740 1 -- 172.21.15.123:0/167237467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5eda720 msgr2=0x5564a5ef2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/167237467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5eda720 0x5564a5ef2760 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7feaf8006010 tx=0x7feaf8032f00 comp rx=0 tx=0).stop 2024-08-18T22:11:07.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7feb0fbcd740 1 -- 172.21.15.123:0/167237467 shutdown_connections 2024-08-18T22:11:07.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/167237467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5eda720 0x5564a5ef2760 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/167237467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecb910 0x5564a5ef2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/167237467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5ecaff0 0x5564a5ed94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7feb0fbcd740 1 -- 172.21.15.123:0/167237467 >> 172.21.15.123:0/167237467 conn(0x5564a5ec76c0 msgr2=0x5564a5ed8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:07.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7feb0fbcd740 1 -- 172.21.15.123:0/167237467 shutdown_connections 2024-08-18T22:11:07.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.569+0000 7feb0fbcd740 1 -- 172.21.15.123:0/167237467 wait complete. 2024-08-18T22:11:07.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.570+0000 7feb0fbcd740 1 -- start start 2024-08-18T22:11:07.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.570+0000 7feb0fbcd740 1 Processor -- start 2024-08-18T22:11:07.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.570+0000 7feb0fbcd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecaff0 0x5564a5ee2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.570+0000 7feb0fbcd740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5ecb910 0x5564a5ee2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.570+0000 7feb0fbcd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5eda720 0x5564a5edd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.570+0000 7feb0fbcd740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feae800e1f0 con 0x5564a5ecb910 2024-08-18T22:11:07.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.570+0000 7feb0fbcd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feae800f660 con 0x5564a5eda720 2024-08-18T22:11:07.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.570+0000 7feb0fbcd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7feae800e8c0 con 0x5564a5ecaff0 2024-08-18T22:11:07.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.570+0000 7feb0fbcd740 10 client.0 _ll_register_callbacks cb 0x7feb000115e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:07.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.570+0000 7feb067fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5ecb910 0x5564a5ee2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.570+0000 7feb067fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5ecb910 0x5564a5ee2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53456/0 (socket says 172.21.15.123:53456) 2024-08-18T22:11:07.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.570+0000 7feb067fc640 1 -- 172.21.15.123:0/2867252186 learned_addr learned my addr 172.21.15.123:0/2867252186 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:07.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.571+0000 7feb06ffd640 1 --2- 172.21.15.123:0/2867252186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecaff0 0x5564a5ee2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.571+0000 7feb077fe640 1 --2- 172.21.15.123:0/2867252186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5eda720 0x5564a5edd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.571+0000 7feb067fc640 1 -- 172.21.15.123:0/2867252186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecaff0 msgr2=0x5564a5ee2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.571+0000 7feb067fc640 1 --2- 172.21.15.123:0/2867252186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecaff0 0x5564a5ee2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.571+0000 7feb067fc640 1 -- 172.21.15.123:0/2867252186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5eda720 msgr2=0x5564a5edd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:07.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.571+0000 7feb067fc640 1 --2- 172.21.15.123:0/2867252186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5eda720 0x5564a5edd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.571+0000 7feb067fc640 1 -- 172.21.15.123:0/2867252186 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564a5eddc60 con 0x5564a5ecb910 2024-08-18T22:11:07.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.571+0000 7feb067fc640 1 --2- 172.21.15.123:0/2867252186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5ecb910 0x5564a5ee2cb0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7feaf009ad60 tx=0x7feaf009a220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768a5a171019917c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:07.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.571+0000 7feaee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:07.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.571+0000 7feaee7fc640 1 -- 172.21.15.123:0/2867252186 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0020040 con 0x5564a5ecb910 2024-08-18T22:11:07.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.571+0000 7feaee7fc640 1 -- 172.21.15.123:0/2867252186 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7feaf009a490 con 0x5564a5ecb910 2024-08-18T22:11:07.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.571+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2867252186 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaf8031870 con 0x5564a5ecb910 2024-08-18T22:11:07.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.572+0000 7feaee7fc640 1 -- 172.21.15.123:0/2867252186 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feaf0009d20 con 0x5564a5ecb910 2024-08-18T22:11:07.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.572+0000 7feb0fbcd740 10 client.15882 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:07.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.572+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2867252186 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5564a5f55930 con 0x5564a5ecb910 2024-08-18T22:11:07.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.572+0000 7feaee7fc640 1 -- 172.21.15.123:0/2867252186 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf8031870 con 0x5564a5ecb910 2024-08-18T22:11:07.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.572+0000 7feaee7fc640 1 -- 172.21.15.123:0/2867252186 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7feaf00b0070 con 0x5564a5ecb910 2024-08-18T22:11:07.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.572+0000 7feb0fbcd740 10 client.15882 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:07.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.572+0000 7feb0fbcd740 10 client.15882 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:11:07.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.572+0000 7feb0fbcd740 20 client.15882 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:07.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.572+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2867252186 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5564a5f55c80 0x5564a5f58070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:07.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.572+0000 7feb0fbcd740 4 client.15882 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-08-18T22:11:07.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.572+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2867252186 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x5564a5e384f0 con 0x5564a5f55c80 2024-08-18T22:11:07.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.573+0000 7feb06ffd640 1 --2- 172.21.15.123:0/2867252186 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5564a5f55c80 0x5564a5f58070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:07.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.573+0000 7feaee7fc640 10 client.15882 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:07.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.573+0000 7feb06ffd640 1 --2- 172.21.15.123:0/2867252186 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5564a5f55c80 0x5564a5f58070 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec9885557055100a server_cookie=526e7389590e1d66 in_seq=0 out_seq=0 2024-08-18T22:11:07.593 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:11:07.593 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:11:07.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.652+0000 7feaee7fc640 1 -- 172.21.15.123:0/2867252186 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5564a5e384f0 con 0x5564a5f55c80 2024-08-18T22:11:07.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.652+0000 7feaee7fc640 10 client.15882 handle_command_reply: tid=0 2024-08-18T22:11:07.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.652+0000 7feb0fbcd740 1 client.15882 shutdown 2024-08-18T22:11:07.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.652+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2867252186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5ecb910 msgr2=0x5564a5ee2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.652+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2867252186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5ecb910 0x5564a5ee2cb0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7feaf009ad60 tx=0x7feaf009a220 comp rx=0 tx=0).stop 2024-08-18T22:11:07.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.652+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2867252186 shutdown_connections 2024-08-18T22:11:07.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.652+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2867252186 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5564a5f55c80 0x5564a5f58070 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.652+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2867252186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564a5eda720 0x5564a5edd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.652+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2867252186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564a5ecb910 0x5564a5ee2cb0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.652+0000 7feb0fbcd740 1 --2- 172.21.15.123:0/2867252186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564a5ecaff0 0x5564a5ee2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.652+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2867252186 >> 172.21.15.123:0/2867252186 conn(0x5564a5ec76c0 msgr2=0x5564a5ed95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:07.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.652+0000 7feaee7fc640 0 client.15882 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:07.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.653+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2867252186 shutdown_connections 2024-08-18T22:11:07.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.653+0000 7feb0fbcd740 1 -- 172.21.15.123:0/2867252186 wait complete. 2024-08-18T22:11:07.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.653+0000 7feb0fbcd740 20 client.15882 trim_cache size 0 max 16384 2024-08-18T22:11:07.655 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:11:07.655 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 26, 2024-08-18T22:11:07.656 INFO:teuthology.orchestra.run.smithi123.stdout: "leader": 24466, 2024-08-18T22:11:07.656 INFO:teuthology.orchestra.run.smithi123.stdout: "set_version": 6, 2024-08-18T22:11:07.656 INFO:teuthology.orchestra.run.smithi123.stdout: "sets": { 2024-08-18T22:11:07.656 INFO:teuthology.orchestra.run.smithi123.stdout: "6456b877": { 2024-08-18T22:11:07.656 INFO:teuthology.orchestra.run.smithi123.stdout: "version": 6, 2024-08-18T22:11:07.656 INFO:teuthology.orchestra.run.smithi123.stdout: "age_ref": 0.0, 2024-08-18T22:11:07.656 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:11:07.656 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "QUIESCED", 2024-08-18T22:11:07.656 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:11:07.656 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:11:07.656 INFO:teuthology.orchestra.run.smithi123.stdout: "timeout": 90.0, 2024-08-18T22:11:07.656 INFO:teuthology.orchestra.run.smithi123.stdout: "expiration": 130.0, 2024-08-18T22:11:07.656 INFO:teuthology.orchestra.run.smithi123.stdout: "members": { 2024-08-18T22:11:07.657 INFO:teuthology.orchestra.run.smithi123.stdout: "file:/": { 2024-08-18T22:11:07.657 INFO:teuthology.orchestra.run.smithi123.stdout: "excluded": false, 2024-08-18T22:11:07.657 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:11:07.657 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "QUIESCED", 2024-08-18T22:11:07.657 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:11:07.657 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:07.657 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:07.657 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:07.657 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:07.657 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:07.657 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:11:07.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.653+0000 7feb0d7cf640 1 -- 172.21.15.123:0/2110486328 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feaf40a2c00 msgr2=0x7feaf40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.653+0000 7feb0d7cf640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feaf40a2c00 0x7feaf40a50c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feb00005fd0 tx=0x7feb00009500 comp rx=0 tx=0).stop 2024-08-18T22:11:07.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.653+0000 7feb0d7cf640 1 -- 172.21.15.123:0/2110486328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb08103390 msgr2=0x7feb081986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:07.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.653+0000 7feb0d7cf640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb08103390 0x7feb081986d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7feaf000d750 tx=0x7feaf000dc10 comp rx=0 tx=0).stop 2024-08-18T22:11:07.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.654+0000 7feb0d7cf640 1 -- 172.21.15.123:0/2110486328 shutdown_connections 2024-08-18T22:11:07.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.654+0000 7feb0d7cf640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb0810bea0 0x7feb0819ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.654+0000 7feb0d7cf640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb08103390 0x7feb081986d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.654+0000 7feb0d7cf640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7feaf40a2c00 0x7feaf40a50c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.654+0000 7feb0d7cf640 1 --2- 172.21.15.123:0/2110486328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb08102a70 0x7feb08198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:07.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.654+0000 7feb0d7cf640 1 -- 172.21.15.123:0/2110486328 >> 172.21.15.123:0/2110486328 conn(0x7feb080fc4d0 msgr2=0x7feb080fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:07.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.654+0000 7feb0d7cf640 1 -- 172.21.15.123:0/2110486328 shutdown_connections 2024-08-18T22:11:07.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:07.654+0000 7feb0d7cf640 1 -- 172.21.15.123:0/2110486328 wait complete. 2024-08-18T22:11:09.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:09 smithi183 ceph-mon[22097]: pgmap v441: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.7 KiB/s wr, 8 op/s 2024-08-18T22:11:09.474 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:09 smithi123 ceph-mon[18462]: pgmap v441: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.7 KiB/s wr, 8 op/s 2024-08-18T22:11:09.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:09 smithi130 ceph-mon[21698]: pgmap v441: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.7 KiB/s wr, 8 op/s 2024-08-18T22:11:10.042 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-18T22:11:11.163 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6456b877', quiesce took 59.8 seconds. Will release after: -49.8 2024-08-18T22:11:11.164 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:11:11.370 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:11 smithi123 ceph-mon[18462]: pgmap v442: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-08-18T22:11:11.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:11 smithi183 ceph-mon[22097]: pgmap v442: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-08-18T22:11:11.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:11 smithi130 ceph-mon[21698]: pgmap v442: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-08-18T22:11:12.131 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:11:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:11:13.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:13 smithi123 ceph-mon[18462]: pgmap v443: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.2 KiB/s wr, 12 op/s 2024-08-18T22:11:13.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:13 smithi183 ceph-mon[22097]: pgmap v443: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.2 KiB/s wr, 12 op/s 2024-08-18T22:11:13.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:13 smithi130 ceph-mon[21698]: pgmap v443: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.2 KiB/s wr, 12 op/s 2024-08-18T22:11:14.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.321+0000 7f220b4ba640 1 -- 172.21.15.123:0/3996842183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2204103410 msgr2=0x7f22041078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:14.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.321+0000 7f220b4ba640 1 --2- 172.21.15.123:0/3996842183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2204103410 0x7f22041078c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f21f4009930 tx=0x7f21f402a420 comp rx=0 tx=0).stop 2024-08-18T22:11:14.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.321+0000 7f220b4ba640 1 -- 172.21.15.123:0/3996842183 shutdown_connections 2024-08-18T22:11:14.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.321+0000 7f220b4ba640 1 --2- 172.21.15.123:0/3996842183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2204107fd0 0x7f220410e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.321+0000 7f220b4ba640 1 --2- 172.21.15.123:0/3996842183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2204103410 0x7f22041078c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.321+0000 7f220b4ba640 1 --2- 172.21.15.123:0/3996842183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2204102a60 0x7f2204102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.321+0000 7f220b4ba640 1 -- 172.21.15.123:0/3996842183 >> 172.21.15.123:0/3996842183 conn(0x7f22040fc500 msgr2=0x7f22040fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:14.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.322+0000 7f220b4ba640 1 -- 172.21.15.123:0/3996842183 shutdown_connections 2024-08-18T22:11:14.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.322+0000 7f220b4ba640 1 -- 172.21.15.123:0/3996842183 wait complete. 2024-08-18T22:11:14.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.322+0000 7f220b4ba640 1 Processor -- start 2024-08-18T22:11:14.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.322+0000 7f220b4ba640 1 -- start start 2024-08-18T22:11:14.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f220b4ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2204102a60 0x7f22041983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f220b4ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2204103410 0x7f2204198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f220b4ba640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2204107fd0 0x7f220419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f220b4ba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2204111e10 con 0x7f2204103410 2024-08-18T22:11:14.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f220b4ba640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2204111c90 con 0x7f2204107fd0 2024-08-18T22:11:14.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f220b4ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2204111f90 con 0x7f2204102a60 2024-08-18T22:11:14.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f2208a55640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2204103410 0x7f2204198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f2208a55640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2204103410 0x7f2204198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39666/0 (socket says 172.21.15.123:39666) 2024-08-18T22:11:14.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f2208a55640 1 -- 172.21.15.123:0/293682158 learned_addr learned my addr 172.21.15.123:0/293682158 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:14.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f2209a57640 1 --2- 172.21.15.123:0/293682158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2204107fd0 0x7f220419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f2209256640 1 --2- 172.21.15.123:0/293682158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2204102a60 0x7f22041983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f2208a55640 1 -- 172.21.15.123:0/293682158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2204102a60 msgr2=0x7f22041983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f2208a55640 1 --2- 172.21.15.123:0/293682158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2204102a60 0x7f22041983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f2208a55640 1 -- 172.21.15.123:0/293682158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2204107fd0 msgr2=0x7f220419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f2208a55640 1 --2- 172.21.15.123:0/293682158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2204107fd0 0x7f220419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.323+0000 7f2208a55640 1 -- 172.21.15.123:0/293682158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220419d3a0 con 0x7f2204103410 2024-08-18T22:11:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.324+0000 7f2208a55640 1 --2- 172.21.15.123:0/293682158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2204103410 0x7f2204198930 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f21f4005940 tx=0x7f21f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.324+0000 7f21fa7fc640 1 -- 172.21.15.123:0/293682158 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f403f030 con 0x7f2204103410 2024-08-18T22:11:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.324+0000 7f21fa7fc640 1 -- 172.21.15.123:0/293682158 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21f4003ce0 con 0x7f2204103410 2024-08-18T22:11:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.324+0000 7f220b4ba640 1 -- 172.21.15.123:0/293682158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f220419d630 con 0x7f2204103410 2024-08-18T22:11:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.324+0000 7f21fa7fc640 1 -- 172.21.15.123:0/293682158 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f4035070 con 0x7f2204103410 2024-08-18T22:11:14.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.324+0000 7f220b4ba640 1 -- 172.21.15.123:0/293682158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22041005f0 con 0x7f2204103410 2024-08-18T22:11:14.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.324+0000 7f53199f5640 1 -- 172.21.15.123:0/2869652335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5314102c20 msgr2=0x7f531410d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:14.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.324+0000 7f53199f5640 1 --2- 172.21.15.123:0/2869652335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5314102c20 0x7f531410d770 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f530c009ca0 tx=0x7f530c02a970 comp rx=0 tx=0).stop 2024-08-18T22:11:14.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.324+0000 7f53199f5640 1 -- 172.21.15.123:0/2869652335 shutdown_connections 2024-08-18T22:11:14.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.324+0000 7f53199f5640 1 --2- 172.21.15.123:0/2869652335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5314102c20 0x7f531410d770 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.324+0000 7f53199f5640 1 --2- 172.21.15.123:0/2869652335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53141022a0 0x7f53141026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.324+0000 7f53199f5640 1 --2- 172.21.15.123:0/2869652335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5314100b50 0x7f5314100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.324+0000 7f53199f5640 1 -- 172.21.15.123:0/2869652335 >> 172.21.15.123:0/2869652335 conn(0x7f53140fc500 msgr2=0x7f53140fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:14.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.325+0000 7f53199f5640 1 -- 172.21.15.123:0/2869652335 shutdown_connections 2024-08-18T22:11:14.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.325+0000 7f53199f5640 1 -- 172.21.15.123:0/2869652335 wait complete. 2024-08-18T22:11:14.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.325+0000 7f220b4ba640 1 -- 172.21.15.123:0/293682158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f220406a580 con 0x7f2204103410 2024-08-18T22:11:14.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.325+0000 7f53199f5640 1 Processor -- start 2024-08-18T22:11:14.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53199f5640 1 -- start start 2024-08-18T22:11:14.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53199f5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5314100b50 0x7f531419b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53199f5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53141022a0 0x7f531419b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53199f5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5314102c20 0x7f53141a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53199f5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f531406abe0 con 0x7f53141022a0 2024-08-18T22:11:14.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53199f5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f531406aa60 con 0x7f5314102c20 2024-08-18T22:11:14.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53199f5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f531410fdb0 con 0x7f5314100b50 2024-08-18T22:11:14.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53127fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53141022a0 0x7f531419b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53127fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53141022a0 0x7f531419b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39670/0 (socket says 172.21.15.123:39670) 2024-08-18T22:11:14.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53127fc640 1 -- 172.21.15.123:0/4098662509 learned_addr learned my addr 172.21.15.123:0/4098662509 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:14.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53137fe640 1 --2- 172.21.15.123:0/4098662509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5314102c20 0x7f53141a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f5312ffd640 1 --2- 172.21.15.123:0/4098662509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5314100b50 0x7f531419b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53127fc640 1 -- 172.21.15.123:0/4098662509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5314100b50 msgr2=0x7f531419b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:14.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53127fc640 1 --2- 172.21.15.123:0/4098662509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5314100b50 0x7f531419b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53127fc640 1 -- 172.21.15.123:0/4098662509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5314102c20 msgr2=0x7f53141a6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:14.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53127fc640 1 --2- 172.21.15.123:0/4098662509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5314102c20 0x7f53141a6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.326+0000 7f53127fc640 1 -- 172.21.15.123:0/4098662509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53141a6720 con 0x7f53141022a0 2024-08-18T22:11:14.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.327+0000 7f53127fc640 1 --2- 172.21.15.123:0/4098662509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53141022a0 0x7f531419b7f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f530800b450 tx=0x7f530800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:14.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.327+0000 7f21fa7fc640 1 -- 172.21.15.123:0/293682158 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f21f4042030 con 0x7f2204103410 2024-08-18T22:11:14.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.328+0000 7f21fa7fc640 1 --2- 172.21.15.123:0/293682158 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f21f00a2b80 0x7f21f00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.328+0000 7f2209256640 1 --2- 172.21.15.123:0/293682158 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f21f00a2b80 0x7f21f00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.328+0000 7f21fa7fc640 1 -- 172.21.15.123:0/293682158 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f21f40efaf0 con 0x7f2204103410 2024-08-18T22:11:14.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.328+0000 7f2209256640 1 --2- 172.21.15.123:0/293682158 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f21f00a2b80 0x7f21f00a5040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2200009990 tx=0x7f2200009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:14.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.331+0000 7f53189f3640 1 -- 172.21.15.123:0/4098662509 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308015020 con 0x7f53141022a0 2024-08-18T22:11:14.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.331+0000 7f53189f3640 1 -- 172.21.15.123:0/4098662509 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5308011d70 con 0x7f53141022a0 2024-08-18T22:11:14.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.331+0000 7f53189f3640 1 -- 172.21.15.123:0/4098662509 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530800f340 con 0x7f53141022a0 2024-08-18T22:11:14.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.331+0000 7f53199f5640 1 -- 172.21.15.123:0/4098662509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53141a6a10 con 0x7f53141022a0 2024-08-18T22:11:14.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.331+0000 7f21fa7fc640 1 -- 172.21.15.123:0/293682158 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f21f40bc6c0 con 0x7f2204103410 2024-08-18T22:11:14.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.331+0000 7f53199f5640 1 -- 172.21.15.123:0/4098662509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53141a6ea0 con 0x7f53141022a0 2024-08-18T22:11:14.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.333+0000 7f53189f3640 1 -- 172.21.15.123:0/4098662509 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f5308018020 con 0x7f53141022a0 2024-08-18T22:11:14.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.334+0000 7f53189f3640 1 --2- 172.21.15.123:0/4098662509 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f52fc0a2cd0 0x7f52fc0a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.334+0000 7f5312ffd640 1 --2- 172.21.15.123:0/4098662509 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f52fc0a2cd0 0x7f52fc0a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.334+0000 7f53189f3640 1 -- 172.21.15.123:0/4098662509 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f53080cee00 con 0x7f53141022a0 2024-08-18T22:11:14.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.335+0000 7f531bdf3740 1 Processor -- start 2024-08-18T22:11:14.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.335+0000 7f531bdf3740 1 -- start start 2024-08-18T22:11:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.335+0000 7f5312ffd640 1 --2- 172.21.15.123:0/4098662509 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f52fc0a2cd0 0x7f52fc0a5190 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f530400bbe0 tx=0x7f530400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.335+0000 7f531bdf3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63eff0 0x55892e63f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.335+0000 7f531bdf3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e63f910 0x55892e649c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.335+0000 7f531bdf3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e64a1d0 0x55892e64c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.335+0000 7f531bdf3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55892e5a4a40 con 0x55892e63eff0 2024-08-18T22:11:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.335+0000 7f531bdf3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55892e53c9d0 con 0x55892e64a1d0 2024-08-18T22:11:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.335+0000 7f531bdf3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55892e5a0a00 con 0x55892e63f910 2024-08-18T22:11:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.335+0000 7f5312ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63eff0 0x55892e63f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.335+0000 7f5312ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63eff0 0x55892e63f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39684/0 (socket says 172.21.15.123:39684) 2024-08-18T22:11:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.335+0000 7f5312ffd640 1 -- 172.21.15.123:0/4224600599 learned_addr learned my addr 172.21.15.123:0/4224600599 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.335+0000 7f53127fc640 1 --2- 172.21.15.123:0/4224600599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e63f910 0x55892e649c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.335+0000 7f53137fe640 1 --2- 172.21.15.123:0/4224600599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e64a1d0 0x55892e64c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.336+0000 7f5312ffd640 1 -- 172.21.15.123:0/4224600599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e63f910 msgr2=0x55892e649c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.336+0000 7f5312ffd640 1 --2- 172.21.15.123:0/4224600599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e63f910 0x55892e649c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.336+0000 7f5312ffd640 1 -- 172.21.15.123:0/4224600599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e64a1d0 msgr2=0x55892e64c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.336+0000 7f5312ffd640 1 --2- 172.21.15.123:0/4224600599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e64a1d0 0x55892e64c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.336+0000 7f5312ffd640 1 -- 172.21.15.123:0/4224600599 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55892e543650 con 0x55892e63eff0 2024-08-18T22:11:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.336+0000 7f53137fe640 1 --2- 172.21.15.123:0/4224600599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e64a1d0 0x55892e64c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.336+0000 7f5312ffd640 1 --2- 172.21.15.123:0/4224600599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63eff0 0x55892e63f3d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5304005d00 tx=0x7f5304013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a27b7bfe29e2a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.336+0000 7f52f9ffb640 1 -- 172.21.15.123:0/4224600599 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304005220 con 0x55892e63eff0 2024-08-18T22:11:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.336+0000 7f52f9ffb640 1 -- 172.21.15.123:0/4224600599 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5304004c80 con 0x55892e63eff0 2024-08-18T22:11:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.336+0000 7f52f9ffb640 1 -- 172.21.15.123:0/4224600599 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530401ea60 con 0x55892e63eff0 2024-08-18T22:11:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.337+0000 7f531bdf3740 1 -- 172.21.15.123:0/4224600599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63eff0 msgr2=0x55892e63f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.337+0000 7f531bdf3740 1 --2- 172.21.15.123:0/4224600599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63eff0 0x55892e63f3d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5304005d00 tx=0x7f5304013000 comp rx=0 tx=0).stop 2024-08-18T22:11:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.337+0000 7f531bdf3740 1 -- 172.21.15.123:0/4224600599 shutdown_connections 2024-08-18T22:11:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.337+0000 7f531bdf3740 1 --2- 172.21.15.123:0/4224600599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e64a1d0 0x55892e64c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.337+0000 7f531bdf3740 1 --2- 172.21.15.123:0/4224600599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e63f910 0x55892e649c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.337+0000 7f531bdf3740 1 --2- 172.21.15.123:0/4224600599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63eff0 0x55892e63f3d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.337+0000 7f531bdf3740 1 -- 172.21.15.123:0/4224600599 >> 172.21.15.123:0/4224600599 conn(0x55892e63b580 msgr2=0x55892e63b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.337+0000 7f531bdf3740 1 -- 172.21.15.123:0/4224600599 shutdown_connections 2024-08-18T22:11:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.337+0000 7f531bdf3740 1 -- 172.21.15.123:0/4224600599 wait complete. 2024-08-18T22:11:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.338+0000 7f531bdf3740 1 -- start start 2024-08-18T22:11:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.338+0000 7f531bdf3740 1 Processor -- start 2024-08-18T22:11:14.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.338+0000 7f531bdf3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63eff0 0x55892e6470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.338+0000 7f531bdf3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63f910 0x55892e6475f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.338+0000 7f531bdf3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e64a1d0 0x55892e647b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.338+0000 7f531bdf3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55892e64cda0 con 0x55892e63eff0 2024-08-18T22:11:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.338+0000 7f531bdf3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55892e55fb20 con 0x55892e63f910 2024-08-18T22:11:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.338+0000 7f531bdf3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55892e64cf20 con 0x55892e64a1d0 2024-08-18T22:11:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.338+0000 7f5312ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63eff0 0x55892e6470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.338+0000 7f531bdf3740 10 client.0 _ll_register_callbacks cb 0x55892e55dbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.338+0000 7f5312ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63eff0 0x55892e6470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39686/0 (socket says 172.21.15.123:39686) 2024-08-18T22:11:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.339+0000 7f5312ffd640 1 -- 172.21.15.123:0/3094667438 learned_addr learned my addr 172.21.15.123:0/3094667438 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.339+0000 7f53127fc640 1 --2- 172.21.15.123:0/3094667438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63f910 0x55892e6475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.339+0000 7f53137fe640 1 --2- 172.21.15.123:0/3094667438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e64a1d0 0x55892e647b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.339+0000 7f5312ffd640 1 -- 172.21.15.123:0/3094667438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e64a1d0 msgr2=0x55892e647b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.339+0000 7f5312ffd640 1 --2- 172.21.15.123:0/3094667438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e64a1d0 0x55892e647b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.339+0000 7f5312ffd640 1 -- 172.21.15.123:0/3094667438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63f910 msgr2=0x55892e6475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.339+0000 7f5312ffd640 1 --2- 172.21.15.123:0/3094667438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63f910 0x55892e6475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.339+0000 7f5312ffd640 1 -- 172.21.15.123:0/3094667438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55892e3163c0 con 0x55892e63eff0 2024-08-18T22:11:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.339+0000 7f53127fc640 1 --2- 172.21.15.123:0/3094667438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63f910 0x55892e6475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.339+0000 7f5312ffd640 1 --2- 172.21.15.123:0/3094667438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63eff0 0x55892e6470b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5304011f50 tx=0x7f53040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9dafa84c7824bdf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.339+0000 7f52f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.339+0000 7f52f2ffd640 1 -- 172.21.15.123:0/3094667438 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304036060 con 0x55892e63eff0 2024-08-18T22:11:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.339+0000 7f531bdf3740 1 -- 172.21.15.123:0/3094667438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5304004c80 con 0x55892e63eff0 2024-08-18T22:11:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.339+0000 7f52f2ffd640 1 -- 172.21.15.123:0/3094667438 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f5304005410 con 0x55892e63eff0 2024-08-18T22:11:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.340+0000 7f52f2ffd640 1 -- 172.21.15.123:0/3094667438 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f530403d050 con 0x55892e63eff0 2024-08-18T22:11:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.340+0000 7f531bdf3740 10 client.15900 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.340+0000 7f531bdf3740 1 -- 172.21.15.123:0/3094667438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55892e661260 con 0x55892e63eff0 2024-08-18T22:11:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.340+0000 7f52f2ffd640 1 -- 172.21.15.123:0/3094667438 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5304004c80 con 0x55892e63eff0 2024-08-18T22:11:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.340+0000 7f52f2ffd640 1 -- 172.21.15.123:0/3094667438 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5304031400 con 0x55892e63eff0 2024-08-18T22:11:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.340+0000 7f531bdf3740 10 client.15900 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.340+0000 7f531bdf3740 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.340+0000 7f531bdf3740 20 client.15900 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.340+0000 7f531bdf3740 1 --2- 172.21.15.123:0/3094667438 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55892e662a50 0x55892e664ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.341+0000 7f531bdf3740 4 client.15900 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.341+0000 7f531bdf3740 1 -- 172.21.15.123:0/3094667438 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55892e5b1fb0 con 0x55892e662a50 2024-08-18T22:11:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.341+0000 7f53127fc640 1 --2- 172.21.15.123:0/3094667438 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55892e662a50 0x55892e664ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.341+0000 7f52f2ffd640 10 client.15900 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.341+0000 7f53127fc640 1 --2- 172.21.15.123:0/3094667438 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55892e662a50 0x55892e664ec0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c61eea3396cb6919 server_cookie=a84d972a5acae9f7 in_seq=0 out_seq=0 2024-08-18T22:11:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.342+0000 7f52f2ffd640 1 -- 172.21.15.123:0/3094667438 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55892e5b1fb0 con 0x55892e662a50 2024-08-18T22:11:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.342+0000 7f52f2ffd640 10 client.15900 handle_command_reply: tid=0 2024-08-18T22:11:14.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.342+0000 7f531bdf3740 1 client.15900 shutdown 2024-08-18T22:11:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.342+0000 7f531bdf3740 1 -- 172.21.15.123:0/3094667438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63eff0 msgr2=0x55892e6470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.342+0000 7f531bdf3740 1 --2- 172.21.15.123:0/3094667438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63eff0 0x55892e6470b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5304011f50 tx=0x7f53040048f0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.343+0000 7f531bdf3740 1 -- 172.21.15.123:0/3094667438 shutdown_connections 2024-08-18T22:11:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.343+0000 7f531bdf3740 1 --2- 172.21.15.123:0/3094667438 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55892e662a50 0x55892e664ec0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.343+0000 7f531bdf3740 1 --2- 172.21.15.123:0/3094667438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e64a1d0 0x55892e647b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.343+0000 7f531bdf3740 1 --2- 172.21.15.123:0/3094667438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63f910 0x55892e6475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.343+0000 7f531bdf3740 1 --2- 172.21.15.123:0/3094667438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63eff0 0x55892e6470b0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.343+0000 7f531bdf3740 1 -- 172.21.15.123:0/3094667438 >> 172.21.15.123:0/3094667438 conn(0x55892e63b580 msgr2=0x55892e641260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.343+0000 7f52f2ffd640 0 client.15900 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.343+0000 7f531bdf3740 1 -- 172.21.15.123:0/3094667438 shutdown_connections 2024-08-18T22:11:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.343+0000 7f531bdf3740 1 -- 172.21.15.123:0/3094667438 wait complete. 2024-08-18T22:11:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.343+0000 7f531bdf3740 20 client.15900 trim_cache size 0 max 16384 2024-08-18T22:11:14.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.356+0000 7f531bdf3740 1 Processor -- start 2024-08-18T22:11:14.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.356+0000 7f531bdf3740 1 -- start start 2024-08-18T22:11:14.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.356+0000 7f531bdf3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63eff0 0x55892e646090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.356+0000 7f531bdf3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e63f910 0x55892e66a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.356+0000 7f531bdf3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e64a1d0 0x55892e66ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.356+0000 7f531bdf3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f53141af160 con 0x55892e64a1d0 2024-08-18T22:11:14.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.356+0000 7f531bdf3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f53141aca30 con 0x55892e63eff0 2024-08-18T22:11:14.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.356+0000 7f531bdf3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f53141aa8a0 con 0x55892e63f910 2024-08-18T22:11:14.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.356+0000 7f53137fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e64a1d0 0x55892e66ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.356+0000 7f53137fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e64a1d0 0x55892e66ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39690/0 (socket says 172.21.15.123:39690) 2024-08-18T22:11:14.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.356+0000 7f53137fe640 1 -- 172.21.15.123:0/664972709 learned_addr learned my addr 172.21.15.123:0/664972709 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:14.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.357+0000 7f5312ffd640 1 --2- 172.21.15.123:0/664972709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63eff0 0x55892e646090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.357+0000 7f53137fe640 1 -- 172.21.15.123:0/664972709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e63f910 msgr2=0x55892e66a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:14.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.357+0000 7f53137fe640 1 --2- 172.21.15.123:0/664972709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e63f910 0x55892e66a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.357+0000 7f53137fe640 1 -- 172.21.15.123:0/664972709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63eff0 msgr2=0x55892e646090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:14.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.357+0000 7f53137fe640 1 --2- 172.21.15.123:0/664972709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63eff0 0x55892e646090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.357+0000 7f53137fe640 1 -- 172.21.15.123:0/664972709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55892e63f740 con 0x55892e64a1d0 2024-08-18T22:11:14.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.357+0000 7f53137fe640 1 --2- 172.21.15.123:0/664972709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e64a1d0 0x55892e66ad10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f530c02b160 tx=0x7f530c009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b117ef5c72eb21 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:14.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.357+0000 7f52f97fa640 1 -- 172.21.15.123:0/664972709 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c049070 con 0x55892e64a1d0 2024-08-18T22:11:14.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.357+0000 7f52f97fa640 1 -- 172.21.15.123:0/664972709 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f530c003e50 con 0x55892e64a1d0 2024-08-18T22:11:14.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.357+0000 7f52f97fa640 1 -- 172.21.15.123:0/664972709 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c034050 con 0x55892e64a1d0 2024-08-18T22:11:14.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.358+0000 7f531bdf3740 1 -- 172.21.15.123:0/664972709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e64a1d0 msgr2=0x55892e66ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:14.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.358+0000 7f531bdf3740 1 --2- 172.21.15.123:0/664972709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e64a1d0 0x55892e66ad10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f530c02b160 tx=0x7f530c009890 comp rx=0 tx=0).stop 2024-08-18T22:11:14.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.358+0000 7f531bdf3740 1 -- 172.21.15.123:0/664972709 shutdown_connections 2024-08-18T22:11:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.358+0000 7f531bdf3740 1 --2- 172.21.15.123:0/664972709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e64a1d0 0x55892e66ad10 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.358+0000 7f531bdf3740 1 --2- 172.21.15.123:0/664972709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e63f910 0x55892e66a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.358+0000 7f531bdf3740 1 --2- 172.21.15.123:0/664972709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63eff0 0x55892e646090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.358+0000 7f531bdf3740 1 -- 172.21.15.123:0/664972709 >> 172.21.15.123:0/664972709 conn(0x55892e63b580 msgr2=0x55892e645980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.358+0000 7f531bdf3740 1 -- 172.21.15.123:0/664972709 shutdown_connections 2024-08-18T22:11:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.358+0000 7f531bdf3740 1 -- 172.21.15.123:0/664972709 wait complete. 2024-08-18T22:11:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.358+0000 7f531bdf3740 1 -- start start 2024-08-18T22:11:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.359+0000 7f531bdf3740 1 Processor -- start 2024-08-18T22:11:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.359+0000 7f531bdf3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63eff0 0x55892e65aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.359+0000 7f531bdf3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63f910 0x55892e6559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.359+0000 7f531bdf3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e64a1d0 0x55892e655f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.359+0000 7f531bdf3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f53141aaef0 con 0x55892e63f910 2024-08-18T22:11:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.359+0000 7f531bdf3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f53141ac360 con 0x55892e63eff0 2024-08-18T22:11:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.359+0000 7f531bdf3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f53141ab5c0 con 0x55892e64a1d0 2024-08-18T22:11:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.359+0000 7f531bdf3740 10 client.0 _ll_register_callbacks cb 0x7f53080092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.359+0000 7f53127fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63f910 0x55892e6559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.359+0000 7f53127fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63f910 0x55892e6559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39696/0 (socket says 172.21.15.123:39696) 2024-08-18T22:11:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.359+0000 7f53127fc640 1 -- 172.21.15.123:0/1124504965 learned_addr learned my addr 172.21.15.123:0/1124504965 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.359+0000 7f5312ffd640 1 --2- 172.21.15.123:0/1124504965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63eff0 0x55892e65aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.359+0000 7f53137fe640 1 --2- 172.21.15.123:0/1124504965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e64a1d0 0x55892e655f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.360+0000 7f53127fc640 1 -- 172.21.15.123:0/1124504965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e64a1d0 msgr2=0x55892e655f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.360+0000 7f53127fc640 1 --2- 172.21.15.123:0/1124504965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e64a1d0 0x55892e655f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.360+0000 7f53127fc640 1 -- 172.21.15.123:0/1124504965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63eff0 msgr2=0x55892e65aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.360+0000 7f53127fc640 1 --2- 172.21.15.123:0/1124504965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63eff0 0x55892e65aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.360+0000 7f53127fc640 1 -- 172.21.15.123:0/1124504965 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55892e6564c0 con 0x55892e63f910 2024-08-18T22:11:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.360+0000 7f53127fc640 1 --2- 172.21.15.123:0/1124504965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63f910 0x55892e6559c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5308009fd0 tx=0x7f53080bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd5f100062d1564 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.360+0000 7f52f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.360+0000 7f52f2ffd640 1 -- 172.21.15.123:0/1124504965 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530809f620 con 0x55892e63f910 2024-08-18T22:11:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.360+0000 7f52f2ffd640 1 -- 172.21.15.123:0/1124504965 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f5308099570 con 0x55892e63f910 2024-08-18T22:11:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.360+0000 7f531bdf3740 1 -- 172.21.15.123:0/1124504965 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f530c003e50 con 0x55892e63f910 2024-08-18T22:11:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.360+0000 7f52f2ffd640 1 -- 172.21.15.123:0/1124504965 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f53080a3ee0 con 0x55892e63f910 2024-08-18T22:11:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.360+0000 7f531bdf3740 10 client.15906 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.360+0000 7f531bdf3740 1 -- 172.21.15.123:0/1124504965 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55892e6cc5c0 con 0x55892e63f910 2024-08-18T22:11:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.360+0000 7f52f2ffd640 1 -- 172.21.15.123:0/1124504965 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f530c003e50 con 0x55892e63f910 2024-08-18T22:11:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.361+0000 7f52f2ffd640 1 -- 172.21.15.123:0/1124504965 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f530809f120 con 0x55892e63f910 2024-08-18T22:11:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.361+0000 7f531bdf3740 10 client.15906 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.361+0000 7f531bdf3740 10 client.15906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.361+0000 7f531bdf3740 20 client.15906 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.361+0000 7f531bdf3740 1 --2- 172.21.15.123:0/1124504965 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55892e6ccd70 0x55892e6cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:14.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.361+0000 7f531bdf3740 4 client.15906 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:11:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.361+0000 7f531bdf3740 1 -- 172.21.15.123:0/1124504965 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55892e5ac4c0 con 0x55892e6ccd70 2024-08-18T22:11:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.361+0000 7f5312ffd640 1 --2- 172.21.15.123:0/1124504965 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55892e6ccd70 0x55892e6cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f52f2ffd640 10 client.15906 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f5312ffd640 1 --2- 172.21.15.123:0/1124504965 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55892e6ccd70 0x55892e6cf190 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da805207d3153eee server_cookie=9c65c1904779513d in_seq=0 out_seq=0 2024-08-18T22:11:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f52f2ffd640 1 -- 172.21.15.123:0/1124504965 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55892e5ac4c0 con 0x55892e6ccd70 2024-08-18T22:11:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f52f2ffd640 10 client.15906 handle_command_reply: tid=0 2024-08-18T22:11:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f531bdf3740 1 client.15906 shutdown 2024-08-18T22:11:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f531bdf3740 1 -- 172.21.15.123:0/1124504965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63f910 msgr2=0x55892e6559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f531bdf3740 1 --2- 172.21.15.123:0/1124504965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63f910 0x55892e6559c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5308009fd0 tx=0x7f53080bb040 comp rx=0 tx=0).stop 2024-08-18T22:11:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f531bdf3740 1 -- 172.21.15.123:0/1124504965 shutdown_connections 2024-08-18T22:11:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f531bdf3740 1 --2- 172.21.15.123:0/1124504965 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55892e6ccd70 0x55892e6cf190 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f531bdf3740 1 --2- 172.21.15.123:0/1124504965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55892e64a1d0 0x55892e655f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f531bdf3740 1 --2- 172.21.15.123:0/1124504965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55892e63f910 0x55892e6559c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f531bdf3740 1 --2- 172.21.15.123:0/1124504965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55892e63eff0 0x55892e65aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f52f2ffd640 0 client.15906 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:14.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f531bdf3740 1 -- 172.21.15.123:0/1124504965 >> 172.21.15.123:0/1124504965 conn(0x55892e63b580 msgr2=0x55892e6461a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:14.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f531bdf3740 1 -- 172.21.15.123:0/1124504965 shutdown_connections 2024-08-18T22:11:14.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f531bdf3740 1 -- 172.21.15.123:0/1124504965 wait complete. 2024-08-18T22:11:14.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.362+0000 7f531bdf3740 20 client.15906 trim_cache size 0 max 16384 2024-08-18T22:11:14.368 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:11:14.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.363+0000 7f53199f5640 1 -- 172.21.15.123:0/4098662509 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f52fc0a2cd0 msgr2=0x7f52fc0a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:14.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.363+0000 7f53199f5640 1 --2- 172.21.15.123:0/4098662509 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f52fc0a2cd0 0x7f52fc0a5190 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f530400bbe0 tx=0x7f530400b390 comp rx=0 tx=0).stop 2024-08-18T22:11:14.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.363+0000 7f53199f5640 1 -- 172.21.15.123:0/4098662509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53141022a0 msgr2=0x7f531419b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:14.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.363+0000 7f53199f5640 1 --2- 172.21.15.123:0/4098662509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53141022a0 0x7f531419b7f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f530800b450 tx=0x7f530800b910 comp rx=0 tx=0).stop 2024-08-18T22:11:14.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.363+0000 7f53199f5640 1 -- 172.21.15.123:0/4098662509 shutdown_connections 2024-08-18T22:11:14.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.363+0000 7f53199f5640 1 --2- 172.21.15.123:0/4098662509 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f52fc0a2cd0 0x7f52fc0a5190 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.363+0000 7f53199f5640 1 --2- 172.21.15.123:0/4098662509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5314102c20 0x7f53141a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.363+0000 7f53199f5640 1 --2- 172.21.15.123:0/4098662509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53141022a0 0x7f531419b7f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.363+0000 7f53199f5640 1 --2- 172.21.15.123:0/4098662509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5314100b50 0x7f531419b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.363+0000 7f53199f5640 1 -- 172.21.15.123:0/4098662509 >> 172.21.15.123:0/4098662509 conn(0x7f53140fc500 msgr2=0x7f53141058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:14.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.363+0000 7f53199f5640 1 -- 172.21.15.123:0/4098662509 shutdown_connections 2024-08-18T22:11:14.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.363+0000 7f53199f5640 1 -- 172.21.15.123:0/4098662509 wait complete. 2024-08-18T22:11:14.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.553+0000 7f220b4ba640 1 -- 172.21.15.123:0/293682158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2204199750 con 0x7f2204103410 2024-08-18T22:11:14.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.554+0000 7f21fa7fc640 1 -- 172.21.15.123:0/293682158 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7f21f40bbfc0 con 0x7f2204103410 2024-08-18T22:11:14.555 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:11:14.555 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"btime":"2024-08-18T22:07:46:492460+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:07:45.601053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:11:14.555 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 26 2024-08-18T22:11:14.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.556+0000 7f220b4ba640 1 -- 172.21.15.123:0/293682158 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f21f00a2b80 msgr2=0x7f21f00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:14.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.556+0000 7f220b4ba640 1 --2- 172.21.15.123:0/293682158 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f21f00a2b80 0x7f21f00a5040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2200009990 tx=0x7f2200009110 comp rx=0 tx=0).stop 2024-08-18T22:11:14.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.556+0000 7f220b4ba640 1 -- 172.21.15.123:0/293682158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2204103410 msgr2=0x7f2204198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:14.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.556+0000 7f220b4ba640 1 --2- 172.21.15.123:0/293682158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2204103410 0x7f2204198930 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f21f4005940 tx=0x7f21f40042f0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.556+0000 7f220b4ba640 1 -- 172.21.15.123:0/293682158 shutdown_connections 2024-08-18T22:11:14.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.556+0000 7f220b4ba640 1 --2- 172.21.15.123:0/293682158 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f21f00a2b80 0x7f21f00a5040 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.556+0000 7f220b4ba640 1 --2- 172.21.15.123:0/293682158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2204107fd0 0x7f220419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.556+0000 7f220b4ba640 1 --2- 172.21.15.123:0/293682158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2204103410 0x7f2204198930 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.556+0000 7f220b4ba640 1 --2- 172.21.15.123:0/293682158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2204102a60 0x7f22041983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:14.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.556+0000 7f220b4ba640 1 -- 172.21.15.123:0/293682158 >> 172.21.15.123:0/293682158 conn(0x7f22040fc500 msgr2=0x7f22041060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:14.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.556+0000 7f220b4ba640 1 -- 172.21.15.123:0/293682158 shutdown_connections 2024-08-18T22:11:14.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:14.556+0000 7f220b4ba640 1 -- 172.21.15.123:0/293682158 wait complete. 2024-08-18T22:11:15.127 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:15 smithi123 ceph-mon[18462]: pgmap v444: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.2 KiB/s wr, 12 op/s 2024-08-18T22:11:15.127 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:15 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/293682158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:11:15.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:15 smithi183 ceph-mon[22097]: pgmap v444: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.2 KiB/s wr, 12 op/s 2024-08-18T22:11:15.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:15 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/293682158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:11:15.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:15 smithi130 ceph-mon[21698]: pgmap v444: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.2 KiB/s wr, 12 op/s 2024-08-18T22:11:15.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:15 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/293682158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:11:15.613 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db --set-id 6456b877 --release --await' 2024-08-18T22:11:15.613 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24466 quiesce db --set-id 6456b877 --release --await 2024-08-18T22:11:16.306 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:11:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.001+0000 7f5fbb288640 1 -- 172.21.15.123:0/2052593817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fb4101020 msgr2=0x7f5fb410dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.001+0000 7f5fbb288640 1 --2- 172.21.15.123:0/2052593817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fb4101020 0x7f5fb410dce0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009900 tx=0x7f5fa402a410 comp rx=0 tx=0).stop 2024-08-18T22:11:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.001+0000 7f5fbb288640 1 -- 172.21.15.123:0/2052593817 shutdown_connections 2024-08-18T22:11:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.001+0000 7f5fbb288640 1 --2- 172.21.15.123:0/2052593817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb410e220 0x7f5fb4110610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.001+0000 7f5fbb288640 1 --2- 172.21.15.123:0/2052593817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fb4101020 0x7f5fb410dce0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.001+0000 7f5fbb288640 1 --2- 172.21.15.123:0/2052593817 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5fb4100670 0x7f5fb4100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.001+0000 7f5fbb288640 1 -- 172.21.15.123:0/2052593817 >> 172.21.15.123:0/2052593817 conn(0x7f5fb40fc500 msgr2=0x7f5fb40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.002+0000 7f5fbb288640 1 -- 172.21.15.123:0/2052593817 shutdown_connections 2024-08-18T22:11:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.002+0000 7f5fbb288640 1 -- 172.21.15.123:0/2052593817 wait complete. 2024-08-18T22:11:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.002+0000 7f5fbb288640 1 Processor -- start 2024-08-18T22:11:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.002+0000 7f5fbb288640 1 -- start start 2024-08-18T22:11:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.002+0000 7f5fbb288640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fb4100670 0x7f5fb419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.002+0000 7f5fbb288640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb4101020 0x7f5fb419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.002+0000 7f5fbb288640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5fb410e220 0x7f5fb419ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.002+0000 7f5fbb288640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb4113f10 con 0x7f5fb4100670 2024-08-18T22:11:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.002+0000 7f5fbb288640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb4113d90 con 0x7f5fb4101020 2024-08-18T22:11:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.002+0000 7f5fbb288640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb4114090 con 0x7f5fb410e220 2024-08-18T22:11:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.002+0000 7f5fb9024640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fb4100670 0x7f5fb419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.002+0000 7f5fb9024640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fb4100670 0x7f5fb419a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39712/0 (socket says 172.21.15.123:39712) 2024-08-18T22:11:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.002+0000 7f5fb9024640 1 -- 172.21.15.123:0/2892349407 learned_addr learned my addr 172.21.15.123:0/2892349407 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.003+0000 7f5fb8823640 1 --2- 172.21.15.123:0/2892349407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb4101020 0x7f5fb419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.003+0000 7f5fb9825640 1 --2- 172.21.15.123:0/2892349407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5fb410e220 0x7f5fb419ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.003+0000 7f5fb9024640 1 -- 172.21.15.123:0/2892349407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5fb410e220 msgr2=0x7f5fb419ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:17.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.003+0000 7f5fb9024640 1 --2- 172.21.15.123:0/2892349407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5fb410e220 0x7f5fb419ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.003+0000 7f5fb9024640 1 -- 172.21.15.123:0/2892349407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb4101020 msgr2=0x7f5fb419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:17.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.003+0000 7f5fb9024640 1 --2- 172.21.15.123:0/2892349407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb4101020 0x7f5fb419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.003+0000 7f5fb9024640 1 -- 172.21.15.123:0/2892349407 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb419f420 con 0x7f5fb4100670 2024-08-18T22:11:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.003+0000 7f5fb9024640 1 --2- 172.21.15.123:0/2892349407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fb4100670 0x7f5fb419a470 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000b4a0 tx=0x7f5fb000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.003+0000 7f5faa7fc640 1 -- 172.21.15.123:0/2892349407 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0014070 con 0x7f5fb4100670 2024-08-18T22:11:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.003+0000 7f5faa7fc640 1 -- 172.21.15.123:0/2892349407 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fb0010af0 con 0x7f5fb4100670 2024-08-18T22:11:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.003+0000 7f5fbb288640 1 -- 172.21.15.123:0/2892349407 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb419f710 con 0x7f5fb4100670 2024-08-18T22:11:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.003+0000 7f5faa7fc640 1 -- 172.21.15.123:0/2892349407 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0017d10 con 0x7f5fb4100670 2024-08-18T22:11:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.003+0000 7f5fbb288640 1 -- 172.21.15.123:0/2892349407 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb41a6ff0 con 0x7f5fb4100670 2024-08-18T22:11:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.005+0000 7f5faa7fc640 1 -- 172.21.15.123:0/2892349407 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f5fb0017070 con 0x7f5fb4100670 2024-08-18T22:11:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5fbd686740 1 Processor -- start 2024-08-18T22:11:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5fbd686740 1 -- start start 2024-08-18T22:11:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5fbd686740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3bd990 0x55b9ed3bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5fbd686740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3c8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5fbd686740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3caf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5fbd686740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b9ed323c60 con 0x55b9ed3bd990 2024-08-18T22:11:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5fbd686740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b9ed2bbb90 con 0x55b9ed3c8b70 2024-08-18T22:11:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5fbd686740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b9ed31fc20 con 0x55b9ed3be2b0 2024-08-18T22:11:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5faa7fc640 1 --2- 172.21.15.123:0/2892349407 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5fa00a2c00 0x7f5fa00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5fb9825640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3bd990 0x55b9ed3bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5fb9825640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3bd990 0x55b9ed3bdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39722/0 (socket says 172.21.15.123:39722) 2024-08-18T22:11:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5fb9825640 1 -- 172.21.15.123:0/3950204901 learned_addr learned my addr 172.21.15.123:0/3950204901 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5fb9825640 1 --2- 172.21.15.123:0/2892349407 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5fa00a2c00 0x7f5fa00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5faa7fc640 1 -- 172.21.15.123:0/2892349407 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f5fb00ce770 con 0x7f5fb4100670 2024-08-18T22:11:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5fb9024640 1 --2- 172.21.15.123:0/3950204901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.006+0000 7f5fb8823640 1 --2- 172.21.15.123:0/3950204901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.007+0000 7f5fb9825640 1 -- 172.21.15.123:0/3950204901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3be2b0 msgr2=0x55b9ed3c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.007+0000 7f5fb9825640 1 --2- 172.21.15.123:0/3950204901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.007+0000 7f5fb9825640 1 -- 172.21.15.123:0/3950204901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3c8b70 msgr2=0x55b9ed3caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.007+0000 7f5fb9825640 1 --2- 172.21.15.123:0/3950204901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.007+0000 7f5fb9825640 1 -- 172.21.15.123:0/3950204901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9ed033580 con 0x55b9ed3bd990 2024-08-18T22:11:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.007+0000 7f5fb9825640 1 --2- 172.21.15.123:0/3950204901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3bd990 0x55b9ed3bdd70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5fac013dc0 tx=0x7f5fac0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ee67039da34d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.007+0000 7f5fb9825640 1 --2- 172.21.15.123:0/2892349407 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5fa00a2c00 0x7f5fa00a50c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5fac005c40 tx=0x7f5fac015000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.007+0000 7f5f9f7fe640 1 -- 172.21.15.123:0/3950204901 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00ad20 con 0x55b9ed3bd990 2024-08-18T22:11:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.007+0000 7f5f9f7fe640 1 -- 172.21.15.123:0/3950204901 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fac003e50 con 0x55b9ed3bd990 2024-08-18T22:11:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.007+0000 7f5f9f7fe640 1 -- 172.21.15.123:0/3950204901 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac0046c0 con 0x55b9ed3bd990 2024-08-18T22:11:17.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.008+0000 7f5fbd686740 1 -- 172.21.15.123:0/3950204901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3bd990 msgr2=0x55b9ed3bdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:17.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.008+0000 7f5fbd686740 1 --2- 172.21.15.123:0/3950204901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3bd990 0x55b9ed3bdd70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5fac013dc0 tx=0x7f5fac0107a0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.008+0000 7f5fbd686740 1 -- 172.21.15.123:0/3950204901 shutdown_connections 2024-08-18T22:11:17.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.008+0000 7f5fbd686740 1 --2- 172.21.15.123:0/3950204901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.008+0000 7f5fbd686740 1 --2- 172.21.15.123:0/3950204901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.008+0000 7f5fbd686740 1 --2- 172.21.15.123:0/3950204901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3bd990 0x55b9ed3bdd70 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.008+0000 7f5fbd686740 1 -- 172.21.15.123:0/3950204901 >> 172.21.15.123:0/3950204901 conn(0x55b9ed3b9f20 msgr2=0x55b9ed3ba300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:17.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.008+0000 7f5fbd686740 1 -- 172.21.15.123:0/3950204901 shutdown_connections 2024-08-18T22:11:17.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.008+0000 7f5fbd686740 1 -- 172.21.15.123:0/3950204901 wait complete. 2024-08-18T22:11:17.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.008+0000 7f5fbd686740 1 -- start start 2024-08-18T22:11:17.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.008+0000 7f5fbd686740 1 Processor -- start 2024-08-18T22:11:17.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fbd686740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3bd990 0x55b9ed3c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fbd686740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fbd686740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3c6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fbd686740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b9ed3cb740 con 0x55b9ed3be2b0 2024-08-18T22:11:17.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fbd686740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b9ed2c17c0 con 0x55b9ed3bd990 2024-08-18T22:11:17.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fbd686740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b9ed3cb8c0 con 0x55b9ed3c8b70 2024-08-18T22:11:17.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fbd686740 10 client.0 _ll_register_callbacks cb 0x55b9ed2caf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:17.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fb8823640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fb8823640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3c5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39732/0 (socket says 172.21.15.123:39732) 2024-08-18T22:11:17.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fb8823640 1 -- 172.21.15.123:0/4057113009 learned_addr learned my addr 172.21.15.123:0/4057113009 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:17.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fb9024640 1 --2- 172.21.15.123:0/4057113009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3bd990 0x55b9ed3c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fb9825640 1 --2- 172.21.15.123:0/4057113009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fb8823640 1 -- 172.21.15.123:0/4057113009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3c8b70 msgr2=0x55b9ed3c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:17.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fb8823640 1 --2- 172.21.15.123:0/4057113009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fb8823640 1 -- 172.21.15.123:0/4057113009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3bd990 msgr2=0x55b9ed3c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:17.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fb8823640 1 --2- 172.21.15.123:0/4057113009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3bd990 0x55b9ed3c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fb8823640 1 -- 172.21.15.123:0/4057113009 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9ed0fd960 con 0x55b9ed3be2b0 2024-08-18T22:11:17.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fb9825640 1 --2- 172.21.15.123:0/4057113009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:17.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5fb8823640 1 --2- 172.21.15.123:0/4057113009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3c5fe0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5fa402a930 tx=0x7f5fa4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d483f443f426d222 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:17.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.009+0000 7f5f9cff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:17.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.010+0000 7f5f9cff9640 1 -- 172.21.15.123:0/4057113009 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4035040 con 0x55b9ed3be2b0 2024-08-18T22:11:17.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.010+0000 7f5f9cff9640 1 -- 172.21.15.123:0/4057113009 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f5fa4005020 con 0x55b9ed3be2b0 2024-08-18T22:11:17.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.010+0000 7f5fbd686740 1 -- 172.21.15.123:0/4057113009 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fac003e50 con 0x55b9ed3be2b0 2024-08-18T22:11:17.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.010+0000 7f5f9cff9640 1 -- 172.21.15.123:0/4057113009 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5fa404e050 con 0x55b9ed3be2b0 2024-08-18T22:11:17.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.010+0000 7f5fbd686740 10 client.15918 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:17.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.010+0000 7f5fbd686740 1 -- 172.21.15.123:0/4057113009 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b9ed3d77d0 con 0x55b9ed3be2b0 2024-08-18T22:11:17.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.010+0000 7f5f9cff9640 1 -- 172.21.15.123:0/4057113009 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fac003e50 con 0x55b9ed3be2b0 2024-08-18T22:11:17.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.010+0000 7f5f9cff9640 1 -- 172.21.15.123:0/4057113009 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5fa40035f0 con 0x55b9ed3be2b0 2024-08-18T22:11:17.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.010+0000 7f5fbd686740 10 client.15918 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:17.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.010+0000 7f5fbd686740 10 client.15918 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:11:17.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.010+0000 7f5fbd686740 20 client.15918 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:17.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.010+0000 7f5fbd686740 1 --2- 172.21.15.123:0/4057113009 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b9ed3d8d30 0x55b9ed3db140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.010+0000 7f5fbd686740 4 client.15918 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:17.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.010+0000 7f5fbd686740 1 -- 172.21.15.123:0/4057113009 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9ed3311d0 con 0x55b9ed3d8d30 2024-08-18T22:11:17.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.010+0000 7f5fb9024640 1 --2- 172.21.15.123:0/4057113009 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b9ed3d8d30 0x55b9ed3db140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.011+0000 7f5fb9024640 1 --2- 172.21.15.123:0/4057113009 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b9ed3d8d30 0x55b9ed3db140 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab3f6ba2f46cc65 server_cookie=c749444a1922f84c in_seq=0 out_seq=0 2024-08-18T22:11:17.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.011+0000 7f5f9cff9640 10 client.15918 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:17.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.012+0000 7f5f9cff9640 1 -- 172.21.15.123:0/4057113009 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9ed3311d0 con 0x55b9ed3d8d30 2024-08-18T22:11:17.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.012+0000 7f5f9cff9640 10 client.15918 handle_command_reply: tid=0 2024-08-18T22:11:17.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.012+0000 7f5fbd686740 1 client.15918 shutdown 2024-08-18T22:11:17.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.012+0000 7f5fbd686740 1 -- 172.21.15.123:0/4057113009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3be2b0 msgr2=0x55b9ed3c5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:17.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.012+0000 7f5fbd686740 1 --2- 172.21.15.123:0/4057113009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3c5fe0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5fa402a930 tx=0x7f5fa4004270 comp rx=0 tx=0).stop 2024-08-18T22:11:17.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.012+0000 7f5fbd686740 1 -- 172.21.15.123:0/4057113009 shutdown_connections 2024-08-18T22:11:17.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.012+0000 7f5fbd686740 1 --2- 172.21.15.123:0/4057113009 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b9ed3d8d30 0x55b9ed3db140 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.012+0000 7f5f9cff9640 0 client.15918 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:17.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.012+0000 7f5fbd686740 1 --2- 172.21.15.123:0/4057113009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.012+0000 7f5fbd686740 1 --2- 172.21.15.123:0/4057113009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3c5fe0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.012+0000 7f5fbd686740 1 --2- 172.21.15.123:0/4057113009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3bd990 0x55b9ed3c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.012+0000 7f5fbd686740 1 -- 172.21.15.123:0/4057113009 >> 172.21.15.123:0/4057113009 conn(0x55b9ed3b9f20 msgr2=0x55b9ed3bfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:17.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.012+0000 7f5fbd686740 1 -- 172.21.15.123:0/4057113009 shutdown_connections 2024-08-18T22:11:17.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.012+0000 7f5fbd686740 1 -- 172.21.15.123:0/4057113009 wait complete. 2024-08-18T22:11:17.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.012+0000 7f5fbd686740 20 client.15918 trim_cache size 0 max 16384 2024-08-18T22:11:17.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.029+0000 7f5fbd686740 1 Processor -- start 2024-08-18T22:11:17.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.029+0000 7f5fbd686740 1 -- start start 2024-08-18T22:11:17.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.029+0000 7f5fbd686740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3bd990 0x55b9ed3c6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.029+0000 7f5fbd686740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3e0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.029+0000 7f5fbd686740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3e0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.029+0000 7f5fbd686740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb41b3610 con 0x55b9ed3bd990 2024-08-18T22:11:17.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.029+0000 7f5fbd686740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb41b0ee0 con 0x55b9ed3c8b70 2024-08-18T22:11:17.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.029+0000 7f5fbd686740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb41aed30 con 0x55b9ed3be2b0 2024-08-18T22:11:17.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.029+0000 7f5fb9024640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3bd990 0x55b9ed3c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.029+0000 7f5fb9024640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3bd990 0x55b9ed3c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39736/0 (socket says 172.21.15.123:39736) 2024-08-18T22:11:17.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.029+0000 7f5fb9024640 1 -- 172.21.15.123:0/1165727775 learned_addr learned my addr 172.21.15.123:0/1165727775 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:17.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.030+0000 7f5fb8823640 1 --2- 172.21.15.123:0/1165727775 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3e0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.030+0000 7f5fb9024640 1 -- 172.21.15.123:0/1165727775 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3be2b0 msgr2=0x55b9ed3e0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:17.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.030+0000 7f5fb9024640 1 --2- 172.21.15.123:0/1165727775 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3e0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.030+0000 7f5fb9024640 1 -- 172.21.15.123:0/1165727775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3c8b70 msgr2=0x55b9ed3e0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:17.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.030+0000 7f5fb9024640 1 --2- 172.21.15.123:0/1165727775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3e0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.030+0000 7f5fb9024640 1 -- 172.21.15.123:0/1165727775 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9ed3c16a0 con 0x55b9ed3bd990 2024-08-18T22:11:17.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.030+0000 7f5fb8823640 1 --2- 172.21.15.123:0/1165727775 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3e0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:11:17.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.030+0000 7f5fb9024640 1 --2- 172.21.15.123:0/1165727775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3bd990 0x55b9ed3c6370 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000b470 tx=0x7f5fb000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6a8362e2080038 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:17.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.030+0000 7f5f9effd640 1 -- 172.21.15.123:0/1165727775 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb00b2050 con 0x55b9ed3bd990 2024-08-18T22:11:17.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.030+0000 7f5f9effd640 1 -- 172.21.15.123:0/1165727775 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fb00cbff0 con 0x55b9ed3bd990 2024-08-18T22:11:17.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.030+0000 7f5f9effd640 1 -- 172.21.15.123:0/1165727775 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb001e040 con 0x55b9ed3bd990 2024-08-18T22:11:17.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.030+0000 7f5fbd686740 1 -- 172.21.15.123:0/1165727775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3bd990 msgr2=0x55b9ed3c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:17.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.030+0000 7f5fbd686740 1 --2- 172.21.15.123:0/1165727775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3bd990 0x55b9ed3c6370 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000b470 tx=0x7f5fb000bf90 comp rx=0 tx=0).stop 2024-08-18T22:11:17.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.031+0000 7f5fbd686740 1 -- 172.21.15.123:0/1165727775 shutdown_connections 2024-08-18T22:11:17.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.031+0000 7f5fbd686740 1 --2- 172.21.15.123:0/1165727775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3e0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.031+0000 7f5fbd686740 1 --2- 172.21.15.123:0/1165727775 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3e0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.031+0000 7f5fbd686740 1 --2- 172.21.15.123:0/1165727775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3bd990 0x55b9ed3c6370 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.031+0000 7f5fbd686740 1 -- 172.21.15.123:0/1165727775 >> 172.21.15.123:0/1165727775 conn(0x55b9ed3b9f20 msgr2=0x55b9ed3c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:17.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.031+0000 7f5fbd686740 1 -- 172.21.15.123:0/1165727775 shutdown_connections 2024-08-18T22:11:17.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.031+0000 7f5fbd686740 1 -- 172.21.15.123:0/1165727775 wait complete. 2024-08-18T22:11:17.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.031+0000 7f5fbd686740 1 -- start start 2024-08-18T22:11:17.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.031+0000 7f5fbd686740 1 Processor -- start 2024-08-18T22:11:17.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.031+0000 7f5fbd686740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3bd990 0x55b9ed3d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.031+0000 7f5fbd686740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.031+0000 7f5fbd686740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.031+0000 7f5fbd686740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb41af3a0 con 0x55b9ed3c8b70 2024-08-18T22:11:17.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.031+0000 7f5fbd686740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb41b0810 con 0x55b9ed3be2b0 2024-08-18T22:11:17.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.031+0000 7f5fbd686740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb41afa70 con 0x55b9ed3bd990 2024-08-18T22:11:17.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5fbd686740 10 client.0 _ll_register_callbacks cb 0x7f5fa4031a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:17.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5fb9825640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5fb9825640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39738/0 (socket says 172.21.15.123:39738) 2024-08-18T22:11:17.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5fb9825640 1 -- 172.21.15.123:0/1723663711 learned_addr learned my addr 172.21.15.123:0/1723663711 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:17.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5fb9024640 1 --2- 172.21.15.123:0/1723663711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3bd990 0x55b9ed3d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5fb8823640 1 --2- 172.21.15.123:0/1723663711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5fb9825640 1 -- 172.21.15.123:0/1723663711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3bd990 msgr2=0x55b9ed3d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:17.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5fb9825640 1 --2- 172.21.15.123:0/1723663711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3bd990 0x55b9ed3d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5fb9825640 1 -- 172.21.15.123:0/1723663711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3be2b0 msgr2=0x55b9ed3d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:17.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5fb9825640 1 --2- 172.21.15.123:0/1723663711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3d1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5fb9825640 1 -- 172.21.15.123:0/1723663711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9ed3ce020 con 0x55b9ed3c8b70 2024-08-18T22:11:17.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5fb9825640 1 --2- 172.21.15.123:0/1723663711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3cdae0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00ad50 tx=0x7f5fac00ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e3b3ba80ccccce server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:17.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5f9cff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:17.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5f9cff9640 1 -- 172.21.15.123:0/1723663711 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac035020 con 0x55b9ed3c8b70 2024-08-18T22:11:17.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5f9cff9640 1 -- 172.21.15.123:0/1723663711 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f5fac003970 con 0x55b9ed3c8b70 2024-08-18T22:11:17.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5fbd686740 1 -- 172.21.15.123:0/1723663711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fb00cbff0 con 0x55b9ed3c8b70 2024-08-18T22:11:17.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5f9cff9640 1 -- 172.21.15.123:0/1723663711 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5fac03d050 con 0x55b9ed3c8b70 2024-08-18T22:11:17.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5fbd686740 10 client.15924 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:17.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.032+0000 7f5fbd686740 1 -- 172.21.15.123:0/1723663711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b9ed444090 con 0x55b9ed3c8b70 2024-08-18T22:11:17.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.033+0000 7f5f9cff9640 1 -- 172.21.15.123:0/1723663711 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fb00cbff0 con 0x55b9ed3c8b70 2024-08-18T22:11:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.033+0000 7f5f9cff9640 1 -- 172.21.15.123:0/1723663711 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5fac030070 con 0x55b9ed3c8b70 2024-08-18T22:11:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.033+0000 7f5fbd686740 10 client.15924 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.033+0000 7f5fbd686740 10 client.15924 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:11:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.033+0000 7f5fbd686740 20 client.15924 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.033+0000 7f5fbd686740 1 --2- 172.21.15.123:0/1723663711 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b9ed3d8d30 0x55b9ed4465f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.033+0000 7f5fbd686740 4 client.15924 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6456b877", "release": true, "await": true}] 2024-08-18T22:11:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.033+0000 7f5fbd686740 1 -- 172.21.15.123:0/1723663711 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6456b877", "release": true, "await": true}) -- 0x55b9ed3b51d0 con 0x55b9ed3d8d30 2024-08-18T22:11:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.033+0000 7f5fb9024640 1 --2- 172.21.15.123:0/1723663711 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b9ed3d8d30 0x55b9ed4465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.033+0000 7f5f9cff9640 10 client.15924 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.033+0000 7f5fb9024640 1 --2- 172.21.15.123:0/1723663711 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b9ed3d8d30 0x55b9ed4465f0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78b28fab43240e20 server_cookie=b20de60a14be60b8 in_seq=0 out_seq=0 2024-08-18T22:11:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.036+0000 7f5f9cff9640 1 -- 172.21.15.123:0/1723663711 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b9ed3b51d0 con 0x55b9ed3d8d30 2024-08-18T22:11:17.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.036+0000 7f5f9cff9640 10 client.15924 handle_command_reply: tid=0 2024-08-18T22:11:17.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.036+0000 7f5fbd686740 1 client.15924 shutdown 2024-08-18T22:11:17.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.037+0000 7f5fbd686740 1 -- 172.21.15.123:0/1723663711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3c8b70 msgr2=0x55b9ed3cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:17.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.037+0000 7f5fbd686740 1 --2- 172.21.15.123:0/1723663711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3cdae0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00ad50 tx=0x7f5fac00ad80 comp rx=0 tx=0).stop 2024-08-18T22:11:17.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.037+0000 7f5fbd686740 1 -- 172.21.15.123:0/1723663711 shutdown_connections 2024-08-18T22:11:17.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.037+0000 7f5fbd686740 1 --2- 172.21.15.123:0/1723663711 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b9ed3d8d30 0x55b9ed4465f0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.037+0000 7f5fbd686740 1 --2- 172.21.15.123:0/1723663711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b9ed3c8b70 0x55b9ed3cdae0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.037+0000 7f5fbd686740 1 --2- 172.21.15.123:0/1723663711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9ed3be2b0 0x55b9ed3d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.037+0000 7f5fbd686740 1 --2- 172.21.15.123:0/1723663711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b9ed3bd990 0x55b9ed3d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.037+0000 7f5fbd686740 1 -- 172.21.15.123:0/1723663711 >> 172.21.15.123:0/1723663711 conn(0x55b9ed3b9f20 msgr2=0x55b9ed3b8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:17.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.037+0000 7f5f9cff9640 0 client.15924 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:17.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.037+0000 7f5fbd686740 1 -- 172.21.15.123:0/1723663711 shutdown_connections 2024-08-18T22:11:17.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.037+0000 7f5fbd686740 1 -- 172.21.15.123:0/1723663711 wait complete. 2024-08-18T22:11:17.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.037+0000 7f5fbd686740 20 client.15924 trim_cache size 0 max 16384 2024-08-18T22:11:17.043 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:11:17.043 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 26, 2024-08-18T22:11:17.044 INFO:teuthology.orchestra.run.smithi123.stdout: "leader": 24466, 2024-08-18T22:11:17.044 INFO:teuthology.orchestra.run.smithi123.stdout: "set_version": 8, 2024-08-18T22:11:17.044 INFO:teuthology.orchestra.run.smithi123.stdout: "sets": { 2024-08-18T22:11:17.044 INFO:teuthology.orchestra.run.smithi123.stdout: "6456b877": { 2024-08-18T22:11:17.044 INFO:teuthology.orchestra.run.smithi123.stdout: "version": 8, 2024-08-18T22:11:17.044 INFO:teuthology.orchestra.run.smithi123.stdout: "age_ref": 0.0, 2024-08-18T22:11:17.044 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:11:17.044 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RELEASED", 2024-08-18T22:11:17.044 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:11:17.044 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:11:17.044 INFO:teuthology.orchestra.run.smithi123.stdout: "timeout": 90.0, 2024-08-18T22:11:17.044 INFO:teuthology.orchestra.run.smithi123.stdout: "expiration": 130.0, 2024-08-18T22:11:17.045 INFO:teuthology.orchestra.run.smithi123.stdout: "members": { 2024-08-18T22:11:17.045 INFO:teuthology.orchestra.run.smithi123.stdout: "file:/": { 2024-08-18T22:11:17.045 INFO:teuthology.orchestra.run.smithi123.stdout: "excluded": false, 2024-08-18T22:11:17.045 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:11:17.045 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RELEASED", 2024-08-18T22:11:17.045 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:11:17.045 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:17.045 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:17.045 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:17.045 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:17.045 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:17.046 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:11:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.038+0000 7f5fbb288640 1 -- 172.21.15.123:0/2892349407 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5fa00a2c00 msgr2=0x7f5fa00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.038+0000 7f5fbb288640 1 --2- 172.21.15.123:0/2892349407 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5fa00a2c00 0x7f5fa00a50c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5fac005c40 tx=0x7f5fac015000 comp rx=0 tx=0).stop 2024-08-18T22:11:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.038+0000 7f5fbb288640 1 -- 172.21.15.123:0/2892349407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fb4100670 msgr2=0x7f5fb419a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.038+0000 7f5fbb288640 1 --2- 172.21.15.123:0/2892349407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fb4100670 0x7f5fb419a470 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000b4a0 tx=0x7f5fb000b960 comp rx=0 tx=0).stop 2024-08-18T22:11:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.038+0000 7f5fbb288640 1 -- 172.21.15.123:0/2892349407 shutdown_connections 2024-08-18T22:11:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.038+0000 7f5fbb288640 1 --2- 172.21.15.123:0/2892349407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5fb410e220 0x7f5fb419ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.038+0000 7f5fbb288640 1 --2- 172.21.15.123:0/2892349407 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5fa00a2c00 0x7f5fa00a50c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.038+0000 7f5fbb288640 1 --2- 172.21.15.123:0/2892349407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb4101020 0x7f5fb419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.038+0000 7f5fbb288640 1 --2- 172.21.15.123:0/2892349407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fb4100670 0x7f5fb419a470 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.038+0000 7f5fbb288640 1 -- 172.21.15.123:0/2892349407 >> 172.21.15.123:0/2892349407 conn(0x7f5fb40fc500 msgr2=0x7f5fb40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.038+0000 7f5fbb288640 1 -- 172.21.15.123:0/2892349407 shutdown_connections 2024-08-18T22:11:17.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:17.038+0000 7f5fbb288640 1 -- 172.21.15.123:0/2892349407 wait complete. 2024-08-18T22:11:17.048 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:17.048 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:17.048 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 93 -lt 100 ']' 2024-08-18T22:11:17.048 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 93 + 1 2024-08-18T22:11:17.121 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=94 2024-08-18T22:11:17.122 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:11:17.151 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:17.151 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:17.152 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:11:17.152 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:11:17.153 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:11:17.161 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:17 smithi123 ceph-mon[18462]: pgmap v445: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-08-18T22:11:17.246 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-18T22:11:17.247 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-18T22:11:17.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:17 smithi183 ceph-mon[22097]: pgmap v445: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-08-18T22:11:17.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:17 smithi130 ceph-mon[21698]: pgmap v445: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-08-18T22:11:17.658 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:17.659 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:17.869 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:11:17.869 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:11:17.884 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:17.884 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:17.884 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 94 -lt 100 ']' 2024-08-18T22:11:17.884 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 94 + 1 2024-08-18T22:11:17.891 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=95 2024-08-18T22:11:17.891 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:11:17.895 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:17.895 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:17.896 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:11:17.896 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:11:17.896 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:11:19.059 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:19.059 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:19.198 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:11:19.198 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:11:19.217 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:19.218 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:19.218 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 95 -lt 100 ']' 2024-08-18T22:11:19.218 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 95 + 1 2024-08-18T22:11:19.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:19 smithi123 ceph-mon[18462]: pgmap v446: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.8 KiB/s wr, 11 op/s 2024-08-18T22:11:19.291 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=96 2024-08-18T22:11:19.291 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:11:19.342 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:19.342 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:19.343 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:11:19.343 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:11:19.343 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:11:19.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:19 smithi183 ceph-mon[22097]: pgmap v446: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.8 KiB/s wr, 11 op/s 2024-08-18T22:11:19.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:19 smithi130 ceph-mon[21698]: pgmap v446: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.8 KiB/s wr, 11 op/s 2024-08-18T22:11:20.099 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6456b877', total seconds elapsed: 68.8 2024-08-18T22:11:20.442 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:20.442 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:20.733 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:11:20.733 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:11:20.767 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:20.768 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:20.768 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 96 -lt 100 ']' 2024-08-18T22:11:20.768 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 96 + 1 2024-08-18T22:11:20.800 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=97 2024-08-18T22:11:20.801 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:11:20.859 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:20.859 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:20.860 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:11:20.860 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:11:20.861 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:11:21.316 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:21 smithi130 ceph-mon[21698]: pgmap v447: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.4 KiB/s wr, 12 op/s 2024-08-18T22:11:21.333 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:21 smithi123 ceph-mon[18462]: pgmap v447: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.4 KiB/s wr, 12 op/s 2024-08-18T22:11:21.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:21 smithi183 ceph-mon[22097]: pgmap v447: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.4 KiB/s wr, 12 op/s 2024-08-18T22:11:21.570 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:21.571 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:21.869 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:11:21.869 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:11:21.916 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:21.916 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:21.917 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 97 -lt 100 ']' 2024-08-18T22:11:21.917 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 97 + 1 2024-08-18T22:11:22.051 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=98 2024-08-18T22:11:22.051 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:11:22.108 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:22.108 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:22.109 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:11:22.109 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:11:22.110 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:11:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.985+0000 7f198f61e640 1 -- 172.21.15.123:0/2831597306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1988102a80 msgr2=0x7f1988102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.985+0000 7f198f61e640 1 --2- 172.21.15.123:0/2831597306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1988102a80 0x7f1988102f00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1978009900 tx=0x7f197802a410 comp rx=0 tx=0).stop 2024-08-18T22:11:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.985+0000 7f198f61e640 1 -- 172.21.15.123:0/2831597306 shutdown_connections 2024-08-18T22:11:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.985+0000 7f198f61e640 1 --2- 172.21.15.123:0/2831597306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1988103440 0x7f1988109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.985+0000 7f198f61e640 1 --2- 172.21.15.123:0/2831597306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1988102a80 0x7f1988102f00 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.985+0000 7f198f61e640 1 --2- 172.21.15.123:0/2831597306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1988101890 0x7f1988101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:22.988 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.985+0000 7f198f61e640 1 -- 172.21.15.123:0/2831597306 >> 172.21.15.123:0/2831597306 conn(0x7f19880fcff0 msgr2=0x7f19880ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:22.988 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.986+0000 7f198f61e640 1 -- 172.21.15.123:0/2831597306 shutdown_connections 2024-08-18T22:11:22.988 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.986+0000 7f198f61e640 1 -- 172.21.15.123:0/2831597306 wait complete. 2024-08-18T22:11:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.989+0000 7f198f61e640 1 Processor -- start 2024-08-18T22:11:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.989+0000 7f198f61e640 1 -- start start 2024-08-18T22:11:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198f61e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1988101890 0x7f1988199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198f61e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1988102a80 0x7f198819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198f61e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1988103440 0x7f19881a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198f61e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f198810d560 con 0x7f1988102a80 2024-08-18T22:11:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198f61e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f198810d3e0 con 0x7f1988103440 2024-08-18T22:11:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198f61e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f198810d6e0 con 0x7f1988101890 2024-08-18T22:11:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198cbb9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1988102a80 0x7f198819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198cbb9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1988102a80 0x7f198819a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58416/0 (socket says 172.21.15.123:58416) 2024-08-18T22:11:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198cbb9640 1 -- 172.21.15.123:0/2513983676 learned_addr learned my addr 172.21.15.123:0/2513983676 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198d3ba640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1988101890 0x7f1988199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198dbbb640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1988103440 0x7f19881a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198d3ba640 1 -- 172.21.15.123:0/2513983676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1988103440 msgr2=0x7f19881a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198d3ba640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1988103440 0x7f19881a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198d3ba640 1 -- 172.21.15.123:0/2513983676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1988102a80 msgr2=0x7f198819a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198d3ba640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1988102a80 0x7f198819a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198d3ba640 1 -- 172.21.15.123:0/2513983676 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19881a1960 con 0x7f1988101890 2024-08-18T22:11:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198cbb9640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1988102a80 0x7f198819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.990+0000 7f198dbbb640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1988103440 0x7f19881a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.991+0000 7f198d3ba640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1988101890 0x7f1988199d40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1984005fd0 tx=0x7f198400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.992+0000 7f197e7fc640 1 -- 172.21.15.123:0/2513983676 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1984010630 con 0x7f1988101890 2024-08-18T22:11:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.993+0000 7f198f61e640 1 -- 172.21.15.123:0/2513983676 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19881a1c50 con 0x7f1988101890 2024-08-18T22:11:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.993+0000 7f197e7fc640 1 -- 172.21.15.123:0/2513983676 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1984010cb0 con 0x7f1988101890 2024-08-18T22:11:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.993+0000 7f197e7fc640 1 -- 172.21.15.123:0/2513983676 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1984018d90 con 0x7f1988101890 2024-08-18T22:11:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.993+0000 7f198f61e640 1 -- 172.21.15.123:0/2513983676 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19881a21a0 con 0x7f1988101890 2024-08-18T22:11:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.995+0000 7f197e7fc640 1 -- 172.21.15.123:0/2513983676 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f198401f020 con 0x7f1988101890 2024-08-18T22:11:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.996+0000 7f197e7fc640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f19740a2da0 0x7f19740a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.996+0000 7f198cbb9640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f19740a2da0 0x7f19740a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.996+0000 7f197e7fc640 1 -- 172.21.15.123:0/2513983676 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f19840cf800 con 0x7f1988101890 2024-08-18T22:11:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:22.997+0000 7f198cbb9640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f19740a2da0 0x7f19740a5260 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f198819b250 tx=0x7f19780315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:23.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:23 smithi123 ceph-mon[18462]: pgmap v448: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-08-18T22:11:23.269 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.268+0000 7f19923e1740 1 Processor -- start 2024-08-18T22:11:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.268+0000 7f19923e1740 1 -- start start 2024-08-18T22:11:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.268+0000 7f19923e1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf7fc680 0x559ecf7fca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.268+0000 7f19923e1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fcfc0 0x559ecf801a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.268+0000 7f19923e1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf802050 0x559ecf804510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.268+0000 7f19923e1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559ecf75f9d0 con 0x559ecf7fcfc0 2024-08-18T22:11:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.268+0000 7f19923e1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559ecf707820 con 0x559ecf802050 2024-08-18T22:11:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.268+0000 7f19923e1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x559ecf75b990 con 0x559ecf7fc680 2024-08-18T22:11:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.268+0000 7f198cbb9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fcfc0 0x559ecf801a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.268+0000 7f198cbb9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fcfc0 0x559ecf801a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58422/0 (socket says 172.21.15.123:58422) 2024-08-18T22:11:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.268+0000 7f198cbb9640 1 -- 172.21.15.123:0/2673089401 learned_addr learned my addr 172.21.15.123:0/2673089401 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.268+0000 7f198d3ba640 1 --2- 172.21.15.123:0/2673089401 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf7fc680 0x559ecf7fca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.268+0000 7f198dbbb640 1 --2- 172.21.15.123:0/2673089401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf802050 0x559ecf804510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.269+0000 7f198cbb9640 1 -- 172.21.15.123:0/2673089401 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf7fc680 msgr2=0x559ecf7fca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.269+0000 7f198cbb9640 1 --2- 172.21.15.123:0/2673089401 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf7fc680 0x559ecf7fca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.269+0000 7f198cbb9640 1 -- 172.21.15.123:0/2673089401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf802050 msgr2=0x559ecf804510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.269+0000 7f198cbb9640 1 --2- 172.21.15.123:0/2673089401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf802050 0x559ecf804510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.269+0000 7f198cbb9640 1 -- 172.21.15.123:0/2673089401 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ecf473210 con 0x559ecf7fcfc0 2024-08-18T22:11:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.269+0000 7f198cbb9640 1 --2- 172.21.15.123:0/2673089401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fcfc0 0x559ecf801a80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f197802a930 tx=0x7f197803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3996a4c7bbdeb82f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.269+0000 7f19737fe640 1 -- 172.21.15.123:0/2673089401 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978035040 con 0x559ecf7fcfc0 2024-08-18T22:11:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.269+0000 7f19737fe640 1 -- 172.21.15.123:0/2673089401 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f197804e070 con 0x559ecf7fcfc0 2024-08-18T22:11:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.269+0000 7f19737fe640 1 -- 172.21.15.123:0/2673089401 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978049940 con 0x559ecf7fcfc0 2024-08-18T22:11:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.270+0000 7f19923e1740 1 -- 172.21.15.123:0/2673089401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fcfc0 msgr2=0x559ecf801a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.270+0000 7f19923e1740 1 --2- 172.21.15.123:0/2673089401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fcfc0 0x559ecf801a80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f197802a930 tx=0x7f197803d000 comp rx=0 tx=0).stop 2024-08-18T22:11:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.270+0000 7f19923e1740 1 -- 172.21.15.123:0/2673089401 shutdown_connections 2024-08-18T22:11:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.270+0000 7f19923e1740 1 --2- 172.21.15.123:0/2673089401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf802050 0x559ecf804510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.270+0000 7f19923e1740 1 --2- 172.21.15.123:0/2673089401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fcfc0 0x559ecf801a80 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.270+0000 7f19923e1740 1 --2- 172.21.15.123:0/2673089401 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf7fc680 0x559ecf7fca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.270+0000 7f19923e1740 1 -- 172.21.15.123:0/2673089401 >> 172.21.15.123:0/2673089401 conn(0x559ecf7f7cf0 msgr2=0x559ecf7f80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.270+0000 7f19923e1740 1 -- 172.21.15.123:0/2673089401 shutdown_connections 2024-08-18T22:11:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.270+0000 7f19923e1740 1 -- 172.21.15.123:0/2673089401 wait complete. 2024-08-18T22:11:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.311+0000 7f19923e1740 1 -- start start 2024-08-18T22:11:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.314+0000 7f19923e1740 1 Processor -- start 2024-08-18T22:11:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.314+0000 7f19923e1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fc680 0x559ecf806780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.314+0000 7f19923e1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf7fcfc0 0x559ecf806cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.314+0000 7f19923e1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf802050 0x559ecf80dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.314+0000 7f19923e1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559ecf804fc0 con 0x559ecf7fc680 2024-08-18T22:11:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.314+0000 7f19923e1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559ecf71b520 con 0x559ecf802050 2024-08-18T22:11:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.314+0000 7f19923e1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x559ecf805140 con 0x559ecf7fcfc0 2024-08-18T22:11:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.314+0000 7f198d3ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fc680 0x559ecf806780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.314+0000 7f198d3ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fc680 0x559ecf806780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58428/0 (socket says 172.21.15.123:58428) 2024-08-18T22:11:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.314+0000 7f198d3ba640 1 -- 172.21.15.123:0/2855974556 learned_addr learned my addr 172.21.15.123:0/2855974556 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.315+0000 7f198dbbb640 1 --2- 172.21.15.123:0/2855974556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf802050 0x559ecf80dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.315+0000 7f198cbb9640 1 --2- 172.21.15.123:0/2855974556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf7fcfc0 0x559ecf806cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.315+0000 7f198d3ba640 1 -- 172.21.15.123:0/2855974556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf7fcfc0 msgr2=0x559ecf806cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.315+0000 7f198d3ba640 1 --2- 172.21.15.123:0/2855974556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf7fcfc0 0x559ecf806cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.315+0000 7f198d3ba640 1 -- 172.21.15.123:0/2855974556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf802050 msgr2=0x559ecf80dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.315+0000 7f198d3ba640 1 --2- 172.21.15.123:0/2855974556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf802050 0x559ecf80dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.315+0000 7f198d3ba640 1 -- 172.21.15.123:0/2855974556 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ecf53f620 con 0x559ecf7fc680 2024-08-18T22:11:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.315+0000 7f198dbbb640 1 --2- 172.21.15.123:0/2855974556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf802050 0x559ecf80dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.315+0000 7f198d3ba640 1 --2- 172.21.15.123:0/2855974556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fc680 0x559ecf806780 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f198409b9d0 tx=0x7f1984009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2fefe70da0e91d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.315+0000 7f1970ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.315+0000 7f1970ff9640 1 -- 172.21.15.123:0/2855974556 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1984010e60 con 0x559ecf7fc680 2024-08-18T22:11:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.315+0000 7f1970ff9640 1 -- 172.21.15.123:0/2855974556 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f1984098340 con 0x559ecf7fc680 2024-08-18T22:11:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.315+0000 7f19923e1740 10 client.0 _ll_register_callbacks cb 0x559ecf472a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.318+0000 7f19923e1740 1 -- 172.21.15.123:0/2855974556 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f197804e070 con 0x559ecf7fc680 2024-08-18T22:11:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.318+0000 7f1970ff9640 1 -- 172.21.15.123:0/2855974556 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f198409bcd0 con 0x559ecf7fc680 2024-08-18T22:11:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.318+0000 7f19923e1740 10 client.15936 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.318+0000 7f19923e1740 1 -- 172.21.15.123:0/2855974556 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({fsmap=26}) -- 0x559ecf8109c0 con 0x559ecf7fc680 2024-08-18T22:11:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.320+0000 7f1970ff9640 1 -- 172.21.15.123:0/2855974556 <== mon.0 v2:172.21.15.123:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f19840b3020 con 0x559ecf7fc680 2024-08-18T22:11:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.320+0000 7f19923e1740 10 client.15936 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.320+0000 7f19923e1740 10 client.15936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:23.323 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.322+0000 7f19923e1740 20 client.15936 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:23.323 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.322+0000 7f19923e1740 1 --2- 172.21.15.123:0/2855974556 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559ecf812010 0x559ecf8144d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:23.323 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.322+0000 7f19923e1740 4 client.15936 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:23.323 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.322+0000 7f19923e1740 1 -- 172.21.15.123:0/2855974556 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ecf76d100 con 0x559ecf812010 2024-08-18T22:11:23.323 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.322+0000 7f198cbb9640 1 --2- 172.21.15.123:0/2855974556 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559ecf812010 0x559ecf8144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:23.323 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.323+0000 7f1970ff9640 10 client.15936 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:23.324 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.323+0000 7f198cbb9640 1 --2- 172.21.15.123:0/2855974556 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559ecf812010 0x559ecf8144d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de9b5914d780f3e6 server_cookie=3ee556b709abbb5c in_seq=0 out_seq=0 2024-08-18T22:11:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.323+0000 7f1970ff9640 1 -- 172.21.15.123:0/2855974556 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ecf76d100 con 0x559ecf812010 2024-08-18T22:11:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.323+0000 7f1970ff9640 10 client.15936 handle_command_reply: tid=0 2024-08-18T22:11:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.323+0000 7f19923e1740 1 client.15936 shutdown 2024-08-18T22:11:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.324+0000 7f19923e1740 1 -- 172.21.15.123:0/2855974556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fc680 msgr2=0x559ecf806780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.324+0000 7f19923e1740 1 --2- 172.21.15.123:0/2855974556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fc680 0x559ecf806780 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f198409b9d0 tx=0x7f1984009820 comp rx=0 tx=0).stop 2024-08-18T22:11:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.324+0000 7f19923e1740 1 -- 172.21.15.123:0/2855974556 shutdown_connections 2024-08-18T22:11:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.324+0000 7f19923e1740 1 --2- 172.21.15.123:0/2855974556 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559ecf812010 0x559ecf8144d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.324+0000 7f19923e1740 1 --2- 172.21.15.123:0/2855974556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf802050 0x559ecf80dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.324+0000 7f19923e1740 1 --2- 172.21.15.123:0/2855974556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf7fcfc0 0x559ecf806cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.324+0000 7f1970ff9640 0 client.15936 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:23.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.324+0000 7f19923e1740 1 --2- 172.21.15.123:0/2855974556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fc680 0x559ecf806780 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.324+0000 7f19923e1740 1 -- 172.21.15.123:0/2855974556 >> 172.21.15.123:0/2855974556 conn(0x559ecf7f7cf0 msgr2=0x559ecf7f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:23.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.324+0000 7f19923e1740 1 -- 172.21.15.123:0/2855974556 shutdown_connections 2024-08-18T22:11:23.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.324+0000 7f19923e1740 1 -- 172.21.15.123:0/2855974556 wait complete. 2024-08-18T22:11:23.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.324+0000 7f19923e1740 20 client.15936 trim_cache size 0 max 16384 2024-08-18T22:11:23.333 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:23.333 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.360+0000 7f19923e1740 1 Processor -- start 2024-08-18T22:11:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.360+0000 7f19923e1740 1 -- start start 2024-08-18T22:11:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.360+0000 7f19923e1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fc680 0x559ecf806c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.360+0000 7f19923e1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf7fcfc0 0x559ecf8017f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.360+0000 7f19923e1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf802050 0x559ecf80dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.360+0000 7f19923e1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f19881aee90 con 0x559ecf7fc680 2024-08-18T22:11:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.360+0000 7f19923e1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f19881ac6f0 con 0x559ecf7fcfc0 2024-08-18T22:11:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.360+0000 7f19923e1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f19881aa540 con 0x559ecf802050 2024-08-18T22:11:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.360+0000 7f198d3ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fc680 0x559ecf806c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.360+0000 7f198d3ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fc680 0x559ecf806c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58438/0 (socket says 172.21.15.123:58438) 2024-08-18T22:11:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.360+0000 7f198d3ba640 1 -- 172.21.15.123:0/2792546943 learned_addr learned my addr 172.21.15.123:0/2792546943 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.361+0000 7f198dbbb640 1 --2- 172.21.15.123:0/2792546943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf802050 0x559ecf80dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.361+0000 7f198cbb9640 1 --2- 172.21.15.123:0/2792546943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf7fcfc0 0x559ecf8017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.361+0000 7f198d3ba640 1 -- 172.21.15.123:0/2792546943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf802050 msgr2=0x559ecf80dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.361+0000 7f198d3ba640 1 --2- 172.21.15.123:0/2792546943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf802050 0x559ecf80dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.364 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.361+0000 7f198d3ba640 1 -- 172.21.15.123:0/2792546943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf7fcfc0 msgr2=0x559ecf8017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:23.364 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.361+0000 7f198d3ba640 1 --2- 172.21.15.123:0/2792546943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf7fcfc0 0x559ecf8017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.364 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.361+0000 7f198d3ba640 1 -- 172.21.15.123:0/2792546943 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ecf7fdc50 con 0x559ecf7fc680 2024-08-18T22:11:23.364 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.361+0000 7f198d3ba640 1 --2- 172.21.15.123:0/2792546943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fc680 0x559ecf806c40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f198409bc60 tx=0x7f1984023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49eed70f97186b6a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:23.364 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.361+0000 7f1972ffd640 1 -- 172.21.15.123:0/2792546943 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1984010e60 con 0x559ecf7fc680 2024-08-18T22:11:23.364 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.361+0000 7f1972ffd640 1 -- 172.21.15.123:0/2792546943 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f197804e070 con 0x559ecf7fc680 2024-08-18T22:11:23.364 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.361+0000 7f1972ffd640 1 -- 172.21.15.123:0/2792546943 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19840a4df0 con 0x559ecf7fc680 2024-08-18T22:11:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.362+0000 7f19923e1740 1 -- 172.21.15.123:0/2792546943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fc680 msgr2=0x559ecf806c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.362+0000 7f19923e1740 1 --2- 172.21.15.123:0/2792546943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fc680 0x559ecf806c40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f198409bc60 tx=0x7f1984023000 comp rx=0 tx=0).stop 2024-08-18T22:11:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.362+0000 7f19923e1740 1 -- 172.21.15.123:0/2792546943 shutdown_connections 2024-08-18T22:11:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.362+0000 7f19923e1740 1 --2- 172.21.15.123:0/2792546943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf802050 0x559ecf80dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.362+0000 7f19923e1740 1 --2- 172.21.15.123:0/2792546943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf7fcfc0 0x559ecf8017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.362+0000 7f19923e1740 1 --2- 172.21.15.123:0/2792546943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fc680 0x559ecf806c40 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.362+0000 7f19923e1740 1 -- 172.21.15.123:0/2792546943 >> 172.21.15.123:0/2792546943 conn(0x559ecf7f7cf0 msgr2=0x559ecf806530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.362+0000 7f19923e1740 1 -- 172.21.15.123:0/2792546943 shutdown_connections 2024-08-18T22:11:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.362+0000 7f19923e1740 1 -- 172.21.15.123:0/2792546943 wait complete. 2024-08-18T22:11:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.362+0000 7f19923e1740 1 -- start start 2024-08-18T22:11:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.363+0000 7f19923e1740 1 Processor -- start 2024-08-18T22:11:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.363+0000 7f19923e1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf7fc680 0x559ecf80b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.363+0000 7f19923e1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fcfc0 0x559ecf80ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.363+0000 7f19923e1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf802050 0x559ecf80caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:23.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.363+0000 7f19923e1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f19881aabb0 con 0x559ecf7fcfc0 2024-08-18T22:11:23.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.363+0000 7f19923e1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f19881ac020 con 0x559ecf7fc680 2024-08-18T22:11:23.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.363+0000 7f19923e1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f19881ab280 con 0x559ecf802050 2024-08-18T22:11:23.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.363+0000 7f19923e1740 10 client.0 _ll_register_callbacks cb 0x7f1984098060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:23.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.363+0000 7f198cbb9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fcfc0 0x559ecf80ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:23.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.363+0000 7f198cbb9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fcfc0 0x559ecf80ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58444/0 (socket says 172.21.15.123:58444) 2024-08-18T22:11:23.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.363+0000 7f198cbb9640 1 -- 172.21.15.123:0/2788747066 learned_addr learned my addr 172.21.15.123:0/2788747066 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:23.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.363+0000 7f198dbbb640 1 --2- 172.21.15.123:0/2788747066 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf802050 0x559ecf80caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:23.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.364+0000 7f198d3ba640 1 --2- 172.21.15.123:0/2788747066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf7fc680 0x559ecf80b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:23.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.364+0000 7f198cbb9640 1 -- 172.21.15.123:0/2788747066 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf802050 msgr2=0x559ecf80caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:23.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.364+0000 7f198cbb9640 1 --2- 172.21.15.123:0/2788747066 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf802050 0x559ecf80caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.364+0000 7f198cbb9640 1 -- 172.21.15.123:0/2788747066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf7fc680 msgr2=0x559ecf80b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:23.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.364+0000 7f198cbb9640 1 --2- 172.21.15.123:0/2788747066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf7fc680 0x559ecf80b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.364+0000 7f198cbb9640 1 -- 172.21.15.123:0/2788747066 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ecf80d0b0 con 0x559ecf7fcfc0 2024-08-18T22:11:23.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.364+0000 7f198d3ba640 1 --2- 172.21.15.123:0/2788747066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf7fc680 0x559ecf80b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:23.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.364+0000 7f198cbb9640 1 --2- 172.21.15.123:0/2788747066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fcfc0 0x559ecf80ba90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f19780319e0 tx=0x7f19780043f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba504f3ef3eb5ba server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:23.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.364+0000 7f1970ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:23.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.364+0000 7f1970ff9640 1 -- 172.21.15.123:0/2788747066 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978040040 con 0x559ecf7fcfc0 2024-08-18T22:11:23.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.364+0000 7f1970ff9640 1 -- 172.21.15.123:0/2788747066 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f1978059030 con 0x559ecf7fcfc0 2024-08-18T22:11:23.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.364+0000 7f19923e1740 1 -- 172.21.15.123:0/2788747066 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f197804e070 con 0x559ecf7fcfc0 2024-08-18T22:11:23.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.365+0000 7f1970ff9640 1 -- 172.21.15.123:0/2788747066 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1978035040 con 0x559ecf7fcfc0 2024-08-18T22:11:23.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.365+0000 7f19923e1740 10 client.15942 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:23.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.365+0000 7f19923e1740 1 -- 172.21.15.123:0/2788747066 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559ecf87cee0 con 0x559ecf7fcfc0 2024-08-18T22:11:23.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.365+0000 7f1970ff9640 1 -- 172.21.15.123:0/2788747066 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f197804e070 con 0x559ecf7fcfc0 2024-08-18T22:11:23.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.365+0000 7f1970ff9640 1 -- 172.21.15.123:0/2788747066 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f19780039d0 con 0x559ecf7fcfc0 2024-08-18T22:11:23.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.365+0000 7f19923e1740 10 client.15942 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:23.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.365+0000 7f19923e1740 10 client.15942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:23.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.365+0000 7f19923e1740 20 client.15942 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:23.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.365+0000 7f19923e1740 1 --2- 172.21.15.123:0/2788747066 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559ecf87d4a0 0x559ecf87f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:23.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.365+0000 7f19923e1740 4 client.15942 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:11:23.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.365+0000 7f19923e1740 1 -- 172.21.15.123:0/2788747066 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559ecf767450 con 0x559ecf87d4a0 2024-08-18T22:11:23.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.365+0000 7f198d3ba640 1 --2- 172.21.15.123:0/2788747066 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559ecf87d4a0 0x559ecf87f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:23.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.366+0000 7f198d3ba640 1 --2- 172.21.15.123:0/2788747066 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559ecf87d4a0 0x559ecf87f890 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a953c86bd1c9ac73 server_cookie=1e46b1396d2007d4 in_seq=0 out_seq=0 2024-08-18T22:11:23.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.366+0000 7f1970ff9640 10 client.15942 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:23.384 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f1970ff9640 1 -- 172.21.15.123:0/2788747066 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559ecf767450 con 0x559ecf87d4a0 2024-08-18T22:11:23.384 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f1970ff9640 10 client.15942 handle_command_reply: tid=0 2024-08-18T22:11:23.384 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f19923e1740 1 client.15942 shutdown 2024-08-18T22:11:23.384 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f19923e1740 1 -- 172.21.15.123:0/2788747066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fcfc0 msgr2=0x559ecf80ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:23.384 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f19923e1740 1 --2- 172.21.15.123:0/2788747066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fcfc0 0x559ecf80ba90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f19780319e0 tx=0x7f19780043f0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.384 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f19923e1740 1 -- 172.21.15.123:0/2788747066 shutdown_connections 2024-08-18T22:11:23.384 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f19923e1740 1 --2- 172.21.15.123:0/2788747066 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x559ecf87d4a0 0x559ecf87f890 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.384 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f19923e1740 1 --2- 172.21.15.123:0/2788747066 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559ecf802050 0x559ecf80caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.384 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f19923e1740 1 --2- 172.21.15.123:0/2788747066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559ecf7fcfc0 0x559ecf80ba90 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.384 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f1970ff9640 0 client.15942 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:23.384 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f19923e1740 1 --2- 172.21.15.123:0/2788747066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ecf7fc680 0x559ecf80b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f19923e1740 1 -- 172.21.15.123:0/2788747066 >> 172.21.15.123:0/2788747066 conn(0x559ecf7f7cf0 msgr2=0x559ecf7f8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f19923e1740 1 -- 172.21.15.123:0/2788747066 shutdown_connections 2024-08-18T22:11:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f19923e1740 1 -- 172.21.15.123:0/2788747066 wait complete. 2024-08-18T22:11:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f19923e1740 20 client.15942 trim_cache size 0 max 16384 2024-08-18T22:11:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:11:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:11:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:11:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:11:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f198f61e640 1 -- 172.21.15.123:0/2513983676 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f19740a2da0 msgr2=0x7f19740a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f198f61e640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f19740a2da0 0x7f19740a5260 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f198819b250 tx=0x7f19780315b0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f198f61e640 1 -- 172.21.15.123:0/2513983676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1988101890 msgr2=0x7f1988199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.383+0000 7f198f61e640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1988101890 0x7f1988199d40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1984005fd0 tx=0x7f198400c6a0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.384+0000 7f198f61e640 1 -- 172.21.15.123:0/2513983676 shutdown_connections 2024-08-18T22:11:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.384+0000 7f198f61e640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f19740a2da0 0x7f19740a5260 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.384+0000 7f198f61e640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1988103440 0x7f19881a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.384+0000 7f198f61e640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1988102a80 0x7f198819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.384+0000 7f198f61e640 1 --2- 172.21.15.123:0/2513983676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1988101890 0x7f1988199d40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.384+0000 7f198f61e640 1 -- 172.21.15.123:0/2513983676 >> 172.21.15.123:0/2513983676 conn(0x7f19880fcff0 msgr2=0x7f1988074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.384+0000 7f198f61e640 1 -- 172.21.15.123:0/2513983676 shutdown_connections 2024-08-18T22:11:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:23.384+0000 7f198f61e640 1 -- 172.21.15.123:0/2513983676 wait complete. 2024-08-18T22:11:23.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:23 smithi183 ceph-mon[22097]: pgmap v448: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-08-18T22:11:23.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:23 smithi130 ceph-mon[21698]: pgmap v448: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-08-18T22:11:23.871 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:11:23.871 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:11:23.890 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:23.890 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:23.890 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 98 -lt 100 ']' 2024-08-18T22:11:23.891 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 98 + 1 2024-08-18T22:11:23.967 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=99 2024-08-18T22:11:23.967 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:11:24.001 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:24.001 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:24.002 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:11:24.002 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:11:24.003 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:11:24.841 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:24.841 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:25.299 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:11:25.299 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:11:25.324 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:25.324 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:25.324 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 99 -lt 100 ']' 2024-08-18T22:11:25.324 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 99 + 1 2024-08-18T22:11:25.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:25 smithi183 ceph-mon[22097]: pgmap v449: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-08-18T22:11:25.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:25 smithi123 ceph-mon[18462]: pgmap v449: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-08-18T22:11:25.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:25 smithi130 ceph-mon[21698]: pgmap v449: 129 pgs: 129 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-08-18T22:11:25.516 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=100 2024-08-18T22:11:25.516 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:11:25.566 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:25.566 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:25.568 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-08-18T22:11:25.568 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-08-18T22:11:25.568 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-08-18T22:11:26.407 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-08-18T22:11:26.407 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-08-18T22:11:26.743 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-08-18T22:11:26.743 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:11:26.773 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:26.774 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-08-18T22:11:26.774 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 100 -lt 100 ']' 2024-08-18T22:11:26.787 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-08-18T22:11:26.808 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n system.posix_acl_access -v 0x02000000 d1 2024-08-18T22:11:26.820 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n system.posix_acl_default -v 0x02000000 . 2024-08-18T22:11:26.822 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_failure getfattr -n system.posix_acl_access d1 2024-08-18T22:11:26.822 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n system.posix_acl_access d1 2024-08-18T22:11:26.837 INFO:tasks.workunit.client.0.smithi123.stderr:d1: system.posix_acl_access: No such attribute 2024-08-18T22:11:26.837 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2024-08-18T22:11:26.837 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_failure getfattr -n system.posix_acl_default . 2024-08-18T22:11:26.837 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n system.posix_acl_default . 2024-08-18T22:11:26.838 INFO:tasks.workunit.client.0.smithi123.stderr:.: system.posix_acl_default: No such attribute 2024-08-18T22:11:26.838 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2024-08-18T22:11:26.838 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-08-18T22:11:26.841 INFO:tasks.workunit.client.0.smithi123.stderr:+ cd .. 2024-08-18T22:11:26.847 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir testdir 2024-08-18T22:11:26.854 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo OK 2024-08-18T22:11:26.855 INFO:tasks.workunit.client.0.smithi123.stdout:OK 2024-08-18T22:11:26.856 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-18T22:11:26.856 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-18T22:11:27.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:27 smithi123 ceph-mon[18462]: pgmap v450: 129 pgs: 129 active+clean; 2.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 KiB/s wr, 11 op/s 2024-08-18T22:11:27.287 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:11:27.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:27 smithi183 ceph-mon[22097]: pgmap v450: 129 pgs: 129 active+clean; 2.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 KiB/s wr, 11 op/s 2024-08-18T22:11:27.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:27 smithi130 ceph-mon[21698]: pgmap v450: 129 pgs: 129 active+clean; 2.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 KiB/s wr, 11 op/s 2024-08-18T22:11:27.554 INFO:tasks.workunit:Running workunit fs/misc/chmod.sh... 2024-08-18T22:11:27.555 DEBUG:teuthology.orchestra.run.smithi123:workunit test fs/misc/chmod.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh 2024-08-18T22:11:27.730 INFO:tasks.workunit.client.0.smithi123.stderr:+ set -e 2024-08-18T22:11:27.730 INFO:tasks.workunit.client.0.smithi123.stderr:+ file=test_chmod.77693 2024-08-18T22:11:27.730 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo foo 2024-08-18T22:11:27.734 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 0 '!=' 0 2024-08-18T22:11:27.734 INFO:tasks.workunit.client.0.smithi123.stderr:+ chmod 400 test_chmod.77693 2024-08-18T22:11:27.744 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 0 '!=' 0 2024-08-18T22:11:27.744 INFO:tasks.workunit.client.0.smithi123.stderr:+ check_perms test_chmod.77693 -r-------- 2024-08-18T22:11:27.745 INFO:tasks.workunit.client.0.smithi123.stderr:+ file=test_chmod.77693 2024-08-18T22:11:27.745 INFO:tasks.workunit.client.0.smithi123.stderr:++ ls -la test_chmod.77693 2024-08-18T22:11:27.823 INFO:tasks.workunit.client.0.smithi123.stderr:+ r='-r--------. 1 ubuntu ubuntu 4 Aug 18 22:11 test_chmod.77693' 2024-08-18T22:11:27.823 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 0 '!=' 0 2024-08-18T22:11:27.823 INFO:tasks.workunit.client.0.smithi123.stderr:+ perms=-r-------- 2024-08-18T22:11:27.824 INFO:tasks.workunit.client.0.smithi123.stderr:++ echo -r--------. 1 ubuntu ubuntu 4 Aug 18 22:11 test_chmod.77693 2024-08-18T22:11:27.824 INFO:tasks.workunit.client.0.smithi123.stderr:++ awk '{print $1}' 2024-08-18T22:11:28.132 INFO:tasks.workunit.client.0.smithi123.stderr:+ test -r-------- '!=' -r--------. 2024-08-18T22:11:28.133 INFO:tasks.workunit.client.0.smithi123.stderr:++ echo -r--------. 1 ubuntu ubuntu 4 Aug 18 22:11 test_chmod.77693 2024-08-18T22:11:28.133 INFO:tasks.workunit.client.0.smithi123.stderr:++ awk '{print $1}' 2024-08-18T22:11:28.135 INFO:tasks.workunit.client.0.smithi123.stderr:+ test -r--------. '!=' -r--------. 2024-08-18T22:11:28.135 INFO:tasks.workunit.client.0.smithi123.stderr:+ set +e 2024-08-18T22:11:28.136 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo bar 2024-08-18T22:11:28.136 INFO:tasks.workunit.client.0.smithi123.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh: line 40: test_chmod.77693: Permission denied 2024-08-18T22:11:28.136 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 1 = 0 2024-08-18T22:11:28.136 INFO:tasks.workunit.client.0.smithi123.stderr:+ set -e 2024-08-18T22:11:28.136 INFO:tasks.workunit.client.0.smithi123.stderr:+ chmod 600 test_chmod.77693 2024-08-18T22:11:28.138 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo bar 2024-08-18T22:11:28.138 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 0 '!=' 0 2024-08-18T22:11:28.138 INFO:tasks.workunit.client.0.smithi123.stderr:+ check_perms test_chmod.77693 -rw------- 2024-08-18T22:11:28.138 INFO:tasks.workunit.client.0.smithi123.stderr:+ file=test_chmod.77693 2024-08-18T22:11:28.138 INFO:tasks.workunit.client.0.smithi123.stderr:++ ls -la test_chmod.77693 2024-08-18T22:11:28.138 INFO:tasks.workunit.client.0.smithi123.stderr:+ r='-rw-------. 1 ubuntu ubuntu 8 Aug 18 22:11 test_chmod.77693' 2024-08-18T22:11:28.138 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 0 '!=' 0 2024-08-18T22:11:28.138 INFO:tasks.workunit.client.0.smithi123.stderr:+ perms=-rw------- 2024-08-18T22:11:28.139 INFO:tasks.workunit.client.0.smithi123.stderr:++ echo -rw-------. 1 ubuntu ubuntu 8 Aug 18 22:11 test_chmod.77693 2024-08-18T22:11:28.139 INFO:tasks.workunit.client.0.smithi123.stderr:++ awk '{print $1}' 2024-08-18T22:11:28.141 INFO:tasks.workunit.client.0.smithi123.stderr:+ test -rw------- '!=' -rw-------. 2024-08-18T22:11:28.141 INFO:tasks.workunit.client.0.smithi123.stderr:++ echo -rw-------. 1 ubuntu ubuntu 8 Aug 18 22:11 test_chmod.77693 2024-08-18T22:11:28.142 INFO:tasks.workunit.client.0.smithi123.stderr:++ awk '{print $1}' 2024-08-18T22:11:28.144 INFO:tasks.workunit.client.0.smithi123.stderr:+ test -rw-------. '!=' -rw-------. 2024-08-18T22:11:28.144 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo foo 2024-08-18T22:11:28.144 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 0 '!=' 0 2024-08-18T22:11:28.144 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-18T22:11:28.145 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-18T22:11:28.188 INFO:tasks.workunit:Running workunit fs/misc/dac_override.sh... 2024-08-18T22:11:28.188 DEBUG:teuthology.orchestra.run.smithi123:workunit test fs/misc/dac_override.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dac_override.sh 2024-08-18T22:11:28.253 INFO:tasks.workunit.client.0.smithi123.stderr:+ set -e 2024-08-18T22:11:28.253 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir -p testdir 2024-08-18T22:11:28.255 INFO:tasks.workunit.client.0.smithi123.stderr:+ file=test_chmod.77748 2024-08-18T22:11:28.255 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo foo 2024-08-18T22:11:28.256 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo chmod 600 testdir 2024-08-18T22:11:28.269 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_failure cat testdir/test_chmod.77748 2024-08-18T22:11:28.269 INFO:tasks.workunit.client.0.smithi123.stderr:+ cat testdir/test_chmod.77748 2024-08-18T22:11:28.270 INFO:tasks.workunit.client.0.smithi123.stderr:cat: testdir/test_chmod.77748: Permission denied 2024-08-18T22:11:28.270 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2024-08-18T22:11:28.270 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo cat testdir/test_chmod.77748 2024-08-18T22:11:28.286 INFO:tasks.workunit.client.0.smithi123.stdout:foo 2024-08-18T22:11:28.288 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-18T22:11:28.288 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-18T22:11:28.378 INFO:tasks.workunit:Running workunit fs/misc/direct_io.py... 2024-08-18T22:11:28.378 DEBUG:teuthology.orchestra.run.smithi123:workunit test fs/misc/direct_io.py> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/direct_io.py 2024-08-18T22:11:29.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:29 smithi183 ceph-mon[22097]: pgmap v451: 129 pgs: 129 active+clean; 2.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.9 KiB/s wr, 10 op/s 2024-08-18T22:11:29.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:29 smithi123 ceph-mon[18462]: pgmap v451: 129 pgs: 129 active+clean; 2.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.9 KiB/s wr, 10 op/s 2024-08-18T22:11:29.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:29 smithi130 ceph-mon[21698]: pgmap v451: 129 pgs: 129 active+clean; 2.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.9 KiB/s wr, 10 op/s 2024-08-18T22:11:30.433 INFO:tasks.workunit.client.0.smithi123.stdout:ok 2024-08-18T22:11:30.438 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-18T22:11:30.438 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-18T22:11:30.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.462+0000 7f634c4ad640 1 -- 172.21.15.123:0/3398167821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6344103410 msgr2=0x7f63441078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:30.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.462+0000 7f634c4ad640 1 --2- 172.21.15.123:0/3398167821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6344103410 0x7f63441078c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6334009930 tx=0x7f633402a420 comp rx=0 tx=0).stop 2024-08-18T22:11:30.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.462+0000 7f634c4ad640 1 -- 172.21.15.123:0/3398167821 shutdown_connections 2024-08-18T22:11:30.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.462+0000 7f634c4ad640 1 --2- 172.21.15.123:0/3398167821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6344107fd0 0x7f634410e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.462+0000 7f634c4ad640 1 --2- 172.21.15.123:0/3398167821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6344103410 0x7f63441078c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.462+0000 7f634c4ad640 1 --2- 172.21.15.123:0/3398167821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6344102a60 0x7f6344102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.462+0000 7f634c4ad640 1 -- 172.21.15.123:0/3398167821 >> 172.21.15.123:0/3398167821 conn(0x7f63440fc500 msgr2=0x7f63440fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:30.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.462+0000 7f634c4ad640 1 -- 172.21.15.123:0/3398167821 shutdown_connections 2024-08-18T22:11:30.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.462+0000 7f634c4ad640 1 -- 172.21.15.123:0/3398167821 wait complete. 2024-08-18T22:11:30.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.463+0000 7f634c4ad640 1 Processor -- start 2024-08-18T22:11:30.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.463+0000 7f634c4ad640 1 -- start start 2024-08-18T22:11:30.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.463+0000 7f634c4ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6344102a60 0x7f63441006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.463+0000 7f634c4ad640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6344103410 0x7f6344100c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.463+0000 7f634c4ad640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6344107fd0 0x7f6344101140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.463+0000 7f634c4ad640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6344111dd0 con 0x7f6344103410 2024-08-18T22:11:30.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.463+0000 7f634c4ad640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6344111c50 con 0x7f6344102a60 2024-08-18T22:11:30.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.463+0000 7f634c4ad640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6344111f50 con 0x7f6344107fd0 2024-08-18T22:11:30.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.463+0000 7f6349a48640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6344103410 0x7f6344100c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.463+0000 7f6349a48640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6344103410 0x7f6344100c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58484/0 (socket says 172.21.15.123:58484) 2024-08-18T22:11:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.463+0000 7f6349a48640 1 -- 172.21.15.123:0/2560305461 learned_addr learned my addr 172.21.15.123:0/2560305461 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.464+0000 7f634a249640 1 --2- 172.21.15.123:0/2560305461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6344102a60 0x7f63441006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.464+0000 7f634aa4a640 1 --2- 172.21.15.123:0/2560305461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6344107fd0 0x7f6344101140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.464+0000 7f6349a48640 1 -- 172.21.15.123:0/2560305461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6344107fd0 msgr2=0x7f6344101140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.464+0000 7f6349a48640 1 --2- 172.21.15.123:0/2560305461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6344107fd0 0x7f6344101140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.464+0000 7f6349a48640 1 -- 172.21.15.123:0/2560305461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6344102a60 msgr2=0x7f63441006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.464+0000 7f6349a48640 1 --2- 172.21.15.123:0/2560305461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6344102a60 0x7f63441006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.464+0000 7f6349a48640 1 -- 172.21.15.123:0/2560305461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63441a6870 con 0x7f6344103410 2024-08-18T22:11:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.464+0000 7f6349a48640 1 --2- 172.21.15.123:0/2560305461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6344103410 0x7f6344100c00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6334005940 tx=0x7f63340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.464+0000 7f633b7fe640 1 -- 172.21.15.123:0/2560305461 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633403f030 con 0x7f6344103410 2024-08-18T22:11:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.464+0000 7f633b7fe640 1 -- 172.21.15.123:0/2560305461 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6334003ce0 con 0x7f6344103410 2024-08-18T22:11:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.464+0000 7f633b7fe640 1 -- 172.21.15.123:0/2560305461 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6334035070 con 0x7f6344103410 2024-08-18T22:11:30.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.464+0000 7f634c4ad640 1 -- 172.21.15.123:0/2560305461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63441a6b00 con 0x7f6344103410 2024-08-18T22:11:30.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.465+0000 7f634c4ad640 1 -- 172.21.15.123:0/2560305461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63441a6f90 con 0x7f6344103410 2024-08-18T22:11:30.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.467+0000 7f633b7fe640 1 -- 172.21.15.123:0/2560305461 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f6334042030 con 0x7f6344103410 2024-08-18T22:11:30.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.468+0000 7f633b7fe640 1 --2- 172.21.15.123:0/2560305461 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f63300a2c00 0x7f63300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.468+0000 7f634a249640 1 --2- 172.21.15.123:0/2560305461 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f63300a2c00 0x7f63300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.468+0000 7f633b7fe640 1 -- 172.21.15.123:0/2560305461 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f63340ef370 con 0x7f6344103410 2024-08-18T22:11:30.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.468+0000 7f634a249640 1 --2- 172.21.15.123:0/2560305461 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f63300a2c00 0x7f63300a50c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f634000bbe0 tx=0x7f634000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:30.478 INFO:tasks.workunit:Running workunit fs/misc/dirfrag.sh... 2024-08-18T22:11:30.479 DEBUG:teuthology.orchestra.run.smithi123:workunit test fs/misc/dirfrag.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dirfrag.sh 2024-08-18T22:11:30.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.491+0000 7f634e8ab740 1 Processor -- start 2024-08-18T22:11:30.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.491+0000 7f634e8ab740 1 -- start start 2024-08-18T22:11:30.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634e8ab740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba948425e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634e8ab740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842b20 0x55ba9484cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634e8ab740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba9484d3e0 0x55ba9484f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634e8ab740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ba94805e40 con 0x55ba94842200 2024-08-18T22:11:30.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634e8ab740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ba947a77f0 con 0x55ba9484d3e0 2024-08-18T22:11:30.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634e8ab740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ba9474efb0 con 0x55ba94842b20 2024-08-18T22:11:30.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634a249640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba948425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634a249640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba948425e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58486/0 (socket says 172.21.15.123:58486) 2024-08-18T22:11:30.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634a249640 1 -- 172.21.15.123:0/3916902339 learned_addr learned my addr 172.21.15.123:0/3916902339 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:30.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634aa4a640 1 --2- 172.21.15.123:0/3916902339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba9484d3e0 0x55ba9484f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f6349a48640 1 --2- 172.21.15.123:0/3916902339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842b20 0x55ba9484cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634a249640 1 -- 172.21.15.123:0/3916902339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842b20 msgr2=0x55ba9484cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:30.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634a249640 1 --2- 172.21.15.123:0/3916902339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842b20 0x55ba9484cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634a249640 1 -- 172.21.15.123:0/3916902339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba9484d3e0 msgr2=0x55ba9484f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:30.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634a249640 1 --2- 172.21.15.123:0/3916902339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba9484d3e0 0x55ba9484f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634a249640 1 -- 172.21.15.123:0/3916902339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba945196a0 con 0x55ba94842200 2024-08-18T22:11:30.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f6349a48640 1 --2- 172.21.15.123:0/3916902339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842b20 0x55ba9484cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:11:30.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634aa4a640 1 --2- 172.21.15.123:0/3916902339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba9484d3e0 0x55ba9484f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:30.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.492+0000 7f634a249640 1 --2- 172.21.15.123:0/3916902339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba948425e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6340005d00 tx=0x7f6340013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5850149a81e56d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:30.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.493+0000 7f6338ff9640 1 -- 172.21.15.123:0/3916902339 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340005220 con 0x55ba94842200 2024-08-18T22:11:30.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.493+0000 7f6338ff9640 1 -- 172.21.15.123:0/3916902339 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6340004c80 con 0x55ba94842200 2024-08-18T22:11:30.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.493+0000 7f6338ff9640 1 -- 172.21.15.123:0/3916902339 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634001ea70 con 0x55ba94842200 2024-08-18T22:11:30.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.493+0000 7f634e8ab740 1 -- 172.21.15.123:0/3916902339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 msgr2=0x55ba948425e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:30.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.493+0000 7f634e8ab740 1 --2- 172.21.15.123:0/3916902339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba948425e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6340005d00 tx=0x7f6340013000 comp rx=0 tx=0).stop 2024-08-18T22:11:30.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.494+0000 7f634e8ab740 1 -- 172.21.15.123:0/3916902339 shutdown_connections 2024-08-18T22:11:30.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.494+0000 7f634e8ab740 1 --2- 172.21.15.123:0/3916902339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba9484d3e0 0x55ba9484f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.494+0000 7f634e8ab740 1 --2- 172.21.15.123:0/3916902339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842b20 0x55ba9484cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.494+0000 7f634e8ab740 1 --2- 172.21.15.123:0/3916902339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba948425e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.494+0000 7f634e8ab740 1 -- 172.21.15.123:0/3916902339 >> 172.21.15.123:0/3916902339 conn(0x55ba9483e790 msgr2=0x55ba9483eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:30.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.494+0000 7f634e8ab740 1 -- 172.21.15.123:0/3916902339 shutdown_connections 2024-08-18T22:11:30.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.494+0000 7f634e8ab740 1 -- 172.21.15.123:0/3916902339 wait complete. 2024-08-18T22:11:30.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.494+0000 7f634e8ab740 1 -- start start 2024-08-18T22:11:30.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.494+0000 7f634e8ab740 1 Processor -- start 2024-08-18T22:11:30.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.494+0000 7f634e8ab740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842200 0x55ba9484a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.494+0000 7f634e8ab740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba94842b20 0x55ba9484a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.494+0000 7f634e8ab740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba9484d3e0 0x55ba9484ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.494+0000 7f634e8ab740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ba94762cb0 con 0x55ba9484d3e0 2024-08-18T22:11:30.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.494+0000 7f634e8ab740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ba947a37b0 con 0x55ba94842b20 2024-08-18T22:11:30.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.494+0000 7f634e8ab740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ba9484ffb0 con 0x55ba94842200 2024-08-18T22:11:30.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.495+0000 7f634e8ab740 10 client.0 _ll_register_callbacks cb 0x55ba944b6ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:30.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.495+0000 7f634aa4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba9484d3e0 0x55ba9484ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.495+0000 7f634aa4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba9484d3e0 0x55ba9484ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58490/0 (socket says 172.21.15.123:58490) 2024-08-18T22:11:30.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.495+0000 7f634aa4a640 1 -- 172.21.15.123:0/2644035520 learned_addr learned my addr 172.21.15.123:0/2644035520 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:30.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.495+0000 7f634a249640 1 --2- 172.21.15.123:0/2644035520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842200 0x55ba9484a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.495+0000 7f6349a48640 1 --2- 172.21.15.123:0/2644035520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba94842b20 0x55ba9484a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.495+0000 7f634aa4a640 1 -- 172.21.15.123:0/2644035520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842200 msgr2=0x55ba9484a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:30.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.495+0000 7f634aa4a640 1 --2- 172.21.15.123:0/2644035520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842200 0x55ba9484a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.495+0000 7f634aa4a640 1 -- 172.21.15.123:0/2644035520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba94842b20 msgr2=0x55ba9484a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:30.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.495+0000 7f634aa4a640 1 --2- 172.21.15.123:0/2644035520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba94842b20 0x55ba9484a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.495+0000 7f634aa4a640 1 -- 172.21.15.123:0/2644035520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba94761bc0 con 0x55ba9484d3e0 2024-08-18T22:11:30.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.495+0000 7f634aa4a640 1 --2- 172.21.15.123:0/2644035520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba9484d3e0 0x55ba9484ad40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f633c0127b0 tx=0x7f633c012c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9355e6c78e8656 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:30.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.495+0000 7f632dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:30.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.495+0000 7f632dffb640 1 -- 172.21.15.123:0/2644035520 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c003d80 con 0x55ba9484d3e0 2024-08-18T22:11:30.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.496+0000 7f632dffb640 1 -- 172.21.15.123:0/2644035520 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f633c0109b0 con 0x55ba9484d3e0 2024-08-18T22:11:30.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.496+0000 7f634e8ab740 1 -- 172.21.15.123:0/2644035520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6340004c80 con 0x55ba9484d3e0 2024-08-18T22:11:30.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.496+0000 7f632dffb640 1 -- 172.21.15.123:0/2644035520 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f633c010bb0 con 0x55ba9484d3e0 2024-08-18T22:11:30.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.496+0000 7f634e8ab740 10 client.15972 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:30.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.496+0000 7f634e8ab740 1 -- 172.21.15.123:0/2644035520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ba9485be40 con 0x55ba9484d3e0 2024-08-18T22:11:30.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.496+0000 7f632dffb640 1 -- 172.21.15.123:0/2644035520 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6340004c80 con 0x55ba9484d3e0 2024-08-18T22:11:30.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.496+0000 7f632dffb640 1 -- 172.21.15.123:0/2644035520 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f633c019070 con 0x55ba9484d3e0 2024-08-18T22:11:30.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.496+0000 7f634e8ab740 10 client.15972 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:30.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.496+0000 7f634e8ab740 10 client.15972 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:30.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.496+0000 7f634e8ab740 20 client.15972 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:30.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.496+0000 7f634e8ab740 1 --2- 172.21.15.123:0/2644035520 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ba9485d350 0x55ba9485f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.496+0000 7f634e8ab740 4 client.15972 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:30.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.496+0000 7f634e8ab740 1 -- 172.21.15.123:0/2644035520 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba947b4d60 con 0x55ba9485d350 2024-08-18T22:11:30.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.497+0000 7f634a249640 1 --2- 172.21.15.123:0/2644035520 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ba9485d350 0x55ba9485f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.497+0000 7f634a249640 1 --2- 172.21.15.123:0/2644035520 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ba9485d350 0x55ba9485f770 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c1c8a6fbb19c00d server_cookie=7055a905ce42a935 in_seq=0 out_seq=0 2024-08-18T22:11:30.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.497+0000 7f632dffb640 10 client.15972 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:30.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.498+0000 7f632dffb640 1 -- 172.21.15.123:0/2644035520 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba947b4d60 con 0x55ba9485d350 2024-08-18T22:11:30.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.498+0000 7f632dffb640 10 client.15972 handle_command_reply: tid=0 2024-08-18T22:11:30.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.498+0000 7f634e8ab740 1 client.15972 shutdown 2024-08-18T22:11:30.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.498+0000 7f634e8ab740 1 -- 172.21.15.123:0/2644035520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba9484d3e0 msgr2=0x55ba9484ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:30.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.498+0000 7f634e8ab740 1 --2- 172.21.15.123:0/2644035520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba9484d3e0 0x55ba9484ad40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f633c0127b0 tx=0x7f633c012c70 comp rx=0 tx=0).stop 2024-08-18T22:11:30.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.498+0000 7f634e8ab740 1 -- 172.21.15.123:0/2644035520 shutdown_connections 2024-08-18T22:11:30.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.498+0000 7f634e8ab740 1 --2- 172.21.15.123:0/2644035520 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ba9485d350 0x55ba9485f770 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.498+0000 7f634e8ab740 1 --2- 172.21.15.123:0/2644035520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba9484d3e0 0x55ba9484ad40 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.498+0000 7f634e8ab740 1 --2- 172.21.15.123:0/2644035520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba94842b20 0x55ba9484a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.498+0000 7f632dffb640 0 client.15972 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:30.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.498+0000 7f634e8ab740 1 --2- 172.21.15.123:0/2644035520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842200 0x55ba9484a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.498+0000 7f634e8ab740 1 -- 172.21.15.123:0/2644035520 >> 172.21.15.123:0/2644035520 conn(0x55ba9483e790 msgr2=0x55ba94844470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:30.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.498+0000 7f634e8ab740 1 -- 172.21.15.123:0/2644035520 shutdown_connections 2024-08-18T22:11:30.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.498+0000 7f634e8ab740 1 -- 172.21.15.123:0/2644035520 wait complete. 2024-08-18T22:11:30.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.498+0000 7f634e8ab740 20 client.15972 trim_cache size 0 max 16384 2024-08-18T22:11:30.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634e8ab740 1 Processor -- start 2024-08-18T22:11:30.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634e8ab740 1 -- start start 2024-08-18T22:11:30.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634e8ab740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba9484ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634e8ab740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842b20 0x55ba9483d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634e8ab740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba9484d3e0 0x55ba94865040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634e8ab740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f63441b35e0 con 0x55ba94842200 2024-08-18T22:11:30.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634e8ab740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f63441b0eb0 con 0x55ba9484d3e0 2024-08-18T22:11:30.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634e8ab740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f63441aed00 con 0x55ba94842b20 2024-08-18T22:11:30.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634a249640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba9484ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634a249640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba9484ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58498/0 (socket says 172.21.15.123:58498) 2024-08-18T22:11:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634a249640 1 -- 172.21.15.123:0/3544706062 learned_addr learned my addr 172.21.15.123:0/3544706062 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634aa4a640 1 --2- 172.21.15.123:0/3544706062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba9484d3e0 0x55ba94865040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f6349a48640 1 --2- 172.21.15.123:0/3544706062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842b20 0x55ba9483d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634a249640 1 -- 172.21.15.123:0/3544706062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842b20 msgr2=0x55ba9483d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634a249640 1 --2- 172.21.15.123:0/3544706062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842b20 0x55ba9483d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634a249640 1 -- 172.21.15.123:0/3544706062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba9484d3e0 msgr2=0x55ba94865040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634a249640 1 --2- 172.21.15.123:0/3544706062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba9484d3e0 0x55ba94865040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f634a249640 1 -- 172.21.15.123:0/3544706062 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba9485fdf0 con 0x55ba94842200 2024-08-18T22:11:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.516+0000 7f6349a48640 1 --2- 172.21.15.123:0/3544706062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842b20 0x55ba9483d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:11:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.517+0000 7f634a249640 1 --2- 172.21.15.123:0/3544706062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba9484ab60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f6340010860 tx=0x7f634001e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf546f34c37dc84 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.517+0000 7f632ffff640 1 -- 172.21.15.123:0/3544706062 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634001e700 con 0x55ba94842200 2024-08-18T22:11:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.517+0000 7f632ffff640 1 -- 172.21.15.123:0/3544706062 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f634001ed80 con 0x55ba94842200 2024-08-18T22:11:30.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.517+0000 7f632ffff640 1 -- 172.21.15.123:0/3544706062 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634003dac0 con 0x55ba94842200 2024-08-18T22:11:30.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.517+0000 7f634e8ab740 1 -- 172.21.15.123:0/3544706062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 msgr2=0x55ba9484ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:30.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 --2- 172.21.15.123:0/3544706062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba9484ab60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f6340010860 tx=0x7f634001e530 comp rx=0 tx=0).stop 2024-08-18T22:11:30.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 -- 172.21.15.123:0/3544706062 shutdown_connections 2024-08-18T22:11:30.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 --2- 172.21.15.123:0/3544706062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba9484d3e0 0x55ba94865040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 --2- 172.21.15.123:0/3544706062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba94842b20 0x55ba9483d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 --2- 172.21.15.123:0/3544706062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba9484ab60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 -- 172.21.15.123:0/3544706062 >> 172.21.15.123:0/3544706062 conn(0x55ba9483e790 msgr2=0x55ba9483d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:30.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 -- 172.21.15.123:0/3544706062 shutdown_connections 2024-08-18T22:11:30.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 -- 172.21.15.123:0/3544706062 wait complete. 2024-08-18T22:11:30.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 -- start start 2024-08-18T22:11:30.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 Processor -- start 2024-08-18T22:11:30.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba948553e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba94842b20 0x55ba94855920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba9484d3e0 0x55ba948521d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f63441af370 con 0x55ba94842200 2024-08-18T22:11:30.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f63441b07e0 con 0x55ba94842b20 2024-08-18T22:11:30.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f63441afa40 con 0x55ba9484d3e0 2024-08-18T22:11:30.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634e8ab740 10 client.0 _ll_register_callbacks cb 0x7f633c009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:30.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.518+0000 7f634a249640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba948553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.519+0000 7f634a249640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba948553e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58504/0 (socket says 172.21.15.123:58504) 2024-08-18T22:11:30.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.519+0000 7f634a249640 1 -- 172.21.15.123:0/1712363652 learned_addr learned my addr 172.21.15.123:0/1712363652 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:30.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.519+0000 7f634aa4a640 1 --2- 172.21.15.123:0/1712363652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba9484d3e0 0x55ba948521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.519+0000 7f6349a48640 1 --2- 172.21.15.123:0/1712363652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba94842b20 0x55ba94855920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.519+0000 7f634a249640 1 -- 172.21.15.123:0/1712363652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba9484d3e0 msgr2=0x55ba948521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:30.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.519+0000 7f634a249640 1 --2- 172.21.15.123:0/1712363652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba9484d3e0 0x55ba948521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.519+0000 7f634a249640 1 -- 172.21.15.123:0/1712363652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba94842b20 msgr2=0x55ba94855920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:30.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.519+0000 7f634a249640 1 --2- 172.21.15.123:0/1712363652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba94842b20 0x55ba94855920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.519+0000 7f634a249640 1 -- 172.21.15.123:0/1712363652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba94852890 con 0x55ba94842200 2024-08-18T22:11:30.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.519+0000 7f634a249640 1 --2- 172.21.15.123:0/1712363652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba948553e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f634003d530 tx=0x7f634003d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58af24d142e117 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:30.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.519+0000 7f632dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:30.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.519+0000 7f632dffb640 1 -- 172.21.15.123:0/1712363652 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340041020 con 0x55ba94842200 2024-08-18T22:11:30.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.519+0000 7f632dffb640 1 -- 172.21.15.123:0/1712363652 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f634003dd50 con 0x55ba94842200 2024-08-18T22:11:30.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.519+0000 7f634e8ab740 1 -- 172.21.15.123:0/1712363652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f634001ed80 con 0x55ba94842200 2024-08-18T22:11:30.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.520+0000 7f632dffb640 1 -- 172.21.15.123:0/1712363652 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f634004c050 con 0x55ba94842200 2024-08-18T22:11:30.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.520+0000 7f634e8ab740 10 client.15978 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:30.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.520+0000 7f634e8ab740 1 -- 172.21.15.123:0/1712363652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ba948c8950 con 0x55ba94842200 2024-08-18T22:11:30.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.520+0000 7f632dffb640 1 -- 172.21.15.123:0/1712363652 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f634001ea80 con 0x55ba94842200 2024-08-18T22:11:30.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.520+0000 7f632dffb640 1 -- 172.21.15.123:0/1712363652 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6340004740 con 0x55ba94842200 2024-08-18T22:11:30.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.520+0000 7f634e8ab740 10 client.15978 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:30.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.520+0000 7f634e8ab740 10 client.15978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:30.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.520+0000 7f634e8ab740 20 client.15978 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:30.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.520+0000 7f634e8ab740 1 --2- 172.21.15.123:0/1712363652 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ba948c8e60 0x55ba948cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:30.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.520+0000 7f634e8ab740 4 client.15978 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-18T22:11:30.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.520+0000 7f634e8ab740 1 -- 172.21.15.123:0/1712363652 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f634001ed80 con 0x55ba948c8e60 2024-08-18T22:11:30.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.521+0000 7f6349a48640 1 --2- 172.21.15.123:0/1712363652 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ba948c8e60 0x55ba948cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:30.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.521+0000 7f6349a48640 1 --2- 172.21.15.123:0/1712363652 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ba948c8e60 0x55ba948cb250 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31a7e6f645b99cfd server_cookie=6022ef21aa78ef0a in_seq=0 out_seq=0 2024-08-18T22:11:30.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.521+0000 7f632dffb640 10 client.15978 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:30.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.522+0000 7f632dffb640 1 -- 172.21.15.123:0/1712363652 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f634001ed80 con 0x55ba948c8e60 2024-08-18T22:11:30.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.522+0000 7f632dffb640 10 client.15978 handle_command_reply: tid=0 2024-08-18T22:11:30.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.522+0000 7f634e8ab740 1 client.15978 shutdown 2024-08-18T22:11:30.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.522+0000 7f634e8ab740 1 -- 172.21.15.123:0/1712363652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 msgr2=0x55ba948553e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:30.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.522+0000 7f634e8ab740 1 --2- 172.21.15.123:0/1712363652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba948553e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f634003d530 tx=0x7f634003d560 comp rx=0 tx=0).stop 2024-08-18T22:11:30.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.522+0000 7f634e8ab740 1 -- 172.21.15.123:0/1712363652 shutdown_connections 2024-08-18T22:11:30.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.522+0000 7f634e8ab740 1 --2- 172.21.15.123:0/1712363652 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ba948c8e60 0x55ba948cb250 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.522+0000 7f634e8ab740 1 --2- 172.21.15.123:0/1712363652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ba9484d3e0 0x55ba948521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.522+0000 7f634e8ab740 1 --2- 172.21.15.123:0/1712363652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba94842b20 0x55ba94855920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.522+0000 7f632dffb640 0 client.15978 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:30.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.522+0000 7f634e8ab740 1 --2- 172.21.15.123:0/1712363652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ba94842200 0x55ba948553e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.522+0000 7f634e8ab740 1 -- 172.21.15.123:0/1712363652 >> 172.21.15.123:0/1712363652 conn(0x55ba9483e790 msgr2=0x55ba9483d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:30.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.522+0000 7f634e8ab740 1 -- 172.21.15.123:0/1712363652 shutdown_connections 2024-08-18T22:11:30.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.522+0000 7f634e8ab740 1 -- 172.21.15.123:0/1712363652 wait complete. 2024-08-18T22:11:30.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.522+0000 7f634e8ab740 20 client.15978 trim_cache size 0 max 16384 2024-08-18T22:11:30.528 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:11:30.528 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-08-18T22:11:30.528 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "76ece515-adc8-47ca-ad74-285d664bb3b4", 2024-08-18T22:11:30.528 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-08-18T22:11:30.528 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:11:30.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.523+0000 7f634c4ad640 1 -- 172.21.15.123:0/2560305461 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f63300a2c00 msgr2=0x7f63300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:30.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.523+0000 7f634c4ad640 1 --2- 172.21.15.123:0/2560305461 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f63300a2c00 0x7f63300a50c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f634000bbe0 tx=0x7f634000b390 comp rx=0 tx=0).stop 2024-08-18T22:11:30.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.523+0000 7f634c4ad640 1 -- 172.21.15.123:0/2560305461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6344103410 msgr2=0x7f6344100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:30.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.523+0000 7f634c4ad640 1 --2- 172.21.15.123:0/2560305461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6344103410 0x7f6344100c00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6334005940 tx=0x7f63340042f0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.523+0000 7f634c4ad640 1 -- 172.21.15.123:0/2560305461 shutdown_connections 2024-08-18T22:11:30.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.523+0000 7f634c4ad640 1 --2- 172.21.15.123:0/2560305461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6344107fd0 0x7f6344101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.523+0000 7f634c4ad640 1 --2- 172.21.15.123:0/2560305461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6344103410 0x7f6344100c00 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.523+0000 7f634c4ad640 1 --2- 172.21.15.123:0/2560305461 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f63300a2c00 0x7f63300a50c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.523+0000 7f634c4ad640 1 --2- 172.21.15.123:0/2560305461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6344102a60 0x7f63441006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:30.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.523+0000 7f634c4ad640 1 -- 172.21.15.123:0/2560305461 >> 172.21.15.123:0/2560305461 conn(0x7f63440fc500 msgr2=0x7f6344105b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:30.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.523+0000 7f634c4ad640 1 -- 172.21.15.123:0/2560305461 shutdown_connections 2024-08-18T22:11:30.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:30.523+0000 7f634c4ad640 1 -- 172.21.15.123:0/2560305461 wait complete. 2024-08-18T22:11:30.561 INFO:tasks.workunit.client.0.smithi123.stdout:creating folder hierarchy 2024-08-18T22:11:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:31 smithi183 ceph-mon[22097]: pgmap v452: 129 pgs: 129 active+clean; 2.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-08-18T22:11:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:31 smithi183 ceph-mon[22097]: scrub queued for path: / 2024-08-18T22:11:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:31 smithi183 ceph-mon[22097]: scrub summary: idle+waiting paths [/] 2024-08-18T22:11:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:31 smithi183 ceph-mon[22097]: scrub summary: active paths [/] 2024-08-18T22:11:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:31 smithi183 ceph-mon[22097]: scrub summary: idle+waiting paths [/] 2024-08-18T22:11:31.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:31 smithi123 ceph-mon[18462]: pgmap v452: 129 pgs: 129 active+clean; 2.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-08-18T22:11:31.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:31 smithi123 ceph-mon[18462]: scrub queued for path: / 2024-08-18T22:11:31.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:31 smithi123 ceph-mon[18462]: scrub summary: idle+waiting paths [/] 2024-08-18T22:11:31.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:31 smithi123 ceph-mon[18462]: scrub summary: active paths [/] 2024-08-18T22:11:31.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:31 smithi123 ceph-mon[18462]: scrub summary: idle+waiting paths [/] 2024-08-18T22:11:31.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:31 smithi130 ceph-mon[21698]: pgmap v452: 129 pgs: 129 active+clean; 2.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-08-18T22:11:31.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:31 smithi130 ceph-mon[21698]: scrub queued for path: / 2024-08-18T22:11:31.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:31 smithi130 ceph-mon[21698]: scrub summary: idle+waiting paths [/] 2024-08-18T22:11:31.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:31 smithi130 ceph-mon[21698]: scrub summary: active paths [/] 2024-08-18T22:11:31.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:31 smithi130 ceph-mon[21698]: scrub summary: idle+waiting paths [/] 2024-08-18T22:11:31.662 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-18T22:11:32.259 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:11:32.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.761+0000 7f6382247640 1 -- 172.21.15.123:0/708150361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f637c105bf0 msgr2=0x7f637c106070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:32.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.761+0000 7f6382247640 1 --2- 172.21.15.123:0/708150361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f637c105bf0 0x7f637c106070 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6374009ca0 tx=0x7f637402a8c0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.762+0000 7f6382247640 1 -- 172.21.15.123:0/708150361 shutdown_connections 2024-08-18T22:11:32.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.762+0000 7f6382247640 1 --2- 172.21.15.123:0/708150361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f637c105bf0 0x7f637c106070 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.762+0000 7f6382247640 1 --2- 172.21.15.123:0/708150361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f637c100f10 0x7f637c1056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.762+0000 7f6382247640 1 --2- 172.21.15.123:0/708150361 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f637c1005f0 0x7f637c1009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.762+0000 7f6382247640 1 -- 172.21.15.123:0/708150361 >> 172.21.15.123:0/708150361 conn(0x7f637c0fc500 msgr2=0x7f637c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:32.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.762+0000 7f6382247640 1 -- 172.21.15.123:0/708150361 shutdown_connections 2024-08-18T22:11:32.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.762+0000 7f6382247640 1 -- 172.21.15.123:0/708150361 wait complete. 2024-08-18T22:11:32.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.762+0000 7f6382247640 1 Processor -- start 2024-08-18T22:11:32.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.762+0000 7f6382247640 1 -- start start 2024-08-18T22:11:32.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f6382247640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f637c1005f0 0x7f637c1a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f6382247640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f637c100f10 0x7f637c1a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f6382247640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f637c105bf0 0x7f637c19e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f6382247640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f637c118360 con 0x7f637c1005f0 2024-08-18T22:11:32.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f6382247640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f637c1181e0 con 0x7f637c105bf0 2024-08-18T22:11:32.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f6382247640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f637c1184e0 con 0x7f637c100f10 2024-08-18T22:11:32.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f637b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f637c1005f0 0x7f637c1a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f637b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f637c1005f0 0x7f637c1a45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39192/0 (socket says 172.21.15.123:39192) 2024-08-18T22:11:32.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f637b7fe640 1 -- 172.21.15.123:0/1901567132 learned_addr learned my addr 172.21.15.123:0/1901567132 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:32.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f6373fff640 1 --2- 172.21.15.123:0/1901567132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f637c100f10 0x7f637c1a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f637bfff640 1 --2- 172.21.15.123:0/1901567132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f637c105bf0 0x7f637c19e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f637b7fe640 1 -- 172.21.15.123:0/1901567132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f637c100f10 msgr2=0x7f637c1a4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:32.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f637b7fe640 1 --2- 172.21.15.123:0/1901567132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f637c100f10 0x7f637c1a4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f637b7fe640 1 -- 172.21.15.123:0/1901567132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f637c105bf0 msgr2=0x7f637c19e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:32.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f637b7fe640 1 --2- 172.21.15.123:0/1901567132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f637c105bf0 0x7f637c19e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f637b7fe640 1 -- 172.21.15.123:0/1901567132 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c19eee0 con 0x7f637c1005f0 2024-08-18T22:11:32.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f637b7fe640 1 --2- 172.21.15.123:0/1901567132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f637c1005f0 0x7f637c1a45a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f636c00e9f0 tx=0x7f636c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:32.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f63797fa640 1 -- 172.21.15.123:0/1901567132 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c00cd80 con 0x7f637c1005f0 2024-08-18T22:11:32.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f6382247640 1 -- 172.21.15.123:0/1901567132 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f637c19f1d0 con 0x7f637c1005f0 2024-08-18T22:11:32.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f63797fa640 1 -- 172.21.15.123:0/1901567132 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f636c005500 con 0x7f637c1005f0 2024-08-18T22:11:32.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f63797fa640 1 -- 172.21.15.123:0/1901567132 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c010690 con 0x7f637c1005f0 2024-08-18T22:11:32.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.763+0000 7f6382247640 1 -- 172.21.15.123:0/1901567132 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f637c1ab520 con 0x7f637c1005f0 2024-08-18T22:11:32.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f63797fa640 1 -- 172.21.15.123:0/1901567132 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f636c0046c0 con 0x7f637c1005f0 2024-08-18T22:11:32.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f6384645740 1 Processor -- start 2024-08-18T22:11:32.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f6384645740 1 -- start start 2024-08-18T22:11:32.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f6384645740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6210 0x556b45ed65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f6384645740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6b30 0x556b45ee0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f6384645740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ee13f0 0x556b45ee37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f6384645740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556b45e3b980 con 0x556b45ed6b30 2024-08-18T22:11:32.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f6384645740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556b45dd3a70 con 0x556b45ee13f0 2024-08-18T22:11:32.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f6384645740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556b45e37940 con 0x556b45ed6210 2024-08-18T22:11:32.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f63797fa640 1 --2- 172.21.15.123:0/1901567132 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f63680a2b80 0x7f63680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f637b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6b30 0x556b45ee0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f637bfff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6210 0x556b45ed65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f637b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6b30 0x556b45ee0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39208/0 (socket says 172.21.15.123:39208) 2024-08-18T22:11:32.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f637b7fe640 1 -- 172.21.15.123:0/425557380 learned_addr learned my addr 172.21.15.123:0/425557380 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:32.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f6373fff640 1 --2- 172.21.15.123:0/425557380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ee13f0 0x556b45ee37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.766+0000 7f637bfff640 1 --2- 172.21.15.123:0/1901567132 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f63680a2b80 0x7f63680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.767+0000 7f63797fa640 1 -- 172.21.15.123:0/1901567132 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f636c0cf860 con 0x7f637c1005f0 2024-08-18T22:11:32.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.767+0000 7f637b7fe640 1 -- 172.21.15.123:0/425557380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6210 msgr2=0x556b45ed65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:32.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.767+0000 7f637b7fe640 1 --2- 172.21.15.123:0/425557380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6210 0x556b45ed65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.767+0000 7f637b7fe640 1 -- 172.21.15.123:0/425557380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ee13f0 msgr2=0x556b45ee37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:32.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.767+0000 7f637b7fe640 1 --2- 172.21.15.123:0/425557380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ee13f0 0x556b45ee37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.767+0000 7f637b7fe640 1 -- 172.21.15.123:0/425557380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b45e366e0 con 0x556b45ed6b30 2024-08-18T22:11:32.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.767+0000 7f637bfff640 1 --2- 172.21.15.123:0/425557380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6210 0x556b45ed65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:32.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.767+0000 7f637b7fe640 1 --2- 172.21.15.123:0/425557380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6b30 0x556b45ee0eb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f636c0a4470 tx=0x7f636c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bc191037341a18 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:32.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.767+0000 7f637bfff640 1 --2- 172.21.15.123:0/1901567132 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f63680a2b80 0x7f63680a5040 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6374004af0 tx=0x7f63740095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:32.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.767+0000 7f6371ffb640 1 -- 172.21.15.123:0/425557380 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c09c430 con 0x556b45ed6b30 2024-08-18T22:11:32.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.767+0000 7f6371ffb640 1 -- 172.21.15.123:0/425557380 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f636c09bd30 con 0x556b45ed6b30 2024-08-18T22:11:32.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.767+0000 7f6371ffb640 1 -- 172.21.15.123:0/425557380 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c0a4730 con 0x556b45ed6b30 2024-08-18T22:11:32.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.768+0000 7f6384645740 1 -- 172.21.15.123:0/425557380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6b30 msgr2=0x556b45ee0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:32.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.768+0000 7f6384645740 1 --2- 172.21.15.123:0/425557380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6b30 0x556b45ee0eb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f636c0a4470 tx=0x7f636c004a40 comp rx=0 tx=0).stop 2024-08-18T22:11:32.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.768+0000 7f6384645740 1 -- 172.21.15.123:0/425557380 shutdown_connections 2024-08-18T22:11:32.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.768+0000 7f6384645740 1 --2- 172.21.15.123:0/425557380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ee13f0 0x556b45ee37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.768+0000 7f6384645740 1 --2- 172.21.15.123:0/425557380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6b30 0x556b45ee0eb0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.768+0000 7f6384645740 1 --2- 172.21.15.123:0/425557380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6210 0x556b45ed65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.768+0000 7f6384645740 1 -- 172.21.15.123:0/425557380 >> 172.21.15.123:0/425557380 conn(0x556b45ed27a0 msgr2=0x556b45ed2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:32.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.768+0000 7f6384645740 1 -- 172.21.15.123:0/425557380 shutdown_connections 2024-08-18T22:11:32.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.768+0000 7f6384645740 1 -- 172.21.15.123:0/425557380 wait complete. 2024-08-18T22:11:32.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.768+0000 7f6384645740 1 -- start start 2024-08-18T22:11:32.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.768+0000 7f6384645740 1 Processor -- start 2024-08-18T22:11:32.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6384645740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ed6210 0x556b45ede370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6384645740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6b30 0x556b45ede8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6384645740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ee13f0 0x556b45ededf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6384645740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556b45ee3fc0 con 0x556b45ed6b30 2024-08-18T22:11:32.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6384645740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556b45df6aa0 con 0x556b45ed6210 2024-08-18T22:11:32.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6384645740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556b45ee4140 con 0x556b45ee13f0 2024-08-18T22:11:32.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6384645740 10 client.0 _ll_register_callbacks cb 0x556b45de5e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:32.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6373fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6b30 0x556b45ede8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6373fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6b30 0x556b45ede8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39216/0 (socket says 172.21.15.123:39216) 2024-08-18T22:11:32.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6373fff640 1 -- 172.21.15.123:0/2062783089 learned_addr learned my addr 172.21.15.123:0/2062783089 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:32.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f637bfff640 1 --2- 172.21.15.123:0/2062783089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ee13f0 0x556b45ededf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f637b7fe640 1 --2- 172.21.15.123:0/2062783089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ed6210 0x556b45ede370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6373fff640 1 -- 172.21.15.123:0/2062783089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ee13f0 msgr2=0x556b45ededf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:32.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6373fff640 1 --2- 172.21.15.123:0/2062783089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ee13f0 0x556b45ededf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6373fff640 1 -- 172.21.15.123:0/2062783089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ed6210 msgr2=0x556b45ede370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:32.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6373fff640 1 --2- 172.21.15.123:0/2062783089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ed6210 0x556b45ede370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6373fff640 1 -- 172.21.15.123:0/2062783089 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b45dda650 con 0x556b45ed6b30 2024-08-18T22:11:32.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f6373fff640 1 --2- 172.21.15.123:0/2062783089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6b30 0x556b45ede8b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f636400bf30 tx=0x7f63640118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7146c388f4855d0a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:32.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f635affd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:32.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.769+0000 7f635affd640 1 -- 172.21.15.123:0/2062783089 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6364004020 con 0x556b45ed6b30 2024-08-18T22:11:32.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.770+0000 7f635affd640 1 -- 172.21.15.123:0/2062783089 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f63640041c0 con 0x556b45ed6b30 2024-08-18T22:11:32.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.770+0000 7f6384645740 1 -- 172.21.15.123:0/2062783089 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f636c09bd30 con 0x556b45ed6b30 2024-08-18T22:11:32.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.770+0000 7f635affd640 1 -- 172.21.15.123:0/2062783089 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6364024050 con 0x556b45ed6b30 2024-08-18T22:11:32.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.770+0000 7f6384645740 10 client.15990 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:32.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.770+0000 7f6384645740 1 -- 172.21.15.123:0/2062783089 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556b45bad3c0 con 0x556b45ed6b30 2024-08-18T22:11:32.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.770+0000 7f635affd640 1 -- 172.21.15.123:0/2062783089 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f636c09bd30 con 0x556b45ed6b30 2024-08-18T22:11:32.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.770+0000 7f635affd640 1 -- 172.21.15.123:0/2062783089 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6364003a00 con 0x556b45ed6b30 2024-08-18T22:11:32.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.770+0000 7f6384645740 10 client.15990 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:32.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.770+0000 7f6384645740 10 client.15990 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:32.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.770+0000 7f6384645740 20 client.15990 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:32.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.770+0000 7f6384645740 1 --2- 172.21.15.123:0/2062783089 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556b45ef1020 0x556b45ef3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.770+0000 7f6384645740 4 client.15990 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:32.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.770+0000 7f6384645740 1 -- 172.21.15.123:0/2062783089 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b45e48ef0 con 0x556b45ef1020 2024-08-18T22:11:32.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.770+0000 7f637b7fe640 1 --2- 172.21.15.123:0/2062783089 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556b45ef1020 0x556b45ef3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.771+0000 7f637b7fe640 1 --2- 172.21.15.123:0/2062783089 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556b45ef1020 0x556b45ef3480 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdba7fc0474b3ef3 server_cookie=b1a90c9ddc554319 in_seq=0 out_seq=0 2024-08-18T22:11:32.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.771+0000 7f635affd640 10 client.15990 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:32.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.772+0000 7f635affd640 1 -- 172.21.15.123:0/2062783089 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b45e48ef0 con 0x556b45ef1020 2024-08-18T22:11:32.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.772+0000 7f635affd640 10 client.15990 handle_command_reply: tid=0 2024-08-18T22:11:32.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.772+0000 7f6384645740 1 client.15990 shutdown 2024-08-18T22:11:32.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.772+0000 7f6384645740 1 -- 172.21.15.123:0/2062783089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6b30 msgr2=0x556b45ede8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:32.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.772+0000 7f6384645740 1 --2- 172.21.15.123:0/2062783089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6b30 0x556b45ede8b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f636400bf30 tx=0x7f63640118d0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.772+0000 7f6384645740 1 -- 172.21.15.123:0/2062783089 shutdown_connections 2024-08-18T22:11:32.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.772+0000 7f6384645740 1 --2- 172.21.15.123:0/2062783089 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556b45ef1020 0x556b45ef3480 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.772+0000 7f6384645740 1 --2- 172.21.15.123:0/2062783089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ee13f0 0x556b45ededf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.772+0000 7f6384645740 1 --2- 172.21.15.123:0/2062783089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6b30 0x556b45ede8b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.772+0000 7f6384645740 1 --2- 172.21.15.123:0/2062783089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ed6210 0x556b45ede370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.772+0000 7f6384645740 1 -- 172.21.15.123:0/2062783089 >> 172.21.15.123:0/2062783089 conn(0x556b45ed27a0 msgr2=0x556b45ed8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:32.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.773+0000 7f635affd640 0 client.15990 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:32.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.773+0000 7f6384645740 1 -- 172.21.15.123:0/2062783089 shutdown_connections 2024-08-18T22:11:32.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.773+0000 7f6384645740 1 -- 172.21.15.123:0/2062783089 wait complete. 2024-08-18T22:11:32.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.773+0000 7f6384645740 20 client.15990 trim_cache size 0 max 16384 2024-08-18T22:11:32.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f6384645740 1 Processor -- start 2024-08-18T22:11:32.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f6384645740 1 -- start start 2024-08-18T22:11:32.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f6384645740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6210 0x556b45ef3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f6384645740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6b30 0x556b45ee01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f6384645740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ee13f0 0x556b45ef8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f6384645740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f637c1b7970 con 0x556b45ed6210 2024-08-18T22:11:32.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f6384645740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f637c1b5240 con 0x556b45ee13f0 2024-08-18T22:11:32.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f6384645740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f637c1b3090 con 0x556b45ed6b30 2024-08-18T22:11:32.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f637b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6210 0x556b45ef3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f637b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6210 0x556b45ef3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39222/0 (socket says 172.21.15.123:39222) 2024-08-18T22:11:32.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f637b7fe640 1 -- 172.21.15.123:0/2155722247 learned_addr learned my addr 172.21.15.123:0/2155722247 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:32.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f6373fff640 1 --2- 172.21.15.123:0/2155722247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6b30 0x556b45ee01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f637b7fe640 1 -- 172.21.15.123:0/2155722247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6b30 msgr2=0x556b45ee01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:32.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f637b7fe640 1 --2- 172.21.15.123:0/2155722247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6b30 0x556b45ee01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f637b7fe640 1 -- 172.21.15.123:0/2155722247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ee13f0 msgr2=0x556b45ef8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:32.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f637b7fe640 1 --2- 172.21.15.123:0/2155722247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ee13f0 0x556b45ef8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f637b7fe640 1 -- 172.21.15.123:0/2155722247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b45edc8c0 con 0x556b45ed6210 2024-08-18T22:11:32.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.791+0000 7f637b7fe640 1 --2- 172.21.15.123:0/2155722247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6210 0x556b45ef3030 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f636c0097d0 tx=0x7f636c0980a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1bf9c170e7a8b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:32.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.792+0000 7f63717fa640 1 -- 172.21.15.123:0/2155722247 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c09bb00 con 0x556b45ed6210 2024-08-18T22:11:32.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.792+0000 7f63717fa640 1 -- 172.21.15.123:0/2155722247 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f636c0a00e0 con 0x556b45ed6210 2024-08-18T22:11:32.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.792+0000 7f63717fa640 1 -- 172.21.15.123:0/2155722247 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c09b180 con 0x556b45ed6210 2024-08-18T22:11:32.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.792+0000 7f6384645740 1 -- 172.21.15.123:0/2155722247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6210 msgr2=0x556b45ef3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:32.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.792+0000 7f6384645740 1 --2- 172.21.15.123:0/2155722247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6210 0x556b45ef3030 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f636c0097d0 tx=0x7f636c0980a0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.792+0000 7f6384645740 1 -- 172.21.15.123:0/2155722247 shutdown_connections 2024-08-18T22:11:32.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.792+0000 7f6384645740 1 --2- 172.21.15.123:0/2155722247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ee13f0 0x556b45ef8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.792+0000 7f6384645740 1 --2- 172.21.15.123:0/2155722247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6b30 0x556b45ee01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.792+0000 7f6384645740 1 --2- 172.21.15.123:0/2155722247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ed6210 0x556b45ef3030 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.792+0000 7f6384645740 1 -- 172.21.15.123:0/2155722247 >> 172.21.15.123:0/2155722247 conn(0x556b45ed27a0 msgr2=0x556b45edfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:32.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.792+0000 7f6384645740 1 -- 172.21.15.123:0/2155722247 shutdown_connections 2024-08-18T22:11:32.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.792+0000 7f6384645740 1 -- 172.21.15.123:0/2155722247 wait complete. 2024-08-18T22:11:32.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.793+0000 7f6384645740 1 -- start start 2024-08-18T22:11:32.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.793+0000 7f6384645740 1 Processor -- start 2024-08-18T22:11:32.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.793+0000 7f6384645740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6210 0x556b45ee9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.793+0000 7f6384645740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ed6b30 0x556b45ee4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.793+0000 7f6384645740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ee13f0 0x556b45ee52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.793+0000 7f6384645740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f637c1b3700 con 0x556b45ee13f0 2024-08-18T22:11:32.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.793+0000 7f6384645740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f637c1b4b70 con 0x556b45ed6b30 2024-08-18T22:11:32.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.793+0000 7f6384645740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f637c1b3dd0 con 0x556b45ed6210 2024-08-18T22:11:32.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.793+0000 7f6384645740 10 client.0 _ll_register_callbacks cb 0x7f636400bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:32.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.793+0000 7f637bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ee13f0 0x556b45ee52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.793+0000 7f637b7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6210 0x556b45ee9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.793+0000 7f637bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ee13f0 0x556b45ee52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39224/0 (socket says 172.21.15.123:39224) 2024-08-18T22:11:32.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.793+0000 7f637bfff640 1 -- 172.21.15.123:0/366436603 learned_addr learned my addr 172.21.15.123:0/366436603 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:32.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.793+0000 7f6373fff640 1 --2- 172.21.15.123:0/366436603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ed6b30 0x556b45ee4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f637bfff640 1 -- 172.21.15.123:0/366436603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6210 msgr2=0x556b45ee9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:32.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f637bfff640 1 --2- 172.21.15.123:0/366436603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6210 0x556b45ee9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f637bfff640 1 -- 172.21.15.123:0/366436603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ed6b30 msgr2=0x556b45ee4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:32.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f637bfff640 1 --2- 172.21.15.123:0/366436603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ed6b30 0x556b45ee4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f637bfff640 1 -- 172.21.15.123:0/366436603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b45ee5ad0 con 0x556b45ee13f0 2024-08-18T22:11:32.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f637b7fe640 1 --2- 172.21.15.123:0/366436603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6210 0x556b45ee9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:32.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f6373fff640 1 --2- 172.21.15.123:0/366436603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ed6b30 0x556b45ee4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:11:32.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f637bfff640 1 --2- 172.21.15.123:0/366436603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ee13f0 0x556b45ee52c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6374009ca0 tx=0x7f6374009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89864e2cfad5f89e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:32.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f635affd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:32.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f635affd640 1 -- 172.21.15.123:0/366436603 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6374051070 con 0x556b45ee13f0 2024-08-18T22:11:32.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f635affd640 1 -- 172.21.15.123:0/366436603 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f6374004510 con 0x556b45ee13f0 2024-08-18T22:11:32.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f6384645740 1 -- 172.21.15.123:0/366436603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f636c0a00e0 con 0x556b45ee13f0 2024-08-18T22:11:32.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f635affd640 1 -- 172.21.15.123:0/366436603 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6374004730 con 0x556b45ee13f0 2024-08-18T22:11:32.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f6384645740 10 client.15996 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:32.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f6384645740 1 -- 172.21.15.123:0/366436603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556b45f5bca0 con 0x556b45ee13f0 2024-08-18T22:11:32.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f635affd640 1 -- 172.21.15.123:0/366436603 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f636c0a00e0 con 0x556b45ee13f0 2024-08-18T22:11:32.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.794+0000 7f635affd640 1 -- 172.21.15.123:0/366436603 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f637404a040 con 0x556b45ee13f0 2024-08-18T22:11:32.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.795+0000 7f6384645740 10 client.15996 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:32.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.795+0000 7f6384645740 10 client.15996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:32.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.795+0000 7f6384645740 20 client.15996 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:32.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.795+0000 7f6384645740 1 --2- 172.21.15.123:0/366436603 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556b45f5c3f0 0x556b45f5e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:32.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.795+0000 7f6384645740 4 client.15996 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:11:32.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.795+0000 7f6384645740 1 -- 172.21.15.123:0/366436603 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556b45e43400 con 0x556b45f5c3f0 2024-08-18T22:11:32.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.795+0000 7f637b7fe640 1 --2- 172.21.15.123:0/366436603 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556b45f5c3f0 0x556b45f5e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:32.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.795+0000 7f637b7fe640 1 --2- 172.21.15.123:0/366436603 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556b45f5c3f0 0x556b45f5e810 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=967143e772820dd server_cookie=7ad44661216202ec in_seq=0 out_seq=0 2024-08-18T22:11:32.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.795+0000 7f635affd640 10 client.15996 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:32.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.796+0000 7f635affd640 1 -- 172.21.15.123:0/366436603 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556b45e43400 con 0x556b45f5c3f0 2024-08-18T22:11:32.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.796+0000 7f635affd640 10 client.15996 handle_command_reply: tid=0 2024-08-18T22:11:32.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.796+0000 7f6384645740 1 client.15996 shutdown 2024-08-18T22:11:32.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6384645740 1 -- 172.21.15.123:0/366436603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ee13f0 msgr2=0x556b45ee52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:32.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6384645740 1 --2- 172.21.15.123:0/366436603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ee13f0 0x556b45ee52c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6374009ca0 tx=0x7f6374009380 comp rx=0 tx=0).stop 2024-08-18T22:11:32.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6384645740 1 -- 172.21.15.123:0/366436603 shutdown_connections 2024-08-18T22:11:32.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6384645740 1 --2- 172.21.15.123:0/366436603 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556b45f5c3f0 0x556b45f5e810 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6384645740 1 --2- 172.21.15.123:0/366436603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556b45ee13f0 0x556b45ee52c0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f635affd640 0 client.15996 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:32.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6384645740 1 --2- 172.21.15.123:0/366436603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b45ed6b30 0x556b45ee4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6384645740 1 --2- 172.21.15.123:0/366436603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556b45ed6210 0x556b45ee9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6384645740 1 -- 172.21.15.123:0/366436603 >> 172.21.15.123:0/366436603 conn(0x556b45ed27a0 msgr2=0x556b45ed1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:32.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6384645740 1 -- 172.21.15.123:0/366436603 shutdown_connections 2024-08-18T22:11:32.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6384645740 1 -- 172.21.15.123:0/366436603 wait complete. 2024-08-18T22:11:32.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6384645740 20 client.15996 trim_cache size 0 max 16384 2024-08-18T22:11:32.823 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:11:32.823 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "no active scrubs running", 2024-08-18T22:11:32.823 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-08-18T22:11:32.823 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:11:32.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6382247640 1 -- 172.21.15.123:0/1901567132 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f63680a2b80 msgr2=0x7f63680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:32.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6382247640 1 --2- 172.21.15.123:0/1901567132 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f63680a2b80 0x7f63680a5040 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6374004af0 tx=0x7f63740095c0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6382247640 1 -- 172.21.15.123:0/1901567132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f637c1005f0 msgr2=0x7f637c1a45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:32.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6382247640 1 --2- 172.21.15.123:0/1901567132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f637c1005f0 0x7f637c1a45a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f636c00e9f0 tx=0x7f636c00edf0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6382247640 1 -- 172.21.15.123:0/1901567132 shutdown_connections 2024-08-18T22:11:32.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6382247640 1 --2- 172.21.15.123:0/1901567132 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f63680a2b80 0x7f63680a5040 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6382247640 1 --2- 172.21.15.123:0/1901567132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f637c105bf0 0x7f637c19e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6382247640 1 --2- 172.21.15.123:0/1901567132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f637c100f10 0x7f637c1a4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6382247640 1 --2- 172.21.15.123:0/1901567132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f637c1005f0 0x7f637c1a45a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:32.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6382247640 1 -- 172.21.15.123:0/1901567132 >> 172.21.15.123:0/1901567132 conn(0x7f637c0fc500 msgr2=0x7f637c103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:32.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6382247640 1 -- 172.21.15.123:0/1901567132 shutdown_connections 2024-08-18T22:11:32.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:32.797+0000 7f6382247640 1 -- 172.21.15.123:0/1901567132 wait complete. 2024-08-18T22:11:33.395 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:33 smithi123 ceph-mon[18462]: pgmap v453: 129 pgs: 129 active+clean; 2.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-08-18T22:11:33.395 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:33 smithi123 ceph-mon[18462]: scrub summary: idle 2024-08-18T22:11:33.408 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:33 smithi183 ceph-mon[22097]: pgmap v453: 129 pgs: 129 active+clean; 2.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-08-18T22:11:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:33 smithi183 ceph-mon[22097]: scrub summary: idle 2024-08-18T22:11:33.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:33 smithi130 ceph-mon[21698]: pgmap v453: 129 pgs: 129 active+clean; 2.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-08-18T22:11:33.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:33 smithi130 ceph-mon[21698]: scrub summary: idle 2024-08-18T22:11:33.632 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-18T22:11:33.632 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:11:33.908 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:11:34.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.397+0000 7f6650305640 1 -- 172.21.15.123:0/4235108329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6648102ac0 msgr2=0x7f6648102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:34.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.397+0000 7f6650305640 1 --2- 172.21.15.123:0/4235108329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6648102ac0 0x7f6648102ea0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6640009930 tx=0x7f664002a420 comp rx=0 tx=0).stop 2024-08-18T22:11:34.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.397+0000 7f6650305640 1 -- 172.21.15.123:0/4235108329 shutdown_connections 2024-08-18T22:11:34.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.397+0000 7f6650305640 1 --2- 172.21.15.123:0/4235108329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6648107fc0 0x7f664810e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:34.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.397+0000 7f6650305640 1 --2- 172.21.15.123:0/4235108329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6648103470 0x7f66481078b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:34.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.397+0000 7f6650305640 1 --2- 172.21.15.123:0/4235108329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6648102ac0 0x7f6648102ea0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:34.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.397+0000 7f6650305640 1 -- 172.21.15.123:0/4235108329 >> 172.21.15.123:0/4235108329 conn(0x7f66480fc500 msgr2=0x7f66480fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:34.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.397+0000 7f6650305640 1 -- 172.21.15.123:0/4235108329 shutdown_connections 2024-08-18T22:11:34.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.397+0000 7f6650305640 1 -- 172.21.15.123:0/4235108329 wait complete. 2024-08-18T22:11:34.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.398+0000 7f6650305640 1 Processor -- start 2024-08-18T22:11:34.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.398+0000 7f6650305640 1 -- start start 2024-08-18T22:11:34.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.398+0000 7f6650305640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6648102ac0 0x7f6648198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:34.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.398+0000 7f6650305640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6648103470 0x7f6648198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:34.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.398+0000 7f6650305640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6648107fc0 0x7f664819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:34.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.398+0000 7f6650305640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6648111dc0 con 0x7f6648102ac0 2024-08-18T22:11:34.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.398+0000 7f6650305640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6648111c40 con 0x7f6648107fc0 2024-08-18T22:11:34.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.398+0000 7f6650305640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6648111f40 con 0x7f6648103470 2024-08-18T22:11:34.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.398+0000 7f664e0a1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6648102ac0 0x7f6648198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:34.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.398+0000 7f664e0a1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6648102ac0 0x7f6648198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39242/0 (socket says 172.21.15.123:39242) 2024-08-18T22:11:34.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.398+0000 7f664e0a1640 1 -- 172.21.15.123:0/280963774 learned_addr learned my addr 172.21.15.123:0/280963774 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:34.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.399+0000 7f664d8a0640 1 --2- 172.21.15.123:0/280963774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6648103470 0x7f6648198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:34.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.399+0000 7f664e8a2640 1 --2- 172.21.15.123:0/280963774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6648107fc0 0x7f664819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:34.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.399+0000 7f664e0a1640 1 -- 172.21.15.123:0/280963774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6648103470 msgr2=0x7f6648198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:34.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.399+0000 7f664e0a1640 1 --2- 172.21.15.123:0/280963774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6648103470 0x7f6648198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:34.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.399+0000 7f664e0a1640 1 -- 172.21.15.123:0/280963774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6648107fc0 msgr2=0x7f664819cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:34.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.399+0000 7f664e0a1640 1 --2- 172.21.15.123:0/280963774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6648107fc0 0x7f664819cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:34.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.399+0000 7f664e0a1640 1 -- 172.21.15.123:0/280963774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664819d1f0 con 0x7f6648102ac0 2024-08-18T22:11:34.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.399+0000 7f664e8a2640 1 --2- 172.21.15.123:0/280963774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6648107fc0 0x7f664819cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:11:34.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.399+0000 7f664e0a1640 1 --2- 172.21.15.123:0/280963774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6648102ac0 0x7f6648198240 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6640009230 tx=0x7f6640004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:34.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.399+0000 7f66477fe640 1 -- 172.21.15.123:0/280963774 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664003f030 con 0x7f6648102ac0 2024-08-18T22:11:34.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.399+0000 7f6650305640 1 -- 172.21.15.123:0/280963774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f664819d480 con 0x7f6648102ac0 2024-08-18T22:11:34.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.399+0000 7f66477fe640 1 -- 172.21.15.123:0/280963774 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6640003ad0 con 0x7f6648102ac0 2024-08-18T22:11:34.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.399+0000 7f66477fe640 1 -- 172.21.15.123:0/280963774 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6640035070 con 0x7f6648102ac0 2024-08-18T22:11:34.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.399+0000 7f6650305640 1 -- 172.21.15.123:0/280963774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66481a4dc0 con 0x7f6648102ac0 2024-08-18T22:11:34.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.400+0000 7f6650305640 1 -- 172.21.15.123:0/280963774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f664806a520 con 0x7f6648102ac0 2024-08-18T22:11:34.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.401+0000 7f66477fe640 1 -- 172.21.15.123:0/280963774 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f6640042030 con 0x7f6648102ac0 2024-08-18T22:11:34.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.402+0000 7f66477fe640 1 --2- 172.21.15.123:0/280963774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66300a2b80 0x7f66300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:34.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.402+0000 7f664d8a0640 1 --2- 172.21.15.123:0/280963774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66300a2b80 0x7f66300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:34.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.402+0000 7f66477fe640 1 -- 172.21.15.123:0/280963774 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f66400efe80 con 0x7f6648102ac0 2024-08-18T22:11:34.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.403+0000 7f664d8a0640 1 --2- 172.21.15.123:0/280963774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66300a2b80 0x7f66300a5040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f66480feab0 tx=0x7f663c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:34.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.406+0000 7f66477fe640 1 -- 172.21.15.123:0/280963774 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f66400bca50 con 0x7f6648102ac0 2024-08-18T22:11:34.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.622+0000 7f6650305640 1 -- 172.21.15.123:0/280963774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6648102ea0 con 0x7f6648102ac0 2024-08-18T22:11:34.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.623+0000 7f66477fe640 1 -- 172.21.15.123:0/280963774 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7f66400bc350 con 0x7f6648102ac0 2024-08-18T22:11:34.624 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:11:34.624 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"btime":"2024-08-18T22:07:46:492460+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:07:45.601053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:11:34.625 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 26 2024-08-18T22:11:34.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.626+0000 7f6650305640 1 -- 172.21.15.123:0/280963774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66300a2b80 msgr2=0x7f66300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:34.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.626+0000 7f6650305640 1 --2- 172.21.15.123:0/280963774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66300a2b80 0x7f66300a5040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f66480feab0 tx=0x7f663c00a2d0 comp rx=0 tx=0).stop 2024-08-18T22:11:34.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.626+0000 7f6650305640 1 -- 172.21.15.123:0/280963774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6648102ac0 msgr2=0x7f6648198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:34.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.626+0000 7f6650305640 1 --2- 172.21.15.123:0/280963774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6648102ac0 0x7f6648198240 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6640009230 tx=0x7f6640004270 comp rx=0 tx=0).stop 2024-08-18T22:11:34.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.626+0000 7f6650305640 1 -- 172.21.15.123:0/280963774 shutdown_connections 2024-08-18T22:11:34.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.626+0000 7f6650305640 1 --2- 172.21.15.123:0/280963774 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f66300a2b80 0x7f66300a5040 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:34.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.626+0000 7f6650305640 1 --2- 172.21.15.123:0/280963774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6648107fc0 0x7f664819cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:34.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.626+0000 7f6650305640 1 --2- 172.21.15.123:0/280963774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6648103470 0x7f6648198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:34.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.626+0000 7f6650305640 1 --2- 172.21.15.123:0/280963774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6648102ac0 0x7f6648198240 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:34.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.626+0000 7f6650305640 1 -- 172.21.15.123:0/280963774 >> 172.21.15.123:0/280963774 conn(0x7f66480fc500 msgr2=0x7f66481060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:34.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.626+0000 7f6650305640 1 -- 172.21.15.123:0/280963774 shutdown_connections 2024-08-18T22:11:34.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:34.626+0000 7f6650305640 1 -- 172.21.15.123:0/280963774 wait complete. 2024-08-18T22:11:35.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:35 smithi123 ceph-mon[18462]: pgmap v454: 129 pgs: 129 active+clean; 2.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 36 KiB/s wr, 20 op/s 2024-08-18T22:11:35.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:35 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/280963774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:11:35.300 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-18T22:11:35.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:35 smithi183 ceph-mon[22097]: pgmap v454: 129 pgs: 129 active+clean; 2.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 36 KiB/s wr, 20 op/s 2024-08-18T22:11:35.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:35 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/280963774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:11:35.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:35 smithi130 ceph-mon[21698]: pgmap v454: 129 pgs: 129 active+clean; 2.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 36 KiB/s wr, 20 op/s 2024-08-18T22:11:35.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:35 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/280963774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:11:35.578 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:11:36.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.060+0000 7f02555c6640 1 -- 172.21.15.123:0/3619892284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0250102090 msgr2=0x7f025010e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:36.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.060+0000 7f02555c6640 1 --2- 172.21.15.123:0/3619892284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0250102090 0x7f025010e5c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0248009cd0 tx=0x7f024802a8e0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.060+0000 7f02555c6640 1 -- 172.21.15.123:0/3619892284 shutdown_connections 2024-08-18T22:11:36.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.060+0000 7f02555c6640 1 --2- 172.21.15.123:0/3619892284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0250102090 0x7f025010e5c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.060+0000 7f02555c6640 1 --2- 172.21.15.123:0/3619892284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02501016f0 0x7f0250101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.060+0000 7f02555c6640 1 --2- 172.21.15.123:0/3619892284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02501076f0 0x7f0250107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.060+0000 7f02555c6640 1 -- 172.21.15.123:0/3619892284 >> 172.21.15.123:0/3619892284 conn(0x7f02500fd450 msgr2=0x7f02500ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:36.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.060+0000 7f02555c6640 1 -- 172.21.15.123:0/3619892284 shutdown_connections 2024-08-18T22:11:36.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.060+0000 7f02555c6640 1 -- 172.21.15.123:0/3619892284 wait complete. 2024-08-18T22:11:36.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.060+0000 7f02555c6640 1 Processor -- start 2024-08-18T22:11:36.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.060+0000 7f02555c6640 1 -- start start 2024-08-18T22:11:36.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f02555c6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02501016f0 0x7f0250197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f02555c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0250102090 0x7f0250198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f02555c6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02501076f0 0x7f025019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f02555c6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0250111af0 con 0x7f02501076f0 2024-08-18T22:11:36.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f02555c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0250111970 con 0x7f0250102090 2024-08-18T22:11:36.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f02555c6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0250111c70 con 0x7f02501016f0 2024-08-18T22:11:36.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f0254dc5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02501076f0 0x7f025019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f0254dc5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02501076f0 0x7f025019c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39264/0 (socket says 172.21.15.123:39264) 2024-08-18T22:11:36.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f0254dc5640 1 -- 172.21.15.123:0/597012869 learned_addr learned my addr 172.21.15.123:0/597012869 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:36.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f024ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02501016f0 0x7f0250197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f024f7fe640 1 --2- 172.21.15.123:0/597012869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0250102090 0x7f0250198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f024ffff640 1 -- 172.21.15.123:0/597012869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0250102090 msgr2=0x7f0250198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:36.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f024ffff640 1 --2- 172.21.15.123:0/597012869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0250102090 0x7f0250198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f024ffff640 1 -- 172.21.15.123:0/597012869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02501076f0 msgr2=0x7f025019c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:36.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f024ffff640 1 --2- 172.21.15.123:0/597012869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02501076f0 0x7f025019c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f024ffff640 1 -- 172.21.15.123:0/597012869 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f025019cf00 con 0x7f02501016f0 2024-08-18T22:11:36.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.061+0000 7f0254dc5640 1 --2- 172.21.15.123:0/597012869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02501076f0 0x7f025019c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:36.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.062+0000 7f024ffff640 1 --2- 172.21.15.123:0/597012869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02501016f0 0x7f0250197f50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f024000e9f0 tx=0x7f024000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:36.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.062+0000 7f024d7fa640 1 -- 172.21.15.123:0/597012869 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024000ccc0 con 0x7f02501016f0 2024-08-18T22:11:36.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.062+0000 7f024d7fa640 1 -- 172.21.15.123:0/597012869 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0240005020 con 0x7f02501016f0 2024-08-18T22:11:36.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.062+0000 7f02555c6640 1 -- 172.21.15.123:0/597012869 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f025019d1f0 con 0x7f02501016f0 2024-08-18T22:11:36.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.062+0000 7f024d7fa640 1 -- 172.21.15.123:0/597012869 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02400049e0 con 0x7f02501016f0 2024-08-18T22:11:36.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.062+0000 7f02555c6640 1 -- 172.21.15.123:0/597012869 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02501a4ad0 con 0x7f02501016f0 2024-08-18T22:11:36.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.064+0000 7f024d7fa640 1 -- 172.21.15.123:0/597012869 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f0240005560 con 0x7f02501016f0 2024-08-18T22:11:36.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.064+0000 7f0258c26740 1 Processor -- start 2024-08-18T22:11:36.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f0258c26740 1 -- start start 2024-08-18T22:11:36.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f0258c26740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf7531c0 0x556ecf7535a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f0258c26740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf753ae0 0x556ecf75de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f0258c26740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf75e3a0 0x556ecf760790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f0258c26740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556ecf6b8a40 con 0x556ecf7531c0 2024-08-18T22:11:36.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f0258c26740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556ecf6509d0 con 0x556ecf753ae0 2024-08-18T22:11:36.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f0258c26740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556ecf6b4a00 con 0x556ecf75e3a0 2024-08-18T22:11:36.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f0254dc5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf7531c0 0x556ecf7535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f0254dc5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf7531c0 0x556ecf7535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39278/0 (socket says 172.21.15.123:39278) 2024-08-18T22:11:36.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f0254dc5640 1 -- 172.21.15.123:0/4261477332 learned_addr learned my addr 172.21.15.123:0/4261477332 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:36.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f024f7fe640 1 --2- 172.21.15.123:0/4261477332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf75e3a0 0x556ecf760790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f024ffff640 1 --2- 172.21.15.123:0/4261477332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf753ae0 0x556ecf75de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f0254dc5640 1 -- 172.21.15.123:0/4261477332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf75e3a0 msgr2=0x556ecf760790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:36.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f0254dc5640 1 --2- 172.21.15.123:0/4261477332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf75e3a0 0x556ecf760790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f0254dc5640 1 -- 172.21.15.123:0/4261477332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf753ae0 msgr2=0x556ecf75de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:36.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f0254dc5640 1 --2- 172.21.15.123:0/4261477332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf753ae0 0x556ecf75de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f024d7fa640 1 --2- 172.21.15.123:0/597012869 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f02380a2c00 0x7f02380a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f0254dc5640 1 -- 172.21.15.123:0/4261477332 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ecf657650 con 0x556ecf7531c0 2024-08-18T22:11:36.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f024f7fe640 1 --2- 172.21.15.123:0/4261477332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf75e3a0 0x556ecf760790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:36.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.065+0000 7f024d7fa640 1 -- 172.21.15.123:0/597012869 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f02400cf300 con 0x7f02501016f0 2024-08-18T22:11:36.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.066+0000 7f0254dc5640 1 --2- 172.21.15.123:0/597012869 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f02380a2c00 0x7f02380a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.066+0000 7f0254dc5640 1 --2- 172.21.15.123:0/4261477332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf7531c0 0x556ecf7535a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0248031940 tx=0x7f0248009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302ddeaae6349326 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:36.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.066+0000 7f02367fc640 1 -- 172.21.15.123:0/4261477332 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248003a50 con 0x556ecf7531c0 2024-08-18T22:11:36.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.066+0000 7f02367fc640 1 -- 172.21.15.123:0/4261477332 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0248036070 con 0x556ecf7531c0 2024-08-18T22:11:36.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.066+0000 7f02367fc640 1 -- 172.21.15.123:0/4261477332 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248045640 con 0x556ecf7531c0 2024-08-18T22:11:36.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.067+0000 7f0258c26740 1 -- 172.21.15.123:0/4261477332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf7531c0 msgr2=0x556ecf7535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:36.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.067+0000 7f0258c26740 1 --2- 172.21.15.123:0/4261477332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf7531c0 0x556ecf7535a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0248031940 tx=0x7f0248009a20 comp rx=0 tx=0).stop 2024-08-18T22:11:36.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.067+0000 7f0254dc5640 1 --2- 172.21.15.123:0/597012869 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f02380a2c00 0x7f02380a50c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0248049000 tx=0x7f0248046000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:36.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.067+0000 7f0258c26740 1 -- 172.21.15.123:0/4261477332 shutdown_connections 2024-08-18T22:11:36.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.067+0000 7f0258c26740 1 --2- 172.21.15.123:0/4261477332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf75e3a0 0x556ecf760790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.067+0000 7f0258c26740 1 --2- 172.21.15.123:0/4261477332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf753ae0 0x556ecf75de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.067+0000 7f0258c26740 1 --2- 172.21.15.123:0/4261477332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf7531c0 0x556ecf7535a0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.067+0000 7f0258c26740 1 -- 172.21.15.123:0/4261477332 >> 172.21.15.123:0/4261477332 conn(0x556ecf74f750 msgr2=0x556ecf74fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:36.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.067+0000 7f0258c26740 1 -- 172.21.15.123:0/4261477332 shutdown_connections 2024-08-18T22:11:36.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.067+0000 7f0258c26740 1 -- 172.21.15.123:0/4261477332 wait complete. 2024-08-18T22:11:36.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.067+0000 7f0258c26740 1 -- start start 2024-08-18T22:11:36.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.067+0000 7f0258c26740 1 Processor -- start 2024-08-18T22:11:36.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0258c26740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf7531c0 0x556ecf75b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0258c26740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf753ae0 0x556ecf75b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0258c26740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf75e3a0 0x556ecf75bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0258c26740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556ecf765380 con 0x556ecf75e3a0 2024-08-18T22:11:36.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0258c26740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556ecf673b20 con 0x556ecf7531c0 2024-08-18T22:11:36.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0258c26740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556ecf765500 con 0x556ecf753ae0 2024-08-18T22:11:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0258c26740 10 client.0 _ll_register_callbacks cb 0x556ecf671bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0254dc5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf75e3a0 0x556ecf75bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f024f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf753ae0 0x556ecf75b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0254dc5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf75e3a0 0x556ecf75bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39280/0 (socket says 172.21.15.123:39280) 2024-08-18T22:11:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0254dc5640 1 -- 172.21.15.123:0/2607722354 learned_addr learned my addr 172.21.15.123:0/2607722354 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f024ffff640 1 --2- 172.21.15.123:0/2607722354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf7531c0 0x556ecf75b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0254dc5640 1 -- 172.21.15.123:0/2607722354 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf753ae0 msgr2=0x556ecf75b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0254dc5640 1 --2- 172.21.15.123:0/2607722354 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf753ae0 0x556ecf75b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0254dc5640 1 -- 172.21.15.123:0/2607722354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf7531c0 msgr2=0x556ecf75b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0254dc5640 1 --2- 172.21.15.123:0/2607722354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf7531c0 0x556ecf75b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0254dc5640 1 -- 172.21.15.123:0/2607722354 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ecf42a3c0 con 0x556ecf75e3a0 2024-08-18T22:11:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f024f7fe640 1 --2- 172.21.15.123:0/2607722354 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf753ae0 0x556ecf75b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:36.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f0254dc5640 1 --2- 172.21.15.123:0/2607722354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf75e3a0 0x556ecf75bc50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0248005cc0 tx=0x7f0248030e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6090b8f5f8adff5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:36.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.068+0000 7f022f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:36.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.069+0000 7f022f7fe640 1 -- 172.21.15.123:0/2607722354 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248061060 con 0x556ecf75e3a0 2024-08-18T22:11:36.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.069+0000 7f0258c26740 1 -- 172.21.15.123:0/2607722354 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0248036070 con 0x556ecf75e3a0 2024-08-18T22:11:36.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.069+0000 7f022f7fe640 1 -- 172.21.15.123:0/2607722354 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0248003970 con 0x556ecf75e3a0 2024-08-18T22:11:36.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.069+0000 7f022f7fe640 1 -- 172.21.15.123:0/2607722354 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0248051480 con 0x556ecf75e3a0 2024-08-18T22:11:36.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.069+0000 7f0258c26740 10 client.16014 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:36.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.069+0000 7f0258c26740 1 -- 172.21.15.123:0/2607722354 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556ecf765380 con 0x556ecf75e3a0 2024-08-18T22:11:36.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.069+0000 7f022f7fe640 1 -- 172.21.15.123:0/2607722354 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0248036070 con 0x556ecf75e3a0 2024-08-18T22:11:36.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.069+0000 7f022f7fe640 1 -- 172.21.15.123:0/2607722354 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f0248042040 con 0x556ecf75e3a0 2024-08-18T22:11:36.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.069+0000 7f0258c26740 10 client.16014 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:36.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.069+0000 7f0258c26740 10 client.16014 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-18T22:11:36.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.069+0000 7f0258c26740 20 client.16014 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:36.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.069+0000 7f0258c26740 1 --2- 172.21.15.123:0/2607722354 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x556ecf772080 0x556ecf774470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.069+0000 7f0258c26740 4 client.16014 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:36.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.069+0000 7f0258c26740 1 -- 172.21.15.123:0/2607722354 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ecf6c5fb0 con 0x556ecf772080 2024-08-18T22:11:36.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.070+0000 7f024ffff640 1 --2- 172.21.15.123:0/2607722354 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x556ecf772080 0x556ecf774470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.070+0000 7f024ffff640 1 --2- 172.21.15.123:0/2607722354 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x556ecf772080 0x556ecf774470 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5f2d79414832f9a9 server_cookie=d06af9227c6c11bf in_seq=0 out_seq=0 2024-08-18T22:11:36.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.070+0000 7f022f7fe640 10 client.16014 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:11:36.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.071+0000 7f022f7fe640 1 -- 172.21.15.123:0/2607722354 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ecf6c5fb0 con 0x556ecf772080 2024-08-18T22:11:36.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.071+0000 7f022f7fe640 10 client.16014 handle_command_reply: tid=0 2024-08-18T22:11:36.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.071+0000 7f0258c26740 1 client.16014 shutdown 2024-08-18T22:11:36.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.071+0000 7f0258c26740 1 -- 172.21.15.123:0/2607722354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf75e3a0 msgr2=0x556ecf75bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:36.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.071+0000 7f0258c26740 1 --2- 172.21.15.123:0/2607722354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf75e3a0 0x556ecf75bc50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0248005cc0 tx=0x7f0248030e50 comp rx=0 tx=0).stop 2024-08-18T22:11:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.071+0000 7f0258c26740 1 -- 172.21.15.123:0/2607722354 shutdown_connections 2024-08-18T22:11:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.071+0000 7f0258c26740 1 --2- 172.21.15.123:0/2607722354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf75e3a0 0x556ecf75bc50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.071+0000 7f0258c26740 1 --2- 172.21.15.123:0/2607722354 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x556ecf772080 0x556ecf774470 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.071+0000 7f022f7fe640 0 client.16014 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:11:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.071+0000 7f0258c26740 1 --2- 172.21.15.123:0/2607722354 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf753ae0 0x556ecf75b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.071+0000 7f0258c26740 1 --2- 172.21.15.123:0/2607722354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf7531c0 0x556ecf75b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.071+0000 7f0258c26740 1 -- 172.21.15.123:0/2607722354 >> 172.21.15.123:0/2607722354 conn(0x556ecf74f750 msgr2=0x556ecf74e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.071+0000 7f0258c26740 1 -- 172.21.15.123:0/2607722354 shutdown_connections 2024-08-18T22:11:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.071+0000 7f0258c26740 1 -- 172.21.15.123:0/2607722354 wait complete. 2024-08-18T22:11:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.071+0000 7f0258c26740 20 client.16014 trim_cache size 0 max 16384 2024-08-18T22:11:36.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.085+0000 7f0258c26740 1 Processor -- start 2024-08-18T22:11:36.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.085+0000 7f0258c26740 1 -- start start 2024-08-18T22:11:36.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f0258c26740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf7531c0 0x556ecf779c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f0258c26740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf753ae0 0x556ecf77a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f0258c26740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf75e3a0 0x556ecf75c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f0258c26740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f02501aef40 con 0x556ecf753ae0 2024-08-18T22:11:36.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f0258c26740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f02501ac810 con 0x556ecf7531c0 2024-08-18T22:11:36.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f0258c26740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f02501aa660 con 0x556ecf75e3a0 2024-08-18T22:11:36.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f024f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf753ae0 0x556ecf77a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f024f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf753ae0 0x556ecf77a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39292/0 (socket says 172.21.15.123:39292) 2024-08-18T22:11:36.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f024f7fe640 1 -- 172.21.15.123:0/605451584 learned_addr learned my addr 172.21.15.123:0/605451584 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:36.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f0254dc5640 1 --2- 172.21.15.123:0/605451584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf75e3a0 0x556ecf75c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f024ffff640 1 --2- 172.21.15.123:0/605451584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf7531c0 0x556ecf779c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f0254dc5640 1 -- 172.21.15.123:0/605451584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf7531c0 msgr2=0x556ecf779c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:36.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f0254dc5640 1 --2- 172.21.15.123:0/605451584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf7531c0 0x556ecf779c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f0254dc5640 1 -- 172.21.15.123:0/605451584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf753ae0 msgr2=0x556ecf77a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:36.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f0254dc5640 1 --2- 172.21.15.123:0/605451584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf753ae0 0x556ecf77a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f0254dc5640 1 -- 172.21.15.123:0/605451584 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ecf7747e0 con 0x556ecf75e3a0 2024-08-18T22:11:36.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f024ffff640 1 --2- 172.21.15.123:0/605451584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf7531c0 0x556ecf779c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:36.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f024f7fe640 1 --2- 172.21.15.123:0/605451584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf753ae0 0x556ecf77a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:36.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.086+0000 7f0254dc5640 1 --2- 172.21.15.123:0/605451584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf75e3a0 0x556ecf75c920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0248051ea0 tx=0x7f0248009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68362041d2288a92 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:36.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.087+0000 7f0235ffb640 1 -- 172.21.15.123:0/605451584 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248009b20 con 0x556ecf75e3a0 2024-08-18T22:11:36.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.087+0000 7f0235ffb640 1 -- 172.21.15.123:0/605451584 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0248036040 con 0x556ecf75e3a0 2024-08-18T22:11:36.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.087+0000 7f0235ffb640 1 -- 172.21.15.123:0/605451584 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248051620 con 0x556ecf75e3a0 2024-08-18T22:11:36.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.087+0000 7f0258c26740 1 -- 172.21.15.123:0/605451584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf75e3a0 msgr2=0x556ecf75c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:36.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.087+0000 7f0258c26740 1 --2- 172.21.15.123:0/605451584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf75e3a0 0x556ecf75c920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0248051ea0 tx=0x7f0248009a20 comp rx=0 tx=0).stop 2024-08-18T22:11:36.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.087+0000 7f0258c26740 1 -- 172.21.15.123:0/605451584 shutdown_connections 2024-08-18T22:11:36.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.087+0000 7f0258c26740 1 --2- 172.21.15.123:0/605451584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf75e3a0 0x556ecf75c920 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.087+0000 7f0258c26740 1 --2- 172.21.15.123:0/605451584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf753ae0 0x556ecf77a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.087+0000 7f0258c26740 1 --2- 172.21.15.123:0/605451584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf7531c0 0x556ecf779c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.087+0000 7f0258c26740 1 -- 172.21.15.123:0/605451584 >> 172.21.15.123:0/605451584 conn(0x556ecf74f750 msgr2=0x556ecf75a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:36.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.087+0000 7f0258c26740 1 -- 172.21.15.123:0/605451584 shutdown_connections 2024-08-18T22:11:36.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.088+0000 7f0258c26740 1 -- 172.21.15.123:0/605451584 wait complete. 2024-08-18T22:11:36.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.088+0000 7f0258c26740 1 -- start start 2024-08-18T22:11:36.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.088+0000 7f0258c26740 1 Processor -- start 2024-08-18T22:11:36.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.088+0000 7f0258c26740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf7531c0 0x556ecf765860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.088+0000 7f0258c26740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf753ae0 0x556ecf765da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.088+0000 7f0258c26740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf75e3a0 0x556ecf7dac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.088+0000 7f0258c26740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f02501aacd0 con 0x556ecf75e3a0 2024-08-18T22:11:36.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.088+0000 7f0258c26740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f02501ac140 con 0x556ecf753ae0 2024-08-18T22:11:36.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.088+0000 7f0258c26740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f02501ab3a0 con 0x556ecf7531c0 2024-08-18T22:11:36.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.088+0000 7f0258c26740 10 client.0 _ll_register_callbacks cb 0x7f0248048020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:36.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.088+0000 7f0254dc5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf75e3a0 0x556ecf7dac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.088+0000 7f024ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf7531c0 0x556ecf765860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f0254dc5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf75e3a0 0x556ecf7dac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39306/0 (socket says 172.21.15.123:39306) 2024-08-18T22:11:36.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f024ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf7531c0 0x556ecf765860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:42248/0 (socket says 172.21.15.123:42248) 2024-08-18T22:11:36.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f0254dc5640 1 -- 172.21.15.123:0/958224180 learned_addr learned my addr 172.21.15.123:0/958224180 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:36.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f024f7fe640 1 --2- 172.21.15.123:0/958224180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf753ae0 0x556ecf765da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f024ffff640 1 -- 172.21.15.123:0/958224180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf753ae0 msgr2=0x556ecf765da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:36.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f024ffff640 1 --2- 172.21.15.123:0/958224180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf753ae0 0x556ecf765da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f024ffff640 1 -- 172.21.15.123:0/958224180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf75e3a0 msgr2=0x556ecf7dac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:36.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f024ffff640 1 --2- 172.21.15.123:0/958224180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf75e3a0 0x556ecf7dac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f024ffff640 1 -- 172.21.15.123:0/958224180 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ecf7db150 con 0x556ecf7531c0 2024-08-18T22:11:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f0254dc5640 1 --2- 172.21.15.123:0/958224180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf75e3a0 0x556ecf7dac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f024ffff640 1 --2- 172.21.15.123:0/958224180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf7531c0 0x556ecf765860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f02400ccac0 tx=0x7f02400054d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e336430bf201ff05 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f022f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-08-18T22:11:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f022f7fe640 1 -- 172.21.15.123:0/958224180 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024001c040 con 0x556ecf7531c0 2024-08-18T22:11:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f022f7fe640 1 -- 172.21.15.123:0/958224180 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f02400860b0 con 0x556ecf7531c0 2024-08-18T22:11:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f0258c26740 1 -- 172.21.15.123:0/958224180 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0248036040 con 0x556ecf7531c0 2024-08-18T22:11:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f022f7fe640 1 -- 172.21.15.123:0/958224180 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f024009bed0 con 0x556ecf7531c0 2024-08-18T22:11:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f0258c26740 10 client.25465 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.089+0000 7f0258c26740 1 -- 172.21.15.123:0/958224180 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556ecf7dc350 con 0x556ecf7531c0 2024-08-18T22:11:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.090+0000 7f022f7fe640 1 -- 172.21.15.123:0/958224180 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0248036040 con 0x556ecf7531c0 2024-08-18T22:11:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.090+0000 7f022f7fe640 1 -- 172.21.15.123:0/958224180 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f0240004ca0 con 0x556ecf7531c0 2024-08-18T22:11:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.090+0000 7f0258c26740 10 client.25465 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.090+0000 7f0258c26740 10 client.25465 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-18T22:11:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.090+0000 7f0258c26740 20 client.25465 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.090+0000 7f0258c26740 1 --2- 172.21.15.123:0/958224180 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x556ecf7dcb40 0x556ecf7def60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.090+0000 7f0258c26740 4 client.25465 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:11:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.090+0000 7f0258c26740 1 -- 172.21.15.123:0/958224180 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ecf6c04c0 con 0x556ecf7dcb40 2024-08-18T22:11:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.090+0000 7f024f7fe640 1 --2- 172.21.15.123:0/958224180 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x556ecf7dcb40 0x556ecf7def60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.091+0000 7f024f7fe640 1 --2- 172.21.15.123:0/958224180 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x556ecf7dcb40 0x556ecf7def60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=38d30ac7eb863366 server_cookie=12cb89bb1650d5fc in_seq=0 out_seq=0 2024-08-18T22:11:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.091+0000 7f022f7fe640 10 client.25465 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:11:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.091+0000 7f022f7fe640 1 -- 172.21.15.123:0/958224180 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ecf6c04c0 con 0x556ecf7dcb40 2024-08-18T22:11:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.091+0000 7f022f7fe640 10 client.25465 handle_command_reply: tid=0 2024-08-18T22:11:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.091+0000 7f0258c26740 1 client.25465 shutdown 2024-08-18T22:11:36.097 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:11:36.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.091+0000 7f0258c26740 1 -- 172.21.15.123:0/958224180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf7531c0 msgr2=0x556ecf765860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:36.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.091+0000 7f0258c26740 1 --2- 172.21.15.123:0/958224180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf7531c0 0x556ecf765860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f02400ccac0 tx=0x7f02400054d0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.092+0000 7f0258c26740 1 -- 172.21.15.123:0/958224180 shutdown_connections 2024-08-18T22:11:36.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.092+0000 7f0258c26740 1 --2- 172.21.15.123:0/958224180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556ecf75e3a0 0x556ecf7dac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.092+0000 7f0258c26740 1 --2- 172.21.15.123:0/958224180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ecf753ae0 0x556ecf765da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.092+0000 7f0258c26740 1 --2- 172.21.15.123:0/958224180 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x556ecf7dcb40 0x556ecf7def60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.092+0000 7f0258c26740 1 --2- 172.21.15.123:0/958224180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ecf7531c0 0x556ecf765860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.092+0000 7f0258c26740 1 -- 172.21.15.123:0/958224180 >> 172.21.15.123:0/958224180 conn(0x556ecf74f750 msgr2=0x556ecf74e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:36.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.092+0000 7f022f7fe640 0 client.25465 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:11:36.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.092+0000 7f0258c26740 1 -- 172.21.15.123:0/958224180 shutdown_connections 2024-08-18T22:11:36.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.092+0000 7f0258c26740 1 -- 172.21.15.123:0/958224180 wait complete. 2024-08-18T22:11:36.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.092+0000 7f0258c26740 20 client.25465 trim_cache size 0 max 16384 2024-08-18T22:11:36.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.092+0000 7f02555c6640 1 -- 172.21.15.123:0/597012869 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f02380a2c00 msgr2=0x7f02380a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:36.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.092+0000 7f02555c6640 1 --2- 172.21.15.123:0/597012869 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f02380a2c00 0x7f02380a50c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0248049000 tx=0x7f0248046000 comp rx=0 tx=0).stop 2024-08-18T22:11:36.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.092+0000 7f02555c6640 1 -- 172.21.15.123:0/597012869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02501016f0 msgr2=0x7f0250197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:36.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.092+0000 7f02555c6640 1 --2- 172.21.15.123:0/597012869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02501016f0 0x7f0250197f50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f024000e9f0 tx=0x7f024000eeb0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.093+0000 7f02555c6640 1 -- 172.21.15.123:0/597012869 shutdown_connections 2024-08-18T22:11:36.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.093+0000 7f02555c6640 1 --2- 172.21.15.123:0/597012869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02501076f0 0x7f025019c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.093+0000 7f02555c6640 1 --2- 172.21.15.123:0/597012869 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f02380a2c00 0x7f02380a50c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.093+0000 7f02555c6640 1 --2- 172.21.15.123:0/597012869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0250102090 0x7f0250198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.093+0000 7f02555c6640 1 --2- 172.21.15.123:0/597012869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02501016f0 0x7f0250197f50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:36.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.093+0000 7f02555c6640 1 -- 172.21.15.123:0/597012869 >> 172.21.15.123:0/597012869 conn(0x7f02500fd450 msgr2=0x7f02500fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:36.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.093+0000 7f02555c6640 1 -- 172.21.15.123:0/597012869 shutdown_connections 2024-08-18T22:11:36.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:36.093+0000 7f02555c6640 1 -- 172.21.15.123:0/597012869 wait complete. 2024-08-18T22:11:36.896 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-18T22:11:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.069+0000 7f06e2dff640 1 -- 172.21.15.123:0/1643475773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc100770 msgr2=0x7f06dc100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.069+0000 7f06e2dff640 1 --2- 172.21.15.123:0/1643475773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc100770 0x7f06dc100b70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009900 tx=0x7f06d002a410 comp rx=0 tx=0).stop 2024-08-18T22:11:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.070+0000 7f06e2dff640 1 -- 172.21.15.123:0/1643475773 shutdown_connections 2024-08-18T22:11:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.070+0000 7f06e2dff640 1 --2- 172.21.15.123:0/1643475773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06dc102320 0x7f06dc108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.070+0000 7f06e2dff640 1 --2- 172.21.15.123:0/1643475773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc101960 0x7f06dc101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.070+0000 7f06e2dff640 1 --2- 172.21.15.123:0/1643475773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc100770 0x7f06dc100b70 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.070+0000 7f06e2dff640 1 -- 172.21.15.123:0/1643475773 >> 172.21.15.123:0/1643475773 conn(0x7f06dc0fbf10 msgr2=0x7f06dc0fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.070+0000 7f06e2dff640 1 -- 172.21.15.123:0/1643475773 shutdown_connections 2024-08-18T22:11:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.070+0000 7f06e2dff640 1 -- 172.21.15.123:0/1643475773 wait complete. 2024-08-18T22:11:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.070+0000 7f06e2dff640 1 Processor -- start 2024-08-18T22:11:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.070+0000 7f06e2dff640 1 -- start start 2024-08-18T22:11:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.070+0000 7f06e2dff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc100770 0x7f06dc06a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.070+0000 7f06e2dff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06dc101960 0x7f06dc19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.070+0000 7f06e2dff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc102320 0x7f06dc19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.070+0000 7f06e2dff640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc10c4c0 con 0x7f06dc102320 2024-08-18T22:11:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.070+0000 7f06e2dff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc10c340 con 0x7f06dc101960 2024-08-18T22:11:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.070+0000 7f06e2dff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc10c640 con 0x7f06dc100770 2024-08-18T22:11:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06e139c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc102320 0x7f06dc19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06e0b9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc100770 0x7f06dc06a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06e139c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc102320 0x7f06dc19eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39320/0 (socket says 172.21.15.123:39320) 2024-08-18T22:11:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06e0b9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc100770 0x7f06dc06a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:42266/0 (socket says 172.21.15.123:42266) 2024-08-18T22:11:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06e139c640 1 -- 172.21.15.123:0/1477810283 learned_addr learned my addr 172.21.15.123:0/1477810283 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06dbfff640 1 --2- 172.21.15.123:0/1477810283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06dc101960 0x7f06dc19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06e0b9b640 1 -- 172.21.15.123:0/1477810283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06dc101960 msgr2=0x7f06dc19c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/1477810283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06dc101960 0x7f06dc19c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06e0b9b640 1 -- 172.21.15.123:0/1477810283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc102320 msgr2=0x7f06dc19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/1477810283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc102320 0x7f06dc19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06e0b9b640 1 -- 172.21.15.123:0/1477810283 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06dc19f800 con 0x7f06dc100770 2024-08-18T22:11:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06e139c640 1 --2- 172.21.15.123:0/1477810283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc102320 0x7f06dc19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/1477810283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc100770 0x7f06dc06a140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009230 tx=0x7f06d0032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06d9ffb640 1 -- 172.21.15.123:0/1477810283 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d003f030 con 0x7f06dc100770 2024-08-18T22:11:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06d9ffb640 1 -- 172.21.15.123:0/1477810283 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06d0003ce0 con 0x7f06dc100770 2024-08-18T22:11:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06e2dff640 1 -- 172.21.15.123:0/1477810283 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06dc19fa30 con 0x7f06dc100770 2024-08-18T22:11:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.071+0000 7f06d9ffb640 1 -- 172.21.15.123:0/1477810283 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0035070 con 0x7f06dc100770 2024-08-18T22:11:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.072+0000 7f06e2dff640 1 -- 172.21.15.123:0/1477810283 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06dc19ff70 con 0x7f06dc100770 2024-08-18T22:11:37.076 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.074+0000 7f06d9ffb640 1 -- 172.21.15.123:0/1477810283 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f06d0042030 con 0x7f06dc100770 2024-08-18T22:11:37.076 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.074+0000 7f06d9ffb640 1 --2- 172.21.15.123:0/1477810283 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f06cc0a2c30 0x7f06cc0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.076 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.075+0000 7f06d9ffb640 1 -- 172.21.15.123:0/1477810283 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f06d00ef870 con 0x7f06dc100770 2024-08-18T22:11:37.076 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.075+0000 7f06dbfff640 1 --2- 172.21.15.123:0/1477810283 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f06cc0a2c30 0x7f06cc0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.076 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.075+0000 7f06dbfff640 1 --2- 172.21.15.123:0/1477810283 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f06cc0a2c30 0x7f06cc0a50f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f06dc069eb0 tx=0x7f06c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e5bc6740 1 Processor -- start 2024-08-18T22:11:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e5bc6740 1 -- start start 2024-08-18T22:11:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e5bc6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64d680 0x56423f64da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e5bc6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f64dfc0 0x56423f652a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e5bc6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f653050 0x56423f655510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e5bc6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56423f5b09d0 con 0x56423f653050 2024-08-18T22:11:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e5bc6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56423f558820 con 0x56423f64dfc0 2024-08-18T22:11:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e5bc6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56423f5ac990 con 0x56423f64d680 2024-08-18T22:11:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e139c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f653050 0x56423f655510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e0b9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64d680 0x56423f64da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e139c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f653050 0x56423f655510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39326/0 (socket says 172.21.15.123:39326) 2024-08-18T22:11:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e0b9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64d680 0x56423f64da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:42282/0 (socket says 172.21.15.123:42282) 2024-08-18T22:11:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e139c640 1 -- 172.21.15.123:0/3202945700 learned_addr learned my addr 172.21.15.123:0/3202945700 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06dbfff640 1 --2- 172.21.15.123:0/3202945700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f64dfc0 0x56423f652a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e0b9b640 1 -- 172.21.15.123:0/3202945700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f64dfc0 msgr2=0x56423f652a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/3202945700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f64dfc0 0x56423f652a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e0b9b640 1 -- 172.21.15.123:0/3202945700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f653050 msgr2=0x56423f655510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/3202945700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f653050 0x56423f655510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e0b9b640 1 -- 172.21.15.123:0/3202945700 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56423f2c4210 con 0x56423f64d680 2024-08-18T22:11:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.120+0000 7f06e139c640 1 --2- 172.21.15.123:0/3202945700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f653050 0x56423f655510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.121+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/3202945700 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64d680 0x56423f64da80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f06d0006010 tx=0x7f06d0031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a422230969ce7126 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.121+0000 7f06c6ffd640 1 -- 172.21.15.123:0/3202945700 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0049040 con 0x56423f64d680 2024-08-18T22:11:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.121+0000 7f06c6ffd640 1 -- 172.21.15.123:0/3202945700 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06d00c0090 con 0x56423f64d680 2024-08-18T22:11:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.121+0000 7f06c6ffd640 1 -- 172.21.15.123:0/3202945700 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d00b8550 con 0x56423f64d680 2024-08-18T22:11:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.121+0000 7f06e5bc6740 1 -- 172.21.15.123:0/3202945700 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64d680 msgr2=0x56423f64da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.121+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/3202945700 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64d680 0x56423f64da80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f06d0006010 tx=0x7f06d0031400 comp rx=0 tx=0).stop 2024-08-18T22:11:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.121+0000 7f06e5bc6740 1 -- 172.21.15.123:0/3202945700 shutdown_connections 2024-08-18T22:11:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.121+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/3202945700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f653050 0x56423f655510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.121+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/3202945700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f64dfc0 0x56423f652a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.121+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/3202945700 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64d680 0x56423f64da80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.121+0000 7f06e5bc6740 1 -- 172.21.15.123:0/3202945700 >> 172.21.15.123:0/3202945700 conn(0x56423f648cf0 msgr2=0x56423f6490f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.122+0000 7f06e5bc6740 1 -- 172.21.15.123:0/3202945700 shutdown_connections 2024-08-18T22:11:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.122+0000 7f06e5bc6740 1 -- 172.21.15.123:0/3202945700 wait complete. 2024-08-18T22:11:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.125+0000 7f06e5bc6740 1 -- start start 2024-08-18T22:11:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.131+0000 7f06e5bc6740 1 Processor -- start 2024-08-18T22:11:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e5bc6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64d680 0x56423f657530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e5bc6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64dfc0 0x56423f657a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e5bc6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f653050 0x56423f65eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e5bc6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56423f655de0 con 0x56423f64d680 2024-08-18T22:11:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e5bc6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56423f56c520 con 0x56423f653050 2024-08-18T22:11:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e5bc6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56423f655f60 con 0x56423f64dfc0 2024-08-18T22:11:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e0b9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64d680 0x56423f657530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06dbfff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64dfc0 0x56423f657a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e0b9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64d680 0x56423f657530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39338/0 (socket says 172.21.15.123:39338) 2024-08-18T22:11:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06dbfff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64dfc0 0x56423f657a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:42286/0 (socket says 172.21.15.123:42286) 2024-08-18T22:11:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e0b9b640 1 -- 172.21.15.123:0/2765135172 learned_addr learned my addr 172.21.15.123:0/2765135172 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e139c640 1 --2- 172.21.15.123:0/2765135172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f653050 0x56423f65eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e0b9b640 1 -- 172.21.15.123:0/2765135172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64dfc0 msgr2=0x56423f657a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/2765135172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64dfc0 0x56423f657a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e0b9b640 1 -- 172.21.15.123:0/2765135172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f653050 msgr2=0x56423f65eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/2765135172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f653050 0x56423f65eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e0b9b640 1 -- 172.21.15.123:0/2765135172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56423f390620 con 0x56423f64d680 2024-08-18T22:11:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06dbfff640 1 --2- 172.21.15.123:0/2765135172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64dfc0 0x56423f657a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e5bc6740 10 client.0 _ll_register_callbacks cb 0x56423f2c3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/2765135172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64d680 0x56423f657530 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f06d00ba2e0 tx=0x7f06d002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec2b5f627662e5f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.132+0000 7f06bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.133+0000 7f06bbfff640 1 -- 172.21.15.123:0/2765135172 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d009f060 con 0x56423f64d680 2024-08-18T22:11:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.133+0000 7f06bbfff640 1 -- 172.21.15.123:0/2765135172 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f06d00bbff0 con 0x56423f64d680 2024-08-18T22:11:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.136+0000 7f06e5bc6740 1 -- 172.21.15.123:0/2765135172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06d00c0090 con 0x56423f64d680 2024-08-18T22:11:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.137+0000 7f06bbfff640 1 -- 172.21.15.123:0/2765135172 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f06d0049070 con 0x56423f64d680 2024-08-18T22:11:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.137+0000 7f06e5bc6740 10 client.16032 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.137+0000 7f06e5bc6740 1 -- 172.21.15.123:0/2765135172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({fsmap=26}) -- 0x56423f655de0 con 0x56423f64d680 2024-08-18T22:11:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.143+0000 7f06bbfff640 1 -- 172.21.15.123:0/2765135172 <== mon.0 v2:172.21.15.123:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f06d00c44c0 con 0x56423f64d680 2024-08-18T22:11:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.143+0000 7f06e5bc6740 10 client.16032 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.143+0000 7f06e5bc6740 10 client.16032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.143+0000 7f06e5bc6740 20 client.16032 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.143+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/2765135172 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56423f662ac0 0x56423f664f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.143+0000 7f06e5bc6740 4 client.16032 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.143+0000 7f06e5bc6740 1 -- 172.21.15.123:0/2765135172 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56423f5be100 con 0x56423f662ac0 2024-08-18T22:11:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.143+0000 7f06dbfff640 1 --2- 172.21.15.123:0/2765135172 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56423f662ac0 0x56423f664f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.144+0000 7f06dbfff640 1 --2- 172.21.15.123:0/2765135172 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56423f662ac0 0x56423f664f50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7299df0fdda1686c server_cookie=ab8650e4d03b0cae in_seq=0 out_seq=0 2024-08-18T22:11:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.144+0000 7f06bbfff640 10 client.16032 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:37.146 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.145+0000 7f06bbfff640 1 -- 172.21.15.123:0/2765135172 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56423f5be100 con 0x56423f662ac0 2024-08-18T22:11:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.145+0000 7f06bbfff640 10 client.16032 handle_command_reply: tid=0 2024-08-18T22:11:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.145+0000 7f06e5bc6740 1 client.16032 shutdown 2024-08-18T22:11:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.145+0000 7f06e5bc6740 1 -- 172.21.15.123:0/2765135172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64d680 msgr2=0x56423f657530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.145+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/2765135172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64d680 0x56423f657530 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f06d00ba2e0 tx=0x7f06d002a410 comp rx=0 tx=0).stop 2024-08-18T22:11:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.145+0000 7f06e5bc6740 1 -- 172.21.15.123:0/2765135172 shutdown_connections 2024-08-18T22:11:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.145+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/2765135172 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56423f662ac0 0x56423f664f50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.145+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/2765135172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f653050 0x56423f65eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.145+0000 7f06bbfff640 0 client.16032 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.145+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/2765135172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64dfc0 0x56423f657a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.145+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/2765135172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64d680 0x56423f657530 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.145+0000 7f06e5bc6740 1 -- 172.21.15.123:0/2765135172 >> 172.21.15.123:0/2765135172 conn(0x56423f648cf0 msgr2=0x56423f64a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.146+0000 7f06e5bc6740 1 -- 172.21.15.123:0/2765135172 shutdown_connections 2024-08-18T22:11:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.146+0000 7f06e5bc6740 1 -- 172.21.15.123:0/2765135172 wait complete. 2024-08-18T22:11:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.146+0000 7f06e5bc6740 20 client.16032 trim_cache size 0 max 16384 2024-08-18T22:11:37.163 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:11:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.163+0000 7f06e5bc6740 1 Processor -- start 2024-08-18T22:11:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.163+0000 7f06e5bc6740 1 -- start start 2024-08-18T22:11:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e5bc6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64d680 0x56423f657b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e5bc6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f64dfc0 0x56423f647d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e5bc6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f653050 0x56423f669850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e5bc6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc1acc80 con 0x56423f64d680 2024-08-18T22:11:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e5bc6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc1aa550 con 0x56423f64dfc0 2024-08-18T22:11:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e5bc6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc1a83a0 con 0x56423f653050 2024-08-18T22:11:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e0b9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64d680 0x56423f657b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e139c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f653050 0x56423f669850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e0b9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64d680 0x56423f657b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39342/0 (socket says 172.21.15.123:39342) 2024-08-18T22:11:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e139c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f653050 0x56423f669850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:42302/0 (socket says 172.21.15.123:42302) 2024-08-18T22:11:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e0b9b640 1 -- 172.21.15.123:0/87333819 learned_addr learned my addr 172.21.15.123:0/87333819 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06dbfff640 1 --2- 172.21.15.123:0/87333819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f64dfc0 0x56423f647d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e0b9b640 1 -- 172.21.15.123:0/87333819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f653050 msgr2=0x56423f669850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/87333819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f653050 0x56423f669850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e0b9b640 1 -- 172.21.15.123:0/87333819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f64dfc0 msgr2=0x56423f647d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/87333819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f64dfc0 0x56423f647d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e0b9b640 1 -- 172.21.15.123:0/87333819 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56423f6655d0 con 0x56423f64d680 2024-08-18T22:11:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e139c640 1 --2- 172.21.15.123:0/87333819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f653050 0x56423f669850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06dbfff640 1 --2- 172.21.15.123:0/87333819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f64dfc0 0x56423f647d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/87333819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64d680 0x56423f657b00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f06d00b81f0 tx=0x7f06d0049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a59877f0e38dd0b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.164+0000 7f06c67fc640 1 -- 172.21.15.123:0/87333819 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d009f070 con 0x56423f64d680 2024-08-18T22:11:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.165+0000 7f06c67fc640 1 -- 172.21.15.123:0/87333819 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06d00c0090 con 0x56423f64d680 2024-08-18T22:11:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.165+0000 7f06c67fc640 1 -- 172.21.15.123:0/87333819 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d00bbff0 con 0x56423f64d680 2024-08-18T22:11:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.165+0000 7f06e5bc6740 1 -- 172.21.15.123:0/87333819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64d680 msgr2=0x56423f657b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.165+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/87333819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64d680 0x56423f657b00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f06d00b81f0 tx=0x7f06d0049000 comp rx=0 tx=0).stop 2024-08-18T22:11:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.165+0000 7f06e5bc6740 1 -- 172.21.15.123:0/87333819 shutdown_connections 2024-08-18T22:11:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.165+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/87333819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f653050 0x56423f669850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.165+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/87333819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f64dfc0 0x56423f647d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.165+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/87333819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64d680 0x56423f657b00 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.165+0000 7f06e5bc6740 1 -- 172.21.15.123:0/87333819 >> 172.21.15.123:0/87333819 conn(0x56423f648cf0 msgr2=0x56423f647680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.165+0000 7f06e5bc6740 1 -- 172.21.15.123:0/87333819 shutdown_connections 2024-08-18T22:11:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.165+0000 7f06e5bc6740 1 -- 172.21.15.123:0/87333819 wait complete. 2024-08-18T22:11:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.166+0000 7f06e5bc6740 1 -- start start 2024-08-18T22:11:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.166+0000 7f06e5bc6740 1 Processor -- start 2024-08-18T22:11:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.166+0000 7f06e5bc6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64d680 0x56423f6c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.166+0000 7f06e5bc6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64dfc0 0x56423f6c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.166+0000 7f06e5bc6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f653050 0x56423f6d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.166+0000 7f06e5bc6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc1a8a10 con 0x56423f64dfc0 2024-08-18T22:11:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.166+0000 7f06e5bc6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc1a9e80 con 0x56423f653050 2024-08-18T22:11:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.166+0000 7f06e5bc6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc1a90e0 con 0x56423f64d680 2024-08-18T22:11:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.166+0000 7f06e5bc6740 10 client.0 _ll_register_callbacks cb 0x7f06c8009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.166+0000 7f06dbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64dfc0 0x56423f6c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.166+0000 7f06dbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64dfc0 0x56423f6c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39352/0 (socket says 172.21.15.123:39352) 2024-08-18T22:11:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.166+0000 7f06dbfff640 1 -- 172.21.15.123:0/1955038588 learned_addr learned my addr 172.21.15.123:0/1955038588 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.166+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/1955038588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64d680 0x56423f6c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.166+0000 7f06e139c640 1 --2- 172.21.15.123:0/1955038588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f653050 0x56423f6d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.167+0000 7f06dbfff640 1 -- 172.21.15.123:0/1955038588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64d680 msgr2=0x56423f6c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.167+0000 7f06dbfff640 1 --2- 172.21.15.123:0/1955038588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64d680 0x56423f6c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.167+0000 7f06dbfff640 1 -- 172.21.15.123:0/1955038588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f653050 msgr2=0x56423f6d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.167+0000 7f06dbfff640 1 --2- 172.21.15.123:0/1955038588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f653050 0x56423f6d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.167+0000 7f06dbfff640 1 -- 172.21.15.123:0/1955038588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56423f6d0640 con 0x56423f64dfc0 2024-08-18T22:11:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.167+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/1955038588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64d680 0x56423f6c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.167+0000 7f06dbfff640 1 --2- 172.21.15.123:0/1955038588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64dfc0 0x56423f6c8ff0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x56423f64e9f0 tx=0x7f06c8013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a263a011ef035c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.167+0000 7f06bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.167+0000 7f06bbfff640 1 -- 172.21.15.123:0/1955038588 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8020b50 con 0x56423f64dfc0 2024-08-18T22:11:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.167+0000 7f06bbfff640 1 -- 172.21.15.123:0/1955038588 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f06c8020cf0 con 0x56423f64dfc0 2024-08-18T22:11:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.167+0000 7f06e5bc6740 1 -- 172.21.15.123:0/1955038588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06d00c0090 con 0x56423f64dfc0 2024-08-18T22:11:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.167+0000 7f06bbfff640 1 -- 172.21.15.123:0/1955038588 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f06c803a050 con 0x56423f64dfc0 2024-08-18T22:11:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.167+0000 7f06e5bc6740 10 client.16038 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.167+0000 7f06e5bc6740 1 -- 172.21.15.123:0/1955038588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56423f6d1a20 con 0x56423f64dfc0 2024-08-18T22:11:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.167+0000 7f06bbfff640 1 -- 172.21.15.123:0/1955038588 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06d00c0090 con 0x56423f64dfc0 2024-08-18T22:11:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.168+0000 7f06bbfff640 1 -- 172.21.15.123:0/1955038588 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f06c8004b80 con 0x56423f64dfc0 2024-08-18T22:11:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.168+0000 7f06e5bc6740 10 client.16038 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.168+0000 7f06e5bc6740 10 client.16038 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.168+0000 7f06e5bc6740 20 client.16038 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.168+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/1955038588 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56423f6d2400 0x56423f6d4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.168+0000 7f06e5bc6740 4 client.16038 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:11:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.168+0000 7f06e5bc6740 1 -- 172.21.15.123:0/1955038588 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56423f5b8450 con 0x56423f6d2400 2024-08-18T22:11:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.168+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/1955038588 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56423f6d2400 0x56423f6d4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.168+0000 7f06bbfff640 10 client.16038 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:37.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:37.168+0000 7f06e0b9b640 1 --2- 172.21.15.123:0/1955038588 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56423f6d2400 0x56423f6d4820 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41a86bc729d74678 server_cookie=eb05296393afa478 in_seq=0 out_seq=0 2024-08-18T22:11:37.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:37 smithi123 ceph-mon[18462]: pgmap v455: 129 pgs: 129 active+clean; 8.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 571 KiB/s wr, 25 op/s 2024-08-18T22:11:37.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:37 smithi183 ceph-mon[22097]: pgmap v455: 129 pgs: 129 active+clean; 8.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 571 KiB/s wr, 25 op/s 2024-08-18T22:11:37.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:37 smithi130 ceph-mon[21698]: pgmap v455: 129 pgs: 129 active+clean; 8.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 571 KiB/s wr, 25 op/s 2024-08-18T22:11:37.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.684+0000 7f95f1328640 1 -- 172.21.15.123:0/3598997643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95ec1022a0 msgr2=0x7f95ec1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:37.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.684+0000 7f95f1328640 1 --2- 172.21.15.123:0/3598997643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95ec1022a0 0x7f95ec1026e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009900 tx=0x7f95d402a480 comp rx=0 tx=0).stop 2024-08-18T22:11:37.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.685+0000 7f95f1328640 1 -- 172.21.15.123:0/3598997643 shutdown_connections 2024-08-18T22:11:37.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.685+0000 7f95f1328640 1 --2- 172.21.15.123:0/3598997643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95ec102c20 0x7f95ec10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.685+0000 7f95f1328640 1 --2- 172.21.15.123:0/3598997643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95ec1022a0 0x7f95ec1026e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.685+0000 7f95f1328640 1 --2- 172.21.15.123:0/3598997643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95ec100b50 0x7f95ec100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.685+0000 7f95f1328640 1 -- 172.21.15.123:0/3598997643 >> 172.21.15.123:0/3598997643 conn(0x7f95ec0fc500 msgr2=0x7f95ec0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:37.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.685+0000 7f95f1328640 1 -- 172.21.15.123:0/3598997643 shutdown_connections 2024-08-18T22:11:37.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.685+0000 7f95f1328640 1 -- 172.21.15.123:0/3598997643 wait complete. 2024-08-18T22:11:37.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.685+0000 7f95f1328640 1 Processor -- start 2024-08-18T22:11:37.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.685+0000 7f95f1328640 1 -- start start 2024-08-18T22:11:37.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.685+0000 7f95f1328640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95ec100b50 0x7f95ec1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.685+0000 7f95f1328640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95ec1022a0 0x7f95ec198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.685+0000 7f95f1328640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95ec102c20 0x7f95ec19ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.685+0000 7f95f1328640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec110cb0 con 0x7f95ec100b50 2024-08-18T22:11:37.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.685+0000 7f95f1328640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec110b30 con 0x7f95ec1022a0 2024-08-18T22:11:37.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.685+0000 7f95f1328640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec110e30 con 0x7f95ec102c20 2024-08-18T22:11:37.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95eaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95ec100b50 0x7f95ec1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95eaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95ec100b50 0x7f95ec1981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39376/0 (socket says 172.21.15.123:39376) 2024-08-18T22:11:37.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95eaffd640 1 -- 172.21.15.123:0/3330567416 learned_addr learned my addr 172.21.15.123:0/3330567416 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:37.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95eb7fe640 1 --2- 172.21.15.123:0/3330567416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95ec102c20 0x7f95ec19ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95e3fff640 1 --2- 172.21.15.123:0/3330567416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95ec1022a0 0x7f95ec198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95eaffd640 1 -- 172.21.15.123:0/3330567416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95ec102c20 msgr2=0x7f95ec19ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:37.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95eaffd640 1 --2- 172.21.15.123:0/3330567416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95ec102c20 0x7f95ec19ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95eaffd640 1 -- 172.21.15.123:0/3330567416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95ec1022a0 msgr2=0x7f95ec198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:37.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95eaffd640 1 --2- 172.21.15.123:0/3330567416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95ec1022a0 0x7f95ec198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95eaffd640 1 -- 172.21.15.123:0/3330567416 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec19d170 con 0x7f95ec100b50 2024-08-18T22:11:37.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95e3fff640 1 --2- 172.21.15.123:0/3330567416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95ec1022a0 0x7f95ec198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:11:37.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95eaffd640 1 --2- 172.21.15.123:0/3330567416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95ec100b50 0x7f95ec1981c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00e9f0 tx=0x7f95dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:37.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95e8ff9640 1 -- 172.21.15.123:0/3330567416 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc00cd80 con 0x7f95ec100b50 2024-08-18T22:11:37.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95e8ff9640 1 -- 172.21.15.123:0/3330567416 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95dc005500 con 0x7f95ec100b50 2024-08-18T22:11:37.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95f1328640 1 -- 172.21.15.123:0/3330567416 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ec19d460 con 0x7f95ec100b50 2024-08-18T22:11:37.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95e8ff9640 1 -- 172.21.15.123:0/3330567416 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc010690 con 0x7f95ec100b50 2024-08-18T22:11:37.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.686+0000 7f95f1328640 1 -- 172.21.15.123:0/3330567416 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ec1a4d40 con 0x7f95ec100b50 2024-08-18T22:11:37.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.689+0000 7f95f3726740 1 Processor -- start 2024-08-18T22:11:37.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.689+0000 7f95e8ff9640 1 -- 172.21.15.123:0/3330567416 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f95dc0046c0 con 0x7f95ec100b50 2024-08-18T22:11:37.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.689+0000 7f95f3726740 1 -- start start 2024-08-18T22:11:37.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.689+0000 7f95f3726740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 0x556d81cb93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.689+0000 7f95f3726740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 0x556d81cc3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.689+0000 7f95f3726740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cc65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.689+0000 7f95f3726740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556d81c1ea40 con 0x556d81cc41d0 2024-08-18T22:11:37.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.689+0000 7f95f3726740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556d81bb69d0 con 0x556d81cb9910 2024-08-18T22:11:37.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.689+0000 7f95f3726740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556d81c1aa00 con 0x556d81cb8ff0 2024-08-18T22:11:37.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.689+0000 7f95e3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cc65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.689+0000 7f95eb7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 0x556d81cb93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.689+0000 7f95e3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cc65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39386/0 (socket says 172.21.15.123:39386) 2024-08-18T22:11:37.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.689+0000 7f95e3fff640 1 -- 172.21.15.123:0/1382604473 learned_addr learned my addr 172.21.15.123:0/1382604473 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:37.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.689+0000 7f95eb7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 0x556d81cb93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:42326/0 (socket says 172.21.15.123:42326) 2024-08-18T22:11:37.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.690+0000 7f95eaffd640 1 --2- 172.21.15.123:0/1382604473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 0x556d81cc3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.690+0000 7f95e3fff640 1 -- 172.21.15.123:0/1382604473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 msgr2=0x556d81cb93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.690+0000 7f95e3fff640 1 --2- 172.21.15.123:0/1382604473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 0x556d81cb93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.690+0000 7f95e3fff640 1 -- 172.21.15.123:0/1382604473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 msgr2=0x556d81cc3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.690+0000 7f95e3fff640 1 --2- 172.21.15.123:0/1382604473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 0x556d81cc3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.690+0000 7f95e3fff640 1 -- 172.21.15.123:0/1382604473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d81bbd650 con 0x556d81cc41d0 2024-08-18T22:11:37.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.690+0000 7f95eb7fe640 1 --2- 172.21.15.123:0/1382604473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 0x556d81cb93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:37.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.690+0000 7f95e8ff9640 1 --2- 172.21.15.123:0/3330567416 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f95d80a2b80 0x7f95d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.690+0000 7f95e3fff640 1 --2- 172.21.15.123:0/1382604473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cc65c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f95d4000c00 tx=0x7f95d4009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feee7dac3b4370ff server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:37.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.690+0000 7f95eb7fe640 1 --2- 172.21.15.123:0/3330567416 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f95d80a2b80 0x7f95d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.690+0000 7f95e8ff9640 1 -- 172.21.15.123:0/3330567416 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f95dc0cf860 con 0x7f95ec100b50 2024-08-18T22:11:37.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.690+0000 7f95e17fa640 1 -- 172.21.15.123:0/1382604473 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d403f070 con 0x556d81cc41d0 2024-08-18T22:11:37.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.690+0000 7f95e17fa640 1 -- 172.21.15.123:0/1382604473 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95d4004470 con 0x556d81cc41d0 2024-08-18T22:11:37.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.690+0000 7f95e17fa640 1 -- 172.21.15.123:0/1382604473 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4035030 con 0x556d81cc41d0 2024-08-18T22:11:37.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.691+0000 7f95f3726740 1 -- 172.21.15.123:0/1382604473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 msgr2=0x556d81cc65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:37.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.691+0000 7f95eb7fe640 1 --2- 172.21.15.123:0/3330567416 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f95d80a2b80 0x7f95d80a5040 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f95e4011940 tx=0x7f95e4013040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:37.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.691+0000 7f95f3726740 1 --2- 172.21.15.123:0/1382604473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cc65c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f95d4000c00 tx=0x7f95d4009680 comp rx=0 tx=0).stop 2024-08-18T22:11:37.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.691+0000 7f95f3726740 1 -- 172.21.15.123:0/1382604473 shutdown_connections 2024-08-18T22:11:37.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.691+0000 7f95f3726740 1 --2- 172.21.15.123:0/1382604473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cc65c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.691+0000 7f95f3726740 1 --2- 172.21.15.123:0/1382604473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 0x556d81cc3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.691+0000 7f95f3726740 1 --2- 172.21.15.123:0/1382604473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 0x556d81cb93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.691+0000 7f95f3726740 1 -- 172.21.15.123:0/1382604473 >> 172.21.15.123:0/1382604473 conn(0x556d81cb5580 msgr2=0x556d81cb5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:37.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.691+0000 7f95f3726740 1 -- 172.21.15.123:0/1382604473 shutdown_connections 2024-08-18T22:11:37.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.691+0000 7f95f3726740 1 -- 172.21.15.123:0/1382604473 wait complete. 2024-08-18T22:11:37.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95f3726740 1 -- start start 2024-08-18T22:11:37.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95f3726740 1 Processor -- start 2024-08-18T22:11:37.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95f3726740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 0x556d81cc1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95f3726740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 0x556d81cc15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95f3726740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cc1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95f3726740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556d81cc6da0 con 0x556d81cc41d0 2024-08-18T22:11:37.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95f3726740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556d81bd9b20 con 0x556d81cb9910 2024-08-18T22:11:37.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95f3726740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556d81cc6f20 con 0x556d81cb8ff0 2024-08-18T22:11:37.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95f3726740 10 client.0 _ll_register_callbacks cb 0x556d81bd7bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:37.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95eb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cc1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95eb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cc1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39398/0 (socket says 172.21.15.123:39398) 2024-08-18T22:11:37.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95eb7fe640 1 -- 172.21.15.123:0/3770610174 learned_addr learned my addr 172.21.15.123:0/3770610174 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:37.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95eaffd640 1 --2- 172.21.15.123:0/3770610174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 0x556d81cc1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95e3fff640 1 --2- 172.21.15.123:0/3770610174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 0x556d81cc15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95eb7fe640 1 -- 172.21.15.123:0/3770610174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 msgr2=0x556d81cc1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95eb7fe640 1 --2- 172.21.15.123:0/3770610174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 0x556d81cc1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95eb7fe640 1 -- 172.21.15.123:0/3770610174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 msgr2=0x556d81cc15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95eb7fe640 1 --2- 172.21.15.123:0/3770610174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 0x556d81cc15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.692+0000 7f95eb7fe640 1 -- 172.21.15.123:0/3770610174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d819903c0 con 0x556d81cc41d0 2024-08-18T22:11:37.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95eb7fe640 1 --2- 172.21.15.123:0/3770610174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cc1af0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f95e401f6b0 tx=0x7f95e4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e745af4583a9b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:37.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:37.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95d27fc640 1 -- 172.21.15.123:0/3770610174 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e402d060 con 0x556d81cc41d0 2024-08-18T22:11:37.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95d27fc640 1 -- 172.21.15.123:0/3770610174 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f95e4028410 con 0x556d81cc41d0 2024-08-18T22:11:37.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95f3726740 1 -- 172.21.15.123:0/3770610174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95d4004470 con 0x556d81cc41d0 2024-08-18T22:11:37.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95d27fc640 1 -- 172.21.15.123:0/3770610174 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f95e4034050 con 0x556d81cc41d0 2024-08-18T22:11:37.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95f3726740 10 client.16050 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:37.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95f3726740 1 -- 172.21.15.123:0/3770610174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556d81cd29d0 con 0x556d81cc41d0 2024-08-18T22:11:37.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95d27fc640 1 -- 172.21.15.123:0/3770610174 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95d4004470 con 0x556d81cc41d0 2024-08-18T22:11:37.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95d27fc640 1 -- 172.21.15.123:0/3770610174 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f95e401d7e0 con 0x556d81cc41d0 2024-08-18T22:11:37.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95f3726740 10 client.16050 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:37.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95f3726740 10 client.16050 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-18T22:11:37.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95f3726740 20 client.16050 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:37.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95f3726740 1 --2- 172.21.15.123:0/3770610174 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x556d81cd3e90 0x556d81cd62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95f3726740 4 client.16050 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:37.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.693+0000 7f95f3726740 1 -- 172.21.15.123:0/3770610174 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d81c2bfb0 con 0x556d81cd3e90 2024-08-18T22:11:37.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.694+0000 7f95eaffd640 1 --2- 172.21.15.123:0/3770610174 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x556d81cd3e90 0x556d81cd62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.694+0000 7f95d27fc640 10 client.16050 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:11:37.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.694+0000 7f95eaffd640 1 --2- 172.21.15.123:0/3770610174 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x556d81cd3e90 0x556d81cd62e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=34e313fb7cde32bf server_cookie=a80f0a5c46a8cc2b in_seq=0 out_seq=0 2024-08-18T22:11:37.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.695+0000 7f95d27fc640 1 -- 172.21.15.123:0/3770610174 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556d81c2bfb0 con 0x556d81cd3e90 2024-08-18T22:11:37.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.695+0000 7f95d27fc640 10 client.16050 handle_command_reply: tid=0 2024-08-18T22:11:37.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.695+0000 7f95f3726740 1 client.16050 shutdown 2024-08-18T22:11:37.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.695+0000 7f95f3726740 1 -- 172.21.15.123:0/3770610174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 msgr2=0x556d81cc1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:37.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.695+0000 7f95f3726740 1 --2- 172.21.15.123:0/3770610174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cc1af0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f95e401f6b0 tx=0x7f95e4004ab0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.695+0000 7f95f3726740 1 -- 172.21.15.123:0/3770610174 shutdown_connections 2024-08-18T22:11:37.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.695+0000 7f95f3726740 1 --2- 172.21.15.123:0/3770610174 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x556d81cd3e90 0x556d81cd62e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.695+0000 7f95f3726740 1 --2- 172.21.15.123:0/3770610174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cc1af0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.695+0000 7f95f3726740 1 --2- 172.21.15.123:0/3770610174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 0x556d81cc15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.695+0000 7f95f3726740 1 --2- 172.21.15.123:0/3770610174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 0x556d81cc1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.695+0000 7f95f3726740 1 -- 172.21.15.123:0/3770610174 >> 172.21.15.123:0/3770610174 conn(0x556d81cb5580 msgr2=0x556d81cbb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:37.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.695+0000 7f95d27fc640 0 client.16050 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:11:37.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.695+0000 7f95f3726740 1 -- 172.21.15.123:0/3770610174 shutdown_connections 2024-08-18T22:11:37.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.695+0000 7f95f3726740 1 -- 172.21.15.123:0/3770610174 wait complete. 2024-08-18T22:11:37.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.695+0000 7f95f3726740 20 client.16050 trim_cache size 0 max 16384 2024-08-18T22:11:37.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95f3726740 1 Processor -- start 2024-08-18T22:11:37.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95f3726740 1 -- start start 2024-08-18T22:11:37.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95f3726740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 0x556d81cdbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95f3726740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 0x556d81cdc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95f3726740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cbf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95f3726740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec1aef60 con 0x556d81cc41d0 2024-08-18T22:11:37.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95f3726740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec1ac830 con 0x556d81cb9910 2024-08-18T22:11:37.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95f3726740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec1aa680 con 0x556d81cb8ff0 2024-08-18T22:11:37.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95eb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cbf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95eb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cbf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39414/0 (socket says 172.21.15.123:39414) 2024-08-18T22:11:37.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95eb7fe640 1 -- 172.21.15.123:0/2379203683 learned_addr learned my addr 172.21.15.123:0/2379203683 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:37.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95eaffd640 1 --2- 172.21.15.123:0/2379203683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 0x556d81cdbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95e3fff640 1 --2- 172.21.15.123:0/2379203683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 0x556d81cdc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95eb7fe640 1 -- 172.21.15.123:0/2379203683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 msgr2=0x556d81cdbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95eb7fe640 1 --2- 172.21.15.123:0/2379203683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 0x556d81cdbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.709+0000 7f95eb7fe640 1 -- 172.21.15.123:0/2379203683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 msgr2=0x556d81cdc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.710+0000 7f95eb7fe640 1 --2- 172.21.15.123:0/2379203683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 0x556d81cdc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.710+0000 7f95eb7fe640 1 -- 172.21.15.123:0/2379203683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d81cb6210 con 0x556d81cc41d0 2024-08-18T22:11:37.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.710+0000 7f95eaffd640 1 --2- 172.21.15.123:0/2379203683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 0x556d81cdbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:37.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.710+0000 7f95e3fff640 1 --2- 172.21.15.123:0/2379203683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 0x556d81cdc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:11:37.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.710+0000 7f95eb7fe640 1 --2- 172.21.15.123:0/2379203683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cbf960 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f95e4007ef0 tx=0x7f95e400ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ad88148ece8da3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:37.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.710+0000 7f95e0ff9640 1 -- 172.21.15.123:0/2379203683 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4004b20 con 0x556d81cc41d0 2024-08-18T22:11:37.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.710+0000 7f95e0ff9640 1 -- 172.21.15.123:0/2379203683 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95e401d8f0 con 0x556d81cc41d0 2024-08-18T22:11:37.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.710+0000 7f95e0ff9640 1 -- 172.21.15.123:0/2379203683 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e40055e0 con 0x556d81cc41d0 2024-08-18T22:11:37.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.711+0000 7f95f3726740 1 -- 172.21.15.123:0/2379203683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 msgr2=0x556d81cbf960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:37.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.711+0000 7f95f3726740 1 --2- 172.21.15.123:0/2379203683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cbf960 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f95e4007ef0 tx=0x7f95e400ce80 comp rx=0 tx=0).stop 2024-08-18T22:11:37.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.711+0000 7f95f3726740 1 -- 172.21.15.123:0/2379203683 shutdown_connections 2024-08-18T22:11:37.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.711+0000 7f95f3726740 1 --2- 172.21.15.123:0/2379203683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cc41d0 0x556d81cbf960 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.711+0000 7f95f3726740 1 --2- 172.21.15.123:0/2379203683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cb9910 0x556d81cdc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.711+0000 7f95f3726740 1 --2- 172.21.15.123:0/2379203683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb8ff0 0x556d81cdbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.711+0000 7f95f3726740 1 -- 172.21.15.123:0/2379203683 >> 172.21.15.123:0/2379203683 conn(0x556d81cb5580 msgr2=0x556d81cb01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.711+0000 7f95f3726740 1 -- 172.21.15.123:0/2379203683 shutdown_connections 2024-08-18T22:11:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.711+0000 7f95f3726740 1 -- 172.21.15.123:0/2379203683 wait complete. 2024-08-18T22:11:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.711+0000 7f95f3726740 1 -- start start 2024-08-18T22:11:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.711+0000 7f95f3726740 1 Processor -- start 2024-08-18T22:11:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.711+0000 7f95f3726740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cb8ff0 0x556d81ccc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.711+0000 7f95f3726740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb9910 0x556d81ccc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.711+0000 7f95f3726740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cc41d0 0x556d81cbd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95f3726740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec1aacf0 con 0x556d81cb8ff0 2024-08-18T22:11:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95f3726740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec1ac160 con 0x556d81cc41d0 2024-08-18T22:11:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95f3726740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec1ab3c0 con 0x556d81cb9910 2024-08-18T22:11:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95f3726740 10 client.0 _ll_register_callbacks cb 0x7f95e4007740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:37.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95eaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cb8ff0 0x556d81ccc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95eaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cb8ff0 0x556d81ccc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39422/0 (socket says 172.21.15.123:39422) 2024-08-18T22:11:37.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95eaffd640 1 -- 172.21.15.123:0/2419666175 learned_addr learned my addr 172.21.15.123:0/2419666175 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:37.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95e3fff640 1 --2- 172.21.15.123:0/2419666175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb9910 0x556d81ccc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95eb7fe640 1 --2- 172.21.15.123:0/2419666175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cc41d0 0x556d81cbd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95eaffd640 1 -- 172.21.15.123:0/2419666175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb9910 msgr2=0x556d81ccc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95eaffd640 1 --2- 172.21.15.123:0/2419666175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb9910 0x556d81ccc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95eaffd640 1 -- 172.21.15.123:0/2419666175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cc41d0 msgr2=0x556d81cbd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:37.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95eaffd640 1 --2- 172.21.15.123:0/2419666175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cc41d0 0x556d81cbd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95eaffd640 1 -- 172.21.15.123:0/2419666175 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d81cbd920 con 0x556d81cb8ff0 2024-08-18T22:11:37.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95eb7fe640 1 --2- 172.21.15.123:0/2419666175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cc41d0 0x556d81cbd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:11:37.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95eaffd640 1 --2- 172.21.15.123:0/2419666175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cb8ff0 0x556d81ccc170 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0ccfd0 tx=0x7f95dc09b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b422a0c7cb21fa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:37.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95d27fc640 1 -- 172.21.15.123:0/2419666175 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc09bd30 con 0x556d81cb8ff0 2024-08-18T22:11:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95d27fc640 1 -- 172.21.15.123:0/2419666175 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f95dc0983a0 con 0x556d81cb8ff0 2024-08-18T22:11:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95f3726740 1 -- 172.21.15.123:0/2419666175 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95e401d8f0 con 0x556d81cb8ff0 2024-08-18T22:11:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95d27fc640 1 -- 172.21.15.123:0/2419666175 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f95dc0a00e0 con 0x556d81cb8ff0 2024-08-18T22:11:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95f3726740 10 client.16056 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.712+0000 7f95f3726740 1 -- 172.21.15.123:0/2419666175 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556d81d3e0f0 con 0x556d81cb8ff0 2024-08-18T22:11:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.713+0000 7f95d27fc640 1 -- 172.21.15.123:0/2419666175 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95e401d8f0 con 0x556d81cb8ff0 2024-08-18T22:11:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.713+0000 7f95d27fc640 1 -- 172.21.15.123:0/2419666175 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f95dc09abf0 con 0x556d81cb8ff0 2024-08-18T22:11:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.713+0000 7f95f3726740 10 client.16056 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.713+0000 7f95f3726740 10 client.16056 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-18T22:11:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.713+0000 7f95f3726740 20 client.16056 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.713+0000 7f95f3726740 1 --2- 172.21.15.123:0/2419666175 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x556d81d3e860 0x556d81d40c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.713+0000 7f95f3726740 4 client.16056 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:11:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.713+0000 7f95f3726740 1 -- 172.21.15.123:0/2419666175 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556d81c264c0 con 0x556d81d3e860 2024-08-18T22:11:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.713+0000 7f95e3fff640 1 --2- 172.21.15.123:0/2419666175 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x556d81d3e860 0x556d81d40c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95d27fc640 10 client.16056 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:11:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95e3fff640 1 --2- 172.21.15.123:0/2419666175 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x556d81d3e860 0x556d81d40c80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=63599976916fade8 server_cookie=b954bb956e7e8502 in_seq=0 out_seq=0 2024-08-18T22:11:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95d27fc640 1 -- 172.21.15.123:0/2419666175 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556d81c264c0 con 0x556d81d3e860 2024-08-18T22:11:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95d27fc640 10 client.16056 handle_command_reply: tid=0 2024-08-18T22:11:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95f3726740 1 client.16056 shutdown 2024-08-18T22:11:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95f3726740 1 -- 172.21.15.123:0/2419666175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cb8ff0 msgr2=0x556d81ccc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95f3726740 1 --2- 172.21.15.123:0/2419666175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cb8ff0 0x556d81ccc170 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0ccfd0 tx=0x7f95dc09b750 comp rx=0 tx=0).stop 2024-08-18T22:11:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95f3726740 1 -- 172.21.15.123:0/2419666175 shutdown_connections 2024-08-18T22:11:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95f3726740 1 --2- 172.21.15.123:0/2419666175 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x556d81d3e860 0x556d81d40c80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95f3726740 1 --2- 172.21.15.123:0/2419666175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d81cc41d0 0x556d81cbd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95f3726740 1 --2- 172.21.15.123:0/2419666175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d81cb9910 0x556d81ccc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95f3726740 1 --2- 172.21.15.123:0/2419666175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d81cb8ff0 0x556d81ccc170 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95f3726740 1 -- 172.21.15.123:0/2419666175 >> 172.21.15.123:0/2419666175 conn(0x556d81cb5580 msgr2=0x556d81cbf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:37.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95d27fc640 0 client.16056 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:11:37.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95f3726740 1 -- 172.21.15.123:0/2419666175 shutdown_connections 2024-08-18T22:11:37.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95f3726740 1 -- 172.21.15.123:0/2419666175 wait complete. 2024-08-18T22:11:37.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.714+0000 7f95f3726740 20 client.16056 trim_cache size 0 max 16384 2024-08-18T22:11:37.724 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:11:37.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.715+0000 7f95f1328640 1 -- 172.21.15.123:0/3330567416 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f95d80a2b80 msgr2=0x7f95d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:37.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.715+0000 7f95f1328640 1 --2- 172.21.15.123:0/3330567416 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f95d80a2b80 0x7f95d80a5040 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f95e4011940 tx=0x7f95e4013040 comp rx=0 tx=0).stop 2024-08-18T22:11:37.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.715+0000 7f95f1328640 1 -- 172.21.15.123:0/3330567416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95ec100b50 msgr2=0x7f95ec1981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:37.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.715+0000 7f95f1328640 1 --2- 172.21.15.123:0/3330567416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95ec100b50 0x7f95ec1981c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00e9f0 tx=0x7f95dc00edf0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.715+0000 7f95f1328640 1 -- 172.21.15.123:0/3330567416 shutdown_connections 2024-08-18T22:11:37.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.715+0000 7f95f1328640 1 --2- 172.21.15.123:0/3330567416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95ec102c20 0x7f95ec19ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.715+0000 7f95f1328640 1 --2- 172.21.15.123:0/3330567416 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f95d80a2b80 0x7f95d80a5040 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.715+0000 7f95f1328640 1 --2- 172.21.15.123:0/3330567416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95ec1022a0 0x7f95ec198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.715+0000 7f95f1328640 1 --2- 172.21.15.123:0/3330567416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95ec100b50 0x7f95ec1981c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:37.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.715+0000 7f95f1328640 1 -- 172.21.15.123:0/3330567416 >> 172.21.15.123:0/3330567416 conn(0x7f95ec0fc500 msgr2=0x7f95ec069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:37.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.715+0000 7f95f1328640 1 -- 172.21.15.123:0/3330567416 shutdown_connections 2024-08-18T22:11:37.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:37.715+0000 7f95f1328640 1 -- 172.21.15.123:0/3330567416 wait complete. 2024-08-18T22:11:38.672 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-18T22:11:38.672 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-08-18T22:11:38.672 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:11:38.687 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-18T22:11:39.316 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:11:39.369 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:11:39.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:39 smithi183 ceph-mon[22097]: pgmap v456: 129 pgs: 129 active+clean; 9.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 737 KiB/s wr, 25 op/s 2024-08-18T22:11:39.494 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:39 smithi123 ceph-mon[18462]: pgmap v456: 129 pgs: 129 active+clean; 9.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 737 KiB/s wr, 25 op/s 2024-08-18T22:11:39.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:39 smithi130 ceph-mon[21698]: pgmap v456: 129 pgs: 129 active+clean; 9.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 737 KiB/s wr, 25 op/s 2024-08-18T22:11:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.134+0000 7f06bbfff640 1 -- 172.21.15.123:0/1955038588 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56423f5b8450 con 0x56423f6d2400 2024-08-18T22:11:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.134+0000 7f06bbfff640 10 client.16038 handle_command_reply: tid=0 2024-08-18T22:11:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.134+0000 7f06e5bc6740 1 client.16038 shutdown 2024-08-18T22:11:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.135+0000 7f06e5bc6740 1 -- 172.21.15.123:0/1955038588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64dfc0 msgr2=0x56423f6c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.135+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/1955038588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64dfc0 0x56423f6c8ff0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x56423f64e9f0 tx=0x7f06c8013040 comp rx=0 tx=0).stop 2024-08-18T22:11:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.135+0000 7f06e5bc6740 1 -- 172.21.15.123:0/1955038588 shutdown_connections 2024-08-18T22:11:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.135+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/1955038588 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56423f6d2400 0x56423f6d4820 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.135+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/1955038588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56423f653050 0x56423f6d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.135+0000 7f06bbfff640 0 client.16038 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.135+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/1955038588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56423f64dfc0 0x56423f6c8ff0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.135+0000 7f06e5bc6740 1 --2- 172.21.15.123:0/1955038588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56423f64d680 0x56423f6c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.135+0000 7f06e5bc6740 1 -- 172.21.15.123:0/1955038588 >> 172.21.15.123:0/1955038588 conn(0x56423f648cf0 msgr2=0x56423f657990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.135+0000 7f06e5bc6740 1 -- 172.21.15.123:0/1955038588 shutdown_connections 2024-08-18T22:11:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.135+0000 7f06e5bc6740 1 -- 172.21.15.123:0/1955038588 wait complete. 2024-08-18T22:11:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.135+0000 7f06e5bc6740 20 client.16038 trim_cache size 0 max 16384 2024-08-18T22:11:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:11:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:11:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:11:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:11:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.136+0000 7f06e2dff640 1 -- 172.21.15.123:0/1477810283 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f06cc0a2c30 msgr2=0x7f06cc0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.136+0000 7f06e2dff640 1 --2- 172.21.15.123:0/1477810283 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f06cc0a2c30 0x7f06cc0a50f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f06dc069eb0 tx=0x7f06c8005f90 comp rx=0 tx=0).stop 2024-08-18T22:11:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.136+0000 7f06e2dff640 1 -- 172.21.15.123:0/1477810283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc100770 msgr2=0x7f06dc06a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.136+0000 7f06e2dff640 1 --2- 172.21.15.123:0/1477810283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc100770 0x7f06dc06a140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009230 tx=0x7f06d0032ce0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.136+0000 7f06e2dff640 1 -- 172.21.15.123:0/1477810283 shutdown_connections 2024-08-18T22:11:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.136+0000 7f06e2dff640 1 --2- 172.21.15.123:0/1477810283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc102320 0x7f06dc19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.136+0000 7f06e2dff640 1 --2- 172.21.15.123:0/1477810283 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f06cc0a2c30 0x7f06cc0a50f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.136+0000 7f06e2dff640 1 --2- 172.21.15.123:0/1477810283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06dc101960 0x7f06dc19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.136+0000 7f06e2dff640 1 --2- 172.21.15.123:0/1477810283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc100770 0x7f06dc06a140 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.136+0000 7f06e2dff640 1 -- 172.21.15.123:0/1477810283 >> 172.21.15.123:0/1477810283 conn(0x7f06dc0fbf10 msgr2=0x7f06dc104c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.136+0000 7f06e2dff640 1 -- 172.21.15.123:0/1477810283 shutdown_connections 2024-08-18T22:11:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:40.136+0000 7f06e2dff640 1 -- 172.21.15.123:0/1477810283 wait complete. 2024-08-18T22:11:40.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.075+0000 7fe7d02d1640 1 -- 172.21.15.123:0/2803377280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7c8102c20 msgr2=0x7fe7c810d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:40.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.075+0000 7fe7d02d1640 1 --2- 172.21.15.123:0/2803377280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7c8102c20 0x7fe7c810d770 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009ca0 tx=0x7fe7c002a950 comp rx=0 tx=0).stop 2024-08-18T22:11:40.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.075+0000 7fe7d02d1640 1 -- 172.21.15.123:0/2803377280 shutdown_connections 2024-08-18T22:11:40.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.075+0000 7fe7d02d1640 1 --2- 172.21.15.123:0/2803377280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7c8102c20 0x7fe7c810d770 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.075+0000 7fe7d02d1640 1 --2- 172.21.15.123:0/2803377280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7c81022a0 0x7fe7c81026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.075+0000 7fe7d02d1640 1 --2- 172.21.15.123:0/2803377280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7c8100b50 0x7fe7c8100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.075+0000 7fe7d02d1640 1 -- 172.21.15.123:0/2803377280 >> 172.21.15.123:0/2803377280 conn(0x7fe7c80fc500 msgr2=0x7fe7c80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:40.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.075+0000 7fe7d02d1640 1 -- 172.21.15.123:0/2803377280 shutdown_connections 2024-08-18T22:11:40.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.075+0000 7fe7d02d1640 1 -- 172.21.15.123:0/2803377280 wait complete. 2024-08-18T22:11:40.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7d02d1640 1 Processor -- start 2024-08-18T22:11:40.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7d02d1640 1 -- start start 2024-08-18T22:11:40.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7d02d1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7c8100b50 0x7fe7c819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:40.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7d02d1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7c81022a0 0x7fe7c819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:40.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7d02d1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7c8102c20 0x7fe7c819ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:40.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7d02d1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c8110cb0 con 0x7fe7c8100b50 2024-08-18T22:11:40.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7d02d1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c8110b30 con 0x7fe7c81022a0 2024-08-18T22:11:40.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7d02d1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c8110e30 con 0x7fe7c8102c20 2024-08-18T22:11:40.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7ce06d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7c8100b50 0x7fe7c819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:40.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7ce06d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7c8100b50 0x7fe7c819a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39450/0 (socket says 172.21.15.123:39450) 2024-08-18T22:11:40.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7ce06d640 1 -- 172.21.15.123:0/810514519 learned_addr learned my addr 172.21.15.123:0/810514519 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:40.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7ce86e640 1 --2- 172.21.15.123:0/810514519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7c8102c20 0x7fe7c819ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:40.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7cd86c640 1 --2- 172.21.15.123:0/810514519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7c81022a0 0x7fe7c819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:40.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7ce06d640 1 -- 172.21.15.123:0/810514519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7c8102c20 msgr2=0x7fe7c819ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:40.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7ce06d640 1 --2- 172.21.15.123:0/810514519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7c8102c20 0x7fe7c819ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7ce06d640 1 -- 172.21.15.123:0/810514519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7c81022a0 msgr2=0x7fe7c819a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:40.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7ce06d640 1 --2- 172.21.15.123:0/810514519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7c81022a0 0x7fe7c819a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7ce06d640 1 -- 172.21.15.123:0/810514519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c819f330 con 0x7fe7c8100b50 2024-08-18T22:11:40.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.076+0000 7fe7cd86c640 1 --2- 172.21.15.123:0/810514519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7c81022a0 0x7fe7c819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:40.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.077+0000 7fe7ce06d640 1 --2- 172.21.15.123:0/810514519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7c8100b50 0x7fe7c819a380 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400d950 tx=0x7fe7c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:40.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.077+0000 7fe7bf7fe640 1 -- 172.21.15.123:0/810514519 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4017030 con 0x7fe7c8100b50 2024-08-18T22:11:40.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.077+0000 7fe7d02d1640 1 -- 172.21.15.123:0/810514519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c819f620 con 0x7fe7c8100b50 2024-08-18T22:11:40.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.077+0000 7fe7bf7fe640 1 -- 172.21.15.123:0/810514519 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7c4004020 con 0x7fe7c8100b50 2024-08-18T22:11:40.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.077+0000 7fe7bf7fe640 1 -- 172.21.15.123:0/810514519 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40047a0 con 0x7fe7c8100b50 2024-08-18T22:11:40.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.077+0000 7fe7d02d1640 1 -- 172.21.15.123:0/810514519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c81a6f00 con 0x7fe7c8100b50 2024-08-18T22:11:40.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.078+0000 7fe7d02d1640 1 -- 172.21.15.123:0/810514519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c8100f30 con 0x7fe7c8100b50 2024-08-18T22:11:40.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.080+0000 7fe7bf7fe640 1 -- 172.21.15.123:0/810514519 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fe7c40041d0 con 0x7fe7c8100b50 2024-08-18T22:11:40.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.081+0000 7fe7bf7fe640 1 --2- 172.21.15.123:0/810514519 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe7b40a2b80 0x7fe7b40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:40.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.081+0000 7fe7cd86c640 1 --2- 172.21.15.123:0/810514519 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe7b40a2b80 0x7fe7b40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:40.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.081+0000 7fe7bf7fe640 1 -- 172.21.15.123:0/810514519 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe7c40cf4d0 con 0x7fe7c8100b50 2024-08-18T22:11:40.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.081+0000 7fe7cd86c640 1 --2- 172.21.15.123:0/810514519 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe7b40a2b80 0x7fe7b40a5040 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8005fd0 tx=0x7fe7b8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:40.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.084+0000 7fe7bf7fe640 1 -- 172.21.15.123:0/810514519 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe7c409c0a0 con 0x7fe7c8100b50 2024-08-18T22:11:40.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.319+0000 7fe7d02d1640 1 -- 172.21.15.123:0/810514519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7c81a7160 con 0x7fe7c8100b50 2024-08-18T22:11:40.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.320+0000 7fe7bf7fe640 1 -- 172.21.15.123:0/810514519 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7fe7c409b9a0 con 0x7fe7c8100b50 2024-08-18T22:11:40.321 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:11:40.321 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"btime":"2024-08-18T22:07:46:492460+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:07:45.601053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:11:40.322 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 26 2024-08-18T22:11:40.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.322+0000 7fe7d02d1640 1 -- 172.21.15.123:0/810514519 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe7b40a2b80 msgr2=0x7fe7b40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:40.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.322+0000 7fe7d02d1640 1 --2- 172.21.15.123:0/810514519 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe7b40a2b80 0x7fe7b40a5040 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8005fd0 tx=0x7fe7b8005850 comp rx=0 tx=0).stop 2024-08-18T22:11:40.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.322+0000 7fe7d02d1640 1 -- 172.21.15.123:0/810514519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7c8100b50 msgr2=0x7fe7c819a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:40.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.322+0000 7fe7d02d1640 1 --2- 172.21.15.123:0/810514519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7c8100b50 0x7fe7c819a380 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400d950 tx=0x7fe7c400de10 comp rx=0 tx=0).stop 2024-08-18T22:11:40.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.322+0000 7fe7d02d1640 1 -- 172.21.15.123:0/810514519 shutdown_connections 2024-08-18T22:11:40.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.322+0000 7fe7d02d1640 1 --2- 172.21.15.123:0/810514519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7c8102c20 0x7fe7c819ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.322+0000 7fe7d02d1640 1 --2- 172.21.15.123:0/810514519 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe7b40a2b80 0x7fe7b40a5040 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.322+0000 7fe7d02d1640 1 --2- 172.21.15.123:0/810514519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7c81022a0 0x7fe7c819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.322+0000 7fe7d02d1640 1 --2- 172.21.15.123:0/810514519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7c8100b50 0x7fe7c819a380 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:40.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.322+0000 7fe7d02d1640 1 -- 172.21.15.123:0/810514519 >> 172.21.15.123:0/810514519 conn(0x7fe7c80fc500 msgr2=0x7fe7c806a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:40.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.322+0000 7fe7d02d1640 1 -- 172.21.15.123:0/810514519 shutdown_connections 2024-08-18T22:11:40.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:40.322+0000 7fe7d02d1640 1 -- 172.21.15.123:0/810514519 wait complete. 2024-08-18T22:11:41.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:41 smithi123 ceph-mon[18462]: pgmap v457: 129 pgs: 129 active+clean; 9.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 851 KiB/s wr, 165 op/s 2024-08-18T22:11:41.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:41 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/810514519' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:11:41.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:41 smithi183 ceph-mon[22097]: pgmap v457: 129 pgs: 129 active+clean; 9.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 851 KiB/s wr, 165 op/s 2024-08-18T22:11:41.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:41 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/810514519' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:11:41.431 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-08-18T22:11:41.432 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24466 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-08-18T22:11:41.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:41 smithi130 ceph-mon[21698]: pgmap v457: 129 pgs: 129 active+clean; 9.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 851 KiB/s wr, 165 op/s 2024-08-18T22:11:41.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:41 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/810514519' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:11:41.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.672+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2179288166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc102c20 msgr2=0x7f06dc10d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:41.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.672+0000 7f06e0ab3640 1 --2- 172.21.15.123:0/2179288166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc102c20 0x7f06dc10d770 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009ca0 tx=0x7f06d402a950 comp rx=0 tx=0).stop 2024-08-18T22:11:41.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.672+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2179288166 shutdown_connections 2024-08-18T22:11:41.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.672+0000 7f06e0ab3640 1 --2- 172.21.15.123:0/2179288166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc102c20 0x7f06dc10d770 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.672+0000 7f06e0ab3640 1 --2- 172.21.15.123:0/2179288166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06dc1022a0 0x7f06dc1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.672+0000 7f06e0ab3640 1 --2- 172.21.15.123:0/2179288166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc100b50 0x7f06dc100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.672+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2179288166 >> 172.21.15.123:0/2179288166 conn(0x7f06dc0fc500 msgr2=0x7f06dc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:41.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.672+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2179288166 shutdown_connections 2024-08-18T22:11:41.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.672+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2179288166 wait complete. 2024-08-18T22:11:41.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.673+0000 7f06e0ab3640 1 Processor -- start 2024-08-18T22:11:41.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.673+0000 7f06e0ab3640 1 -- start start 2024-08-18T22:11:41.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.673+0000 7f06e0ab3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc100b50 0x7f06dc197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.674+0000 7f06e0ab3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06dc1022a0 0x7f06dc1976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.674+0000 7f06da59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc100b50 0x7f06dc197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.674+0000 7f06da59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc100b50 0x7f06dc197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:42392/0 (socket says 172.21.15.123:42392) 2024-08-18T22:11:41.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.674+0000 7f06e0ab3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc102c20 0x7f06dc19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.674+0000 7f06da59c640 1 -- 172.21.15.123:0/2679584024 learned_addr learned my addr 172.21.15.123:0/2679584024 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:41.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.674+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2679584024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc110cb0 con 0x7f06dc102c20 2024-08-18T22:11:41.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.674+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2679584024 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc110b30 con 0x7f06dc1022a0 2024-08-18T22:11:41.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.674+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2679584024 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc110e30 con 0x7f06dc100b50 2024-08-18T22:11:41.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.674+0000 7f06d9d9b640 1 --2- 172.21.15.123:0/2679584024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06dc1022a0 0x7f06dc1976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.674+0000 7f06dad9d640 1 --2- 172.21.15.123:0/2679584024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc102c20 0x7f06dc19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.674+0000 7f06da59c640 1 -- 172.21.15.123:0/2679584024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06dc1022a0 msgr2=0x7f06dc1976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:41.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.674+0000 7f06da59c640 1 --2- 172.21.15.123:0/2679584024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06dc1022a0 0x7f06dc1976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.674+0000 7f06da59c640 1 -- 172.21.15.123:0/2679584024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc102c20 msgr2=0x7f06dc19ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:41.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.674+0000 7f06da59c640 1 --2- 172.21.15.123:0/2679584024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc102c20 0x7f06dc19ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.674+0000 7f06da59c640 1 -- 172.21.15.123:0/2679584024 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06dc19c120 con 0x7f06dc100b50 2024-08-18T22:11:41.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.675+0000 7f06da59c640 1 --2- 172.21.15.123:0/2679584024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc100b50 0x7f06dc197170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00e9f0 tx=0x7f06cc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:41.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.675+0000 7f06cb7fe640 1 -- 172.21.15.123:0/2679584024 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc00cd80 con 0x7f06dc100b50 2024-08-18T22:11:41.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.675+0000 7f06cb7fe640 1 -- 172.21.15.123:0/2679584024 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06cc010910 con 0x7f06dc100b50 2024-08-18T22:11:41.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.675+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2679584024 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06dc19c410 con 0x7f06dc100b50 2024-08-18T22:11:41.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.675+0000 7f06cb7fe640 1 -- 172.21.15.123:0/2679584024 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc018990 con 0x7f06dc100b50 2024-08-18T22:11:41.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.675+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2679584024 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06dc069ca0 con 0x7f06dc100b50 2024-08-18T22:11:41.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.678+0000 7f06cb7fe640 1 -- 172.21.15.123:0/2679584024 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f06cc018b30 con 0x7f06dc100b50 2024-08-18T22:11:41.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.678+0000 7f06e2eb1740 1 Processor -- start 2024-08-18T22:11:41.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.678+0000 7f06e2eb1740 1 -- start start 2024-08-18T22:11:41.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06e2eb1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x5570164263d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06e2eb1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 0x557016430c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06e2eb1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5570164311d0 0x5570164335c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06e2eb1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55701638ba40 con 0x557016425ff0 2024-08-18T22:11:41.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06e2eb1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5570163239d0 con 0x557016426910 2024-08-18T22:11:41.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06e2eb1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557016387a00 con 0x5570164311d0 2024-08-18T22:11:41.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06da59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 0x557016430c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06dad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x5570164263d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06dad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x5570164263d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39462/0 (socket says 172.21.15.123:39462) 2024-08-18T22:11:41.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06dad9d640 1 -- 172.21.15.123:0/821087790 learned_addr learned my addr 172.21.15.123:0/821087790 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:41.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06d9d9b640 1 --2- 172.21.15.123:0/821087790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5570164311d0 0x5570164335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06cb7fe640 1 --2- 172.21.15.123:0/2679584024 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f06c40a2cd0 0x7f06c40a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06da59c640 1 -- 172.21.15.123:0/821087790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5570164311d0 msgr2=0x5570164335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:41.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06da59c640 1 --2- 172.21.15.123:0/821087790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5570164311d0 0x5570164335c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06da59c640 1 -- 172.21.15.123:0/821087790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 msgr2=0x5570164263d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:41.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06da59c640 1 --2- 172.21.15.123:0/821087790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x5570164263d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.679+0000 7f06da59c640 1 -- 172.21.15.123:0/821087790 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55701632a650 con 0x557016426910 2024-08-18T22:11:41.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.680+0000 7f06d9d9b640 1 --2- 172.21.15.123:0/821087790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5570164311d0 0x5570164335c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:41.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.680+0000 7f06dad9d640 1 --2- 172.21.15.123:0/2679584024 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f06c40a2cd0 0x7f06c40a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.680+0000 7f06cb7fe640 1 -- 172.21.15.123:0/2679584024 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f06cc0cf620 con 0x7f06dc100b50 2024-08-18T22:11:41.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.680+0000 7f06da59c640 1 --2- 172.21.15.123:0/821087790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 0x557016430c90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0ccd60 tx=0x7f06cc0c6680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0c7deb1e0be37fa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:41.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.680+0000 7f06c8ff9640 1 -- 172.21.15.123:0/821087790 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc026030 con 0x557016426910 2024-08-18T22:11:41.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.680+0000 7f06c8ff9640 1 -- 172.21.15.123:0/821087790 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06cc06f310 con 0x557016426910 2024-08-18T22:11:41.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.680+0000 7f06c8ff9640 1 -- 172.21.15.123:0/821087790 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0a1030 con 0x557016426910 2024-08-18T22:11:41.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.681+0000 7f06e2eb1740 1 -- 172.21.15.123:0/821087790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 msgr2=0x557016430c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:41.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.681+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/821087790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 0x557016430c90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0ccd60 tx=0x7f06cc0c6680 comp rx=0 tx=0).stop 2024-08-18T22:11:41.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.681+0000 7f06dad9d640 1 --2- 172.21.15.123:0/2679584024 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f06c40a2cd0 0x7f06c40a5190 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009ca0 tx=0x7f06d402fe20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:41.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.681+0000 7f06e2eb1740 1 -- 172.21.15.123:0/821087790 shutdown_connections 2024-08-18T22:11:41.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.681+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/821087790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5570164311d0 0x5570164335c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.681+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/821087790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 0x557016430c90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.681+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/821087790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x5570164263d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.681+0000 7f06e2eb1740 1 -- 172.21.15.123:0/821087790 >> 172.21.15.123:0/821087790 conn(0x557016422580 msgr2=0x557016422960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:41.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.681+0000 7f06e2eb1740 1 -- 172.21.15.123:0/821087790 shutdown_connections 2024-08-18T22:11:41.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.681+0000 7f06e2eb1740 1 -- 172.21.15.123:0/821087790 wait complete. 2024-08-18T22:11:41.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.682+0000 7f06e2eb1740 1 -- start start 2024-08-18T22:11:41.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.682+0000 7f06e2eb1740 1 Processor -- start 2024-08-18T22:11:41.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.682+0000 7f06e2eb1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x557016430940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.682+0000 7f06e2eb1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 0x557016429c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.682+0000 7f06e2eb1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5570164311d0 0x55701642a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.682+0000 7f06e2eb1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5570164381b0 con 0x557016425ff0 2024-08-18T22:11:41.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.682+0000 7f06e2eb1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557016346b20 con 0x557016426910 2024-08-18T22:11:41.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.682+0000 7f06e2eb1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557016438330 con 0x5570164311d0 2024-08-18T22:11:41.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.682+0000 7f06e2eb1740 10 client.0 _ll_register_callbacks cb 0x557016344bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:41.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.682+0000 7f06dad9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5570164311d0 0x55701642a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.682+0000 7f06dad9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5570164311d0 0x55701642a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:42418/0 (socket says 172.21.15.123:42418) 2024-08-18T22:11:41.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.682+0000 7f06dad9d640 1 -- 172.21.15.123:0/1244951793 learned_addr learned my addr 172.21.15.123:0/1244951793 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:41.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.682+0000 7f06da59c640 1 --2- 172.21.15.123:0/1244951793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x557016430940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.682+0000 7f06d9d9b640 1 --2- 172.21.15.123:0/1244951793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 0x557016429c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.682+0000 7f06dad9d640 1 -- 172.21.15.123:0/1244951793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 msgr2=0x557016429c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:41.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.683+0000 7f06dad9d640 1 --2- 172.21.15.123:0/1244951793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 0x557016429c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.683+0000 7f06dad9d640 1 -- 172.21.15.123:0/1244951793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 msgr2=0x557016430940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:41.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.683+0000 7f06dad9d640 1 --2- 172.21.15.123:0/1244951793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x557016430940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.683+0000 7f06dad9d640 1 -- 172.21.15.123:0/1244951793 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570160fd3c0 con 0x5570164311d0 2024-08-18T22:11:41.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.683+0000 7f06da59c640 1 --2- 172.21.15.123:0/1244951793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x557016430940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:41.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.683+0000 7f06d9d9b640 1 --2- 172.21.15.123:0/1244951793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 0x557016429c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:41.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.683+0000 7f06dad9d640 1 --2- 172.21.15.123:0/1244951793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5570164311d0 0x55701642a1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f06d402f6d0 tx=0x7f06d4040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52215e45d0e46d14 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:41.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.683+0000 7f06c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-08-18T22:11:41.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.683+0000 7f06c1ffb640 1 -- 172.21.15.123:0/1244951793 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4043050 con 0x5570164311d0 2024-08-18T22:11:41.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.683+0000 7f06c1ffb640 1 -- 172.21.15.123:0/1244951793 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f06d4004240 con 0x5570164311d0 2024-08-18T22:11:41.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.683+0000 7f06e2eb1740 1 -- 172.21.15.123:0/1244951793 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06cc06f310 con 0x5570164311d0 2024-08-18T22:11:41.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.683+0000 7f06c1ffb640 1 -- 172.21.15.123:0/1244951793 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f06d405c050 con 0x5570164311d0 2024-08-18T22:11:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.684+0000 7f06e2eb1740 10 client.25519 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.684+0000 7f06e2eb1740 1 -- 172.21.15.123:0/1244951793 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55701642f190 con 0x5570164311d0 2024-08-18T22:11:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.684+0000 7f06c1ffb640 1 -- 172.21.15.123:0/1244951793 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06cc06f310 con 0x5570164311d0 2024-08-18T22:11:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.684+0000 7f06c1ffb640 1 -- 172.21.15.123:0/1244951793 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f06d40309d0 con 0x5570164311d0 2024-08-18T22:11:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.684+0000 7f06e2eb1740 10 client.25519 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.684+0000 7f06e2eb1740 10 client.25519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.684+0000 7f06e2eb1740 20 client.25519 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.684+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/1244951793 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557016449a90 0x55701644bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.684+0000 7f06e2eb1740 4 client.25519 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.684+0000 7f06e2eb1740 1 -- 172.21.15.123:0/1244951793 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557016398fb0 con 0x557016449a90 2024-08-18T22:11:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.684+0000 7f06da59c640 1 --2- 172.21.15.123:0/1244951793 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557016449a90 0x55701644bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.684+0000 7f06c1ffb640 10 client.25519 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.685+0000 7f06da59c640 1 --2- 172.21.15.123:0/1244951793 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557016449a90 0x55701644bed0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1f3fb926a45c5a3 server_cookie=17881d3bf44e8122 in_seq=0 out_seq=0 2024-08-18T22:11:41.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.686+0000 7f06c1ffb640 1 -- 172.21.15.123:0/1244951793 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557016398fb0 con 0x557016449a90 2024-08-18T22:11:41.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.686+0000 7f06c1ffb640 10 client.25519 handle_command_reply: tid=0 2024-08-18T22:11:41.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.686+0000 7f06e2eb1740 1 client.25519 shutdown 2024-08-18T22:11:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.687+0000 7f06e2eb1740 1 -- 172.21.15.123:0/1244951793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5570164311d0 msgr2=0x55701642a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.687+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/1244951793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5570164311d0 0x55701642a1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f06d402f6d0 tx=0x7f06d4040000 comp rx=0 tx=0).stop 2024-08-18T22:11:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.687+0000 7f06e2eb1740 1 -- 172.21.15.123:0/1244951793 shutdown_connections 2024-08-18T22:11:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.687+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/1244951793 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557016449a90 0x55701644bed0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.687+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/1244951793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5570164311d0 0x55701642a1b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.687+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/1244951793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 0x557016429c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.687+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/1244951793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x557016430940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.687+0000 7f06e2eb1740 1 -- 172.21.15.123:0/1244951793 >> 172.21.15.123:0/1244951793 conn(0x557016422580 msgr2=0x5570164282b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.687+0000 7f06c1ffb640 0 client.25519 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.687+0000 7f06e2eb1740 1 -- 172.21.15.123:0/1244951793 shutdown_connections 2024-08-18T22:11:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.687+0000 7f06e2eb1740 1 -- 172.21.15.123:0/1244951793 wait complete. 2024-08-18T22:11:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.687+0000 7f06e2eb1740 20 client.25519 trim_cache size 0 max 16384 2024-08-18T22:11:41.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.703+0000 7f06e2eb1740 1 Processor -- start 2024-08-18T22:11:41.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.703+0000 7f06e2eb1740 1 -- start start 2024-08-18T22:11:41.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.703+0000 7f06e2eb1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557016422580 0x557016428a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.703+0000 7f06e2eb1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x55701644baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.703+0000 7f06e2eb1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 0x557016434280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.703+0000 7f06e2eb1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc1af080 con 0x557016425ff0 2024-08-18T22:11:41.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.703+0000 7f06e2eb1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc1ac950 con 0x557016426910 2024-08-18T22:11:41.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.703+0000 7f06e2eb1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc1aa7f0 con 0x557016422580 2024-08-18T22:11:41.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.703+0000 7f06d9d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x55701644baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.703+0000 7f06da59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557016422580 0x557016428a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.703+0000 7f06da59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557016422580 0x557016428a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:42430/0 (socket says 172.21.15.123:42430) 2024-08-18T22:11:41.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.703+0000 7f06da59c640 1 -- 172.21.15.123:0/2337696599 learned_addr learned my addr 172.21.15.123:0/2337696599 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:41.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.703+0000 7f06dad9d640 1 --2- 172.21.15.123:0/2337696599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 0x557016434280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.703+0000 7f06d9d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x55701644baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39480/0 (socket says 172.21.15.123:39480) 2024-08-18T22:11:41.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.704+0000 7f06da59c640 1 -- 172.21.15.123:0/2337696599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 msgr2=0x557016434280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:41.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.704+0000 7f06da59c640 1 --2- 172.21.15.123:0/2337696599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 0x557016434280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.704+0000 7f06da59c640 1 -- 172.21.15.123:0/2337696599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 msgr2=0x55701644baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:41.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.704+0000 7f06da59c640 1 --2- 172.21.15.123:0/2337696599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x55701644baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.704+0000 7f06da59c640 1 -- 172.21.15.123:0/2337696599 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55701642aff0 con 0x557016422580 2024-08-18T22:11:41.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.704+0000 7f06d9d9b640 1 --2- 172.21.15.123:0/2337696599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x55701644baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:41.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.704+0000 7f06da59c640 1 --2- 172.21.15.123:0/2337696599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557016422580 0x557016428a50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00c6a0 tx=0x7f06cc0d5550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b956636bc7dbcc85 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:41.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.704+0000 7f06c3fff640 1 -- 172.21.15.123:0/2337696599 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc06f110 con 0x557016422580 2024-08-18T22:11:41.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.704+0000 7f06c3fff640 1 -- 172.21.15.123:0/2337696599 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06cc06f310 con 0x557016422580 2024-08-18T22:11:41.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.704+0000 7f06c3fff640 1 -- 172.21.15.123:0/2337696599 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc099cd0 con 0x557016422580 2024-08-18T22:11:41.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.705+0000 7f06e2eb1740 1 -- 172.21.15.123:0/2337696599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557016422580 msgr2=0x557016428a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:41.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.705+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/2337696599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557016422580 0x557016428a50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00c6a0 tx=0x7f06cc0d5550 comp rx=0 tx=0).stop 2024-08-18T22:11:41.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.705+0000 7f06e2eb1740 1 -- 172.21.15.123:0/2337696599 shutdown_connections 2024-08-18T22:11:41.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.705+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/2337696599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016426910 0x557016434280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.705+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/2337696599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016425ff0 0x55701644baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.705+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/2337696599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557016422580 0x557016428a50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.705+0000 7f06e2eb1740 1 -- 172.21.15.123:0/2337696599 >> 172.21.15.123:0/2337696599 conn(0x557016437b90 msgr2=0x55701641d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:41.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.705+0000 7f06e2eb1740 1 -- 172.21.15.123:0/2337696599 shutdown_connections 2024-08-18T22:11:41.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.705+0000 7f06e2eb1740 1 -- 172.21.15.123:0/2337696599 wait complete. 2024-08-18T22:11:41.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.705+0000 7f06e2eb1740 1 -- start start 2024-08-18T22:11:41.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.706+0000 7f06e2eb1740 1 Processor -- start 2024-08-18T22:11:41.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.706+0000 7f06e2eb1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016422580 0x557016446000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.706+0000 7f06e2eb1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016425ff0 0x557016446540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.706+0000 7f06e2eb1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557016426910 0x557016440dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.706+0000 7f06da59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016422580 0x557016446000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.706+0000 7f06e2eb1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc1aae60 con 0x557016422580 2024-08-18T22:11:41.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.706+0000 7f06e2eb1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc1ac280 con 0x557016425ff0 2024-08-18T22:11:41.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.706+0000 7f06e2eb1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc1ab4e0 con 0x557016426910 2024-08-18T22:11:41.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.706+0000 7f06da59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016422580 0x557016446000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39486/0 (socket says 172.21.15.123:39486) 2024-08-18T22:11:41.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.706+0000 7f06da59c640 1 -- 172.21.15.123:0/4220975724 learned_addr learned my addr 172.21.15.123:0/4220975724 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:41.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.706+0000 7f06dad9d640 1 --2- 172.21.15.123:0/4220975724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557016426910 0x557016440dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.706+0000 7f06d9d9b640 1 --2- 172.21.15.123:0/4220975724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016425ff0 0x557016446540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.706+0000 7f06e2eb1740 10 client.0 _ll_register_callbacks cb 0x7f06d4009820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:41.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.706+0000 7f06dad9d640 1 -- 172.21.15.123:0/4220975724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016425ff0 msgr2=0x557016446540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:41.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.706+0000 7f06dad9d640 1 --2- 172.21.15.123:0/4220975724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016425ff0 0x557016446540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.707+0000 7f06dad9d640 1 -- 172.21.15.123:0/4220975724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016422580 msgr2=0x557016446000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:41.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.707+0000 7f06dad9d640 1 --2- 172.21.15.123:0/4220975724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016422580 0x557016446000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.707+0000 7f06dad9d640 1 -- 172.21.15.123:0/4220975724 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557016441510 con 0x557016426910 2024-08-18T22:11:41.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.707+0000 7f06dad9d640 1 --2- 172.21.15.123:0/4220975724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557016426910 0x557016440dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f06d4030da0 tx=0x7f06d4009540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=957a0078a3843133 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:41.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.707+0000 7f06c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-08-18T22:11:41.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.707+0000 7f06c1ffb640 1 -- 172.21.15.123:0/4220975724 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4065070 con 0x557016426910 2024-08-18T22:11:41.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.707+0000 7f06e2eb1740 1 -- 172.21.15.123:0/4220975724 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06cc06f310 con 0x557016426910 2024-08-18T22:11:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.707+0000 7f06c1ffb640 1 -- 172.21.15.123:0/4220975724 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f06d4030850 con 0x557016426910 2024-08-18T22:11:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.707+0000 7f06c1ffb640 1 -- 172.21.15.123:0/4220975724 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f06d4071050 con 0x557016426910 2024-08-18T22:11:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.707+0000 7f06e2eb1740 10 client.25525 fetch_fsmap learned FSMap version 26 2024-08-18T22:11:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.707+0000 7f06e2eb1740 1 -- 172.21.15.123:0/4220975724 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5570164b3140 con 0x557016426910 2024-08-18T22:11:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.707+0000 7f06c1ffb640 1 -- 172.21.15.123:0/4220975724 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06cc06f310 con 0x557016426910 2024-08-18T22:11:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.708+0000 7f06c1ffb640 1 -- 172.21.15.123:0/4220975724 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f06d406a440 con 0x557016426910 2024-08-18T22:11:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.708+0000 7f06e2eb1740 10 client.25525 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:11:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.708+0000 7f06e2eb1740 10 client.25525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.708+0000 7f06e2eb1740 20 client.25525 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.708+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/4220975724 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5570164311d0 0x5570164b5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.708+0000 7f06e2eb1740 4 client.25525 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:11:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.708+0000 7f06e2eb1740 1 -- 172.21.15.123:0/4220975724 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5570163934c0 con 0x5570164311d0 2024-08-18T22:11:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.708+0000 7f06da59c640 1 --2- 172.21.15.123:0/4220975724 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5570164311d0 0x5570164b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.708+0000 7f06c1ffb640 10 client.25525 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.708+0000 7f06da59c640 1 --2- 172.21.15.123:0/4220975724 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5570164311d0 0x5570164b5830 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=195fe2156668b665 server_cookie=f7230b915f109c32 in_seq=0 out_seq=0 2024-08-18T22:11:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.710+0000 7f06c1ffb640 1 -- 172.21.15.123:0/4220975724 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5570163934c0 con 0x5570164311d0 2024-08-18T22:11:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.710+0000 7f06c1ffb640 10 client.25525 handle_command_reply: tid=0 2024-08-18T22:11:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.710+0000 7f06e2eb1740 1 client.25525 shutdown 2024-08-18T22:11:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.710+0000 7f06e2eb1740 1 -- 172.21.15.123:0/4220975724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557016426910 msgr2=0x557016440dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.710+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/4220975724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557016426910 0x557016440dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f06d4030da0 tx=0x7f06d4009540 comp rx=0 tx=0).stop 2024-08-18T22:11:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.710+0000 7f06e2eb1740 1 -- 172.21.15.123:0/4220975724 shutdown_connections 2024-08-18T22:11:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.710+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/4220975724 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5570164311d0 0x5570164b5830 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.711+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/4220975724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557016426910 0x557016440dd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.711+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/4220975724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557016425ff0 0x557016446540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.711+0000 7f06e2eb1740 1 --2- 172.21.15.123:0/4220975724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557016422580 0x557016446000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.711+0000 7f06e2eb1740 1 -- 172.21.15.123:0/4220975724 >> 172.21.15.123:0/4220975724 conn(0x557016437b90 msgr2=0x55701644baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.711+0000 7f06c1ffb640 0 client.25525 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.711+0000 7f06e2eb1740 1 -- 172.21.15.123:0/4220975724 shutdown_connections 2024-08-18T22:11:41.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.711+0000 7f06e2eb1740 1 -- 172.21.15.123:0/4220975724 wait complete. 2024-08-18T22:11:41.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.711+0000 7f06e2eb1740 20 client.25525 trim_cache size 0 max 16384 2024-08-18T22:11:41.716 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:11:41.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.712+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2679584024 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f06c40a2cd0 msgr2=0x7f06c40a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:41.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.712+0000 7f06e0ab3640 1 --2- 172.21.15.123:0/2679584024 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f06c40a2cd0 0x7f06c40a5190 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009ca0 tx=0x7f06d402fe20 comp rx=0 tx=0).stop 2024-08-18T22:11:41.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.712+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2679584024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc100b50 msgr2=0x7f06dc197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:41.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.712+0000 7f06e0ab3640 1 --2- 172.21.15.123:0/2679584024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc100b50 0x7f06dc197170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00e9f0 tx=0x7f06cc00eeb0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.712+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2679584024 shutdown_connections 2024-08-18T22:11:41.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.712+0000 7f06e0ab3640 1 --2- 172.21.15.123:0/2679584024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06dc102c20 0x7f06dc19ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.712+0000 7f06e0ab3640 1 --2- 172.21.15.123:0/2679584024 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f06c40a2cd0 0x7f06c40a5190 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.712+0000 7f06e0ab3640 1 --2- 172.21.15.123:0/2679584024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06dc1022a0 0x7f06dc1976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.712+0000 7f06e0ab3640 1 --2- 172.21.15.123:0/2679584024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06dc100b50 0x7f06dc197170 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:41.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.712+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2679584024 >> 172.21.15.123:0/2679584024 conn(0x7f06dc0fc500 msgr2=0x7f06dc106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:41.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.712+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2679584024 shutdown_connections 2024-08-18T22:11:41.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:41.712+0000 7f06e0ab3640 1 -- 172.21.15.123:0/2679584024 wait complete. 2024-08-18T22:11:42.885 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:11:43.402 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:43 smithi123 ceph-mon[18462]: pgmap v458: 129 pgs: 129 active+clean; 10 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 1.4 MiB/s wr, 574 op/s 2024-08-18T22:11:43.408 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:43 smithi183 ceph-mon[22097]: pgmap v458: 129 pgs: 129 active+clean; 10 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 1.4 MiB/s wr, 574 op/s 2024-08-18T22:11:43.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:43 smithi130 ceph-mon[21698]: pgmap v458: 129 pgs: 129 active+clean; 10 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 1.4 MiB/s wr, 574 op/s 2024-08-18T22:11:43.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.805+0000 7f51e5f63640 1 -- 172.21.15.123:0/2499490678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51e0102c20 msgr2=0x7f51e010d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:43.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.805+0000 7f51e5f63640 1 --2- 172.21.15.123:0/2499490678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51e0102c20 0x7f51e010d770 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009ca0 tx=0x7f51d802a950 comp rx=0 tx=0).stop 2024-08-18T22:11:43.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.805+0000 7f51e5f63640 1 -- 172.21.15.123:0/2499490678 shutdown_connections 2024-08-18T22:11:43.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.805+0000 7f51e5f63640 1 --2- 172.21.15.123:0/2499490678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51e0102c20 0x7f51e010d770 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.805+0000 7f51e5f63640 1 --2- 172.21.15.123:0/2499490678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e01022a0 0x7f51e01026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.805+0000 7f51e5f63640 1 --2- 172.21.15.123:0/2499490678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51e0100b50 0x7f51e0100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.805+0000 7f51e5f63640 1 -- 172.21.15.123:0/2499490678 >> 172.21.15.123:0/2499490678 conn(0x7f51e00fc500 msgr2=0x7f51e00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:43.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.805+0000 7f51e5f63640 1 -- 172.21.15.123:0/2499490678 shutdown_connections 2024-08-18T22:11:43.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.805+0000 7f51e5f63640 1 -- 172.21.15.123:0/2499490678 wait complete. 2024-08-18T22:11:43.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.805+0000 7f51e5f63640 1 Processor -- start 2024-08-18T22:11:43.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.805+0000 7f51e5f63640 1 -- start start 2024-08-18T22:11:43.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51e5f63640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51e0100b50 0x7f51e01990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51e5f63640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e01022a0 0x7f51e0199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51e5f63640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51e0102c20 0x7f51e01a4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51e5f63640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f51e0110cd0 con 0x7f51e0100b50 2024-08-18T22:11:43.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51e5f63640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f51e0110b50 con 0x7f51e0102c20 2024-08-18T22:11:43.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51e5f63640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f51e0110e50 con 0x7f51e01022a0 2024-08-18T22:11:43.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51deffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e01022a0 0x7f51e0199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51deffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e01022a0 0x7f51e0199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:52168/0 (socket says 172.21.15.123:52168) 2024-08-18T22:11:43.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51deffd640 1 -- 172.21.15.123:0/1159727333 learned_addr learned my addr 172.21.15.123:0/1159727333 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:43.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51df7fe640 1 --2- 172.21.15.123:0/1159727333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51e0100b50 0x7f51e01990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51dffff640 1 --2- 172.21.15.123:0/1159727333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51e0102c20 0x7f51e01a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51deffd640 1 -- 172.21.15.123:0/1159727333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51e0102c20 msgr2=0x7f51e01a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:43.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51deffd640 1 --2- 172.21.15.123:0/1159727333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51e0102c20 0x7f51e01a4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51deffd640 1 -- 172.21.15.123:0/1159727333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51e0100b50 msgr2=0x7f51e01990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:43.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51deffd640 1 --2- 172.21.15.123:0/1159727333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51e0100b50 0x7f51e01990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51deffd640 1 -- 172.21.15.123:0/1159727333 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e01a46a0 con 0x7f51e01022a0 2024-08-18T22:11:43.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.806+0000 7f51df7fe640 1 --2- 172.21.15.123:0/1159727333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51e0100b50 0x7f51e01990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:43.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.807+0000 7f51deffd640 1 --2- 172.21.15.123:0/1159727333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e01022a0 0x7f51e0199620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f51d400e9f0 tx=0x7f51d400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:43.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.807+0000 7f51dcff9640 1 -- 172.21.15.123:0/1159727333 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d400ccc0 con 0x7f51e01022a0 2024-08-18T22:11:43.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.807+0000 7f51dcff9640 1 -- 172.21.15.123:0/1159727333 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51d4010910 con 0x7f51e01022a0 2024-08-18T22:11:43.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.807+0000 7f51dcff9640 1 -- 172.21.15.123:0/1159727333 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d40188a0 con 0x7f51e01022a0 2024-08-18T22:11:43.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.807+0000 7f51e5f63640 1 -- 172.21.15.123:0/1159727333 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e01a4870 con 0x7f51e01022a0 2024-08-18T22:11:43.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.807+0000 7f51e5f63640 1 -- 172.21.15.123:0/1159727333 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e01a4d80 con 0x7f51e01022a0 2024-08-18T22:11:43.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.810+0000 7f51e8361740 1 Processor -- start 2024-08-18T22:11:43.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.810+0000 7f51e8361740 1 -- start start 2024-08-18T22:11:43.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.810+0000 7f51e8361740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814130 0x555929814510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.810+0000 7f51e8361740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555929814a50 0x55592981edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.810+0000 7f51e8361740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55592981f310 0x555929821700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.810+0000 7f51e8361740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555929779a70 con 0x555929814a50 2024-08-18T22:11:43.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.810+0000 7f51e8361740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555929711780 con 0x55592981f310 2024-08-18T22:11:43.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.810+0000 7f51e8361740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555929775a30 con 0x555929814130 2024-08-18T22:11:43.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.810+0000 7f51dffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814130 0x555929814510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.810+0000 7f51dffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814130 0x555929814510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:52176/0 (socket says 172.21.15.123:52176) 2024-08-18T22:11:43.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.810+0000 7f51dffff640 1 -- 172.21.15.123:0/2735476759 learned_addr learned my addr 172.21.15.123:0/2735476759 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:43.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.811+0000 7f51df7fe640 1 --2- 172.21.15.123:0/2735476759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555929814a50 0x55592981edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.811+0000 7f51dffff640 1 -- 172.21.15.123:0/2735476759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55592981f310 msgr2=0x555929821700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T22:11:43.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.811+0000 7f51dffff640 1 --2- 172.21.15.123:0/2735476759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55592981f310 0x555929821700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.811+0000 7f51dffff640 1 -- 172.21.15.123:0/2735476759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555929814a50 msgr2=0x55592981edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:43.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.811+0000 7f51dffff640 1 --2- 172.21.15.123:0/2735476759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555929814a50 0x55592981edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.811+0000 7f51dffff640 1 -- 172.21.15.123:0/2735476759 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559294ebb90 con 0x555929814130 2024-08-18T22:11:43.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.811+0000 7f51df7fe640 1 --2- 172.21.15.123:0/2735476759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555929814a50 0x55592981edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:43.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.811+0000 7f51dcff9640 1 -- 172.21.15.123:0/1159727333 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f51d4010ac0 con 0x7f51e01022a0 2024-08-18T22:11:43.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.811+0000 7f51dffff640 1 --2- 172.21.15.123:0/2735476759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814130 0x555929814510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51d8035000 tx=0x7f51d8009820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96a32bfb0aae8d9d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:43.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.811+0000 7f51c5ffb640 1 -- 172.21.15.123:0/2735476759 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d8048070 con 0x555929814130 2024-08-18T22:11:43.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.811+0000 7f51c5ffb640 1 -- 172.21.15.123:0/2735476759 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51d802f930 con 0x555929814130 2024-08-18T22:11:43.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.811+0000 7f51c5ffb640 1 -- 172.21.15.123:0/2735476759 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d8034040 con 0x555929814130 2024-08-18T22:11:43.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.812+0000 7f51dcff9640 1 --2- 172.21.15.123:0/1159727333 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f51c80a2b80 0x7f51c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.812+0000 7f51df7fe640 1 --2- 172.21.15.123:0/1159727333 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f51c80a2b80 0x7f51c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.812+0000 7f51dcff9640 1 -- 172.21.15.123:0/1159727333 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f51d40cf860 con 0x7f51e01022a0 2024-08-18T22:11:43.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.812+0000 7f51e8361740 1 -- 172.21.15.123:0/2735476759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814130 msgr2=0x555929814510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:43.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.812+0000 7f51e8361740 1 --2- 172.21.15.123:0/2735476759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814130 0x555929814510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51d8035000 tx=0x7f51d8009820 comp rx=0 tx=0).stop 2024-08-18T22:11:43.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.812+0000 7f51e8361740 1 -- 172.21.15.123:0/2735476759 shutdown_connections 2024-08-18T22:11:43.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.812+0000 7f51e8361740 1 --2- 172.21.15.123:0/2735476759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55592981f310 0x555929821700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.812+0000 7f51e8361740 1 --2- 172.21.15.123:0/2735476759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555929814a50 0x55592981edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.812+0000 7f51e8361740 1 --2- 172.21.15.123:0/2735476759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814130 0x555929814510 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.812+0000 7f51e8361740 1 -- 172.21.15.123:0/2735476759 >> 172.21.15.123:0/2735476759 conn(0x5559298106c0 msgr2=0x555929810aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:43.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.812+0000 7f51df7fe640 1 --2- 172.21.15.123:0/1159727333 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f51c80a2b80 0x7f51c80a5040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x555929811520 tx=0x7f51d0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:43.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.812+0000 7f51e8361740 1 -- 172.21.15.123:0/2735476759 shutdown_connections 2024-08-18T22:11:43.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.813+0000 7f51e8361740 1 -- 172.21.15.123:0/2735476759 wait complete. 2024-08-18T22:11:43.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.813+0000 7f51e8361740 1 -- start start 2024-08-18T22:11:43.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.813+0000 7f51e8361740 1 Processor -- start 2024-08-18T22:11:43.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.813+0000 7f51e8361740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814130 0x55592981c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.813+0000 7f51e8361740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814a50 0x55592981c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.813+0000 7f51e8361740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 0x55592981cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.813+0000 7f51e8361740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5559298262f0 con 0x55592981f310 2024-08-18T22:11:43.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.813+0000 7f51e8361740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555929734990 con 0x555929814130 2024-08-18T22:11:43.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.813+0000 7f51e8361740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555929826470 con 0x555929814a50 2024-08-18T22:11:43.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.813+0000 7f51e8361740 10 client.0 _ll_register_callbacks cb 0x555929489090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:43.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51deffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814a50 0x55592981c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51deffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814a50 0x55592981c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:52180/0 (socket says 172.21.15.123:52180) 2024-08-18T22:11:43.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51dffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 0x55592981cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51deffd640 1 -- 172.21.15.123:0/1185374479 learned_addr learned my addr 172.21.15.123:0/1185374479 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:43.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51df7fe640 1 --2- 172.21.15.123:0/1185374479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814130 0x55592981c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51deffd640 1 -- 172.21.15.123:0/1185374479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814130 msgr2=0x55592981c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:43.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51deffd640 1 --2- 172.21.15.123:0/1185374479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814130 0x55592981c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51deffd640 1 -- 172.21.15.123:0/1185374479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 msgr2=0x55592981cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:43.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51deffd640 1 --2- 172.21.15.123:0/1185374479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 0x55592981cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51deffd640 1 -- 172.21.15.123:0/1185374479 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559297336c0 con 0x555929814a50 2024-08-18T22:11:43.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51dffff640 1 --2- 172.21.15.123:0/1185374479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 0x55592981cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:43.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51deffd640 1 --2- 172.21.15.123:0/1185374479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814a50 0x55592981c7f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f51d400e9c0 tx=0x7f51d409c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=868f5072bb9a2e2a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:43.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51beffd640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-08-18T22:11:43.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51beffd640 1 -- 172.21.15.123:0/1185374479 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d409b320 con 0x555929814a50 2024-08-18T22:11:43.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51beffd640 1 -- 172.21.15.123:0/1185374479 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f51d4010430 con 0x555929814a50 2024-08-18T22:11:43.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.814+0000 7f51e8361740 1 -- 172.21.15.123:0/1185374479 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51d802f930 con 0x555929814a50 2024-08-18T22:11:43.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.815+0000 7f51beffd640 1 -- 172.21.15.123:0/1185374479 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f51d40a4940 con 0x555929814a50 2024-08-18T22:11:43.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.815+0000 7f51e8361740 10 client.25537 fetch_fsmap learned FSMap version 27 2024-08-18T22:11:43.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.815+0000 7f51e8361740 1 -- 172.21.15.123:0/1185374479 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555929832070 con 0x555929814a50 2024-08-18T22:11:43.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.815+0000 7f51beffd640 1 -- 172.21.15.123:0/1185374479 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51d802f930 con 0x555929814a50 2024-08-18T22:11:43.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.815+0000 7f51beffd640 1 -- 172.21.15.123:0/1185374479 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f51d40a1210 con 0x555929814a50 2024-08-18T22:11:43.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.815+0000 7f51e8361740 10 client.25537 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:11:43.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.815+0000 7f51e8361740 10 client.25537 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:11:43.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.815+0000 7f51e8361740 20 client.25537 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:43.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.815+0000 7f51e8361740 1 --2- 172.21.15.123:0/1185374479 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5559298339e0 0x555929835e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.815+0000 7f51e8361740 4 client.25537 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:43.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.815+0000 7f51e8361740 1 -- 172.21.15.123:0/1185374479 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559297871a0 con 0x5559298339e0 2024-08-18T22:11:43.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.815+0000 7f51df7fe640 1 --2- 172.21.15.123:0/1185374479 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5559298339e0 0x555929835e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.816+0000 7f51df7fe640 1 --2- 172.21.15.123:0/1185374479 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5559298339e0 0x555929835e00 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51034e2f9bf841ed server_cookie=6c2c3182e21e1012 in_seq=0 out_seq=0 2024-08-18T22:11:43.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.816+0000 7f51beffd640 10 client.25537 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.819+0000 7f51beffd640 1 -- 172.21.15.123:0/1185374479 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559297871a0 con 0x5559298339e0 2024-08-18T22:11:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.819+0000 7f51beffd640 10 client.25537 handle_command_reply: tid=0 2024-08-18T22:11:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.819+0000 7f51e8361740 1 client.25537 shutdown 2024-08-18T22:11:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.820+0000 7f51e8361740 1 -- 172.21.15.123:0/1185374479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814a50 msgr2=0x55592981c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.820+0000 7f51e8361740 1 --2- 172.21.15.123:0/1185374479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814a50 0x55592981c7f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f51d400e9c0 tx=0x7f51d409c510 comp rx=0 tx=0).stop 2024-08-18T22:11:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.820+0000 7f51e8361740 1 -- 172.21.15.123:0/1185374479 shutdown_connections 2024-08-18T22:11:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.820+0000 7f51e8361740 1 --2- 172.21.15.123:0/1185374479 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5559298339e0 0x555929835e00 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.820+0000 7f51e8361740 1 --2- 172.21.15.123:0/1185374479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 0x55592981cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.820+0000 7f51e8361740 1 --2- 172.21.15.123:0/1185374479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814a50 0x55592981c7f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.820+0000 7f51e8361740 1 --2- 172.21.15.123:0/1185374479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814130 0x55592981c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.820+0000 7f51beffd640 0 client.25537 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:43.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.820+0000 7f51e8361740 1 -- 172.21.15.123:0/1185374479 >> 172.21.15.123:0/1185374479 conn(0x5559298106c0 msgr2=0x5559298163f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:43.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.820+0000 7f51e8361740 1 -- 172.21.15.123:0/1185374479 shutdown_connections 2024-08-18T22:11:43.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.820+0000 7f51e8361740 1 -- 172.21.15.123:0/1185374479 wait complete. 2024-08-18T22:11:43.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.820+0000 7f51e8361740 20 client.25537 trim_cache size 0 max 16384 2024-08-18T22:11:43.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.837+0000 7f51e8361740 1 Processor -- start 2024-08-18T22:11:43.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.837+0000 7f51e8361740 1 -- start start 2024-08-18T22:11:43.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.837+0000 7f51e8361740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814130 0x55592981cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.837+0000 7f51e8361740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814a50 0x55592983b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.837+0000 7f51e8361740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 0x55592983bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.837+0000 7f51e8361740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01aef40 con 0x55592981f310 2024-08-18T22:11:43.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.837+0000 7f51e8361740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01ac810 con 0x555929814a50 2024-08-18T22:11:43.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.837+0000 7f51e8361740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01aa660 con 0x555929814130 2024-08-18T22:11:43.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.838+0000 7f51df7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814130 0x55592981cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.838+0000 7f51df7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814130 0x55592981cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:52196/0 (socket says 172.21.15.123:52196) 2024-08-18T22:11:43.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.838+0000 7f51df7fe640 1 -- 172.21.15.123:0/3750255368 learned_addr learned my addr 172.21.15.123:0/3750255368 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.838+0000 7f51dffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 0x55592983bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.838+0000 7f51deffd640 1 --2- 172.21.15.123:0/3750255368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814a50 0x55592983b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.838+0000 7f51df7fe640 1 -- 172.21.15.123:0/3750255368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814a50 msgr2=0x55592983b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.838+0000 7f51df7fe640 1 --2- 172.21.15.123:0/3750255368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814a50 0x55592983b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.838+0000 7f51df7fe640 1 -- 172.21.15.123:0/3750255368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 msgr2=0x55592983bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.838+0000 7f51df7fe640 1 --2- 172.21.15.123:0/3750255368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 0x55592983bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.838+0000 7f51df7fe640 1 -- 172.21.15.123:0/3750255368 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55592981a820 con 0x555929814130 2024-08-18T22:11:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.838+0000 7f51deffd640 1 --2- 172.21.15.123:0/3750255368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814a50 0x55592983b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.838+0000 7f51df7fe640 1 --2- 172.21.15.123:0/3750255368 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814130 0x55592981cb80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f51d00154c0 tx=0x7f51d0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c114d65979c0057 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.838+0000 7f51c57fa640 1 -- 172.21.15.123:0/3750255368 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0029310 con 0x555929814130 2024-08-18T22:11:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.838+0000 7f51c57fa640 1 -- 172.21.15.123:0/3750255368 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51d002f070 con 0x555929814130 2024-08-18T22:11:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.838+0000 7f51c57fa640 1 -- 172.21.15.123:0/3750255368 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0022820 con 0x555929814130 2024-08-18T22:11:43.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.839+0000 7f51e8361740 1 -- 172.21.15.123:0/3750255368 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814130 msgr2=0x55592981cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:43.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.839+0000 7f51e8361740 1 --2- 172.21.15.123:0/3750255368 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814130 0x55592981cb80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f51d00154c0 tx=0x7f51d0014000 comp rx=0 tx=0).stop 2024-08-18T22:11:43.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.839+0000 7f51e8361740 1 -- 172.21.15.123:0/3750255368 shutdown_connections 2024-08-18T22:11:43.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.839+0000 7f51e8361740 1 --2- 172.21.15.123:0/3750255368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 0x55592983bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.839+0000 7f51e8361740 1 --2- 172.21.15.123:0/3750255368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814a50 0x55592983b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.839+0000 7f51e8361740 1 --2- 172.21.15.123:0/3750255368 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814130 0x55592981cb80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.839+0000 7f51e8361740 1 -- 172.21.15.123:0/3750255368 >> 172.21.15.123:0/3750255368 conn(0x5559298106c0 msgr2=0x55592981e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:43.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.839+0000 7f51e8361740 1 -- 172.21.15.123:0/3750255368 shutdown_connections 2024-08-18T22:11:43.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.839+0000 7f51e8361740 1 -- 172.21.15.123:0/3750255368 wait complete. 2024-08-18T22:11:43.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.840+0000 7f51e8361740 1 -- start start 2024-08-18T22:11:43.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.840+0000 7f51e8361740 1 Processor -- start 2024-08-18T22:11:43.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.840+0000 7f51e8361740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814130 0x55592982b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.840+0000 7f51e8361740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814a50 0x55592982bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.840+0000 7f51e8361740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 0x555929818b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.840+0000 7f51e8361740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01aacd0 con 0x55592981f310 2024-08-18T22:11:43.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.840+0000 7f51e8361740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01ac140 con 0x555929814130 2024-08-18T22:11:43.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.840+0000 7f51e8361740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01ab3a0 con 0x555929814a50 2024-08-18T22:11:43.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.840+0000 7f51dffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 0x555929818b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.840+0000 7f51deffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814a50 0x55592982bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.840+0000 7f51deffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814a50 0x55592982bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:52198/0 (socket says 172.21.15.123:52198) 2024-08-18T22:11:43.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.841+0000 7f51deffd640 1 -- 172.21.15.123:0/17200244 learned_addr learned my addr 172.21.15.123:0/17200244 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:43.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.841+0000 7f51e8361740 10 client.0 _ll_register_callbacks cb 0x7f51d4097f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:43.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.841+0000 7f51df7fe640 1 --2- 172.21.15.123:0/17200244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814130 0x55592982b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.841+0000 7f51dffff640 1 -- 172.21.15.123:0/17200244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814a50 msgr2=0x55592982bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:43.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.841+0000 7f51dffff640 1 --2- 172.21.15.123:0/17200244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814a50 0x55592982bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.841+0000 7f51dffff640 1 -- 172.21.15.123:0/17200244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814130 msgr2=0x55592982b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:43.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.841+0000 7f51dffff640 1 --2- 172.21.15.123:0/17200244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814130 0x55592982b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:43.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.841+0000 7f51dffff640 1 -- 172.21.15.123:0/17200244 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555929819390 con 0x55592981f310 2024-08-18T22:11:43.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.841+0000 7f51deffd640 1 --2- 172.21.15.123:0/17200244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814a50 0x55592982bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.841+0000 7f51dffff640 1 --2- 172.21.15.123:0/17200244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 0x555929818b60 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009a60 tx=0x7f51d8003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb068326452c6e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.841+0000 7f51beffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.841+0000 7f51beffd640 1 -- 172.21.15.123:0/17200244 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d8053020 con 0x55592981f310 2024-08-18T22:11:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.841+0000 7f51beffd640 1 -- 172.21.15.123:0/17200244 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f51d804e470 con 0x55592981f310 2024-08-18T22:11:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.841+0000 7f51e8361740 1 -- 172.21.15.123:0/17200244 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51d002f070 con 0x55592981f310 2024-08-18T22:11:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.842+0000 7f51beffd640 1 -- 172.21.15.123:0/17200244 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f51d805e050 con 0x55592981f310 2024-08-18T22:11:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.842+0000 7f51e8361740 10 client.16098 fetch_fsmap learned FSMap version 27 2024-08-18T22:11:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.842+0000 7f51e8361740 1 -- 172.21.15.123:0/17200244 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55592989e180 con 0x55592981f310 2024-08-18T22:11:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.842+0000 7f51beffd640 1 -- 172.21.15.123:0/17200244 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51d002f070 con 0x55592981f310 2024-08-18T22:11:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.842+0000 7f51beffd640 1 -- 172.21.15.123:0/17200244 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f51d8003fd0 con 0x55592981f310 2024-08-18T22:11:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.842+0000 7f51e8361740 10 client.16098 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:11:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.842+0000 7f51e8361740 10 client.16098 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:11:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.842+0000 7f51e8361740 20 client.16098 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.842+0000 7f51e8361740 1 --2- 172.21.15.123:0/17200244 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55592989e520 0x5559298a0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:43.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.842+0000 7f51e8361740 4 client.16098 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-08-18T22:11:43.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.842+0000 7f51e8361740 1 -- 172.21.15.123:0/17200244 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x5559297814f0 con 0x55592989e520 2024-08-18T22:11:43.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.842+0000 7f51df7fe640 1 --2- 172.21.15.123:0/17200244 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55592989e520 0x5559298a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:43.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.843+0000 7f51beffd640 10 client.16098 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:43.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:43.843+0000 7f51df7fe640 1 --2- 172.21.15.123:0/17200244 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55592989e520 0x5559298a0910 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b97ae61f014b2d68 server_cookie=aae68a8a5f8ba807 in_seq=0 out_seq=0 2024-08-18T22:11:43.849 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-18T22:11:43.849 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-18T22:11:44.129 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:11:44.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:44 smithi183 ceph-mon[22097]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:11:44.416 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:44 smithi123 ceph-mon[18462]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:11:44.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:44 smithi130 ceph-mon[21698]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:11:45.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.660+0000 7f97218a2640 1 -- 172.21.15.123:0/2274912295 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971c101150 msgr2=0x7f971c10d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:45.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.660+0000 7f97218a2640 1 --2- 172.21.15.123:0/2274912295 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971c101150 0x7f971c10d680 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9714009cd0 tx=0x7f971402a8e0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.660+0000 7f97218a2640 1 -- 172.21.15.123:0/2274912295 shutdown_connections 2024-08-18T22:11:45.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.660+0000 7f97218a2640 1 --2- 172.21.15.123:0/2274912295 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971c101150 0x7f971c10d680 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.660+0000 7f97218a2640 1 --2- 172.21.15.123:0/2274912295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f971c1007b0 0x7f971c100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.660+0000 7f97218a2640 1 --2- 172.21.15.123:0/2274912295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f971c1067b0 0x7f971c106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.660+0000 7f97218a2640 1 -- 172.21.15.123:0/2274912295 >> 172.21.15.123:0/2274912295 conn(0x7f971c0fc4d0 msgr2=0x7f971c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:45.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.660+0000 7f97218a2640 1 -- 172.21.15.123:0/2274912295 shutdown_connections 2024-08-18T22:11:45.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.660+0000 7f97218a2640 1 -- 172.21.15.123:0/2274912295 wait complete. 2024-08-18T22:11:45.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.661+0000 7f97218a2640 1 Processor -- start 2024-08-18T22:11:45.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.661+0000 7f97218a2640 1 -- start start 2024-08-18T22:11:45.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.662+0000 7f97218a2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971c1007b0 0x7f971c112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.662+0000 7f97218a2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f971c101150 0x7f971c111330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.662+0000 7f971affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971c1007b0 0x7f971c112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.662+0000 7f971affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971c1007b0 0x7f971c112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49052/0 (socket says 172.21.15.123:49052) 2024-08-18T22:11:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.662+0000 7f971affd640 1 -- 172.21.15.123:0/156474809 learned_addr learned my addr 172.21.15.123:0/156474809 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.662+0000 7f97218a2640 1 --2- 172.21.15.123:0/156474809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f971c1067b0 0x7f971c111970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.662+0000 7f971a7fc640 1 --2- 172.21.15.123:0/156474809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f971c101150 0x7f971c111330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.662+0000 7f97218a2640 1 -- 172.21.15.123:0/156474809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f971c110bb0 con 0x7f971c1007b0 2024-08-18T22:11:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.662+0000 7f97218a2640 1 -- 172.21.15.123:0/156474809 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f971c110a30 con 0x7f971c1067b0 2024-08-18T22:11:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.662+0000 7f97218a2640 1 -- 172.21.15.123:0/156474809 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f971c110d30 con 0x7f971c101150 2024-08-18T22:11:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.662+0000 7f971b7fe640 1 --2- 172.21.15.123:0/156474809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f971c1067b0 0x7f971c111970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.662+0000 7f971affd640 1 -- 172.21.15.123:0/156474809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f971c101150 msgr2=0x7f971c111330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.662+0000 7f971affd640 1 --2- 172.21.15.123:0/156474809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f971c101150 0x7f971c111330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.662+0000 7f971affd640 1 -- 172.21.15.123:0/156474809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f971c1067b0 msgr2=0x7f971c111970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.663+0000 7f971affd640 1 --2- 172.21.15.123:0/156474809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f971c1067b0 0x7f971c111970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.663+0000 7f971affd640 1 -- 172.21.15.123:0/156474809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971c1a66d0 con 0x7f971c1007b0 2024-08-18T22:11:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.663+0000 7f971affd640 1 --2- 172.21.15.123:0/156474809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971c1007b0 0x7f971c112f50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f970c00e9f0 tx=0x7f970c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.663+0000 7f97208a0640 1 -- 172.21.15.123:0/156474809 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c00cd80 con 0x7f971c1007b0 2024-08-18T22:11:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.663+0000 7f97218a2640 1 -- 172.21.15.123:0/156474809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f971c1a6900 con 0x7f971c1007b0 2024-08-18T22:11:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.663+0000 7f97208a0640 1 -- 172.21.15.123:0/156474809 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f970c005500 con 0x7f971c1007b0 2024-08-18T22:11:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.663+0000 7f97208a0640 1 -- 172.21.15.123:0/156474809 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c010690 con 0x7f971c1007b0 2024-08-18T22:11:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.663+0000 7f97218a2640 1 -- 172.21.15.123:0/156474809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f971c1a6e10 con 0x7f971c1007b0 2024-08-18T22:11:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.667+0000 7f97208a0640 1 -- 172.21.15.123:0/156474809 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f970c010830 con 0x7f971c1007b0 2024-08-18T22:11:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.667+0000 7f9723ca0740 1 Processor -- start 2024-08-18T22:11:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.667+0000 7f9723ca0740 1 -- start start 2024-08-18T22:11:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f9723ca0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5120 0x55e2022c5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f9723ca0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5a40 0x55e2022d86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f9723ca0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022d8bf0 0x55e2022dafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f9723ca0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e202288e40 con 0x55e2022c5a40 2024-08-18T22:11:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f9723ca0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e20222a7f0 con 0x55e2022d8bf0 2024-08-18T22:11:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f9723ca0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e2021d1fb0 con 0x55e2022c5120 2024-08-18T22:11:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f971b7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5120 0x55e2022c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f971b7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5120 0x55e2022c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:52224/0 (socket says 172.21.15.123:52224) 2024-08-18T22:11:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f971b7fe640 1 -- 172.21.15.123:0/259990182 learned_addr learned my addr 172.21.15.123:0/259990182 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f97208a0640 1 --2- 172.21.15.123:0/156474809 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f97040a2c00 0x7f97040a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f971affd640 1 --2- 172.21.15.123:0/259990182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5a40 0x55e2022d86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f971a7fc640 1 --2- 172.21.15.123:0/259990182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022d8bf0 0x55e2022dafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f971b7fe640 1 -- 172.21.15.123:0/259990182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022d8bf0 msgr2=0x55e2022dafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f971b7fe640 1 --2- 172.21.15.123:0/259990182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022d8bf0 0x55e2022dafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f971b7fe640 1 -- 172.21.15.123:0/259990182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5a40 msgr2=0x55e2022d86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f971b7fe640 1 --2- 172.21.15.123:0/259990182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5a40 0x55e2022d86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f971b7fe640 1 -- 172.21.15.123:0/259990182 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e201f9c6a0 con 0x55e2022c5120 2024-08-18T22:11:45.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.668+0000 7f97208a0640 1 -- 172.21.15.123:0/156474809 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f970c0cf730 con 0x7f971c1007b0 2024-08-18T22:11:45.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.669+0000 7f971b7fe640 1 --2- 172.21.15.123:0/156474809 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f97040a2c00 0x7f97040a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.669+0000 7f971affd640 1 --2- 172.21.15.123:0/259990182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5a40 0x55e2022d86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:11:45.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.669+0000 7f971b7fe640 1 --2- 172.21.15.123:0/259990182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5120 0x55e2022c5500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9714009cd0 tx=0x7f9714009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f228b0f852561bdd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:45.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.669+0000 7f9701ffb640 1 -- 172.21.15.123:0/259990182 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97140318c0 con 0x55e2022c5120 2024-08-18T22:11:45.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.669+0000 7f9701ffb640 1 -- 172.21.15.123:0/259990182 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9714036070 con 0x55e2022c5120 2024-08-18T22:11:45.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.669+0000 7f9701ffb640 1 -- 172.21.15.123:0/259990182 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9714030b80 con 0x55e2022c5120 2024-08-18T22:11:45.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.670+0000 7f9723ca0740 1 -- 172.21.15.123:0/259990182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5120 msgr2=0x55e2022c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.670+0000 7f9723ca0740 1 --2- 172.21.15.123:0/259990182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5120 0x55e2022c5500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9714009cd0 tx=0x7f9714009a20 comp rx=0 tx=0).stop 2024-08-18T22:11:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.670+0000 7f971b7fe640 1 --2- 172.21.15.123:0/156474809 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f97040a2c00 0x7f97040a50c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9714049000 tx=0x7f971404a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.670+0000 7f9723ca0740 1 -- 172.21.15.123:0/259990182 shutdown_connections 2024-08-18T22:11:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.670+0000 7f9723ca0740 1 --2- 172.21.15.123:0/259990182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022d8bf0 0x55e2022dafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.670+0000 7f9723ca0740 1 --2- 172.21.15.123:0/259990182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5a40 0x55e2022d86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.670+0000 7f9723ca0740 1 --2- 172.21.15.123:0/259990182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5120 0x55e2022c5500 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.670+0000 7f9723ca0740 1 -- 172.21.15.123:0/259990182 >> 172.21.15.123:0/259990182 conn(0x55e2022c1790 msgr2=0x55e2022c1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.671+0000 7f9723ca0740 1 -- 172.21.15.123:0/259990182 shutdown_connections 2024-08-18T22:11:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.671+0000 7f9723ca0740 1 -- 172.21.15.123:0/259990182 wait complete. 2024-08-18T22:11:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.671+0000 7f9723ca0740 1 -- start start 2024-08-18T22:11:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.671+0000 7f9723ca0740 1 Processor -- start 2024-08-18T22:11:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f9723ca0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5120 0x55e2022d5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f9723ca0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5a40 0x55e2022d6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f9723ca0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022d8bf0 0x55e2022d6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f9723ca0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e2021e5cb0 con 0x55e2022c5120 2024-08-18T22:11:45.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f9723ca0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e2022267b0 con 0x55e2022d8bf0 2024-08-18T22:11:45.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f9723ca0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e2022db760 con 0x55e2022c5a40 2024-08-18T22:11:45.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f971affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5120 0x55e2022d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f971a7fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5a40 0x55e2022d6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f971affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5120 0x55e2022d5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49076/0 (socket says 172.21.15.123:49076) 2024-08-18T22:11:45.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f971affd640 1 -- 172.21.15.123:0/2486759177 learned_addr learned my addr 172.21.15.123:0/2486759177 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:45.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f971b7fe640 1 --2- 172.21.15.123:0/2486759177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022d8bf0 0x55e2022d6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f9723ca0740 10 client.0 _ll_register_callbacks cb 0x55e201f39ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:45.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f971a7fc640 1 -- 172.21.15.123:0/2486759177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022d8bf0 msgr2=0x55e2022d6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:45.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f971a7fc640 1 --2- 172.21.15.123:0/2486759177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022d8bf0 0x55e2022d6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f971a7fc640 1 -- 172.21.15.123:0/2486759177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5120 msgr2=0x55e2022d5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f971a7fc640 1 --2- 172.21.15.123:0/2486759177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5120 0x55e2022d5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f971a7fc640 1 -- 172.21.15.123:0/2486759177 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2021e4bc0 con 0x55e2022c5a40 2024-08-18T22:11:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f971a7fc640 1 --2- 172.21.15.123:0/2486759177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5a40 0x55e2022d6140 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f971c0fe980 tx=0x7f971000bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb88355868af893a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.672+0000 7f96faffd640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-08-18T22:11:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.673+0000 7f96faffd640 1 -- 172.21.15.123:0/2486759177 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710005020 con 0x55e2022c5a40 2024-08-18T22:11:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.673+0000 7f96faffd640 1 -- 172.21.15.123:0/2486759177 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f97100051c0 con 0x55e2022c5a40 2024-08-18T22:11:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.673+0000 7f9723ca0740 1 -- 172.21.15.123:0/2486759177 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9714036070 con 0x55e2022c5a40 2024-08-18T22:11:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.673+0000 7f96faffd640 1 -- 172.21.15.123:0/2486759177 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9710023050 con 0x55e2022c5a40 2024-08-18T22:11:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.673+0000 7f9723ca0740 10 client.25555 fetch_fsmap learned FSMap version 27 2024-08-18T22:11:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.673+0000 7f9723ca0740 1 -- 172.21.15.123:0/2486759177 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e2022e7760 con 0x55e2022c5a40 2024-08-18T22:11:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.673+0000 7f96faffd640 1 -- 172.21.15.123:0/2486759177 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9710016070 con 0x55e2022c5a40 2024-08-18T22:11:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.673+0000 7f96faffd640 1 -- 172.21.15.123:0/2486759177 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9710012650 con 0x55e2022c5a40 2024-08-18T22:11:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.674+0000 7f9723ca0740 10 client.25555 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:11:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.674+0000 7f9723ca0740 10 client.25555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.674+0000 7f9723ca0740 20 client.25555 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.674+0000 7f9723ca0740 1 --2- 172.21.15.123:0/2486759177 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e2022e8cc0 0x55e2022eb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.674+0000 7f9723ca0740 4 client.25555 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.674+0000 7f9723ca0740 1 -- 172.21.15.123:0/2486759177 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9714036070 con 0x55e2022e8cc0 2024-08-18T22:11:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.674+0000 7f971affd640 1 --2- 172.21.15.123:0/2486759177 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e2022e8cc0 0x55e2022eb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.674+0000 7f96faffd640 10 client.25555 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.675+0000 7f971affd640 1 --2- 172.21.15.123:0/2486759177 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e2022e8cc0 0x55e2022eb0b0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b8ca7729058ae91 server_cookie=57251c14ae1a3d0f in_seq=0 out_seq=0 2024-08-18T22:11:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.677+0000 7f96faffd640 1 -- 172.21.15.123:0/2486759177 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f9714036070 con 0x55e2022e8cc0 2024-08-18T22:11:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.677+0000 7f96faffd640 10 client.25555 handle_command_reply: tid=0 2024-08-18T22:11:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.677+0000 7f9723ca0740 1 client.25555 shutdown 2024-08-18T22:11:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.678+0000 7f9723ca0740 1 -- 172.21.15.123:0/2486759177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5a40 msgr2=0x55e2022d6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.678+0000 7f9723ca0740 1 --2- 172.21.15.123:0/2486759177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5a40 0x55e2022d6140 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f971c0fe980 tx=0x7f971000bda0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.678+0000 7f9723ca0740 1 -- 172.21.15.123:0/2486759177 shutdown_connections 2024-08-18T22:11:45.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.678+0000 7f9723ca0740 1 --2- 172.21.15.123:0/2486759177 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e2022e8cc0 0x55e2022eb0b0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.678+0000 7f96faffd640 0 client.25555 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:45.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.678+0000 7f9723ca0740 1 --2- 172.21.15.123:0/2486759177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022d8bf0 0x55e2022d6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.678+0000 7f9723ca0740 1 --2- 172.21.15.123:0/2486759177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5a40 0x55e2022d6140 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.678+0000 7f9723ca0740 1 --2- 172.21.15.123:0/2486759177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5120 0x55e2022d5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.678+0000 7f9723ca0740 1 -- 172.21.15.123:0/2486759177 >> 172.21.15.123:0/2486759177 conn(0x55e2022c1790 msgr2=0x55e2022c08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:45.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.678+0000 7f9723ca0740 1 -- 172.21.15.123:0/2486759177 shutdown_connections 2024-08-18T22:11:45.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.679+0000 7f9723ca0740 1 -- 172.21.15.123:0/2486759177 wait complete. 2024-08-18T22:11:45.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.679+0000 7f9723ca0740 20 client.25555 trim_cache size 0 max 16384 2024-08-18T22:11:45.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.703+0000 7f9723ca0740 1 Processor -- start 2024-08-18T22:11:45.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.703+0000 7f9723ca0740 1 -- start start 2024-08-18T22:11:45.095 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:11:45.095 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-08-18T22:11:45.095 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "7c0c7a16-a499-4494-9131-efd0bfd104f9", 2024-08-18T22:11:45.095 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-08-18T22:11:45.095 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:11:45.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f9723ca0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5120 0x55e2022d64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f9723ca0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022c5a40 0x55e2022c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f9723ca0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022d8bf0 0x55e2022f0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f9723ca0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f971c1af290 con 0x55e2022c5120 2024-08-18T22:11:45.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f9723ca0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f971c1acb60 con 0x55e2022c5a40 2024-08-18T22:11:45.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f9723ca0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f971c1aaa10 con 0x55e2022d8bf0 2024-08-18T22:11:45.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f971affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5120 0x55e2022d64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f971affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5120 0x55e2022d64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49086/0 (socket says 172.21.15.123:49086) 2024-08-18T22:11:45.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f971affd640 1 -- 172.21.15.123:0/1821368890 learned_addr learned my addr 172.21.15.123:0/1821368890 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:45.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f971b7fe640 1 --2- 172.21.15.123:0/1821368890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022d8bf0 0x55e2022f0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f971a7fc640 1 --2- 172.21.15.123:0/1821368890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022c5a40 0x55e2022c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f971affd640 1 -- 172.21.15.123:0/1821368890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022d8bf0 msgr2=0x55e2022f0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:45.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f971affd640 1 --2- 172.21.15.123:0/1821368890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022d8bf0 0x55e2022f0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f971affd640 1 -- 172.21.15.123:0/1821368890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022c5a40 msgr2=0x55e2022c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:45.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f971affd640 1 --2- 172.21.15.123:0/1821368890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022c5a40 0x55e2022c07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f971affd640 1 -- 172.21.15.123:0/1821368890 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2022d4bb0 con 0x55e2022c5120 2024-08-18T22:11:45.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f971a7fc640 1 --2- 172.21.15.123:0/1821368890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022c5a40 0x55e2022c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:11:45.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.704+0000 7f971affd640 1 --2- 172.21.15.123:0/1821368890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5120 0x55e2022d64d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f970c00cfd0 tx=0x7f970c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1ebd1531a61d31 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:45.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.705+0000 7f97017fa640 1 -- 172.21.15.123:0/1821368890 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c0b9070 con 0x55e2022c5120 2024-08-18T22:11:45.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.705+0000 7f97017fa640 1 -- 172.21.15.123:0/1821368890 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f970c0ccf50 con 0x55e2022c5120 2024-08-18T22:11:45.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.705+0000 7f97017fa640 1 -- 172.21.15.123:0/1821368890 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c09b1b0 con 0x55e2022c5120 2024-08-18T22:11:45.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.705+0000 7f9723ca0740 1 -- 172.21.15.123:0/1821368890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5120 msgr2=0x55e2022d64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:45.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.705+0000 7f9723ca0740 1 --2- 172.21.15.123:0/1821368890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5120 0x55e2022d64d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f970c00cfd0 tx=0x7f970c004a40 comp rx=0 tx=0).stop 2024-08-18T22:11:45.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.706+0000 7f9723ca0740 1 -- 172.21.15.123:0/1821368890 shutdown_connections 2024-08-18T22:11:45.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.706+0000 7f9723ca0740 1 --2- 172.21.15.123:0/1821368890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022d8bf0 0x55e2022f0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.706+0000 7f9723ca0740 1 --2- 172.21.15.123:0/1821368890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022c5a40 0x55e2022c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.706+0000 7f9723ca0740 1 --2- 172.21.15.123:0/1821368890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5120 0x55e2022d64d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.706+0000 7f9723ca0740 1 -- 172.21.15.123:0/1821368890 >> 172.21.15.123:0/1821368890 conn(0x55e2022c1790 msgr2=0x55e2022c00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:45.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.706+0000 7f9723ca0740 1 -- 172.21.15.123:0/1821368890 shutdown_connections 2024-08-18T22:11:45.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.706+0000 7f9723ca0740 1 -- 172.21.15.123:0/1821368890 wait complete. 2024-08-18T22:11:45.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.706+0000 7f9723ca0740 1 -- start start 2024-08-18T22:11:45.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.706+0000 7f9723ca0740 1 Processor -- start 2024-08-18T22:11:45.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f9723ca0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5120 0x55e2022dc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f9723ca0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5a40 0x55e2022dcc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f9723ca0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022d8bf0 0x55e2022dd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f9723ca0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f971c1ab060 con 0x55e2022c5a40 2024-08-18T22:11:45.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f9723ca0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f971c1ac490 con 0x55e2022d8bf0 2024-08-18T22:11:45.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f9723ca0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f971c1ab6f0 con 0x55e2022c5120 2024-08-18T22:11:45.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f9723ca0740 10 client.0 _ll_register_callbacks cb 0x7f971c113490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:45.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f971a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5a40 0x55e2022dcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f971a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5a40 0x55e2022dcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49102/0 (socket says 172.21.15.123:49102) 2024-08-18T22:11:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f971a7fc640 1 -- 172.21.15.123:0/925196303 learned_addr learned my addr 172.21.15.123:0/925196303 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f971affd640 1 --2- 172.21.15.123:0/925196303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5120 0x55e2022dc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f971b7fe640 1 --2- 172.21.15.123:0/925196303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022d8bf0 0x55e2022dd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f971a7fc640 1 -- 172.21.15.123:0/925196303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5120 msgr2=0x55e2022dc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f971a7fc640 1 --2- 172.21.15.123:0/925196303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5120 0x55e2022dc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f971a7fc640 1 -- 172.21.15.123:0/925196303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022d8bf0 msgr2=0x55e2022dd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f971a7fc640 1 --2- 172.21.15.123:0/925196303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022d8bf0 0x55e2022dd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f971a7fc640 1 -- 172.21.15.123:0/925196303 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2022d09c0 con 0x55e2022c5a40 2024-08-18T22:11:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f971a7fc640 1 --2- 172.21.15.123:0/925196303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5a40 0x55e2022dcc90 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55e2022d5490 tx=0x7f9710012c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f230168a9d8ee02 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f96faffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f96faffd640 1 -- 172.21.15.123:0/925196303 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710005850 con 0x55e2022c5a40 2024-08-18T22:11:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f96faffd640 1 -- 172.21.15.123:0/925196303 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f9710012450 con 0x55e2022c5a40 2024-08-18T22:11:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.707+0000 7f9723ca0740 1 -- 172.21.15.123:0/925196303 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f970c0ccf50 con 0x55e2022c5a40 2024-08-18T22:11:45.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.708+0000 7f96faffd640 1 -- 172.21.15.123:0/925196303 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9710012650 con 0x55e2022c5a40 2024-08-18T22:11:45.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.708+0000 7f9723ca0740 10 client.16113 fetch_fsmap learned FSMap version 27 2024-08-18T22:11:45.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.708+0000 7f9723ca0740 1 -- 172.21.15.123:0/925196303 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e202353a70 con 0x55e2022c5a40 2024-08-18T22:11:45.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.708+0000 7f96faffd640 1 -- 172.21.15.123:0/925196303 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f970c0ccf50 con 0x55e2022c5a40 2024-08-18T22:11:45.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.708+0000 7f96faffd640 1 -- 172.21.15.123:0/925196303 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9710004780 con 0x55e2022c5a40 2024-08-18T22:11:45.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.708+0000 7f9723ca0740 10 client.16113 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:11:45.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.708+0000 7f9723ca0740 10 client.16113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:45.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.708+0000 7f9723ca0740 20 client.16113 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:45.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.708+0000 7f9723ca0740 1 --2- 172.21.15.123:0/925196303 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e2022e8cc0 0x55e2023562f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:45.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.708+0000 7f9723ca0740 4 client.16113 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-18T22:11:45.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.708+0000 7f9723ca0740 1 -- 172.21.15.123:0/925196303 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e202237d60 con 0x55e2022e8cc0 2024-08-18T22:11:45.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.708+0000 7f971affd640 1 --2- 172.21.15.123:0/925196303 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e2022e8cc0 0x55e2023562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:45.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.708+0000 7f971affd640 1 --2- 172.21.15.123:0/925196303 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e2022e8cc0 0x55e2023562f0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=350b334090778bda server_cookie=c39e2545f8ccf161 in_seq=0 out_seq=0 2024-08-18T22:11:45.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.708+0000 7f96faffd640 10 client.16113 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:45.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.759+0000 7f96faffd640 1 -- 172.21.15.123:0/925196303 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e202237d60 con 0x55e2022e8cc0 2024-08-18T22:11:45.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.759+0000 7f96faffd640 10 client.16113 handle_command_reply: tid=0 2024-08-18T22:11:45.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.759+0000 7f9723ca0740 1 client.16113 shutdown 2024-08-18T22:11:45.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.759+0000 7f9723ca0740 1 -- 172.21.15.123:0/925196303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5a40 msgr2=0x55e2022dcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:45.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.759+0000 7f9723ca0740 1 --2- 172.21.15.123:0/925196303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5a40 0x55e2022dcc90 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55e2022d5490 tx=0x7f9710012c10 comp rx=0 tx=0).stop 2024-08-18T22:11:45.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.759+0000 7f9723ca0740 1 -- 172.21.15.123:0/925196303 shutdown_connections 2024-08-18T22:11:45.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.759+0000 7f9723ca0740 1 --2- 172.21.15.123:0/925196303 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e2022e8cc0 0x55e2023562f0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.759+0000 7f9723ca0740 1 --2- 172.21.15.123:0/925196303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2022d8bf0 0x55e2022dd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.759+0000 7f96faffd640 0 client.16113 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:45.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.759+0000 7f9723ca0740 1 --2- 172.21.15.123:0/925196303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e2022c5a40 0x55e2022dcc90 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.759+0000 7f9723ca0740 1 --2- 172.21.15.123:0/925196303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e2022c5120 0x55e2022dc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.759+0000 7f9723ca0740 1 -- 172.21.15.123:0/925196303 >> 172.21.15.123:0/925196303 conn(0x55e2022c1790 msgr2=0x55e2022d7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:45.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.759+0000 7f9723ca0740 1 -- 172.21.15.123:0/925196303 shutdown_connections 2024-08-18T22:11:45.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.759+0000 7f9723ca0740 1 -- 172.21.15.123:0/925196303 wait complete. 2024-08-18T22:11:45.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.759+0000 7f9723ca0740 20 client.16113 trim_cache size 0 max 16384 2024-08-18T22:11:45.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.760+0000 7f97218a2640 1 -- 172.21.15.123:0/156474809 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f97040a2c00 msgr2=0x7f97040a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:45.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.760+0000 7f97218a2640 1 --2- 172.21.15.123:0/156474809 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f97040a2c00 0x7f97040a50c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9714049000 tx=0x7f971404a000 comp rx=0 tx=0).stop 2024-08-18T22:11:45.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.760+0000 7f97218a2640 1 -- 172.21.15.123:0/156474809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971c1007b0 msgr2=0x7f971c112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:45.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.760+0000 7f97218a2640 1 --2- 172.21.15.123:0/156474809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971c1007b0 0x7f971c112f50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f970c00e9f0 tx=0x7f970c00edf0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.760+0000 7f97218a2640 1 -- 172.21.15.123:0/156474809 shutdown_connections 2024-08-18T22:11:45.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.760+0000 7f97218a2640 1 --2- 172.21.15.123:0/156474809 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f97040a2c00 0x7f97040a50c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.760+0000 7f97218a2640 1 --2- 172.21.15.123:0/156474809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f971c1067b0 0x7f971c111970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.760+0000 7f97218a2640 1 --2- 172.21.15.123:0/156474809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f971c101150 0x7f971c111330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.760+0000 7f97218a2640 1 --2- 172.21.15.123:0/156474809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971c1007b0 0x7f971c112f50 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:45.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.760+0000 7f97218a2640 1 -- 172.21.15.123:0/156474809 >> 172.21.15.123:0/156474809 conn(0x7f971c0fc4d0 msgr2=0x7f971c0fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:45.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.760+0000 7f97218a2640 1 -- 172.21.15.123:0/156474809 shutdown_connections 2024-08-18T22:11:45.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:44.760+0000 7f97218a2640 1 -- 172.21.15.123:0/156474809 wait complete. 2024-08-18T22:11:45.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:45 smithi183 ceph-mon[22097]: pgmap v459: 129 pgs: 129 active+clean; 13 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 1.19k op/s 2024-08-18T22:11:45.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:45 smithi123 ceph-mon[18462]: pgmap v459: 129 pgs: 129 active+clean; 13 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 1.19k op/s 2024-08-18T22:11:45.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:45 smithi130 ceph-mon[21698]: pgmap v459: 129 pgs: 129 active+clean; 13 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 1.19k op/s 2024-08-18T22:11:46.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:46 smithi183 ceph-mon[22097]: scrub queued for path: / 2024-08-18T22:11:46.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:46 smithi183 ceph-mon[22097]: scrub summary: idle+waiting paths [/] 2024-08-18T22:11:46.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:46 smithi183 ceph-mon[22097]: scrub summary: active paths [/] 2024-08-18T22:11:46.449 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:46 smithi123 ceph-mon[18462]: scrub queued for path: / 2024-08-18T22:11:46.449 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:46 smithi123 ceph-mon[18462]: scrub summary: idle+waiting paths [/] 2024-08-18T22:11:46.449 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:46 smithi123 ceph-mon[18462]: scrub summary: active paths [/] 2024-08-18T22:11:46.484 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-18T22:11:46.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:46 smithi130 ceph-mon[21698]: scrub queued for path: / 2024-08-18T22:11:46.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:46 smithi130 ceph-mon[21698]: scrub summary: idle+waiting paths [/] 2024-08-18T22:11:46.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:46 smithi130 ceph-mon[21698]: scrub summary: active paths [/] 2024-08-18T22:11:46.763 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:11:47.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:47 smithi183 ceph-mon[22097]: pgmap v460: 129 pgs: 129 active+clean; 13 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 1.21k op/s 2024-08-18T22:11:47.438 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:47 smithi123 ceph-mon[18462]: pgmap v460: 129 pgs: 129 active+clean; 13 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 1.21k op/s 2024-08-18T22:11:47.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:47 smithi130 ceph-mon[21698]: pgmap v460: 129 pgs: 129 active+clean; 13 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 1.21k op/s 2024-08-18T22:11:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.520+0000 7f7b93a6d640 1 -- 172.21.15.123:0/231801528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c102c20 msgr2=0x7f7b8c10d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.520+0000 7f7b93a6d640 1 --2- 172.21.15.123:0/231801528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c102c20 0x7f7b8c10d770 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009ca0 tx=0x7f7b8402a950 comp rx=0 tx=0).stop 2024-08-18T22:11:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.520+0000 7f7b93a6d640 1 -- 172.21.15.123:0/231801528 shutdown_connections 2024-08-18T22:11:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.520+0000 7f7b93a6d640 1 --2- 172.21.15.123:0/231801528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c102c20 0x7f7b8c10d770 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.520+0000 7f7b93a6d640 1 --2- 172.21.15.123:0/231801528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b8c1022a0 0x7f7b8c1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.520+0000 7f7b93a6d640 1 --2- 172.21.15.123:0/231801528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b8c100b50 0x7f7b8c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.520+0000 7f7b93a6d640 1 -- 172.21.15.123:0/231801528 >> 172.21.15.123:0/231801528 conn(0x7f7b8c0fc500 msgr2=0x7f7b8c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.520+0000 7f7b93a6d640 1 -- 172.21.15.123:0/231801528 shutdown_connections 2024-08-18T22:11:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.520+0000 7f7b93a6d640 1 -- 172.21.15.123:0/231801528 wait complete. 2024-08-18T22:11:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.520+0000 7f7b93a6d640 1 Processor -- start 2024-08-18T22:11:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b93a6d640 1 -- start start 2024-08-18T22:11:47.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b93a6d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c100b50 0x7f7b8c198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b93a6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b8c1022a0 0x7f7b8c199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b93a6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b8c102c20 0x7f7b8c1a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b93a6d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c110cb0 con 0x7f7b8c100b50 2024-08-18T22:11:47.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b93a6d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c110b30 con 0x7f7b8c102c20 2024-08-18T22:11:47.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b93a6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c110e30 con 0x7f7b8c1022a0 2024-08-18T22:11:47.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b91809640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c100b50 0x7f7b8c198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b91809640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c100b50 0x7f7b8c198fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49116/0 (socket says 172.21.15.123:49116) 2024-08-18T22:11:47.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b91809640 1 -- 172.21.15.123:0/1537832552 learned_addr learned my addr 172.21.15.123:0/1537832552 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:47.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b9200a640 1 --2- 172.21.15.123:0/1537832552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b8c102c20 0x7f7b8c1a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b91008640 1 --2- 172.21.15.123:0/1537832552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b8c1022a0 0x7f7b8c199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b91809640 1 -- 172.21.15.123:0/1537832552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b8c1022a0 msgr2=0x7f7b8c199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:47.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b91809640 1 --2- 172.21.15.123:0/1537832552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b8c1022a0 0x7f7b8c199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b91809640 1 -- 172.21.15.123:0/1537832552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b8c102c20 msgr2=0x7f7b8c1a4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:47.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b91809640 1 --2- 172.21.15.123:0/1537832552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b8c102c20 0x7f7b8c1a4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b91809640 1 -- 172.21.15.123:0/1537832552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b8c1a45a0 con 0x7f7b8c100b50 2024-08-18T22:11:47.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b91809640 1 --2- 172.21.15.123:0/1537832552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c100b50 0x7f7b8c198fe0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800e9f0 tx=0x7f7b8800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:47.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b82ffd640 1 -- 172.21.15.123:0/1537832552 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8800cd80 con 0x7f7b8c100b50 2024-08-18T22:11:47.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.521+0000 7f7b93a6d640 1 -- 172.21.15.123:0/1537832552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b8c1a4770 con 0x7f7b8c100b50 2024-08-18T22:11:47.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.522+0000 7f7b82ffd640 1 -- 172.21.15.123:0/1537832552 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b88010910 con 0x7f7b8c100b50 2024-08-18T22:11:47.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.522+0000 7f7b82ffd640 1 -- 172.21.15.123:0/1537832552 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b880188f0 con 0x7f7b8c100b50 2024-08-18T22:11:47.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.522+0000 7f7b93a6d640 1 -- 172.21.15.123:0/1537832552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b8c1a4d00 con 0x7f7b8c100b50 2024-08-18T22:11:47.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.524+0000 7f7b82ffd640 1 -- 172.21.15.123:0/1537832552 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f7b88010ac0 con 0x7f7b8c100b50 2024-08-18T22:11:47.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.524+0000 7f7b95e6b740 1 Processor -- start 2024-08-18T22:11:47.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.524+0000 7f7b95e6b740 1 -- start start 2024-08-18T22:11:47.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.524+0000 7f7b95e6b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e1f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.524+0000 7f7b95e6b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e1fa10 0x5585d7e2e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.524+0000 7f7b95e6b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e2e800 0x5585d7e30bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.524+0000 7f7b95e6b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5585d7d84980 con 0x5585d7e2e800 2024-08-18T22:11:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.524+0000 7f7b95e6b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5585d7d1ca70 con 0x5585d7e1fa10 2024-08-18T22:11:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.524+0000 7f7b95e6b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5585d7d80940 con 0x5585d7e1f0f0 2024-08-18T22:11:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b91008640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e2e800 0x5585d7e30bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b91809640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e1fa10 0x5585d7e2e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b9200a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e1f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b91008640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e2e800 0x5585d7e30bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49132/0 (socket says 172.21.15.123:49132) 2024-08-18T22:11:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b91008640 1 -- 172.21.15.123:0/3559654123 learned_addr learned my addr 172.21.15.123:0/3559654123 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b82ffd640 1 --2- 172.21.15.123:0/1537832552 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7b780a2b80 0x7f7b780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b91008640 1 -- 172.21.15.123:0/3559654123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 msgr2=0x5585d7e1f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b91008640 1 --2- 172.21.15.123:0/3559654123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e1f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b91008640 1 -- 172.21.15.123:0/3559654123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e1fa10 msgr2=0x5585d7e2e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b91008640 1 --2- 172.21.15.123:0/3559654123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e1fa10 0x5585d7e2e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b91008640 1 -- 172.21.15.123:0/3559654123 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d7d7f6e0 con 0x5585d7e2e800 2024-08-18T22:11:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b9200a640 1 --2- 172.21.15.123:0/1537832552 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7b780a2b80 0x7f7b780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b82ffd640 1 -- 172.21.15.123:0/1537832552 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f7b880cf780 con 0x7f7b8c100b50 2024-08-18T22:11:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b91008640 1 --2- 172.21.15.123:0/3559654123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e2e800 0x5585d7e30bf0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009c20 tx=0x7f7b7c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658f2a3d9e015ec server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b77fff640 1 -- 172.21.15.123:0/3559654123 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c004230 con 0x5585d7e2e800 2024-08-18T22:11:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b77fff640 1 -- 172.21.15.123:0/3559654123 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b7c0043d0 con 0x5585d7e2e800 2024-08-18T22:11:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.525+0000 7f7b77fff640 1 -- 172.21.15.123:0/3559654123 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c004db0 con 0x5585d7e2e800 2024-08-18T22:11:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.526+0000 7f7b95e6b740 1 -- 172.21.15.123:0/3559654123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e2e800 msgr2=0x5585d7e30bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.526+0000 7f7b9200a640 1 --2- 172.21.15.123:0/1537832552 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7b780a2b80 0x7f7b780a5040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7b84005e30 tx=0x7f7b8403c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.526+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/3559654123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e2e800 0x5585d7e30bf0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009c20 tx=0x7f7b7c011810 comp rx=0 tx=0).stop 2024-08-18T22:11:47.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.526+0000 7f7b95e6b740 1 -- 172.21.15.123:0/3559654123 shutdown_connections 2024-08-18T22:11:47.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.526+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/3559654123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e2e800 0x5585d7e30bf0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.526+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/3559654123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e1fa10 0x5585d7e2e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.526+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/3559654123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e1f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.526+0000 7f7b95e6b740 1 -- 172.21.15.123:0/3559654123 >> 172.21.15.123:0/3559654123 conn(0x5585d7e1b7a0 msgr2=0x5585d7e1bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:47.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.526+0000 7f7b95e6b740 1 -- 172.21.15.123:0/3559654123 shutdown_connections 2024-08-18T22:11:47.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.526+0000 7f7b95e6b740 1 -- 172.21.15.123:0/3559654123 wait complete. 2024-08-18T22:11:47.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.526+0000 7f7b95e6b740 1 -- start start 2024-08-18T22:11:47.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b95e6b740 1 Processor -- start 2024-08-18T22:11:47.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b95e6b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e2b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b95e6b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e1fa10 0x5585d7e2bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b95e6b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e2e800 0x5585d7e2c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b95e6b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5585d7e313d0 con 0x5585d7e2e800 2024-08-18T22:11:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b95e6b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5585d7d3faa0 con 0x5585d7e1fa10 2024-08-18T22:11:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b95e6b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5585d7e31550 con 0x5585d7e1f0f0 2024-08-18T22:11:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b95e6b740 10 client.0 _ll_register_callbacks cb 0x5585d7d2ee60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b9200a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e2e800 0x5585d7e2c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b91809640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e2b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b9200a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e2e800 0x5585d7e2c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49142/0 (socket says 172.21.15.123:49142) 2024-08-18T22:11:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b9200a640 1 -- 172.21.15.123:0/1003843087 learned_addr learned my addr 172.21.15.123:0/1003843087 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b91008640 1 --2- 172.21.15.123:0/1003843087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e1fa10 0x5585d7e2bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b9200a640 1 -- 172.21.15.123:0/1003843087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 msgr2=0x5585d7e2b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b9200a640 1 --2- 172.21.15.123:0/1003843087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e2b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b9200a640 1 -- 172.21.15.123:0/1003843087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e1fa10 msgr2=0x5585d7e2bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.527+0000 7f7b9200a640 1 --2- 172.21.15.123:0/1003843087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e1fa10 0x5585d7e2bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b9200a640 1 -- 172.21.15.123:0/1003843087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585d7d23650 con 0x5585d7e2e800 2024-08-18T22:11:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b91008640 1 --2- 172.21.15.123:0/1003843087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e1fa10 0x5585d7e2bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b91809640 1 --2- 172.21.15.123:0/1003843087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e2b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b9200a640 1 --2- 172.21.15.123:0/1003843087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e2e800 0x5585d7e2c180 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7b8402fb90 tx=0x7f7b84005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a67147541451bbc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b757fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b757fa640 1 -- 172.21.15.123:0/1003843087 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b84034040 con 0x5585d7e2e800 2024-08-18T22:11:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b757fa640 1 -- 172.21.15.123:0/1003843087 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f7b84003d80 con 0x5585d7e2e800 2024-08-18T22:11:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b95e6b740 1 -- 172.21.15.123:0/1003843087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b7c0043d0 con 0x5585d7e2e800 2024-08-18T22:11:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b757fa640 1 -- 172.21.15.123:0/1003843087 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7b8405b050 con 0x5585d7e2e800 2024-08-18T22:11:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b95e6b740 10 client.16125 fetch_fsmap learned FSMap version 27 2024-08-18T22:11:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b95e6b740 1 -- 172.21.15.123:0/1003843087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5585d7af63c0 con 0x5585d7e2e800 2024-08-18T22:11:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b757fa640 1 -- 172.21.15.123:0/1003843087 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b7c0043d0 con 0x5585d7e2e800 2024-08-18T22:11:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b757fa640 1 -- 172.21.15.123:0/1003843087 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7b84030880 con 0x5585d7e2e800 2024-08-18T22:11:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b95e6b740 10 client.16125 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:11:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b95e6b740 10 client.16125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b95e6b740 20 client.16125 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.528+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/1003843087 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5585d7e3e370 0x5585d7e40810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.529+0000 7f7b95e6b740 4 client.16125 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.529+0000 7f7b95e6b740 1 -- 172.21.15.123:0/1003843087 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585d7d91ef0 con 0x5585d7e3e370 2024-08-18T22:11:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.529+0000 7f7b91809640 1 --2- 172.21.15.123:0/1003843087 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5585d7e3e370 0x5585d7e40810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.529+0000 7f7b91809640 1 --2- 172.21.15.123:0/1003843087 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5585d7e3e370 0x5585d7e40810 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eec6bf28b948c244 server_cookie=ee8850c6b4c0b3b0 in_seq=0 out_seq=0 2024-08-18T22:11:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.529+0000 7f7b757fa640 10 client.16125 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.534+0000 7f7b757fa640 1 -- 172.21.15.123:0/1003843087 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585d7d91ef0 con 0x5585d7e3e370 2024-08-18T22:11:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.534+0000 7f7b757fa640 10 client.16125 handle_command_reply: tid=0 2024-08-18T22:11:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.534+0000 7f7b95e6b740 1 client.16125 shutdown 2024-08-18T22:11:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.534+0000 7f7b95e6b740 1 -- 172.21.15.123:0/1003843087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e2e800 msgr2=0x5585d7e2c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.534+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/1003843087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e2e800 0x5585d7e2c180 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7b8402fb90 tx=0x7f7b84005c50 comp rx=0 tx=0).stop 2024-08-18T22:11:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.534+0000 7f7b95e6b740 1 -- 172.21.15.123:0/1003843087 shutdown_connections 2024-08-18T22:11:47.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.534+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/1003843087 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5585d7e3e370 0x5585d7e40810 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.534+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/1003843087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e2e800 0x5585d7e2c180 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.534+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/1003843087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e1fa10 0x5585d7e2bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.534+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/1003843087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e2b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.534+0000 7f7b757fa640 0 client.16125 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:47.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.534+0000 7f7b95e6b740 1 -- 172.21.15.123:0/1003843087 >> 172.21.15.123:0/1003843087 conn(0x5585d7e1b7a0 msgr2=0x5585d7e21500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:47.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.534+0000 7f7b95e6b740 1 -- 172.21.15.123:0/1003843087 shutdown_connections 2024-08-18T22:11:47.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.534+0000 7f7b95e6b740 1 -- 172.21.15.123:0/1003843087 wait complete. 2024-08-18T22:11:47.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.534+0000 7f7b95e6b740 20 client.16125 trim_cache size 0 max 16384 2024-08-18T22:11:47.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b95e6b740 1 Processor -- start 2024-08-18T22:11:47.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b95e6b740 1 -- start start 2024-08-18T22:11:47.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b95e6b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e29ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b95e6b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e1fa10 0x5585d7e2d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b95e6b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e2e800 0x5585d7e46120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b95e6b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c1af090 con 0x5585d7e1fa10 2024-08-18T22:11:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b95e6b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c1ac960 con 0x5585d7e2e800 2024-08-18T22:11:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b95e6b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c1aa7b0 con 0x5585d7e1f0f0 2024-08-18T22:11:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b91008640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e1fa10 0x5585d7e2d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b91008640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e1fa10 0x5585d7e2d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49150/0 (socket says 172.21.15.123:49150) 2024-08-18T22:11:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b91008640 1 -- 172.21.15.123:0/4141683075 learned_addr learned my addr 172.21.15.123:0/4141683075 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b9200a640 1 --2- 172.21.15.123:0/4141683075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e2e800 0x5585d7e46120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b91809640 1 --2- 172.21.15.123:0/4141683075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e29ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b91008640 1 -- 172.21.15.123:0/4141683075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 msgr2=0x5585d7e29ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b91008640 1 --2- 172.21.15.123:0/4141683075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e29ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b91008640 1 -- 172.21.15.123:0/4141683075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e2e800 msgr2=0x5585d7e46120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b91008640 1 --2- 172.21.15.123:0/4141683075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e2e800 0x5585d7e46120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b91008640 1 -- 172.21.15.123:0/4141683075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d7e2a6d0 con 0x5585d7e1fa10 2024-08-18T22:11:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b91809640 1 --2- 172.21.15.123:0/4141683075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e29ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.552+0000 7f7b91008640 1 --2- 172.21.15.123:0/4141683075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e1fa10 0x5585d7e2d560 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009b40 tx=0x7f7b7c0049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e802b0cc75bf6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.553+0000 7f7b777fe640 1 -- 172.21.15.123:0/4141683075 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c01e040 con 0x5585d7e1fa10 2024-08-18T22:11:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.553+0000 7f7b777fe640 1 -- 172.21.15.123:0/4141683075 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b7c01f040 con 0x5585d7e1fa10 2024-08-18T22:11:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.553+0000 7f7b777fe640 1 -- 172.21.15.123:0/4141683075 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c0035f0 con 0x5585d7e1fa10 2024-08-18T22:11:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.553+0000 7f7b95e6b740 1 -- 172.21.15.123:0/4141683075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e1fa10 msgr2=0x5585d7e2d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.553+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/4141683075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e1fa10 0x5585d7e2d560 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009b40 tx=0x7f7b7c0049f0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.553+0000 7f7b95e6b740 1 -- 172.21.15.123:0/4141683075 shutdown_connections 2024-08-18T22:11:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.553+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/4141683075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e2e800 0x5585d7e46120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.553+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/4141683075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e1fa10 0x5585d7e2d560 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.553+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/4141683075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e29ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.553+0000 7f7b95e6b740 1 -- 172.21.15.123:0/4141683075 >> 172.21.15.123:0/4141683075 conn(0x5585d7e1b7a0 msgr2=0x5585d7e2ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:47.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.553+0000 7f7b95e6b740 1 -- 172.21.15.123:0/4141683075 shutdown_connections 2024-08-18T22:11:47.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.553+0000 7f7b95e6b740 1 -- 172.21.15.123:0/4141683075 wait complete. 2024-08-18T22:11:47.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b95e6b740 1 -- start start 2024-08-18T22:11:47.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b95e6b740 1 Processor -- start 2024-08-18T22:11:47.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b95e6b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e367e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b95e6b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e1fa10 0x5585d7e36d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b95e6b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e2e800 0x5585d7e27cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b95e6b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c1aae20 con 0x5585d7e1fa10 2024-08-18T22:11:47.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b95e6b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c1ac290 con 0x5585d7e2e800 2024-08-18T22:11:47.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b95e6b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c1ab4f0 con 0x5585d7e1f0f0 2024-08-18T22:11:47.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b95e6b740 10 client.0 _ll_register_callbacks cb 0x7f7b84009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:47.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b91008640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e1fa10 0x5585d7e36d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b91809640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b91008640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e1fa10 0x5585d7e36d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49152/0 (socket says 172.21.15.123:49152) 2024-08-18T22:11:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b91008640 1 -- 172.21.15.123:0/532204653 learned_addr learned my addr 172.21.15.123:0/532204653 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b9200a640 1 --2- 172.21.15.123:0/532204653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e2e800 0x5585d7e27cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b91008640 1 -- 172.21.15.123:0/532204653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 msgr2=0x5585d7e367e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.554+0000 7f7b91008640 1 --2- 172.21.15.123:0/532204653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e367e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b91008640 1 -- 172.21.15.123:0/532204653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e2e800 msgr2=0x5585d7e27cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b91008640 1 --2- 172.21.15.123:0/532204653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e2e800 0x5585d7e27cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b91008640 1 -- 172.21.15.123:0/532204653 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585d7e28220 con 0x5585d7e1fa10 2024-08-18T22:11:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b91008640 1 --2- 172.21.15.123:0/532204653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e1fa10 0x5585d7e36d20 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c019bd0 tx=0x7f7b7c009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f7cd3d55a82fbf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b757fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b757fa640 1 -- 172.21.15.123:0/532204653 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c031070 con 0x5585d7e1fa10 2024-08-18T22:11:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b95e6b740 1 -- 172.21.15.123:0/532204653 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b7c01f040 con 0x5585d7e1fa10 2024-08-18T22:11:47.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b757fa640 1 -- 172.21.15.123:0/532204653 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f7b7c004450 con 0x5585d7e1fa10 2024-08-18T22:11:47.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b757fa640 1 -- 172.21.15.123:0/532204653 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7b7c03d050 con 0x5585d7e1fa10 2024-08-18T22:11:47.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b95e6b740 10 client.16131 fetch_fsmap learned FSMap version 27 2024-08-18T22:11:47.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b95e6b740 1 -- 172.21.15.123:0/532204653 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5585d7ea8940 con 0x5585d7e1fa10 2024-08-18T22:11:47.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b757fa640 1 -- 172.21.15.123:0/532204653 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b7c01f040 con 0x5585d7e1fa10 2024-08-18T22:11:47.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b757fa640 1 -- 172.21.15.123:0/532204653 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7b7c018070 con 0x5585d7e1fa10 2024-08-18T22:11:47.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b95e6b740 10 client.16131 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:11:47.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b95e6b740 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:47.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b95e6b740 20 client.16131 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:47.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/532204653 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5585d7ea8e90 0x5585d7eab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:47.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b95e6b740 4 client.16131 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:11:47.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.555+0000 7f7b95e6b740 1 -- 172.21.15.123:0/532204653 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5585d7d8c400 con 0x5585d7ea8e90 2024-08-18T22:11:47.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.556+0000 7f7b91809640 1 --2- 172.21.15.123:0/532204653 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5585d7ea8e90 0x5585d7eab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:47.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.556+0000 7f7b757fa640 10 client.16131 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:47.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.556+0000 7f7b91809640 1 --2- 172.21.15.123:0/532204653 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5585d7ea8e90 0x5585d7eab2b0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=816ecb2e9c01d740 server_cookie=bde6127f9ffba8fb in_seq=0 out_seq=0 2024-08-18T22:11:47.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.561+0000 7f7b757fa640 1 -- 172.21.15.123:0/532204653 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x5585d7d8c400 con 0x5585d7ea8e90 2024-08-18T22:11:47.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.561+0000 7f7b757fa640 10 client.16131 handle_command_reply: tid=0 2024-08-18T22:11:47.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.561+0000 7f7b95e6b740 1 client.16131 shutdown 2024-08-18T22:11:47.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.561+0000 7f7b95e6b740 1 -- 172.21.15.123:0/532204653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e1fa10 msgr2=0x5585d7e36d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:47.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.561+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/532204653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e1fa10 0x5585d7e36d20 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c019bd0 tx=0x7f7b7c009f00 comp rx=0 tx=0).stop 2024-08-18T22:11:47.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.561+0000 7f7b95e6b740 1 -- 172.21.15.123:0/532204653 shutdown_connections 2024-08-18T22:11:47.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.561+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/532204653 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5585d7ea8e90 0x5585d7eab2b0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.561+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/532204653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585d7e2e800 0x5585d7e27cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.561+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/532204653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585d7e1fa10 0x5585d7e36d20 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.561+0000 7f7b757fa640 0 client.16131 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:47.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.561+0000 7f7b95e6b740 1 --2- 172.21.15.123:0/532204653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585d7e1f0f0 0x5585d7e367e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.561+0000 7f7b95e6b740 1 -- 172.21.15.123:0/532204653 >> 172.21.15.123:0/532204653 conn(0x5585d7e1b7a0 msgr2=0x5585d7e1a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:47.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.561+0000 7f7b95e6b740 1 -- 172.21.15.123:0/532204653 shutdown_connections 2024-08-18T22:11:47.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.561+0000 7f7b95e6b740 1 -- 172.21.15.123:0/532204653 wait complete. 2024-08-18T22:11:47.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.561+0000 7f7b95e6b740 20 client.16131 trim_cache size 0 max 16384 2024-08-18T22:11:47.565 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:11:47.565 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "scrub active (1761 inodes in the stack)", 2024-08-18T22:11:47.565 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": { 2024-08-18T22:11:47.565 INFO:teuthology.orchestra.run.smithi123.stdout: "7c0c7a16-a499-4494-9131-efd0bfd104f9": { 2024-08-18T22:11:47.565 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/", 2024-08-18T22:11:47.566 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "7c0c7a16-a499-4494-9131-efd0bfd104f9", 2024-08-18T22:11:47.566 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "recursive,force" 2024-08-18T22:11:47.566 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:47.566 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:47.566 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:11:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.562+0000 7f7b93a6d640 1 -- 172.21.15.123:0/1537832552 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7b780a2b80 msgr2=0x7f7b780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.562+0000 7f7b93a6d640 1 --2- 172.21.15.123:0/1537832552 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7b780a2b80 0x7f7b780a5040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7b84005e30 tx=0x7f7b8403c040 comp rx=0 tx=0).stop 2024-08-18T22:11:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.562+0000 7f7b93a6d640 1 -- 172.21.15.123:0/1537832552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c100b50 msgr2=0x7f7b8c198fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.562+0000 7f7b93a6d640 1 --2- 172.21.15.123:0/1537832552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c100b50 0x7f7b8c198fe0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800e9f0 tx=0x7f7b8800eeb0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.562+0000 7f7b93a6d640 1 -- 172.21.15.123:0/1537832552 shutdown_connections 2024-08-18T22:11:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.562+0000 7f7b93a6d640 1 --2- 172.21.15.123:0/1537832552 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7b780a2b80 0x7f7b780a5040 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.562+0000 7f7b93a6d640 1 --2- 172.21.15.123:0/1537832552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b8c102c20 0x7f7b8c1a4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.562+0000 7f7b93a6d640 1 --2- 172.21.15.123:0/1537832552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b8c1022a0 0x7f7b8c199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.562+0000 7f7b93a6d640 1 --2- 172.21.15.123:0/1537832552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b8c100b50 0x7f7b8c198fe0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.562+0000 7f7b93a6d640 1 -- 172.21.15.123:0/1537832552 >> 172.21.15.123:0/1537832552 conn(0x7f7b8c0fc500 msgr2=0x7f7b8c106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.562+0000 7f7b93a6d640 1 -- 172.21.15.123:0/1537832552 shutdown_connections 2024-08-18T22:11:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:47.562+0000 7f7b93a6d640 1 -- 172.21.15.123:0/1537832552 wait complete. 2024-08-18T22:11:48.699 INFO:tasks.cephfs.filesystem:scrub status for tag:7c0c7a16-a499-4494-9131-efd0bfd104f9 - {'path': '/', 'tag': '7c0c7a16-a499-4494-9131-efd0bfd104f9', 'options': 'recursive,force'} 2024-08-18T22:11:49.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:49 smithi183 ceph-mon[22097]: pgmap v461: 129 pgs: 129 active+clean; 16 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 1.33k op/s 2024-08-18T22:11:49.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:49 smithi123 ceph-mon[18462]: pgmap v461: 129 pgs: 129 active+clean; 16 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 1.33k op/s 2024-08-18T22:11:49.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:49 smithi130 ceph-mon[21698]: pgmap v461: 129 pgs: 129 active+clean; 16 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 1.33k op/s 2024-08-18T22:11:51.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:51 smithi183 ceph-mon[22097]: pgmap v462: 129 pgs: 129 active+clean; 18 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 1.44k op/s 2024-08-18T22:11:51.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:51 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:11:51.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:51 smithi123 ceph-mon[18462]: pgmap v462: 129 pgs: 129 active+clean; 18 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 1.44k op/s 2024-08-18T22:11:51.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:51 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:11:51.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:51 smithi130 ceph-mon[21698]: pgmap v462: 129 pgs: 129 active+clean; 18 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 1.44k op/s 2024-08-18T22:11:51.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:51 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:11:52.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:52 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:11:52.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:52 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:11:52.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:52 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:11:52.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:52 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:11:52.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:52 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:11:52.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:52 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:11:52.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:52 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:11:52.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:52 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:11:52.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:52 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:11:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.239+0000 7fe64468f640 1 -- 172.21.15.123:0/2266514283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe63c100790 msgr2=0x7fe63c100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.239+0000 7fe64468f640 1 --2- 172.21.15.123:0/2266514283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe63c100790 0x7fe63c100b90 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009900 tx=0x7fe62c02a410 comp rx=0 tx=0).stop 2024-08-18T22:11:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.239+0000 7fe64468f640 1 -- 172.21.15.123:0/2266514283 shutdown_connections 2024-08-18T22:11:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.239+0000 7fe64468f640 1 --2- 172.21.15.123:0/2266514283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe63c102340 0x7fe63c108bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.239+0000 7fe64468f640 1 --2- 172.21.15.123:0/2266514283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe63c101980 0x7fe63c101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.239+0000 7fe64468f640 1 --2- 172.21.15.123:0/2266514283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe63c100790 0x7fe63c100b90 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.239+0000 7fe64468f640 1 -- 172.21.15.123:0/2266514283 >> 172.21.15.123:0/2266514283 conn(0x7fe63c0fbef0 msgr2=0x7fe63c0fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.239+0000 7fe64468f640 1 -- 172.21.15.123:0/2266514283 shutdown_connections 2024-08-18T22:11:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.239+0000 7fe64468f640 1 -- 172.21.15.123:0/2266514283 wait complete. 2024-08-18T22:11:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe64468f640 1 Processor -- start 2024-08-18T22:11:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe64468f640 1 -- start start 2024-08-18T22:11:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe64468f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe63c100790 0x7fe63c1969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe64468f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe63c101980 0x7fe63c196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe64468f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe63c102340 0x7fe63c19dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe64468f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c10c460 con 0x7fe63c102340 2024-08-18T22:11:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe64468f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c10c2e0 con 0x7fe63c101980 2024-08-18T22:11:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe64468f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c10c5e0 con 0x7fe63c100790 2024-08-18T22:11:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe642c2c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe63c102340 0x7fe63c19dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe64242b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe63c100790 0x7fe63c1969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe642c2c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe63c102340 0x7fe63c19dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45700/0 (socket says 172.21.15.123:45700) 2024-08-18T22:11:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe641c2a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe63c101980 0x7fe63c196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe64242b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe63c100790 0x7fe63c1969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:53862/0 (socket says 172.21.15.123:53862) 2024-08-18T22:11:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe642c2c640 1 -- 172.21.15.123:0/1191099831 learned_addr learned my addr 172.21.15.123:0/1191099831 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe642c2c640 1 -- 172.21.15.123:0/1191099831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe63c100790 msgr2=0x7fe63c1969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe642c2c640 1 --2- 172.21.15.123:0/1191099831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe63c100790 0x7fe63c1969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe642c2c640 1 -- 172.21.15.123:0/1191099831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe63c101980 msgr2=0x7fe63c196f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe642c2c640 1 --2- 172.21.15.123:0/1191099831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe63c101980 0x7fe63c196f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.240+0000 7fe642c2c640 1 -- 172.21.15.123:0/1191099831 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe63c19e610 con 0x7fe63c102340 2024-08-18T22:11:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.241+0000 7fe642c2c640 1 --2- 172.21.15.123:0/1191099831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe63c102340 0x7fe63c19dfa0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe63400eb10 tx=0x7fe63400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.241+0000 7fe6337fe640 1 -- 172.21.15.123:0/1191099831 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634004b20 con 0x7fe63c102340 2024-08-18T22:11:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.241+0000 7fe6337fe640 1 -- 172.21.15.123:0/1191099831 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe634004cc0 con 0x7fe63c102340 2024-08-18T22:11:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.241+0000 7fe64468f640 1 -- 172.21.15.123:0/1191099831 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe63c19e900 con 0x7fe63c102340 2024-08-18T22:11:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.241+0000 7fe6337fe640 1 -- 172.21.15.123:0/1191099831 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634010760 con 0x7fe63c102340 2024-08-18T22:11:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.241+0000 7fe64468f640 1 -- 172.21.15.123:0/1191099831 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe63c19ee00 con 0x7fe63c102340 2024-08-18T22:11:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.243+0000 7fe6337fe640 1 -- 172.21.15.123:0/1191099831 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fe634005020 con 0x7fe63c102340 2024-08-18T22:11:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.243+0000 7fe647451740 1 Processor -- start 2024-08-18T22:11:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.243+0000 7fe647451740 1 -- start start 2024-08-18T22:11:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe647451740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d692890 0x56120d692c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe647451740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d6931d0 0x56120d697c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe647451740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d698260 0x56120d69a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe647451740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56120d5f39d0 con 0x56120d698260 2024-08-18T22:11:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe647451740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56120d59b820 con 0x56120d6931d0 2024-08-18T22:11:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe647451740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56120d5ef990 con 0x56120d692890 2024-08-18T22:11:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe6337fe640 1 --2- 172.21.15.123:0/1191099831 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe6280a2c30 0x7fe6280a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe64242b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d6931d0 0x56120d697c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe641c2a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d692890 0x56120d692c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe64242b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d6931d0 0x56120d697c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:52422/0 (socket says 172.21.15.123:52422) 2024-08-18T22:11:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe641c2a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d692890 0x56120d692c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:53876/0 (socket says 172.21.15.123:53876) 2024-08-18T22:11:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe64242b640 1 -- 172.21.15.123:0/3865034919 learned_addr learned my addr 172.21.15.123:0/3865034919 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe641c2a640 1 --2- 172.21.15.123:0/3865034919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d698260 0x56120d69a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe642c2c640 1 --2- 172.21.15.123:0/1191099831 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe6280a2c30 0x7fe6280a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe641c2a640 1 -- 172.21.15.123:0/3865034919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d6931d0 msgr2=0x56120d697c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe641c2a640 1 --2- 172.21.15.123:0/3865034919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d6931d0 0x56120d697c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe641c2a640 1 -- 172.21.15.123:0/3865034919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d698260 msgr2=0x56120d69a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe641c2a640 1 --2- 172.21.15.123:0/3865034919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d698260 0x56120d69a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe641c2a640 1 -- 172.21.15.123:0/3865034919 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120d307210 con 0x56120d692890 2024-08-18T22:11:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe6337fe640 1 -- 172.21.15.123:0/1191099831 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe6340cf980 con 0x7fe63c102340 2024-08-18T22:11:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe641c2a640 1 --2- 172.21.15.123:0/3865034919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d692890 0x56120d692c90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe63c197f00 tx=0x7fe6380046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9a060121987b663 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe642c2c640 1 --2- 172.21.15.123:0/1191099831 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe6280a2c30 0x7fe6280a50f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe63409bde0 tx=0x7fe634096860 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.244+0000 7fe630ff9640 1 -- 172.21.15.123:0/3865034919 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe638004050 con 0x56120d692890 2024-08-18T22:11:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.245+0000 7fe630ff9640 1 -- 172.21.15.123:0/3865034919 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe63800fca0 con 0x56120d692890 2024-08-18T22:11:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.245+0000 7fe630ff9640 1 -- 172.21.15.123:0/3865034919 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe638003950 con 0x56120d692890 2024-08-18T22:11:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.245+0000 7fe647451740 1 -- 172.21.15.123:0/3865034919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d692890 msgr2=0x56120d692c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.245+0000 7fe647451740 1 --2- 172.21.15.123:0/3865034919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d692890 0x56120d692c90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe63c197f00 tx=0x7fe6380046c0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.245+0000 7fe647451740 1 -- 172.21.15.123:0/3865034919 shutdown_connections 2024-08-18T22:11:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.245+0000 7fe647451740 1 --2- 172.21.15.123:0/3865034919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d698260 0x56120d69a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.245+0000 7fe647451740 1 --2- 172.21.15.123:0/3865034919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d6931d0 0x56120d697c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.245+0000 7fe647451740 1 --2- 172.21.15.123:0/3865034919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d692890 0x56120d692c90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.245+0000 7fe647451740 1 -- 172.21.15.123:0/3865034919 >> 172.21.15.123:0/3865034919 conn(0x56120d68df00 msgr2=0x56120d68e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.245+0000 7fe647451740 1 -- 172.21.15.123:0/3865034919 shutdown_connections 2024-08-18T22:11:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.245+0000 7fe647451740 1 -- 172.21.15.123:0/3865034919 wait complete. 2024-08-18T22:11:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe647451740 1 -- start start 2024-08-18T22:11:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe647451740 1 Processor -- start 2024-08-18T22:11:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe647451740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d692890 0x56120d69ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe647451740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d6931d0 0x56120d69f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe647451740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d698260 0x56120d6a6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe647451740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56120d69b230 con 0x56120d698260 2024-08-18T22:11:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe647451740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56120d5af520 con 0x56120d692890 2024-08-18T22:11:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe647451740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56120d69b3b0 con 0x56120d6931d0 2024-08-18T22:11:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe647451740 10 client.0 _ll_register_callbacks cb 0x56120d306a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe641c2a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d698260 0x56120d6a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe641c2a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d698260 0x56120d6a6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45730/0 (socket says 172.21.15.123:45730) 2024-08-18T22:11:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe641c2a640 1 -- 172.21.15.123:0/426888162 learned_addr learned my addr 172.21.15.123:0/426888162 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe64242b640 1 --2- 172.21.15.123:0/426888162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d6931d0 0x56120d69f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe641c2a640 1 --2- 172.21.15.123:0/426888162 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d692890 0x56120d69ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe64242b640 1 -- 172.21.15.123:0/426888162 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d692890 msgr2=0x56120d69ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe64242b640 1 --2- 172.21.15.123:0/426888162 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d692890 0x56120d69ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe64242b640 1 -- 172.21.15.123:0/426888162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d698260 msgr2=0x56120d6a6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe64242b640 1 --2- 172.21.15.123:0/426888162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d698260 0x56120d6a6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe64242b640 1 -- 172.21.15.123:0/426888162 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120d3d3620 con 0x56120d6931d0 2024-08-18T22:11:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.246+0000 7fe641c2a640 1 --2- 172.21.15.123:0/426888162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d698260 0x56120d6a6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:11:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.247+0000 7fe64242b640 1 --2- 172.21.15.123:0/426888162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d6931d0 0x56120d69f1c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe62c006010 tx=0x7fe62c0043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18e53eb28159d249 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.247+0000 7fe625ffb640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-08-18T22:11:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.247+0000 7fe625ffb640 1 -- 172.21.15.123:0/426888162 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c035040 con 0x56120d6931d0 2024-08-18T22:11:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.247+0000 7fe625ffb640 1 -- 172.21.15.123:0/426888162 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe62c005450 con 0x56120d6931d0 2024-08-18T22:11:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.247+0000 7fe647451740 1 -- 172.21.15.123:0/426888162 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe63800fca0 con 0x56120d6931d0 2024-08-18T22:11:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.247+0000 7fe625ffb640 1 -- 172.21.15.123:0/426888162 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe62c04f050 con 0x56120d6931d0 2024-08-18T22:11:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.247+0000 7fe647451740 10 client.25591 fetch_fsmap learned FSMap version 27 2024-08-18T22:11:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.247+0000 7fe647451740 1 -- 172.21.15.123:0/426888162 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56120d6a8ff0 con 0x56120d6931d0 2024-08-18T22:11:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.247+0000 7fe625ffb640 1 -- 172.21.15.123:0/426888162 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe63800fca0 con 0x56120d6931d0 2024-08-18T22:11:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.248+0000 7fe625ffb640 1 -- 172.21.15.123:0/426888162 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe62c031a90 con 0x56120d6931d0 2024-08-18T22:11:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.248+0000 7fe647451740 10 client.25591 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:11:53.256 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.248+0000 7fe647451740 10 client.25591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:53.256 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.248+0000 7fe647451740 20 client.25591 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:53.256 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.248+0000 7fe647451740 1 --2- 172.21.15.123:0/426888162 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56120d6aa710 0x56120d6acb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.256 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.248+0000 7fe647451740 4 client.25591 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:11:53.256 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.248+0000 7fe647451740 1 -- 172.21.15.123:0/426888162 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56120d601100 con 0x56120d6aa710 2024-08-18T22:11:53.256 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.248+0000 7fe641c2a640 1 --2- 172.21.15.123:0/426888162 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56120d6aa710 0x56120d6acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.256 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.248+0000 7fe641c2a640 1 --2- 172.21.15.123:0/426888162 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56120d6aa710 0x56120d6acb20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e937739a4a32f9df server_cookie=2681bf308657c051 in_seq=0 out_seq=0 2024-08-18T22:11:53.256 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.248+0000 7fe625ffb640 10 client.25591 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:53.257 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.251+0000 7fe625ffb640 1 -- 172.21.15.123:0/426888162 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56120d601100 con 0x56120d6aa710 2024-08-18T22:11:53.257 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.251+0000 7fe625ffb640 10 client.25591 handle_command_reply: tid=0 2024-08-18T22:11:53.257 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.252+0000 7fe647451740 1 client.25591 shutdown 2024-08-18T22:11:53.257 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.252+0000 7fe647451740 1 -- 172.21.15.123:0/426888162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d6931d0 msgr2=0x56120d69f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:53.257 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.252+0000 7fe647451740 1 --2- 172.21.15.123:0/426888162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d6931d0 0x56120d69f1c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe62c006010 tx=0x7fe62c0043b0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.252+0000 7fe647451740 1 -- 172.21.15.123:0/426888162 shutdown_connections 2024-08-18T22:11:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.252+0000 7fe647451740 1 --2- 172.21.15.123:0/426888162 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56120d6aa710 0x56120d6acb20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.252+0000 7fe647451740 1 --2- 172.21.15.123:0/426888162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d698260 0x56120d6a6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.252+0000 7fe647451740 1 --2- 172.21.15.123:0/426888162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d6931d0 0x56120d69f1c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.252+0000 7fe647451740 1 --2- 172.21.15.123:0/426888162 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d692890 0x56120d69ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.252+0000 7fe625ffb640 0 client.25591 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.252+0000 7fe647451740 1 -- 172.21.15.123:0/426888162 >> 172.21.15.123:0/426888162 conn(0x56120d68df00 msgr2=0x56120d68eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.252+0000 7fe647451740 1 -- 172.21.15.123:0/426888162 shutdown_connections 2024-08-18T22:11:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.252+0000 7fe647451740 1 -- 172.21.15.123:0/426888162 wait complete. 2024-08-18T22:11:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.252+0000 7fe647451740 20 client.25591 trim_cache size 0 max 16384 2024-08-18T22:11:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.266+0000 7fe647451740 1 Processor -- start 2024-08-18T22:11:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.266+0000 7fe647451740 1 -- start start 2024-08-18T22:11:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.266+0000 7fe647451740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d692890 0x56120d68d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.266+0000 7fe647451740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d6931d0 0x56120d6a6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.266+0000 7fe647451740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d698260 0x56120d69b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.266+0000 7fe647451740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c1aaa40 con 0x56120d6931d0 2024-08-18T22:11:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.266+0000 7fe647451740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c1a8310 con 0x56120d698260 2024-08-18T22:11:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.266+0000 7fe647451740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c1a6160 con 0x56120d692890 2024-08-18T22:11:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.266+0000 7fe64242b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d6931d0 0x56120d6a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.266+0000 7fe64242b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d6931d0 0x56120d6a6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45734/0 (socket says 172.21.15.123:45734) 2024-08-18T22:11:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.266+0000 7fe64242b640 1 -- 172.21.15.123:0/3922860936 learned_addr learned my addr 172.21.15.123:0/3922860936 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.266+0000 7fe641c2a640 1 --2- 172.21.15.123:0/3922860936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d698260 0x56120d69b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.266+0000 7fe641c2a640 1 --2- 172.21.15.123:0/3922860936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d692890 0x56120d68d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.267+0000 7fe64242b640 1 -- 172.21.15.123:0/3922860936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d692890 msgr2=0x56120d68d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.267+0000 7fe64242b640 1 --2- 172.21.15.123:0/3922860936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d692890 0x56120d68d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.267+0000 7fe64242b640 1 -- 172.21.15.123:0/3922860936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d698260 msgr2=0x56120d69b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.267+0000 7fe64242b640 1 --2- 172.21.15.123:0/3922860936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d698260 0x56120d69b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.267+0000 7fe64242b640 1 -- 172.21.15.123:0/3922860936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120d6ad1a0 con 0x56120d6931d0 2024-08-18T22:11:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.267+0000 7fe641c2a640 1 --2- 172.21.15.123:0/3922860936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d692890 0x56120d68d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:11:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.267+0000 7fe64242b640 1 --2- 172.21.15.123:0/3922860936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d6931d0 0x56120d6a6150 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009850 tx=0x7fe62c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bae12cb73f0e58d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.267+0000 7fe627fff640 1 -- 172.21.15.123:0/3922860936 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c035030 con 0x56120d6931d0 2024-08-18T22:11:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.267+0000 7fe627fff640 1 -- 172.21.15.123:0/3922860936 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe62c041070 con 0x56120d6931d0 2024-08-18T22:11:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.267+0000 7fe627fff640 1 -- 172.21.15.123:0/3922860936 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c000e60 con 0x56120d6931d0 2024-08-18T22:11:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 -- 172.21.15.123:0/3922860936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d6931d0 msgr2=0x56120d6a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 --2- 172.21.15.123:0/3922860936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d6931d0 0x56120d6a6150 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009850 tx=0x7fe62c0046c0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 -- 172.21.15.123:0/3922860936 shutdown_connections 2024-08-18T22:11:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 --2- 172.21.15.123:0/3922860936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d698260 0x56120d69b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 --2- 172.21.15.123:0/3922860936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d6931d0 0x56120d6a6150 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 --2- 172.21.15.123:0/3922860936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d692890 0x56120d68d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 -- 172.21.15.123:0/3922860936 >> 172.21.15.123:0/3922860936 conn(0x56120d68df00 msgr2=0x56120d68cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 -- 172.21.15.123:0/3922860936 shutdown_connections 2024-08-18T22:11:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 -- 172.21.15.123:0/3922860936 wait complete. 2024-08-18T22:11:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 -- start start 2024-08-18T22:11:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 Processor -- start 2024-08-18T22:11:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d692890 0x56120d6a32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d6931d0 0x56120d6a3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d698260 0x56120d6a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c1a67d0 con 0x56120d6931d0 2024-08-18T22:11:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c1a7c40 con 0x56120d692890 2024-08-18T22:11:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c1a6ea0 con 0x56120d698260 2024-08-18T22:11:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe647451740 10 client.0 _ll_register_callbacks cb 0x7fe62c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:11:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe64242b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d6931d0 0x56120d6a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe64242b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d6931d0 0x56120d6a3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45738/0 (socket says 172.21.15.123:45738) 2024-08-18T22:11:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe64242b640 1 -- 172.21.15.123:0/3017914082 learned_addr learned my addr 172.21.15.123:0/3017914082 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:11:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe641c2a640 1 --2- 172.21.15.123:0/3017914082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d692890 0x56120d6a32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.268+0000 7fe641c2a640 1 --2- 172.21.15.123:0/3017914082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d698260 0x56120d6a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe64242b640 1 -- 172.21.15.123:0/3017914082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d698260 msgr2=0x56120d6a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe64242b640 1 --2- 172.21.15.123:0/3017914082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d698260 0x56120d6a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe64242b640 1 -- 172.21.15.123:0/3017914082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d692890 msgr2=0x56120d6a32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:11:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe64242b640 1 --2- 172.21.15.123:0/3017914082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d692890 0x56120d6a32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe64242b640 1 -- 172.21.15.123:0/3017914082 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120d6a4dd0 con 0x56120d6931d0 2024-08-18T22:11:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe64242b640 1 --2- 172.21.15.123:0/3017914082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d6931d0 0x56120d6a3820 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe62c000c00 tx=0x7fe62c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8393c15924a8c13c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:11:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe625ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:11:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe625ffb640 1 -- 172.21.15.123:0/3017914082 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c060020 con 0x56120d6931d0 2024-08-18T22:11:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe647451740 1 -- 172.21.15.123:0/3017914082 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe62c041070 con 0x56120d6931d0 2024-08-18T22:11:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe625ffb640 1 -- 172.21.15.123:0/3017914082 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe62c003a10 con 0x56120d6931d0 2024-08-18T22:11:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe625ffb640 1 -- 172.21.15.123:0/3017914082 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe62c068050 con 0x56120d6931d0 2024-08-18T22:11:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe647451740 10 client.16149 fetch_fsmap learned FSMap version 27 2024-08-18T22:11:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe647451740 1 -- 172.21.15.123:0/3017914082 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56120d6a60e0 con 0x56120d6931d0 2024-08-18T22:11:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe625ffb640 1 -- 172.21.15.123:0/3017914082 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe62c041070 con 0x56120d6931d0 2024-08-18T22:11:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe625ffb640 1 -- 172.21.15.123:0/3017914082 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe62c004770 con 0x56120d6931d0 2024-08-18T22:11:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe647451740 10 client.16149 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:11:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe647451740 10 client.16149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:11:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe647451740 20 client.16149 populate_metadata read hostname 'smithi123' 2024-08-18T22:11:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe647451740 1 --2- 172.21.15.123:0/3017914082 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56120d7157c0 0x56120d717be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:11:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe647451740 4 client.16149 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:11:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.269+0000 7fe647451740 1 -- 172.21.15.123:0/3017914082 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56120d5fb450 con 0x56120d7157c0 2024-08-18T22:11:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.270+0000 7fe641c2a640 1 --2- 172.21.15.123:0/3017914082 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56120d7157c0 0x56120d717be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:11:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.270+0000 7fe625ffb640 10 client.16149 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:53.270+0000 7fe641c2a640 1 --2- 172.21.15.123:0/3017914082 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56120d7157c0 0x56120d717be0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8fac3c42aac9d2d server_cookie=69eb63d692235465 in_seq=0 out_seq=0 2024-08-18T22:11:53.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:53 smithi183 ceph-mon[22097]: pgmap v463: 129 pgs: 129 active+clean; 19 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 1.32k op/s 2024-08-18T22:11:53.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:53 smithi123 ceph-mon[18462]: pgmap v463: 129 pgs: 129 active+clean; 19 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 1.32k op/s 2024-08-18T22:11:53.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:53 smithi130 ceph-mon[21698]: pgmap v463: 129 pgs: 129 active+clean; 19 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 1.32k op/s 2024-08-18T22:11:55.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:55 smithi183 ceph-mon[22097]: pgmap v464: 129 pgs: 129 active+clean; 25 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 1.15k op/s 2024-08-18T22:11:55.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:55 smithi123 ceph-mon[18462]: pgmap v464: 129 pgs: 129 active+clean; 25 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 1.15k op/s 2024-08-18T22:11:55.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:55 smithi130 ceph-mon[21698]: pgmap v464: 129 pgs: 129 active+clean; 25 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 1.15k op/s 2024-08-18T22:11:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.925+0000 7fe625ffb640 1 -- 172.21.15.123:0/3017914082 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56120d5fb450 con 0x56120d7157c0 2024-08-18T22:11:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.925+0000 7fe625ffb640 10 client.16149 handle_command_reply: tid=0 2024-08-18T22:11:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.925+0000 7fe647451740 1 client.16149 shutdown 2024-08-18T22:11:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.925+0000 7fe647451740 1 -- 172.21.15.123:0/3017914082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d6931d0 msgr2=0x56120d6a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.925+0000 7fe647451740 1 --2- 172.21.15.123:0/3017914082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d6931d0 0x56120d6a3820 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe62c000c00 tx=0x7fe62c031400 comp rx=0 tx=0).stop 2024-08-18T22:11:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.925+0000 7fe647451740 1 -- 172.21.15.123:0/3017914082 shutdown_connections 2024-08-18T22:11:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.925+0000 7fe647451740 1 --2- 172.21.15.123:0/3017914082 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56120d7157c0 0x56120d717be0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.925+0000 7fe647451740 1 --2- 172.21.15.123:0/3017914082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56120d698260 0x56120d6a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.925+0000 7fe647451740 1 --2- 172.21.15.123:0/3017914082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56120d6931d0 0x56120d6a3820 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.925+0000 7fe647451740 1 --2- 172.21.15.123:0/3017914082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56120d692890 0x56120d6a32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:55.928 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.925+0000 7fe625ffb640 0 client.16149 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:55.928 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.925+0000 7fe647451740 1 -- 172.21.15.123:0/3017914082 >> 172.21.15.123:0/3017914082 conn(0x56120d68df00 msgr2=0x56120d69d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:55.928 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.925+0000 7fe647451740 1 -- 172.21.15.123:0/3017914082 shutdown_connections 2024-08-18T22:11:55.928 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.925+0000 7fe647451740 1 -- 172.21.15.123:0/3017914082 wait complete. 2024-08-18T22:11:55.928 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.926+0000 7fe647451740 20 client.16149 trim_cache size 0 max 16384 2024-08-18T22:11:55.928 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:11:55.928 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:11:55.928 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:11:55.928 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:11:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.926+0000 7fe64468f640 1 -- 172.21.15.123:0/1191099831 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe6280a2c30 msgr2=0x7fe6280a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.926+0000 7fe64468f640 1 --2- 172.21.15.123:0/1191099831 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe6280a2c30 0x7fe6280a50f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe63409bde0 tx=0x7fe634096860 comp rx=0 tx=0).stop 2024-08-18T22:11:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.926+0000 7fe64468f640 1 -- 172.21.15.123:0/1191099831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe63c102340 msgr2=0x7fe63c19dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.926+0000 7fe64468f640 1 --2- 172.21.15.123:0/1191099831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe63c102340 0x7fe63c19dfa0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe63400eb10 tx=0x7fe63400c2d0 comp rx=0 tx=0).stop 2024-08-18T22:11:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.926+0000 7fe64468f640 1 -- 172.21.15.123:0/1191099831 shutdown_connections 2024-08-18T22:11:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.926+0000 7fe64468f640 1 --2- 172.21.15.123:0/1191099831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe63c102340 0x7fe63c19dfa0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.926+0000 7fe64468f640 1 --2- 172.21.15.123:0/1191099831 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe6280a2c30 0x7fe6280a50f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.926+0000 7fe64468f640 1 --2- 172.21.15.123:0/1191099831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe63c101980 0x7fe63c196f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.926+0000 7fe64468f640 1 --2- 172.21.15.123:0/1191099831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe63c100790 0x7fe63c1969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.926+0000 7fe64468f640 1 -- 172.21.15.123:0/1191099831 >> 172.21.15.123:0/1191099831 conn(0x7fe63c0fbef0 msgr2=0x7fe63c104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.926+0000 7fe64468f640 1 -- 172.21.15.123:0/1191099831 shutdown_connections 2024-08-18T22:11:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:11:55.926+0000 7fe64468f640 1 -- 172.21.15.123:0/1191099831 wait complete. 2024-08-18T22:11:57.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.294+0000 7f51beffd640 1 -- 172.21.15.123:0/17200244 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5559297814f0 con 0x55592989e520 2024-08-18T22:11:57.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.294+0000 7f51beffd640 10 client.16098 handle_command_reply: tid=0 2024-08-18T22:11:57.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.294+0000 7f51e8361740 1 client.16098 shutdown 2024-08-18T22:11:57.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.294+0000 7f51e8361740 1 -- 172.21.15.123:0/17200244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 msgr2=0x555929818b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:57.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.295+0000 7f51e8361740 1 --2- 172.21.15.123:0/17200244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 0x555929818b60 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009a60 tx=0x7f51d8003d30 comp rx=0 tx=0).stop 2024-08-18T22:11:57.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.295+0000 7f51e8361740 1 -- 172.21.15.123:0/17200244 shutdown_connections 2024-08-18T22:11:57.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.295+0000 7f51e8361740 1 --2- 172.21.15.123:0/17200244 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55592989e520 0x5559298a0910 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:57.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.295+0000 7f51e8361740 1 --2- 172.21.15.123:0/17200244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55592981f310 0x555929818b60 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:57.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.295+0000 7f51beffd640 0 client.16098 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:11:57.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.295+0000 7f51e8361740 1 --2- 172.21.15.123:0/17200244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555929814a50 0x55592982bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:57.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.295+0000 7f51e8361740 1 --2- 172.21.15.123:0/17200244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555929814130 0x55592982b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:57.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.295+0000 7f51e8361740 1 -- 172.21.15.123:0/17200244 >> 172.21.15.123:0/17200244 conn(0x5559298106c0 msgr2=0x55592981db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:57.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.295+0000 7f51e8361740 1 -- 172.21.15.123:0/17200244 shutdown_connections 2024-08-18T22:11:57.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.295+0000 7f51e8361740 1 -- 172.21.15.123:0/17200244 wait complete. 2024-08-18T22:11:57.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.295+0000 7f51e8361740 20 client.16098 trim_cache size 0 max 16384 2024-08-18T22:11:57.297 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:11:57.298 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 27, 2024-08-18T22:11:57.298 INFO:teuthology.orchestra.run.smithi123.stdout: "leader": 24466, 2024-08-18T22:11:57.298 INFO:teuthology.orchestra.run.smithi123.stdout: "set_version": 10, 2024-08-18T22:11:57.298 INFO:teuthology.orchestra.run.smithi123.stdout: "sets": { 2024-08-18T22:11:57.298 INFO:teuthology.orchestra.run.smithi123.stdout: "959c2d5d": { 2024-08-18T22:11:57.298 INFO:teuthology.orchestra.run.smithi123.stdout: "version": 10, 2024-08-18T22:11:57.298 INFO:teuthology.orchestra.run.smithi123.stdout: "age_ref": 0.0, 2024-08-18T22:11:57.298 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:11:57.298 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "QUIESCED", 2024-08-18T22:11:57.298 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:11:57.298 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:11:57.298 INFO:teuthology.orchestra.run.smithi123.stdout: "timeout": 90.0, 2024-08-18T22:11:57.298 INFO:teuthology.orchestra.run.smithi123.stdout: "expiration": 150.0, 2024-08-18T22:11:57.299 INFO:teuthology.orchestra.run.smithi123.stdout: "members": { 2024-08-18T22:11:57.299 INFO:teuthology.orchestra.run.smithi123.stdout: "file:/": { 2024-08-18T22:11:57.299 INFO:teuthology.orchestra.run.smithi123.stdout: "excluded": false, 2024-08-18T22:11:57.299 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:11:57.299 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "QUIESCED", 2024-08-18T22:11:57.299 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:11:57.299 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:57.299 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:57.299 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:57.299 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:57.299 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:11:57.299 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:11:57.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.296+0000 7f51e5f63640 1 -- 172.21.15.123:0/1159727333 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f51c80a2b80 msgr2=0x7f51c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:57.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.296+0000 7f51e5f63640 1 --2- 172.21.15.123:0/1159727333 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f51c80a2b80 0x7f51c80a5040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x555929811520 tx=0x7f51d0008040 comp rx=0 tx=0).stop 2024-08-18T22:11:57.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.296+0000 7f51e5f63640 1 -- 172.21.15.123:0/1159727333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e01022a0 msgr2=0x7f51e0199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:11:57.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.296+0000 7f51e5f63640 1 --2- 172.21.15.123:0/1159727333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e01022a0 0x7f51e0199620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f51d400e9f0 tx=0x7f51d400edf0 comp rx=0 tx=0).stop 2024-08-18T22:11:57.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.296+0000 7f51e5f63640 1 -- 172.21.15.123:0/1159727333 shutdown_connections 2024-08-18T22:11:57.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.296+0000 7f51e5f63640 1 --2- 172.21.15.123:0/1159727333 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f51c80a2b80 0x7f51c80a5040 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:57.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.296+0000 7f51e5f63640 1 --2- 172.21.15.123:0/1159727333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51e0102c20 0x7f51e01a4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:57.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.296+0000 7f51e5f63640 1 --2- 172.21.15.123:0/1159727333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e01022a0 0x7f51e0199620 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:57.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.296+0000 7f51e5f63640 1 --2- 172.21.15.123:0/1159727333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51e0100b50 0x7f51e01990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:11:57.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.296+0000 7f51e5f63640 1 -- 172.21.15.123:0/1159727333 >> 172.21.15.123:0/1159727333 conn(0x7f51e00fc500 msgr2=0x7f51e0106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:11:57.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.296+0000 7f51e5f63640 1 -- 172.21.15.123:0/1159727333 shutdown_connections 2024-08-18T22:11:57.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:11:57.296+0000 7f51e5f63640 1 -- 172.21.15.123:0/1159727333 wait complete. 2024-08-18T22:11:57.650 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:57 smithi123 ceph-mon[18462]: pgmap v465: 129 pgs: 129 active+clean; 26 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 812 op/s 2024-08-18T22:11:57.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:57 smithi183 ceph-mon[22097]: pgmap v465: 129 pgs: 129 active+clean; 26 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 812 op/s 2024-08-18T22:11:57.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:57 smithi130 ceph-mon[21698]: pgmap v465: 129 pgs: 129 active+clean; 26 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 812 op/s 2024-08-18T22:11:58.098 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '959c2d5d', quiesce took 19.4 seconds. Will release after: 10.600000000000001 2024-08-18T22:11:59.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:59 smithi183 ceph-mon[22097]: pgmap v466: 129 pgs: 129 active+clean; 14 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 1.19k op/s 2024-08-18T22:11:59.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:11:59 smithi183 ceph-mon[22097]: scrub summary: idle+waiting paths [/] 2024-08-18T22:11:59.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:59 smithi123 ceph-mon[18462]: pgmap v466: 129 pgs: 129 active+clean; 14 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 1.19k op/s 2024-08-18T22:11:59.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:11:59 smithi123 ceph-mon[18462]: scrub summary: idle+waiting paths [/] 2024-08-18T22:11:59.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:59 smithi130 ceph-mon[21698]: pgmap v466: 129 pgs: 129 active+clean; 14 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 1.19k op/s 2024-08-18T22:11:59.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:11:59 smithi130 ceph-mon[21698]: scrub summary: idle+waiting paths [/] 2024-08-18T22:12:01.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:01 smithi183 ceph-mon[22097]: pgmap v467: 129 pgs: 129 active+clean; 6.1 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.90k op/s 2024-08-18T22:12:01.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:01 smithi123 ceph-mon[18462]: pgmap v467: 129 pgs: 129 active+clean; 6.1 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.90k op/s 2024-08-18T22:12:01.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:01 smithi130 ceph-mon[21698]: pgmap v467: 129 pgs: 129 active+clean; 6.1 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.90k op/s 2024-08-18T22:12:03.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:03 smithi183 ceph-mon[22097]: pgmap v468: 129 pgs: 129 active+clean; 8.7 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 2.13k op/s 2024-08-18T22:12:03.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:03 smithi183 ceph-mon[22097]: scrub summary: idle 2024-08-18T22:12:03.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:03 smithi123 ceph-mon[18462]: pgmap v468: 129 pgs: 129 active+clean; 8.7 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 2.13k op/s 2024-08-18T22:12:03.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:03 smithi123 ceph-mon[18462]: scrub summary: idle 2024-08-18T22:12:03.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:03 smithi130 ceph-mon[21698]: pgmap v468: 129 pgs: 129 active+clean; 8.7 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 2.13k op/s 2024-08-18T22:12:03.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:03 smithi130 ceph-mon[21698]: scrub summary: idle 2024-08-18T22:12:05.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:05 smithi183 ceph-mon[22097]: pgmap v469: 129 pgs: 129 active+clean; 8.7 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 2.19k op/s 2024-08-18T22:12:05.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:05 smithi123 ceph-mon[18462]: pgmap v469: 129 pgs: 129 active+clean; 8.7 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 2.19k op/s 2024-08-18T22:12:05.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:05 smithi130 ceph-mon[21698]: pgmap v469: 129 pgs: 129 active+clean; 8.7 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 2.19k op/s 2024-08-18T22:12:07.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:07 smithi183 ceph-mon[22097]: pgmap v470: 129 pgs: 129 active+clean; 8.8 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 1.95k op/s 2024-08-18T22:12:07.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:07 smithi123 ceph-mon[18462]: pgmap v470: 129 pgs: 129 active+clean; 8.8 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 1.95k op/s 2024-08-18T22:12:07.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:07 smithi130 ceph-mon[21698]: pgmap v470: 129 pgs: 129 active+clean; 8.8 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 1.95k op/s 2024-08-18T22:12:08.700 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:12:08.965 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:12:09.024 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.022+0000 7f0824d93640 1 -- 172.21.15.123:0/1367201688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0820107550 msgr2=0x7f08201099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.022+0000 7f0824d93640 1 --2- 172.21.15.123:0/1367201688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0820107550 0x7f08201099c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0818009900 tx=0x7f081802a410 comp rx=0 tx=0).stop 2024-08-18T22:12:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.022+0000 7f0824d93640 1 -- 172.21.15.123:0/1367201688 shutdown_connections 2024-08-18T22:12:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.022+0000 7f0824d93640 1 --2- 172.21.15.123:0/1367201688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0820107550 0x7f08201099c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.022+0000 7f0824d93640 1 --2- 172.21.15.123:0/1367201688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0820104c20 0x7f0820107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.022+0000 7f0824d93640 1 --2- 172.21.15.123:0/1367201688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08201022f0 0x7f08201046e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.022+0000 7f0824d93640 1 -- 172.21.15.123:0/1367201688 >> 172.21.15.123:0/1367201688 conn(0x7f08200fbf10 msgr2=0x7f08200fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.022+0000 7f0824d93640 1 -- 172.21.15.123:0/1367201688 shutdown_connections 2024-08-18T22:12:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.022+0000 7f0824d93640 1 -- 172.21.15.123:0/1367201688 wait complete. 2024-08-18T22:12:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.023+0000 7f0824d93640 1 Processor -- start 2024-08-18T22:12:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.023+0000 7f0824d93640 1 -- start start 2024-08-18T22:12:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f0824d93640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08201022f0 0x7f0820197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f0824d93640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0820104c20 0x7f0820198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f0824d93640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0820107550 0x7f082019f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f0824d93640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f082010d590 con 0x7f0820104c20 2024-08-18T22:12:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f0824d93640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f082010d410 con 0x7f08201022f0 2024-08-18T22:12:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f0824d93640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f082010d710 con 0x7f0820107550 2024-08-18T22:12:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f081dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0820104c20 0x7f0820198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f081dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0820104c20 0x7f0820198120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49228/0 (socket says 172.21.15.123:49228) 2024-08-18T22:12:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f081dd9b640 1 -- 172.21.15.123:0/3029627140 learned_addr learned my addr 172.21.15.123:0/3029627140 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f081ed9d640 1 --2- 172.21.15.123:0/3029627140 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0820107550 0x7f082019f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f081e59c640 1 --2- 172.21.15.123:0/3029627140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08201022f0 0x7f0820197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f081dd9b640 1 -- 172.21.15.123:0/3029627140 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0820107550 msgr2=0x7f082019f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f081dd9b640 1 --2- 172.21.15.123:0/3029627140 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0820107550 0x7f082019f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f081dd9b640 1 -- 172.21.15.123:0/3029627140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08201022f0 msgr2=0x7f0820197be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f081dd9b640 1 --2- 172.21.15.123:0/3029627140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08201022f0 0x7f0820197be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f081dd9b640 1 -- 172.21.15.123:0/3029627140 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f082019f800 con 0x7f0820104c20 2024-08-18T22:12:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f081dd9b640 1 --2- 172.21.15.123:0/3029627140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0820104c20 0x7f0820198120 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f081400c970 tx=0x7f081400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f080f7fe640 1 -- 172.21.15.123:0/3029627140 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814007bb0 con 0x7f0820104c20 2024-08-18T22:12:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f0824d93640 1 -- 172.21.15.123:0/3029627140 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f082019faf0 con 0x7f0820104c20 2024-08-18T22:12:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f080f7fe640 1 -- 172.21.15.123:0/3029627140 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0814007d50 con 0x7f0820104c20 2024-08-18T22:12:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.024+0000 7f080f7fe640 1 -- 172.21.15.123:0/3029627140 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081400f450 con 0x7f0820104c20 2024-08-18T22:12:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.025+0000 7f0824d93640 1 -- 172.21.15.123:0/3029627140 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08201a0040 con 0x7f0820104c20 2024-08-18T22:12:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.027+0000 7f080f7fe640 1 -- 172.21.15.123:0/3029627140 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f0814004f90 con 0x7f0820104c20 2024-08-18T22:12:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.027+0000 7f0827c2b740 1 Processor -- start 2024-08-18T22:12:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.027+0000 7f0827c2b740 1 -- start start 2024-08-18T22:12:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f0827c2b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd96680 0x5568dcd96a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f0827c2b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96fc0 0x5568dcd9ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f0827c2b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd9c050 0x5568dcd9e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f0827c2b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5568dccf99d0 con 0x5568dcd9c050 2024-08-18T22:12:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f0827c2b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5568dcca1820 con 0x5568dcd96fc0 2024-08-18T22:12:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f0827c2b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5568dccf5990 con 0x5568dcd96680 2024-08-18T22:12:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f081dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd9c050 0x5568dcd9e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f081dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd9c050 0x5568dcd9e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49232/0 (socket says 172.21.15.123:49232) 2024-08-18T22:12:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f081dd9b640 1 -- 172.21.15.123:0/4074423917 learned_addr learned my addr 172.21.15.123:0/4074423917 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f080f7fe640 1 --2- 172.21.15.123:0/3029627140 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f08080a2c30 0x7f08080a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f081e59c640 1 --2- 172.21.15.123:0/4074423917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96fc0 0x5568dcd9ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f081ed9d640 1 --2- 172.21.15.123:0/4074423917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd96680 0x5568dcd96a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f081ed9d640 1 --2- 172.21.15.123:0/3029627140 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f08080a2c30 0x7f08080a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f080f7fe640 1 -- 172.21.15.123:0/3029627140 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f08140cf0f0 con 0x7f0820104c20 2024-08-18T22:12:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f081dd9b640 1 -- 172.21.15.123:0/4074423917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd96680 msgr2=0x5568dcd96a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f081dd9b640 1 --2- 172.21.15.123:0/4074423917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd96680 0x5568dcd96a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f081dd9b640 1 -- 172.21.15.123:0/4074423917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96fc0 msgr2=0x5568dcd9ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f081dd9b640 1 --2- 172.21.15.123:0/4074423917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96fc0 0x5568dcd9ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f081dd9b640 1 -- 172.21.15.123:0/4074423917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568dca0d210 con 0x5568dcd9c050 2024-08-18T22:12:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f081ed9d640 1 --2- 172.21.15.123:0/4074423917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd96680 0x5568dcd96a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.028+0000 7f081dd9b640 1 --2- 172.21.15.123:0/4074423917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd9c050 0x5568dcd9e510 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f081409b550 tx=0x7f08140049b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b41c3e1a83fb35a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.029+0000 7f080cff9640 1 -- 172.21.15.123:0/4074423917 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081401d030 con 0x5568dcd9c050 2024-08-18T22:12:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.029+0000 7f081ed9d640 1 --2- 172.21.15.123:0/3029627140 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f08080a2c30 0x7f08080a50f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0818005ab0 tx=0x7f08180315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.029+0000 7f080cff9640 1 -- 172.21.15.123:0/4074423917 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0814097040 con 0x5568dcd9c050 2024-08-18T22:12:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.029+0000 7f080cff9640 1 -- 172.21.15.123:0/4074423917 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814097c80 con 0x5568dcd9c050 2024-08-18T22:12:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.029+0000 7f0827c2b740 1 -- 172.21.15.123:0/4074423917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd9c050 msgr2=0x5568dcd9e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.029+0000 7f0827c2b740 1 --2- 172.21.15.123:0/4074423917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd9c050 0x5568dcd9e510 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f081409b550 tx=0x7f08140049b0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.029+0000 7f0827c2b740 1 -- 172.21.15.123:0/4074423917 shutdown_connections 2024-08-18T22:12:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.029+0000 7f0827c2b740 1 --2- 172.21.15.123:0/4074423917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd9c050 0x5568dcd9e510 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.029+0000 7f0827c2b740 1 --2- 172.21.15.123:0/4074423917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96fc0 0x5568dcd9ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.029+0000 7f0827c2b740 1 --2- 172.21.15.123:0/4074423917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd96680 0x5568dcd96a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.029+0000 7f0827c2b740 1 -- 172.21.15.123:0/4074423917 >> 172.21.15.123:0/4074423917 conn(0x5568dcd91cf0 msgr2=0x5568dcd920f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.029+0000 7f0827c2b740 1 -- 172.21.15.123:0/4074423917 shutdown_connections 2024-08-18T22:12:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.029+0000 7f0827c2b740 1 -- 172.21.15.123:0/4074423917 wait complete. 2024-08-18T22:12:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f0827c2b740 1 -- start start 2024-08-18T22:12:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f0827c2b740 1 Processor -- start 2024-08-18T22:12:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f0827c2b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96680 0x5568dcda0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f0827c2b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96fc0 0x5568dcda0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f0827c2b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd9c050 0x5568dcda7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f0827c2b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5568dcd9efc0 con 0x5568dcd96680 2024-08-18T22:12:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f0827c2b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5568dccb5520 con 0x5568dcd96fc0 2024-08-18T22:12:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f0827c2b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5568dcd9f140 con 0x5568dcd9c050 2024-08-18T22:12:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f0827c2b740 10 client.0 _ll_register_callbacks cb 0x5568dca0ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f081e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96680 0x5568dcda0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f081e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96680 0x5568dcda0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49244/0 (socket says 172.21.15.123:49244) 2024-08-18T22:12:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f081e59c640 1 -- 172.21.15.123:0/541758107 learned_addr learned my addr 172.21.15.123:0/541758107 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f081ed9d640 1 --2- 172.21.15.123:0/541758107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd9c050 0x5568dcda7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f081e59c640 1 -- 172.21.15.123:0/541758107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd9c050 msgr2=0x5568dcda7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f081dd9b640 1 --2- 172.21.15.123:0/541758107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96fc0 0x5568dcda0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f081e59c640 1 --2- 172.21.15.123:0/541758107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd9c050 0x5568dcda7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f081e59c640 1 -- 172.21.15.123:0/541758107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96fc0 msgr2=0x5568dcda0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f081e59c640 1 --2- 172.21.15.123:0/541758107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96fc0 0x5568dcda0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f081e59c640 1 -- 172.21.15.123:0/541758107 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568dcad9620 con 0x5568dcd96680 2024-08-18T22:12:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.030+0000 7f081dd9b640 1 --2- 172.21.15.123:0/541758107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96fc0 0x5568dcda0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:12:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f081e59c640 1 --2- 172.21.15.123:0/541758107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96680 0x5568dcda0840 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f081000ab30 tx=0x7f08100111b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c67751ac6d51a01 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f0805ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f0805ffb640 1 -- 172.21.15.123:0/541758107 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081001a070 con 0x5568dcd96680 2024-08-18T22:12:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f0805ffb640 1 -- 172.21.15.123:0/541758107 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0810011df0 con 0x5568dcd96680 2024-08-18T22:12:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f0827c2b740 1 -- 172.21.15.123:0/541758107 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0814097040 con 0x5568dcd96680 2024-08-18T22:12:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f0805ffb640 1 -- 172.21.15.123:0/541758107 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0810026050 con 0x5568dcd96680 2024-08-18T22:12:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f0827c2b740 10 client.16161 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f0827c2b740 1 -- 172.21.15.123:0/541758107 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5568dcdaac60 con 0x5568dcd96680 2024-08-18T22:12:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f0805ffb640 1 -- 172.21.15.123:0/541758107 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0814097040 con 0x5568dcd96680 2024-08-18T22:12:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f0805ffb640 1 -- 172.21.15.123:0/541758107 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f081001e780 con 0x5568dcd96680 2024-08-18T22:12:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f0827c2b740 10 client.16161 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f0827c2b740 10 client.16161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f0827c2b740 20 client.16161 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f0827c2b740 1 --2- 172.21.15.123:0/541758107 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5568dcdac350 0x5568dcdae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f0827c2b740 4 client.16161 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:12:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.031+0000 7f0827c2b740 1 -- 172.21.15.123:0/541758107 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568dcd07100 con 0x5568dcdac350 2024-08-18T22:12:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.032+0000 7f081dd9b640 1 --2- 172.21.15.123:0/541758107 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5568dcdac350 0x5568dcdae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.032+0000 7f081dd9b640 1 --2- 172.21.15.123:0/541758107 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5568dcdac350 0x5568dcdae7f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31f41e56dc1800b0 server_cookie=ff82d5104edce07f in_seq=0 out_seq=0 2024-08-18T22:12:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.032+0000 7f0805ffb640 10 client.16161 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.033+0000 7f0805ffb640 1 -- 172.21.15.123:0/541758107 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568dcd07100 con 0x5568dcdac350 2024-08-18T22:12:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.033+0000 7f0805ffb640 10 client.16161 handle_command_reply: tid=0 2024-08-18T22:12:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.033+0000 7f0827c2b740 1 client.16161 shutdown 2024-08-18T22:12:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.033+0000 7f0827c2b740 1 -- 172.21.15.123:0/541758107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96680 msgr2=0x5568dcda0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.033+0000 7f0827c2b740 1 --2- 172.21.15.123:0/541758107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96680 0x5568dcda0840 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f081000ab30 tx=0x7f08100111b0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.033+0000 7f0827c2b740 1 -- 172.21.15.123:0/541758107 shutdown_connections 2024-08-18T22:12:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.033+0000 7f0827c2b740 1 --2- 172.21.15.123:0/541758107 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5568dcdac350 0x5568dcdae7f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.033+0000 7f0827c2b740 1 --2- 172.21.15.123:0/541758107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd9c050 0x5568dcda7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.033+0000 7f0827c2b740 1 --2- 172.21.15.123:0/541758107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96fc0 0x5568dcda0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.033+0000 7f0827c2b740 1 --2- 172.21.15.123:0/541758107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96680 0x5568dcda0840 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.043 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.033+0000 7f0805ffb640 0 client.16161 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:09.043 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.033+0000 7f0827c2b740 1 -- 172.21.15.123:0/541758107 >> 172.21.15.123:0/541758107 conn(0x5568dcd91cf0 msgr2=0x5568dcd93500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:09.043 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.033+0000 7f0827c2b740 1 -- 172.21.15.123:0/541758107 shutdown_connections 2024-08-18T22:12:09.043 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.033+0000 7f0827c2b740 1 -- 172.21.15.123:0/541758107 wait complete. 2024-08-18T22:12:09.043 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.033+0000 7f0827c2b740 20 client.16161 trim_cache size 0 max 16384 2024-08-18T22:12:09.053 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.047+0000 7f0827c2b740 1 Processor -- start 2024-08-18T22:12:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.047+0000 7f0827c2b740 1 -- start start 2024-08-18T22:12:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.047+0000 7f0827c2b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96680 0x5568dcda0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.047+0000 7f0827c2b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96fc0 0x5568dcd91150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.047+0000 7f0827c2b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd9c050 0x5568dcda7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.047+0000 7f0827c2b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f08201ace70 con 0x5568dcd96fc0 2024-08-18T22:12:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.047+0000 7f0827c2b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f08201aa740 con 0x5568dcd96680 2024-08-18T22:12:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.047+0000 7f0827c2b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f08201a8590 con 0x5568dcd9c050 2024-08-18T22:12:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.048+0000 7f081dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96fc0 0x5568dcd91150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.048+0000 7f081dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96fc0 0x5568dcd91150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49252/0 (socket says 172.21.15.123:49252) 2024-08-18T22:12:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.048+0000 7f081dd9b640 1 -- 172.21.15.123:0/2605927773 learned_addr learned my addr 172.21.15.123:0/2605927773 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.048+0000 7f081dd9b640 1 -- 172.21.15.123:0/2605927773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd9c050 msgr2=0x5568dcda7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:09.055 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.048+0000 7f081dd9b640 1 --2- 172.21.15.123:0/2605927773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd9c050 0x5568dcda7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.055 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.048+0000 7f081dd9b640 1 -- 172.21.15.123:0/2605927773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96680 msgr2=0x5568dcda0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:09.055 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.048+0000 7f081dd9b640 1 --2- 172.21.15.123:0/2605927773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96680 0x5568dcda0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.055 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.048+0000 7f081dd9b640 1 -- 172.21.15.123:0/2605927773 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568dcd91b10 con 0x5568dcd96fc0 2024-08-18T22:12:09.055 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.048+0000 7f081dd9b640 1 --2- 172.21.15.123:0/2605927773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96fc0 0x5568dcd91150 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f08140861d0 tx=0x7f0814095fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df7771dcb7f3640 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:09.055 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.048+0000 7f0807fff640 1 -- 172.21.15.123:0/2605927773 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081401d040 con 0x5568dcd96fc0 2024-08-18T22:12:09.055 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.048+0000 7f0807fff640 1 -- 172.21.15.123:0/2605927773 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0814097040 con 0x5568dcd96fc0 2024-08-18T22:12:09.055 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.048+0000 7f0807fff640 1 -- 172.21.15.123:0/2605927773 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814097e10 con 0x5568dcd96fc0 2024-08-18T22:12:09.055 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 -- 172.21.15.123:0/2605927773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96fc0 msgr2=0x5568dcd91150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:09.055 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 --2- 172.21.15.123:0/2605927773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96fc0 0x5568dcd91150 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f08140861d0 tx=0x7f0814095fd0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.055 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 -- 172.21.15.123:0/2605927773 shutdown_connections 2024-08-18T22:12:09.055 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 --2- 172.21.15.123:0/2605927773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd9c050 0x5568dcda7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.055 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 --2- 172.21.15.123:0/2605927773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96fc0 0x5568dcd91150 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.055 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 --2- 172.21.15.123:0/2605927773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96680 0x5568dcda0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 -- 172.21.15.123:0/2605927773 >> 172.21.15.123:0/2605927773 conn(0x5568dcd91cf0 msgr2=0x5568dcda0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 -- 172.21.15.123:0/2605927773 shutdown_connections 2024-08-18T22:12:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 -- 172.21.15.123:0/2605927773 wait complete. 2024-08-18T22:12:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 -- start start 2024-08-18T22:12:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 Processor -- start 2024-08-18T22:12:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96680 0x5568dcda54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96fc0 0x5568dcda5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd9c050 0x5568dcda6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f08201a8c00 con 0x5568dcd96fc0 2024-08-18T22:12:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f08201aa070 con 0x5568dcd96680 2024-08-18T22:12:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f08201a92d0 con 0x5568dcd9c050 2024-08-18T22:12:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f0827c2b740 10 client.0 _ll_register_callbacks cb 0x7f0810009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f081dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96fc0 0x5568dcda5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f081dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96fc0 0x5568dcda5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49262/0 (socket says 172.21.15.123:49262) 2024-08-18T22:12:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f081dd9b640 1 -- 172.21.15.123:0/2578205686 learned_addr learned my addr 172.21.15.123:0/2578205686 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f081ed9d640 1 --2- 172.21.15.123:0/2578205686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd9c050 0x5568dcda6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.049+0000 7f081e59c640 1 --2- 172.21.15.123:0/2578205686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96680 0x5568dcda54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f081dd9b640 1 -- 172.21.15.123:0/2578205686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd9c050 msgr2=0x5568dcda6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f081dd9b640 1 --2- 172.21.15.123:0/2578205686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd9c050 0x5568dcda6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f081dd9b640 1 -- 172.21.15.123:0/2578205686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96680 msgr2=0x5568dcda54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f081dd9b640 1 --2- 172.21.15.123:0/2578205686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96680 0x5568dcda54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f081dd9b640 1 -- 172.21.15.123:0/2578205686 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568dcda7030 con 0x5568dcd96fc0 2024-08-18T22:12:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f081ed9d640 1 --2- 172.21.15.123:0/2578205686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd9c050 0x5568dcda6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f081e59c640 1 --2- 172.21.15.123:0/2578205686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96680 0x5568dcda54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f081dd9b640 1 --2- 172.21.15.123:0/2578205686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96fc0 0x5568dcda5a10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0814004960 tx=0x7f08140a42b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2730cff1515a50 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f0805ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f0805ffb640 1 -- 172.21.15.123:0/2578205686 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814097df0 con 0x5568dcd96fc0 2024-08-18T22:12:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f0805ffb640 1 -- 172.21.15.123:0/2578205686 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0814005280 con 0x5568dcd96fc0 2024-08-18T22:12:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f0827c2b740 1 -- 172.21.15.123:0/2578205686 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0814097040 con 0x5568dcd96fc0 2024-08-18T22:12:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f0805ffb640 1 -- 172.21.15.123:0/2578205686 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0814084ba0 con 0x5568dcd96fc0 2024-08-18T22:12:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f0827c2b740 10 client.16167 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f0827c2b740 1 -- 172.21.15.123:0/2578205686 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5568dce17220 con 0x5568dcd96fc0 2024-08-18T22:12:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f0805ffb640 1 -- 172.21.15.123:0/2578205686 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0814097040 con 0x5568dcd96fc0 2024-08-18T22:12:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f0805ffb640 1 -- 172.21.15.123:0/2578205686 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f08140b4200 con 0x5568dcd96fc0 2024-08-18T22:12:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f0827c2b740 10 client.16167 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f0827c2b740 10 client.16167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f0827c2b740 20 client.16167 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f0827c2b740 1 --2- 172.21.15.123:0/2578205686 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5568dce17720 0x5568dce19b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f0827c2b740 4 client.16167 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:12:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.050+0000 7f0827c2b740 1 -- 172.21.15.123:0/2578205686 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5568dcd01450 con 0x5568dce17720 2024-08-18T22:12:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.051+0000 7f081e59c640 1 --2- 172.21.15.123:0/2578205686 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5568dce17720 0x5568dce19b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.051+0000 7f081e59c640 1 --2- 172.21.15.123:0/2578205686 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5568dce17720 0x5568dce19b10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e968dffc2312828 server_cookie=50dc2d8b0af4a4b8 in_seq=0 out_seq=0 2024-08-18T22:12:09.059 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.051+0000 7f0805ffb640 10 client.16167 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:09.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.240+0000 7f0805ffb640 1 -- 172.21.15.123:0/2578205686 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5568dcd01450 con 0x5568dce17720 2024-08-18T22:12:09.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.240+0000 7f0805ffb640 10 client.16167 handle_command_reply: tid=0 2024-08-18T22:12:09.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.240+0000 7f0827c2b740 1 client.16167 shutdown 2024-08-18T22:12:09.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0827c2b740 1 -- 172.21.15.123:0/2578205686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96fc0 msgr2=0x5568dcda5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:09.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0827c2b740 1 --2- 172.21.15.123:0/2578205686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96fc0 0x5568dcda5a10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0814004960 tx=0x7f08140a42b0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0827c2b740 1 -- 172.21.15.123:0/2578205686 shutdown_connections 2024-08-18T22:12:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0827c2b740 1 --2- 172.21.15.123:0/2578205686 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5568dce17720 0x5568dce19b10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0805ffb640 0 client.16167 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0827c2b740 1 --2- 172.21.15.123:0/2578205686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568dcd9c050 0x5568dcda6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0827c2b740 1 --2- 172.21.15.123:0/2578205686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568dcd96fc0 0x5568dcda5a10 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0827c2b740 1 --2- 172.21.15.123:0/2578205686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5568dcd96680 0x5568dcda54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0827c2b740 1 -- 172.21.15.123:0/2578205686 >> 172.21.15.123:0/2578205686 conn(0x5568dcd91cf0 msgr2=0x5568dcd920d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0827c2b740 1 -- 172.21.15.123:0/2578205686 shutdown_connections 2024-08-18T22:12:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0827c2b740 1 -- 172.21.15.123:0/2578205686 wait complete. 2024-08-18T22:12:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0827c2b740 20 client.16167 trim_cache size 0 max 16384 2024-08-18T22:12:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:12:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:12:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:12:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:12:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0824d93640 1 -- 172.21.15.123:0/3029627140 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f08080a2c30 msgr2=0x7f08080a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0824d93640 1 --2- 172.21.15.123:0/3029627140 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f08080a2c30 0x7f08080a50f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0818005ab0 tx=0x7f08180315b0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0824d93640 1 -- 172.21.15.123:0/3029627140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0820104c20 msgr2=0x7f0820198120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0824d93640 1 --2- 172.21.15.123:0/3029627140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0820104c20 0x7f0820198120 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f081400c970 tx=0x7f081400ce30 comp rx=0 tx=0).stop 2024-08-18T22:12:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.241+0000 7f0824d93640 1 -- 172.21.15.123:0/3029627140 shutdown_connections 2024-08-18T22:12:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.242+0000 7f0824d93640 1 --2- 172.21.15.123:0/3029627140 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0820107550 0x7f082019f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.242+0000 7f0824d93640 1 --2- 172.21.15.123:0/3029627140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0820104c20 0x7f0820198120 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.242+0000 7f0824d93640 1 --2- 172.21.15.123:0/3029627140 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f08080a2c30 0x7f08080a50f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.242+0000 7f0824d93640 1 --2- 172.21.15.123:0/3029627140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08201022f0 0x7f0820197be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.242+0000 7f0824d93640 1 -- 172.21.15.123:0/3029627140 >> 172.21.15.123:0/3029627140 conn(0x7f08200fbf10 msgr2=0x7f0820102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.242+0000 7f0824d93640 1 -- 172.21.15.123:0/3029627140 shutdown_connections 2024-08-18T22:12:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:09.242+0000 7f0824d93640 1 -- 172.21.15.123:0/3029627140 wait complete. 2024-08-18T22:12:09.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.451+0000 7f335c8fa640 1 -- 172.21.15.123:0/2206032027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358102c20 msgr2=0x7f335810d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:09.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.451+0000 7f335c8fa640 1 --2- 172.21.15.123:0/2206032027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358102c20 0x7f335810d770 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3350009ca0 tx=0x7f335002a950 comp rx=0 tx=0).stop 2024-08-18T22:12:09.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.451+0000 7f335c8fa640 1 -- 172.21.15.123:0/2206032027 shutdown_connections 2024-08-18T22:12:09.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.451+0000 7f335c8fa640 1 --2- 172.21.15.123:0/2206032027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358102c20 0x7f335810d770 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.451+0000 7f335c8fa640 1 --2- 172.21.15.123:0/2206032027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33581022a0 0x7f33581026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.451+0000 7f335c8fa640 1 --2- 172.21.15.123:0/2206032027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3358100b50 0x7f3358100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.451+0000 7f335c8fa640 1 -- 172.21.15.123:0/2206032027 >> 172.21.15.123:0/2206032027 conn(0x7f33580fc500 msgr2=0x7f33580fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:09.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.451+0000 7f335c8fa640 1 -- 172.21.15.123:0/2206032027 shutdown_connections 2024-08-18T22:12:09.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.451+0000 7f335c8fa640 1 -- 172.21.15.123:0/2206032027 wait complete. 2024-08-18T22:12:09.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.451+0000 7f335c8fa640 1 Processor -- start 2024-08-18T22:12:09.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335c8fa640 1 -- start start 2024-08-18T22:12:09.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335c8fa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358100b50 0x7f3358199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335c8fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33581022a0 0x7f3358199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335c8fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3358102c20 0x7f33581a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335c8fa640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3358110cb0 con 0x7f3358100b50 2024-08-18T22:12:09.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335c8fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3358110b30 con 0x7f33581022a0 2024-08-18T22:12:09.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335c8fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3358110e30 con 0x7f3358102c20 2024-08-18T22:12:09.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358100b50 0x7f3358199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358100b50 0x7f3358199020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49280/0 (socket says 172.21.15.123:49280) 2024-08-18T22:12:09.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335659c640 1 -- 172.21.15.123:0/2148053394 learned_addr learned my addr 172.21.15.123:0/2148053394 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:09.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f3356d9d640 1 --2- 172.21.15.123:0/2148053394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3358102c20 0x7f33581a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f334dd9b640 1 --2- 172.21.15.123:0/2148053394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33581022a0 0x7f3358199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335659c640 1 -- 172.21.15.123:0/2148053394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3358102c20 msgr2=0x7f33581a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:09.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335659c640 1 --2- 172.21.15.123:0/2148053394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3358102c20 0x7f33581a40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335659c640 1 -- 172.21.15.123:0/2148053394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33581022a0 msgr2=0x7f3358199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:09.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335659c640 1 --2- 172.21.15.123:0/2148053394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33581022a0 0x7f3358199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335659c640 1 -- 172.21.15.123:0/2148053394 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33581a45e0 con 0x7f3358100b50 2024-08-18T22:12:09.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f334dd9b640 1 --2- 172.21.15.123:0/2148053394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33581022a0 0x7f3358199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:09.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.452+0000 7f335659c640 1 --2- 172.21.15.123:0/2148053394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358100b50 0x7f3358199020 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f334800d950 tx=0x7f334800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:09.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.453+0000 7f334ffff640 1 -- 172.21.15.123:0/2148053394 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3348017070 con 0x7f3358100b50 2024-08-18T22:12:09.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.453+0000 7f334ffff640 1 -- 172.21.15.123:0/2148053394 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3348009c30 con 0x7f3358100b50 2024-08-18T22:12:09.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.453+0000 7f335c8fa640 1 -- 172.21.15.123:0/2148053394 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33581a47b0 con 0x7f3358100b50 2024-08-18T22:12:09.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.453+0000 7f334ffff640 1 -- 172.21.15.123:0/2148053394 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334800f6b0 con 0x7f3358100b50 2024-08-18T22:12:09.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.453+0000 7f335c8fa640 1 -- 172.21.15.123:0/2148053394 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33581a4cc0 con 0x7f3358100b50 2024-08-18T22:12:09.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.454+0000 7f335c8fa640 1 -- 172.21.15.123:0/2148053394 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3358100f30 con 0x7f3358100b50 2024-08-18T22:12:09.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.455+0000 7f334ffff640 1 -- 172.21.15.123:0/2148053394 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f33480109d0 con 0x7f3358100b50 2024-08-18T22:12:09.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.456+0000 7f334ffff640 1 --2- 172.21.15.123:0/2148053394 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f33440a2b80 0x7f33440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:09.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.456+0000 7f334dd9b640 1 --2- 172.21.15.123:0/2148053394 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f33440a2b80 0x7f33440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:09.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.456+0000 7f334ffff640 1 -- 172.21.15.123:0/2148053394 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f33480cf060 con 0x7f3358100b50 2024-08-18T22:12:09.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.456+0000 7f334dd9b640 1 --2- 172.21.15.123:0/2148053394 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f33440a2b80 0x7f33440a5040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f335806a7f0 tx=0x7f3340005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:09.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.460+0000 7f334ffff640 1 -- 172.21.15.123:0/2148053394 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3348009de0 con 0x7f3358100b50 2024-08-18T22:12:09.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:09 smithi183 ceph-mon[22097]: pgmap v471: 129 pgs: 129 active+clean; 8.8 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 935 KiB/s wr, 1.67k op/s 2024-08-18T22:12:09.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.659+0000 7f335c8fa640 1 -- 172.21.15.123:0/2148053394 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33581a4f20 con 0x7f3358100b50 2024-08-18T22:12:09.661 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:09 smithi123 ceph-mon[18462]: pgmap v471: 129 pgs: 129 active+clean; 8.8 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 935 KiB/s wr, 1.67k op/s 2024-08-18T22:12:09.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.660+0000 7f334ffff640 1 -- 172.21.15.123:0/2148053394 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f334809bc30 con 0x7f3358100b50 2024-08-18T22:12:09.663 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:12:09.663 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":27,"btime":"2024-08-18T22:11:43:088943+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:11:42.650261+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24448,24458,24466]},"id":1}]} 2024-08-18T22:12:09.663 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 27 2024-08-18T22:12:09.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.662+0000 7f335c8fa640 1 -- 172.21.15.123:0/2148053394 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f33440a2b80 msgr2=0x7f33440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:09.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.662+0000 7f335c8fa640 1 --2- 172.21.15.123:0/2148053394 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f33440a2b80 0x7f33440a5040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f335806a7f0 tx=0x7f3340005f90 comp rx=0 tx=0).stop 2024-08-18T22:12:09.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.662+0000 7f335c8fa640 1 -- 172.21.15.123:0/2148053394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358100b50 msgr2=0x7f3358199020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:09.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.662+0000 7f335c8fa640 1 --2- 172.21.15.123:0/2148053394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358100b50 0x7f3358199020 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f334800d950 tx=0x7f334800de10 comp rx=0 tx=0).stop 2024-08-18T22:12:09.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.662+0000 7f335c8fa640 1 -- 172.21.15.123:0/2148053394 shutdown_connections 2024-08-18T22:12:09.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.662+0000 7f335c8fa640 1 --2- 172.21.15.123:0/2148053394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3358102c20 0x7f33581a40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.662+0000 7f335c8fa640 1 --2- 172.21.15.123:0/2148053394 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f33440a2b80 0x7f33440a5040 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.662+0000 7f335c8fa640 1 --2- 172.21.15.123:0/2148053394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33581022a0 0x7f3358199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.662+0000 7f335c8fa640 1 --2- 172.21.15.123:0/2148053394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358100b50 0x7f3358199020 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:09.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.663+0000 7f335c8fa640 1 -- 172.21.15.123:0/2148053394 >> 172.21.15.123:0/2148053394 conn(0x7f33580fc500 msgr2=0x7f3358106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:09.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.663+0000 7f335c8fa640 1 -- 172.21.15.123:0/2148053394 shutdown_connections 2024-08-18T22:12:09.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:09.663+0000 7f335c8fa640 1 -- 172.21.15.123:0/2148053394 wait complete. 2024-08-18T22:12:09.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:09 smithi130 ceph-mon[21698]: pgmap v471: 129 pgs: 129 active+clean; 8.8 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 935 KiB/s wr, 1.67k op/s 2024-08-18T22:12:10.473 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db --set-id 959c2d5d --release --await' 2024-08-18T22:12:10.473 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24466 quiesce db --set-id 959c2d5d --release --await 2024-08-18T22:12:10.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:10 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2148053394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:12:10.723 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:12:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:10 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2148053394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:12:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:10 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2148053394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:12:11.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.199+0000 7f34db7e0640 1 -- 172.21.15.123:0/3889290136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d41018c0 msgr2=0x7f34d4101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:11.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.199+0000 7f34db7e0640 1 --2- 172.21.15.123:0/3889290136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d41018c0 0x7f34d4101d20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009930 tx=0x7f34c402a420 comp rx=0 tx=0).stop 2024-08-18T22:12:11.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.200+0000 7f34db7e0640 1 -- 172.21.15.123:0/3889290136 shutdown_connections 2024-08-18T22:12:11.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.200+0000 7f34db7e0640 1 --2- 172.21.15.123:0/3889290136 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34d4102260 0x7f34d410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.200+0000 7f34db7e0640 1 --2- 172.21.15.123:0/3889290136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d41018c0 0x7f34d4101d20 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.200+0000 7f34db7e0640 1 --2- 172.21.15.123:0/3889290136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34d41078c0 0x7f34d4107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.200+0000 7f34db7e0640 1 -- 172.21.15.123:0/3889290136 >> 172.21.15.123:0/3889290136 conn(0x7f34d40fd620 msgr2=0x7f34d40ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.200+0000 7f34db7e0640 1 -- 172.21.15.123:0/3889290136 shutdown_connections 2024-08-18T22:12:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.200+0000 7f34db7e0640 1 -- 172.21.15.123:0/3889290136 wait complete. 2024-08-18T22:12:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.200+0000 7f34db7e0640 1 Processor -- start 2024-08-18T22:12:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.200+0000 7f34db7e0640 1 -- start start 2024-08-18T22:12:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.200+0000 7f34db7e0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34d41018c0 0x7f34d4074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.200+0000 7f34db7e0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d4102260 0x7f34d4074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34db7e0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34d41078c0 0x7f34d4074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34db7e0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f34d4111cc0 con 0x7f34d4102260 2024-08-18T22:12:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34db7e0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34d4111b40 con 0x7f34d41018c0 2024-08-18T22:12:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34db7e0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f34d4111e40 con 0x7f34d41078c0 2024-08-18T22:12:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34d8d7b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d4102260 0x7f34d4074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34d8d7b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d4102260 0x7f34d4074760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49306/0 (socket says 172.21.15.123:49306) 2024-08-18T22:12:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34d8d7b640 1 -- 172.21.15.123:0/3267931645 learned_addr learned my addr 172.21.15.123:0/3267931645 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34d957c640 1 --2- 172.21.15.123:0/3267931645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34d41018c0 0x7f34d4074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34d9d7d640 1 --2- 172.21.15.123:0/3267931645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34d41078c0 0x7f34d4074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34d8d7b640 1 -- 172.21.15.123:0/3267931645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34d41078c0 msgr2=0x7f34d4074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34d8d7b640 1 --2- 172.21.15.123:0/3267931645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34d41078c0 0x7f34d4074ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34d8d7b640 1 -- 172.21.15.123:0/3267931645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34d41018c0 msgr2=0x7f34d4074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34d8d7b640 1 --2- 172.21.15.123:0/3267931645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34d41018c0 0x7f34d4074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34d8d7b640 1 -- 172.21.15.123:0/3267931645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d41a66c0 con 0x7f34d4102260 2024-08-18T22:12:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34d9d7d640 1 --2- 172.21.15.123:0/3267931645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34d41078c0 0x7f34d4074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:12:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34d8d7b640 1 --2- 172.21.15.123:0/3267931645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d4102260 0x7f34d4074760 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009230 tx=0x7f34c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34ca7fc640 1 -- 172.21.15.123:0/3267931645 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c403f030 con 0x7f34d4102260 2024-08-18T22:12:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34ca7fc640 1 -- 172.21.15.123:0/3267931645 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34c4003ad0 con 0x7f34d4102260 2024-08-18T22:12:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34db7e0640 1 -- 172.21.15.123:0/3267931645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d41a6950 con 0x7f34d4102260 2024-08-18T22:12:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34ca7fc640 1 -- 172.21.15.123:0/3267931645 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4035070 con 0x7f34d4102260 2024-08-18T22:12:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.201+0000 7f34db7e0640 1 -- 172.21.15.123:0/3267931645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d41a6e80 con 0x7f34d4102260 2024-08-18T22:12:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.203+0000 7f34ca7fc640 1 -- 172.21.15.123:0/3267931645 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f34c4042030 con 0x7f34d4102260 2024-08-18T22:12:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.204+0000 7f34ddbde740 1 Processor -- start 2024-08-18T22:12:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.204+0000 7f34ddbde740 1 -- start start 2024-08-18T22:12:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.204+0000 7f34ddbde740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b556990 0x55b76b556d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.204+0000 7f34ddbde740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b5572b0 0x55b76b561630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.204+0000 7f34ddbde740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b561b70 0x55b76b563f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.204+0000 7f34ddbde740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b76b4bcc60 con 0x55b76b556990 2024-08-18T22:12:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.204+0000 7f34ddbde740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b76b454b90 con 0x55b76b561b70 2024-08-18T22:12:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.204+0000 7f34ddbde740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b76b4b8c20 con 0x55b76b5572b0 2024-08-18T22:12:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.204+0000 7f34d9d7d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b556990 0x55b76b556d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.204+0000 7f34d9d7d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b556990 0x55b76b556d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49322/0 (socket says 172.21.15.123:49322) 2024-08-18T22:12:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.204+0000 7f34d9d7d640 1 -- 172.21.15.123:0/353130850 learned_addr learned my addr 172.21.15.123:0/353130850 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.204+0000 7f34d957c640 1 --2- 172.21.15.123:0/353130850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b5572b0 0x55b76b561630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.204+0000 7f34d9d7d640 1 -- 172.21.15.123:0/353130850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b5572b0 msgr2=0x55b76b561630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.204+0000 7f34d9d7d640 1 --2- 172.21.15.123:0/353130850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b5572b0 0x55b76b561630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.205+0000 7f34d9d7d640 1 -- 172.21.15.123:0/353130850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b561b70 msgr2=0x55b76b563f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.205+0000 7f34d8d7b640 1 --2- 172.21.15.123:0/353130850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b561b70 0x55b76b563f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.205+0000 7f34ca7fc640 1 --2- 172.21.15.123:0/3267931645 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f34c00a2c00 0x7f34c00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.205+0000 7f34d9d7d640 1 --2- 172.21.15.123:0/353130850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b561b70 0x55b76b563f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.205+0000 7f34d9d7d640 1 -- 172.21.15.123:0/353130850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76b1cc580 con 0x55b76b556990 2024-08-18T22:12:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.205+0000 7f34d8d7b640 1 --2- 172.21.15.123:0/353130850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b561b70 0x55b76b563f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:12:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.205+0000 7f34d9d7d640 1 --2- 172.21.15.123:0/353130850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b556990 0x55b76b556d70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009ea0 tx=0x7f34cc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fa7bbfd5bcc1a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.205+0000 7f34ca7fc640 1 -- 172.21.15.123:0/3267931645 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f34c40ef7b0 con 0x7f34d4102260 2024-08-18T22:12:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.205+0000 7f34d9d7d640 1 --2- 172.21.15.123:0/3267931645 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f34c00a2c00 0x7f34c00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.205+0000 7f34bf7fe640 1 -- 172.21.15.123:0/353130850 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc01a6c0 con 0x55b76b556990 2024-08-18T22:12:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.205+0000 7f34bf7fe640 1 -- 172.21.15.123:0/353130850 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34cc011440 con 0x55b76b556990 2024-08-18T22:12:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.205+0000 7f34bf7fe640 1 -- 172.21.15.123:0/353130850 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc019770 con 0x55b76b556990 2024-08-18T22:12:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.206+0000 7f34ddbde740 1 -- 172.21.15.123:0/353130850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b556990 msgr2=0x55b76b556d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.206+0000 7f34d9d7d640 1 --2- 172.21.15.123:0/3267931645 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f34c00a2c00 0x7f34c00a50c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f34cc019000 tx=0x7f34cc019e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.206+0000 7f34ddbde740 1 --2- 172.21.15.123:0/353130850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b556990 0x55b76b556d70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009ea0 tx=0x7f34cc009f90 comp rx=0 tx=0).stop 2024-08-18T22:12:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.206+0000 7f34ddbde740 1 -- 172.21.15.123:0/353130850 shutdown_connections 2024-08-18T22:12:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.206+0000 7f34ddbde740 1 --2- 172.21.15.123:0/353130850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b561b70 0x55b76b563f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.206+0000 7f34ddbde740 1 --2- 172.21.15.123:0/353130850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b5572b0 0x55b76b561630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.206+0000 7f34ddbde740 1 --2- 172.21.15.123:0/353130850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b556990 0x55b76b556d70 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.206+0000 7f34ddbde740 1 -- 172.21.15.123:0/353130850 >> 172.21.15.123:0/353130850 conn(0x55b76b552f20 msgr2=0x55b76b553300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.206+0000 7f34ddbde740 1 -- 172.21.15.123:0/353130850 shutdown_connections 2024-08-18T22:12:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.206+0000 7f34ddbde740 1 -- 172.21.15.123:0/353130850 wait complete. 2024-08-18T22:12:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.206+0000 7f34ddbde740 1 -- start start 2024-08-18T22:12:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.206+0000 7f34ddbde740 1 Processor -- start 2024-08-18T22:12:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34ddbde740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b556990 0x55b76b55e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34ddbde740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b5572b0 0x55b76b55eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34ddbde740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b561b70 0x55b76b55f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34ddbde740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b76b564740 con 0x55b76b556990 2024-08-18T22:12:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34ddbde740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b76b45a7c0 con 0x55b76b5572b0 2024-08-18T22:12:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34ddbde740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b76b5648c0 con 0x55b76b561b70 2024-08-18T22:12:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34ddbde740 10 client.0 _ll_register_callbacks cb 0x55b76b463f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34d957c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b556990 0x55b76b55e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34d957c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b556990 0x55b76b55e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49336/0 (socket says 172.21.15.123:49336) 2024-08-18T22:12:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34d957c640 1 -- 172.21.15.123:0/4156778083 learned_addr learned my addr 172.21.15.123:0/4156778083 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34d8d7b640 1 --2- 172.21.15.123:0/4156778083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b5572b0 0x55b76b55eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34d9d7d640 1 --2- 172.21.15.123:0/4156778083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b561b70 0x55b76b55f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34d957c640 1 -- 172.21.15.123:0/4156778083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b561b70 msgr2=0x55b76b55f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34d957c640 1 --2- 172.21.15.123:0/4156778083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b561b70 0x55b76b55f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34d957c640 1 -- 172.21.15.123:0/4156778083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b5572b0 msgr2=0x55b76b55eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34d957c640 1 --2- 172.21.15.123:0/4156778083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b5572b0 0x55b76b55eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34d957c640 1 -- 172.21.15.123:0/4156778083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b76b296960 con 0x55b76b556990 2024-08-18T22:12:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34d957c640 1 --2- 172.21.15.123:0/4156778083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b556990 0x55b76b55e9a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f34d0012710 tx=0x7f34d0012bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e621af15c2f6d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.207+0000 7f34bcff9640 1 -- 172.21.15.123:0/4156778083 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d000f920 con 0x55b76b556990 2024-08-18T22:12:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.208+0000 7f34bcff9640 1 -- 172.21.15.123:0/4156778083 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f34d000fac0 con 0x55b76b556990 2024-08-18T22:12:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.208+0000 7f34ddbde740 1 -- 172.21.15.123:0/4156778083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34cc011440 con 0x55b76b556990 2024-08-18T22:12:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.208+0000 7f34bcff9640 1 -- 172.21.15.123:0/4156778083 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f34d000fcc0 con 0x55b76b556990 2024-08-18T22:12:11.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.208+0000 7f34ddbde740 10 client.16185 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:11.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.208+0000 7f34ddbde740 1 -- 172.21.15.123:0/4156778083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b76b5706d0 con 0x55b76b556990 2024-08-18T22:12:11.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.208+0000 7f34bcff9640 1 -- 172.21.15.123:0/4156778083 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34cc011440 con 0x55b76b556990 2024-08-18T22:12:11.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.208+0000 7f34bcff9640 1 -- 172.21.15.123:0/4156778083 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f34d001c420 con 0x55b76b556990 2024-08-18T22:12:11.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.208+0000 7f34ddbde740 10 client.16185 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:11.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.208+0000 7f34ddbde740 10 client.16185 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:12:11.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.208+0000 7f34ddbde740 20 client.16185 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:11.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.208+0000 7f34ddbde740 1 --2- 172.21.15.123:0/4156778083 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b76b571be0 0x55b76b5740a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.208+0000 7f34ddbde740 4 client.16185 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:12:11.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.208+0000 7f34ddbde740 1 -- 172.21.15.123:0/4156778083 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b76b4ca1d0 con 0x55b76b571be0 2024-08-18T22:12:11.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.208+0000 7f34d8d7b640 1 --2- 172.21.15.123:0/4156778083 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b76b571be0 0x55b76b5740a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.209+0000 7f34d8d7b640 1 --2- 172.21.15.123:0/4156778083 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b76b571be0 0x55b76b5740a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d182c6027b45005 server_cookie=e62182a22b8c6705 in_seq=0 out_seq=0 2024-08-18T22:12:11.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.209+0000 7f34bcff9640 10 client.16185 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:11.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.209+0000 7f34bcff9640 1 -- 172.21.15.123:0/4156778083 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b76b4ca1d0 con 0x55b76b571be0 2024-08-18T22:12:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.209+0000 7f34bcff9640 10 client.16185 handle_command_reply: tid=0 2024-08-18T22:12:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.209+0000 7f34ddbde740 1 client.16185 shutdown 2024-08-18T22:12:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.209+0000 7f34ddbde740 1 -- 172.21.15.123:0/4156778083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b556990 msgr2=0x55b76b55e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.209+0000 7f34ddbde740 1 --2- 172.21.15.123:0/4156778083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b556990 0x55b76b55e9a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f34d0012710 tx=0x7f34d0012bd0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.210+0000 7f34ddbde740 1 -- 172.21.15.123:0/4156778083 shutdown_connections 2024-08-18T22:12:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.210+0000 7f34ddbde740 1 --2- 172.21.15.123:0/4156778083 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b76b571be0 0x55b76b5740a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.210+0000 7f34ddbde740 1 --2- 172.21.15.123:0/4156778083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b561b70 0x55b76b55f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.210+0000 7f34ddbde740 1 --2- 172.21.15.123:0/4156778083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b5572b0 0x55b76b55eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.210+0000 7f34ddbde740 1 --2- 172.21.15.123:0/4156778083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b556990 0x55b76b55e9a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.210+0000 7f34ddbde740 1 -- 172.21.15.123:0/4156778083 >> 172.21.15.123:0/4156778083 conn(0x55b76b552f20 msgr2=0x55b76b558c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.210+0000 7f34bcff9640 0 client.16185 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.210+0000 7f34ddbde740 1 -- 172.21.15.123:0/4156778083 shutdown_connections 2024-08-18T22:12:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.210+0000 7f34ddbde740 1 -- 172.21.15.123:0/4156778083 wait complete. 2024-08-18T22:12:11.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.210+0000 7f34ddbde740 20 client.16185 trim_cache size 0 max 16384 2024-08-18T22:12:11.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.226+0000 7f34ddbde740 1 Processor -- start 2024-08-18T22:12:11.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.226+0000 7f34ddbde740 1 -- start start 2024-08-18T22:12:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34ddbde740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b552f20 0x55b76b55d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34ddbde740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b556990 0x55b76b579970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34ddbde740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b5572b0 0x55b76b579eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34ddbde740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f34d41b3570 con 0x55b76b5572b0 2024-08-18T22:12:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34ddbde740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34d41b0e40 con 0x55b76b552f20 2024-08-18T22:12:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34ddbde740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f34d41aec90 con 0x55b76b556990 2024-08-18T22:12:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34d9d7d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b5572b0 0x55b76b579eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34d9d7d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b5572b0 0x55b76b579eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49350/0 (socket says 172.21.15.123:49350) 2024-08-18T22:12:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34d9d7d640 1 -- 172.21.15.123:0/782516708 learned_addr learned my addr 172.21.15.123:0/782516708 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34d957c640 1 --2- 172.21.15.123:0/782516708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b552f20 0x55b76b55d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34d8d7b640 1 --2- 172.21.15.123:0/782516708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b556990 0x55b76b579970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34d9d7d640 1 -- 172.21.15.123:0/782516708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b556990 msgr2=0x55b76b579970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34d9d7d640 1 --2- 172.21.15.123:0/782516708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b556990 0x55b76b579970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34d9d7d640 1 -- 172.21.15.123:0/782516708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b552f20 msgr2=0x55b76b55d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:11.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34d9d7d640 1 --2- 172.21.15.123:0/782516708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b552f20 0x55b76b55d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34d9d7d640 1 -- 172.21.15.123:0/782516708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76b551470 con 0x55b76b5572b0 2024-08-18T22:12:11.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34d8d7b640 1 --2- 172.21.15.123:0/782516708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b556990 0x55b76b579970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:11.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34d9d7d640 1 --2- 172.21.15.123:0/782516708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b5572b0 0x55b76b579eb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f34cc011f80 tx=0x7f34cc026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bfcc98b923c837 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:11.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34beffd640 1 -- 172.21.15.123:0/782516708 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc02c050 con 0x55b76b5572b0 2024-08-18T22:12:11.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.227+0000 7f34beffd640 1 -- 172.21.15.123:0/782516708 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34cc02d040 con 0x55b76b5572b0 2024-08-18T22:12:11.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.228+0000 7f34beffd640 1 -- 172.21.15.123:0/782516708 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc004c20 con 0x55b76b5572b0 2024-08-18T22:12:11.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.228+0000 7f34ddbde740 1 -- 172.21.15.123:0/782516708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b5572b0 msgr2=0x55b76b579eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.228+0000 7f34ddbde740 1 --2- 172.21.15.123:0/782516708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b5572b0 0x55b76b579eb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f34cc011f80 tx=0x7f34cc026000 comp rx=0 tx=0).stop 2024-08-18T22:12:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.228+0000 7f34ddbde740 1 -- 172.21.15.123:0/782516708 shutdown_connections 2024-08-18T22:12:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.228+0000 7f34ddbde740 1 --2- 172.21.15.123:0/782516708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b5572b0 0x55b76b579eb0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.228+0000 7f34ddbde740 1 --2- 172.21.15.123:0/782516708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b556990 0x55b76b579970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.228+0000 7f34ddbde740 1 --2- 172.21.15.123:0/782516708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b552f20 0x55b76b55d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.228+0000 7f34ddbde740 1 -- 172.21.15.123:0/782516708 >> 172.21.15.123:0/782516708 conn(0x55b76b55a390 msgr2=0x55b76b55d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.228+0000 7f34ddbde740 1 -- 172.21.15.123:0/782516708 shutdown_connections 2024-08-18T22:12:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.228+0000 7f34ddbde740 1 -- 172.21.15.123:0/782516708 wait complete. 2024-08-18T22:12:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34ddbde740 1 -- start start 2024-08-18T22:12:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34ddbde740 1 Processor -- start 2024-08-18T22:12:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34ddbde740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b552f20 0x55b76b565f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34ddbde740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b556990 0x55b76b5664b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34ddbde740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b5572b0 0x55b76b5e4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34ddbde740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f34d41af300 con 0x55b76b5572b0 2024-08-18T22:12:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34ddbde740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34d41b0770 con 0x55b76b556990 2024-08-18T22:12:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34ddbde740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f34d41af9d0 con 0x55b76b552f20 2024-08-18T22:12:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34ddbde740 10 client.0 _ll_register_callbacks cb 0x7f34d0009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34d9d7d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b5572b0 0x55b76b5e4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34d9d7d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b5572b0 0x55b76b5e4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49362/0 (socket says 172.21.15.123:49362) 2024-08-18T22:12:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34d9d7d640 1 -- 172.21.15.123:0/1107524781 learned_addr learned my addr 172.21.15.123:0/1107524781 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34d957c640 1 --2- 172.21.15.123:0/1107524781 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b552f20 0x55b76b565f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34d8d7b640 1 --2- 172.21.15.123:0/1107524781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b556990 0x55b76b5664b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34d9d7d640 1 -- 172.21.15.123:0/1107524781 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b552f20 msgr2=0x55b76b565f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34d9d7d640 1 --2- 172.21.15.123:0/1107524781 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b552f20 0x55b76b565f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34d9d7d640 1 -- 172.21.15.123:0/1107524781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b556990 msgr2=0x55b76b5664b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34d9d7d640 1 --2- 172.21.15.123:0/1107524781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b556990 0x55b76b5664b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.229+0000 7f34d9d7d640 1 -- 172.21.15.123:0/1107524781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b76b5e4690 con 0x55b76b5572b0 2024-08-18T22:12:11.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34d9d7d640 1 --2- 172.21.15.123:0/1107524781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b5572b0 0x55b76b5e4150 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0097d0 tx=0x7f34cc01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a6bb880a2b93ce server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:11.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:11.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34bcff9640 1 -- 172.21.15.123:0/1107524781 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc040070 con 0x55b76b5572b0 2024-08-18T22:12:11.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34bcff9640 1 -- 172.21.15.123:0/1107524781 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f34cc0049c0 con 0x55b76b5572b0 2024-08-18T22:12:11.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34ddbde740 1 -- 172.21.15.123:0/1107524781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34cc02d040 con 0x55b76b5572b0 2024-08-18T22:12:11.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34bcff9640 1 -- 172.21.15.123:0/1107524781 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f34cc02c020 con 0x55b76b5572b0 2024-08-18T22:12:11.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34ddbde740 10 client.16191 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:11.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34ddbde740 1 -- 172.21.15.123:0/1107524781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b76b5e5950 con 0x55b76b5572b0 2024-08-18T22:12:11.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34bcff9640 1 -- 172.21.15.123:0/1107524781 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34cc02d040 con 0x55b76b5572b0 2024-08-18T22:12:11.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34bcff9640 1 -- 172.21.15.123:0/1107524781 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f34cc0193e0 con 0x55b76b5572b0 2024-08-18T22:12:11.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34ddbde740 10 client.16191 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:11.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34ddbde740 10 client.16191 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:12:11.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34ddbde740 20 client.16191 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34ddbde740 1 --2- 172.21.15.123:0/1107524781 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b76b561b70 0x55b76b5e7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34ddbde740 4 client.16191 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "959c2d5d", "release": true, "await": true}] 2024-08-18T22:12:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.230+0000 7f34ddbde740 1 -- 172.21.15.123:0/1107524781 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "quiesce db", "set_id": "959c2d5d", "release": true, "await": true}) -- 0x55b76b4c46e0 con 0x55b76b561b70 2024-08-18T22:12:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.231+0000 7f34d957c640 1 --2- 172.21.15.123:0/1107524781 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b76b561b70 0x55b76b5e7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.231+0000 7f34bcff9640 10 client.16191 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.231+0000 7f34d957c640 1 --2- 172.21.15.123:0/1107524781 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b76b561b70 0x55b76b5e7f40 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f8eb98c68365333 server_cookie=39d026a4b9f2594c in_seq=0 out_seq=0 2024-08-18T22:12:11.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:11 smithi123 ceph-mon[18462]: pgmap v472: 129 pgs: 129 active+clean; 8.8 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 864 KiB/s wr, 1.28k op/s 2024-08-18T22:12:11.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.580+0000 7f34bcff9640 1 -- 172.21.15.123:0/1107524781 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b76b4c46e0 con 0x55b76b561b70 2024-08-18T22:12:11.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.580+0000 7f34bcff9640 10 client.16191 handle_command_reply: tid=0 2024-08-18T22:12:11.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.580+0000 7f34ddbde740 1 client.16191 shutdown 2024-08-18T22:12:11.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.580+0000 7f34ddbde740 1 -- 172.21.15.123:0/1107524781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b5572b0 msgr2=0x55b76b5e4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:11.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.580+0000 7f34ddbde740 1 --2- 172.21.15.123:0/1107524781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b5572b0 0x55b76b5e4150 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0097d0 tx=0x7f34cc01abb0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.580+0000 7f34ddbde740 1 -- 172.21.15.123:0/1107524781 shutdown_connections 2024-08-18T22:12:11.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.580+0000 7f34ddbde740 1 --2- 172.21.15.123:0/1107524781 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55b76b561b70 0x55b76b5e7f40 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.580+0000 7f34ddbde740 1 --2- 172.21.15.123:0/1107524781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b76b5572b0 0x55b76b5e4150 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.580+0000 7f34ddbde740 1 --2- 172.21.15.123:0/1107524781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b76b556990 0x55b76b5664b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.580+0000 7f34bcff9640 0 client.16191 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:11.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.580+0000 7f34ddbde740 1 --2- 172.21.15.123:0/1107524781 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b76b552f20 0x55b76b565f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.580+0000 7f34ddbde740 1 -- 172.21.15.123:0/1107524781 >> 172.21.15.123:0/1107524781 conn(0x55b76b55a390 msgr2=0x55b76b558c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:11.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.581+0000 7f34ddbde740 1 -- 172.21.15.123:0/1107524781 shutdown_connections 2024-08-18T22:12:11.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.581+0000 7f34ddbde740 1 -- 172.21.15.123:0/1107524781 wait complete. 2024-08-18T22:12:11.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.581+0000 7f34ddbde740 20 client.16191 trim_cache size 0 max 16384 2024-08-18T22:12:11.584 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:12:11.585 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 27, 2024-08-18T22:12:11.585 INFO:teuthology.orchestra.run.smithi123.stdout: "leader": 24466, 2024-08-18T22:12:11.585 INFO:teuthology.orchestra.run.smithi123.stdout: "set_version": 12, 2024-08-18T22:12:11.585 INFO:teuthology.orchestra.run.smithi123.stdout: "sets": { 2024-08-18T22:12:11.585 INFO:teuthology.orchestra.run.smithi123.stdout: "959c2d5d": { 2024-08-18T22:12:11.585 INFO:teuthology.orchestra.run.smithi123.stdout: "version": 12, 2024-08-18T22:12:11.585 INFO:teuthology.orchestra.run.smithi123.stdout: "age_ref": 0.0, 2024-08-18T22:12:11.585 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:12:11.585 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RELEASED", 2024-08-18T22:12:11.585 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:12:11.585 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:12:11.585 INFO:teuthology.orchestra.run.smithi123.stdout: "timeout": 90.0, 2024-08-18T22:12:11.585 INFO:teuthology.orchestra.run.smithi123.stdout: "expiration": 150.0, 2024-08-18T22:12:11.586 INFO:teuthology.orchestra.run.smithi123.stdout: "members": { 2024-08-18T22:12:11.586 INFO:teuthology.orchestra.run.smithi123.stdout: "file:/": { 2024-08-18T22:12:11.586 INFO:teuthology.orchestra.run.smithi123.stdout: "excluded": false, 2024-08-18T22:12:11.586 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:12:11.586 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RELEASED", 2024-08-18T22:12:11.586 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:12:11.586 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:11.586 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:11.586 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:11.586 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:11.586 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:11.586 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:12:11.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.581+0000 7f34db7e0640 1 -- 172.21.15.123:0/3267931645 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f34c00a2c00 msgr2=0x7f34c00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:11.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.581+0000 7f34db7e0640 1 --2- 172.21.15.123:0/3267931645 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f34c00a2c00 0x7f34c00a50c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f34cc019000 tx=0x7f34cc019e40 comp rx=0 tx=0).stop 2024-08-18T22:12:11.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.581+0000 7f34db7e0640 1 -- 172.21.15.123:0/3267931645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d4102260 msgr2=0x7f34d4074760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:11.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.581+0000 7f34db7e0640 1 --2- 172.21.15.123:0/3267931645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d4102260 0x7f34d4074760 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009230 tx=0x7f34c4004270 comp rx=0 tx=0).stop 2024-08-18T22:12:11.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.581+0000 7f34db7e0640 1 -- 172.21.15.123:0/3267931645 shutdown_connections 2024-08-18T22:12:11.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.581+0000 7f34db7e0640 1 --2- 172.21.15.123:0/3267931645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34d41078c0 0x7f34d4074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.581+0000 7f34db7e0640 1 --2- 172.21.15.123:0/3267931645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d4102260 0x7f34d4074760 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.581+0000 7f34db7e0640 1 --2- 172.21.15.123:0/3267931645 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f34c00a2c00 0x7f34c00a50c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.581+0000 7f34db7e0640 1 --2- 172.21.15.123:0/3267931645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34d41018c0 0x7f34d4074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:11.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.581+0000 7f34db7e0640 1 -- 172.21.15.123:0/3267931645 >> 172.21.15.123:0/3267931645 conn(0x7f34d40fd620 msgr2=0x7f34d40fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:11.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.581+0000 7f34db7e0640 1 -- 172.21.15.123:0/3267931645 shutdown_connections 2024-08-18T22:12:11.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:11.581+0000 7f34db7e0640 1 -- 172.21.15.123:0/3267931645 wait complete. 2024-08-18T22:12:11.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:11 smithi183 ceph-mon[22097]: pgmap v472: 129 pgs: 129 active+clean; 8.8 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 864 KiB/s wr, 1.28k op/s 2024-08-18T22:12:11.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:11 smithi130 ceph-mon[21698]: pgmap v472: 129 pgs: 129 active+clean; 8.8 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 864 KiB/s wr, 1.28k op/s 2024-08-18T22:12:12.398 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '959c2d5d', total seconds elapsed: 33.7 2024-08-18T22:12:12.398 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-08-18T22:12:12.399 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:12:12.657 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:12:13.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.147+0000 7f7eac1f1640 1 -- 172.21.15.123:0/1080320843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea4100b50 msgr2=0x7f7ea4100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:13.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.147+0000 7f7eac1f1640 1 --2- 172.21.15.123:0/1080320843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea4100b50 0x7f7ea4100f30 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009900 tx=0x7f7ea002a480 comp rx=0 tx=0).stop 2024-08-18T22:12:13.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.147+0000 7f7eac1f1640 1 -- 172.21.15.123:0/1080320843 shutdown_connections 2024-08-18T22:12:13.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.147+0000 7f7eac1f1640 1 --2- 172.21.15.123:0/1080320843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea4102c20 0x7f7ea410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:13.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.147+0000 7f7eac1f1640 1 --2- 172.21.15.123:0/1080320843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ea41022a0 0x7f7ea41026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:13.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.147+0000 7f7eac1f1640 1 --2- 172.21.15.123:0/1080320843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea4100b50 0x7f7ea4100f30 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:13.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.147+0000 7f7eac1f1640 1 -- 172.21.15.123:0/1080320843 >> 172.21.15.123:0/1080320843 conn(0x7f7ea40fc500 msgr2=0x7f7ea40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:13.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.147+0000 7f7eac1f1640 1 -- 172.21.15.123:0/1080320843 shutdown_connections 2024-08-18T22:12:13.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.147+0000 7f7eac1f1640 1 -- 172.21.15.123:0/1080320843 wait complete. 2024-08-18T22:12:13.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.147+0000 7f7eac1f1640 1 Processor -- start 2024-08-18T22:12:13.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7eac1f1640 1 -- start start 2024-08-18T22:12:13.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7eac1f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea4100b50 0x7f7ea4198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:13.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7eac1f1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ea41022a0 0x7f7ea4198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:13.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7eac1f1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea4102c20 0x7f7ea419cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:13.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7eac1f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea4110cb0 con 0x7f7ea4100b50 2024-08-18T22:12:13.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7eac1f1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea4110b30 con 0x7f7ea4102c20 2024-08-18T22:12:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7eac1f1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea4110e30 con 0x7f7ea41022a0 2024-08-18T22:12:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7ea9f8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea4100b50 0x7f7ea4198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7ea9f8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea4100b50 0x7f7ea4198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50456/0 (socket says 172.21.15.123:50456) 2024-08-18T22:12:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7ea9f8d640 1 -- 172.21.15.123:0/3969788895 learned_addr learned my addr 172.21.15.123:0/3969788895 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7ea978c640 1 --2- 172.21.15.123:0/3969788895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ea41022a0 0x7f7ea4198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7eaa78e640 1 --2- 172.21.15.123:0/3969788895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea4102c20 0x7f7ea419cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7ea9f8d640 1 -- 172.21.15.123:0/3969788895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ea41022a0 msgr2=0x7f7ea4198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7ea9f8d640 1 --2- 172.21.15.123:0/3969788895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ea41022a0 0x7f7ea4198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7ea9f8d640 1 -- 172.21.15.123:0/3969788895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea4102c20 msgr2=0x7f7ea419cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7ea9f8d640 1 --2- 172.21.15.123:0/3969788895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea4102c20 0x7f7ea419cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7ea9f8d640 1 -- 172.21.15.123:0/3969788895 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea419d1e0 con 0x7f7ea4100b50 2024-08-18T22:12:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7eaa78e640 1 --2- 172.21.15.123:0/3969788895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea4102c20 0x7f7ea419cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.148+0000 7f7ea9f8d640 1 --2- 172.21.15.123:0/3969788895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea4100b50 0x7f7ea4198230 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0006010 tx=0x7f7ea0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.149+0000 7f7e9affd640 1 -- 172.21.15.123:0/3969788895 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea003f070 con 0x7f7ea4100b50 2024-08-18T22:12:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.149+0000 7f7e9affd640 1 -- 172.21.15.123:0/3969788895 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ea0031c30 con 0x7f7ea4100b50 2024-08-18T22:12:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.149+0000 7f7eac1f1640 1 -- 172.21.15.123:0/3969788895 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea419d470 con 0x7f7ea4100b50 2024-08-18T22:12:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.149+0000 7f7e9affd640 1 -- 172.21.15.123:0/3969788895 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0035030 con 0x7f7ea4100b50 2024-08-18T22:12:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.149+0000 7f7eac1f1640 1 -- 172.21.15.123:0/3969788895 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea41a4db0 con 0x7f7ea4100b50 2024-08-18T22:12:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.150+0000 7f7eac1f1640 1 -- 172.21.15.123:0/3969788895 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ea4100f30 con 0x7f7ea4100b50 2024-08-18T22:12:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.151+0000 7f7e9affd640 1 -- 172.21.15.123:0/3969788895 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f7ea0042070 con 0x7f7ea4100b50 2024-08-18T22:12:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.152+0000 7f7e9affd640 1 --2- 172.21.15.123:0/3969788895 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7e900a2c00 0x7f7e900a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.152+0000 7f7ea978c640 1 --2- 172.21.15.123:0/3969788895 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7e900a2c00 0x7f7e900a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.152+0000 7f7e9affd640 1 -- 172.21.15.123:0/3969788895 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f7ea00efa60 con 0x7f7ea4100b50 2024-08-18T22:12:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.152+0000 7f7ea978c640 1 --2- 172.21.15.123:0/3969788895 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7e900a2c00 0x7f7e900a50c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7ea406ad80 tx=0x7f7e94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.156+0000 7f7e9affd640 1 -- 172.21.15.123:0/3969788895 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7ea00bc630 con 0x7f7ea4100b50 2024-08-18T22:12:13.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.379+0000 7f7eac1f1640 1 -- 172.21.15.123:0/3969788895 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ea41a4f80 con 0x7f7ea4100b50 2024-08-18T22:12:13.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.380+0000 7f7e9affd640 1 -- 172.21.15.123:0/3969788895 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f7ea0031de0 con 0x7f7ea4100b50 2024-08-18T22:12:13.381 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:12:13.382 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":27,"btime":"2024-08-18T22:11:43:088943+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:11:42.650261+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24448,24458,24466]},"id":1}]} 2024-08-18T22:12:13.382 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 27 2024-08-18T22:12:13.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.382+0000 7f7eac1f1640 1 -- 172.21.15.123:0/3969788895 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7e900a2c00 msgr2=0x7f7e900a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.382+0000 7f7eac1f1640 1 --2- 172.21.15.123:0/3969788895 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7e900a2c00 0x7f7e900a50c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7ea406ad80 tx=0x7f7e94005f90 comp rx=0 tx=0).stop 2024-08-18T22:12:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.382+0000 7f7eac1f1640 1 -- 172.21.15.123:0/3969788895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea4100b50 msgr2=0x7f7ea4198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.382+0000 7f7eac1f1640 1 --2- 172.21.15.123:0/3969788895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea4100b50 0x7f7ea4198230 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0006010 tx=0x7f7ea0003c10 comp rx=0 tx=0).stop 2024-08-18T22:12:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.383+0000 7f7eac1f1640 1 -- 172.21.15.123:0/3969788895 shutdown_connections 2024-08-18T22:12:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.383+0000 7f7eac1f1640 1 --2- 172.21.15.123:0/3969788895 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f7e900a2c00 0x7f7e900a50c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.383+0000 7f7eac1f1640 1 --2- 172.21.15.123:0/3969788895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea4102c20 0x7f7ea419cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.383+0000 7f7eac1f1640 1 --2- 172.21.15.123:0/3969788895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ea41022a0 0x7f7ea4198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.383+0000 7f7eac1f1640 1 --2- 172.21.15.123:0/3969788895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea4100b50 0x7f7ea4198230 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.383+0000 7f7eac1f1640 1 -- 172.21.15.123:0/3969788895 >> 172.21.15.123:0/3969788895 conn(0x7f7ea40fc500 msgr2=0x7f7ea4105be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.383+0000 7f7eac1f1640 1 -- 172.21.15.123:0/3969788895 shutdown_connections 2024-08-18T22:12:13.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:13.383+0000 7f7eac1f1640 1 -- 172.21.15.123:0/3969788895 wait complete. 2024-08-18T22:12:13.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:13 smithi183 ceph-mon[22097]: pgmap v473: 129 pgs: 129 active+clean; 4.9 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 426 KiB/s wr, 470 op/s 2024-08-18T22:12:13.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:13 smithi123 ceph-mon[18462]: pgmap v473: 129 pgs: 129 active+clean; 4.9 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 426 KiB/s wr, 470 op/s 2024-08-18T22:12:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:13 smithi130 ceph-mon[21698]: pgmap v473: 129 pgs: 129 active+clean; 4.9 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 426 KiB/s wr, 470 op/s 2024-08-18T22:12:14.071 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-08-18T22:12:14.071 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24466 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-08-18T22:12:14.342 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:12:14.637 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:14 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3969788895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:12:14.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:14 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3969788895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:12:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:14 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3969788895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:12:14.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.844+0000 7f9d2b1ac640 1 -- 172.21.15.123:0/3238891004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d24101140 msgr2=0x7f9d2410d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:14.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.844+0000 7f9d2b1ac640 1 --2- 172.21.15.123:0/3238891004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d24101140 0x7f9d2410d670 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009cd0 tx=0x7f9d1c02a8e0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.844+0000 7f9d2b1ac640 1 -- 172.21.15.123:0/3238891004 shutdown_connections 2024-08-18T22:12:14.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.844+0000 7f9d2b1ac640 1 --2- 172.21.15.123:0/3238891004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d24101140 0x7f9d2410d670 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.844+0000 7f9d2b1ac640 1 --2- 172.21.15.123:0/3238891004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d241007a0 0x7f9d24100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.844+0000 7f9d2b1ac640 1 --2- 172.21.15.123:0/3238891004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d241067a0 0x7f9d24106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.844+0000 7f9d2b1ac640 1 -- 172.21.15.123:0/3238891004 >> 172.21.15.123:0/3238891004 conn(0x7f9d240fc4c0 msgr2=0x7f9d240fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:14.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.844+0000 7f9d2b1ac640 1 -- 172.21.15.123:0/3238891004 shutdown_connections 2024-08-18T22:12:14.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.844+0000 7f9d2b1ac640 1 -- 172.21.15.123:0/3238891004 wait complete. 2024-08-18T22:12:14.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d2b1ac640 1 Processor -- start 2024-08-18T22:12:14.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d2b1ac640 1 -- start start 2024-08-18T22:12:14.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d2b1ac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d241007a0 0x7f9d24197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d2b1ac640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d24101140 0x7f9d24197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d2b1ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d241067a0 0x7f9d2419b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d2b1ac640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9d24110ba0 con 0x7f9d241007a0 2024-08-18T22:12:14.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d2b1ac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9d24110a20 con 0x7f9d241067a0 2024-08-18T22:12:14.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d2b1ac640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9d24110d20 con 0x7f9d24101140 2024-08-18T22:12:14.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d28f48640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d241007a0 0x7f9d24197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d28f48640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d241007a0 0x7f9d24197020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50482/0 (socket says 172.21.15.123:50482) 2024-08-18T22:12:14.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d28f48640 1 -- 172.21.15.123:0/2883592510 learned_addr learned my addr 172.21.15.123:0/2883592510 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:14.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d23fff640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d24101140 0x7f9d24197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d29749640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d241067a0 0x7f9d2419b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d28f48640 1 -- 172.21.15.123:0/2883592510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d24101140 msgr2=0x7f9d24197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:14.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d28f48640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d24101140 0x7f9d24197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d28f48640 1 -- 172.21.15.123:0/2883592510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d241067a0 msgr2=0x7f9d2419b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:14.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.845+0000 7f9d28f48640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d241067a0 0x7f9d2419b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.846+0000 7f9d28f48640 1 -- 172.21.15.123:0/2883592510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2419bfd0 con 0x7f9d241007a0 2024-08-18T22:12:14.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.846+0000 7f9d23fff640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d24101140 0x7f9d24197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:12:14.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.846+0000 7f9d29749640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d241067a0 0x7f9d2419b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:12:14.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.846+0000 7f9d28f48640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d241007a0 0x7f9d24197020 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800e9f0 tx=0x7f9d1800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:14.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.846+0000 7f9d21ffb640 1 -- 172.21.15.123:0/2883592510 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800cd80 con 0x7f9d241007a0 2024-08-18T22:12:14.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.846+0000 7f9d2b1ac640 1 -- 172.21.15.123:0/2883592510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2419c2c0 con 0x7f9d241007a0 2024-08-18T22:12:14.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.846+0000 7f9d21ffb640 1 -- 172.21.15.123:0/2883592510 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d18005500 con 0x7f9d241007a0 2024-08-18T22:12:14.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.846+0000 7f9d21ffb640 1 -- 172.21.15.123:0/2883592510 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18010690 con 0x7f9d241007a0 2024-08-18T22:12:14.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.846+0000 7f9d2b1ac640 1 -- 172.21.15.123:0/2883592510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2406a4c0 con 0x7f9d241007a0 2024-08-18T22:12:14.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.848+0000 7f9d21ffb640 1 -- 172.21.15.123:0/2883592510 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f9d180046c0 con 0x7f9d241007a0 2024-08-18T22:12:14.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d2d5aa740 1 Processor -- start 2024-08-18T22:12:14.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d2d5aa740 1 -- start start 2024-08-18T22:12:14.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d2d5aa740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2b130 0x56490be2b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d2d5aa740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2ba50 0x56490be35dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d21ffb640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9d140a4d90 0x7f9d140a7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d2d5aa740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be36310 0x56490be38700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d2d5aa740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56490bd90a70 con 0x56490be2b130 2024-08-18T22:12:14.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d2d5aa740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56490bd28780 con 0x56490be2ba50 2024-08-18T22:12:14.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d2d5aa740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56490bd8ca30 con 0x56490be36310 2024-08-18T22:12:14.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d28f48640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9d140a4d90 0x7f9d140a7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d21ffb640 1 -- 172.21.15.123:0/2883592510 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f9d180cf820 con 0x7f9d241007a0 2024-08-18T22:12:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d29749640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2b130 0x56490be2b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d29749640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2b130 0x56490be2b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50486/0 (socket says 172.21.15.123:50486) 2024-08-18T22:12:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d29749640 1 -- 172.21.15.123:0/3068772878 learned_addr learned my addr 172.21.15.123:0/3068772878 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d23fff640 1 --2- 172.21.15.123:0/3068772878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2ba50 0x56490be35dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.849+0000 7f9d29749640 1 --2- 172.21.15.123:0/3068772878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be36310 0x56490be38700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.850+0000 7f9d29749640 1 -- 172.21.15.123:0/3068772878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be36310 msgr2=0x56490be38700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.850+0000 7f9d29749640 1 --2- 172.21.15.123:0/3068772878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be36310 0x56490be38700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.850+0000 7f9d29749640 1 -- 172.21.15.123:0/3068772878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2ba50 msgr2=0x56490be35dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.850+0000 7f9d29749640 1 --2- 172.21.15.123:0/3068772878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2ba50 0x56490be35dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.850+0000 7f9d29749640 1 -- 172.21.15.123:0/3068772878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56490bb02b90 con 0x56490be2b130 2024-08-18T22:12:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.850+0000 7f9d29749640 1 --2- 172.21.15.123:0/3068772878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2b130 0x56490be2b510 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009a60 tx=0x7f9d1c004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b34018379f1f85 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.850+0000 7f9d28f48640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9d140a4d90 0x7f9d140a7250 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9d180ccf90 tx=0x7f9d180911d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.850+0000 7f9d0effd640 1 -- 172.21.15.123:0/3068772878 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c003970 con 0x56490be2b130 2024-08-18T22:12:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.850+0000 7f9d0effd640 1 -- 172.21.15.123:0/3068772878 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d1c036070 con 0x56490be2b130 2024-08-18T22:12:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.850+0000 7f9d0effd640 1 -- 172.21.15.123:0/3068772878 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0047b0 con 0x56490be2b130 2024-08-18T22:12:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.851+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/3068772878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2b130 msgr2=0x56490be2b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.851+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/3068772878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2b130 0x56490be2b510 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009a60 tx=0x7f9d1c004a80 comp rx=0 tx=0).stop 2024-08-18T22:12:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.851+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/3068772878 shutdown_connections 2024-08-18T22:12:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.851+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/3068772878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be36310 0x56490be38700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.851+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/3068772878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2ba50 0x56490be35dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.851+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/3068772878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2b130 0x56490be2b510 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.851+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/3068772878 >> 172.21.15.123:0/3068772878 conn(0x56490be276c0 msgr2=0x56490be27aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.851+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/3068772878 shutdown_connections 2024-08-18T22:12:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.851+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/3068772878 wait complete. 2024-08-18T22:12:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.852+0000 7f9d2d5aa740 1 -- start start 2024-08-18T22:12:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.852+0000 7f9d2d5aa740 1 Processor -- start 2024-08-18T22:12:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.852+0000 7f9d2d5aa740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2b130 0x56490be33240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.852+0000 7f9d2d5aa740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2ba50 0x56490be33780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.852+0000 7f9d2d5aa740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be36310 0x56490be33cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.852+0000 7f9d2d5aa740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56490be38ee0 con 0x56490be2b130 2024-08-18T22:12:14.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.852+0000 7f9d2d5aa740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56490bd4b990 con 0x56490be2ba50 2024-08-18T22:12:14.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.852+0000 7f9d2d5aa740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56490be39060 con 0x56490be36310 2024-08-18T22:12:14.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.852+0000 7f9d2d5aa740 10 client.0 _ll_register_callbacks cb 0x56490baa0090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:14.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.852+0000 7f9d29749640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2b130 0x56490be33240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.853+0000 7f9d29749640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2b130 0x56490be33240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50494/0 (socket says 172.21.15.123:50494) 2024-08-18T22:12:14.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.853+0000 7f9d29749640 1 -- 172.21.15.123:0/3992494450 learned_addr learned my addr 172.21.15.123:0/3992494450 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:14.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.853+0000 7f9d29749640 1 --2- 172.21.15.123:0/3992494450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be36310 0x56490be33cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.853+0000 7f9d23fff640 1 --2- 172.21.15.123:0/3992494450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2ba50 0x56490be33780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.853+0000 7f9d29749640 1 -- 172.21.15.123:0/3992494450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be36310 msgr2=0x56490be33cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.853+0000 7f9d29749640 1 --2- 172.21.15.123:0/3992494450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be36310 0x56490be33cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.853+0000 7f9d29749640 1 -- 172.21.15.123:0/3992494450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2ba50 msgr2=0x56490be33780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.853+0000 7f9d29749640 1 --2- 172.21.15.123:0/3992494450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2ba50 0x56490be33780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.853+0000 7f9d29749640 1 -- 172.21.15.123:0/3992494450 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56490bd4a6c0 con 0x56490be2b130 2024-08-18T22:12:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.853+0000 7f9d29749640 1 --2- 172.21.15.123:0/3992494450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2b130 0x56490be33240 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c031a20 tx=0x7f9d1c004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e42cee9ef66805 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.853+0000 7f9d03fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.853+0000 7f9d03fff640 1 -- 172.21.15.123:0/3992494450 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c004b40 con 0x56490be2b130 2024-08-18T22:12:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.853+0000 7f9d03fff640 1 -- 172.21.15.123:0/3992494450 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f9d1c004ce0 con 0x56490be2b130 2024-08-18T22:12:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.853+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/3992494450 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d1c036070 con 0x56490be2b130 2024-08-18T22:12:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.854+0000 7f9d03fff640 1 -- 172.21.15.123:0/3992494450 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9d1c003970 con 0x56490be2b130 2024-08-18T22:12:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.854+0000 7f9d2d5aa740 10 client.16209 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.854+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/3992494450 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56490be44be0 con 0x56490be2b130 2024-08-18T22:12:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.854+0000 7f9d03fff640 1 -- 172.21.15.123:0/3992494450 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d1c036070 con 0x56490be2b130 2024-08-18T22:12:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.854+0000 7f9d03fff640 1 -- 172.21.15.123:0/3992494450 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9d1c030070 con 0x56490be2b130 2024-08-18T22:12:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.854+0000 7f9d2d5aa740 10 client.16209 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.854+0000 7f9d2d5aa740 10 client.16209 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:12:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.854+0000 7f9d2d5aa740 20 client.16209 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.854+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/3992494450 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56490be45f30 0x56490be48320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.854+0000 7f9d2d5aa740 4 client.16209 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:12:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.854+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/3992494450 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56490bd9e1a0 con 0x56490be45f30 2024-08-18T22:12:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.854+0000 7f9d23fff640 1 --2- 172.21.15.123:0/3992494450 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56490be45f30 0x56490be48320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.855+0000 7f9d03fff640 10 client.16209 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.855+0000 7f9d23fff640 1 --2- 172.21.15.123:0/3992494450 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56490be45f30 0x56490be48320 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78902e49215ec1a9 server_cookie=27c15d5a70aaf7bd in_seq=0 out_seq=0 2024-08-18T22:12:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.858+0000 7f9d03fff640 1 -- 172.21.15.123:0/3992494450 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56490bd9e1a0 con 0x56490be45f30 2024-08-18T22:12:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.858+0000 7f9d03fff640 10 client.16209 handle_command_reply: tid=0 2024-08-18T22:12:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.858+0000 7f9d2d5aa740 1 client.16209 shutdown 2024-08-18T22:12:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.858+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/3992494450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2b130 msgr2=0x56490be33240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.858+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/3992494450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2b130 0x56490be33240 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c031a20 tx=0x7f9d1c004390 comp rx=0 tx=0).stop 2024-08-18T22:12:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.858+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/3992494450 shutdown_connections 2024-08-18T22:12:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.858+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/3992494450 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56490be45f30 0x56490be48320 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.858+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/3992494450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be36310 0x56490be33cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.858+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/3992494450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2ba50 0x56490be33780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.858+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/3992494450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2b130 0x56490be33240 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.858+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/3992494450 >> 172.21.15.123:0/3992494450 conn(0x56490be276c0 msgr2=0x56490be2d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.858+0000 7f9d03fff640 0 client.16209 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.858+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/3992494450 shutdown_connections 2024-08-18T22:12:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.858+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/3992494450 wait complete. 2024-08-18T22:12:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.858+0000 7f9d2d5aa740 20 client.16209 trim_cache size 0 max 16384 2024-08-18T22:12:14.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d2d5aa740 1 Processor -- start 2024-08-18T22:12:14.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d2d5aa740 1 -- start start 2024-08-18T22:12:14.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d2d5aa740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2b130 0x56490be31b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d2d5aa740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2ba50 0x56490be4af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d2d5aa740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be36310 0x56490be4b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d2d5aa740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9d241af0d0 con 0x56490be2ba50 2024-08-18T22:12:14.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d2d5aa740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9d241ac9a0 con 0x56490be2b130 2024-08-18T22:12:14.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d2d5aa740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9d241aa7f0 con 0x56490be36310 2024-08-18T22:12:14.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d23fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2ba50 0x56490be4af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d23fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2ba50 0x56490be4af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50506/0 (socket says 172.21.15.123:50506) 2024-08-18T22:12:14.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d23fff640 1 -- 172.21.15.123:0/4123280589 learned_addr learned my addr 172.21.15.123:0/4123280589 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:14.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d29749640 1 --2- 172.21.15.123:0/4123280589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2b130 0x56490be31b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d29749640 1 --2- 172.21.15.123:0/4123280589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be36310 0x56490be4b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d23fff640 1 -- 172.21.15.123:0/4123280589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be36310 msgr2=0x56490be4b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:14.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d23fff640 1 --2- 172.21.15.123:0/4123280589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be36310 0x56490be4b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d23fff640 1 -- 172.21.15.123:0/4123280589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2b130 msgr2=0x56490be31b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:14.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d23fff640 1 --2- 172.21.15.123:0/4123280589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2b130 0x56490be31b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d23fff640 1 -- 172.21.15.123:0/4123280589 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56490be35d90 con 0x56490be2ba50 2024-08-18T22:12:14.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.876+0000 7f9d23fff640 1 --2- 172.21.15.123:0/4123280589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2ba50 0x56490be4af60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x56490be32ad0 tx=0x7f9d10013ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783ee2516ffee3a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:14.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.877+0000 7f9d0e7fc640 1 -- 172.21.15.123:0/4123280589 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10004220 con 0x56490be2ba50 2024-08-18T22:12:14.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.877+0000 7f9d0e7fc640 1 -- 172.21.15.123:0/4123280589 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d100043c0 con 0x56490be2ba50 2024-08-18T22:12:14.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.877+0000 7f9d0e7fc640 1 -- 172.21.15.123:0/4123280589 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1001d870 con 0x56490be2ba50 2024-08-18T22:12:14.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.877+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/4123280589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2ba50 msgr2=0x56490be4af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:14.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.877+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/4123280589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2ba50 0x56490be4af60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x56490be32ad0 tx=0x7f9d10013ab0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.877+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/4123280589 shutdown_connections 2024-08-18T22:12:14.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.877+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/4123280589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be36310 0x56490be4b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.877+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/4123280589 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be2ba50 0x56490be4af60 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.877+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/4123280589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2b130 0x56490be31b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.877+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/4123280589 >> 172.21.15.123:0/4123280589 conn(0x56490be276c0 msgr2=0x56490be352c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:14.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.877+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/4123280589 shutdown_connections 2024-08-18T22:12:14.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.877+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/4123280589 wait complete. 2024-08-18T22:12:14.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.878+0000 7f9d2d5aa740 1 -- start start 2024-08-18T22:12:14.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.878+0000 7f9d2d5aa740 1 Processor -- start 2024-08-18T22:12:14.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.878+0000 7f9d2d5aa740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be2b130 0x56490be4b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.878+0000 7f9d2d5aa740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2ba50 0x56490be48b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.878+0000 7f9d2d5aa740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be36310 0x56490be49320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.878+0000 7f9d2d5aa740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9d241aae60 con 0x56490be36310 2024-08-18T22:12:14.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.878+0000 7f9d2d5aa740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9d241ac2d0 con 0x56490be2ba50 2024-08-18T22:12:14.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.878+0000 7f9d2d5aa740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9d241ab530 con 0x56490be2b130 2024-08-18T22:12:14.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.878+0000 7f9d2d5aa740 10 client.0 _ll_register_callbacks cb 0x7f9d1c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:14.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.878+0000 7f9d29749640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be36310 0x56490be49320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.878+0000 7f9d29749640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be36310 0x56490be49320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50508/0 (socket says 172.21.15.123:50508) 2024-08-18T22:12:14.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.878+0000 7f9d29749640 1 -- 172.21.15.123:0/2608363800 learned_addr learned my addr 172.21.15.123:0/2608363800 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:14.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.878+0000 7f9d23fff640 1 --2- 172.21.15.123:0/2608363800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2ba50 0x56490be48b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.878+0000 7f9d29749640 1 --2- 172.21.15.123:0/2608363800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be2b130 0x56490be4b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.879+0000 7f9d29749640 1 -- 172.21.15.123:0/2608363800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be2b130 msgr2=0x56490be4b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:14.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.879+0000 7f9d29749640 1 --2- 172.21.15.123:0/2608363800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be2b130 0x56490be4b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.879+0000 7f9d29749640 1 -- 172.21.15.123:0/2608363800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2ba50 msgr2=0x56490be48b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:14.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.879+0000 7f9d29749640 1 --2- 172.21.15.123:0/2608363800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2ba50 0x56490be48b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:14.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.879+0000 7f9d29749640 1 -- 172.21.15.123:0/2608363800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56490beb3c80 con 0x56490be36310 2024-08-18T22:12:14.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.879+0000 7f9d29749640 1 --2- 172.21.15.123:0/2608363800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be36310 0x56490be49320 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009430 tx=0x7f9d1c02a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3fd8221610efc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:14.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.879+0000 7f9d03fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:14.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.879+0000 7f9d03fff640 1 -- 172.21.15.123:0/2608363800 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c068060 con 0x56490be36310 2024-08-18T22:12:14.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.879+0000 7f9d03fff640 1 -- 172.21.15.123:0/2608363800 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f9d1c004800 con 0x56490be36310 2024-08-18T22:12:14.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.879+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/2608363800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d100043c0 con 0x56490be36310 2024-08-18T22:12:14.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.879+0000 7f9d03fff640 1 -- 172.21.15.123:0/2608363800 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9d1c06f050 con 0x56490be36310 2024-08-18T22:12:14.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.879+0000 7f9d2d5aa740 10 client.16215 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:14.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.879+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/2608363800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56490beb4d60 con 0x56490be36310 2024-08-18T22:12:14.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.879+0000 7f9d03fff640 1 -- 172.21.15.123:0/2608363800 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d100043c0 con 0x56490be36310 2024-08-18T22:12:14.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.880+0000 7f9d03fff640 1 -- 172.21.15.123:0/2608363800 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9d1c060070 con 0x56490be36310 2024-08-18T22:12:14.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.880+0000 7f9d2d5aa740 10 client.16215 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:14.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.880+0000 7f9d2d5aa740 10 client.16215 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:12:14.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.880+0000 7f9d2d5aa740 20 client.16215 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:14.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.880+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/2608363800 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56490beb53d0 0x56490beb77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:14.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.880+0000 7f9d2d5aa740 4 client.16215 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-08-18T22:12:14.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.880+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/2608363800 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x56490bd984f0 con 0x56490beb53d0 2024-08-18T22:12:14.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.880+0000 7f9d23fff640 1 --2- 172.21.15.123:0/2608363800 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56490beb53d0 0x56490beb77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:14.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.880+0000 7f9d03fff640 10 client.16215 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:14.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:14.880+0000 7f9d23fff640 1 --2- 172.21.15.123:0/2608363800 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56490beb53d0 0x56490beb77f0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0a7ee465f7b6437 server_cookie=8142eb6a9bd2e31 in_seq=0 out_seq=0 2024-08-18T22:12:15.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:15 smithi183 ceph-mon[22097]: pgmap v474: 129 pgs: 129 active+clean; 895 KiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 185 KiB/s wr, 171 op/s 2024-08-18T22:12:15.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:15 smithi123 ceph-mon[18462]: pgmap v474: 129 pgs: 129 active+clean; 895 KiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 185 KiB/s wr, 171 op/s 2024-08-18T22:12:15.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:15 smithi130 ceph-mon[21698]: pgmap v474: 129 pgs: 129 active+clean; 895 KiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 185 KiB/s wr, 171 op/s 2024-08-18T22:12:17.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:17 smithi183 ceph-mon[22097]: pgmap v475: 129 pgs: 129 active+clean; 6.9 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 705 KiB/s wr, 83 op/s 2024-08-18T22:12:17.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:17 smithi123 ceph-mon[18462]: pgmap v475: 129 pgs: 129 active+clean; 6.9 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 705 KiB/s wr, 83 op/s 2024-08-18T22:12:17.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:17 smithi130 ceph-mon[21698]: pgmap v475: 129 pgs: 129 active+clean; 6.9 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 705 KiB/s wr, 83 op/s 2024-08-18T22:12:18.700 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-18T22:12:18.975 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:12:19.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.455+0000 7f792dbc9640 1 -- 172.21.15.123:0/1103545018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79281007b0 msgr2=0x7f7928100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:19.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.455+0000 7f792dbc9640 1 --2- 172.21.15.123:0/1103545018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79281007b0 0x7f7928100c10 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7910009930 tx=0x7f791002a420 comp rx=0 tx=0).stop 2024-08-18T22:12:19.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.455+0000 7f792dbc9640 1 -- 172.21.15.123:0/1103545018 shutdown_connections 2024-08-18T22:12:19.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.455+0000 7f792dbc9640 1 --2- 172.21.15.123:0/1103545018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7928101150 0x7f792810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.455+0000 7f792dbc9640 1 --2- 172.21.15.123:0/1103545018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79281007b0 0x7f7928100c10 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.455+0000 7f792dbc9640 1 --2- 172.21.15.123:0/1103545018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79281067b0 0x7f7928106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.455+0000 7f792dbc9640 1 -- 172.21.15.123:0/1103545018 >> 172.21.15.123:0/1103545018 conn(0x7f79280fc4d0 msgr2=0x7f79280fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:19.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.455+0000 7f792dbc9640 1 -- 172.21.15.123:0/1103545018 shutdown_connections 2024-08-18T22:12:19.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.455+0000 7f792dbc9640 1 -- 172.21.15.123:0/1103545018 wait complete. 2024-08-18T22:12:19.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.456+0000 7f792dbc9640 1 Processor -- start 2024-08-18T22:12:19.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.456+0000 7f792dbc9640 1 -- start start 2024-08-18T22:12:19.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.456+0000 7f792dbc9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79281007b0 0x7f79281970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.456+0000 7f792dbc9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7928101150 0x7f7928197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.456+0000 7f792dbc9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79281067b0 0x7f792819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.456+0000 7f792dbc9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7928110bb0 con 0x7f7928101150 2024-08-18T22:12:19.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.456+0000 7f792dbc9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7928110a30 con 0x7f79281067b0 2024-08-18T22:12:19.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.456+0000 7f792dbc9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7928110d30 con 0x7f79281007b0 2024-08-18T22:12:19.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.456+0000 7f791effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7928101150 0x7f7928197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.456+0000 7f79277fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79281007b0 0x7f79281970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.456+0000 7f791effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7928101150 0x7f7928197610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50522/0 (socket says 172.21.15.123:50522) 2024-08-18T22:12:19.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.456+0000 7f791effd640 1 -- 172.21.15.123:0/1226116966 learned_addr learned my addr 172.21.15.123:0/1226116966 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:19.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.456+0000 7f7927fff640 1 --2- 172.21.15.123:0/1226116966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79281067b0 0x7f792819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.457+0000 7f791effd640 1 -- 172.21.15.123:0/1226116966 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79281007b0 msgr2=0x7f79281970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:19.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.457+0000 7f791effd640 1 --2- 172.21.15.123:0/1226116966 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79281007b0 0x7f79281970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.457+0000 7f791effd640 1 -- 172.21.15.123:0/1226116966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79281067b0 msgr2=0x7f792819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:19.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.457+0000 7f791effd640 1 --2- 172.21.15.123:0/1226116966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79281067b0 0x7f792819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.457+0000 7f791effd640 1 -- 172.21.15.123:0/1226116966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792819c080 con 0x7f7928101150 2024-08-18T22:12:19.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.457+0000 7f79277fe640 1 --2- 172.21.15.123:0/1226116966 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79281007b0 0x7f79281970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:12:19.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.457+0000 7f791effd640 1 --2- 172.21.15.123:0/1226116966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7928101150 0x7f7928197610 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7910009230 tx=0x7f7910004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:19.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.457+0000 7f79257fa640 1 -- 172.21.15.123:0/1226116966 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910046070 con 0x7f7928101150 2024-08-18T22:12:19.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.457+0000 7f79257fa640 1 -- 172.21.15.123:0/1226116966 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79100043c0 con 0x7f7928101150 2024-08-18T22:12:19.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.457+0000 7f792dbc9640 1 -- 172.21.15.123:0/1226116966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f792819c310 con 0x7f7928101150 2024-08-18T22:12:19.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.457+0000 7f79257fa640 1 -- 172.21.15.123:0/1226116966 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910035050 con 0x7f7928101150 2024-08-18T22:12:19.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.457+0000 7f792dbc9640 1 -- 172.21.15.123:0/1226116966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f792806a4c0 con 0x7f7928101150 2024-08-18T22:12:19.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.459+0000 7f79257fa640 1 -- 172.21.15.123:0/1226116966 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f7910049070 con 0x7f7928101150 2024-08-18T22:12:19.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.460+0000 7f792ffc7740 1 Processor -- start 2024-08-18T22:12:19.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.460+0000 7f792ffc7740 1 -- start start 2024-08-18T22:12:19.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.460+0000 7f79257fa640 1 --2- 172.21.15.123:0/1226116966 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f79140a2b80 0x7f79140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.460+0000 7f792ffc7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb0d0 0x563bdc5bb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.460+0000 7f792ffc7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb9f0 0x563bdc5ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.460+0000 7f792ffc7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5ca800 0x563bdc5ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.460+0000 7f792ffc7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x563bdc520980 con 0x563bdc5bb9f0 2024-08-18T22:12:19.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.460+0000 7f792ffc7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563bdc4b8a70 con 0x563bdc5ca800 2024-08-18T22:12:19.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.460+0000 7f792ffc7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563bdc51c940 con 0x563bdc5bb0d0 2024-08-18T22:12:19.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.460+0000 7f7927fff640 1 --2- 172.21.15.123:0/1226116966 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f79140a2b80 0x7f79140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.461+0000 7f79257fa640 1 -- 172.21.15.123:0/1226116966 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f79100f0d20 con 0x7f7928101150 2024-08-18T22:12:19.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.461+0000 7f79277fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb0d0 0x563bdc5bb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.461+0000 7f79277fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb0d0 0x563bdc5bb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:51756/0 (socket says 172.21.15.123:51756) 2024-08-18T22:12:19.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.461+0000 7f79277fe640 1 -- 172.21.15.123:0/2404668376 learned_addr learned my addr 172.21.15.123:0/2404668376 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:19.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.461+0000 7f791effd640 1 --2- 172.21.15.123:0/2404668376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb9f0 0x563bdc5ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.461+0000 7f79277fe640 1 -- 172.21.15.123:0/2404668376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5ca800 msgr2=0x563bdc5ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:19.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.461+0000 7f79277fe640 1 --2- 172.21.15.123:0/2404668376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5ca800 0x563bdc5ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.461+0000 7f79277fe640 1 -- 172.21.15.123:0/2404668376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb9f0 msgr2=0x563bdc5ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:19.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.461+0000 7f79277fe640 1 --2- 172.21.15.123:0/2404668376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb9f0 0x563bdc5ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.461+0000 7f79277fe640 1 -- 172.21.15.123:0/2404668376 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bdc51b6e0 con 0x563bdc5bb0d0 2024-08-18T22:12:19.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.461+0000 7f7927fff640 1 --2- 172.21.15.123:0/1226116966 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f79140a2b80 0x7f79140a5040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7920009be0 tx=0x7f7920011440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:19.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.461+0000 7f79277fe640 1 --2- 172.21.15.123:0/2404668376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb0d0 0x563bdc5bb4b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7918005f40 tx=0x7f7918011cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ffad27fb839d276 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:19.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.461+0000 7f791dffb640 1 -- 172.21.15.123:0/2404668376 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918011220 con 0x563bdc5bb0d0 2024-08-18T22:12:19.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.461+0000 7f791dffb640 1 -- 172.21.15.123:0/2404668376 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f791800f9a0 con 0x563bdc5bb0d0 2024-08-18T22:12:19.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.461+0000 7f791dffb640 1 -- 172.21.15.123:0/2404668376 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918004520 con 0x563bdc5bb0d0 2024-08-18T22:12:19.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.462+0000 7f792ffc7740 1 -- 172.21.15.123:0/2404668376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb0d0 msgr2=0x563bdc5bb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:19.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.462+0000 7f792ffc7740 1 --2- 172.21.15.123:0/2404668376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb0d0 0x563bdc5bb4b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7918005f40 tx=0x7f7918011cb0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.462+0000 7f792ffc7740 1 -- 172.21.15.123:0/2404668376 shutdown_connections 2024-08-18T22:12:19.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.462+0000 7f792ffc7740 1 --2- 172.21.15.123:0/2404668376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5ca800 0x563bdc5ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.462+0000 7f792ffc7740 1 --2- 172.21.15.123:0/2404668376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb9f0 0x563bdc5ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.462+0000 7f792ffc7740 1 --2- 172.21.15.123:0/2404668376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb0d0 0x563bdc5bb4b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.462+0000 7f792ffc7740 1 -- 172.21.15.123:0/2404668376 >> 172.21.15.123:0/2404668376 conn(0x563bdc5b77a0 msgr2=0x563bdc5b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:19.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.462+0000 7f792ffc7740 1 -- 172.21.15.123:0/2404668376 shutdown_connections 2024-08-18T22:12:19.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.462+0000 7f792ffc7740 1 -- 172.21.15.123:0/2404668376 wait complete. 2024-08-18T22:12:19.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.462+0000 7f792ffc7740 1 -- start start 2024-08-18T22:12:19.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f792ffc7740 1 Processor -- start 2024-08-18T22:12:19.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f792ffc7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5bb0d0 0x563bdc5c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f792ffc7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb9f0 0x563bdc5c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f792ffc7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5ca800 0x563bdc5c8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f792ffc7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x563bdc5cd3d0 con 0x563bdc5ca800 2024-08-18T22:12:19.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f792ffc7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563bdc4dbaa0 con 0x563bdc5bb0d0 2024-08-18T22:12:19.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f792ffc7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563bdc5cd550 con 0x563bdc5bb9f0 2024-08-18T22:12:19.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f792ffc7740 10 client.0 _ll_register_callbacks cb 0x563bdc4cae60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:19.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f7927fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5ca800 0x563bdc5c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f791effd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb9f0 0x563bdc5c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f7927fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5ca800 0x563bdc5c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50536/0 (socket says 172.21.15.123:50536) 2024-08-18T22:12:19.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f7927fff640 1 -- 172.21.15.123:0/3143130275 learned_addr learned my addr 172.21.15.123:0/3143130275 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:19.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f79277fe640 1 --2- 172.21.15.123:0/3143130275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5bb0d0 0x563bdc5c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f791effd640 1 -- 172.21.15.123:0/3143130275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5bb0d0 msgr2=0x563bdc5c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:19.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f791effd640 1 --2- 172.21.15.123:0/3143130275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5bb0d0 0x563bdc5c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f791effd640 1 -- 172.21.15.123:0/3143130275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5ca800 msgr2=0x563bdc5c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:19.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f791effd640 1 --2- 172.21.15.123:0/3143130275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5ca800 0x563bdc5c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f791effd640 1 -- 172.21.15.123:0/3143130275 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bdc4bf650 con 0x563bdc5bb9f0 2024-08-18T22:12:19.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f79277fe640 1 --2- 172.21.15.123:0/3143130275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5bb0d0 0x563bdc5c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:12:19.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f7927fff640 1 --2- 172.21.15.123:0/3143130275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5ca800 0x563bdc5c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:12:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f791effd640 1 --2- 172.21.15.123:0/3143130275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb9f0 0x563bdc5c7c40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7910009900 tx=0x7f79100bcc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26424c59fc3cca8f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.463+0000 7f7906ffd640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-08-18T22:12:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.464+0000 7f7906ffd640 1 -- 172.21.15.123:0/3143130275 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910038380 con 0x563bdc5bb9f0 2024-08-18T22:12:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.464+0000 7f7906ffd640 1 -- 172.21.15.123:0/3143130275 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f7910030b30 con 0x563bdc5bb9f0 2024-08-18T22:12:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.464+0000 7f792ffc7740 1 -- 172.21.15.123:0/3143130275 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f791800f9a0 con 0x563bdc5bb9f0 2024-08-18T22:12:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.464+0000 7f7906ffd640 1 -- 172.21.15.123:0/3143130275 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f79100c15a0 con 0x563bdc5bb9f0 2024-08-18T22:12:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.464+0000 7f792ffc7740 10 client.25663 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.464+0000 7f792ffc7740 1 -- 172.21.15.123:0/3143130275 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563bdc2923c0 con 0x563bdc5bb9f0 2024-08-18T22:12:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.464+0000 7f7906ffd640 1 -- 172.21.15.123:0/3143130275 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f791800f9a0 con 0x563bdc5bb9f0 2024-08-18T22:12:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.464+0000 7f7906ffd640 1 -- 172.21.15.123:0/3143130275 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f79100305c0 con 0x563bdc5bb9f0 2024-08-18T22:12:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.464+0000 7f792ffc7740 10 client.25663 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.464+0000 7f792ffc7740 10 client.25663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:19.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.464+0000 7f792ffc7740 20 client.25663 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:19.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.464+0000 7f792ffc7740 1 --2- 172.21.15.123:0/3143130275 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x563bdc5da3c0 0x563bdc5dc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.464+0000 7f792ffc7740 4 client.25663 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:12:19.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.464+0000 7f792ffc7740 1 -- 172.21.15.123:0/3143130275 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bdc52def0 con 0x563bdc5da3c0 2024-08-18T22:12:19.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.464+0000 7f79277fe640 1 --2- 172.21.15.123:0/3143130275 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x563bdc5da3c0 0x563bdc5dc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.465+0000 7f79277fe640 1 --2- 172.21.15.123:0/3143130275 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x563bdc5da3c0 0x563bdc5dc800 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=329253e4ff3b265e server_cookie=bfc4f75f39883201 in_seq=0 out_seq=0 2024-08-18T22:12:19.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.465+0000 7f7906ffd640 10 client.25663 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:19.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.549+0000 7f7906ffd640 1 -- 172.21.15.123:0/3143130275 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563bdc52def0 con 0x563bdc5da3c0 2024-08-18T22:12:19.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.549+0000 7f7906ffd640 10 client.25663 handle_command_reply: tid=0 2024-08-18T22:12:19.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.549+0000 7f792ffc7740 1 client.25663 shutdown 2024-08-18T22:12:19.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.549+0000 7f792ffc7740 1 -- 172.21.15.123:0/3143130275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb9f0 msgr2=0x563bdc5c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:19.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.549+0000 7f792ffc7740 1 --2- 172.21.15.123:0/3143130275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb9f0 0x563bdc5c7c40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7910009900 tx=0x7f79100bcc00 comp rx=0 tx=0).stop 2024-08-18T22:12:19.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.549+0000 7f792ffc7740 1 -- 172.21.15.123:0/3143130275 shutdown_connections 2024-08-18T22:12:19.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.549+0000 7f792ffc7740 1 --2- 172.21.15.123:0/3143130275 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x563bdc5da3c0 0x563bdc5dc800 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.549+0000 7f792ffc7740 1 --2- 172.21.15.123:0/3143130275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5ca800 0x563bdc5c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.549+0000 7f792ffc7740 1 --2- 172.21.15.123:0/3143130275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb9f0 0x563bdc5c7c40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.549+0000 7f792ffc7740 1 --2- 172.21.15.123:0/3143130275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5bb0d0 0x563bdc5c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.549+0000 7f7906ffd640 0 client.25663 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:19.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.549+0000 7f792ffc7740 1 -- 172.21.15.123:0/3143130275 >> 172.21.15.123:0/3143130275 conn(0x563bdc5b77a0 msgr2=0x563bdc5bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:19.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.549+0000 7f792ffc7740 1 -- 172.21.15.123:0/3143130275 shutdown_connections 2024-08-18T22:12:19.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.549+0000 7f792ffc7740 1 -- 172.21.15.123:0/3143130275 wait complete. 2024-08-18T22:12:19.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.550+0000 7f792ffc7740 20 client.25663 trim_cache size 0 max 16384 2024-08-18T22:12:19.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.568+0000 7f792ffc7740 1 Processor -- start 2024-08-18T22:12:19.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.568+0000 7f792ffc7740 1 -- start start 2024-08-18T22:12:19.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f792ffc7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb0d0 0x563bdc5c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f792ffc7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb9f0 0x563bdc5e2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f792ffc7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5ca800 0x563bdc5e2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f792ffc7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f79281af050 con 0x563bdc5bb0d0 2024-08-18T22:12:19.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f792ffc7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f79281ac920 con 0x563bdc5ca800 2024-08-18T22:12:19.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f792ffc7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f79281aa770 con 0x563bdc5bb9f0 2024-08-18T22:12:19.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f79277fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb0d0 0x563bdc5c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f791effd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb9f0 0x563bdc5e2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f79277fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb0d0 0x563bdc5c2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50548/0 (socket says 172.21.15.123:50548) 2024-08-18T22:12:19.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f7927fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5ca800 0x563bdc5e2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f79277fe640 1 -- 172.21.15.123:0/959481027 learned_addr learned my addr 172.21.15.123:0/959481027 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:19.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f791effd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb9f0 0x563bdc5e2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:51784/0 (socket says 172.21.15.123:51784) 2024-08-18T22:12:19.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f79277fe640 1 -- 172.21.15.123:0/959481027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb9f0 msgr2=0x563bdc5e2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:19.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f79277fe640 1 --2- 172.21.15.123:0/959481027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb9f0 0x563bdc5e2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f79277fe640 1 -- 172.21.15.123:0/959481027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5ca800 msgr2=0x563bdc5e2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:19.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f79277fe640 1 --2- 172.21.15.123:0/959481027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5ca800 0x563bdc5e2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f79277fe640 1 -- 172.21.15.123:0/959481027 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bdc5c5c50 con 0x563bdc5bb0d0 2024-08-18T22:12:19.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f79277fe640 1 --2- 172.21.15.123:0/959481027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb0d0 0x563bdc5c2a40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7918003a50 tx=0x7f7918004160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a1f561ed65af3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:19.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.569+0000 7f791d7fa640 1 -- 172.21.15.123:0/959481027 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791801e040 con 0x563bdc5bb0d0 2024-08-18T22:12:19.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.570+0000 7f791d7fa640 1 -- 172.21.15.123:0/959481027 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7918009480 con 0x563bdc5bb0d0 2024-08-18T22:12:19.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.570+0000 7f791d7fa640 1 -- 172.21.15.123:0/959481027 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918024420 con 0x563bdc5bb0d0 2024-08-18T22:12:19.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.570+0000 7f792ffc7740 1 -- 172.21.15.123:0/959481027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb0d0 msgr2=0x563bdc5c2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:19.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.570+0000 7f792ffc7740 1 --2- 172.21.15.123:0/959481027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb0d0 0x563bdc5c2a40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7918003a50 tx=0x7f7918004160 comp rx=0 tx=0).stop 2024-08-18T22:12:19.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.570+0000 7f792ffc7740 1 -- 172.21.15.123:0/959481027 shutdown_connections 2024-08-18T22:12:19.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.570+0000 7f792ffc7740 1 --2- 172.21.15.123:0/959481027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5ca800 0x563bdc5e2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.570+0000 7f792ffc7740 1 --2- 172.21.15.123:0/959481027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5bb9f0 0x563bdc5e2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.570+0000 7f792ffc7740 1 --2- 172.21.15.123:0/959481027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb0d0 0x563bdc5c2a40 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.570+0000 7f792ffc7740 1 -- 172.21.15.123:0/959481027 >> 172.21.15.123:0/959481027 conn(0x563bdc5b77a0 msgr2=0x563bdc5c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:19.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.571+0000 7f792ffc7740 1 -- 172.21.15.123:0/959481027 shutdown_connections 2024-08-18T22:12:19.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.571+0000 7f792ffc7740 1 -- 172.21.15.123:0/959481027 wait complete. 2024-08-18T22:12:19.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.571+0000 7f792ffc7740 1 -- start start 2024-08-18T22:12:19.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.571+0000 7f792ffc7740 1 Processor -- start 2024-08-18T22:12:19.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.571+0000 7f792ffc7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb0d0 0x563bdc5cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.571+0000 7f792ffc7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5bb9f0 0x563bdc5ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.571+0000 7f792ffc7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5ca800 0x563bdc6430d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.571+0000 7f792ffc7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f79281aade0 con 0x563bdc5bb0d0 2024-08-18T22:12:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.571+0000 7f792ffc7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f79281ac250 con 0x563bdc5bb9f0 2024-08-18T22:12:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.571+0000 7f792ffc7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f79281ab4b0 con 0x563bdc5ca800 2024-08-18T22:12:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.571+0000 7f792ffc7740 10 client.0 _ll_register_callbacks cb 0x7f7910004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f79277fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb0d0 0x563bdc5cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f79277fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb0d0 0x563bdc5cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50562/0 (socket says 172.21.15.123:50562) 2024-08-18T22:12:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f79277fe640 1 -- 172.21.15.123:0/2222958540 learned_addr learned my addr 172.21.15.123:0/2222958540 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f791effd640 1 --2- 172.21.15.123:0/2222958540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5bb9f0 0x563bdc5ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f7927fff640 1 --2- 172.21.15.123:0/2222958540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5ca800 0x563bdc6430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f79277fe640 1 -- 172.21.15.123:0/2222958540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5ca800 msgr2=0x563bdc6430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f79277fe640 1 --2- 172.21.15.123:0/2222958540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5ca800 0x563bdc6430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f79277fe640 1 -- 172.21.15.123:0/2222958540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5bb9f0 msgr2=0x563bdc5ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f79277fe640 1 --2- 172.21.15.123:0/2222958540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5bb9f0 0x563bdc5ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f79277fe640 1 -- 172.21.15.123:0/2222958540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bdc643610 con 0x563bdc5bb0d0 2024-08-18T22:12:19.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f791effd640 1 --2- 172.21.15.123:0/2222958540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5bb9f0 0x563bdc5ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:12:19.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f7927fff640 1 --2- 172.21.15.123:0/2222958540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5ca800 0x563bdc6430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:19.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f79277fe640 1 --2- 172.21.15.123:0/2222958540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb0d0 0x563bdc5cdd40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f79180099d0 tx=0x7f791800fef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51bb67ff0664e725 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:19.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f7906ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:19.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f7906ffd640 1 -- 172.21.15.123:0/2222958540 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918011020 con 0x563bdc5bb0d0 2024-08-18T22:12:19.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f7906ffd640 1 -- 172.21.15.123:0/2222958540 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f79180111c0 con 0x563bdc5bb0d0 2024-08-18T22:12:19.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.572+0000 7f792ffc7740 1 -- 172.21.15.123:0/2222958540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7918009480 con 0x563bdc5bb0d0 2024-08-18T22:12:19.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.573+0000 7f7906ffd640 1 -- 172.21.15.123:0/2222958540 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7918005040 con 0x563bdc5bb0d0 2024-08-18T22:12:19.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.573+0000 7f792ffc7740 10 client.16233 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:19.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.573+0000 7f792ffc7740 1 -- 172.21.15.123:0/2222958540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563bdc644860 con 0x563bdc5bb0d0 2024-08-18T22:12:19.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.573+0000 7f7906ffd640 1 -- 172.21.15.123:0/2222958540 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79180056c0 con 0x563bdc5bb0d0 2024-08-18T22:12:19.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.573+0000 7f7906ffd640 1 -- 172.21.15.123:0/2222958540 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7918018070 con 0x563bdc5bb0d0 2024-08-18T22:12:19.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.573+0000 7f792ffc7740 10 client.16233 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:19.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.573+0000 7f792ffc7740 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:19.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.573+0000 7f792ffc7740 20 client.16233 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:19.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.573+0000 7f792ffc7740 1 --2- 172.21.15.123:0/2222958540 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x563bdc644db0 0x563bdc6471d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:19.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.573+0000 7f792ffc7740 4 client.16233 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:12:19.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.573+0000 7f792ffc7740 1 -- 172.21.15.123:0/2222958540 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f7918009480 con 0x563bdc644db0 2024-08-18T22:12:19.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.573+0000 7f791effd640 1 --2- 172.21.15.123:0/2222958540 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x563bdc644db0 0x563bdc6471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:19.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.574+0000 7f791effd640 1 --2- 172.21.15.123:0/2222958540 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x563bdc644db0 0x563bdc6471d0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15bcec1af56e68c1 server_cookie=1d33f572079ea88f in_seq=0 out_seq=0 2024-08-18T22:12:19.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.574+0000 7f7906ffd640 10 client.16233 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.577+0000 7f7906ffd640 1 -- 172.21.15.123:0/2222958540 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f7918009480 con 0x563bdc644db0 2024-08-18T22:12:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.577+0000 7f7906ffd640 10 client.16233 handle_command_reply: tid=0 2024-08-18T22:12:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.577+0000 7f792ffc7740 1 client.16233 shutdown 2024-08-18T22:12:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.577+0000 7f792ffc7740 1 -- 172.21.15.123:0/2222958540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb0d0 msgr2=0x563bdc5cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.577+0000 7f792ffc7740 1 --2- 172.21.15.123:0/2222958540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb0d0 0x563bdc5cdd40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f79180099d0 tx=0x7f791800fef0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.577+0000 7f792ffc7740 1 -- 172.21.15.123:0/2222958540 shutdown_connections 2024-08-18T22:12:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.577+0000 7f792ffc7740 1 --2- 172.21.15.123:0/2222958540 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x563bdc644db0 0x563bdc6471d0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f7906ffd640 0 client.16233 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792ffc7740 1 --2- 172.21.15.123:0/2222958540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563bdc5ca800 0x563bdc6430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792ffc7740 1 --2- 172.21.15.123:0/2222958540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563bdc5bb9f0 0x563bdc5ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792ffc7740 1 --2- 172.21.15.123:0/2222958540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bdc5bb0d0 0x563bdc5cdd40 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792ffc7740 1 -- 172.21.15.123:0/2222958540 >> 172.21.15.123:0/2222958540 conn(0x563bdc5b77a0 msgr2=0x563bdc5b60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:19.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792ffc7740 1 -- 172.21.15.123:0/2222958540 shutdown_connections 2024-08-18T22:12:19.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792ffc7740 1 -- 172.21.15.123:0/2222958540 wait complete. 2024-08-18T22:12:19.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792ffc7740 20 client.16233 trim_cache size 0 max 16384 2024-08-18T22:12:19.586 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:12:19.586 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "no active scrubs running", 2024-08-18T22:12:19.586 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-08-18T22:12:19.586 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:12:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792dbc9640 1 -- 172.21.15.123:0/1226116966 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f79140a2b80 msgr2=0x7f79140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792dbc9640 1 --2- 172.21.15.123:0/1226116966 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f79140a2b80 0x7f79140a5040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7920009be0 tx=0x7f7920011440 comp rx=0 tx=0).stop 2024-08-18T22:12:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792dbc9640 1 -- 172.21.15.123:0/1226116966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7928101150 msgr2=0x7f7928197610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792dbc9640 1 --2- 172.21.15.123:0/1226116966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7928101150 0x7f7928197610 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7910009230 tx=0x7f7910004040 comp rx=0 tx=0).stop 2024-08-18T22:12:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792dbc9640 1 -- 172.21.15.123:0/1226116966 shutdown_connections 2024-08-18T22:12:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792dbc9640 1 --2- 172.21.15.123:0/1226116966 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f79140a2b80 0x7f79140a5040 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792dbc9640 1 --2- 172.21.15.123:0/1226116966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79281067b0 0x7f792819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792dbc9640 1 --2- 172.21.15.123:0/1226116966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7928101150 0x7f7928197610 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792dbc9640 1 --2- 172.21.15.123:0/1226116966 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79281007b0 0x7f79281970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:19.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.578+0000 7f792dbc9640 1 -- 172.21.15.123:0/1226116966 >> 172.21.15.123:0/1226116966 conn(0x7f79280fc4d0 msgr2=0x7f79280fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:19.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.579+0000 7f792dbc9640 1 -- 172.21.15.123:0/1226116966 shutdown_connections 2024-08-18T22:12:19.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:19.579+0000 7f792dbc9640 1 -- 172.21.15.123:0/1226116966 wait complete. 2024-08-18T22:12:19.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:19 smithi183 ceph-mon[22097]: pgmap v476: 129 pgs: 129 active+clean; 6.9 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 717 KiB/s wr, 81 op/s 2024-08-18T22:12:19.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:19 smithi123 ceph-mon[18462]: pgmap v476: 129 pgs: 129 active+clean; 6.9 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 717 KiB/s wr, 81 op/s 2024-08-18T22:12:19.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:19 smithi130 ceph-mon[21698]: pgmap v476: 129 pgs: 129 active+clean; 6.9 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 717 KiB/s wr, 81 op/s 2024-08-18T22:12:20.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.718+0000 7f9d03fff640 1 -- 172.21.15.123:0/2608363800 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56490bd984f0 con 0x56490beb53d0 2024-08-18T22:12:20.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.718+0000 7f9d03fff640 10 client.16215 handle_command_reply: tid=0 2024-08-18T22:12:20.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.718+0000 7f9d2d5aa740 1 client.16215 shutdown 2024-08-18T22:12:20.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.718+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/2608363800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be36310 msgr2=0x56490be49320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:20.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.718+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/2608363800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be36310 0x56490be49320 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009430 tx=0x7f9d1c02a8e0 comp rx=0 tx=0).stop 2024-08-18T22:12:20.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.718+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/2608363800 shutdown_connections 2024-08-18T22:12:20.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.718+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/2608363800 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56490beb53d0 0x56490beb77f0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.718+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/2608363800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56490be36310 0x56490be49320 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.718+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/2608363800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56490be2ba50 0x56490be48b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.718+0000 7f9d2d5aa740 1 --2- 172.21.15.123:0/2608363800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56490be2b130 0x56490be4b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.718+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/2608363800 >> 172.21.15.123:0/2608363800 conn(0x56490be276c0 msgr2=0x56490be412b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.718+0000 7f9d03fff640 0 client.16215 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.719+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/2608363800 shutdown_connections 2024-08-18T22:12:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.719+0000 7f9d2d5aa740 1 -- 172.21.15.123:0/2608363800 wait complete. 2024-08-18T22:12:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.719+0000 7f9d2d5aa740 20 client.16215 trim_cache size 0 max 16384 2024-08-18T22:12:20.721 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:12:20.721 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 27, 2024-08-18T22:12:20.722 INFO:teuthology.orchestra.run.smithi123.stdout: "leader": 24466, 2024-08-18T22:12:20.722 INFO:teuthology.orchestra.run.smithi123.stdout: "set_version": 14, 2024-08-18T22:12:20.722 INFO:teuthology.orchestra.run.smithi123.stdout: "sets": { 2024-08-18T22:12:20.722 INFO:teuthology.orchestra.run.smithi123.stdout: "b9516e05": { 2024-08-18T22:12:20.722 INFO:teuthology.orchestra.run.smithi123.stdout: "version": 14, 2024-08-18T22:12:20.722 INFO:teuthology.orchestra.run.smithi123.stdout: "age_ref": 0.0, 2024-08-18T22:12:20.722 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:12:20.722 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "QUIESCED", 2024-08-18T22:12:20.722 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:12:20.722 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:12:20.722 INFO:teuthology.orchestra.run.smithi123.stdout: "timeout": 90.0, 2024-08-18T22:12:20.722 INFO:teuthology.orchestra.run.smithi123.stdout: "expiration": 150.0, 2024-08-18T22:12:20.723 INFO:teuthology.orchestra.run.smithi123.stdout: "members": { 2024-08-18T22:12:20.723 INFO:teuthology.orchestra.run.smithi123.stdout: "file:/": { 2024-08-18T22:12:20.723 INFO:teuthology.orchestra.run.smithi123.stdout: "excluded": false, 2024-08-18T22:12:20.723 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:12:20.723 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "QUIESCED", 2024-08-18T22:12:20.723 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:12:20.723 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:20.723 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:20.723 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:20.723 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:20.723 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:20.723 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:12:20.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.719+0000 7f9d2b1ac640 1 -- 172.21.15.123:0/2883592510 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9d140a4d90 msgr2=0x7f9d140a7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:20.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.719+0000 7f9d2b1ac640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9d140a4d90 0x7f9d140a7250 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9d180ccf90 tx=0x7f9d180911d0 comp rx=0 tx=0).stop 2024-08-18T22:12:20.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.719+0000 7f9d2b1ac640 1 -- 172.21.15.123:0/2883592510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d241007a0 msgr2=0x7f9d24197020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:20.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.719+0000 7f9d2b1ac640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d241007a0 0x7f9d24197020 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800e9f0 tx=0x7f9d1800edf0 comp rx=0 tx=0).stop 2024-08-18T22:12:20.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.719+0000 7f9d2b1ac640 1 -- 172.21.15.123:0/2883592510 shutdown_connections 2024-08-18T22:12:20.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.719+0000 7f9d2b1ac640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9d140a4d90 0x7f9d140a7250 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:20.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.719+0000 7f9d2b1ac640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d241067a0 0x7f9d2419b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:20.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.719+0000 7f9d2b1ac640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d24101140 0x7f9d24197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:20.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.720+0000 7f9d2b1ac640 1 --2- 172.21.15.123:0/2883592510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d241007a0 0x7f9d24197020 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:20.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.720+0000 7f9d2b1ac640 1 -- 172.21.15.123:0/2883592510 >> 172.21.15.123:0/2883592510 conn(0x7f9d240fc4c0 msgr2=0x7f9d240fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:20.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.720+0000 7f9d2b1ac640 1 -- 172.21.15.123:0/2883592510 shutdown_connections 2024-08-18T22:12:20.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:20.720+0000 7f9d2b1ac640 1 -- 172.21.15.123:0/2883592510 wait complete. 2024-08-18T22:12:21.023 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-18T22:12:21.023 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:12:21.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:21 smithi183 ceph-mon[22097]: pgmap v477: 129 pgs: 129 active+clean; 8.9 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 957 KiB/s wr, 161 op/s 2024-08-18T22:12:21.691 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:21 smithi123 ceph-mon[18462]: pgmap v477: 129 pgs: 129 active+clean; 8.9 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 957 KiB/s wr, 161 op/s 2024-08-18T22:12:21.721 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b9516e05', quiesce took 9.3 seconds. Will release after: 20.7 2024-08-18T22:12:21.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:21 smithi130 ceph-mon[21698]: pgmap v477: 129 pgs: 129 active+clean; 8.9 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 957 KiB/s wr, 161 op/s 2024-08-18T22:12:21.803 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:12:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.336+0000 7f388fe7d640 1 -- 172.21.15.123:0/366061805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3888102310 msgr2=0x7f3888104700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.336+0000 7f388fe7d640 1 --2- 172.21.15.123:0/366061805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3888102310 0x7f3888104700 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3884009900 tx=0x7f388402a410 comp rx=0 tx=0).stop 2024-08-18T22:12:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.337+0000 7f388fe7d640 1 -- 172.21.15.123:0/366061805 shutdown_connections 2024-08-18T22:12:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.337+0000 7f388fe7d640 1 --2- 172.21.15.123:0/366061805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3888107570 0x7f38881099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.337+0000 7f388fe7d640 1 --2- 172.21.15.123:0/366061805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3888104c40 0x7f3888107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.337+0000 7f388fe7d640 1 --2- 172.21.15.123:0/366061805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3888102310 0x7f3888104700 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.337+0000 7f388fe7d640 1 -- 172.21.15.123:0/366061805 >> 172.21.15.123:0/366061805 conn(0x7f38880fbf10 msgr2=0x7f38880fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.337+0000 7f388fe7d640 1 -- 172.21.15.123:0/366061805 shutdown_connections 2024-08-18T22:12:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.337+0000 7f388fe7d640 1 -- 172.21.15.123:0/366061805 wait complete. 2024-08-18T22:12:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.337+0000 7f388fe7d640 1 Processor -- start 2024-08-18T22:12:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.337+0000 7f388fe7d640 1 -- start start 2024-08-18T22:12:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.337+0000 7f388fe7d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3888102310 0x7f3888101c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.337+0000 7f388fe7d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3888104c40 0x7f38881002c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388fe7d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3888107570 0x7f3888100800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388fe7d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f388810d550 con 0x7f3888107570 2024-08-18T22:12:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388fe7d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f388810d3d0 con 0x7f3888102310 2024-08-18T22:12:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388fe7d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f388810d6d0 con 0x7f3888104c40 2024-08-18T22:12:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388e41a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3888107570 0x7f3888100800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388e41a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3888107570 0x7f3888100800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50576/0 (socket says 172.21.15.123:50576) 2024-08-18T22:12:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388d418640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3888104c40 0x7f38881002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388e41a640 1 -- 172.21.15.123:0/2231654190 learned_addr learned my addr 172.21.15.123:0/2231654190 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388dc19640 1 --2- 172.21.15.123:0/2231654190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3888102310 0x7f3888101c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388e41a640 1 -- 172.21.15.123:0/2231654190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3888104c40 msgr2=0x7f38881002c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388e41a640 1 --2- 172.21.15.123:0/2231654190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3888104c40 0x7f38881002c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388e41a640 1 -- 172.21.15.123:0/2231654190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3888102310 msgr2=0x7f3888101c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388e41a640 1 --2- 172.21.15.123:0/2231654190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3888102310 0x7f3888101c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388e41a640 1 -- 172.21.15.123:0/2231654190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3888101090 con 0x7f3888107570 2024-08-18T22:12:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388d418640 1 --2- 172.21.15.123:0/2231654190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3888104c40 0x7f38881002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:12:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388e41a640 1 --2- 172.21.15.123:0/2231654190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3888107570 0x7f3888100800 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f388000e9d0 tx=0x7f388000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f387effd640 1 -- 172.21.15.123:0/2231654190 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388000cd80 con 0x7f3888107570 2024-08-18T22:12:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f387effd640 1 -- 172.21.15.123:0/2231654190 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3880005020 con 0x7f3888107570 2024-08-18T22:12:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f388fe7d640 1 -- 172.21.15.123:0/2231654190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38881a1cc0 con 0x7f3888107570 2024-08-18T22:12:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.338+0000 7f387effd640 1 -- 172.21.15.123:0/2231654190 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38800116d0 con 0x7f3888107570 2024-08-18T22:12:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.339+0000 7f388fe7d640 1 -- 172.21.15.123:0/2231654190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38881a21c0 con 0x7f3888107570 2024-08-18T22:12:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.341+0000 7f387effd640 1 -- 172.21.15.123:0/2231654190 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f38800051d0 con 0x7f3888107570 2024-08-18T22:12:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.341+0000 7f3892c3c740 1 Processor -- start 2024-08-18T22:12:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.341+0000 7f3892c3c740 1 -- start start 2024-08-18T22:12:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f3892c3c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713f4680 0x5575713f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f3892c3c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4fc0 0x5575713f9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f3892c3c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713fa050 0x5575713fc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f3892c3c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5575713579d0 con 0x5575713f4fc0 2024-08-18T22:12:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f3892c3c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5575712ff820 con 0x5575713fa050 2024-08-18T22:12:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f3892c3c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557571353990 con 0x5575713f4680 2024-08-18T22:12:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f388dc19640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4fc0 0x5575713f9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f388dc19640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4fc0 0x5575713f9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50584/0 (socket says 172.21.15.123:50584) 2024-08-18T22:12:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f388dc19640 1 -- 172.21.15.123:0/983204536 learned_addr learned my addr 172.21.15.123:0/983204536 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f387effd640 1 --2- 172.21.15.123:0/2231654190 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f38740a2cb0 0x7f38740a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f388d418640 1 --2- 172.21.15.123:0/983204536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713fa050 0x5575713fc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f388d418640 1 --2- 172.21.15.123:0/983204536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713f4680 0x5575713f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f388e41a640 1 --2- 172.21.15.123:0/2231654190 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f38740a2cb0 0x7f38740a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f388dc19640 1 -- 172.21.15.123:0/983204536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713f4680 msgr2=0x5575713f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f388dc19640 1 --2- 172.21.15.123:0/983204536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713f4680 0x5575713f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f388dc19640 1 -- 172.21.15.123:0/983204536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713fa050 msgr2=0x5575713fc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f388dc19640 1 --2- 172.21.15.123:0/983204536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713fa050 0x5575713fc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f388dc19640 1 -- 172.21.15.123:0/983204536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55757106b210 con 0x5575713f4fc0 2024-08-18T22:12:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f388d418640 1 --2- 172.21.15.123:0/983204536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713f4680 0x5575713f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f387effd640 1 -- 172.21.15.123:0/2231654190 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f38800cf900 con 0x7f3888107570 2024-08-18T22:12:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f388dc19640 1 --2- 172.21.15.123:0/983204536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4fc0 0x5575713f9a80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f388402a930 tx=0x7f3884005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cf36c5b6ef3a63 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.342+0000 7f388e41a640 1 --2- 172.21.15.123:0/2231654190 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f38740a2cb0 0x7f38740a5170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f38800cd3e0 tx=0x7f388006ef40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.343+0000 7f3873fff640 1 -- 172.21.15.123:0/983204536 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884040070 con 0x5575713f4fc0 2024-08-18T22:12:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.343+0000 7f3873fff640 1 -- 172.21.15.123:0/983204536 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38840318b0 con 0x5575713f4fc0 2024-08-18T22:12:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.343+0000 7f3873fff640 1 -- 172.21.15.123:0/983204536 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884035040 con 0x5575713f4fc0 2024-08-18T22:12:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.343+0000 7f3892c3c740 1 -- 172.21.15.123:0/983204536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4fc0 msgr2=0x5575713f9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.343+0000 7f3892c3c740 1 --2- 172.21.15.123:0/983204536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4fc0 0x5575713f9a80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f388402a930 tx=0x7f3884005c00 comp rx=0 tx=0).stop 2024-08-18T22:12:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.343+0000 7f3892c3c740 1 -- 172.21.15.123:0/983204536 shutdown_connections 2024-08-18T22:12:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.343+0000 7f3892c3c740 1 --2- 172.21.15.123:0/983204536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713fa050 0x5575713fc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.343+0000 7f3892c3c740 1 --2- 172.21.15.123:0/983204536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4fc0 0x5575713f9a80 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.343+0000 7f3892c3c740 1 --2- 172.21.15.123:0/983204536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713f4680 0x5575713f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.343+0000 7f3892c3c740 1 -- 172.21.15.123:0/983204536 >> 172.21.15.123:0/983204536 conn(0x5575713efcf0 msgr2=0x5575713f00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.343+0000 7f3892c3c740 1 -- 172.21.15.123:0/983204536 shutdown_connections 2024-08-18T22:12:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.343+0000 7f3892c3c740 1 -- 172.21.15.123:0/983204536 wait complete. 2024-08-18T22:12:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.344+0000 7f3892c3c740 1 -- start start 2024-08-18T22:12:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.344+0000 7f3892c3c740 1 Processor -- start 2024-08-18T22:12:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.344+0000 7f3892c3c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4680 0x5575713fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.344+0000 7f3892c3c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713f4fc0 0x5575713fece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.344+0000 7f3892c3c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713fa050 0x557571405d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.344+0000 7f3892c3c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5575713fcfc0 con 0x5575713f4680 2024-08-18T22:12:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.344+0000 7f3892c3c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557571313520 con 0x5575713fa050 2024-08-18T22:12:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.344+0000 7f3892c3c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5575713fd140 con 0x5575713f4fc0 2024-08-18T22:12:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.344+0000 7f3892c3c740 10 client.0 _ll_register_callbacks cb 0x55757106aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.344+0000 7f388d418640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4680 0x5575713fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.344+0000 7f388d418640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4680 0x5575713fe7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50592/0 (socket says 172.21.15.123:50592) 2024-08-18T22:12:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.344+0000 7f388d418640 1 -- 172.21.15.123:0/874992746 learned_addr learned my addr 172.21.15.123:0/874992746 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f388d418640 1 --2- 172.21.15.123:0/874992746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713fa050 0x557571405d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f388dc19640 1 --2- 172.21.15.123:0/874992746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713f4fc0 0x5575713fece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f388d418640 1 -- 172.21.15.123:0/874992746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713f4fc0 msgr2=0x5575713fece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f388d418640 1 --2- 172.21.15.123:0/874992746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713f4fc0 0x5575713fece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f388d418640 1 -- 172.21.15.123:0/874992746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713fa050 msgr2=0x557571405d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f388d418640 1 --2- 172.21.15.123:0/874992746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713fa050 0x557571405d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f388d418640 1 -- 172.21.15.123:0/874992746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557571137620 con 0x5575713f4680 2024-08-18T22:12:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f388d418640 1 --2- 172.21.15.123:0/874992746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4680 0x5575713fe7a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3878012b70 tx=0x7f3878004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d97beaff471f15a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f38717fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f38717fa640 1 -- 172.21.15.123:0/874992746 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878004020 con 0x5575713f4680 2024-08-18T22:12:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f38717fa640 1 -- 172.21.15.123:0/874992746 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f38780041c0 con 0x5575713f4680 2024-08-18T22:12:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f3892c3c740 1 -- 172.21.15.123:0/874992746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38840318b0 con 0x5575713f4680 2024-08-18T22:12:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f38717fa640 1 -- 172.21.15.123:0/874992746 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f38780043c0 con 0x5575713f4680 2024-08-18T22:12:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f3892c3c740 10 client.16245 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f3892c3c740 1 -- 172.21.15.123:0/874992746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557571408be0 con 0x5575713f4680 2024-08-18T22:12:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.345+0000 7f38717fa640 1 -- 172.21.15.123:0/874992746 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38840318b0 con 0x5575713f4680 2024-08-18T22:12:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.346+0000 7f38717fa640 1 -- 172.21.15.123:0/874992746 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f387801f630 con 0x5575713f4680 2024-08-18T22:12:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.346+0000 7f3892c3c740 10 client.16245 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.346+0000 7f3892c3c740 10 client.16245 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.346+0000 7f3892c3c740 20 client.16245 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.346+0000 7f3892c3c740 1 --2- 172.21.15.123:0/874992746 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55757140a2d0 0x55757140c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.346+0000 7f3892c3c740 4 client.16245 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:12:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.346+0000 7f3892c3c740 1 -- 172.21.15.123:0/874992746 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557571365100 con 0x55757140a2d0 2024-08-18T22:12:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.346+0000 7f388dc19640 1 --2- 172.21.15.123:0/874992746 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55757140a2d0 0x55757140c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.346+0000 7f38717fa640 10 client.16245 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.346+0000 7f388dc19640 1 --2- 172.21.15.123:0/874992746 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55757140a2d0 0x55757140c750 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=543ee8678b1d816e server_cookie=f36a47e43f86815f in_seq=0 out_seq=0 2024-08-18T22:12:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.347+0000 7f38717fa640 1 -- 172.21.15.123:0/874992746 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557571365100 con 0x55757140a2d0 2024-08-18T22:12:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.347+0000 7f38717fa640 10 client.16245 handle_command_reply: tid=0 2024-08-18T22:12:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.347+0000 7f3892c3c740 1 client.16245 shutdown 2024-08-18T22:12:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.347+0000 7f3892c3c740 1 -- 172.21.15.123:0/874992746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4680 msgr2=0x5575713fe7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.347+0000 7f3892c3c740 1 --2- 172.21.15.123:0/874992746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4680 0x5575713fe7a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3878012b70 tx=0x7f3878004730 comp rx=0 tx=0).stop 2024-08-18T22:12:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.347+0000 7f3892c3c740 1 -- 172.21.15.123:0/874992746 shutdown_connections 2024-08-18T22:12:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.347+0000 7f3892c3c740 1 --2- 172.21.15.123:0/874992746 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55757140a2d0 0x55757140c750 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.347+0000 7f3892c3c740 1 --2- 172.21.15.123:0/874992746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713fa050 0x557571405d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.347+0000 7f3892c3c740 1 --2- 172.21.15.123:0/874992746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713f4fc0 0x5575713fece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.347+0000 7f3892c3c740 1 --2- 172.21.15.123:0/874992746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4680 0x5575713fe7a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.347+0000 7f38717fa640 0 client.16245 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.347+0000 7f3892c3c740 1 -- 172.21.15.123:0/874992746 >> 172.21.15.123:0/874992746 conn(0x5575713efcf0 msgr2=0x5575713f1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.347+0000 7f3892c3c740 1 -- 172.21.15.123:0/874992746 shutdown_connections 2024-08-18T22:12:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.347+0000 7f3892c3c740 1 -- 172.21.15.123:0/874992746 wait complete. 2024-08-18T22:12:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.347+0000 7f3892c3c740 20 client.16245 trim_cache size 0 max 16384 2024-08-18T22:12:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.362+0000 7f3892c3c740 1 Processor -- start 2024-08-18T22:12:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.362+0000 7f3892c3c740 1 -- start start 2024-08-18T22:12:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.362+0000 7f3892c3c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713f4680 0x5575713fea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.362+0000 7f3892c3c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713f4fc0 0x557571405ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.362+0000 7f3892c3c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713fa050 0x5575713f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.362+0000 7f3892c3c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f38881aeff0 con 0x5575713fa050 2024-08-18T22:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.362+0000 7f3892c3c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f38881ac8c0 con 0x5575713f4680 2024-08-18T22:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.362+0000 7f3892c3c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f38881aa710 con 0x5575713f4fc0 2024-08-18T22:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.362+0000 7f388d418640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713fa050 0x5575713f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.362+0000 7f388d418640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713fa050 0x5575713f0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50598/0 (socket says 172.21.15.123:50598) 2024-08-18T22:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.363+0000 7f388d418640 1 -- 172.21.15.123:0/2632847036 learned_addr learned my addr 172.21.15.123:0/2632847036 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.363+0000 7f388d418640 1 -- 172.21.15.123:0/2632847036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713f4fc0 msgr2=0x557571405ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.363+0000 7f388d418640 1 --2- 172.21.15.123:0/2632847036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713f4fc0 0x557571405ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.363+0000 7f388d418640 1 -- 172.21.15.123:0/2632847036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713f4680 msgr2=0x5575713fea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.363+0000 7f388d418640 1 --2- 172.21.15.123:0/2632847036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713f4680 0x5575713fea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.363+0000 7f388d418640 1 -- 172.21.15.123:0/2632847036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575713f5810 con 0x5575713fa050 2024-08-18T22:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.363+0000 7f388d418640 1 --2- 172.21.15.123:0/2632847036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713fa050 0x5575713f0ba0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f387801fad0 tx=0x7f3878000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b892325caa0af066 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.363+0000 7f38737fe640 1 -- 172.21.15.123:0/2632847036 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878000e60 con 0x5575713fa050 2024-08-18T22:12:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.363+0000 7f38737fe640 1 -- 172.21.15.123:0/2632847036 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f387801fcc0 con 0x5575713fa050 2024-08-18T22:12:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.363+0000 7f38737fe640 1 -- 172.21.15.123:0/2632847036 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878004dd0 con 0x5575713fa050 2024-08-18T22:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 -- 172.21.15.123:0/2632847036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713fa050 msgr2=0x5575713f0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 --2- 172.21.15.123:0/2632847036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713fa050 0x5575713f0ba0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f387801fad0 tx=0x7f3878000bc0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 -- 172.21.15.123:0/2632847036 shutdown_connections 2024-08-18T22:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 --2- 172.21.15.123:0/2632847036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713fa050 0x5575713f0ba0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 --2- 172.21.15.123:0/2632847036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713f4fc0 0x557571405ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 --2- 172.21.15.123:0/2632847036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713f4680 0x5575713fea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 -- 172.21.15.123:0/2632847036 >> 172.21.15.123:0/2632847036 conn(0x5575713efcf0 msgr2=0x5575713fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 -- 172.21.15.123:0/2632847036 shutdown_connections 2024-08-18T22:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 -- 172.21.15.123:0/2632847036 wait complete. 2024-08-18T22:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 -- start start 2024-08-18T22:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 Processor -- start 2024-08-18T22:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4680 0x557571403490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713f4fc0 0x5575714039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713fa050 0x5575714049e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f38881aad80 con 0x5575713f4680 2024-08-18T22:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f38881ac1f0 con 0x5575713f4fc0 2024-08-18T22:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.364+0000 7f3892c3c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f38881ab450 con 0x5575713fa050 2024-08-18T22:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f3892c3c740 10 client.0 _ll_register_callbacks cb 0x7f38780124f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f388d418640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4680 0x557571403490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f388d418640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4680 0x557571403490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50610/0 (socket says 172.21.15.123:50610) 2024-08-18T22:12:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f388d418640 1 -- 172.21.15.123:0/1507393127 learned_addr learned my addr 172.21.15.123:0/1507393127 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f388dc19640 1 --2- 172.21.15.123:0/1507393127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713f4fc0 0x5575714039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f388d418640 1 -- 172.21.15.123:0/1507393127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713fa050 msgr2=0x5575714049e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f388d418640 1 --2- 172.21.15.123:0/1507393127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713fa050 0x5575714049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f388d418640 1 -- 172.21.15.123:0/1507393127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713f4fc0 msgr2=0x5575714039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f388d418640 1 --2- 172.21.15.123:0/1507393127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713f4fc0 0x5575714039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f388d418640 1 -- 172.21.15.123:0/1507393127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557571404ff0 con 0x5575713f4680 2024-08-18T22:12:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f388d418640 1 --2- 172.21.15.123:0/1507393127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4680 0x557571403490 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f387802b630 tx=0x7f387802b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cdd3202c890f46 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f38717fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f38717fa640 1 -- 172.21.15.123:0/1507393127 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387800bea0 con 0x5575713f4680 2024-08-18T22:12:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f38717fa640 1 -- 172.21.15.123:0/1507393127 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f3878030040 con 0x5575713f4680 2024-08-18T22:12:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f3892c3c740 1 -- 172.21.15.123:0/1507393127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f387801fcc0 con 0x5575713f4680 2024-08-18T22:12:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f38717fa640 1 -- 172.21.15.123:0/1507393127 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3878004730 con 0x5575713f4680 2024-08-18T22:12:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f3892c3c740 10 client.16251 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f3892c3c740 1 -- 172.21.15.123:0/1507393127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557571475120 con 0x5575713f4680 2024-08-18T22:12:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.365+0000 7f38717fa640 1 -- 172.21.15.123:0/1507393127 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f387801fcc0 con 0x5575713f4680 2024-08-18T22:12:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.366+0000 7f38717fa640 1 -- 172.21.15.123:0/1507393127 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f38780349e0 con 0x5575713f4680 2024-08-18T22:12:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.366+0000 7f3892c3c740 10 client.16251 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.366+0000 7f3892c3c740 10 client.16251 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.366+0000 7f3892c3c740 20 client.16251 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.366+0000 7f3892c3c740 1 --2- 172.21.15.123:0/1507393127 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557571475b10 0x557571477f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.366+0000 7f3892c3c740 4 client.16251 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:12:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.366+0000 7f3892c3c740 1 -- 172.21.15.123:0/1507393127 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55757135f450 con 0x557571475b10 2024-08-18T22:12:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.366+0000 7f388dc19640 1 --2- 172.21.15.123:0/1507393127 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557571475b10 0x557571477f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.366+0000 7f388dc19640 1 --2- 172.21.15.123:0/1507393127 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557571475b10 0x557571477f30 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af291462a7510cd5 server_cookie=5d9b2dee775db90e in_seq=0 out_seq=0 2024-08-18T22:12:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:22.366+0000 7f38717fa640 10 client.16251 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:23.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.052+0000 7fe947a65640 1 -- 172.21.15.123:0/2749458865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe940109180 msgr2=0x7fe94010ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:23.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.052+0000 7fe947a65640 1 --2- 172.21.15.123:0/2749458865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe940109180 0x7fe94010ff80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe938009ca0 tx=0x7fe93802a8d0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.056+0000 7fe947a65640 1 -- 172.21.15.123:0/2749458865 shutdown_connections 2024-08-18T22:12:23.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.056+0000 7fe947a65640 1 --2- 172.21.15.123:0/2749458865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe94011ae70 0x7fe94011d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.056+0000 7fe947a65640 1 --2- 172.21.15.123:0/2749458865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe940109560 0x7fe9401099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.056+0000 7fe947a65640 1 --2- 172.21.15.123:0/2749458865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe940109180 0x7fe94010ff80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.056+0000 7fe947a65640 1 -- 172.21.15.123:0/2749458865 >> 172.21.15.123:0/2749458865 conn(0x7fe94006de70 msgr2=0x7fe94006e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:23.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.065+0000 7fe947a65640 1 -- 172.21.15.123:0/2749458865 shutdown_connections 2024-08-18T22:12:23.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.067+0000 7fe947a65640 1 -- 172.21.15.123:0/2749458865 wait complete. 2024-08-18T22:12:23.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.067+0000 7fe947a65640 1 Processor -- start 2024-08-18T22:12:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.068+0000 7fe947a65640 1 -- start start 2024-08-18T22:12:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.068+0000 7fe947a65640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe940109180 0x7fe94011a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.068+0000 7fe947a65640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe940109560 0x7fe94011a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.068+0000 7fe947a65640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe94011ae70 0x7fe940113660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.068+0000 7fe947a65640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe940120b20 con 0x7fe94011ae70 2024-08-18T22:12:23.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.068+0000 7fe947a65640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe9401209a0 con 0x7fe940109560 2024-08-18T22:12:23.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.068+0000 7fe947a65640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe940120ca0 con 0x7fe940109180 2024-08-18T22:12:23.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.069+0000 7fe946002640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe94011ae70 0x7fe940113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:23.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.069+0000 7fe946002640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe94011ae70 0x7fe940113660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55010/0 (socket says 172.21.15.123:55010) 2024-08-18T22:12:23.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.069+0000 7fe946002640 1 -- 172.21.15.123:0/83976755 learned_addr learned my addr 172.21.15.123:0/83976755 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:23.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.070+0000 7fe945801640 1 --2- 172.21.15.123:0/83976755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe940109180 0x7fe94011a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:23.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.070+0000 7fe945000640 1 --2- 172.21.15.123:0/83976755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe940109560 0x7fe94011a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:23.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.072+0000 7fe946002640 1 -- 172.21.15.123:0/83976755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe940109180 msgr2=0x7fe94011a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.072+0000 7fe946002640 1 --2- 172.21.15.123:0/83976755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe940109180 0x7fe94011a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.072+0000 7fe946002640 1 -- 172.21.15.123:0/83976755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe940109560 msgr2=0x7fe94011a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.073+0000 7fe946002640 1 --2- 172.21.15.123:0/83976755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe940109560 0x7fe94011a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.073+0000 7fe946002640 1 -- 172.21.15.123:0/83976755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe940113f20 con 0x7fe94011ae70 2024-08-18T22:12:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.073+0000 7fe946002640 1 --2- 172.21.15.123:0/83976755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe94011ae70 0x7fe940113660 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00c970 tx=0x7fe93c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.078+0000 7fe9367fc640 1 -- 172.21.15.123:0/83976755 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c007bb0 con 0x7fe94011ae70 2024-08-18T22:12:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.078+0000 7fe947a65640 1 -- 172.21.15.123:0/83976755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe940114210 con 0x7fe94011ae70 2024-08-18T22:12:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.078+0000 7fe947a65640 1 -- 172.21.15.123:0/83976755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe940118200 con 0x7fe94011ae70 2024-08-18T22:12:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.078+0000 7fe9367fc640 1 -- 172.21.15.123:0/83976755 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe93c007d50 con 0x7fe94011ae70 2024-08-18T22:12:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.078+0000 7fe9367fc640 1 -- 172.21.15.123:0/83976755 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c00f450 con 0x7fe94011ae70 2024-08-18T22:12:23.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.082+0000 7fe947a65640 1 -- 172.21.15.123:0/83976755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe924005290 con 0x7fe94011ae70 2024-08-18T22:12:23.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.085+0000 7fe9367fc640 1 -- 172.21.15.123:0/83976755 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fe93c0046c0 con 0x7fe94011ae70 2024-08-18T22:12:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.086+0000 7fe9367fc640 1 --2- 172.21.15.123:0/83976755 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe92c0a2d90 0x7fe92c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.087+0000 7fe9367fc640 1 -- 172.21.15.123:0/83976755 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe93c0cf0f0 con 0x7fe94011ae70 2024-08-18T22:12:23.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.088+0000 7fe945801640 1 --2- 172.21.15.123:0/83976755 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe92c0a2d90 0x7fe92c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:23.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.094+0000 7fe945801640 1 --2- 172.21.15.123:0/83976755 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe92c0a2d90 0x7fe92c0a5250 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe938005fe0 tx=0x7fe938005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.106+0000 7fe9367fc640 1 -- 172.21.15.123:0/83976755 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe93c01d020 con 0x7fe94011ae70 2024-08-18T22:12:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.528+0000 7f38717fa640 1 -- 172.21.15.123:0/1507393127 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55757135f450 con 0x557571475b10 2024-08-18T22:12:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.529+0000 7f38717fa640 10 client.16251 handle_command_reply: tid=0 2024-08-18T22:12:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.529+0000 7f3892c3c740 1 client.16251 shutdown 2024-08-18T22:12:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.529+0000 7f3892c3c740 1 -- 172.21.15.123:0/1507393127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4680 msgr2=0x557571403490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.529+0000 7f3892c3c740 1 --2- 172.21.15.123:0/1507393127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4680 0x557571403490 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f387802b630 tx=0x7f387802b660 comp rx=0 tx=0).stop 2024-08-18T22:12:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.529+0000 7f3892c3c740 1 -- 172.21.15.123:0/1507393127 shutdown_connections 2024-08-18T22:12:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.529+0000 7f3892c3c740 1 --2- 172.21.15.123:0/1507393127 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557571475b10 0x557571477f30 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.529+0000 7f38717fa640 0 client.16251 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.529+0000 7f3892c3c740 1 --2- 172.21.15.123:0/1507393127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575713fa050 0x5575714049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.529+0000 7f3892c3c740 1 --2- 172.21.15.123:0/1507393127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575713f4fc0 0x5575714039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.529+0000 7f3892c3c740 1 --2- 172.21.15.123:0/1507393127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575713f4680 0x557571403490 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.529+0000 7f3892c3c740 1 -- 172.21.15.123:0/1507393127 >> 172.21.15.123:0/1507393127 conn(0x5575713efcf0 msgr2=0x5575713feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.529+0000 7f3892c3c740 1 -- 172.21.15.123:0/1507393127 shutdown_connections 2024-08-18T22:12:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.529+0000 7f3892c3c740 1 -- 172.21.15.123:0/1507393127 wait complete. 2024-08-18T22:12:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.529+0000 7f3892c3c740 20 client.16251 trim_cache size 0 max 16384 2024-08-18T22:12:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:12:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:12:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:12:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:12:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.530+0000 7f388fe7d640 1 -- 172.21.15.123:0/2231654190 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f38740a2cb0 msgr2=0x7f38740a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.530+0000 7f388fe7d640 1 --2- 172.21.15.123:0/2231654190 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f38740a2cb0 0x7f38740a5170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f38800cd3e0 tx=0x7f388006ef40 comp rx=0 tx=0).stop 2024-08-18T22:12:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.530+0000 7f388fe7d640 1 -- 172.21.15.123:0/2231654190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3888107570 msgr2=0x7f3888100800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.530+0000 7f388fe7d640 1 --2- 172.21.15.123:0/2231654190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3888107570 0x7f3888100800 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f388000e9d0 tx=0x7f388000ee90 comp rx=0 tx=0).stop 2024-08-18T22:12:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.530+0000 7f388fe7d640 1 -- 172.21.15.123:0/2231654190 shutdown_connections 2024-08-18T22:12:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.530+0000 7f388fe7d640 1 --2- 172.21.15.123:0/2231654190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3888107570 0x7f3888100800 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.530+0000 7f388fe7d640 1 --2- 172.21.15.123:0/2231654190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3888104c40 0x7f38881002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.530+0000 7f388fe7d640 1 --2- 172.21.15.123:0/2231654190 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f38740a2cb0 0x7f38740a5170 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.530+0000 7f388fe7d640 1 --2- 172.21.15.123:0/2231654190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3888102310 0x7f3888101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.530+0000 7f388fe7d640 1 -- 172.21.15.123:0/2231654190 >> 172.21.15.123:0/2231654190 conn(0x7f38880fbf10 msgr2=0x7f3888102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.530+0000 7f388fe7d640 1 -- 172.21.15.123:0/2231654190 shutdown_connections 2024-08-18T22:12:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:23.530+0000 7f388fe7d640 1 -- 172.21.15.123:0/2231654190 wait complete. 2024-08-18T22:12:23.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.531+0000 7fe947a65640 1 -- 172.21.15.123:0/83976755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe924005580 con 0x7fe94011ae70 2024-08-18T22:12:23.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.532+0000 7fe9367fc640 1 -- 172.21.15.123:0/83976755 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7fe93c014030 con 0x7fe94011ae70 2024-08-18T22:12:23.535 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:12:23.535 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":27,"btime":"2024-08-18T22:11:43:088943+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:11:42.650261+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24448,24458,24466]},"id":1}]} 2024-08-18T22:12:23.535 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 27 2024-08-18T22:12:23.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.534+0000 7fe947a65640 1 -- 172.21.15.123:0/83976755 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe92c0a2d90 msgr2=0x7fe92c0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:23.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.534+0000 7fe947a65640 1 --2- 172.21.15.123:0/83976755 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe92c0a2d90 0x7fe92c0a5250 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe938005fe0 tx=0x7fe938005ef0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.534+0000 7fe947a65640 1 -- 172.21.15.123:0/83976755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe94011ae70 msgr2=0x7fe940113660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:23.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.534+0000 7fe947a65640 1 --2- 172.21.15.123:0/83976755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe94011ae70 0x7fe940113660 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00c970 tx=0x7fe93c00ce30 comp rx=0 tx=0).stop 2024-08-18T22:12:23.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.534+0000 7fe947a65640 1 -- 172.21.15.123:0/83976755 shutdown_connections 2024-08-18T22:12:23.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.534+0000 7fe947a65640 1 --2- 172.21.15.123:0/83976755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe94011ae70 0x7fe940113660 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.534+0000 7fe947a65640 1 --2- 172.21.15.123:0/83976755 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe92c0a2d90 0x7fe92c0a5250 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.534+0000 7fe947a65640 1 --2- 172.21.15.123:0/83976755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe940109560 0x7fe94011a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.534+0000 7fe947a65640 1 --2- 172.21.15.123:0/83976755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe940109180 0x7fe94011a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:23.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.534+0000 7fe947a65640 1 -- 172.21.15.123:0/83976755 >> 172.21.15.123:0/83976755 conn(0x7fe94006de70 msgr2=0x7fe9400720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:23.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.535+0000 7fe947a65640 1 -- 172.21.15.123:0/83976755 shutdown_connections 2024-08-18T22:12:23.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:23.535+0000 7fe947a65640 1 -- 172.21.15.123:0/83976755 wait complete. 2024-08-18T22:12:23.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:23 smithi183 ceph-mon[22097]: pgmap v478: 129 pgs: 129 active+clean; 11 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 1.1 MiB/s wr, 223 op/s 2024-08-18T22:12:23.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:23 smithi123 ceph-mon[18462]: pgmap v478: 129 pgs: 129 active+clean; 11 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 1.1 MiB/s wr, 223 op/s 2024-08-18T22:12:23.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:23 smithi130 ceph-mon[21698]: pgmap v478: 129 pgs: 129 active+clean; 11 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 1.1 MiB/s wr, 223 op/s 2024-08-18T22:12:24.303 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-18T22:12:24.559 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:12:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:24 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/83976755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:12:24.680 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:24 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/83976755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:12:24.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:24 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/83976755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:12:25.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:25 smithi183 ceph-mon[22097]: pgmap v479: 129 pgs: 129 active+clean; 14 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 646 op/s 2024-08-18T22:12:25.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:25 smithi123 ceph-mon[18462]: pgmap v479: 129 pgs: 129 active+clean; 14 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 646 op/s 2024-08-18T22:12:25.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:25 smithi130 ceph-mon[21698]: pgmap v479: 129 pgs: 129 active+clean; 14 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 646 op/s 2024-08-18T22:12:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.356+0000 7f345f163640 1 -- 172.21.15.123:0/1518007907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34581067b0 msgr2=0x7f3458106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.356+0000 7f345f163640 1 --2- 172.21.15.123:0/1518007907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34581067b0 0x7f3458106b90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3448009930 tx=0x7f344802a420 comp rx=0 tx=0).stop 2024-08-18T22:12:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.356+0000 7f345f163640 1 -- 172.21.15.123:0/1518007907 shutdown_connections 2024-08-18T22:12:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.356+0000 7f345f163640 1 --2- 172.21.15.123:0/1518007907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3458101150 0x7f345810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.356+0000 7f345f163640 1 --2- 172.21.15.123:0/1518007907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34581007b0 0x7f3458100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.356+0000 7f345f163640 1 --2- 172.21.15.123:0/1518007907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34581067b0 0x7f3458106b90 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.356+0000 7f345f163640 1 -- 172.21.15.123:0/1518007907 >> 172.21.15.123:0/1518007907 conn(0x7f34580fc4d0 msgr2=0x7f34580fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.356+0000 7f345f163640 1 -- 172.21.15.123:0/1518007907 shutdown_connections 2024-08-18T22:12:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.356+0000 7f345f163640 1 -- 172.21.15.123:0/1518007907 wait complete. 2024-08-18T22:12:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.356+0000 7f345f163640 1 Processor -- start 2024-08-18T22:12:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.356+0000 7f345f163640 1 -- start start 2024-08-18T22:12:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345f163640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34581007b0 0x7f3458198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345f163640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3458101150 0x7f3458198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345f163640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34581067b0 0x7f345819ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345f163640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3458111cd0 con 0x7f34581007b0 2024-08-18T22:12:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345f163640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3458111b50 con 0x7f3458101150 2024-08-18T22:12:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345f163640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3458111e50 con 0x7f34581067b0 2024-08-18T22:12:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345ceff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34581007b0 0x7f3458198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345ceff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34581007b0 0x7f3458198150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55036/0 (socket says 172.21.15.123:55036) 2024-08-18T22:12:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345ceff640 1 -- 172.21.15.123:0/2426036124 learned_addr learned my addr 172.21.15.123:0/2426036124 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f3457fff640 1 --2- 172.21.15.123:0/2426036124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3458101150 0x7f3458198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345d700640 1 --2- 172.21.15.123:0/2426036124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34581067b0 0x7f345819ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345ceff640 1 -- 172.21.15.123:0/2426036124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34581067b0 msgr2=0x7f345819ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345ceff640 1 --2- 172.21.15.123:0/2426036124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34581067b0 0x7f345819ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345ceff640 1 -- 172.21.15.123:0/2426036124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3458101150 msgr2=0x7f3458198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345ceff640 1 --2- 172.21.15.123:0/2426036124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3458101150 0x7f3458198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345ceff640 1 -- 172.21.15.123:0/2426036124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345819d100 con 0x7f34581007b0 2024-08-18T22:12:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345d700640 1 --2- 172.21.15.123:0/2426036124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34581067b0 0x7f345819ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:12:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345ceff640 1 --2- 172.21.15.123:0/2426036124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34581007b0 0x7f3458198150 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3448009a50 tx=0x7f3448004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:26.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f3455ffb640 1 -- 172.21.15.123:0/2426036124 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344803f030 con 0x7f34581007b0 2024-08-18T22:12:26.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f345f163640 1 -- 172.21.15.123:0/2426036124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345819d390 con 0x7f34581007b0 2024-08-18T22:12:26.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f3455ffb640 1 -- 172.21.15.123:0/2426036124 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3448003ce0 con 0x7f34581007b0 2024-08-18T22:12:26.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.357+0000 7f3455ffb640 1 -- 172.21.15.123:0/2426036124 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3448035070 con 0x7f34581007b0 2024-08-18T22:12:26.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.358+0000 7f345f163640 1 -- 172.21.15.123:0/2426036124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34581a4cd0 con 0x7f34581007b0 2024-08-18T22:12:26.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.361+0000 7f3455ffb640 1 -- 172.21.15.123:0/2426036124 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f3448042030 con 0x7f34581007b0 2024-08-18T22:12:26.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.361+0000 7f3461561740 1 Processor -- start 2024-08-18T22:12:26.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.361+0000 7f3461561740 1 -- start start 2024-08-18T22:12:26.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.361+0000 7f3461561740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fc8ed0 0x5565b4fc92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.361+0000 7f3461561740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc97f0 0x5565b4fd80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.361+0000 7f3461561740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fd85e0 0x5565b4fda9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.361+0000 7f3461561740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5565b4f2ea40 con 0x5565b4fd85e0 2024-08-18T22:12:26.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.361+0000 7f3461561740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5565b4ec69d0 con 0x5565b4fc97f0 2024-08-18T22:12:26.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.361+0000 7f3461561740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5565b4f2aa00 con 0x5565b4fc8ed0 2024-08-18T22:12:26.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.361+0000 7f3457fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fd85e0 0x5565b4fda9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.361+0000 7f345d700640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fc8ed0 0x5565b4fc92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.361+0000 7f345ceff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc97f0 0x5565b4fd80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.361+0000 7f345d700640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fc8ed0 0x5565b4fc92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:43912/0 (socket says 172.21.15.123:43912) 2024-08-18T22:12:26.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.361+0000 7f345d700640 1 -- 172.21.15.123:0/743983644 learned_addr learned my addr 172.21.15.123:0/743983644 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:26.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.361+0000 7f3455ffb640 1 --2- 172.21.15.123:0/2426036124 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f34400a2b80 0x7f34400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.362+0000 7f345d700640 1 --2- 172.21.15.123:0/2426036124 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f34400a2b80 0x7f34400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.362+0000 7f3457fff640 1 -- 172.21.15.123:0/743983644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fc8ed0 msgr2=0x5565b4fc92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:26.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.362+0000 7f3457fff640 1 --2- 172.21.15.123:0/743983644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fc8ed0 0x5565b4fc92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.362+0000 7f3457fff640 1 -- 172.21.15.123:0/743983644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc97f0 msgr2=0x5565b4fd80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:26.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.362+0000 7f3457fff640 1 --2- 172.21.15.123:0/743983644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc97f0 0x5565b4fd80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.362+0000 7f3457fff640 1 -- 172.21.15.123:0/743983644 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565b4ecd650 con 0x5565b4fd85e0 2024-08-18T22:12:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.362+0000 7f3455ffb640 1 -- 172.21.15.123:0/2426036124 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f34480ef990 con 0x7f34581007b0 2024-08-18T22:12:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.362+0000 7f3457fff640 1 --2- 172.21.15.123:0/743983644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fd85e0 0x5565b4fda9d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f344c0058c0 tx=0x7f344c00af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0250e006105efc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.362+0000 7f343effd640 1 -- 172.21.15.123:0/743983644 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c004020 con 0x5565b4fd85e0 2024-08-18T22:12:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.362+0000 7f345d700640 1 --2- 172.21.15.123:0/2426036124 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f34400a2b80 0x7f34400a5040 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3450014c40 tx=0x7f3450004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.362+0000 7f343effd640 1 -- 172.21.15.123:0/743983644 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f344c0041c0 con 0x5565b4fd85e0 2024-08-18T22:12:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.362+0000 7f343effd640 1 -- 172.21.15.123:0/743983644 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c0186a0 con 0x5565b4fd85e0 2024-08-18T22:12:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.363+0000 7f3461561740 1 -- 172.21.15.123:0/743983644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fd85e0 msgr2=0x5565b4fda9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.363+0000 7f3461561740 1 --2- 172.21.15.123:0/743983644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fd85e0 0x5565b4fda9d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f344c0058c0 tx=0x7f344c00af10 comp rx=0 tx=0).stop 2024-08-18T22:12:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.363+0000 7f3461561740 1 -- 172.21.15.123:0/743983644 shutdown_connections 2024-08-18T22:12:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.363+0000 7f3461561740 1 --2- 172.21.15.123:0/743983644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fd85e0 0x5565b4fda9d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.363+0000 7f3461561740 1 --2- 172.21.15.123:0/743983644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc97f0 0x5565b4fd80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.363+0000 7f3461561740 1 --2- 172.21.15.123:0/743983644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fc8ed0 0x5565b4fc92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.363+0000 7f3461561740 1 -- 172.21.15.123:0/743983644 >> 172.21.15.123:0/743983644 conn(0x5565b4fc5580 msgr2=0x5565b4fc5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.363+0000 7f3461561740 1 -- 172.21.15.123:0/743983644 shutdown_connections 2024-08-18T22:12:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.363+0000 7f3461561740 1 -- 172.21.15.123:0/743983644 wait complete. 2024-08-18T22:12:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.363+0000 7f3461561740 1 -- start start 2024-08-18T22:12:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.363+0000 7f3461561740 1 Processor -- start 2024-08-18T22:12:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f3461561740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc8ed0 0x5565b4fd5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f3461561740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fc97f0 0x5565b4fd5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f3461561740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fd85e0 0x5565b4fd5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f3461561740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5565b4fdb1b0 con 0x5565b4fc8ed0 2024-08-18T22:12:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f3461561740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5565b4ee9b20 con 0x5565b4fd85e0 2024-08-18T22:12:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f3461561740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5565b4fdb330 con 0x5565b4fc97f0 2024-08-18T22:12:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f3461561740 10 client.0 _ll_register_callbacks cb 0x5565b4ee7bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f345ceff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc8ed0 0x5565b4fd5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f345ceff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc8ed0 0x5565b4fd5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55042/0 (socket says 172.21.15.123:55042) 2024-08-18T22:12:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f345ceff640 1 -- 172.21.15.123:0/2693864238 learned_addr learned my addr 172.21.15.123:0/2693864238 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f345d700640 1 --2- 172.21.15.123:0/2693864238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fd85e0 0x5565b4fd5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f3457fff640 1 --2- 172.21.15.123:0/2693864238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fc97f0 0x5565b4fd5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f345ceff640 1 -- 172.21.15.123:0/2693864238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fc97f0 msgr2=0x5565b4fd5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f345ceff640 1 --2- 172.21.15.123:0/2693864238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fc97f0 0x5565b4fd5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f345ceff640 1 -- 172.21.15.123:0/2693864238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fd85e0 msgr2=0x5565b4fd5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f345ceff640 1 --2- 172.21.15.123:0/2693864238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fd85e0 0x5565b4fd5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f345ceff640 1 -- 172.21.15.123:0/2693864238 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565b4ca03c0 con 0x5565b4fc8ed0 2024-08-18T22:12:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f345ceff640 1 --2- 172.21.15.123:0/2693864238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc8ed0 0x5565b4fd5440 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3448031550 tx=0x7f3448009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7bfe629905a885 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.364+0000 7f3437fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.365+0000 7f3437fff640 1 -- 172.21.15.123:0/2693864238 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34480bb7c0 con 0x5565b4fc8ed0 2024-08-18T22:12:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.365+0000 7f3437fff640 1 -- 172.21.15.123:0/2693864238 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f34480b84d0 con 0x5565b4fc8ed0 2024-08-18T22:12:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.365+0000 7f3461561740 1 -- 172.21.15.123:0/2693864238 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f344c0041c0 con 0x5565b4fc8ed0 2024-08-18T22:12:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.365+0000 7f3437fff640 1 -- 172.21.15.123:0/2693864238 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3448049070 con 0x5565b4fc8ed0 2024-08-18T22:12:26.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.365+0000 7f3461561740 10 client.16266 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:26.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.365+0000 7f3461561740 1 -- 172.21.15.123:0/2693864238 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5565b4fe6d80 con 0x5565b4fc8ed0 2024-08-18T22:12:26.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.365+0000 7f3437fff640 1 -- 172.21.15.123:0/2693864238 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f344c0041c0 con 0x5565b4fc8ed0 2024-08-18T22:12:26.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.365+0000 7f3437fff640 1 -- 172.21.15.123:0/2693864238 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f344803b460 con 0x5565b4fc8ed0 2024-08-18T22:12:26.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.365+0000 7f3461561740 10 client.16266 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:26.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.365+0000 7f3461561740 10 client.16266 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-18T22:12:26.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.365+0000 7f3461561740 20 client.16266 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:26.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.365+0000 7f3461561740 1 --2- 172.21.15.123:0/2693864238 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5565b4fe8170 0x5565b4fea580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.365+0000 7f3461561740 4 client.16266 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:12:26.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.365+0000 7f3461561740 1 -- 172.21.15.123:0/2693864238 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565b4f3bfb0 con 0x5565b4fe8170 2024-08-18T22:12:26.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.366+0000 7f3457fff640 1 --2- 172.21.15.123:0/2693864238 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5565b4fe8170 0x5565b4fea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.366+0000 7f3457fff640 1 --2- 172.21.15.123:0/2693864238 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5565b4fe8170 0x5565b4fea580 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=55fedded473e0df6 server_cookie=c24dd99600dbff28 in_seq=0 out_seq=0 2024-08-18T22:12:26.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.366+0000 7f3437fff640 10 client.16266 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:12:26.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.367+0000 7f3437fff640 1 -- 172.21.15.123:0/2693864238 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565b4f3bfb0 con 0x5565b4fe8170 2024-08-18T22:12:26.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.367+0000 7f3437fff640 10 client.16266 handle_command_reply: tid=0 2024-08-18T22:12:26.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.367+0000 7f3461561740 1 client.16266 shutdown 2024-08-18T22:12:26.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.367+0000 7f3461561740 1 -- 172.21.15.123:0/2693864238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc8ed0 msgr2=0x5565b4fd5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:26.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.367+0000 7f3461561740 1 --2- 172.21.15.123:0/2693864238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc8ed0 0x5565b4fd5440 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3448031550 tx=0x7f3448009560 comp rx=0 tx=0).stop 2024-08-18T22:12:26.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.367+0000 7f3461561740 1 -- 172.21.15.123:0/2693864238 shutdown_connections 2024-08-18T22:12:26.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.367+0000 7f3461561740 1 --2- 172.21.15.123:0/2693864238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fd85e0 0x5565b4fd5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.367+0000 7f3461561740 1 --2- 172.21.15.123:0/2693864238 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5565b4fe8170 0x5565b4fea580 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.367+0000 7f3461561740 1 --2- 172.21.15.123:0/2693864238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fc97f0 0x5565b4fd5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.367+0000 7f3461561740 1 --2- 172.21.15.123:0/2693864238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc8ed0 0x5565b4fd5440 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.367+0000 7f3437fff640 0 client.16266 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:12:26.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.367+0000 7f3461561740 1 -- 172.21.15.123:0/2693864238 >> 172.21.15.123:0/2693864238 conn(0x5565b4fc5580 msgr2=0x5565b4fcb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:26.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.367+0000 7f3461561740 1 -- 172.21.15.123:0/2693864238 shutdown_connections 2024-08-18T22:12:26.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.367+0000 7f3461561740 1 -- 172.21.15.123:0/2693864238 wait complete. 2024-08-18T22:12:26.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.367+0000 7f3461561740 20 client.16266 trim_cache size 0 max 16384 2024-08-18T22:12:26.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.380+0000 7f3461561740 1 Processor -- start 2024-08-18T22:12:26.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.380+0000 7f3461561740 1 -- start start 2024-08-18T22:12:26.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.380+0000 7f3461561740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc8ed0 0x5565b4fc01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.380+0000 7f3461561740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc97f0 0x5565b4fefe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.380+0000 7f3461561740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fd85e0 0x5565b4ff03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.380+0000 7f3461561740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f34581af010 con 0x5565b4fc8ed0 2024-08-18T22:12:26.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.380+0000 7f3461561740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34581ac8e0 con 0x5565b4fc97f0 2024-08-18T22:12:26.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.380+0000 7f3461561740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f34581aa730 con 0x5565b4fd85e0 2024-08-18T22:12:26.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.380+0000 7f345ceff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc8ed0 0x5565b4fc01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.380+0000 7f345ceff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc8ed0 0x5565b4fc01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55048/0 (socket says 172.21.15.123:55048) 2024-08-18T22:12:26.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.380+0000 7f345ceff640 1 -- 172.21.15.123:0/2656118826 learned_addr learned my addr 172.21.15.123:0/2656118826 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:26.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.381+0000 7f3457fff640 1 --2- 172.21.15.123:0/2656118826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc97f0 0x5565b4fefe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.381+0000 7f345d700640 1 --2- 172.21.15.123:0/2656118826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fd85e0 0x5565b4ff03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.381+0000 7f345ceff640 1 -- 172.21.15.123:0/2656118826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fd85e0 msgr2=0x5565b4ff03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:26.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.381+0000 7f345ceff640 1 --2- 172.21.15.123:0/2656118826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fd85e0 0x5565b4ff03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.381+0000 7f345ceff640 1 -- 172.21.15.123:0/2656118826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc97f0 msgr2=0x5565b4fefe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:26.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.381+0000 7f345ceff640 1 --2- 172.21.15.123:0/2656118826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc97f0 0x5565b4fefe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.381+0000 7f345ceff640 1 -- 172.21.15.123:0/2656118826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565b4fc9620 con 0x5565b4fc8ed0 2024-08-18T22:12:26.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.381+0000 7f345ceff640 1 --2- 172.21.15.123:0/2656118826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc8ed0 0x5565b4fc01b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f34480b8830 tx=0x7f34480c0140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a42c83243c2e4e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:26.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.381+0000 7f343e7fc640 1 -- 172.21.15.123:0/2656118826 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34480bbc30 con 0x5565b4fc8ed0 2024-08-18T22:12:26.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.381+0000 7f343e7fc640 1 -- 172.21.15.123:0/2656118826 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34480bc560 con 0x5565b4fc8ed0 2024-08-18T22:12:26.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.381+0000 7f343e7fc640 1 -- 172.21.15.123:0/2656118826 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344803b460 con 0x5565b4fc8ed0 2024-08-18T22:12:26.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 -- 172.21.15.123:0/2656118826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc8ed0 msgr2=0x5565b4fc01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:26.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 --2- 172.21.15.123:0/2656118826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc8ed0 0x5565b4fc01b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f34480b8830 tx=0x7f34480c0140 comp rx=0 tx=0).stop 2024-08-18T22:12:26.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 -- 172.21.15.123:0/2656118826 shutdown_connections 2024-08-18T22:12:26.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 --2- 172.21.15.123:0/2656118826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fd85e0 0x5565b4ff03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 --2- 172.21.15.123:0/2656118826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc97f0 0x5565b4fefe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 --2- 172.21.15.123:0/2656118826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc8ed0 0x5565b4fc01b0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.402 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:12:26.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 -- 172.21.15.123:0/2656118826 >> 172.21.15.123:0/2656118826 conn(0x5565b4fc5580 msgr2=0x5565b4fd4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:26.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 -- 172.21.15.123:0/2656118826 shutdown_connections 2024-08-18T22:12:26.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 -- 172.21.15.123:0/2656118826 wait complete. 2024-08-18T22:12:26.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 -- start start 2024-08-18T22:12:26.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 Processor -- start 2024-08-18T22:12:26.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc8ed0 0x5565b4fe07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc97f0 0x5565b4fe0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fd85e0 0x5565b4fd1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f34581aada0 con 0x5565b4fc97f0 2024-08-18T22:12:26.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.382+0000 7f3461561740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34581ac210 con 0x5565b4fc8ed0 2024-08-18T22:12:26.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f3461561740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f34581ab470 con 0x5565b4fd85e0 2024-08-18T22:12:26.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f3461561740 10 client.0 _ll_register_callbacks cb 0x7f3448003e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:26.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f345ceff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc8ed0 0x5565b4fe07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f3457fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc97f0 0x5565b4fe0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f345ceff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc8ed0 0x5565b4fe07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:48740/0 (socket says 172.21.15.123:48740) 2024-08-18T22:12:26.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f345ceff640 1 -- 172.21.15.123:0/4239011534 learned_addr learned my addr 172.21.15.123:0/4239011534 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:26.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f345d700640 1 --2- 172.21.15.123:0/4239011534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fd85e0 0x5565b4fd1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f3457fff640 1 -- 172.21.15.123:0/4239011534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fd85e0 msgr2=0x5565b4fd1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:26.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f3457fff640 1 --2- 172.21.15.123:0/4239011534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fd85e0 0x5565b4fd1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f3457fff640 1 -- 172.21.15.123:0/4239011534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc8ed0 msgr2=0x5565b4fe07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:26.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f3457fff640 1 --2- 172.21.15.123:0/4239011534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc8ed0 0x5565b4fe07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f3457fff640 1 -- 172.21.15.123:0/4239011534 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565b4fd22e0 con 0x5565b4fc97f0 2024-08-18T22:12:26.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f345ceff640 1 --2- 172.21.15.123:0/4239011534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc8ed0 0x5565b4fe07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:12:26.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f3457fff640 1 --2- 172.21.15.123:0/4239011534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc97f0 0x5565b4fe0ce0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f344c00f850 tx=0x7f344c003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4c3ce84f37661f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:26.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f3437fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:26.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f3437fff640 1 -- 172.21.15.123:0/4239011534 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c00fd10 con 0x5565b4fc97f0 2024-08-18T22:12:26.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f3437fff640 1 -- 172.21.15.123:0/4239011534 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f344c02b070 con 0x5565b4fc97f0 2024-08-18T22:12:26.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.383+0000 7f3461561740 1 -- 172.21.15.123:0/4239011534 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34480bc560 con 0x5565b4fc97f0 2024-08-18T22:12:26.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.384+0000 7f3437fff640 1 -- 172.21.15.123:0/4239011534 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f344c03a050 con 0x5565b4fc97f0 2024-08-18T22:12:26.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.384+0000 7f3461561740 10 client.16272 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:26.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.384+0000 7f3461561740 1 -- 172.21.15.123:0/4239011534 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5565b5052760 con 0x5565b4fc97f0 2024-08-18T22:12:26.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.384+0000 7f3437fff640 1 -- 172.21.15.123:0/4239011534 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34480bc560 con 0x5565b4fc97f0 2024-08-18T22:12:26.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.384+0000 7f3437fff640 1 -- 172.21.15.123:0/4239011534 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f344c0035f0 con 0x5565b4fc97f0 2024-08-18T22:12:26.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.384+0000 7f3461561740 10 client.16272 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:26.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.384+0000 7f3461561740 10 client.16272 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-18T22:12:26.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.384+0000 7f3461561740 20 client.16272 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:26.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.384+0000 7f3461561740 1 --2- 172.21.15.123:0/4239011534 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5565b5052cb0 0x5565b50550d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:26.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.384+0000 7f3461561740 4 client.16272 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:12:26.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.384+0000 7f3461561740 1 -- 172.21.15.123:0/4239011534 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5565b4f364c0 con 0x5565b5052cb0 2024-08-18T22:12:26.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.384+0000 7f345ceff640 1 --2- 172.21.15.123:0/4239011534 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5565b5052cb0 0x5565b50550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:26.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3437fff640 10 client.16272 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:12:26.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f345ceff640 1 --2- 172.21.15.123:0/4239011534 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5565b5052cb0 0x5565b50550d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e47bf8c7fc27fe51 server_cookie=4c4621ac6f825633 in_seq=0 out_seq=0 2024-08-18T22:12:26.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3437fff640 1 -- 172.21.15.123:0/4239011534 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5565b4f364c0 con 0x5565b5052cb0 2024-08-18T22:12:26.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3437fff640 10 client.16272 handle_command_reply: tid=0 2024-08-18T22:12:26.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3461561740 1 client.16272 shutdown 2024-08-18T22:12:26.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3461561740 1 -- 172.21.15.123:0/4239011534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc97f0 msgr2=0x5565b4fe0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:26.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3461561740 1 --2- 172.21.15.123:0/4239011534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc97f0 0x5565b4fe0ce0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f344c00f850 tx=0x7f344c003e80 comp rx=0 tx=0).stop 2024-08-18T22:12:26.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3461561740 1 -- 172.21.15.123:0/4239011534 shutdown_connections 2024-08-18T22:12:26.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3461561740 1 --2- 172.21.15.123:0/4239011534 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5565b5052cb0 0x5565b50550d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3461561740 1 --2- 172.21.15.123:0/4239011534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5565b4fd85e0 0x5565b4fd1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3461561740 1 --2- 172.21.15.123:0/4239011534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5565b4fc97f0 0x5565b4fe0ce0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3461561740 1 --2- 172.21.15.123:0/4239011534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565b4fc8ed0 0x5565b4fe07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3437fff640 0 client.16272 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:12:26.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3461561740 1 -- 172.21.15.123:0/4239011534 >> 172.21.15.123:0/4239011534 conn(0x5565b4fc5580 msgr2=0x5565b4fd4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:26.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3461561740 1 -- 172.21.15.123:0/4239011534 shutdown_connections 2024-08-18T22:12:26.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3461561740 1 -- 172.21.15.123:0/4239011534 wait complete. 2024-08-18T22:12:26.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.385+0000 7f3461561740 20 client.16272 trim_cache size 0 max 16384 2024-08-18T22:12:26.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.386+0000 7f345f163640 1 -- 172.21.15.123:0/2426036124 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f34400a2b80 msgr2=0x7f34400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:26.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.386+0000 7f345f163640 1 --2- 172.21.15.123:0/2426036124 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f34400a2b80 0x7f34400a5040 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3450014c40 tx=0x7f3450004ab0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.386+0000 7f345f163640 1 -- 172.21.15.123:0/2426036124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34581007b0 msgr2=0x7f3458198150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:26.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.386+0000 7f345f163640 1 --2- 172.21.15.123:0/2426036124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34581007b0 0x7f3458198150 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3448009a50 tx=0x7f3448004270 comp rx=0 tx=0).stop 2024-08-18T22:12:26.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.386+0000 7f345f163640 1 -- 172.21.15.123:0/2426036124 shutdown_connections 2024-08-18T22:12:26.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.386+0000 7f345f163640 1 --2- 172.21.15.123:0/2426036124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34581067b0 0x7f345819ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.386+0000 7f345f163640 1 --2- 172.21.15.123:0/2426036124 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f34400a2b80 0x7f34400a5040 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.386+0000 7f345f163640 1 --2- 172.21.15.123:0/2426036124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3458101150 0x7f3458198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.386+0000 7f345f163640 1 --2- 172.21.15.123:0/2426036124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34581007b0 0x7f3458198150 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:26.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.386+0000 7f345f163640 1 -- 172.21.15.123:0/2426036124 >> 172.21.15.123:0/2426036124 conn(0x7f34580fc4d0 msgr2=0x7f34580fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:26.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.386+0000 7f345f163640 1 -- 172.21.15.123:0/2426036124 shutdown_connections 2024-08-18T22:12:26.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:26.386+0000 7f345f163640 1 -- 172.21.15.123:0/2426036124 wait complete. 2024-08-18T22:12:27.220 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-18T22:12:27.476 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:12:27.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:27 smithi123 ceph-mon[18462]: pgmap v480: 129 pgs: 129 active+clean; 6.1 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 808 op/s 2024-08-18T22:12:27.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:27 smithi183 ceph-mon[22097]: pgmap v480: 129 pgs: 129 active+clean; 6.1 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 808 op/s 2024-08-18T22:12:27.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:27 smithi130 ceph-mon[21698]: pgmap v480: 129 pgs: 129 active+clean; 6.1 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 808 op/s 2024-08-18T22:12:27.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.920+0000 7f70f9822640 1 -- 172.21.15.123:0/1918585607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4107fc0 msgr2=0x7f70f410e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:27.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.920+0000 7f70f9822640 1 --2- 172.21.15.123:0/1918585607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4107fc0 0x7f70f410e960 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009930 tx=0x7f70ec02a420 comp rx=0 tx=0).stop 2024-08-18T22:12:27.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.921+0000 7f70f9822640 1 -- 172.21.15.123:0/1918585607 shutdown_connections 2024-08-18T22:12:27.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.921+0000 7f70f9822640 1 --2- 172.21.15.123:0/1918585607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4107fc0 0x7f70f410e960 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.921+0000 7f70f9822640 1 --2- 172.21.15.123:0/1918585607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f4103470 0x7f70f41078b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.921+0000 7f70f9822640 1 --2- 172.21.15.123:0/1918585607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f4102ac0 0x7f70f4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.921+0000 7f70f9822640 1 -- 172.21.15.123:0/1918585607 >> 172.21.15.123:0/1918585607 conn(0x7f70f40fc500 msgr2=0x7f70f40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:27.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.921+0000 7f70f9822640 1 -- 172.21.15.123:0/1918585607 shutdown_connections 2024-08-18T22:12:27.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.921+0000 7f70f9822640 1 -- 172.21.15.123:0/1918585607 wait complete. 2024-08-18T22:12:27.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.921+0000 7f70f9822640 1 Processor -- start 2024-08-18T22:12:27.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.921+0000 7f70f9822640 1 -- start start 2024-08-18T22:12:27.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f9822640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f4102ac0 0x7f70f4198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f9822640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4103470 0x7f70f4198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f9822640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f4107fc0 0x7f70f419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f9822640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f70f4111e80 con 0x7f70f4103470 2024-08-18T22:12:27.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f9822640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70f4111d00 con 0x7f70f4102ac0 2024-08-18T22:12:27.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f9822640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f70f4112000 con 0x7f70f4107fc0 2024-08-18T22:12:27.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f27fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4103470 0x7f70f4198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f27fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4103470 0x7f70f4198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55070/0 (socket says 172.21.15.123:55070) 2024-08-18T22:12:27.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f27fc640 1 -- 172.21.15.123:0/2533891503 learned_addr learned my addr 172.21.15.123:0/2533891503 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:27.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f2ffd640 1 --2- 172.21.15.123:0/2533891503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f4102ac0 0x7f70f4198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f37fe640 1 --2- 172.21.15.123:0/2533891503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f4107fc0 0x7f70f419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f27fc640 1 -- 172.21.15.123:0/2533891503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f4107fc0 msgr2=0x7f70f419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:27.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f27fc640 1 --2- 172.21.15.123:0/2533891503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f4107fc0 0x7f70f419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f27fc640 1 -- 172.21.15.123:0/2533891503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f4102ac0 msgr2=0x7f70f4198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:27.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f27fc640 1 --2- 172.21.15.123:0/2533891503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f4102ac0 0x7f70f4198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f27fc640 1 -- 172.21.15.123:0/2533891503 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f419d3d0 con 0x7f70f4103470 2024-08-18T22:12:27.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f37fe640 1 --2- 172.21.15.123:0/2533891503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f4107fc0 0x7f70f419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:12:27.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.922+0000 7f70f27fc640 1 --2- 172.21.15.123:0/2533891503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4103470 0x7f70f4198960 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f70e800b450 tx=0x7f70e800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:27.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.923+0000 7f70f8820640 1 -- 172.21.15.123:0/2533891503 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8015020 con 0x7f70f4103470 2024-08-18T22:12:27.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.923+0000 7f70f9822640 1 -- 172.21.15.123:0/2533891503 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f419d6c0 con 0x7f70f4103470 2024-08-18T22:12:27.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.923+0000 7f70f8820640 1 -- 172.21.15.123:0/2533891503 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70e8011d70 con 0x7f70f4103470 2024-08-18T22:12:27.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.923+0000 7f70f8820640 1 -- 172.21.15.123:0/2533891503 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e800f340 con 0x7f70f4103470 2024-08-18T22:12:27.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.923+0000 7f70f9822640 1 -- 172.21.15.123:0/2533891503 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f41a4fa0 con 0x7f70f4103470 2024-08-18T22:12:27.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.925+0000 7f70f8820640 1 -- 172.21.15.123:0/2533891503 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f70e8018020 con 0x7f70f4103470 2024-08-18T22:12:27.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.925+0000 7f70fbc20740 1 Processor -- start 2024-08-18T22:12:27.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.925+0000 7f70fbc20740 1 -- start start 2024-08-18T22:12:27.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.925+0000 7f70fbc20740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd15eb0 0x5614fdd16290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.925+0000 7f70fbc20740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd167d0 0x5614fdd250a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.925+0000 7f70fbc20740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd255e0 0x5614fdd279d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70fbc20740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5614fdc7ba40 con 0x5614fdd15eb0 2024-08-18T22:12:27.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70fbc20740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5614fdc139d0 con 0x5614fdd255e0 2024-08-18T22:12:27.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70fbc20740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5614fdc77a00 con 0x5614fdd167d0 2024-08-18T22:12:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd15eb0 0x5614fdd16290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd15eb0 0x5614fdd16290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55072/0 (socket says 172.21.15.123:55072) 2024-08-18T22:12:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f37fe640 1 -- 172.21.15.123:0/1675847862 learned_addr learned my addr 172.21.15.123:0/1675847862 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f8820640 1 --2- 172.21.15.123:0/2533891503 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f70dc0a2b80 0x7f70dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f27fc640 1 --2- 172.21.15.123:0/1675847862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd255e0 0x5614fdd279d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f2ffd640 1 --2- 172.21.15.123:0/1675847862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd167d0 0x5614fdd250a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f37fe640 1 --2- 172.21.15.123:0/2533891503 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f70dc0a2b80 0x7f70dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f37fe640 1 -- 172.21.15.123:0/1675847862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd167d0 msgr2=0x5614fdd250a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f37fe640 1 --2- 172.21.15.123:0/1675847862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd167d0 0x5614fdd250a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f37fe640 1 -- 172.21.15.123:0/1675847862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd255e0 msgr2=0x5614fdd279d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f37fe640 1 --2- 172.21.15.123:0/1675847862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd255e0 0x5614fdd279d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f37fe640 1 -- 172.21.15.123:0/1675847862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614fdc1a650 con 0x5614fdd15eb0 2024-08-18T22:12:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f2ffd640 1 --2- 172.21.15.123:0/1675847862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd167d0 0x5614fdd250a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f8820640 1 -- 172.21.15.123:0/2533891503 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f70e80ceea0 con 0x7f70f4103470 2024-08-18T22:12:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f37fe640 1 --2- 172.21.15.123:0/1675847862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd15eb0 0x5614fdd16290 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f70ec02a940 tx=0x7f70ec031980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8b2ef02d421b02 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70d9ffb640 1 -- 172.21.15.123:0/1675847862 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec04d070 con 0x5614fdd15eb0 2024-08-18T22:12:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70d9ffb640 1 -- 172.21.15.123:0/1675847862 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70ec032e20 con 0x5614fdd15eb0 2024-08-18T22:12:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70d9ffb640 1 -- 172.21.15.123:0/1675847862 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec035070 con 0x5614fdd15eb0 2024-08-18T22:12:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.926+0000 7f70f37fe640 1 --2- 172.21.15.123:0/2533891503 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f70dc0a2b80 0x7f70dc0a5040 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f70ec04a000 tx=0x7f70ec046000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.927+0000 7f70fbc20740 1 -- 172.21.15.123:0/1675847862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd15eb0 msgr2=0x5614fdd16290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.927+0000 7f70fbc20740 1 --2- 172.21.15.123:0/1675847862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd15eb0 0x5614fdd16290 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f70ec02a940 tx=0x7f70ec031980 comp rx=0 tx=0).stop 2024-08-18T22:12:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.927+0000 7f70fbc20740 1 -- 172.21.15.123:0/1675847862 shutdown_connections 2024-08-18T22:12:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.927+0000 7f70fbc20740 1 --2- 172.21.15.123:0/1675847862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd255e0 0x5614fdd279d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.927+0000 7f70fbc20740 1 --2- 172.21.15.123:0/1675847862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd167d0 0x5614fdd250a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.927+0000 7f70fbc20740 1 --2- 172.21.15.123:0/1675847862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd15eb0 0x5614fdd16290 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.927+0000 7f70fbc20740 1 -- 172.21.15.123:0/1675847862 >> 172.21.15.123:0/1675847862 conn(0x5614fdd12580 msgr2=0x5614fdd12960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.927+0000 7f70fbc20740 1 -- 172.21.15.123:0/1675847862 shutdown_connections 2024-08-18T22:12:27.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.927+0000 7f70fbc20740 1 -- 172.21.15.123:0/1675847862 wait complete. 2024-08-18T22:12:27.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70fbc20740 1 -- start start 2024-08-18T22:12:27.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70fbc20740 1 Processor -- start 2024-08-18T22:12:27.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70fbc20740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd15eb0 0x5614fdd224f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70fbc20740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd167d0 0x5614fdd22a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70fbc20740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd255e0 0x5614fdd22f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70fbc20740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5614fdd281b0 con 0x5614fdd255e0 2024-08-18T22:12:27.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70fbc20740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5614fdc36b20 con 0x5614fdd15eb0 2024-08-18T22:12:27.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70fbc20740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5614fdd28330 con 0x5614fdd167d0 2024-08-18T22:12:27.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70fbc20740 10 client.0 _ll_register_callbacks cb 0x5614fdc34bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:27.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70f37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd255e0 0x5614fdd22f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70f37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd255e0 0x5614fdd22f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55084/0 (socket says 172.21.15.123:55084) 2024-08-18T22:12:27.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70f37fe640 1 -- 172.21.15.123:0/4081057722 learned_addr learned my addr 172.21.15.123:0/4081057722 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:27.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70f27fc640 1 --2- 172.21.15.123:0/4081057722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd167d0 0x5614fdd22a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70f2ffd640 1 --2- 172.21.15.123:0/4081057722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd15eb0 0x5614fdd224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70f37fe640 1 -- 172.21.15.123:0/4081057722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd167d0 msgr2=0x5614fdd22a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70f37fe640 1 --2- 172.21.15.123:0/4081057722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd167d0 0x5614fdd22a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70f37fe640 1 -- 172.21.15.123:0/4081057722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd15eb0 msgr2=0x5614fdd224f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70f37fe640 1 --2- 172.21.15.123:0/4081057722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd15eb0 0x5614fdd224f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.928+0000 7f70f37fe640 1 -- 172.21.15.123:0/4081057722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614fd9ed3c0 con 0x5614fdd255e0 2024-08-18T22:12:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70f37fe640 1 --2- 172.21.15.123:0/4081057722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd255e0 0x5614fdd22f70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009930 tx=0x7f70ec005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9a8c304669b476 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70d2ffd640 1 -- 172.21.15.123:0/4081057722 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec055070 con 0x5614fdd255e0 2024-08-18T22:12:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70d2ffd640 1 -- 172.21.15.123:0/4081057722 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f70ec005510 con 0x5614fdd255e0 2024-08-18T22:12:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70fbc20740 1 -- 172.21.15.123:0/4081057722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70ec032e20 con 0x5614fdd255e0 2024-08-18T22:12:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70d2ffd640 1 -- 172.21.15.123:0/4081057722 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f70ec061050 con 0x5614fdd255e0 2024-08-18T22:12:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70fbc20740 10 client.16284 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70fbc20740 1 -- 172.21.15.123:0/4081057722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5614fdd281b0 con 0x5614fdd255e0 2024-08-18T22:12:27.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70d2ffd640 1 -- 172.21.15.123:0/4081057722 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70ec032e20 con 0x5614fdd255e0 2024-08-18T22:12:27.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70d2ffd640 1 -- 172.21.15.123:0/4081057722 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f70ec03a050 con 0x5614fdd255e0 2024-08-18T22:12:27.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70fbc20740 10 client.16284 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:27.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70fbc20740 10 client.16284 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-18T22:12:27.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70fbc20740 20 client.16284 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:27.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70fbc20740 1 --2- 172.21.15.123:0/4081057722 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5614fdd34fd0 0x5614fdd373c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70fbc20740 4 client.16284 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:12:27.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.929+0000 7f70fbc20740 1 -- 172.21.15.123:0/4081057722 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614fdc88fb0 con 0x5614fdd34fd0 2024-08-18T22:12:27.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.930+0000 7f70f2ffd640 1 --2- 172.21.15.123:0/4081057722 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5614fdd34fd0 0x5614fdd373c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.930+0000 7f70d2ffd640 10 client.16284 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:12:27.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.930+0000 7f70f2ffd640 1 --2- 172.21.15.123:0/4081057722 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5614fdd34fd0 0x5614fdd373c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae96b31f153b643c server_cookie=fda2253249eb6e66 in_seq=0 out_seq=0 2024-08-18T22:12:27.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.931+0000 7f70d2ffd640 1 -- 172.21.15.123:0/4081057722 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614fdc88fb0 con 0x5614fdd34fd0 2024-08-18T22:12:27.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.931+0000 7f70d2ffd640 10 client.16284 handle_command_reply: tid=0 2024-08-18T22:12:27.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.931+0000 7f70fbc20740 1 client.16284 shutdown 2024-08-18T22:12:27.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.931+0000 7f70fbc20740 1 -- 172.21.15.123:0/4081057722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd255e0 msgr2=0x5614fdd22f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:27.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.931+0000 7f70fbc20740 1 --2- 172.21.15.123:0/4081057722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd255e0 0x5614fdd22f70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009930 tx=0x7f70ec005b50 comp rx=0 tx=0).stop 2024-08-18T22:12:27.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.931+0000 7f70fbc20740 1 -- 172.21.15.123:0/4081057722 shutdown_connections 2024-08-18T22:12:27.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.931+0000 7f70fbc20740 1 --2- 172.21.15.123:0/4081057722 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5614fdd34fd0 0x5614fdd373c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.931+0000 7f70fbc20740 1 --2- 172.21.15.123:0/4081057722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd255e0 0x5614fdd22f70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.931+0000 7f70fbc20740 1 --2- 172.21.15.123:0/4081057722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd167d0 0x5614fdd22a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.931+0000 7f70fbc20740 1 --2- 172.21.15.123:0/4081057722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd15eb0 0x5614fdd224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.931+0000 7f70fbc20740 1 -- 172.21.15.123:0/4081057722 >> 172.21.15.123:0/4081057722 conn(0x5614fdd12580 msgr2=0x5614fdd182e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:27.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.931+0000 7f70d2ffd640 0 client.16284 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:12:27.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.931+0000 7f70fbc20740 1 -- 172.21.15.123:0/4081057722 shutdown_connections 2024-08-18T22:12:27.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.931+0000 7f70fbc20740 1 -- 172.21.15.123:0/4081057722 wait complete. 2024-08-18T22:12:27.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.931+0000 7f70fbc20740 20 client.16284 trim_cache size 0 max 16384 2024-08-18T22:12:27.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70fbc20740 1 Processor -- start 2024-08-18T22:12:27.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70fbc20740 1 -- start start 2024-08-18T22:12:27.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70fbc20740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd15eb0 0x5614fdd22dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70fbc20740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd167d0 0x5614fdd114c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70fbc20740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd255e0 0x5614fdd3cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70fbc20740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f70f41af210 con 0x5614fdd167d0 2024-08-18T22:12:27.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70fbc20740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70f41acae0 con 0x5614fdd255e0 2024-08-18T22:12:27.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70fbc20740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f70f41aa930 con 0x5614fdd15eb0 2024-08-18T22:12:27.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70f27fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd167d0 0x5614fdd114c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70f27fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd167d0 0x5614fdd114c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55094/0 (socket says 172.21.15.123:55094) 2024-08-18T22:12:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70f27fc640 1 -- 172.21.15.123:0/4044776356 learned_addr learned my addr 172.21.15.123:0/4044776356 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70f37fe640 1 --2- 172.21.15.123:0/4044776356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd255e0 0x5614fdd3cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70f2ffd640 1 --2- 172.21.15.123:0/4044776356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd15eb0 0x5614fdd22dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70f27fc640 1 -- 172.21.15.123:0/4044776356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd15eb0 msgr2=0x5614fdd22dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70f27fc640 1 --2- 172.21.15.123:0/4044776356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd15eb0 0x5614fdd22dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70f27fc640 1 -- 172.21.15.123:0/4044776356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd255e0 msgr2=0x5614fdd3cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70f27fc640 1 --2- 172.21.15.123:0/4044776356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd255e0 0x5614fdd3cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.945+0000 7f70f27fc640 1 -- 172.21.15.123:0/4044776356 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614fdd27d10 con 0x5614fdd167d0 2024-08-18T22:12:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.946+0000 7f70f27fc640 1 --2- 172.21.15.123:0/4044776356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd167d0 0x5614fdd114c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f70e800be10 tx=0x7f70e80bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2f6f10d58c7f90 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.946+0000 7f70d97fa640 1 -- 172.21.15.123:0/4044776356 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e809f720 con 0x5614fdd167d0 2024-08-18T22:12:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.946+0000 7f70d97fa640 1 -- 172.21.15.123:0/4044776356 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70e80a3fe0 con 0x5614fdd167d0 2024-08-18T22:12:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.946+0000 7f70d97fa640 1 -- 172.21.15.123:0/4044776356 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e809a7c0 con 0x5614fdd167d0 2024-08-18T22:12:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.946+0000 7f70fbc20740 1 -- 172.21.15.123:0/4044776356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd167d0 msgr2=0x5614fdd114c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.946+0000 7f70fbc20740 1 --2- 172.21.15.123:0/4044776356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd167d0 0x5614fdd114c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f70e800be10 tx=0x7f70e80bb040 comp rx=0 tx=0).stop 2024-08-18T22:12:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.947+0000 7f70fbc20740 1 -- 172.21.15.123:0/4044776356 shutdown_connections 2024-08-18T22:12:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.947+0000 7f70fbc20740 1 --2- 172.21.15.123:0/4044776356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd255e0 0x5614fdd3cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.947+0000 7f70fbc20740 1 --2- 172.21.15.123:0/4044776356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd167d0 0x5614fdd114c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.947+0000 7f70fbc20740 1 --2- 172.21.15.123:0/4044776356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd15eb0 0x5614fdd22dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.947+0000 7f70fbc20740 1 -- 172.21.15.123:0/4044776356 >> 172.21.15.123:0/4044776356 conn(0x5614fdd12580 msgr2=0x5614fdd10db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.947+0000 7f70fbc20740 1 -- 172.21.15.123:0/4044776356 shutdown_connections 2024-08-18T22:12:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.947+0000 7f70fbc20740 1 -- 172.21.15.123:0/4044776356 wait complete. 2024-08-18T22:12:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.947+0000 7f70fbc20740 1 -- start start 2024-08-18T22:12:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.947+0000 7f70fbc20740 1 Processor -- start 2024-08-18T22:12:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70fbc20740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd15eb0 0x5614fdd285b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70fbc20740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd167d0 0x5614fdd28af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70fbc20740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd255e0 0x5614fdd29030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70fbc20740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f70f41aafa0 con 0x5614fdd15eb0 2024-08-18T22:12:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70fbc20740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70f41ac410 con 0x5614fdd167d0 2024-08-18T22:12:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70fbc20740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f70f41ab670 con 0x5614fdd255e0 2024-08-18T22:12:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70fbc20740 10 client.0 _ll_register_callbacks cb 0x7f70ec04b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70f2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd15eb0 0x5614fdd285b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70f2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd15eb0 0x5614fdd285b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55110/0 (socket says 172.21.15.123:55110) 2024-08-18T22:12:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70f2ffd640 1 -- 172.21.15.123:0/3039583698 learned_addr learned my addr 172.21.15.123:0/3039583698 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70f27fc640 1 --2- 172.21.15.123:0/3039583698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd167d0 0x5614fdd28af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70f37fe640 1 --2- 172.21.15.123:0/3039583698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd255e0 0x5614fdd29030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70f2ffd640 1 -- 172.21.15.123:0/3039583698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd255e0 msgr2=0x5614fdd29030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70f2ffd640 1 --2- 172.21.15.123:0/3039583698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd255e0 0x5614fdd29030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70f2ffd640 1 -- 172.21.15.123:0/3039583698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd167d0 msgr2=0x5614fdd28af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70f2ffd640 1 --2- 172.21.15.123:0/3039583698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd167d0 0x5614fdd28af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70f2ffd640 1 -- 172.21.15.123:0/3039583698 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614fdd9dac0 con 0x5614fdd15eb0 2024-08-18T22:12:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70f37fe640 1 --2- 172.21.15.123:0/3039583698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd255e0 0x5614fdd29030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70f2ffd640 1 --2- 172.21.15.123:0/3039583698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd15eb0 0x5614fdd285b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f70e400a930 tx=0x7f70e4009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675411fe6384214d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70d2ffd640 1 -- 172.21.15.123:0/3039583698 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e4019d00 con 0x5614fdd15eb0 2024-08-18T22:12:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.948+0000 7f70d2ffd640 1 -- 172.21.15.123:0/3039583698 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f70e4021480 con 0x5614fdd15eb0 2024-08-18T22:12:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.949+0000 7f70fbc20740 1 -- 172.21.15.123:0/3039583698 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70e80a3fe0 con 0x5614fdd15eb0 2024-08-18T22:12:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.949+0000 7f70d2ffd640 1 -- 172.21.15.123:0/3039583698 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f70e402f050 con 0x5614fdd15eb0 2024-08-18T22:12:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.949+0000 7f70fbc20740 10 client.16290 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.949+0000 7f70fbc20740 1 -- 172.21.15.123:0/3039583698 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5614fdd9ecd0 con 0x5614fdd15eb0 2024-08-18T22:12:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.949+0000 7f70d2ffd640 1 -- 172.21.15.123:0/3039583698 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70e80a3fe0 con 0x5614fdd15eb0 2024-08-18T22:12:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.949+0000 7f70d2ffd640 1 -- 172.21.15.123:0/3039583698 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f70e4020740 con 0x5614fdd15eb0 2024-08-18T22:12:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.949+0000 7f70fbc20740 10 client.16290 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.949+0000 7f70fbc20740 10 client.16290 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-18T22:12:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.949+0000 7f70fbc20740 20 client.16290 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.949+0000 7f70fbc20740 1 --2- 172.21.15.123:0/3039583698 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5614fdd9f470 0x5614fdda1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.949+0000 7f70fbc20740 4 client.16290 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:12:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.949+0000 7f70fbc20740 1 -- 172.21.15.123:0/3039583698 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5614fdc834c0 con 0x5614fdd9f470 2024-08-18T22:12:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.949+0000 7f70f27fc640 1 --2- 172.21.15.123:0/3039583698 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5614fdd9f470 0x5614fdda1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70d2ffd640 10 client.16290 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:12:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70f27fc640 1 --2- 172.21.15.123:0/3039583698 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5614fdd9f470 0x5614fdda1890 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5be8edfac31f2a6 server_cookie=a20bcb42e06f412 in_seq=0 out_seq=0 2024-08-18T22:12:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70d2ffd640 1 -- 172.21.15.123:0/3039583698 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5614fdc834c0 con 0x5614fdd9f470 2024-08-18T22:12:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70d2ffd640 10 client.16290 handle_command_reply: tid=0 2024-08-18T22:12:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70fbc20740 1 client.16290 shutdown 2024-08-18T22:12:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70fbc20740 1 -- 172.21.15.123:0/3039583698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd15eb0 msgr2=0x5614fdd285b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70fbc20740 1 --2- 172.21.15.123:0/3039583698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd15eb0 0x5614fdd285b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f70e400a930 tx=0x7f70e4009ba0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70fbc20740 1 -- 172.21.15.123:0/3039583698 shutdown_connections 2024-08-18T22:12:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70fbc20740 1 --2- 172.21.15.123:0/3039583698 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5614fdd9f470 0x5614fdda1890 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70fbc20740 1 --2- 172.21.15.123:0/3039583698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614fdd255e0 0x5614fdd29030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70fbc20740 1 --2- 172.21.15.123:0/3039583698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614fdd167d0 0x5614fdd28af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70d2ffd640 0 client.16290 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:12:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70fbc20740 1 --2- 172.21.15.123:0/3039583698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5614fdd15eb0 0x5614fdd285b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70fbc20740 1 -- 172.21.15.123:0/3039583698 >> 172.21.15.123:0/3039583698 conn(0x5614fdd12580 msgr2=0x5614fdd214b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70fbc20740 1 -- 172.21.15.123:0/3039583698 shutdown_connections 2024-08-18T22:12:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70fbc20740 1 -- 172.21.15.123:0/3039583698 wait complete. 2024-08-18T22:12:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.950+0000 7f70fbc20740 20 client.16290 trim_cache size 0 max 16384 2024-08-18T22:12:27.962 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:12:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.951+0000 7f70f9822640 1 -- 172.21.15.123:0/2533891503 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f70dc0a2b80 msgr2=0x7f70dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.951+0000 7f70f9822640 1 --2- 172.21.15.123:0/2533891503 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f70dc0a2b80 0x7f70dc0a5040 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f70ec04a000 tx=0x7f70ec046000 comp rx=0 tx=0).stop 2024-08-18T22:12:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.951+0000 7f70f9822640 1 -- 172.21.15.123:0/2533891503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4103470 msgr2=0x7f70f4198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.951+0000 7f70f9822640 1 --2- 172.21.15.123:0/2533891503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4103470 0x7f70f4198960 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f70e800b450 tx=0x7f70e800b910 comp rx=0 tx=0).stop 2024-08-18T22:12:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.951+0000 7f70f9822640 1 -- 172.21.15.123:0/2533891503 shutdown_connections 2024-08-18T22:12:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.951+0000 7f70f9822640 1 --2- 172.21.15.123:0/2533891503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f4107fc0 0x7f70f419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.951+0000 7f70f9822640 1 --2- 172.21.15.123:0/2533891503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4103470 0x7f70f4198960 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.951+0000 7f70f9822640 1 --2- 172.21.15.123:0/2533891503 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f70dc0a2b80 0x7f70dc0a5040 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.951+0000 7f70f9822640 1 --2- 172.21.15.123:0/2533891503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f4102ac0 0x7f70f4198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.951+0000 7f70f9822640 1 -- 172.21.15.123:0/2533891503 >> 172.21.15.123:0/2533891503 conn(0x7f70f40fc500 msgr2=0x7f70f4105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.951+0000 7f70f9822640 1 -- 172.21.15.123:0/2533891503 shutdown_connections 2024-08-18T22:12:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:27.951+0000 7f70f9822640 1 -- 172.21.15.123:0/2533891503 wait complete. 2024-08-18T22:12:29.024 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-18T22:12:29.277 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:12:29.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:29 smithi183 ceph-mon[22097]: pgmap v481: 129 pgs: 129 active+clean; 6.1 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 1.10k op/s 2024-08-18T22:12:29.668 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:29 smithi123 ceph-mon[18462]: pgmap v481: 129 pgs: 129 active+clean; 6.1 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 1.10k op/s 2024-08-18T22:12:29.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.747+0000 7fa99408d640 1 -- 172.21.15.123:0/791076731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa98c107890 msgr2=0x7fa98c107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:29.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.747+0000 7fa99408d640 1 --2- 172.21.15.123:0/791076731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa98c107890 0x7fa98c107c70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa988009930 tx=0x7fa98802a420 comp rx=0 tx=0).stop 2024-08-18T22:12:29.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.747+0000 7fa99408d640 1 -- 172.21.15.123:0/791076731 shutdown_connections 2024-08-18T22:12:29.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.747+0000 7fa99408d640 1 --2- 172.21.15.123:0/791076731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa98c102230 0x7fa98c10e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.747+0000 7fa99408d640 1 --2- 172.21.15.123:0/791076731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa98c101890 0x7fa98c101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.747+0000 7fa99408d640 1 --2- 172.21.15.123:0/791076731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa98c107890 0x7fa98c107c70 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.747+0000 7fa99408d640 1 -- 172.21.15.123:0/791076731 >> 172.21.15.123:0/791076731 conn(0x7fa98c0fd5b0 msgr2=0x7fa98c0ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:29.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.748+0000 7fa99408d640 1 -- 172.21.15.123:0/791076731 shutdown_connections 2024-08-18T22:12:29.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.748+0000 7fa99408d640 1 -- 172.21.15.123:0/791076731 wait complete. 2024-08-18T22:12:29.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.748+0000 7fa99408d640 1 Processor -- start 2024-08-18T22:12:29.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.748+0000 7fa99408d640 1 -- start start 2024-08-18T22:12:29.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.748+0000 7fa99408d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa98c101890 0x7fa98c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.748+0000 7fa99408d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa98c102230 0x7fa98c198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.748+0000 7fa99408d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa98c107890 0x7fa98c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.748+0000 7fa99408d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c111d30 con 0x7fa98c102230 2024-08-18T22:12:29.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.748+0000 7fa99408d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c111bb0 con 0x7fa98c101890 2024-08-18T22:12:29.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa99408d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c111eb0 con 0x7fa98c107890 2024-08-18T22:12:29.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa991628640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa98c102230 0x7fa98c198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa991628640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa98c102230 0x7fa98c198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55122/0 (socket says 172.21.15.123:55122) 2024-08-18T22:12:29.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa991628640 1 -- 172.21.15.123:0/3548062623 learned_addr learned my addr 172.21.15.123:0/3548062623 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:29.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa991e29640 1 --2- 172.21.15.123:0/3548062623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa98c101890 0x7fa98c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa99262a640 1 --2- 172.21.15.123:0/3548062623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa98c107890 0x7fa98c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa991628640 1 -- 172.21.15.123:0/3548062623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa98c107890 msgr2=0x7fa98c19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:29.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa991628640 1 --2- 172.21.15.123:0/3548062623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa98c107890 0x7fa98c19cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa991628640 1 -- 172.21.15.123:0/3548062623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa98c101890 msgr2=0x7fa98c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:29.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa991628640 1 --2- 172.21.15.123:0/3548062623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa98c101890 0x7fa98c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa991628640 1 -- 172.21.15.123:0/3548062623 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98c19d2c0 con 0x7fa98c102230 2024-08-18T22:12:29.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa991628640 1 --2- 172.21.15.123:0/3548062623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa98c102230 0x7fa98c198850 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00b4a0 tx=0x7fa97c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:29.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa982ffd640 1 -- 172.21.15.123:0/3548062623 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c014070 con 0x7fa98c102230 2024-08-18T22:12:29.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa99408d640 1 -- 172.21.15.123:0/3548062623 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa98c19d5b0 con 0x7fa98c102230 2024-08-18T22:12:29.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa982ffd640 1 -- 172.21.15.123:0/3548062623 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa97c010af0 con 0x7fa98c102230 2024-08-18T22:12:29.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa982ffd640 1 -- 172.21.15.123:0/3548062623 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c017d10 con 0x7fa98c102230 2024-08-18T22:12:29.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.749+0000 7fa99408d640 1 -- 172.21.15.123:0/3548062623 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa98c1a4e90 con 0x7fa98c102230 2024-08-18T22:12:29.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.752+0000 7fa982ffd640 1 -- 172.21.15.123:0/3548062623 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fa97c017070 con 0x7fa98c102230 2024-08-18T22:12:29.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.752+0000 7fa99648b740 1 Processor -- start 2024-08-18T22:12:29.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.752+0000 7fa99648b740 1 -- start start 2024-08-18T22:12:29.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.752+0000 7fa99648b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc695eb0 0x5604fc696290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.752+0000 7fa99648b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc6967d0 0x5604fc6a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.752+0000 7fa99648b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6a79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.752+0000 7fa99648b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5604fc5fba40 con 0x5604fc6a55e0 2024-08-18T22:12:29.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.752+0000 7fa99648b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5604fc5939d0 con 0x5604fc6967d0 2024-08-18T22:12:29.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.752+0000 7fa99648b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5604fc5f7a00 con 0x5604fc695eb0 2024-08-18T22:12:29.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.752+0000 7fa982ffd640 1 --2- 172.21.15.123:0/3548062623 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa9780a2b80 0x7fa9780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.752+0000 7fa991628640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6a79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa991628640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6a79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55128/0 (socket says 172.21.15.123:55128) 2024-08-18T22:12:29.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa991628640 1 -- 172.21.15.123:0/532802726 learned_addr learned my addr 172.21.15.123:0/532802726 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:29.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa99262a640 1 --2- 172.21.15.123:0/3548062623 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa9780a2b80 0x7fa9780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa991e29640 1 --2- 172.21.15.123:0/532802726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc6967d0 0x5604fc6a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa99262a640 1 --2- 172.21.15.123:0/532802726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc695eb0 0x5604fc696290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa982ffd640 1 -- 172.21.15.123:0/3548062623 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fa97c0ce850 con 0x7fa98c102230 2024-08-18T22:12:29.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa991628640 1 -- 172.21.15.123:0/532802726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc695eb0 msgr2=0x5604fc696290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:29.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa991628640 1 --2- 172.21.15.123:0/532802726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc695eb0 0x5604fc696290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa991628640 1 -- 172.21.15.123:0/532802726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc6967d0 msgr2=0x5604fc6a50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:29.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa991628640 1 --2- 172.21.15.123:0/532802726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc6967d0 0x5604fc6a50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa991628640 1 -- 172.21.15.123:0/532802726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604fc59a650 con 0x5604fc6a55e0 2024-08-18T22:12:29.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa99262a640 1 --2- 172.21.15.123:0/3548062623 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa9780a2b80 0x7fa9780a5040 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa984009fd0 tx=0x7fa984009a10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:29.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa991628640 1 --2- 172.21.15.123:0/532802726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6a79d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0cbfc0 tx=0x7fa97c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4336445132a67df4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:29.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa977fff640 1 -- 172.21.15.123:0/532802726 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c01e070 con 0x5604fc6a55e0 2024-08-18T22:12:29.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa977fff640 1 -- 172.21.15.123:0/532802726 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa97c09b420 con 0x5604fc6a55e0 2024-08-18T22:12:29.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.753+0000 7fa977fff640 1 -- 172.21.15.123:0/532802726 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0990f0 con 0x5604fc6a55e0 2024-08-18T22:12:29.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.754+0000 7fa99648b740 1 -- 172.21.15.123:0/532802726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 msgr2=0x5604fc6a79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:29.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.754+0000 7fa99648b740 1 --2- 172.21.15.123:0/532802726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6a79d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0cbfc0 tx=0x7fa97c0047d0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.754+0000 7fa99648b740 1 -- 172.21.15.123:0/532802726 shutdown_connections 2024-08-18T22:12:29.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.754+0000 7fa99648b740 1 --2- 172.21.15.123:0/532802726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6a79d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.754+0000 7fa99648b740 1 --2- 172.21.15.123:0/532802726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc6967d0 0x5604fc6a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.754+0000 7fa99648b740 1 --2- 172.21.15.123:0/532802726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc695eb0 0x5604fc696290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.754+0000 7fa99648b740 1 -- 172.21.15.123:0/532802726 >> 172.21.15.123:0/532802726 conn(0x5604fc692580 msgr2=0x5604fc692960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:29.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.754+0000 7fa99648b740 1 -- 172.21.15.123:0/532802726 shutdown_connections 2024-08-18T22:12:29.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.754+0000 7fa99648b740 1 -- 172.21.15.123:0/532802726 wait complete. 2024-08-18T22:12:29.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa99648b740 1 -- start start 2024-08-18T22:12:29.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa99648b740 1 Processor -- start 2024-08-18T22:12:29.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa99648b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc695eb0 0x5604fc6a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa99648b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc6967d0 0x5604fc6a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa99648b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6a2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa99648b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5604fc6a81b0 con 0x5604fc6a55e0 2024-08-18T22:12:29.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa99648b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5604fc5b6b20 con 0x5604fc695eb0 2024-08-18T22:12:29.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa99648b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5604fc6a8330 con 0x5604fc6967d0 2024-08-18T22:12:29.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa99648b740 10 client.0 _ll_register_callbacks cb 0x5604fc5b4bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:29.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa99262a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6a2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa99262a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6a2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55140/0 (socket says 172.21.15.123:55140) 2024-08-18T22:12:29.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa99262a640 1 -- 172.21.15.123:0/3629283197 learned_addr learned my addr 172.21.15.123:0/3629283197 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:29.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa991e29640 1 --2- 172.21.15.123:0/3629283197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc695eb0 0x5604fc6a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa991628640 1 --2- 172.21.15.123:0/3629283197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc6967d0 0x5604fc6a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa99262a640 1 -- 172.21.15.123:0/3629283197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc6967d0 msgr2=0x5604fc6a2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:29.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa99262a640 1 --2- 172.21.15.123:0/3629283197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc6967d0 0x5604fc6a2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.755+0000 7fa99262a640 1 -- 172.21.15.123:0/3629283197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc695eb0 msgr2=0x5604fc6a24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:29.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa99262a640 1 --2- 172.21.15.123:0/3629283197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc695eb0 0x5604fc6a24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa99262a640 1 -- 172.21.15.123:0/3629283197 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604fc36d3c0 con 0x5604fc6a55e0 2024-08-18T22:12:29.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa991628640 1 --2- 172.21.15.123:0/3629283197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc6967d0 0x5604fc6a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:29.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa991e29640 1 --2- 172.21.15.123:0/3629283197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc695eb0 0x5604fc6a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:29.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa99262a640 1 --2- 172.21.15.123:0/3629283197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6a2f70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa984016f50 tx=0x7fa9840093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d248f0b99c47ea4f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:29.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa9757fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:29.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa9757fa640 1 -- 172.21.15.123:0/3629283197 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa984028060 con 0x5604fc6a55e0 2024-08-18T22:12:29.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa9757fa640 1 -- 172.21.15.123:0/3629283197 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fa9840233f0 con 0x5604fc6a55e0 2024-08-18T22:12:29.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa99648b740 1 -- 172.21.15.123:0/3629283197 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa97c09b420 con 0x5604fc6a55e0 2024-08-18T22:12:29.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa9757fa640 1 -- 172.21.15.123:0/3629283197 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa98402f050 con 0x5604fc6a55e0 2024-08-18T22:12:29.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa99648b740 10 client.16302 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:29.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa99648b740 1 -- 172.21.15.123:0/3629283197 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5604fc6b3e20 con 0x5604fc6a55e0 2024-08-18T22:12:29.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa9757fa640 1 -- 172.21.15.123:0/3629283197 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa97c09b420 con 0x5604fc6a55e0 2024-08-18T22:12:29.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa9757fa640 1 -- 172.21.15.123:0/3629283197 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa984022070 con 0x5604fc6a55e0 2024-08-18T22:12:29.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa99648b740 10 client.16302 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:29.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa99648b740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:29.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa99648b740 20 client.16302 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:29.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa99648b740 1 --2- 172.21.15.123:0/3629283197 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5604fc6b52e0 0x5604fc6b7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa99648b740 4 client.16302 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:12:29.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.756+0000 7fa99648b740 1 -- 172.21.15.123:0/3629283197 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604fc608fb0 con 0x5604fc6b52e0 2024-08-18T22:12:29.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.757+0000 7fa991e29640 1 --2- 172.21.15.123:0/3629283197 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5604fc6b52e0 0x5604fc6b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.757+0000 7fa991e29640 1 --2- 172.21.15.123:0/3629283197 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5604fc6b52e0 0x5604fc6b7760 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7719915e82c9233a server_cookie=290dbb92e4f51ee7 in_seq=0 out_seq=0 2024-08-18T22:12:29.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.757+0000 7fa9757fa640 10 client.16302 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:29.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.758+0000 7fa9757fa640 1 -- 172.21.15.123:0/3629283197 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604fc608fb0 con 0x5604fc6b52e0 2024-08-18T22:12:29.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.758+0000 7fa9757fa640 10 client.16302 handle_command_reply: tid=0 2024-08-18T22:12:29.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.758+0000 7fa99648b740 1 client.16302 shutdown 2024-08-18T22:12:29.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.758+0000 7fa99648b740 1 -- 172.21.15.123:0/3629283197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 msgr2=0x5604fc6a2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:29.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.758+0000 7fa99648b740 1 --2- 172.21.15.123:0/3629283197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6a2f70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa984016f50 tx=0x7fa9840093d0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.758+0000 7fa99648b740 1 -- 172.21.15.123:0/3629283197 shutdown_connections 2024-08-18T22:12:29.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.758+0000 7fa99648b740 1 --2- 172.21.15.123:0/3629283197 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5604fc6b52e0 0x5604fc6b7760 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.758+0000 7fa99648b740 1 --2- 172.21.15.123:0/3629283197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6a2f70 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.758+0000 7fa99648b740 1 --2- 172.21.15.123:0/3629283197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc6967d0 0x5604fc6a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.758+0000 7fa99648b740 1 --2- 172.21.15.123:0/3629283197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc695eb0 0x5604fc6a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.758+0000 7fa99648b740 1 -- 172.21.15.123:0/3629283197 >> 172.21.15.123:0/3629283197 conn(0x5604fc692580 msgr2=0x5604fc6982e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:29.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.758+0000 7fa9757fa640 0 client.16302 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:29.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.758+0000 7fa99648b740 1 -- 172.21.15.123:0/3629283197 shutdown_connections 2024-08-18T22:12:29.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.759+0000 7fa99648b740 1 -- 172.21.15.123:0/3629283197 wait complete. 2024-08-18T22:12:29.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.759+0000 7fa99648b740 20 client.16302 trim_cache size 0 max 16384 2024-08-18T22:12:29.774 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:29 smithi130 ceph-mon[21698]: pgmap v481: 129 pgs: 129 active+clean; 6.1 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 1.10k op/s 2024-08-18T22:12:29.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.771+0000 7fa99648b740 1 Processor -- start 2024-08-18T22:12:29.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.771+0000 7fa99648b740 1 -- start start 2024-08-18T22:12:29.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa99648b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc695eb0 0x5604fc6a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa99648b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc6967d0 0x5604fc6a1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa99648b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6bd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa99648b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c1af2b0 con 0x5604fc6a55e0 2024-08-18T22:12:29.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa99648b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c1acb80 con 0x5604fc695eb0 2024-08-18T22:12:29.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa99648b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c1aa9d0 con 0x5604fc6967d0 2024-08-18T22:12:29.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa99262a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6bd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa991e29640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc695eb0 0x5604fc6a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa99262a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6bd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55150/0 (socket says 172.21.15.123:55150) 2024-08-18T22:12:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa99262a640 1 -- 172.21.15.123:0/299336216 learned_addr learned my addr 172.21.15.123:0/299336216 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa991628640 1 --2- 172.21.15.123:0/299336216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc6967d0 0x5604fc6a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa99262a640 1 -- 172.21.15.123:0/299336216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc6967d0 msgr2=0x5604fc6a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa99262a640 1 --2- 172.21.15.123:0/299336216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc6967d0 0x5604fc6a1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa99262a640 1 -- 172.21.15.123:0/299336216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc695eb0 msgr2=0x5604fc6a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa99262a640 1 --2- 172.21.15.123:0/299336216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc695eb0 0x5604fc6a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa99262a640 1 -- 172.21.15.123:0/299336216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604fc6970a0 con 0x5604fc6a55e0 2024-08-18T22:12:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa991628640 1 --2- 172.21.15.123:0/299336216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc6967d0 0x5604fc6a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa99262a640 1 --2- 172.21.15.123:0/299336216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6bd030 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa98400a610 tx=0x7fa984004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80855575619bbe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:29.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa9777fe640 1 -- 172.21.15.123:0/299336216 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa984028040 con 0x5604fc6a55e0 2024-08-18T22:12:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.772+0000 7fa9777fe640 1 -- 172.21.15.123:0/299336216 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa984019b90 con 0x5604fc6a55e0 2024-08-18T22:12:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.773+0000 7fa9777fe640 1 -- 172.21.15.123:0/299336216 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa984033650 con 0x5604fc6a55e0 2024-08-18T22:12:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.773+0000 7fa99648b740 1 -- 172.21.15.123:0/299336216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 msgr2=0x5604fc6bd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.773+0000 7fa99648b740 1 --2- 172.21.15.123:0/299336216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6bd030 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa98400a610 tx=0x7fa984004b50 comp rx=0 tx=0).stop 2024-08-18T22:12:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.773+0000 7fa99648b740 1 -- 172.21.15.123:0/299336216 shutdown_connections 2024-08-18T22:12:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.773+0000 7fa99648b740 1 --2- 172.21.15.123:0/299336216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6a55e0 0x5604fc6bd030 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.773+0000 7fa99648b740 1 --2- 172.21.15.123:0/299336216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc6967d0 0x5604fc6a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.773+0000 7fa99648b740 1 --2- 172.21.15.123:0/299336216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc695eb0 0x5604fc6a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.773+0000 7fa99648b740 1 -- 172.21.15.123:0/299336216 >> 172.21.15.123:0/299336216 conn(0x5604fc692580 msgr2=0x5604fc69d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.773+0000 7fa99648b740 1 -- 172.21.15.123:0/299336216 shutdown_connections 2024-08-18T22:12:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.773+0000 7fa99648b740 1 -- 172.21.15.123:0/299336216 wait complete. 2024-08-18T22:12:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.773+0000 7fa99648b740 1 -- start start 2024-08-18T22:12:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa99648b740 1 Processor -- start 2024-08-18T22:12:29.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa99648b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc695eb0 0x5604fc6adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa99648b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6967d0 0x5604fc6a8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa99648b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc6a55e0 0x5604fc6a8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa99648b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c1ab040 con 0x5604fc6967d0 2024-08-18T22:12:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa99648b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c1ac4b0 con 0x5604fc6a55e0 2024-08-18T22:12:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa99648b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c1ab710 con 0x5604fc695eb0 2024-08-18T22:12:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa99648b740 10 client.0 _ll_register_callbacks cb 0x7fa98400a540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa991628640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6967d0 0x5604fc6a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa991628640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6967d0 0x5604fc6a8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55162/0 (socket says 172.21.15.123:55162) 2024-08-18T22:12:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa991628640 1 -- 172.21.15.123:0/2388974364 learned_addr learned my addr 172.21.15.123:0/2388974364 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa991e29640 1 --2- 172.21.15.123:0/2388974364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc695eb0 0x5604fc6adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa99262a640 1 --2- 172.21.15.123:0/2388974364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc6a55e0 0x5604fc6a8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa991628640 1 -- 172.21.15.123:0/2388974364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc695eb0 msgr2=0x5604fc6adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:29.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa991628640 1 --2- 172.21.15.123:0/2388974364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc695eb0 0x5604fc6adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa991628640 1 -- 172.21.15.123:0/2388974364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc6a55e0 msgr2=0x5604fc6a8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:29.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa991628640 1 --2- 172.21.15.123:0/2388974364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc6a55e0 0x5604fc6a8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.774+0000 7fa991628640 1 -- 172.21.15.123:0/2388974364 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604fc6a9390 con 0x5604fc6967d0 2024-08-18T22:12:29.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa991628640 1 --2- 172.21.15.123:0/2388974364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6967d0 0x5604fc6a8580 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0cc330 tx=0x7fa97c09a770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53d872f5ffa2fec server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:29.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa9757fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:29.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa9757fa640 1 -- 172.21.15.123:0/2388974364 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c083070 con 0x5604fc6967d0 2024-08-18T22:12:29.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa9757fa640 1 -- 172.21.15.123:0/2388974364 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fa97c017360 con 0x5604fc6967d0 2024-08-18T22:12:29.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa99648b740 1 -- 172.21.15.123:0/2388974364 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa984019b90 con 0x5604fc6967d0 2024-08-18T22:12:29.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa9757fa640 1 -- 172.21.15.123:0/2388974364 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa97c07e050 con 0x5604fc6967d0 2024-08-18T22:12:29.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa99648b740 10 client.16308 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa99648b740 1 -- 172.21.15.123:0/2388974364 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5604fc71f0c0 con 0x5604fc6967d0 2024-08-18T22:12:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa9757fa640 1 -- 172.21.15.123:0/2388974364 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa984019b90 con 0x5604fc6967d0 2024-08-18T22:12:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa9757fa640 1 -- 172.21.15.123:0/2388974364 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa97c097390 con 0x5604fc6967d0 2024-08-18T22:12:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa99648b740 10 client.16308 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa99648b740 10 client.16308 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa99648b740 20 client.16308 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa99648b740 1 --2- 172.21.15.123:0/2388974364 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5604fc71f460 0x5604fc721850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa99648b740 4 client.16308 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:12:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.775+0000 7fa99648b740 1 -- 172.21.15.123:0/2388974364 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5604fc6034c0 con 0x5604fc71f460 2024-08-18T22:12:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa991e29640 1 --2- 172.21.15.123:0/2388974364 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5604fc71f460 0x5604fc721850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa9757fa640 10 client.16308 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa991e29640 1 --2- 172.21.15.123:0/2388974364 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5604fc71f460 0x5604fc721850 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=702026565ceb13c3 server_cookie=7c7ca631c5156864 in_seq=0 out_seq=0 2024-08-18T22:12:29.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa9757fa640 1 -- 172.21.15.123:0/2388974364 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5604fc6034c0 con 0x5604fc71f460 2024-08-18T22:12:29.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa9757fa640 10 client.16308 handle_command_reply: tid=0 2024-08-18T22:12:29.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa99648b740 1 client.16308 shutdown 2024-08-18T22:12:29.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa99648b740 1 -- 172.21.15.123:0/2388974364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6967d0 msgr2=0x5604fc6a8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:29.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa99648b740 1 --2- 172.21.15.123:0/2388974364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6967d0 0x5604fc6a8580 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0cc330 tx=0x7fa97c09a770 comp rx=0 tx=0).stop 2024-08-18T22:12:29.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa99648b740 1 -- 172.21.15.123:0/2388974364 shutdown_connections 2024-08-18T22:12:29.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa99648b740 1 --2- 172.21.15.123:0/2388974364 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5604fc71f460 0x5604fc721850 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa99648b740 1 --2- 172.21.15.123:0/2388974364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604fc6a55e0 0x5604fc6a8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa99648b740 1 --2- 172.21.15.123:0/2388974364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604fc6967d0 0x5604fc6a8580 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa99648b740 1 --2- 172.21.15.123:0/2388974364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5604fc695eb0 0x5604fc6adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa9757fa640 0 client.16308 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:29.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa99648b740 1 -- 172.21.15.123:0/2388974364 >> 172.21.15.123:0/2388974364 conn(0x5604fc692580 msgr2=0x5604fc6a0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:29.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa99648b740 1 -- 172.21.15.123:0/2388974364 shutdown_connections 2024-08-18T22:12:29.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa99648b740 1 -- 172.21.15.123:0/2388974364 wait complete. 2024-08-18T22:12:29.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.776+0000 7fa99648b740 20 client.16308 trim_cache size 0 max 16384 2024-08-18T22:12:29.786 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:12:29.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.777+0000 7fa99408d640 1 -- 172.21.15.123:0/3548062623 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa9780a2b80 msgr2=0x7fa9780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:29.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.777+0000 7fa99408d640 1 --2- 172.21.15.123:0/3548062623 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa9780a2b80 0x7fa9780a5040 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa984009fd0 tx=0x7fa984009a10 comp rx=0 tx=0).stop 2024-08-18T22:12:29.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.777+0000 7fa99408d640 1 -- 172.21.15.123:0/3548062623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa98c102230 msgr2=0x7fa98c198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:29.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.777+0000 7fa99408d640 1 --2- 172.21.15.123:0/3548062623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa98c102230 0x7fa98c198850 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00b4a0 tx=0x7fa97c00b960 comp rx=0 tx=0).stop 2024-08-18T22:12:29.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.777+0000 7fa99408d640 1 -- 172.21.15.123:0/3548062623 shutdown_connections 2024-08-18T22:12:29.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.777+0000 7fa99408d640 1 --2- 172.21.15.123:0/3548062623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa98c107890 0x7fa98c19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.777+0000 7fa99408d640 1 --2- 172.21.15.123:0/3548062623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa98c102230 0x7fa98c198850 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.777+0000 7fa99408d640 1 --2- 172.21.15.123:0/3548062623 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fa9780a2b80 0x7fa9780a5040 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.777+0000 7fa99408d640 1 --2- 172.21.15.123:0/3548062623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa98c101890 0x7fa98c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:29.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.777+0000 7fa99408d640 1 -- 172.21.15.123:0/3548062623 >> 172.21.15.123:0/3548062623 conn(0x7fa98c0fd5b0 msgr2=0x7fa98c0fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:29.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.777+0000 7fa99408d640 1 -- 172.21.15.123:0/3548062623 shutdown_connections 2024-08-18T22:12:29.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:29.777+0000 7fa99408d640 1 -- 172.21.15.123:0/3548062623 wait complete. 2024-08-18T22:12:31.593 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-18T22:12:31.593 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-18T22:12:31.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:31 smithi183 ceph-mon[22097]: pgmap v482: 129 pgs: 129 active+clean; 2.1 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 1.10k op/s 2024-08-18T22:12:31.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:31 smithi123 ceph-mon[18462]: pgmap v482: 129 pgs: 129 active+clean; 2.1 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 1.10k op/s 2024-08-18T22:12:31.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:31 smithi130 ceph-mon[21698]: pgmap v482: 129 pgs: 129 active+clean; 2.1 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 1.10k op/s 2024-08-18T22:12:31.864 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:12:32.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.393+0000 7f0c70287640 1 -- 172.21.15.123:0/2339280493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c68101150 msgr2=0x7f0c6810d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:32.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.393+0000 7f0c70287640 1 --2- 172.21.15.123:0/2339280493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c68101150 0x7f0c6810d680 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009cd0 tx=0x7f0c6002a8e0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.393+0000 7f0c70287640 1 -- 172.21.15.123:0/2339280493 shutdown_connections 2024-08-18T22:12:32.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.393+0000 7f0c70287640 1 --2- 172.21.15.123:0/2339280493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c68101150 0x7f0c6810d680 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.393+0000 7f0c70287640 1 --2- 172.21.15.123:0/2339280493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c681007b0 0x7f0c68100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.393+0000 7f0c70287640 1 --2- 172.21.15.123:0/2339280493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c681067b0 0x7f0c68106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.393+0000 7f0c70287640 1 -- 172.21.15.123:0/2339280493 >> 172.21.15.123:0/2339280493 conn(0x7f0c680fc4d0 msgr2=0x7f0c680fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:32.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.393+0000 7f0c70287640 1 -- 172.21.15.123:0/2339280493 shutdown_connections 2024-08-18T22:12:32.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.393+0000 7f0c70287640 1 -- 172.21.15.123:0/2339280493 wait complete. 2024-08-18T22:12:32.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.394+0000 7f0c70287640 1 Processor -- start 2024-08-18T22:12:32.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.394+0000 7f0c70287640 1 -- start start 2024-08-18T22:12:32.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.394+0000 7f0c70287640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c681007b0 0x7f0c681980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c70287640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c68101150 0x7f0c68198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c70287640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c681067b0 0x7f0c6819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c70287640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0c68111cc0 con 0x7f0c681007b0 2024-08-18T22:12:32.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c70287640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0c68111b40 con 0x7f0c681067b0 2024-08-18T22:12:32.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c70287640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0c68111e40 con 0x7f0c68101150 2024-08-18T22:12:32.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c6e023640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c681007b0 0x7f0c681980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c6e023640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c681007b0 0x7f0c681980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55172/0 (socket says 172.21.15.123:55172) 2024-08-18T22:12:32.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c6e023640 1 -- 172.21.15.123:0/180795018 learned_addr learned my addr 172.21.15.123:0/180795018 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:32.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c6e824640 1 --2- 172.21.15.123:0/180795018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c681067b0 0x7f0c6819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c6d822640 1 --2- 172.21.15.123:0/180795018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c68101150 0x7f0c68198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c6e023640 1 -- 172.21.15.123:0/180795018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c68101150 msgr2=0x7f0c68198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:32.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c6e023640 1 --2- 172.21.15.123:0/180795018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c68101150 0x7f0c68198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c6e023640 1 -- 172.21.15.123:0/180795018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c681067b0 msgr2=0x7f0c6819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:32.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c6e023640 1 --2- 172.21.15.123:0/180795018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c681067b0 0x7f0c6819c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c6e023640 1 -- 172.21.15.123:0/180795018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6819d080 con 0x7f0c681007b0 2024-08-18T22:12:32.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c6e824640 1 --2- 172.21.15.123:0/180795018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c681067b0 0x7f0c6819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:32.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c6e023640 1 --2- 172.21.15.123:0/180795018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c681007b0 0x7f0c681980d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400d770 tx=0x7f0c6400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:32.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c5b7fe640 1 -- 172.21.15.123:0/180795018 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c64017070 con 0x7f0c681007b0 2024-08-18T22:12:32.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c70287640 1 -- 172.21.15.123:0/180795018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6819d370 con 0x7f0c681007b0 2024-08-18T22:12:32.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c5b7fe640 1 -- 172.21.15.123:0/180795018 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c64005500 con 0x7f0c681007b0 2024-08-18T22:12:32.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c5b7fe640 1 -- 172.21.15.123:0/180795018 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c64004e00 con 0x7f0c681007b0 2024-08-18T22:12:32.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.395+0000 7f0c70287640 1 -- 172.21.15.123:0/180795018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c681a4c50 con 0x7f0c681007b0 2024-08-18T22:12:32.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.398+0000 7f0c5b7fe640 1 -- 172.21.15.123:0/180795018 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f0c64004fa0 con 0x7f0c681007b0 2024-08-18T22:12:32.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.398+0000 7f0c72685740 1 Processor -- start 2024-08-18T22:12:32.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.398+0000 7f0c72685740 1 -- start start 2024-08-18T22:12:32.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.398+0000 7f0c72685740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98200 0x557f2eb985e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.398+0000 7f0c72685740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eb98b20 0x557f2eba2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.398+0000 7f0c72685740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eba33e0 0x557f2eba57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.398+0000 7f0c72685740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557f2eb5be40 con 0x557f2eb98b20 2024-08-18T22:12:32.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.398+0000 7f0c72685740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557f2eafd7f0 con 0x557f2eb98200 2024-08-18T22:12:32.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.398+0000 7f0c72685740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557f2eaa4fb0 con 0x557f2eba33e0 2024-08-18T22:12:32.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c6e023640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eb98b20 0x557f2eba2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c6e023640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eb98b20 0x557f2eba2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55184/0 (socket says 172.21.15.123:55184) 2024-08-18T22:12:32.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c6e023640 1 -- 172.21.15.123:0/4264014401 learned_addr learned my addr 172.21.15.123:0/4264014401 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:32.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c6d822640 1 --2- 172.21.15.123:0/4264014401 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eba33e0 0x557f2eba57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c5b7fe640 1 --2- 172.21.15.123:0/180795018 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0c540a2b80 0x7f0c540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c6e824640 1 --2- 172.21.15.123:0/4264014401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98200 0x557f2eb985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c6e023640 1 -- 172.21.15.123:0/4264014401 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eba33e0 msgr2=0x557f2eba57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:32.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c6e023640 1 --2- 172.21.15.123:0/4264014401 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eba33e0 0x557f2eba57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c6e023640 1 -- 172.21.15.123:0/4264014401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98200 msgr2=0x557f2eb985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:32.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c6e023640 1 --2- 172.21.15.123:0/4264014401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98200 0x557f2eb985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c6e023640 1 -- 172.21.15.123:0/4264014401 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f2e86f6a0 con 0x557f2eb98b20 2024-08-18T22:12:32.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c6e824640 1 --2- 172.21.15.123:0/4264014401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98200 0x557f2eb985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:32.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c6e824640 1 --2- 172.21.15.123:0/180795018 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0c540a2b80 0x7f0c540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c5b7fe640 1 -- 172.21.15.123:0/180795018 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0c640cef00 con 0x7f0c681007b0 2024-08-18T22:12:32.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c6e023640 1 --2- 172.21.15.123:0/4264014401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eb98b20 0x557f2eba2ea0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0c6409b070 tx=0x7f0c64009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22d65553bfdd5c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:32.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.399+0000 7f0c6e824640 1 --2- 172.21.15.123:0/180795018 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0c540a2b80 0x7f0c540a5040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009430 tx=0x7f0c6003e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:32.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.400+0000 7f0c58dea640 1 -- 172.21.15.123:0/4264014401 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c64020070 con 0x557f2eb98b20 2024-08-18T22:12:32.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.400+0000 7f0c58dea640 1 -- 172.21.15.123:0/4264014401 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c640046c0 con 0x557f2eb98b20 2024-08-18T22:12:32.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.400+0000 7f0c58dea640 1 -- 172.21.15.123:0/4264014401 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6409b370 con 0x557f2eb98b20 2024-08-18T22:12:32.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.400+0000 7f0c72685740 1 -- 172.21.15.123:0/4264014401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eb98b20 msgr2=0x557f2eba2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:32.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.400+0000 7f0c72685740 1 --2- 172.21.15.123:0/4264014401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eb98b20 0x557f2eba2ea0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0c6409b070 tx=0x7f0c64009c30 comp rx=0 tx=0).stop 2024-08-18T22:12:32.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.400+0000 7f0c72685740 1 -- 172.21.15.123:0/4264014401 shutdown_connections 2024-08-18T22:12:32.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.400+0000 7f0c72685740 1 --2- 172.21.15.123:0/4264014401 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eba33e0 0x557f2eba57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.400+0000 7f0c72685740 1 --2- 172.21.15.123:0/4264014401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eb98b20 0x557f2eba2ea0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.400+0000 7f0c72685740 1 --2- 172.21.15.123:0/4264014401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98200 0x557f2eb985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.400+0000 7f0c72685740 1 -- 172.21.15.123:0/4264014401 >> 172.21.15.123:0/4264014401 conn(0x557f2eb94790 msgr2=0x557f2eb94b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.401+0000 7f0c72685740 1 -- 172.21.15.123:0/4264014401 shutdown_connections 2024-08-18T22:12:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.401+0000 7f0c72685740 1 -- 172.21.15.123:0/4264014401 wait complete. 2024-08-18T22:12:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.401+0000 7f0c72685740 1 -- start start 2024-08-18T22:12:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.401+0000 7f0c72685740 1 Processor -- start 2024-08-18T22:12:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.401+0000 7f0c72685740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eb98200 0x557f2eba0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.401+0000 7f0c72685740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98b20 0x557f2eba0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.401+0000 7f0c72685740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eba33e0 0x557f2eba0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.401+0000 7f0c72685740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557f2eab8cb0 con 0x557f2eb98200 2024-08-18T22:12:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.401+0000 7f0c72685740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557f2eaf97b0 con 0x557f2eb98b20 2024-08-18T22:12:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.401+0000 7f0c72685740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557f2eba5f50 con 0x557f2eba33e0 2024-08-18T22:12:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.401+0000 7f0c72685740 10 client.0 _ll_register_callbacks cb 0x557f2e80cba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.401+0000 7f0c6e023640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eb98200 0x557f2eba0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.401+0000 7f0c6e023640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eb98200 0x557f2eba0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55186/0 (socket says 172.21.15.123:55186) 2024-08-18T22:12:32.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.401+0000 7f0c6e023640 1 -- 172.21.15.123:0/2147930478 learned_addr learned my addr 172.21.15.123:0/2147930478 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.402+0000 7f0c6e824640 1 --2- 172.21.15.123:0/2147930478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eba33e0 0x557f2eba0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.402+0000 7f0c6d822640 1 --2- 172.21.15.123:0/2147930478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98b20 0x557f2eba0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.402+0000 7f0c6e023640 1 -- 172.21.15.123:0/2147930478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eba33e0 msgr2=0x557f2eba0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.402+0000 7f0c6e023640 1 --2- 172.21.15.123:0/2147930478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eba33e0 0x557f2eba0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.402+0000 7f0c6e023640 1 -- 172.21.15.123:0/2147930478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98b20 msgr2=0x557f2eba0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.402+0000 7f0c6e023640 1 --2- 172.21.15.123:0/2147930478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98b20 0x557f2eba0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.402+0000 7f0c6e023640 1 -- 172.21.15.123:0/2147930478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f2eab7bc0 con 0x557f2eb98200 2024-08-18T22:12:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.402+0000 7f0c6d822640 1 --2- 172.21.15.123:0/2147930478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98b20 0x557f2eba0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.402+0000 7f0c6e023640 1 --2- 172.21.15.123:0/2147930478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eb98200 0x557f2eba0330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0c64097d40 tx=0x7f0c640cf180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ef9353c5a4f9d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:32.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.402+0000 7f0c51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:32.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.403+0000 7f0c51ffb640 1 -- 172.21.15.123:0/2147930478 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c64020070 con 0x557f2eb98200 2024-08-18T22:12:32.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.403+0000 7f0c51ffb640 1 -- 172.21.15.123:0/2147930478 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0c64009cc0 con 0x557f2eb98200 2024-08-18T22:12:32.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.403+0000 7f0c72685740 1 -- 172.21.15.123:0/2147930478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f2eb0ad60 con 0x557f2eb98200 2024-08-18T22:12:32.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.403+0000 7f0c51ffb640 1 -- 172.21.15.123:0/2147930478 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0c640b4050 con 0x557f2eb98200 2024-08-18T22:12:32.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.403+0000 7f0c72685740 10 client.16320 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:32.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.403+0000 7f0c72685740 1 -- 172.21.15.123:0/2147930478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557f2ebb1e70 con 0x557f2eb98200 2024-08-18T22:12:32.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.403+0000 7f0c51ffb640 1 -- 172.21.15.123:0/2147930478 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557f2eb0ad60 con 0x557f2eb98200 2024-08-18T22:12:32.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.403+0000 7f0c51ffb640 1 -- 172.21.15.123:0/2147930478 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0c640d0020 con 0x557f2eb98200 2024-08-18T22:12:32.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.403+0000 7f0c72685740 10 client.16320 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:32.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.403+0000 7f0c72685740 10 client.16320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:32.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.403+0000 7f0c72685740 20 client.16320 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:32.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.403+0000 7f0c72685740 1 --2- 172.21.15.123:0/2147930478 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557f2ebb31c0 0x557f2ebb55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.403+0000 7f0c72685740 4 client.16320 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:12:32.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.403+0000 7f0c72685740 1 -- 172.21.15.123:0/2147930478 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f2eb05270 con 0x557f2ebb31c0 2024-08-18T22:12:32.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.404+0000 7f0c6d822640 1 --2- 172.21.15.123:0/2147930478 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557f2ebb31c0 0x557f2ebb55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.404+0000 7f0c6d822640 1 --2- 172.21.15.123:0/2147930478 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557f2ebb31c0 0x557f2ebb55b0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=773639733514786a server_cookie=967b00a0f0e2f770 in_seq=0 out_seq=0 2024-08-18T22:12:32.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.404+0000 7f0c51ffb640 10 client.16320 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:32.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.405+0000 7f0c51ffb640 1 -- 172.21.15.123:0/2147930478 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f2eb05270 con 0x557f2ebb31c0 2024-08-18T22:12:32.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.405+0000 7f0c51ffb640 10 client.16320 handle_command_reply: tid=0 2024-08-18T22:12:32.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.405+0000 7f0c72685740 1 client.16320 shutdown 2024-08-18T22:12:32.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.405+0000 7f0c72685740 1 -- 172.21.15.123:0/2147930478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eb98200 msgr2=0x557f2eba0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:32.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.405+0000 7f0c72685740 1 --2- 172.21.15.123:0/2147930478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eb98200 0x557f2eba0330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0c64097d40 tx=0x7f0c640cf180 comp rx=0 tx=0).stop 2024-08-18T22:12:32.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.405+0000 7f0c72685740 1 -- 172.21.15.123:0/2147930478 shutdown_connections 2024-08-18T22:12:32.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.405+0000 7f0c72685740 1 --2- 172.21.15.123:0/2147930478 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557f2ebb31c0 0x557f2ebb55b0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.405+0000 7f0c72685740 1 --2- 172.21.15.123:0/2147930478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eba33e0 0x557f2eba0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.405+0000 7f0c72685740 1 --2- 172.21.15.123:0/2147930478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98b20 0x557f2eba0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.405+0000 7f0c51ffb640 0 client.16320 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:32.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.405+0000 7f0c72685740 1 --2- 172.21.15.123:0/2147930478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eb98200 0x557f2eba0330 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.405+0000 7f0c72685740 1 -- 172.21.15.123:0/2147930478 >> 172.21.15.123:0/2147930478 conn(0x557f2eb94790 msgr2=0x557f2eb9a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:32.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.405+0000 7f0c72685740 1 -- 172.21.15.123:0/2147930478 shutdown_connections 2024-08-18T22:12:32.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.405+0000 7f0c72685740 1 -- 172.21.15.123:0/2147930478 wait complete. 2024-08-18T22:12:32.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.405+0000 7f0c72685740 20 client.16320 trim_cache size 0 max 16384 2024-08-18T22:12:32.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.422+0000 7f0c72685740 1 Processor -- start 2024-08-18T22:12:32.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.422+0000 7f0c72685740 1 -- start start 2024-08-18T22:12:32.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.422+0000 7f0c72685740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98200 0x557f2eba22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.422+0000 7f0c72685740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eb98b20 0x557f2ebbad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c72685740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eba33e0 0x557f2ebbb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c72685740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0c681b12a0 con 0x557f2eba33e0 2024-08-18T22:12:32.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c72685740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0c681aeb70 con 0x557f2eb98200 2024-08-18T22:12:32.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c72685740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0c681ac9c0 con 0x557f2eb98b20 2024-08-18T22:12:32.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c6e824640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eba33e0 0x557f2ebbb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c6e824640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eba33e0 0x557f2ebbb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55194/0 (socket says 172.21.15.123:55194) 2024-08-18T22:12:32.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c6e824640 1 -- 172.21.15.123:0/2846851451 learned_addr learned my addr 172.21.15.123:0/2846851451 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:32.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c6d822640 1 --2- 172.21.15.123:0/2846851451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eb98b20 0x557f2ebbad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c6e023640 1 --2- 172.21.15.123:0/2846851451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98200 0x557f2eba22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c6e824640 1 -- 172.21.15.123:0/2846851451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eb98b20 msgr2=0x557f2ebbad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:32.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c6e824640 1 --2- 172.21.15.123:0/2846851451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eb98b20 0x557f2ebbad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c6e824640 1 -- 172.21.15.123:0/2846851451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98200 msgr2=0x557f2eba22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:32.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c6e824640 1 --2- 172.21.15.123:0/2846851451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98200 0x557f2eba22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c6e824640 1 -- 172.21.15.123:0/2846851451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f2eb9f2e0 con 0x557f2eba33e0 2024-08-18T22:12:32.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c6e023640 1 --2- 172.21.15.123:0/2846851451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98200 0x557f2eba22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:32.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c6e824640 1 --2- 172.21.15.123:0/2846851451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eba33e0 0x557f2ebbb260 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009cd0 tx=0x7f0c60040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42d3d965b9ae913 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:32.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c53fff640 1 -- 172.21.15.123:0/2846851451 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60003970 con 0x557f2eba33e0 2024-08-18T22:12:32.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c53fff640 1 -- 172.21.15.123:0/2846851451 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c60036040 con 0x557f2eba33e0 2024-08-18T22:12:32.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.423+0000 7f0c53fff640 1 -- 172.21.15.123:0/2846851451 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c600307e0 con 0x557f2eba33e0 2024-08-18T22:12:32.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.424+0000 7f0c72685740 1 -- 172.21.15.123:0/2846851451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eba33e0 msgr2=0x557f2ebbb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:32.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.424+0000 7f0c72685740 1 --2- 172.21.15.123:0/2846851451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eba33e0 0x557f2ebbb260 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009cd0 tx=0x7f0c60040000 comp rx=0 tx=0).stop 2024-08-18T22:12:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.424+0000 7f0c72685740 1 -- 172.21.15.123:0/2846851451 shutdown_connections 2024-08-18T22:12:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.424+0000 7f0c72685740 1 --2- 172.21.15.123:0/2846851451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eba33e0 0x557f2ebbb260 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.424+0000 7f0c72685740 1 --2- 172.21.15.123:0/2846851451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eb98b20 0x557f2ebbad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.424+0000 7f0c72685740 1 --2- 172.21.15.123:0/2846851451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98200 0x557f2eba22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.424+0000 7f0c72685740 1 -- 172.21.15.123:0/2846851451 >> 172.21.15.123:0/2846851451 conn(0x557f2eb94790 msgr2=0x557f2eba1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.424+0000 7f0c72685740 1 -- 172.21.15.123:0/2846851451 shutdown_connections 2024-08-18T22:12:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.424+0000 7f0c72685740 1 -- 172.21.15.123:0/2846851451 wait complete. 2024-08-18T22:12:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.424+0000 7f0c72685740 1 -- start start 2024-08-18T22:12:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.424+0000 7f0c72685740 1 Processor -- start 2024-08-18T22:12:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c72685740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eb98200 0x557f2ebab380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c72685740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98b20 0x557f2ebab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c72685740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eba33e0 0x557f2eba6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c72685740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0c681ad030 con 0x557f2eba33e0 2024-08-18T22:12:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c72685740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0c681ae4a0 con 0x557f2eb98b20 2024-08-18T22:12:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c72685740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0c681ad700 con 0x557f2eb98200 2024-08-18T22:12:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c72685740 10 client.0 _ll_register_callbacks cb 0x7f0c5c00c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c6e824640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eba33e0 0x557f2eba6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c6e824640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eba33e0 0x557f2eba6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55204/0 (socket says 172.21.15.123:55204) 2024-08-18T22:12:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c6e824640 1 -- 172.21.15.123:0/1208162073 learned_addr learned my addr 172.21.15.123:0/1208162073 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c6d822640 1 --2- 172.21.15.123:0/1208162073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98b20 0x557f2ebab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c6e023640 1 --2- 172.21.15.123:0/1208162073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eb98200 0x557f2ebab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c6e824640 1 -- 172.21.15.123:0/1208162073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eb98200 msgr2=0x557f2ebab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c6e824640 1 --2- 172.21.15.123:0/1208162073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eb98200 0x557f2ebab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c6e824640 1 -- 172.21.15.123:0/1208162073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98b20 msgr2=0x557f2ebab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c6e824640 1 --2- 172.21.15.123:0/1208162073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98b20 0x557f2ebab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c6e824640 1 -- 172.21.15.123:0/1208162073 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f2eba6f70 con 0x557f2eba33e0 2024-08-18T22:12:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c6d822640 1 --2- 172.21.15.123:0/1208162073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98b20 0x557f2ebab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c6e824640 1 --2- 172.21.15.123:0/1208162073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eba33e0 0x557f2eba6740 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0c60030b20 tx=0x7f0c60031820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706f8483910d5416 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c51ffb640 1 -- 172.21.15.123:0/1208162073 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60030e90 con 0x557f2eba33e0 2024-08-18T22:12:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c51ffb640 1 -- 172.21.15.123:0/1208162073 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0c60003970 con 0x557f2eba33e0 2024-08-18T22:12:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.425+0000 7f0c72685740 1 -- 172.21.15.123:0/1208162073 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c60036040 con 0x557f2eba33e0 2024-08-18T22:12:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.426+0000 7f0c51ffb640 1 -- 172.21.15.123:0/1208162073 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0c60063050 con 0x557f2eba33e0 2024-08-18T22:12:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.426+0000 7f0c72685740 10 client.16326 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.426+0000 7f0c72685740 1 -- 172.21.15.123:0/1208162073 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557f2ec1d860 con 0x557f2eba33e0 2024-08-18T22:12:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.426+0000 7f0c51ffb640 1 -- 172.21.15.123:0/1208162073 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c60036040 con 0x557f2eba33e0 2024-08-18T22:12:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.426+0000 7f0c51ffb640 1 -- 172.21.15.123:0/1208162073 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0c60030070 con 0x557f2eba33e0 2024-08-18T22:12:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.426+0000 7f0c72685740 10 client.16326 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.426+0000 7f0c72685740 10 client.16326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:32.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.426+0000 7f0c72685740 20 client.16326 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.426+0000 7f0c72685740 1 --2- 172.21.15.123:0/1208162073 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557f2ec1df80 0x557f2ec203a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.426+0000 7f0c72685740 4 client.16326 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-18T22:12:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.426+0000 7f0c72685740 1 -- 172.21.15.123:0/1208162073 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557f2ea82110 con 0x557f2ec1df80 2024-08-18T22:12:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.426+0000 7f0c6e023640 1 --2- 172.21.15.123:0/1208162073 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557f2ec1df80 0x557f2ec203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.427+0000 7f0c51ffb640 10 client.16326 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.427+0000 7f0c6e023640 1 --2- 172.21.15.123:0/1208162073 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557f2ec1df80 0x557f2ec203a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2360d78448477fbe server_cookie=c9fdc0f5bd1ac725 in_seq=0 out_seq=0 2024-08-18T22:12:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.428+0000 7f0c51ffb640 1 -- 172.21.15.123:0/1208162073 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557f2ea82110 con 0x557f2ec1df80 2024-08-18T22:12:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.428+0000 7f0c51ffb640 10 client.16326 handle_command_reply: tid=0 2024-08-18T22:12:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.428+0000 7f0c72685740 1 client.16326 shutdown 2024-08-18T22:12:32.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.428+0000 7f0c72685740 1 -- 172.21.15.123:0/1208162073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eba33e0 msgr2=0x557f2eba6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:32.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.428+0000 7f0c72685740 1 --2- 172.21.15.123:0/1208162073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eba33e0 0x557f2eba6740 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0c60030b20 tx=0x7f0c60031820 comp rx=0 tx=0).stop 2024-08-18T22:12:32.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.428+0000 7f0c72685740 1 -- 172.21.15.123:0/1208162073 shutdown_connections 2024-08-18T22:12:32.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.428+0000 7f0c72685740 1 --2- 172.21.15.123:0/1208162073 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557f2ec1df80 0x557f2ec203a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.428+0000 7f0c72685740 1 --2- 172.21.15.123:0/1208162073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557f2eba33e0 0x557f2eba6740 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.428+0000 7f0c72685740 1 --2- 172.21.15.123:0/1208162073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f2eb98b20 0x557f2ebab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.428+0000 7f0c72685740 1 --2- 172.21.15.123:0/1208162073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f2eb98200 0x557f2ebab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.428+0000 7f0c72685740 1 -- 172.21.15.123:0/1208162073 >> 172.21.15.123:0/1208162073 conn(0x557f2eb94790 msgr2=0x557f2eb938f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:32.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.428+0000 7f0c51ffb640 0 client.16326 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:32.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.428+0000 7f0c72685740 1 -- 172.21.15.123:0/1208162073 shutdown_connections 2024-08-18T22:12:32.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.428+0000 7f0c72685740 1 -- 172.21.15.123:0/1208162073 wait complete. 2024-08-18T22:12:32.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.428+0000 7f0c72685740 20 client.16326 trim_cache size 0 max 16384 2024-08-18T22:12:32.434 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:12:32.434 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-08-18T22:12:32.434 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "48cba080-cb02-4ba4-8404-0493ac8699d5", 2024-08-18T22:12:32.434 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-08-18T22:12:32.435 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:12:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.429+0000 7f0c70287640 1 -- 172.21.15.123:0/180795018 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0c540a2b80 msgr2=0x7f0c540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.429+0000 7f0c70287640 1 --2- 172.21.15.123:0/180795018 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0c540a2b80 0x7f0c540a5040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009430 tx=0x7f0c6003e040 comp rx=0 tx=0).stop 2024-08-18T22:12:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.429+0000 7f0c70287640 1 -- 172.21.15.123:0/180795018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c681007b0 msgr2=0x7f0c681980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.429+0000 7f0c70287640 1 --2- 172.21.15.123:0/180795018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c681007b0 0x7f0c681980d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400d770 tx=0x7f0c6400dc30 comp rx=0 tx=0).stop 2024-08-18T22:12:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.429+0000 7f0c70287640 1 -- 172.21.15.123:0/180795018 shutdown_connections 2024-08-18T22:12:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.429+0000 7f0c70287640 1 --2- 172.21.15.123:0/180795018 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f0c540a2b80 0x7f0c540a5040 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.429+0000 7f0c70287640 1 --2- 172.21.15.123:0/180795018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c681067b0 0x7f0c6819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.429+0000 7f0c70287640 1 --2- 172.21.15.123:0/180795018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c68101150 0x7f0c68198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.429+0000 7f0c70287640 1 --2- 172.21.15.123:0/180795018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c681007b0 0x7f0c681980d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:32.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.429+0000 7f0c70287640 1 -- 172.21.15.123:0/180795018 >> 172.21.15.123:0/180795018 conn(0x7f0c680fc4d0 msgr2=0x7f0c680fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:32.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.429+0000 7f0c70287640 1 -- 172.21.15.123:0/180795018 shutdown_connections 2024-08-18T22:12:32.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:32.429+0000 7f0c70287640 1 -- 172.21.15.123:0/180795018 wait complete. 2024-08-18T22:12:33.232 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-18T22:12:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:12:33.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:33 smithi183 ceph-mon[22097]: pgmap v483: 129 pgs: 129 active+clean; 2.1 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 1.1 MiB/s wr, 1.02k op/s 2024-08-18T22:12:33.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:33 smithi183 ceph-mon[22097]: scrub queued for path: / 2024-08-18T22:12:33.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:33 smithi183 ceph-mon[22097]: scrub summary: idle+waiting paths [/] 2024-08-18T22:12:33.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:33 smithi183 ceph-mon[22097]: scrub summary: active paths [/] 2024-08-18T22:12:33.661 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:33 smithi123 ceph-mon[18462]: pgmap v483: 129 pgs: 129 active+clean; 2.1 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 1.1 MiB/s wr, 1.02k op/s 2024-08-18T22:12:33.661 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:33 smithi123 ceph-mon[18462]: scrub queued for path: / 2024-08-18T22:12:33.661 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:33 smithi123 ceph-mon[18462]: scrub summary: idle+waiting paths [/] 2024-08-18T22:12:33.662 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:33 smithi123 ceph-mon[18462]: scrub summary: active paths [/] 2024-08-18T22:12:33.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:33 smithi130 ceph-mon[21698]: pgmap v483: 129 pgs: 129 active+clean; 2.1 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 1.1 MiB/s wr, 1.02k op/s 2024-08-18T22:12:33.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:33 smithi130 ceph-mon[21698]: scrub queued for path: / 2024-08-18T22:12:33.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:33 smithi130 ceph-mon[21698]: scrub summary: idle+waiting paths [/] 2024-08-18T22:12:33.765 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:33 smithi130 ceph-mon[21698]: scrub summary: active paths [/] 2024-08-18T22:12:34.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.087+0000 7f6f9f441640 1 -- 172.21.15.123:0/1455643926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f98100860 msgr2=0x7f6f98100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:34.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.087+0000 7f6f9f441640 1 --2- 172.21.15.123:0/1455643926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f98100860 0x7f6f98100c40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009ca0 tx=0x7f6f9402a940 comp rx=0 tx=0).stop 2024-08-18T22:12:34.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.087+0000 7f6f9f441640 1 -- 172.21.15.123:0/1455643926 shutdown_connections 2024-08-18T22:12:34.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.087+0000 7f6f9f441640 1 --2- 172.21.15.123:0/1455643926 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f98105c70 0x7f6f98106100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.087+0000 7f6f9f441640 1 --2- 172.21.15.123:0/1455643926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f98101180 0x7f6f98105650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.087+0000 7f6f9f441640 1 --2- 172.21.15.123:0/1455643926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f98100860 0x7f6f98100c40 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.087+0000 7f6f9f441640 1 -- 172.21.15.123:0/1455643926 >> 172.21.15.123:0/1455643926 conn(0x7f6f980fc4d0 msgr2=0x7f6f980fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:34.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.087+0000 7f6f9f441640 1 -- 172.21.15.123:0/1455643926 shutdown_connections 2024-08-18T22:12:34.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.087+0000 7f6f9f441640 1 -- 172.21.15.123:0/1455643926 wait complete. 2024-08-18T22:12:34.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.087+0000 7f6f9f441640 1 Processor -- start 2024-08-18T22:12:34.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.087+0000 7f6f9f441640 1 -- start start 2024-08-18T22:12:34.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9f441640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f98100860 0x7f6f981a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9f441640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f98101180 0x7f6f981a4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9f441640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f98105c70 0x7f6f9819e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9f441640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6f98118300 con 0x7f6f98105c70 2024-08-18T22:12:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9f441640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6f98118180 con 0x7f6f98100860 2024-08-18T22:12:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9f441640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6f98118480 con 0x7f6f98101180 2024-08-18T22:12:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9d9de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f98105c70 0x7f6f9819e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9d1dd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f98100860 0x7f6f981a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9d9de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f98105c70 0x7f6f9819e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59368/0 (socket says 172.21.15.123:59368) 2024-08-18T22:12:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9d9de640 1 -- 172.21.15.123:0/419322949 learned_addr learned my addr 172.21.15.123:0/419322949 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/419322949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f98101180 0x7f6f981a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9d9de640 1 -- 172.21.15.123:0/419322949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f98101180 msgr2=0x7f6f981a4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9d9de640 1 --2- 172.21.15.123:0/419322949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f98101180 0x7f6f981a4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9d9de640 1 -- 172.21.15.123:0/419322949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f98100860 msgr2=0x7f6f981a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9d9de640 1 --2- 172.21.15.123:0/419322949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f98100860 0x7f6f981a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9d9de640 1 -- 172.21.15.123:0/419322949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9819ed20 con 0x7f6f98105c70 2024-08-18T22:12:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9d9de640 1 --2- 172.21.15.123:0/419322949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f98105c70 0x7f6f9819e5f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009fd0 tx=0x7f6f9000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f8e7fc640 1 -- 172.21.15.123:0/419322949 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90011830 con 0x7f6f98105c70 2024-08-18T22:12:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f8e7fc640 1 -- 172.21.15.123:0/419322949 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f90016070 con 0x7f6f98105c70 2024-08-18T22:12:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9f441640 1 -- 172.21.15.123:0/419322949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9819f010 con 0x7f6f98105c70 2024-08-18T22:12:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f8e7fc640 1 -- 172.21.15.123:0/419322949 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9000f2e0 con 0x7f6f98105c70 2024-08-18T22:12:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.088+0000 7f6f9f441640 1 -- 172.21.15.123:0/419322949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f981ab300 con 0x7f6f98105c70 2024-08-18T22:12:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.090+0000 7f6f8e7fc640 1 -- 172.21.15.123:0/419322949 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f6f900119d0 con 0x7f6f98105c70 2024-08-18T22:12:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.091+0000 7f6fa183f740 1 Processor -- start 2024-08-18T22:12:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.091+0000 7f6fa183f740 1 -- start start 2024-08-18T22:12:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.091+0000 7f6fa183f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4210 0x561984dd45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.091+0000 7f6fa183f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4b30 0x561984ddeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.091+0000 7f6fa183f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984de17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.091+0000 7f6fa183f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x561984d39980 con 0x561984ddf3f0 2024-08-18T22:12:34.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.091+0000 7f6fa183f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561984cd1a70 con 0x561984dd4210 2024-08-18T22:12:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.091+0000 7f6fa183f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x561984d35940 con 0x561984dd4b30 2024-08-18T22:12:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.091+0000 7f6f8e7fc640 1 --2- 172.21.15.123:0/419322949 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6f840a2c00 0x7f6f840a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.091+0000 7f6f9c9dc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984de17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.091+0000 7f6f9c9dc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984de17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59380/0 (socket says 172.21.15.123:59380) 2024-08-18T22:12:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.091+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/2499387713 learned_addr learned my addr 172.21.15.123:0/2499387713 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.091+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/2499387713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4210 0x561984dd45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.091+0000 7f6f9d1dd640 1 --2- 172.21.15.123:0/2499387713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4b30 0x561984ddeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.092+0000 7f6f9d9de640 1 --2- 172.21.15.123:0/419322949 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6f840a2c00 0x7f6f840a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.092+0000 7f6f8e7fc640 1 -- 172.21.15.123:0/419322949 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f6f900ce990 con 0x7f6f98105c70 2024-08-18T22:12:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.092+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/2499387713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4b30 msgr2=0x561984ddeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.092+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/2499387713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4b30 0x561984ddeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.092+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/2499387713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4210 msgr2=0x561984dd45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:34.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.092+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/2499387713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4210 0x561984dd45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.092+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/2499387713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561984d346e0 con 0x561984ddf3f0 2024-08-18T22:12:34.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.092+0000 7f6f9d1dd640 1 --2- 172.21.15.123:0/2499387713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4b30 0x561984ddeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:12:34.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.092+0000 7f6f9d9de640 1 --2- 172.21.15.123:0/419322949 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6f840a2c00 0x7f6f840a50c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6f9009ab60 tx=0x7f6f9006df20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:34.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.092+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/2499387713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984de17e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6f88004630 tx=0x7f6f8800c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f622a182e10b86 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:34.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.092+0000 7f6f837fe640 1 -- 172.21.15.123:0/2499387713 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f880142d0 con 0x561984ddf3f0 2024-08-18T22:12:34.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.092+0000 7f6f837fe640 1 -- 172.21.15.123:0/2499387713 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f8800fc40 con 0x561984ddf3f0 2024-08-18T22:12:34.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.092+0000 7f6f837fe640 1 -- 172.21.15.123:0/2499387713 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88012ab0 con 0x561984ddf3f0 2024-08-18T22:12:34.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.093+0000 7f6fa183f740 1 -- 172.21.15.123:0/2499387713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 msgr2=0x561984de17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:34.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.093+0000 7f6fa183f740 1 --2- 172.21.15.123:0/2499387713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984de17e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6f88004630 tx=0x7f6f8800c4f0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.093+0000 7f6fa183f740 1 -- 172.21.15.123:0/2499387713 shutdown_connections 2024-08-18T22:12:34.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.093+0000 7f6fa183f740 1 --2- 172.21.15.123:0/2499387713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984de17e0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.093+0000 7f6fa183f740 1 --2- 172.21.15.123:0/2499387713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4b30 0x561984ddeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.093+0000 7f6fa183f740 1 --2- 172.21.15.123:0/2499387713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4210 0x561984dd45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.093+0000 7f6fa183f740 1 -- 172.21.15.123:0/2499387713 >> 172.21.15.123:0/2499387713 conn(0x561984dd07a0 msgr2=0x561984dd0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:34.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.093+0000 7f6fa183f740 1 -- 172.21.15.123:0/2499387713 shutdown_connections 2024-08-18T22:12:34.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.093+0000 7f6fa183f740 1 -- 172.21.15.123:0/2499387713 wait complete. 2024-08-18T22:12:34.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.093+0000 7f6fa183f740 1 -- start start 2024-08-18T22:12:34.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.093+0000 7f6fa183f740 1 Processor -- start 2024-08-18T22:12:34.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6fa183f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4210 0x561984ddc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6fa183f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 0x561984ddc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6fa183f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984ddcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6fa183f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x561984de1fc0 con 0x561984ddf3f0 2024-08-18T22:12:34.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6fa183f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561984cf4aa0 con 0x561984dd4b30 2024-08-18T22:12:34.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6fa183f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x561984de2140 con 0x561984dd4210 2024-08-18T22:12:34.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6fa183f740 10 client.0 _ll_register_callbacks cb 0x561984ce3e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:34.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6f9c9dc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984ddcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6f9c9dc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984ddcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59388/0 (socket says 172.21.15.123:59388) 2024-08-18T22:12:34.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/1846865345 learned_addr learned my addr 172.21.15.123:0/1846865345 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:34.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/1846865345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4210 0x561984ddc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6f9d1dd640 1 --2- 172.21.15.123:0/1846865345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 0x561984ddc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/1846865345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4210 msgr2=0x561984ddc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:34.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/1846865345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4210 0x561984ddc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/1846865345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 msgr2=0x561984ddc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:34.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/1846865345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 0x561984ddc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/1846865345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561984cd8650 con 0x561984ddf3f0 2024-08-18T22:12:34.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/1846865345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984ddcde0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6f88001eb0 tx=0x7f6f88012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2296bdbba2aa717a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:34.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6f80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:34.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6f80ff9640 1 -- 172.21.15.123:0/1846865345 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88012a30 con 0x561984ddf3f0 2024-08-18T22:12:34.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6fa183f740 1 -- 172.21.15.123:0/1846865345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f8800fc40 con 0x561984ddf3f0 2024-08-18T22:12:34.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.094+0000 7f6f80ff9640 1 -- 172.21.15.123:0/1846865345 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f6f8800f760 con 0x561984ddf3f0 2024-08-18T22:12:34.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.095+0000 7f6f80ff9640 1 -- 172.21.15.123:0/1846865345 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6f88031050 con 0x561984ddf3f0 2024-08-18T22:12:34.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.095+0000 7f6fa183f740 10 client.16338 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:34.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.095+0000 7f6fa183f740 1 -- 172.21.15.123:0/1846865345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561984aab3c0 con 0x561984ddf3f0 2024-08-18T22:12:34.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.095+0000 7f6f80ff9640 1 -- 172.21.15.123:0/1846865345 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f8800fc40 con 0x561984ddf3f0 2024-08-18T22:12:34.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.095+0000 7f6f80ff9640 1 -- 172.21.15.123:0/1846865345 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6f880046c0 con 0x561984ddf3f0 2024-08-18T22:12:34.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.095+0000 7f6fa183f740 10 client.16338 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:34.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.095+0000 7f6fa183f740 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:34.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.095+0000 7f6fa183f740 20 client.16338 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:34.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.095+0000 7f6fa183f740 1 --2- 172.21.15.123:0/1846865345 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561984deedd0 0x561984df11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.095+0000 7f6fa183f740 4 client.16338 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:12:34.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.095+0000 7f6fa183f740 1 -- 172.21.15.123:0/1846865345 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561984d46ef0 con 0x561984deedd0 2024-08-18T22:12:34.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.095+0000 7f6f9d1dd640 1 --2- 172.21.15.123:0/1846865345 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561984deedd0 0x561984df11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.096+0000 7f6f80ff9640 10 client.16338 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.096+0000 7f6f9d1dd640 1 --2- 172.21.15.123:0/1846865345 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561984deedd0 0x561984df11c0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1b7386060d31500 server_cookie=5d5ed3f203df8053 in_seq=0 out_seq=0 2024-08-18T22:12:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.096+0000 7f6f80ff9640 1 -- 172.21.15.123:0/1846865345 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561984d46ef0 con 0x561984deedd0 2024-08-18T22:12:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.096+0000 7f6f80ff9640 10 client.16338 handle_command_reply: tid=0 2024-08-18T22:12:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.096+0000 7f6fa183f740 1 client.16338 shutdown 2024-08-18T22:12:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.096+0000 7f6fa183f740 1 -- 172.21.15.123:0/1846865345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 msgr2=0x561984ddcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.096+0000 7f6fa183f740 1 --2- 172.21.15.123:0/1846865345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984ddcde0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6f88001eb0 tx=0x7f6f88012690 comp rx=0 tx=0).stop 2024-08-18T22:12:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.096+0000 7f6fa183f740 1 -- 172.21.15.123:0/1846865345 shutdown_connections 2024-08-18T22:12:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.096+0000 7f6fa183f740 1 --2- 172.21.15.123:0/1846865345 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561984deedd0 0x561984df11c0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.096+0000 7f6fa183f740 1 --2- 172.21.15.123:0/1846865345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984ddcde0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.097+0000 7f6fa183f740 1 --2- 172.21.15.123:0/1846865345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 0x561984ddc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.097+0000 7f6fa183f740 1 --2- 172.21.15.123:0/1846865345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4210 0x561984ddc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.097+0000 7f6fa183f740 1 -- 172.21.15.123:0/1846865345 >> 172.21.15.123:0/1846865345 conn(0x561984dd07a0 msgr2=0x561984dd6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:34.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.097+0000 7f6f80ff9640 0 client.16338 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:34.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.097+0000 7f6fa183f740 1 -- 172.21.15.123:0/1846865345 shutdown_connections 2024-08-18T22:12:34.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.097+0000 7f6fa183f740 1 -- 172.21.15.123:0/1846865345 wait complete. 2024-08-18T22:12:34.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.097+0000 7f6fa183f740 20 client.16338 trim_cache size 0 max 16384 2024-08-18T22:12:34.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6fa183f740 1 Processor -- start 2024-08-18T22:12:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6fa183f740 1 -- start start 2024-08-18T22:12:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6fa183f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4210 0x561984dde1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6fa183f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 0x561984df6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6fa183f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984df6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6fa183f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6f981b79e0 con 0x561984ddf3f0 2024-08-18T22:12:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6fa183f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6f981b52b0 con 0x561984dd4b30 2024-08-18T22:12:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6fa183f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6f981b3100 con 0x561984dd4210 2024-08-18T22:12:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6f9c9dc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984df6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6f9c9dc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984df6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59396/0 (socket says 172.21.15.123:59396) 2024-08-18T22:12:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/1177584592 learned_addr learned my addr 172.21.15.123:0/1177584592 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/1177584592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4210 0x561984dde1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6f9d1dd640 1 --2- 172.21.15.123:0/1177584592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 0x561984df6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/1177584592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4210 msgr2=0x561984dde1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/1177584592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4210 0x561984dde1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/1177584592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 msgr2=0x561984df6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/1177584592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 0x561984df6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/1177584592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561984deb220 con 0x561984ddf3f0 2024-08-18T22:12:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.114+0000 7f6f9d1dd640 1 --2- 172.21.15.123:0/1177584592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 0x561984df6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:12:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.115+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/1177584592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984df6e70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800ca00 tx=0x7f6f88005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb5c24022f1ebc5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.115+0000 7f6f82ffd640 1 -- 172.21.15.123:0/1177584592 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88012450 con 0x561984ddf3f0 2024-08-18T22:12:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.115+0000 7f6f82ffd640 1 -- 172.21.15.123:0/1177584592 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f88004680 con 0x561984ddf3f0 2024-08-18T22:12:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.115+0000 7f6f82ffd640 1 -- 172.21.15.123:0/1177584592 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800fbc0 con 0x561984ddf3f0 2024-08-18T22:12:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.115+0000 7f6fa183f740 1 -- 172.21.15.123:0/1177584592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 msgr2=0x561984df6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.115+0000 7f6fa183f740 1 --2- 172.21.15.123:0/1177584592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984df6e70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800ca00 tx=0x7f6f88005b90 comp rx=0 tx=0).stop 2024-08-18T22:12:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.115+0000 7f6fa183f740 1 -- 172.21.15.123:0/1177584592 shutdown_connections 2024-08-18T22:12:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.115+0000 7f6fa183f740 1 --2- 172.21.15.123:0/1177584592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984ddf3f0 0x561984df6e70 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.115+0000 7f6fa183f740 1 --2- 172.21.15.123:0/1177584592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 0x561984df6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.115+0000 7f6fa183f740 1 --2- 172.21.15.123:0/1177584592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984dd4210 0x561984dde1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.115+0000 7f6fa183f740 1 -- 172.21.15.123:0/1177584592 >> 172.21.15.123:0/1177584592 conn(0x561984dd07a0 msgr2=0x561984dddab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.116+0000 7f6fa183f740 1 -- 172.21.15.123:0/1177584592 shutdown_connections 2024-08-18T22:12:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.116+0000 7f6fa183f740 1 -- 172.21.15.123:0/1177584592 wait complete. 2024-08-18T22:12:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.116+0000 7f6fa183f740 1 -- start start 2024-08-18T22:12:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.116+0000 7f6fa183f740 1 Processor -- start 2024-08-18T22:12:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.116+0000 7f6fa183f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984dd4210 0x561984de2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.116+0000 7f6fa183f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 0x561984de2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.116+0000 7f6fa183f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984ddf3f0 0x561984de2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.116+0000 7f6fa183f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6f981b3770 con 0x561984dd4210 2024-08-18T22:12:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.116+0000 7f6fa183f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6f981b4be0 con 0x561984dd4b30 2024-08-18T22:12:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.116+0000 7f6fa183f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6f981b3e40 con 0x561984ddf3f0 2024-08-18T22:12:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.116+0000 7f6fa183f740 10 client.0 _ll_register_callbacks cb 0x7f6f8800ce80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6f9c9dc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984dd4210 0x561984de2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6f9c9dc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984dd4210 0x561984de2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59412/0 (socket says 172.21.15.123:59412) 2024-08-18T22:12:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/3781352546 learned_addr learned my addr 172.21.15.123:0/3781352546 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6f9d1dd640 1 --2- 172.21.15.123:0/3781352546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 0x561984de2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/3781352546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984ddf3f0 msgr2=0x561984de2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/3781352546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984ddf3f0 0x561984de2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/3781352546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 msgr2=0x561984de2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/3781352546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 0x561984de2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6f9c9dc640 1 -- 172.21.15.123:0/3781352546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561984e57a50 con 0x561984dd4210 2024-08-18T22:12:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6f9c9dc640 1 --2- 172.21.15.123:0/3781352546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984dd4210 0x561984de2350 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6f88005c20 tx=0x7f6f88014050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c54df117eafc474 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6f80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6f80ff9640 1 -- 172.21.15.123:0/3781352546 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800cce0 con 0x561984dd4210 2024-08-18T22:12:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6fa183f740 1 -- 172.21.15.123:0/3781352546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f88004680 con 0x561984dd4210 2024-08-18T22:12:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6f80ff9640 1 -- 172.21.15.123:0/3781352546 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f6f88012990 con 0x561984dd4210 2024-08-18T22:12:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6f80ff9640 1 -- 172.21.15.123:0/3781352546 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6f88047050 con 0x561984dd4210 2024-08-18T22:12:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6fa183f740 10 client.16344 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.117+0000 7f6fa183f740 1 -- 172.21.15.123:0/3781352546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561984e58cb0 con 0x561984dd4210 2024-08-18T22:12:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.118+0000 7f6f80ff9640 1 -- 172.21.15.123:0/3781352546 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f88004680 con 0x561984dd4210 2024-08-18T22:12:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.118+0000 7f6f80ff9640 1 -- 172.21.15.123:0/3781352546 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6f8803f020 con 0x561984dd4210 2024-08-18T22:12:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.118+0000 7f6fa183f740 10 client.16344 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:34.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.118+0000 7f6fa183f740 10 client.16344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:34.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.118+0000 7f6fa183f740 20 client.16344 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:34.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.118+0000 7f6fa183f740 1 --2- 172.21.15.123:0/3781352546 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561984e59260 0x561984e5b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:34.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.118+0000 7f6fa183f740 4 client.16344 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:12:34.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.118+0000 7f6fa183f740 1 -- 172.21.15.123:0/3781352546 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561984d41400 con 0x561984e59260 2024-08-18T22:12:34.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.118+0000 7f6f9d1dd640 1 --2- 172.21.15.123:0/3781352546 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561984e59260 0x561984e5b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:34.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6f80ff9640 10 client.16344 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:34.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6f9d1dd640 1 --2- 172.21.15.123:0/3781352546 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561984e59260 0x561984e5b680 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f776cda55396f250 server_cookie=a5c2b46f0c9fac4e in_seq=0 out_seq=0 2024-08-18T22:12:34.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6f80ff9640 1 -- 172.21.15.123:0/3781352546 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x561984d41400 con 0x561984e59260 2024-08-18T22:12:34.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6f80ff9640 10 client.16344 handle_command_reply: tid=0 2024-08-18T22:12:34.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6fa183f740 1 client.16344 shutdown 2024-08-18T22:12:34.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6fa183f740 1 -- 172.21.15.123:0/3781352546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984dd4210 msgr2=0x561984de2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:34.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6fa183f740 1 --2- 172.21.15.123:0/3781352546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984dd4210 0x561984de2350 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6f88005c20 tx=0x7f6f88014050 comp rx=0 tx=0).stop 2024-08-18T22:12:34.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6fa183f740 1 -- 172.21.15.123:0/3781352546 shutdown_connections 2024-08-18T22:12:34.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6fa183f740 1 --2- 172.21.15.123:0/3781352546 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x561984e59260 0x561984e5b680 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6fa183f740 1 --2- 172.21.15.123:0/3781352546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561984ddf3f0 0x561984de2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6fa183f740 1 --2- 172.21.15.123:0/3781352546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561984dd4b30 0x561984de2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6fa183f740 1 --2- 172.21.15.123:0/3781352546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561984dd4210 0x561984de2350 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6fa183f740 1 -- 172.21.15.123:0/3781352546 >> 172.21.15.123:0/3781352546 conn(0x561984dd07a0 msgr2=0x561984deaa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:34.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6f80ff9640 0 client.16344 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:34.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6fa183f740 1 -- 172.21.15.123:0/3781352546 shutdown_connections 2024-08-18T22:12:34.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6fa183f740 1 -- 172.21.15.123:0/3781352546 wait complete. 2024-08-18T22:12:34.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.119+0000 7f6fa183f740 20 client.16344 trim_cache size 0 max 16384 2024-08-18T22:12:34.127 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:12:34.128 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-18T22:12:34.128 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": { 2024-08-18T22:12:34.128 INFO:teuthology.orchestra.run.smithi123.stdout: "48cba080-cb02-4ba4-8404-0493ac8699d5": { 2024-08-18T22:12:34.128 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/", 2024-08-18T22:12:34.128 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "48cba080-cb02-4ba4-8404-0493ac8699d5", 2024-08-18T22:12:34.128 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "recursive,force" 2024-08-18T22:12:34.128 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:34.128 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:34.128 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:12:34.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.120+0000 7f6f9f441640 1 -- 172.21.15.123:0/419322949 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6f840a2c00 msgr2=0x7f6f840a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:34.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.120+0000 7f6f9f441640 1 --2- 172.21.15.123:0/419322949 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6f840a2c00 0x7f6f840a50c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6f9009ab60 tx=0x7f6f9006df20 comp rx=0 tx=0).stop 2024-08-18T22:12:34.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.120+0000 7f6f9f441640 1 -- 172.21.15.123:0/419322949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f98105c70 msgr2=0x7f6f9819e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:34.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.120+0000 7f6f9f441640 1 --2- 172.21.15.123:0/419322949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f98105c70 0x7f6f9819e5f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009fd0 tx=0x7f6f9000b8e0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.120+0000 7f6f9f441640 1 -- 172.21.15.123:0/419322949 shutdown_connections 2024-08-18T22:12:34.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.120+0000 7f6f9f441640 1 --2- 172.21.15.123:0/419322949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f98105c70 0x7f6f9819e5f0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.120+0000 7f6f9f441640 1 --2- 172.21.15.123:0/419322949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f98101180 0x7f6f981a4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.120+0000 7f6f9f441640 1 --2- 172.21.15.123:0/419322949 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6f840a2c00 0x7f6f840a50c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.120+0000 7f6f9f441640 1 --2- 172.21.15.123:0/419322949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f98100860 0x7f6f981a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:34.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.120+0000 7f6f9f441640 1 -- 172.21.15.123:0/419322949 >> 172.21.15.123:0/419322949 conn(0x7f6f980fc4d0 msgr2=0x7f6f9810f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:34.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.120+0000 7f6f9f441640 1 -- 172.21.15.123:0/419322949 shutdown_connections 2024-08-18T22:12:34.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:34.120+0000 7f6f9f441640 1 -- 172.21.15.123:0/419322949 wait complete. 2024-08-18T22:12:34.965 INFO:tasks.cephfs.filesystem:scrub status for tag:48cba080-cb02-4ba4-8404-0493ac8699d5 - {'path': '/', 'tag': '48cba080-cb02-4ba4-8404-0493ac8699d5', 'options': 'recursive,force'} 2024-08-18T22:12:35.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:35 smithi183 ceph-mon[22097]: scrub summary: idle+waiting paths [/] 2024-08-18T22:12:35.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:35 smithi183 ceph-mon[22097]: pgmap v484: 129 pgs: 129 active+clean; 2.1 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 912 KiB/s wr, 1.40k op/s 2024-08-18T22:12:35.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:35 smithi123 ceph-mon[18462]: scrub summary: idle+waiting paths [/] 2024-08-18T22:12:35.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:35 smithi123 ceph-mon[18462]: pgmap v484: 129 pgs: 129 active+clean; 2.1 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 912 KiB/s wr, 1.40k op/s 2024-08-18T22:12:35.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:35 smithi130 ceph-mon[21698]: scrub summary: idle+waiting paths [/] 2024-08-18T22:12:35.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:35 smithi130 ceph-mon[21698]: pgmap v484: 129 pgs: 129 active+clean; 2.1 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 912 KiB/s wr, 1.40k op/s 2024-08-18T22:12:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.626+0000 7ff6df11a640 1 -- 172.21.15.123:0/1241196401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6d8100780 msgr2=0x7ff6d8100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.626+0000 7ff6df11a640 1 --2- 172.21.15.123:0/1241196401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6d8100780 0x7ff6d8100b80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009900 tx=0x7ff6cc02a410 comp rx=0 tx=0).stop 2024-08-18T22:12:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.626+0000 7ff6df11a640 1 -- 172.21.15.123:0/1241196401 shutdown_connections 2024-08-18T22:12:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.626+0000 7ff6df11a640 1 --2- 172.21.15.123:0/1241196401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6d8102330 0x7ff6d8108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.626+0000 7ff6df11a640 1 --2- 172.21.15.123:0/1241196401 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6d8101970 0x7ff6d8101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.626+0000 7ff6df11a640 1 --2- 172.21.15.123:0/1241196401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6d8100780 0x7ff6d8100b80 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.626+0000 7ff6df11a640 1 -- 172.21.15.123:0/1241196401 >> 172.21.15.123:0/1241196401 conn(0x7ff6d80fbee0 msgr2=0x7ff6d80fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:36.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.626+0000 7ff6df11a640 1 -- 172.21.15.123:0/1241196401 shutdown_connections 2024-08-18T22:12:36.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.626+0000 7ff6df11a640 1 -- 172.21.15.123:0/1241196401 wait complete. 2024-08-18T22:12:36.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.626+0000 7ff6df11a640 1 Processor -- start 2024-08-18T22:12:36.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.626+0000 7ff6df11a640 1 -- start start 2024-08-18T22:12:36.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6df11a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6d8100780 0x7ff6d806ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6df11a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6d8101970 0x7ff6d819c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6df11a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6d8102330 0x7ff6d819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6df11a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d810c400 con 0x7ff6d8101970 2024-08-18T22:12:36.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6df11a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d810c280 con 0x7ff6d8100780 2024-08-18T22:12:36.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6df11a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d810c580 con 0x7ff6d8102330 2024-08-18T22:12:36.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6d7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6d8101970 0x7ff6d819c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6d7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6d8101970 0x7ff6d819c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59436/0 (socket says 172.21.15.123:59436) 2024-08-18T22:12:36.630 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6d7fff640 1 -- 172.21.15.123:0/3569228375 learned_addr learned my addr 172.21.15.123:0/3569228375 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6dceb6640 1 --2- 172.21.15.123:0/3569228375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6d8100780 0x7ff6d806ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6dd6b7640 1 --2- 172.21.15.123:0/3569228375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6d8102330 0x7ff6d819ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6d7fff640 1 -- 172.21.15.123:0/3569228375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6d8102330 msgr2=0x7ff6d819ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6d7fff640 1 --2- 172.21.15.123:0/3569228375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6d8102330 0x7ff6d819ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6d7fff640 1 -- 172.21.15.123:0/3569228375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6d8100780 msgr2=0x7ff6d806ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6d7fff640 1 --2- 172.21.15.123:0/3569228375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6d8100780 0x7ff6d806ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6d7fff640 1 -- 172.21.15.123:0/3569228375 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d819f740 con 0x7ff6d8101970 2024-08-18T22:12:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6dd6b7640 1 --2- 172.21.15.123:0/3569228375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6d8102330 0x7ff6d819ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:12:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6d7fff640 1 --2- 172.21.15.123:0/3569228375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6d8101970 0x7ff6d819c810 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400d770 tx=0x7ff6c400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6d5ffb640 1 -- 172.21.15.123:0/3569228375 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4017070 con 0x7ff6d8101970 2024-08-18T22:12:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6d5ffb640 1 -- 172.21.15.123:0/3569228375 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6c4005500 con 0x7ff6d8101970 2024-08-18T22:12:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6d5ffb640 1 -- 172.21.15.123:0/3569228375 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4004e00 con 0x7ff6d8101970 2024-08-18T22:12:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.627+0000 7ff6df11a640 1 -- 172.21.15.123:0/3569228375 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d819f9d0 con 0x7ff6d8101970 2024-08-18T22:12:36.632 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.628+0000 7ff6df11a640 1 -- 172.21.15.123:0/3569228375 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d819ff20 con 0x7ff6d8101970 2024-08-18T22:12:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.630+0000 7ff6d5ffb640 1 -- 172.21.15.123:0/3569228375 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7ff6c4004fa0 con 0x7ff6d8101970 2024-08-18T22:12:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.630+0000 7ff6e1b22740 1 Processor -- start 2024-08-18T22:12:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.630+0000 7ff6e1b22740 1 -- start start 2024-08-18T22:12:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.630+0000 7ff6d5ffb640 1 --2- 172.21.15.123:0/3569228375 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff6c80a2cb0 0x7ff6c80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.630+0000 7ff6e1b22740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49680 0x557dc5f49a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.630+0000 7ff6e1b22740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f49fc0 0x557dc5f4ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.630+0000 7ff6e1b22740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f4f050 0x557dc5f51510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.630+0000 7ff6e1b22740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557dc5eac9d0 con 0x557dc5f4f050 2024-08-18T22:12:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.630+0000 7ff6e1b22740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557dc5e54820 con 0x557dc5f49fc0 2024-08-18T22:12:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6e1b22740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557dc5ea8990 con 0x557dc5f49680 2024-08-18T22:12:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6dd6b7640 1 --2- 172.21.15.123:0/3569228375 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff6c80a2cb0 0x7ff6c80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6d5ffb640 1 -- 172.21.15.123:0/3569228375 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ff6c40cede0 con 0x7ff6d8101970 2024-08-18T22:12:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6dd6b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f4f050 0x557dc5f51510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6dd6b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f4f050 0x557dc5f51510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59438/0 (socket says 172.21.15.123:59438) 2024-08-18T22:12:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6dd6b7640 1 -- 172.21.15.123:0/3566235886 learned_addr learned my addr 172.21.15.123:0/3566235886 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6dceb6640 1 --2- 172.21.15.123:0/3566235886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49680 0x557dc5f49a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6d7fff640 1 --2- 172.21.15.123:0/3566235886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f49fc0 0x557dc5f4ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6dd6b7640 1 -- 172.21.15.123:0/3566235886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49680 msgr2=0x557dc5f49a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6dd6b7640 1 --2- 172.21.15.123:0/3566235886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49680 0x557dc5f49a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6dd6b7640 1 -- 172.21.15.123:0/3566235886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f49fc0 msgr2=0x557dc5f4ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6dd6b7640 1 --2- 172.21.15.123:0/3566235886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f49fc0 0x557dc5f4ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6dd6b7640 1 -- 172.21.15.123:0/3566235886 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dc5bc0210 con 0x557dc5f4f050 2024-08-18T22:12:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6dceb6640 1 --2- 172.21.15.123:0/3566235886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49680 0x557dc5f49a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:12:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6dd6b7640 1 --2- 172.21.15.123:0/3569228375 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff6c80a2cb0 0x7ff6c80a5170 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000afd0 tx=0x7ff6d000adc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6dd6b7640 1 --2- 172.21.15.123:0/3566235886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f4f050 0x557dc5f51510 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0012fd0 tx=0x7ff6d0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67465084d588c5fa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6c2ffd640 1 -- 172.21.15.123:0/3566235886 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0022070 con 0x557dc5f4f050 2024-08-18T22:12:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6c2ffd640 1 -- 172.21.15.123:0/3566235886 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6d000dde0 con 0x557dc5f4f050 2024-08-18T22:12:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.631+0000 7ff6c2ffd640 1 -- 172.21.15.123:0/3566235886 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0010630 con 0x557dc5f4f050 2024-08-18T22:12:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.632+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3566235886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f4f050 msgr2=0x557dc5f51510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.632+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3566235886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f4f050 0x557dc5f51510 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0012fd0 tx=0x7ff6d0019000 comp rx=0 tx=0).stop 2024-08-18T22:12:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.632+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3566235886 shutdown_connections 2024-08-18T22:12:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.632+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3566235886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f4f050 0x557dc5f51510 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.632+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3566235886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f49fc0 0x557dc5f4ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.632+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3566235886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49680 0x557dc5f49a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.632+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3566235886 >> 172.21.15.123:0/3566235886 conn(0x557dc5f44cf0 msgr2=0x557dc5f450f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.632+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3566235886 shutdown_connections 2024-08-18T22:12:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.632+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3566235886 wait complete. 2024-08-18T22:12:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.632+0000 7ff6e1b22740 1 -- start start 2024-08-18T22:12:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6e1b22740 1 Processor -- start 2024-08-18T22:12:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6e1b22740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49680 0x557dc5f537a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6e1b22740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f49fc0 0x557dc5f53ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6e1b22740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f4f050 0x557dc5f5ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6e1b22740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557dc5f51fc0 con 0x557dc5f4f050 2024-08-18T22:12:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6e1b22740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557dc5e68520 con 0x557dc5f49fc0 2024-08-18T22:12:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6e1b22740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557dc5f52140 con 0x557dc5f49680 2024-08-18T22:12:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6e1b22740 10 client.0 _ll_register_callbacks cb 0x557dc5bbfa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6dd6b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f4f050 0x557dc5f5ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6dd6b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f4f050 0x557dc5f5ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59454/0 (socket says 172.21.15.123:59454) 2024-08-18T22:12:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6dd6b7640 1 -- 172.21.15.123:0/3001546105 learned_addr learned my addr 172.21.15.123:0/3001546105 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6dceb6640 1 --2- 172.21.15.123:0/3001546105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49680 0x557dc5f537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6d7fff640 1 --2- 172.21.15.123:0/3001546105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f49fc0 0x557dc5f53ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6dd6b7640 1 -- 172.21.15.123:0/3001546105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49680 msgr2=0x557dc5f537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6dd6b7640 1 --2- 172.21.15.123:0/3001546105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49680 0x557dc5f537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6dd6b7640 1 -- 172.21.15.123:0/3001546105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f49fc0 msgr2=0x557dc5f53ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6dd6b7640 1 --2- 172.21.15.123:0/3001546105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f49fc0 0x557dc5f53ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.633+0000 7ff6dd6b7640 1 -- 172.21.15.123:0/3001546105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dc5c8c620 con 0x557dc5f4f050 2024-08-18T22:12:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6dd6b7640 1 --2- 172.21.15.123:0/3001546105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f4f050 0x557dc5f5ad20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff6d001eed0 tx=0x7ff6d001e6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9977aee41b19e484 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6b7fff640 1 -- 172.21.15.123:0/3001546105 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d002d070 con 0x557dc5f4f050 2024-08-18T22:12:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6b7fff640 1 -- 172.21.15.123:0/3001546105 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ff6d0027860 con 0x557dc5f4f050 2024-08-18T22:12:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3001546105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6d000dde0 con 0x557dc5f4f050 2024-08-18T22:12:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6b7fff640 1 -- 172.21.15.123:0/3001546105 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff6d0022040 con 0x557dc5f4f050 2024-08-18T22:12:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6e1b22740 10 client.16356 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3001546105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557dc5f5db60 con 0x557dc5f4f050 2024-08-18T22:12:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6b7fff640 1 -- 172.21.15.123:0/3001546105 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6d000dde0 con 0x557dc5f4f050 2024-08-18T22:12:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6b7fff640 1 -- 172.21.15.123:0/3001546105 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff6d0031490 con 0x557dc5f4f050 2024-08-18T22:12:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6e1b22740 10 client.16356 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6e1b22740 10 client.16356 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6e1b22740 20 client.16356 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3001546105 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557dc5f5efc0 0x557dc5f613b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6e1b22740 4 client.16356 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:12:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.634+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3001546105 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dc5eba100 con 0x557dc5f5efc0 2024-08-18T22:12:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.635+0000 7ff6dceb6640 1 --2- 172.21.15.123:0/3001546105 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557dc5f5efc0 0x557dc5f613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.635+0000 7ff6b7fff640 10 client.16356 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.635+0000 7ff6dceb6640 1 --2- 172.21.15.123:0/3001546105 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557dc5f5efc0 0x557dc5f613b0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=952eb3d505885f23 server_cookie=2ebd1d054884e755 in_seq=0 out_seq=0 2024-08-18T22:12:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.636+0000 7ff6b7fff640 1 -- 172.21.15.123:0/3001546105 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557dc5eba100 con 0x557dc5f5efc0 2024-08-18T22:12:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.636+0000 7ff6b7fff640 10 client.16356 handle_command_reply: tid=0 2024-08-18T22:12:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.636+0000 7ff6e1b22740 1 client.16356 shutdown 2024-08-18T22:12:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.636+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3001546105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f4f050 msgr2=0x557dc5f5ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.636+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3001546105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f4f050 0x557dc5f5ad20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff6d001eed0 tx=0x7ff6d001e6f0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.636+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3001546105 shutdown_connections 2024-08-18T22:12:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.636+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3001546105 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557dc5f5efc0 0x557dc5f613b0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.636+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3001546105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f4f050 0x557dc5f5ad20 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.636+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3001546105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f49fc0 0x557dc5f53ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.636+0000 7ff6b7fff640 0 client.16356 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.636+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3001546105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49680 0x557dc5f537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.636+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3001546105 >> 172.21.15.123:0/3001546105 conn(0x557dc5f44cf0 msgr2=0x557dc5f46500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.636+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3001546105 shutdown_connections 2024-08-18T22:12:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.636+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3001546105 wait complete. 2024-08-18T22:12:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.636+0000 7ff6e1b22740 20 client.16356 trim_cache size 0 max 16384 2024-08-18T22:12:36.653 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6e1b22740 1 Processor -- start 2024-08-18T22:12:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6e1b22740 1 -- start start 2024-08-18T22:12:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6e1b22740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f49680 0x557dc5f4e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6e1b22740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49fc0 0x557dc5f5ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6e1b22740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f4f050 0x557dc5f537a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6e1b22740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81acb70 con 0x557dc5f49680 2024-08-18T22:12:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6e1b22740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81aa440 con 0x557dc5f4f050 2024-08-18T22:12:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6e1b22740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81a8290 con 0x557dc5f49fc0 2024-08-18T22:12:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6dceb6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f49680 0x557dc5f4e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6dceb6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f49680 0x557dc5f4e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59456/0 (socket says 172.21.15.123:59456) 2024-08-18T22:12:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6dceb6640 1 -- 172.21.15.123:0/2567786601 learned_addr learned my addr 172.21.15.123:0/2567786601 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6d7fff640 1 --2- 172.21.15.123:0/2567786601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49fc0 0x557dc5f5ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6dceb6640 1 -- 172.21.15.123:0/2567786601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49fc0 msgr2=0x557dc5f5ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6dceb6640 1 --2- 172.21.15.123:0/2567786601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49fc0 0x557dc5f5ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6dceb6640 1 -- 172.21.15.123:0/2567786601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f4f050 msgr2=0x557dc5f537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6dceb6640 1 --2- 172.21.15.123:0/2567786601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f4f050 0x557dc5f537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6dceb6640 1 -- 172.21.15.123:0/2567786601 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dc5f4e410 con 0x557dc5f49680 2024-08-18T22:12:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.651+0000 7ff6dceb6640 1 --2- 172.21.15.123:0/2567786601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f49680 0x557dc5f4e790 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc005ab0 tx=0x7ff6cc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a999df5343c4c226 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.652+0000 7ff6c27fc640 1 -- 172.21.15.123:0/2567786601 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc04b070 con 0x557dc5f49680 2024-08-18T22:12:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.652+0000 7ff6c27fc640 1 -- 172.21.15.123:0/2567786601 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6cc005520 con 0x557dc5f49680 2024-08-18T22:12:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.652+0000 7ff6c27fc640 1 -- 172.21.15.123:0/2567786601 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc035040 con 0x557dc5f49680 2024-08-18T22:12:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.652+0000 7ff6e1b22740 1 -- 172.21.15.123:0/2567786601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f49680 msgr2=0x557dc5f4e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.652+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/2567786601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f49680 0x557dc5f4e790 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc005ab0 tx=0x7ff6cc000bc0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.652+0000 7ff6e1b22740 1 -- 172.21.15.123:0/2567786601 shutdown_connections 2024-08-18T22:12:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.652+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/2567786601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f4f050 0x557dc5f537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.652+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/2567786601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f49fc0 0x557dc5f5ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.652+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/2567786601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f49680 0x557dc5f4e790 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.652+0000 7ff6e1b22740 1 -- 172.21.15.123:0/2567786601 >> 172.21.15.123:0/2567786601 conn(0x557dc5f44cf0 msgr2=0x557dc5f4b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.652+0000 7ff6e1b22740 1 -- 172.21.15.123:0/2567786601 shutdown_connections 2024-08-18T22:12:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.652+0000 7ff6e1b22740 1 -- 172.21.15.123:0/2567786601 wait complete. 2024-08-18T22:12:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6e1b22740 1 -- start start 2024-08-18T22:12:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6e1b22740 1 Processor -- start 2024-08-18T22:12:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6e1b22740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f49680 0x557dc5f57f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6e1b22740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f49fc0 0x557dc5f584d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6e1b22740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f4f050 0x557dc5f594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6e1b22740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81a8900 con 0x557dc5f49fc0 2024-08-18T22:12:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6e1b22740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81a9d70 con 0x557dc5f49680 2024-08-18T22:12:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6e1b22740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81a8fd0 con 0x557dc5f4f050 2024-08-18T22:12:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6e1b22740 10 client.0 _ll_register_callbacks cb 0x7ff6c400de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6d7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f49fc0 0x557dc5f584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6d7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f49fc0 0x557dc5f584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59464/0 (socket says 172.21.15.123:59464) 2024-08-18T22:12:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6d7fff640 1 -- 172.21.15.123:0/3623786264 learned_addr learned my addr 172.21.15.123:0/3623786264 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6dd6b7640 1 --2- 172.21.15.123:0/3623786264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f4f050 0x557dc5f594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6d7fff640 1 -- 172.21.15.123:0/3623786264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f4f050 msgr2=0x557dc5f594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6d7fff640 1 --2- 172.21.15.123:0/3623786264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f4f050 0x557dc5f594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6d7fff640 1 -- 172.21.15.123:0/3623786264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f49680 msgr2=0x557dc5f57f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6d7fff640 1 --2- 172.21.15.123:0/3623786264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f49680 0x557dc5f57f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6d7fff640 1 -- 172.21.15.123:0/3623786264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dc5f59af0 con 0x557dc5f49fc0 2024-08-18T22:12:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.653+0000 7ff6dd6b7640 1 --2- 172.21.15.123:0/3623786264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f4f050 0x557dc5f594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:12:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6d7fff640 1 --2- 172.21.15.123:0/3623786264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f49fc0 0x557dc5f584d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009610 tx=0x7ff6c4010520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3f7837f0e0c822 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6b7fff640 1 -- 172.21.15.123:0/3623786264 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4020040 con 0x557dc5f49fc0 2024-08-18T22:12:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6b7fff640 1 -- 172.21.15.123:0/3623786264 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ff6c40870b0 con 0x557dc5f49fc0 2024-08-18T22:12:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3623786264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6cc005520 con 0x557dc5f49fc0 2024-08-18T22:12:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6b7fff640 1 -- 172.21.15.123:0/3623786264 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff6c409f660 con 0x557dc5f49fc0 2024-08-18T22:12:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6e1b22740 10 client.16362 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3623786264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557dc5f5aed0 con 0x557dc5f49fc0 2024-08-18T22:12:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6b7fff640 1 -- 172.21.15.123:0/3623786264 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6cc005520 con 0x557dc5f49fc0 2024-08-18T22:12:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6b7fff640 1 -- 172.21.15.123:0/3623786264 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff6c4097920 con 0x557dc5f49fc0 2024-08-18T22:12:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6e1b22740 10 client.16362 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6e1b22740 10 client.16362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6e1b22740 20 client.16362 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3623786264 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557dc5fca230 0x557dc5fcc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6e1b22740 4 client.16362 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:12:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.654+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3623786264 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557dc5eb4450 con 0x557dc5fca230 2024-08-18T22:12:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.655+0000 7ff6dceb6640 1 --2- 172.21.15.123:0/3623786264 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557dc5fca230 0x557dc5fcc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.655+0000 7ff6b7fff640 10 client.16362 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.655+0000 7ff6dceb6640 1 --2- 172.21.15.123:0/3623786264 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557dc5fca230 0x557dc5fcc650 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2644720c165eb40 server_cookie=c45fc435c53d18 in_seq=0 out_seq=0 2024-08-18T22:12:36.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.718+0000 7ff6b7fff640 1 -- 172.21.15.123:0/3623786264 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557dc5eb4450 con 0x557dc5fca230 2024-08-18T22:12:36.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.718+0000 7ff6b7fff640 10 client.16362 handle_command_reply: tid=0 2024-08-18T22:12:36.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.718+0000 7ff6e1b22740 1 client.16362 shutdown 2024-08-18T22:12:36.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.718+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3623786264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f49fc0 msgr2=0x557dc5f584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:36.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.718+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3623786264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f49fc0 0x557dc5f584d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009610 tx=0x7ff6c4010520 comp rx=0 tx=0).stop 2024-08-18T22:12:36.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.718+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3623786264 shutdown_connections 2024-08-18T22:12:36.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.718+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3623786264 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x557dc5fca230 0x557dc5fcc650 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.718+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3623786264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dc5f4f050 0x557dc5f594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.718+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3623786264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557dc5f49fc0 0x557dc5f584d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.718+0000 7ff6e1b22740 1 --2- 172.21.15.123:0/3623786264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc5f49680 0x557dc5f57f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.718+0000 7ff6b7fff640 0 client.16362 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.718+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3623786264 >> 172.21.15.123:0/3623786264 conn(0x557dc5f44cf0 msgr2=0x557dc5f537a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.718+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3623786264 shutdown_connections 2024-08-18T22:12:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.718+0000 7ff6e1b22740 1 -- 172.21.15.123:0/3623786264 wait complete. 2024-08-18T22:12:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.719+0000 7ff6e1b22740 20 client.16362 trim_cache size 0 max 16384 2024-08-18T22:12:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:12:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:12:36.722 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:12:36.722 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:12:36.722 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.719+0000 7ff6df11a640 1 -- 172.21.15.123:0/3569228375 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff6c80a2cb0 msgr2=0x7ff6c80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:36.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.719+0000 7ff6df11a640 1 --2- 172.21.15.123:0/3569228375 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff6c80a2cb0 0x7ff6c80a5170 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000afd0 tx=0x7ff6d000adc0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.719+0000 7ff6df11a640 1 -- 172.21.15.123:0/3569228375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6d8101970 msgr2=0x7ff6d819c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:36.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.719+0000 7ff6df11a640 1 --2- 172.21.15.123:0/3569228375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6d8101970 0x7ff6d819c810 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400d770 tx=0x7ff6c400dc30 comp rx=0 tx=0).stop 2024-08-18T22:12:36.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.719+0000 7ff6df11a640 1 -- 172.21.15.123:0/3569228375 shutdown_connections 2024-08-18T22:12:36.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.719+0000 7ff6df11a640 1 --2- 172.21.15.123:0/3569228375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6d8102330 0x7ff6d819ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.719+0000 7ff6df11a640 1 --2- 172.21.15.123:0/3569228375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6d8101970 0x7ff6d819c810 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.719+0000 7ff6df11a640 1 --2- 172.21.15.123:0/3569228375 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff6c80a2cb0 0x7ff6c80a5170 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.719+0000 7ff6df11a640 1 --2- 172.21.15.123:0/3569228375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6d8100780 0x7ff6d806ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:36.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.719+0000 7ff6df11a640 1 -- 172.21.15.123:0/3569228375 >> 172.21.15.123:0/3569228375 conn(0x7ff6d80fbee0 msgr2=0x7ff6d8104c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:36.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.719+0000 7ff6df11a640 1 -- 172.21.15.123:0/3569228375 shutdown_connections 2024-08-18T22:12:36.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:36.719+0000 7ff6df11a640 1 -- 172.21.15.123:0/3569228375 wait complete. 2024-08-18T22:12:37.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:37 smithi183 ceph-mon[22097]: pgmap v485: 129 pgs: 129 active+clean; 2.1 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 461 KiB/s wr, 1.10k op/s 2024-08-18T22:12:37.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:37 smithi123 ceph-mon[18462]: pgmap v485: 129 pgs: 129 active+clean; 2.1 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 461 KiB/s wr, 1.10k op/s 2024-08-18T22:12:37.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:37 smithi130 ceph-mon[21698]: pgmap v485: 129 pgs: 129 active+clean; 2.1 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 461 KiB/s wr, 1.10k op/s 2024-08-18T22:12:38.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:38 smithi123 ceph-mon[18462]: scrub summary: idle 2024-08-18T22:12:38.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:38 smithi130 ceph-mon[21698]: scrub summary: idle 2024-08-18T22:12:38.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:38 smithi183 ceph-mon[22097]: scrub summary: idle 2024-08-18T22:12:39.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:39 smithi123 ceph-mon[18462]: pgmap v486: 129 pgs: 129 active+clean; 2.1 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 46 KiB/s wr, 1.23k op/s 2024-08-18T22:12:39.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:39 smithi130 ceph-mon[21698]: pgmap v486: 129 pgs: 129 active+clean; 2.1 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 46 KiB/s wr, 1.23k op/s 2024-08-18T22:12:39.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:39 smithi183 ceph-mon[22097]: pgmap v486: 129 pgs: 129 active+clean; 2.1 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 46 KiB/s wr, 1.23k op/s 2024-08-18T22:12:41.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:41 smithi123 ceph-mon[18462]: pgmap v487: 129 pgs: 129 active+clean; 2.2 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 11 KiB/s wr, 998 op/s 2024-08-18T22:12:41.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:41 smithi130 ceph-mon[21698]: pgmap v487: 129 pgs: 129 active+clean; 2.2 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 11 KiB/s wr, 998 op/s 2024-08-18T22:12:41.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:41 smithi183 ceph-mon[22097]: pgmap v487: 129 pgs: 129 active+clean; 2.2 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 11 KiB/s wr, 998 op/s 2024-08-18T22:12:42.422 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:12:42.682 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:12:43.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.142+0000 7fcae097e640 1 -- 172.21.15.123:0/1299267534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcadc1067b0 msgr2=0x7fcadc106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:43.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.142+0000 7fcae097e640 1 --2- 172.21.15.123:0/1299267534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcadc1067b0 0x7fcadc106b90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009930 tx=0x7fcacc02a420 comp rx=0 tx=0).stop 2024-08-18T22:12:43.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.142+0000 7fcae097e640 1 -- 172.21.15.123:0/1299267534 shutdown_connections 2024-08-18T22:12:43.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.142+0000 7fcae097e640 1 --2- 172.21.15.123:0/1299267534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcadc101150 0x7fcadc10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:43.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.142+0000 7fcae097e640 1 --2- 172.21.15.123:0/1299267534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc1007b0 0x7fcadc100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:43.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.142+0000 7fcae097e640 1 --2- 172.21.15.123:0/1299267534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcadc1067b0 0x7fcadc106b90 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:43.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.142+0000 7fcae097e640 1 -- 172.21.15.123:0/1299267534 >> 172.21.15.123:0/1299267534 conn(0x7fcadc0fc4d0 msgr2=0x7fcadc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:43.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.142+0000 7fcae097e640 1 -- 172.21.15.123:0/1299267534 shutdown_connections 2024-08-18T22:12:43.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.142+0000 7fcae097e640 1 -- 172.21.15.123:0/1299267534 wait complete. 2024-08-18T22:12:43.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.143+0000 7fcae097e640 1 Processor -- start 2024-08-18T22:12:43.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.143+0000 7fcae097e640 1 -- start start 2024-08-18T22:12:43.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.143+0000 7fcae097e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc1007b0 0x7fcadc197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:43.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.143+0000 7fcae097e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcadc101150 0x7fcadc197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:43.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.143+0000 7fcae097e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcadc1067b0 0x7fcadc19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:43.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.143+0000 7fcae097e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc110bd0 con 0x7fcadc1067b0 2024-08-18T22:12:43.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.143+0000 7fcae097e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc110a50 con 0x7fcadc101150 2024-08-18T22:12:43.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.143+0000 7fcae097e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc110d50 con 0x7fcadc1007b0 2024-08-18T22:12:43.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.143+0000 7fcadad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcadc1067b0 0x7fcadc19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:43.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.143+0000 7fcadad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcadc1067b0 0x7fcadc19ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39204/0 (socket says 172.21.15.123:39204) 2024-08-18T22:12:43.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.143+0000 7fcadad9d640 1 -- 172.21.15.123:0/3614144483 learned_addr learned my addr 172.21.15.123:0/3614144483 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:43.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.143+0000 7fcad9d9b640 1 --2- 172.21.15.123:0/3614144483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcadc101150 0x7fcadc197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:43.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.143+0000 7fcada59c640 1 --2- 172.21.15.123:0/3614144483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc1007b0 0x7fcadc197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:43.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.144+0000 7fcadad9d640 1 -- 172.21.15.123:0/3614144483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc1007b0 msgr2=0x7fcadc197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:43.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.144+0000 7fcadad9d640 1 --2- 172.21.15.123:0/3614144483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc1007b0 0x7fcadc197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:43.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.144+0000 7fcadad9d640 1 -- 172.21.15.123:0/3614144483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcadc101150 msgr2=0x7fcadc197670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:43.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.144+0000 7fcadad9d640 1 --2- 172.21.15.123:0/3614144483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcadc101150 0x7fcadc197670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:43.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.144+0000 7fcadad9d640 1 -- 172.21.15.123:0/3614144483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcadc19c0e0 con 0x7fcadc1067b0 2024-08-18T22:12:43.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.144+0000 7fcadad9d640 1 --2- 172.21.15.123:0/3614144483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcadc1067b0 0x7fcadc19ba00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcad400ebb0 tx=0x7fcad4009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:43.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.144+0000 7fcacb7fe640 1 -- 172.21.15.123:0/3614144483 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad400e2e0 con 0x7fcadc1067b0 2024-08-18T22:12:43.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.144+0000 7fcacb7fe640 1 -- 172.21.15.123:0/3614144483 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcad4007950 con 0x7fcadc1067b0 2024-08-18T22:12:43.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.144+0000 7fcae097e640 1 -- 172.21.15.123:0/3614144483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcadc19c370 con 0x7fcadc1067b0 2024-08-18T22:12:43.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.144+0000 7fcacb7fe640 1 -- 172.21.15.123:0/3614144483 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4005790 con 0x7fcadc1067b0 2024-08-18T22:12:43.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.144+0000 7fcae097e640 1 -- 172.21.15.123:0/3614144483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcadc06a4c0 con 0x7fcadc1067b0 2024-08-18T22:12:43.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.145+0000 7fcae097e640 1 -- 172.21.15.123:0/3614144483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcadc101ef0 con 0x7fcadc1067b0 2024-08-18T22:12:43.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.146+0000 7fcacb7fe640 1 -- 172.21.15.123:0/3614144483 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fcad4007b00 con 0x7fcadc1067b0 2024-08-18T22:12:43.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.146+0000 7fcacb7fe640 1 --2- 172.21.15.123:0/3614144483 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcac40a2b80 0x7fcac40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:43.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.147+0000 7fcada59c640 1 --2- 172.21.15.123:0/3614144483 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcac40a2b80 0x7fcac40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:43.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.147+0000 7fcacb7fe640 1 -- 172.21.15.123:0/3614144483 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fcad40d0d90 con 0x7fcadc1067b0 2024-08-18T22:12:43.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.147+0000 7fcada59c640 1 --2- 172.21.15.123:0/3614144483 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcac40a2b80 0x7fcac40a5040 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009900 tx=0x7fcacc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:43.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.150+0000 7fcacb7fe640 1 -- 172.21.15.123:0/3614144483 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcad409d960 con 0x7fcadc1067b0 2024-08-18T22:12:43.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.350+0000 7fcae097e640 1 -- 172.21.15.123:0/3614144483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcadc100c10 con 0x7fcadc1067b0 2024-08-18T22:12:43.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.350+0000 7fcacb7fe640 1 -- 172.21.15.123:0/3614144483 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7fcadc100c10 con 0x7fcadc1067b0 2024-08-18T22:12:43.352 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:12:43.352 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":27,"btime":"2024-08-18T22:11:43:088943+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:11:42.650261+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24448,24458,24466]},"id":1}]} 2024-08-18T22:12:43.352 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 27 2024-08-18T22:12:43.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.352+0000 7fcae097e640 1 -- 172.21.15.123:0/3614144483 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcac40a2b80 msgr2=0x7fcac40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:43.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.352+0000 7fcae097e640 1 --2- 172.21.15.123:0/3614144483 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcac40a2b80 0x7fcac40a5040 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009900 tx=0x7fcacc0058d0 comp rx=0 tx=0).stop 2024-08-18T22:12:43.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.352+0000 7fcae097e640 1 -- 172.21.15.123:0/3614144483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcadc1067b0 msgr2=0x7fcadc19ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:43.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.352+0000 7fcae097e640 1 --2- 172.21.15.123:0/3614144483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcadc1067b0 0x7fcadc19ba00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcad400ebb0 tx=0x7fcad4009f60 comp rx=0 tx=0).stop 2024-08-18T22:12:43.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.352+0000 7fcae097e640 1 -- 172.21.15.123:0/3614144483 shutdown_connections 2024-08-18T22:12:43.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.352+0000 7fcae097e640 1 --2- 172.21.15.123:0/3614144483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcadc1067b0 0x7fcadc19ba00 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:43.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.352+0000 7fcae097e640 1 --2- 172.21.15.123:0/3614144483 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fcac40a2b80 0x7fcac40a5040 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:43.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.352+0000 7fcae097e640 1 --2- 172.21.15.123:0/3614144483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcadc101150 0x7fcadc197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:43.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.352+0000 7fcae097e640 1 --2- 172.21.15.123:0/3614144483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc1007b0 0x7fcadc197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:43.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.352+0000 7fcae097e640 1 -- 172.21.15.123:0/3614144483 >> 172.21.15.123:0/3614144483 conn(0x7fcadc0fc4d0 msgr2=0x7fcadc0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:43.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.353+0000 7fcae097e640 1 -- 172.21.15.123:0/3614144483 shutdown_connections 2024-08-18T22:12:43.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:43.353+0000 7fcae097e640 1 -- 172.21.15.123:0/3614144483 wait complete. 2024-08-18T22:12:43.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:43 smithi123 ceph-mon[18462]: pgmap v488: 129 pgs: 129 active+clean; 2.2 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 6.8 KiB/s wr, 1.02k op/s 2024-08-18T22:12:43.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:43 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3614144483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:12:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:43 smithi130 ceph-mon[21698]: pgmap v488: 129 pgs: 129 active+clean; 2.2 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 6.8 KiB/s wr, 1.02k op/s 2024-08-18T22:12:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:43 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3614144483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:12:43.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:43 smithi183 ceph-mon[22097]: pgmap v488: 129 pgs: 129 active+clean; 2.2 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 6.8 KiB/s wr, 1.02k op/s 2024-08-18T22:12:43.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:43 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3614144483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:12:44.154 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db --set-id b9516e05 --release --await' 2024-08-18T22:12:44.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24466 quiesce db --set-id b9516e05 --release --await 2024-08-18T22:12:44.409 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:12:44.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.910+0000 7f1a9a0b6640 1 -- 172.21.15.123:0/1919733544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a94108010 msgr2=0x7f1a9410e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:44.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.910+0000 7f1a9a0b6640 1 --2- 172.21.15.123:0/1919733544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a94108010 0x7f1a9410e980 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009cd0 tx=0x7f1a8c02a910 comp rx=0 tx=0).stop 2024-08-18T22:12:44.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.910+0000 7f1a9a0b6640 1 -- 172.21.15.123:0/1919733544 shutdown_connections 2024-08-18T22:12:44.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.910+0000 7f1a9a0b6640 1 --2- 172.21.15.123:0/1919733544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a94108010 0x7f1a9410e980 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.910+0000 7f1a9a0b6640 1 --2- 172.21.15.123:0/1919733544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a94103490 0x7f1a941078d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.910+0000 7f1a9a0b6640 1 --2- 172.21.15.123:0/1919733544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a94102ae0 0x7f1a94102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.910+0000 7f1a9a0b6640 1 -- 172.21.15.123:0/1919733544 >> 172.21.15.123:0/1919733544 conn(0x7f1a940fc500 msgr2=0x7f1a940fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:44.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.910+0000 7f1a9a0b6640 1 -- 172.21.15.123:0/1919733544 shutdown_connections 2024-08-18T22:12:44.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.910+0000 7f1a9a0b6640 1 -- 172.21.15.123:0/1919733544 wait complete. 2024-08-18T22:12:44.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a9a0b6640 1 Processor -- start 2024-08-18T22:12:44.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a9a0b6640 1 -- start start 2024-08-18T22:12:44.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a9a0b6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a94102ae0 0x7f1a94100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a9a0b6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a94103490 0x7f1a94100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a9a0b6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a94108010 0x7f1a941011c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a9a0b6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1a94111e40 con 0x7f1a94102ae0 2024-08-18T22:12:44.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a9a0b6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1a94111cc0 con 0x7f1a94108010 2024-08-18T22:12:44.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a9a0b6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1a94111fc0 con 0x7f1a94103490 2024-08-18T22:12:44.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a937fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a94102ae0 0x7f1a94100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a937fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a94102ae0 0x7f1a94100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39216/0 (socket says 172.21.15.123:39216) 2024-08-18T22:12:44.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a937fe640 1 -- 172.21.15.123:0/3734084377 learned_addr learned my addr 172.21.15.123:0/3734084377 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:44.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a92ffd640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a94103490 0x7f1a94100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a93fff640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a94108010 0x7f1a941011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a937fe640 1 -- 172.21.15.123:0/3734084377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a94103490 msgr2=0x7f1a94100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:44.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a937fe640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a94103490 0x7f1a94100c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a937fe640 1 -- 172.21.15.123:0/3734084377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a94108010 msgr2=0x7f1a941011c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:44.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a937fe640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a94108010 0x7f1a941011c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a937fe640 1 -- 172.21.15.123:0/3734084377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a941a67e0 con 0x7f1a94102ae0 2024-08-18T22:12:44.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a93fff640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a94108010 0x7f1a941011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:12:44.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.911+0000 7f1a92ffd640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a94103490 0x7f1a94100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:44.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.912+0000 7f1a937fe640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a94102ae0 0x7f1a94100740 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800c970 tx=0x7f1a8800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:44.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.912+0000 7f1a90ff9640 1 -- 172.21.15.123:0/3734084377 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88007bb0 con 0x7f1a94102ae0 2024-08-18T22:12:44.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.912+0000 7f1a90ff9640 1 -- 172.21.15.123:0/3734084377 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a88007d50 con 0x7f1a94102ae0 2024-08-18T22:12:44.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.912+0000 7f1a9a0b6640 1 -- 172.21.15.123:0/3734084377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a941a6ad0 con 0x7f1a94102ae0 2024-08-18T22:12:44.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.912+0000 7f1a90ff9640 1 -- 172.21.15.123:0/3734084377 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8800f450 con 0x7f1a94102ae0 2024-08-18T22:12:44.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.912+0000 7f1a9a0b6640 1 -- 172.21.15.123:0/3734084377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a941a6fc0 con 0x7f1a94102ae0 2024-08-18T22:12:44.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.914+0000 7f1a90ff9640 1 -- 172.21.15.123:0/3734084377 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f1a88005020 con 0x7f1a94102ae0 2024-08-18T22:12:44.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.914+0000 7f1a9c4b4740 1 Processor -- start 2024-08-18T22:12:44.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.914+0000 7f1a9c4b4740 1 -- start start 2024-08-18T22:12:44.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.914+0000 7f1a9c4b4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 0x55ee0a42cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.914+0000 7f1a9c4b4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42d2b0 0x55ee0a437630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.914+0000 7f1a9c4b4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a439f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a9c4b4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ee0a392c60 con 0x55ee0a437b70 2024-08-18T22:12:44.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a9c4b4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee0a32ab90 con 0x55ee0a42d2b0 2024-08-18T22:12:44.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a9c4b4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ee0a38ec20 con 0x55ee0a42c990 2024-08-18T22:12:44.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a92ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a439f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a90ff9640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1a7c0a2b80 0x7f1a7c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a92ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a439f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39218/0 (socket says 172.21.15.123:39218) 2024-08-18T22:12:44.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a92ffd640 1 -- 172.21.15.123:0/3100816012 learned_addr learned my addr 172.21.15.123:0/3100816012 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:44.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a937fe640 1 --2- 172.21.15.123:0/3100816012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42d2b0 0x55ee0a437630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a93fff640 1 --2- 172.21.15.123:0/3100816012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 0x55ee0a42cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a93fff640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1a7c0a2b80 0x7f1a7c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a90ff9640 1 -- 172.21.15.123:0/3734084377 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f1a880cf260 con 0x7f1a94102ae0 2024-08-18T22:12:44.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a92ffd640 1 -- 172.21.15.123:0/3100816012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 msgr2=0x55ee0a42cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:44.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a92ffd640 1 --2- 172.21.15.123:0/3100816012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 0x55ee0a42cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a92ffd640 1 -- 172.21.15.123:0/3100816012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42d2b0 msgr2=0x55ee0a437630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:44.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a92ffd640 1 --2- 172.21.15.123:0/3100816012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42d2b0 0x55ee0a437630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a92ffd640 1 -- 172.21.15.123:0/3100816012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee0a0a2580 con 0x55ee0a437b70 2024-08-18T22:12:44.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a92ffd640 1 --2- 172.21.15.123:0/3100816012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a439f60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1a840077a0 tx=0x7f1a84007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f9b3228edbc5e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:44.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a93fff640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1a7c0a2b80 0x7f1a7c0a5040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009a60 tx=0x7f1a8c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:44.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.915+0000 7f1a79ffb640 1 -- 172.21.15.123:0/3100816012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8400d950 con 0x55ee0a437b70 2024-08-18T22:12:44.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.916+0000 7f1a79ffb640 1 -- 172.21.15.123:0/3100816012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a84018070 con 0x55ee0a437b70 2024-08-18T22:12:44.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.916+0000 7f1a79ffb640 1 -- 172.21.15.123:0/3100816012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a840123e0 con 0x55ee0a437b70 2024-08-18T22:12:44.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.916+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/3100816012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 msgr2=0x55ee0a439f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:44.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.916+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/3100816012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a439f60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1a840077a0 tx=0x7f1a84007c60 comp rx=0 tx=0).stop 2024-08-18T22:12:44.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.916+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/3100816012 shutdown_connections 2024-08-18T22:12:44.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.916+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/3100816012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a439f60 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.916+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/3100816012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42d2b0 0x55ee0a437630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.916+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/3100816012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 0x55ee0a42cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.916+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/3100816012 >> 172.21.15.123:0/3100816012 conn(0x55ee0a428f20 msgr2=0x55ee0a429300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:44.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.916+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/3100816012 shutdown_connections 2024-08-18T22:12:44.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.916+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/3100816012 wait complete. 2024-08-18T22:12:44.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.917+0000 7f1a9c4b4740 1 -- start start 2024-08-18T22:12:44.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.917+0000 7f1a9c4b4740 1 Processor -- start 2024-08-18T22:12:44.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.917+0000 7f1a9c4b4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 0x55ee0a4349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.917+0000 7f1a9c4b4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a42d2b0 0x55ee0a434f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.917+0000 7f1a9c4b4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a437b70 0x55ee0a435440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.917+0000 7f1a9c4b4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ee0a43a740 con 0x55ee0a42d2b0 2024-08-18T22:12:44.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.917+0000 7f1a9c4b4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee0a3307c0 con 0x55ee0a437b70 2024-08-18T22:12:44.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.917+0000 7f1a9c4b4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ee0a43a8c0 con 0x55ee0a42c990 2024-08-18T22:12:44.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.917+0000 7f1a9c4b4740 10 client.0 _ll_register_callbacks cb 0x55ee0a339f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:44.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.917+0000 7f1a92ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a42d2b0 0x55ee0a434f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.917+0000 7f1a92ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a42d2b0 0x55ee0a434f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39222/0 (socket says 172.21.15.123:39222) 2024-08-18T22:12:44.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.917+0000 7f1a92ffd640 1 -- 172.21.15.123:0/1785217002 learned_addr learned my addr 172.21.15.123:0/1785217002 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:44.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.917+0000 7f1a937fe640 1 --2- 172.21.15.123:0/1785217002 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 0x55ee0a4349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.917+0000 7f1a93fff640 1 --2- 172.21.15.123:0/1785217002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a437b70 0x55ee0a435440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a92ffd640 1 -- 172.21.15.123:0/1785217002 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 msgr2=0x55ee0a4349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:44.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a92ffd640 1 --2- 172.21.15.123:0/1785217002 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 0x55ee0a4349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a92ffd640 1 -- 172.21.15.123:0/1785217002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a437b70 msgr2=0x55ee0a435440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:44.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a92ffd640 1 --2- 172.21.15.123:0/1785217002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a437b70 0x55ee0a435440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a92ffd640 1 -- 172.21.15.123:0/1785217002 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee0a16c960 con 0x55ee0a42d2b0 2024-08-18T22:12:44.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a92ffd640 1 --2- 172.21.15.123:0/1785217002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a42d2b0 0x55ee0a434f00 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1a84000c00 tx=0x7f1a84013730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d18e91408b1559 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:44.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:44.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a72ffd640 1 -- 172.21.15.123:0/1785217002 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8400dd60 con 0x55ee0a42d2b0 2024-08-18T22:12:44.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a72ffd640 1 -- 172.21.15.123:0/1785217002 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f1a8401c3f0 con 0x55ee0a42d2b0 2024-08-18T22:12:44.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/1785217002 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a84018070 con 0x55ee0a42d2b0 2024-08-18T22:12:44.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a72ffd640 1 -- 172.21.15.123:0/1785217002 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1a8401c5f0 con 0x55ee0a42d2b0 2024-08-18T22:12:44.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a9c4b4740 10 client.16380 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:44.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/1785217002 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ee0a446740 con 0x55ee0a42d2b0 2024-08-18T22:12:44.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a72ffd640 1 -- 172.21.15.123:0/1785217002 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a84018070 con 0x55ee0a42d2b0 2024-08-18T22:12:44.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a72ffd640 1 -- 172.21.15.123:0/1785217002 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f1a84024790 con 0x55ee0a42d2b0 2024-08-18T22:12:44.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.918+0000 7f1a9c4b4740 10 client.16380 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:44.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.919+0000 7f1a9c4b4740 10 client.16380 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:12:44.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.919+0000 7f1a9c4b4740 20 client.16380 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:44.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.919+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/1785217002 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a447ba0 0x55ee0a449f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.919+0000 7f1a9c4b4740 4 client.16380 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:12:44.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.919+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/1785217002 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee0a3a01d0 con 0x55ee0a447ba0 2024-08-18T22:12:44.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.919+0000 7f1a937fe640 1 --2- 172.21.15.123:0/1785217002 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a447ba0 0x55ee0a449f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.919+0000 7f1a72ffd640 10 client.16380 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:44.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.919+0000 7f1a937fe640 1 --2- 172.21.15.123:0/1785217002 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a447ba0 0x55ee0a449f90 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92d3f55ae7d4df75 server_cookie=7cd9152a2c96a618 in_seq=0 out_seq=0 2024-08-18T22:12:44.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.920+0000 7f1a72ffd640 1 -- 172.21.15.123:0/1785217002 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee0a3a01d0 con 0x55ee0a447ba0 2024-08-18T22:12:44.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.920+0000 7f1a72ffd640 10 client.16380 handle_command_reply: tid=0 2024-08-18T22:12:44.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.920+0000 7f1a9c4b4740 1 client.16380 shutdown 2024-08-18T22:12:44.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.920+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/1785217002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a42d2b0 msgr2=0x55ee0a434f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:44.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.920+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/1785217002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a42d2b0 0x55ee0a434f00 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1a84000c00 tx=0x7f1a84013730 comp rx=0 tx=0).stop 2024-08-18T22:12:44.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.920+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/1785217002 shutdown_connections 2024-08-18T22:12:44.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.920+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/1785217002 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a447ba0 0x55ee0a449f90 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.920+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/1785217002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a437b70 0x55ee0a435440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.920+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/1785217002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a42d2b0 0x55ee0a434f00 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.920+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/1785217002 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 0x55ee0a4349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.920+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/1785217002 >> 172.21.15.123:0/1785217002 conn(0x55ee0a428f20 msgr2=0x55ee0a42ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:44.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.920+0000 7f1a72ffd640 0 client.16380 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:44.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.920+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/1785217002 shutdown_connections 2024-08-18T22:12:44.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.920+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/1785217002 wait complete. 2024-08-18T22:12:44.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.921+0000 7f1a9c4b4740 20 client.16380 trim_cache size 0 max 16384 2024-08-18T22:12:44.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.937+0000 7f1a9c4b4740 1 Processor -- start 2024-08-18T22:12:44.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.937+0000 7f1a9c4b4740 1 -- start start 2024-08-18T22:12:44.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.937+0000 7f1a9c4b4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42c990 0x55ee0a44f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.937+0000 7f1a9c4b4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42d2b0 0x55ee0a44fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.937+0000 7f1a9c4b4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a427860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.937+0000 7f1a9c4b4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941b35c0 con 0x55ee0a437b70 2024-08-18T22:12:44.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.937+0000 7f1a9c4b4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941b0e90 con 0x55ee0a42c990 2024-08-18T22:12:44.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.937+0000 7f1a9c4b4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941aece0 con 0x55ee0a42d2b0 2024-08-18T22:12:44.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.938+0000 7f1a93fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a427860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.938+0000 7f1a93fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a427860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39234/0 (socket says 172.21.15.123:39234) 2024-08-18T22:12:44.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.938+0000 7f1a93fff640 1 -- 172.21.15.123:0/1396254030 learned_addr learned my addr 172.21.15.123:0/1396254030 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:44.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.938+0000 7f1a92ffd640 1 --2- 172.21.15.123:0/1396254030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42d2b0 0x55ee0a44fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.938+0000 7f1a937fe640 1 --2- 172.21.15.123:0/1396254030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42c990 0x55ee0a44f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.938+0000 7f1a93fff640 1 -- 172.21.15.123:0/1396254030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42d2b0 msgr2=0x55ee0a44fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:44.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.938+0000 7f1a93fff640 1 --2- 172.21.15.123:0/1396254030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42d2b0 0x55ee0a44fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.938+0000 7f1a93fff640 1 -- 172.21.15.123:0/1396254030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42c990 msgr2=0x55ee0a44f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:44.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.938+0000 7f1a93fff640 1 --2- 172.21.15.123:0/1396254030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42c990 0x55ee0a44f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.938+0000 7f1a93fff640 1 -- 172.21.15.123:0/1396254030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee0a42f800 con 0x55ee0a437b70 2024-08-18T22:12:44.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.938+0000 7f1a937fe640 1 --2- 172.21.15.123:0/1396254030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42c990 0x55ee0a44f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:12:44.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.938+0000 7f1a93fff640 1 --2- 172.21.15.123:0/1396254030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a427860 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c032e20 tx=0x7f1a8c042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f7c1b9c9c39dd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:44.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.938+0000 7f1a797fa640 1 -- 172.21.15.123:0/1396254030 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c031460 con 0x55ee0a437b70 2024-08-18T22:12:44.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.938+0000 7f1a797fa640 1 -- 172.21.15.123:0/1396254030 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a8c036040 con 0x55ee0a437b70 2024-08-18T22:12:44.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.938+0000 7f1a797fa640 1 -- 172.21.15.123:0/1396254030 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c02f8d0 con 0x55ee0a437b70 2024-08-18T22:12:44.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.939+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/1396254030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 msgr2=0x55ee0a427860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:44.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.939+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/1396254030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a427860 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c032e20 tx=0x7f1a8c042000 comp rx=0 tx=0).stop 2024-08-18T22:12:44.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.939+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/1396254030 shutdown_connections 2024-08-18T22:12:44.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.939+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/1396254030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a427860 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.939+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/1396254030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42d2b0 0x55ee0a44fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.939+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/1396254030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42c990 0x55ee0a44f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.939+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/1396254030 >> 172.21.15.123:0/1396254030 conn(0x55ee0a428f20 msgr2=0x55ee0a449bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:44.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.939+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/1396254030 shutdown_connections 2024-08-18T22:12:44.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.939+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/1396254030 wait complete. 2024-08-18T22:12:44.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.939+0000 7f1a9c4b4740 1 -- start start 2024-08-18T22:12:44.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a9c4b4740 1 Processor -- start 2024-08-18T22:12:44.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a9c4b4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 0x55ee0a43ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a9c4b4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42d2b0 0x55ee0a4313a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a9c4b4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a4318e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a9c4b4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941af350 con 0x55ee0a437b70 2024-08-18T22:12:44.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a9c4b4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941b07c0 con 0x55ee0a42d2b0 2024-08-18T22:12:44.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a9c4b4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941afa20 con 0x55ee0a42c990 2024-08-18T22:12:44.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a9c4b4740 10 client.0 _ll_register_callbacks cb 0x7f1a840075f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:44.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a93fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a4318e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a93fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a4318e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39242/0 (socket says 172.21.15.123:39242) 2024-08-18T22:12:44.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a93fff640 1 -- 172.21.15.123:0/4064338393 learned_addr learned my addr 172.21.15.123:0/4064338393 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a92ffd640 1 --2- 172.21.15.123:0/4064338393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42d2b0 0x55ee0a4313a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a937fe640 1 --2- 172.21.15.123:0/4064338393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 0x55ee0a43ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a93fff640 1 -- 172.21.15.123:0/4064338393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 msgr2=0x55ee0a43ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a93fff640 1 --2- 172.21.15.123:0/4064338393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 0x55ee0a43ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a93fff640 1 -- 172.21.15.123:0/4064338393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42d2b0 msgr2=0x55ee0a4313a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a93fff640 1 --2- 172.21.15.123:0/4064338393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42d2b0 0x55ee0a4313a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a93fff640 1 -- 172.21.15.123:0/4064338393 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee0a431e20 con 0x55ee0a437b70 2024-08-18T22:12:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a92ffd640 1 --2- 172.21.15.123:0/4064338393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42d2b0 0x55ee0a4313a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:12:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a937fe640 1 --2- 172.21.15.123:0/4064338393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 0x55ee0a43ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:12:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a93fff640 1 --2- 172.21.15.123:0/4064338393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a4318e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c02f510 tx=0x7f1a8c009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bfe1c2bbff7742 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.940+0000 7f1a72ffd640 1 -- 172.21.15.123:0/4064338393 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0042d0 con 0x55ee0a437b70 2024-08-18T22:12:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.941+0000 7f1a72ffd640 1 -- 172.21.15.123:0/4064338393 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f1a8c004b40 con 0x55ee0a437b70 2024-08-18T22:12:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.941+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/4064338393 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a8c036040 con 0x55ee0a437b70 2024-08-18T22:12:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.941+0000 7f1a72ffd640 1 -- 172.21.15.123:0/4064338393 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1a8c004d40 con 0x55ee0a437b70 2024-08-18T22:12:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.941+0000 7f1a9c4b4740 10 client.16386 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.941+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/4064338393 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ee0a4bac60 con 0x55ee0a437b70 2024-08-18T22:12:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.941+0000 7f1a72ffd640 1 -- 172.21.15.123:0/4064338393 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a8c036040 con 0x55ee0a437b70 2024-08-18T22:12:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.941+0000 7f1a72ffd640 1 -- 172.21.15.123:0/4064338393 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f1a8c049040 con 0x55ee0a437b70 2024-08-18T22:12:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.941+0000 7f1a9c4b4740 10 client.16386 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.941+0000 7f1a9c4b4740 10 client.16386 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:12:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.941+0000 7f1a9c4b4740 20 client.16386 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.941+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/4064338393 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a4bb3b0 0x55ee0a4bd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.941+0000 7f1a9c4b4740 4 client.16386 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b9516e05", "release": true, "await": true}] 2024-08-18T22:12:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.941+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/4064338393 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b9516e05", "release": true, "await": true}) -- 0x55ee0a39a6e0 con 0x55ee0a4bb3b0 2024-08-18T22:12:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.941+0000 7f1a937fe640 1 --2- 172.21.15.123:0/4064338393 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a4bb3b0 0x55ee0a4bd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:44.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.942+0000 7f1a72ffd640 10 client.16386 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:44.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:44.942+0000 7f1a937fe640 1 --2- 172.21.15.123:0/4064338393 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a4bb3b0 0x55ee0a4bd7d0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6405a46dccc73efe server_cookie=fbe25fa5a667bb6 in_seq=0 out_seq=0 2024-08-18T22:12:45.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.419+0000 7f1a72ffd640 1 -- 172.21.15.123:0/4064338393 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ee0a39a6e0 con 0x55ee0a4bb3b0 2024-08-18T22:12:45.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.419+0000 7f1a72ffd640 10 client.16386 handle_command_reply: tid=0 2024-08-18T22:12:45.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.419+0000 7f1a9c4b4740 1 client.16386 shutdown 2024-08-18T22:12:45.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.420+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/4064338393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 msgr2=0x55ee0a4318e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:45.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.420+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/4064338393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a4318e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c02f510 tx=0x7f1a8c009880 comp rx=0 tx=0).stop 2024-08-18T22:12:45.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.420+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/4064338393 shutdown_connections 2024-08-18T22:12:45.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.420+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/4064338393 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ee0a4bb3b0 0x55ee0a4bd7d0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.420+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/4064338393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ee0a437b70 0x55ee0a4318e0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.420+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/4064338393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee0a42d2b0 0x55ee0a4313a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.420+0000 7f1a72ffd640 0 client.16386 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.420+0000 7f1a9c4b4740 1 --2- 172.21.15.123:0/4064338393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ee0a42c990 0x55ee0a43ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.420+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/4064338393 >> 172.21.15.123:0/4064338393 conn(0x55ee0a428f20 msgr2=0x55ee0a427860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.420+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/4064338393 shutdown_connections 2024-08-18T22:12:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.420+0000 7f1a9c4b4740 1 -- 172.21.15.123:0/4064338393 wait complete. 2024-08-18T22:12:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.420+0000 7f1a9c4b4740 20 client.16386 trim_cache size 0 max 16384 2024-08-18T22:12:45.422 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:12:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 27, 2024-08-18T22:12:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "leader": 24466, 2024-08-18T22:12:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "set_version": 16, 2024-08-18T22:12:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "sets": { 2024-08-18T22:12:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "b9516e05": { 2024-08-18T22:12:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "version": 16, 2024-08-18T22:12:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "age_ref": 0.0, 2024-08-18T22:12:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:12:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RELEASED", 2024-08-18T22:12:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:12:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:12:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "timeout": 90.0, 2024-08-18T22:12:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "expiration": 150.0, 2024-08-18T22:12:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "members": { 2024-08-18T22:12:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "file:/": { 2024-08-18T22:12:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "excluded": false, 2024-08-18T22:12:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:12:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RELEASED", 2024-08-18T22:12:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:12:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:12:45.424 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:12:45.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.421+0000 7f1a9a0b6640 1 -- 172.21.15.123:0/3734084377 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1a7c0a2b80 msgr2=0x7f1a7c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:45.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.421+0000 7f1a9a0b6640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1a7c0a2b80 0x7f1a7c0a5040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009a60 tx=0x7f1a8c0095c0 comp rx=0 tx=0).stop 2024-08-18T22:12:45.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.421+0000 7f1a9a0b6640 1 -- 172.21.15.123:0/3734084377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a94102ae0 msgr2=0x7f1a94100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:45.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.421+0000 7f1a9a0b6640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a94102ae0 0x7f1a94100740 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800c970 tx=0x7f1a8800ce30 comp rx=0 tx=0).stop 2024-08-18T22:12:45.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.421+0000 7f1a9a0b6640 1 -- 172.21.15.123:0/3734084377 shutdown_connections 2024-08-18T22:12:45.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.421+0000 7f1a9a0b6640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f1a7c0a2b80 0x7f1a7c0a5040 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:45.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.421+0000 7f1a9a0b6640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a94108010 0x7f1a941011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:45.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.421+0000 7f1a9a0b6640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a94103490 0x7f1a94100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:45.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.421+0000 7f1a9a0b6640 1 --2- 172.21.15.123:0/3734084377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a94102ae0 0x7f1a94100740 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:45.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.421+0000 7f1a9a0b6640 1 -- 172.21.15.123:0/3734084377 >> 172.21.15.123:0/3734084377 conn(0x7f1a940fc500 msgr2=0x7f1a941060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:45.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.421+0000 7f1a9a0b6640 1 -- 172.21.15.123:0/3734084377 shutdown_connections 2024-08-18T22:12:45.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:12:45.421+0000 7f1a9a0b6640 1 -- 172.21.15.123:0/3734084377 wait complete. 2024-08-18T22:12:45.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:45 smithi123 ceph-mon[18462]: pgmap v489: 129 pgs: 129 active+clean; 2.2 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 7.8 KiB/s wr, 1.02k op/s 2024-08-18T22:12:45.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:45 smithi130 ceph-mon[21698]: pgmap v489: 129 pgs: 129 active+clean; 2.2 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 7.8 KiB/s wr, 1.02k op/s 2024-08-18T22:12:45.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:45 smithi183 ceph-mon[22097]: pgmap v489: 129 pgs: 129 active+clean; 2.2 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 7.8 KiB/s wr, 1.02k op/s 2024-08-18T22:12:46.168 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b9516e05', total seconds elapsed: 33.8 2024-08-18T22:12:47.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:47 smithi123 ceph-mon[18462]: pgmap v490: 129 pgs: 129 active+clean; 2.2 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 7.8 KiB/s wr, 570 op/s 2024-08-18T22:12:47.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:47 smithi130 ceph-mon[21698]: pgmap v490: 129 pgs: 129 active+clean; 2.2 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 7.8 KiB/s wr, 570 op/s 2024-08-18T22:12:47.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:47 smithi183 ceph-mon[22097]: pgmap v490: 129 pgs: 129 active+clean; 2.2 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 7.8 KiB/s wr, 570 op/s 2024-08-18T22:12:49.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:49 smithi123 ceph-mon[18462]: pgmap v491: 129 pgs: 129 active+clean; 2.2 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 9.6 KiB/s wr, 415 op/s 2024-08-18T22:12:49.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:49 smithi130 ceph-mon[21698]: pgmap v491: 129 pgs: 129 active+clean; 2.2 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 9.6 KiB/s wr, 415 op/s 2024-08-18T22:12:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.812+0000 7f2179cf6640 1 -- 172.21.15.123:0/103381137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2174103440 msgr2=0x7f2174109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.812+0000 7f2179cf6640 1 --2- 172.21.15.123:0/103381137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2174103440 0x7f2174109cd0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f216c009ca0 tx=0x7f216c02a8c0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.812+0000 7f2179cf6640 1 -- 172.21.15.123:0/103381137 shutdown_connections 2024-08-18T22:12:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.812+0000 7f2179cf6640 1 --2- 172.21.15.123:0/103381137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2174103440 0x7f2174109cd0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.812+0000 7f2179cf6640 1 --2- 172.21.15.123:0/103381137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2174102a80 0x7f2174102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.812+0000 7f2179cf6640 1 --2- 172.21.15.123:0/103381137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2174101890 0x7f2174101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.812+0000 7f2179cf6640 1 -- 172.21.15.123:0/103381137 >> 172.21.15.123:0/103381137 conn(0x7f21740fd010 msgr2=0x7f21740ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.812+0000 7f2179cf6640 1 -- 172.21.15.123:0/103381137 shutdown_connections 2024-08-18T22:12:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.812+0000 7f2179cf6640 1 -- 172.21.15.123:0/103381137 wait complete. 2024-08-18T22:12:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2179cf6640 1 Processor -- start 2024-08-18T22:12:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2179cf6640 1 -- start start 2024-08-18T22:12:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2179cf6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2174101890 0x7f2174197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2179cf6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2174102a80 0x7f2174198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2179cf6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2174103440 0x7f217419f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2179cf6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f217410d510 con 0x7f2174103440 2024-08-18T22:12:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2179cf6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f217410d390 con 0x7f2174101890 2024-08-18T22:12:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2179cf6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f217410d690 con 0x7f2174102a80 2024-08-18T22:12:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2173fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2174103440 0x7f217419f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2173fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2174103440 0x7f217419f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39266/0 (socket says 172.21.15.123:39266) 2024-08-18T22:12:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2173fff640 1 -- 172.21.15.123:0/3336646835 learned_addr learned my addr 172.21.15.123:0/3336646835 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2172ffd640 1 --2- 172.21.15.123:0/3336646835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2174102a80 0x7f2174198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f21737fe640 1 --2- 172.21.15.123:0/3336646835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2174101890 0x7f2174197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2173fff640 1 -- 172.21.15.123:0/3336646835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2174102a80 msgr2=0x7f2174198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2173fff640 1 --2- 172.21.15.123:0/3336646835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2174102a80 0x7f2174198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2173fff640 1 -- 172.21.15.123:0/3336646835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2174101890 msgr2=0x7f2174197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2173fff640 1 --2- 172.21.15.123:0/3336646835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2174101890 0x7f2174197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.813+0000 7f2173fff640 1 -- 172.21.15.123:0/3336646835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217419f6f0 con 0x7f2174103440 2024-08-18T22:12:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.814+0000 7f2173fff640 1 --2- 172.21.15.123:0/3336646835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2174103440 0x7f217419f080 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f216c031ae0 tx=0x7f216c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.814+0000 7f2170ff9640 1 -- 172.21.15.123:0/3336646835 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c003c30 con 0x7f2174103440 2024-08-18T22:12:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.814+0000 7f2170ff9640 1 -- 172.21.15.123:0/3336646835 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f216c003dd0 con 0x7f2174103440 2024-08-18T22:12:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.814+0000 7f2170ff9640 1 -- 172.21.15.123:0/3336646835 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c02fcb0 con 0x7f2174103440 2024-08-18T22:12:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.814+0000 7f2179cf6640 1 -- 172.21.15.123:0/3336646835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217419f980 con 0x7f2174103440 2024-08-18T22:12:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.814+0000 7f2179cf6640 1 -- 172.21.15.123:0/3336646835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217419ff20 con 0x7f2174103440 2024-08-18T22:12:49.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.817+0000 7f2170ff9640 1 -- 172.21.15.123:0/3336646835 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f216c0305c0 con 0x7f2174103440 2024-08-18T22:12:49.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.817+0000 7f217caaf740 1 Processor -- start 2024-08-18T22:12:49.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.817+0000 7f217caaf740 1 -- start start 2024-08-18T22:12:49.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f2170ff9640 1 --2- 172.21.15.123:0/3336646835 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f21600a2cb0 0x7f21600a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f217caaf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6823fea90 0x55c6823fee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f217caaf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823ff3d0 0x55c682403e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f217caaf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c682404460 0x55c682406920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f217caaf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c68235d9d0 con 0x55c6823fea90 2024-08-18T22:12:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f217caaf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c682305820 con 0x55c682404460 2024-08-18T22:12:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f217caaf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c682359990 con 0x55c6823ff3d0 2024-08-18T22:12:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f21737fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6823fea90 0x55c6823fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f2172ffd640 1 --2- 172.21.15.123:0/3336646835 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f21600a2cb0 0x7f21600a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f21737fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6823fea90 0x55c6823fee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39278/0 (socket says 172.21.15.123:39278) 2024-08-18T22:12:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f21737fe640 1 -- 172.21.15.123:0/1770455876 learned_addr learned my addr 172.21.15.123:0/1770455876 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f2170ff9640 1 -- 172.21.15.123:0/3336646835 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f216c0f0600 con 0x7f2174103440 2024-08-18T22:12:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f2172ffd640 1 --2- 172.21.15.123:0/1770455876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823ff3d0 0x55c682403e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f2173fff640 1 --2- 172.21.15.123:0/1770455876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c682404460 0x55c682406920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f21737fe640 1 -- 172.21.15.123:0/1770455876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823ff3d0 msgr2=0x55c682403e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f21737fe640 1 --2- 172.21.15.123:0/1770455876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823ff3d0 0x55c682403e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f21737fe640 1 -- 172.21.15.123:0/1770455876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c682404460 msgr2=0x55c682406920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f21737fe640 1 --2- 172.21.15.123:0/1770455876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c682404460 0x55c682406920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f21737fe640 1 -- 172.21.15.123:0/1770455876 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c682071210 con 0x55c6823fea90 2024-08-18T22:12:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f2172ffd640 1 --2- 172.21.15.123:0/3336646835 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f21600a2cb0 0x7f21600a5170 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55c6823ffe00 tx=0x7f2164009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f21737fe640 1 --2- 172.21.15.123:0/1770455876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6823fea90 0x55c6823fee90 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f215c00baa0 tx=0x7f215c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a372480cbb435b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f2169ffb640 1 -- 172.21.15.123:0/1770455876 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c017420 con 0x55c6823fea90 2024-08-18T22:12:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f2169ffb640 1 -- 172.21.15.123:0/1770455876 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f215c017aa0 con 0x55c6823fea90 2024-08-18T22:12:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.818+0000 7f2169ffb640 1 -- 172.21.15.123:0/1770455876 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c00fb00 con 0x55c6823fea90 2024-08-18T22:12:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.819+0000 7f217caaf740 1 -- 172.21.15.123:0/1770455876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6823fea90 msgr2=0x55c6823fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.819+0000 7f217caaf740 1 --2- 172.21.15.123:0/1770455876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6823fea90 0x55c6823fee90 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f215c00baa0 tx=0x7f215c00bf60 comp rx=0 tx=0).stop 2024-08-18T22:12:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.819+0000 7f217caaf740 1 -- 172.21.15.123:0/1770455876 shutdown_connections 2024-08-18T22:12:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.819+0000 7f217caaf740 1 --2- 172.21.15.123:0/1770455876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c682404460 0x55c682406920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.819+0000 7f217caaf740 1 --2- 172.21.15.123:0/1770455876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823ff3d0 0x55c682403e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.819+0000 7f217caaf740 1 --2- 172.21.15.123:0/1770455876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6823fea90 0x55c6823fee90 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.819+0000 7f217caaf740 1 -- 172.21.15.123:0/1770455876 >> 172.21.15.123:0/1770455876 conn(0x55c6823f5cf0 msgr2=0x55c6823f60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.819+0000 7f217caaf740 1 -- 172.21.15.123:0/1770455876 shutdown_connections 2024-08-18T22:12:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.819+0000 7f217caaf740 1 -- 172.21.15.123:0/1770455876 wait complete. 2024-08-18T22:12:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.819+0000 7f217caaf740 1 -- start start 2024-08-18T22:12:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f217caaf740 1 Processor -- start 2024-08-18T22:12:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f217caaf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823fea90 0x55c682408c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f217caaf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823ff3d0 0x55c682409180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f217caaf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c6824101c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f217caaf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c682407430 con 0x55c682404460 2024-08-18T22:12:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f217caaf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c682319520 con 0x55c6823ff3d0 2024-08-18T22:12:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f217caaf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c6824075b0 con 0x55c6823fea90 2024-08-18T22:12:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f217caaf740 10 client.0 _ll_register_callbacks cb 0x55c682070a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f2173fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c6824101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f21737fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823fea90 0x55c682408c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f2173fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c6824101c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39282/0 (socket says 172.21.15.123:39282) 2024-08-18T22:12:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f21737fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823fea90 0x55c682408c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:47774/0 (socket says 172.21.15.123:47774) 2024-08-18T22:12:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f2173fff640 1 -- 172.21.15.123:0/2764437178 learned_addr learned my addr 172.21.15.123:0/2764437178 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f2172ffd640 1 --2- 172.21.15.123:0/2764437178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823ff3d0 0x55c682409180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f2173fff640 1 -- 172.21.15.123:0/2764437178 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823fea90 msgr2=0x55c682408c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f2173fff640 1 --2- 172.21.15.123:0/2764437178 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823fea90 0x55c682408c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f2173fff640 1 -- 172.21.15.123:0/2764437178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823ff3d0 msgr2=0x55c682409180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f2173fff640 1 --2- 172.21.15.123:0/2764437178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823ff3d0 0x55c682409180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f2173fff640 1 -- 172.21.15.123:0/2764437178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c68213d620 con 0x55c682404460 2024-08-18T22:12:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f2173fff640 1 --2- 172.21.15.123:0/2764437178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c6824101c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f216c031a40 tx=0x7f216c0bd290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112acf9bde9d2a5b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.820+0000 7f2152ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.821+0000 7f2152ffd640 1 -- 172.21.15.123:0/2764437178 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0c0e80 con 0x55c682404460 2024-08-18T22:12:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.821+0000 7f2152ffd640 1 -- 172.21.15.123:0/2764437178 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f216c0bab70 con 0x55c682404460 2024-08-18T22:12:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.821+0000 7f217caaf740 1 -- 172.21.15.123:0/2764437178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f215c017aa0 con 0x55c682404460 2024-08-18T22:12:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.821+0000 7f2152ffd640 1 -- 172.21.15.123:0/2764437178 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f216c0d5020 con 0x55c682404460 2024-08-18T22:12:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.821+0000 7f217caaf740 10 client.16398 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.821+0000 7f217caaf740 1 -- 172.21.15.123:0/2764437178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c682407430 con 0x55c682404460 2024-08-18T22:12:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.821+0000 7f2152ffd640 1 -- 172.21.15.123:0/2764437178 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f215c017aa0 con 0x55c682404460 2024-08-18T22:12:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.821+0000 7f2152ffd640 1 -- 172.21.15.123:0/2764437178 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f216c0ab180 con 0x55c682404460 2024-08-18T22:12:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.821+0000 7f217caaf740 10 client.16398 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.821+0000 7f217caaf740 10 client.16398 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.821+0000 7f217caaf740 20 client.16398 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.821+0000 7f217caaf740 1 --2- 172.21.15.123:0/2764437178 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c682414780 0x55c682416c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.821+0000 7f217caaf740 4 client.16398 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:12:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.821+0000 7f217caaf740 1 -- 172.21.15.123:0/2764437178 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c68236b100 con 0x55c682414780 2024-08-18T22:12:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.821+0000 7f21737fe640 1 --2- 172.21.15.123:0/2764437178 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c682414780 0x55c682416c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.822+0000 7f2152ffd640 10 client.16398 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.822+0000 7f21737fe640 1 --2- 172.21.15.123:0/2764437178 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c682414780 0x55c682416c00 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5060dbad4c6aa1b3 server_cookie=6c050958cd3eb420 in_seq=0 out_seq=0 2024-08-18T22:12:49.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.823+0000 7f2152ffd640 1 -- 172.21.15.123:0/2764437178 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c68236b100 con 0x55c682414780 2024-08-18T22:12:49.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.823+0000 7f2152ffd640 10 client.16398 handle_command_reply: tid=0 2024-08-18T22:12:49.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.823+0000 7f217caaf740 1 client.16398 shutdown 2024-08-18T22:12:49.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.824+0000 7f217caaf740 1 -- 172.21.15.123:0/2764437178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 msgr2=0x55c6824101c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:49.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.824+0000 7f217caaf740 1 --2- 172.21.15.123:0/2764437178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c6824101c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f216c031a40 tx=0x7f216c0bd290 comp rx=0 tx=0).stop 2024-08-18T22:12:49.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.824+0000 7f217caaf740 1 -- 172.21.15.123:0/2764437178 shutdown_connections 2024-08-18T22:12:49.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.824+0000 7f217caaf740 1 --2- 172.21.15.123:0/2764437178 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c682414780 0x55c682416c00 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.824+0000 7f217caaf740 1 --2- 172.21.15.123:0/2764437178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c6824101c0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.824+0000 7f217caaf740 1 --2- 172.21.15.123:0/2764437178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823ff3d0 0x55c682409180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.824+0000 7f2152ffd640 0 client.16398 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:49.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.824+0000 7f217caaf740 1 --2- 172.21.15.123:0/2764437178 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823fea90 0x55c682408c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.824+0000 7f217caaf740 1 -- 172.21.15.123:0/2764437178 >> 172.21.15.123:0/2764437178 conn(0x55c6823f5cf0 msgr2=0x55c6823f7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:49.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.824+0000 7f217caaf740 1 -- 172.21.15.123:0/2764437178 shutdown_connections 2024-08-18T22:12:49.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.824+0000 7f217caaf740 1 -- 172.21.15.123:0/2764437178 wait complete. 2024-08-18T22:12:49.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.824+0000 7f217caaf740 20 client.16398 trim_cache size 0 max 16384 2024-08-18T22:12:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.839+0000 7f217caaf740 1 Processor -- start 2024-08-18T22:12:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.839+0000 7f217caaf740 1 -- start start 2024-08-18T22:12:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.839+0000 7f217caaf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823fea90 0x55c6823f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.839+0000 7f217caaf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823ff3d0 0x55c682410180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f217caaf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c6823f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f217caaf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f21741aaaa0 con 0x55c682404460 2024-08-18T22:12:49.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f217caaf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f21741a8370 con 0x55c6823fea90 2024-08-18T22:12:49.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f217caaf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f21741a61c0 con 0x55c6823ff3d0 2024-08-18T22:12:49.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f2173fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c6823f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f2172ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823ff3d0 0x55c682410180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f2173fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c6823f70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39286/0 (socket says 172.21.15.123:39286) 2024-08-18T22:12:49.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f2173fff640 1 -- 172.21.15.123:0/2655446409 learned_addr learned my addr 172.21.15.123:0/2655446409 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:49.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f21737fe640 1 --2- 172.21.15.123:0/2655446409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823fea90 0x55c6823f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f2173fff640 1 -- 172.21.15.123:0/2655446409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823ff3d0 msgr2=0x55c682410180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f2173fff640 1 --2- 172.21.15.123:0/2655446409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823ff3d0 0x55c682410180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f2173fff640 1 -- 172.21.15.123:0/2655446409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823fea90 msgr2=0x55c6823f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f2173fff640 1 --2- 172.21.15.123:0/2655446409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823fea90 0x55c6823f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f2173fff640 1 -- 172.21.15.123:0/2655446409 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6823ffc20 con 0x55c682404460 2024-08-18T22:12:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f21737fe640 1 --2- 172.21.15.123:0/2655446409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823fea90 0x55c6823f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:12:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f2173fff640 1 --2- 172.21.15.123:0/2655446409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c6823f70e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f216c0b8f30 tx=0x7f216c005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ecb082cabe7665 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f21697fa640 1 -- 172.21.15.123:0/2655446409 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0b92c0 con 0x55c682404460 2024-08-18T22:12:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f21697fa640 1 -- 172.21.15.123:0/2655446409 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f216c036040 con 0x55c682404460 2024-08-18T22:12:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.840+0000 7f21697fa640 1 -- 172.21.15.123:0/2655446409 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0bac00 con 0x55c682404460 2024-08-18T22:12:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.841+0000 7f217caaf740 1 -- 172.21.15.123:0/2655446409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 msgr2=0x55c6823f70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.841+0000 7f217caaf740 1 --2- 172.21.15.123:0/2655446409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c6823f70e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f216c0b8f30 tx=0x7f216c005c30 comp rx=0 tx=0).stop 2024-08-18T22:12:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.841+0000 7f217caaf740 1 -- 172.21.15.123:0/2655446409 shutdown_connections 2024-08-18T22:12:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.841+0000 7f217caaf740 1 --2- 172.21.15.123:0/2655446409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c6823f70e0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.841+0000 7f217caaf740 1 --2- 172.21.15.123:0/2655446409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823ff3d0 0x55c682410180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.841+0000 7f217caaf740 1 --2- 172.21.15.123:0/2655446409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823fea90 0x55c6823f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.841+0000 7f217caaf740 1 -- 172.21.15.123:0/2655446409 >> 172.21.15.123:0/2655446409 conn(0x55c6823f5cf0 msgr2=0x55c682408c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.841+0000 7f217caaf740 1 -- 172.21.15.123:0/2655446409 shutdown_connections 2024-08-18T22:12:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.841+0000 7f217caaf740 1 -- 172.21.15.123:0/2655446409 wait complete. 2024-08-18T22:12:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.841+0000 7f217caaf740 1 -- start start 2024-08-18T22:12:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.841+0000 7f217caaf740 1 Processor -- start 2024-08-18T22:12:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f217caaf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823fea90 0x55c68240d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f217caaf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823ff3d0 0x55c68240d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f217caaf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c68240e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f217caaf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f21741a6830 con 0x55c682404460 2024-08-18T22:12:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f217caaf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f21741a7ca0 con 0x55c6823ff3d0 2024-08-18T22:12:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f217caaf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f21741a6f00 con 0x55c6823fea90 2024-08-18T22:12:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f217caaf740 10 client.0 _ll_register_callbacks cb 0x7f216c009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:12:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f21737fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823fea90 0x55c68240d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f2173fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c68240e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f21737fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823fea90 0x55c68240d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:47782/0 (socket says 172.21.15.123:47782) 2024-08-18T22:12:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f21737fe640 1 -- 172.21.15.123:0/4006376577 learned_addr learned my addr 172.21.15.123:0/4006376577 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:12:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f2173fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c68240e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39290/0 (socket says 172.21.15.123:39290) 2024-08-18T22:12:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f2172ffd640 1 --2- 172.21.15.123:0/4006376577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823ff3d0 0x55c68240d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f2173fff640 1 -- 172.21.15.123:0/4006376577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823fea90 msgr2=0x55c68240d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f2173fff640 1 --2- 172.21.15.123:0/4006376577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823fea90 0x55c68240d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f2173fff640 1 -- 172.21.15.123:0/4006376577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823ff3d0 msgr2=0x55c68240d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:12:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f2173fff640 1 --2- 172.21.15.123:0/4006376577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823ff3d0 0x55c68240d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f2173fff640 1 -- 172.21.15.123:0/4006376577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c68240ef10 con 0x55c682404460 2024-08-18T22:12:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f2172ffd640 1 --2- 172.21.15.123:0/4006376577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823ff3d0 0x55c68240d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:12:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f21737fe640 1 --2- 172.21.15.123:0/4006376577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823fea90 0x55c68240d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:12:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f2173fff640 1 --2- 172.21.15.123:0/4006376577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c68240e900 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f216c0bca60 tx=0x7f216c0bc430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53482209fc7fc23 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:12:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f2152ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:12:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f2152ffd640 1 -- 172.21.15.123:0/4006376577 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0c0e80 con 0x55c682404460 2024-08-18T22:12:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f2152ffd640 1 -- 172.21.15.123:0/4006376577 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f216c0db2b0 con 0x55c682404460 2024-08-18T22:12:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f217caaf740 1 -- 172.21.15.123:0/4006376577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f216c036040 con 0x55c682404460 2024-08-18T22:12:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f2152ffd640 1 -- 172.21.15.123:0/4006376577 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f216c0babe0 con 0x55c682404460 2024-08-18T22:12:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f217caaf740 10 client.16404 fetch_fsmap learned FSMap version 27 2024-08-18T22:12:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.842+0000 7f217caaf740 1 -- 172.21.15.123:0/4006376577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c68240ef10 con 0x55c682404460 2024-08-18T22:12:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.843+0000 7f2152ffd640 1 -- 172.21.15.123:0/4006376577 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f216c036040 con 0x55c682404460 2024-08-18T22:12:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.843+0000 7f2152ffd640 1 -- 172.21.15.123:0/4006376577 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f216c0bbf20 con 0x55c682404460 2024-08-18T22:12:49.851 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.843+0000 7f217caaf740 10 client.16404 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:12:49.851 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.843+0000 7f217caaf740 10 client.16404 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:12:49.851 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.843+0000 7f217caaf740 20 client.16404 populate_metadata read hostname 'smithi123' 2024-08-18T22:12:49.851 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.843+0000 7f217caaf740 1 --2- 172.21.15.123:0/4006376577 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c68247f680 0x55c682481aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:12:49.851 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.843+0000 7f217caaf740 4 client.16404 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:12:49.851 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.843+0000 7f217caaf740 1 -- 172.21.15.123:0/4006376577 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c682365450 con 0x55c68247f680 2024-08-18T22:12:49.851 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.843+0000 7f21737fe640 1 --2- 172.21.15.123:0/4006376577 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c68247f680 0x55c682481aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:12:49.851 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.843+0000 7f21737fe640 1 --2- 172.21.15.123:0/4006376577 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c68247f680 0x55c682481aa0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b07592122bbe3165 server_cookie=9439da3473645443 in_seq=0 out_seq=0 2024-08-18T22:12:49.851 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:49.843+0000 7f2152ffd640 10 client.16404 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:49.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:49 smithi183 ceph-mon[22097]: pgmap v491: 129 pgs: 129 active+clean; 2.2 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 9.6 KiB/s wr, 415 op/s 2024-08-18T22:12:51.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:51 smithi123 ceph-mon[18462]: pgmap v492: 129 pgs: 129 active+clean; 4.6 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 211 KiB/s wr, 93 op/s 2024-08-18T22:12:51.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:51 smithi130 ceph-mon[21698]: pgmap v492: 129 pgs: 129 active+clean; 4.6 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 211 KiB/s wr, 93 op/s 2024-08-18T22:12:51.917 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:51 smithi183 ceph-mon[22097]: pgmap v492: 129 pgs: 129 active+clean; 4.6 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 211 KiB/s wr, 93 op/s 2024-08-18T22:12:52.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.171+0000 7f2152ffd640 1 -- 172.21.15.123:0/4006376577 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c682365450 con 0x55c68247f680 2024-08-18T22:12:52.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.171+0000 7f2152ffd640 10 client.16404 handle_command_reply: tid=0 2024-08-18T22:12:52.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.171+0000 7f217caaf740 1 client.16404 shutdown 2024-08-18T22:12:52.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.171+0000 7f217caaf740 1 -- 172.21.15.123:0/4006376577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 msgr2=0x55c68240e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:52.173 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.171+0000 7f217caaf740 1 --2- 172.21.15.123:0/4006376577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c68240e900 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f216c0bca60 tx=0x7f216c0bc430 comp rx=0 tx=0).stop 2024-08-18T22:12:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.172+0000 7f217caaf740 1 -- 172.21.15.123:0/4006376577 shutdown_connections 2024-08-18T22:12:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.172+0000 7f217caaf740 1 --2- 172.21.15.123:0/4006376577 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55c68247f680 0x55c682481aa0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.172+0000 7f217caaf740 1 --2- 172.21.15.123:0/4006376577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c682404460 0x55c68240e900 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.172+0000 7f217caaf740 1 --2- 172.21.15.123:0/4006376577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6823ff3d0 0x55c68240d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.172+0000 7f2152ffd640 0 client.16404 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:12:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.172+0000 7f217caaf740 1 --2- 172.21.15.123:0/4006376577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c6823fea90 0x55c68240d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.172+0000 7f217caaf740 1 -- 172.21.15.123:0/4006376577 >> 172.21.15.123:0/4006376577 conn(0x55c6823f5cf0 msgr2=0x55c6823f4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.172+0000 7f217caaf740 1 -- 172.21.15.123:0/4006376577 shutdown_connections 2024-08-18T22:12:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.172+0000 7f217caaf740 1 -- 172.21.15.123:0/4006376577 wait complete. 2024-08-18T22:12:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.172+0000 7f217caaf740 20 client.16404 trim_cache size 0 max 16384 2024-08-18T22:12:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:12:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:12:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:12:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:12:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.172+0000 7f2179cf6640 1 -- 172.21.15.123:0/3336646835 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f21600a2cb0 msgr2=0x7f21600a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.172+0000 7f2179cf6640 1 --2- 172.21.15.123:0/3336646835 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f21600a2cb0 0x7f21600a5170 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55c6823ffe00 tx=0x7f2164009920 comp rx=0 tx=0).stop 2024-08-18T22:12:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.173+0000 7f2179cf6640 1 -- 172.21.15.123:0/3336646835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2174103440 msgr2=0x7f217419f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:12:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.173+0000 7f2179cf6640 1 --2- 172.21.15.123:0/3336646835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2174103440 0x7f217419f080 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f216c031ae0 tx=0x7f216c031ee0 comp rx=0 tx=0).stop 2024-08-18T22:12:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.173+0000 7f2179cf6640 1 -- 172.21.15.123:0/3336646835 shutdown_connections 2024-08-18T22:12:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.173+0000 7f2179cf6640 1 --2- 172.21.15.123:0/3336646835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2174103440 0x7f217419f080 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.173+0000 7f2179cf6640 1 --2- 172.21.15.123:0/3336646835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2174102a80 0x7f2174198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.173+0000 7f2179cf6640 1 --2- 172.21.15.123:0/3336646835 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f21600a2cb0 0x7f21600a5170 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.173+0000 7f2179cf6640 1 --2- 172.21.15.123:0/3336646835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2174101890 0x7f2174197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:12:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.173+0000 7f2179cf6640 1 -- 172.21.15.123:0/3336646835 >> 172.21.15.123:0/3336646835 conn(0x7f21740fd010 msgr2=0x7f2174105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:12:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.173+0000 7f2179cf6640 1 -- 172.21.15.123:0/3336646835 shutdown_connections 2024-08-18T22:12:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:12:52.173+0000 7f2179cf6640 1 -- 172.21.15.123:0/3336646835 wait complete. 2024-08-18T22:12:52.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:52 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:12:52.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:52 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:12:52.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:52 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:12:52.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:52 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:12:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:52 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:12:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:52 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:12:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:52 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:12:52.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:52 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:12:52.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:52 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:12:52.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:52 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:12:52.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:52 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:12:52.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:52 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:12:53.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:53 smithi123 ceph-mon[18462]: pgmap v493: 129 pgs: 129 active+clean; 10 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 768 KiB/s wr, 155 op/s 2024-08-18T22:12:53.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:53 smithi130 ceph-mon[21698]: pgmap v493: 129 pgs: 129 active+clean; 10 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 768 KiB/s wr, 155 op/s 2024-08-18T22:12:53.809 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:53 smithi183 ceph-mon[22097]: pgmap v493: 129 pgs: 129 active+clean; 10 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 768 KiB/s wr, 155 op/s 2024-08-18T22:12:55.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:55 smithi123 ceph-mon[18462]: pgmap v494: 129 pgs: 129 active+clean; 9.4 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 1.1 MiB/s wr, 808 op/s 2024-08-18T22:12:55.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:55 smithi130 ceph-mon[21698]: pgmap v494: 129 pgs: 129 active+clean; 9.4 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 1.1 MiB/s wr, 808 op/s 2024-08-18T22:12:55.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:55 smithi183 ceph-mon[22097]: pgmap v494: 129 pgs: 129 active+clean; 9.4 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 1.1 MiB/s wr, 808 op/s 2024-08-18T22:12:57.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:57 smithi123 ceph-mon[18462]: pgmap v495: 129 pgs: 129 active+clean; 16 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 1.05k op/s 2024-08-18T22:12:57.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:57 smithi130 ceph-mon[21698]: pgmap v495: 129 pgs: 129 active+clean; 16 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 1.05k op/s 2024-08-18T22:12:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:57 smithi183 ceph-mon[22097]: pgmap v495: 129 pgs: 129 active+clean; 16 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 1.05k op/s 2024-08-18T22:12:59.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:12:59 smithi123 ceph-mon[18462]: pgmap v496: 129 pgs: 129 active+clean; 16 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 1.12k op/s 2024-08-18T22:12:59.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:12:59 smithi130 ceph-mon[21698]: pgmap v496: 129 pgs: 129 active+clean; 16 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 1.12k op/s 2024-08-18T22:12:59.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:12:59 smithi183 ceph-mon[22097]: pgmap v496: 129 pgs: 129 active+clean; 16 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 1.12k op/s 2024-08-18T22:13:01.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:01 smithi123 ceph-mon[18462]: pgmap v497: 129 pgs: 129 active+clean; 21 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 1.12k op/s 2024-08-18T22:13:01.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:01 smithi130 ceph-mon[21698]: pgmap v497: 129 pgs: 129 active+clean; 21 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 1.12k op/s 2024-08-18T22:13:01.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:01 smithi183 ceph-mon[22097]: pgmap v497: 129 pgs: 129 active+clean; 21 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 1.12k op/s 2024-08-18T22:13:03.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:03 smithi123 ceph-mon[18462]: pgmap v498: 129 pgs: 129 active+clean; 27 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 1.13k op/s 2024-08-18T22:13:03.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:03 smithi130 ceph-mon[21698]: pgmap v498: 129 pgs: 129 active+clean; 27 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 1.13k op/s 2024-08-18T22:13:03.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:03 smithi183 ceph-mon[22097]: pgmap v498: 129 pgs: 129 active+clean; 27 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 1.13k op/s 2024-08-18T22:13:04.966 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-18T22:13:05.239 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:13:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.278+0000 7ffbb89e8640 1 -- 172.21.15.123:0/331431928 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac030d30 con 0x7ffbb4100290 2024-08-18T22:13:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.279+0000 7ffbbbc4e640 1 -- 172.21.15.123:0/331431928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbb4100290 msgr2=0x7ffbb4109e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.279+0000 7ffbbbc4e640 1 --2- 172.21.15.123:0/331431928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbb4100290 0x7ffbb4109e40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009cd0 tx=0x7ffbac02a8f0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.279+0000 7ffbbbc4e640 1 -- 172.21.15.123:0/331431928 shutdown_connections 2024-08-18T22:13:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.279+0000 7ffbbbc4e640 1 --2- 172.21.15.123:0/331431928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbb4100290 0x7ffbb4109e40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.279+0000 7ffbbbc4e640 1 --2- 172.21.15.123:0/331431928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbb40ff8d0 0x7ffbb40ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.279+0000 7ffbbbc4e640 1 --2- 172.21.15.123:0/331431928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbb4102e60 0x7ffbb4103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.279+0000 7ffbbbc4e640 1 -- 172.21.15.123:0/331431928 >> 172.21.15.123:0/331431928 conn(0x7ffbb40fb660 msgr2=0x7ffbb40fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.279+0000 7ffbbbc4e640 1 -- 172.21.15.123:0/331431928 shutdown_connections 2024-08-18T22:13:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.279+0000 7ffbbbc4e640 1 -- 172.21.15.123:0/331431928 wait complete. 2024-08-18T22:13:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbbbc4e640 1 Processor -- start 2024-08-18T22:13:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbbbc4e640 1 -- start start 2024-08-18T22:13:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbbbc4e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbb40ff8d0 0x7ffbb419e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbbbc4e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbb4100290 0x7ffbb419e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbbbc4e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbb4102e60 0x7ffbb41a5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbbbc4e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb4113b90 con 0x7ffbb4102e60 2024-08-18T22:13:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbbbc4e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb4113a10 con 0x7ffbb40ff8d0 2024-08-18T22:13:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbbbc4e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb4113d10 con 0x7ffbb4100290 2024-08-18T22:13:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbba1eb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbb4102e60 0x7ffbb41a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbb91e9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbb4100290 0x7ffbb419e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbba1eb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbb4102e60 0x7ffbb41a5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54072/0 (socket says 172.21.15.123:54072) 2024-08-18T22:13:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbb99ea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbb40ff8d0 0x7ffbb419e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbba1eb640 1 -- 172.21.15.123:0/4266095965 learned_addr learned my addr 172.21.15.123:0/4266095965 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbba1eb640 1 -- 172.21.15.123:0/4266095965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbb4100290 msgr2=0x7ffbb419e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbba1eb640 1 --2- 172.21.15.123:0/4266095965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbb4100290 0x7ffbb419e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbba1eb640 1 -- 172.21.15.123:0/4266095965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbb40ff8d0 msgr2=0x7ffbb419e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbba1eb640 1 --2- 172.21.15.123:0/4266095965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbb40ff8d0 0x7ffbb419e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbba1eb640 1 -- 172.21.15.123:0/4266095965 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb41a5d00 con 0x7ffbb4102e60 2024-08-18T22:13:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.280+0000 7ffbb99ea640 1 --2- 172.21.15.123:0/4266095965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbb40ff8d0 0x7ffbb419e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.281+0000 7ffbba1eb640 1 --2- 172.21.15.123:0/4266095965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbb4102e60 0x7ffbb41a5690 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ffbac030f60 tx=0x7ffbac030f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.281+0000 7ffbaaffd640 1 -- 172.21.15.123:0/4266095965 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac004040 con 0x7ffbb4102e60 2024-08-18T22:13:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.281+0000 7ffbaaffd640 1 -- 172.21.15.123:0/4266095965 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbac040070 con 0x7ffbb4102e60 2024-08-18T22:13:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.281+0000 7ffbbbc4e640 1 -- 172.21.15.123:0/4266095965 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb41a5f90 con 0x7ffbb4102e60 2024-08-18T22:13:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.281+0000 7ffbaaffd640 1 -- 172.21.15.123:0/4266095965 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac045c90 con 0x7ffbb4102e60 2024-08-18T22:13:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.281+0000 7ffbbbc4e640 1 -- 172.21.15.123:0/4266095965 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb41a6450 con 0x7ffbb4102e60 2024-08-18T22:13:05.286 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.285+0000 7ffbbea0e740 1 Processor -- start 2024-08-18T22:13:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.286+0000 7ffbaaffd640 1 -- 172.21.15.123:0/4266095965 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7ffbac0041e0 con 0x7ffbb4102e60 2024-08-18T22:13:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.286+0000 7ffbbea0e740 1 -- start start 2024-08-18T22:13:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbbea0e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb358f680 0x55fdb358fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbbea0e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb358ffc0 0x55fdb3594a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbbea0e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb3595050 0x55fdb3597510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbbea0e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55fdb34f29d0 con 0x55fdb358f680 2024-08-18T22:13:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbbea0e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fdb349a820 con 0x55fdb358ffc0 2024-08-18T22:13:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbbea0e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fdb34ee990 con 0x55fdb3595050 2024-08-18T22:13:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbb91e9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb358f680 0x55fdb358fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbb99ea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb358ffc0 0x55fdb3594a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbb91e9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb358f680 0x55fdb358fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54082/0 (socket says 172.21.15.123:54082) 2024-08-18T22:13:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbb91e9640 1 -- 172.21.15.123:0/1052089816 learned_addr learned my addr 172.21.15.123:0/1052089816 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbb91e9640 1 --2- 172.21.15.123:0/1052089816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb3595050 0x55fdb3597510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbb91e9640 1 -- 172.21.15.123:0/1052089816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb3595050 msgr2=0x55fdb3597510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbb91e9640 1 --2- 172.21.15.123:0/1052089816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb3595050 0x55fdb3597510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbb91e9640 1 -- 172.21.15.123:0/1052089816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb358ffc0 msgr2=0x55fdb3594a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbb91e9640 1 --2- 172.21.15.123:0/1052089816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb358ffc0 0x55fdb3594a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbb91e9640 1 -- 172.21.15.123:0/1052089816 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb3206210 con 0x55fdb358f680 2024-08-18T22:13:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.287+0000 7ffbb99ea640 1 --2- 172.21.15.123:0/1052089816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb358ffc0 0x55fdb3594a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.288+0000 7ffbaaffd640 1 --2- 172.21.15.123:0/4266095965 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ffba00a2c30 0x7ffba00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.288+0000 7ffbb91e9640 1 --2- 172.21.15.123:0/1052089816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb358f680 0x55fdb358fa80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffba400c510 tx=0x7ffba4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119ebdd45306f0a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.288+0000 7ffbb99ea640 1 --2- 172.21.15.123:0/4266095965 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ffba00a2c30 0x7ffba00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.288+0000 7ffbaaffd640 1 -- 172.21.15.123:0/4266095965 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ffbac0f0760 con 0x7ffbb4102e60 2024-08-18T22:13:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.288+0000 7ffb9ffff640 1 -- 172.21.15.123:0/1052089816 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba4016040 con 0x55fdb358f680 2024-08-18T22:13:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.288+0000 7ffb9ffff640 1 -- 172.21.15.123:0/1052089816 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffba40035f0 con 0x55fdb358f680 2024-08-18T22:13:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.288+0000 7ffb9ffff640 1 -- 172.21.15.123:0/1052089816 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba401d6c0 con 0x55fdb358f680 2024-08-18T22:13:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.289+0000 7ffbbea0e740 1 -- 172.21.15.123:0/1052089816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb358f680 msgr2=0x55fdb358fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.289+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/1052089816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb358f680 0x55fdb358fa80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffba400c510 tx=0x7ffba4005f90 comp rx=0 tx=0).stop 2024-08-18T22:13:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.289+0000 7ffbb99ea640 1 --2- 172.21.15.123:0/4266095965 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ffba00a2c30 0x7ffba00a50f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009fd0 tx=0x7ffbb0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.289+0000 7ffbbea0e740 1 -- 172.21.15.123:0/1052089816 shutdown_connections 2024-08-18T22:13:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.289+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/1052089816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb3595050 0x55fdb3597510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.289+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/1052089816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb358ffc0 0x55fdb3594a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.289+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/1052089816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb358f680 0x55fdb358fa80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.289+0000 7ffbbea0e740 1 -- 172.21.15.123:0/1052089816 >> 172.21.15.123:0/1052089816 conn(0x55fdb358acf0 msgr2=0x55fdb358b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.289+0000 7ffbbea0e740 1 -- 172.21.15.123:0/1052089816 shutdown_connections 2024-08-18T22:13:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.289+0000 7ffbbea0e740 1 -- 172.21.15.123:0/1052089816 wait complete. 2024-08-18T22:13:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbbea0e740 1 -- start start 2024-08-18T22:13:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbbea0e740 1 Processor -- start 2024-08-18T22:13:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbbea0e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb358ffc0 0x55fdb3599ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbbea0e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb3595050 0x55fdb359a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbbea0e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb359f030 0x55fdb35a1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbbea0e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55fdb3598070 con 0x55fdb359f030 2024-08-18T22:13:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbbea0e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fdb34ae520 con 0x55fdb3595050 2024-08-18T22:13:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbbea0e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fdb35981f0 con 0x55fdb358ffc0 2024-08-18T22:13:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbba1eb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb359f030 0x55fdb35a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbb91e9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb3595050 0x55fdb359a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbbea0e740 10 client.0 _ll_register_callbacks cb 0x55fdb3205a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbba1eb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb359f030 0x55fdb35a1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54096/0 (socket says 172.21.15.123:54096) 2024-08-18T22:13:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbba1eb640 1 -- 172.21.15.123:0/134675991 learned_addr learned my addr 172.21.15.123:0/134675991 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbb99ea640 1 --2- 172.21.15.123:0/134675991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb358ffc0 0x55fdb3599ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbb91e9640 1 -- 172.21.15.123:0/134675991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb358ffc0 msgr2=0x55fdb3599ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbb91e9640 1 --2- 172.21.15.123:0/134675991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb358ffc0 0x55fdb3599ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbb91e9640 1 -- 172.21.15.123:0/134675991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb359f030 msgr2=0x55fdb35a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.290+0000 7ffbb91e9640 1 --2- 172.21.15.123:0/134675991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb359f030 0x55fdb35a1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.291+0000 7ffbb91e9640 1 -- 172.21.15.123:0/134675991 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb32d2620 con 0x55fdb3595050 2024-08-18T22:13:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.291+0000 7ffbba1eb640 1 --2- 172.21.15.123:0/134675991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb359f030 0x55fdb35a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.291+0000 7ffbb91e9640 1 --2- 172.21.15.123:0/134675991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb3595050 0x55fdb359a0e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffba4017000 tx=0x7ffba4005db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4855b77ec5d9f0c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.291+0000 7ffb9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:13:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.291+0000 7ffb9d7fa640 1 -- 172.21.15.123:0/134675991 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba4004210 con 0x55fdb3595050 2024-08-18T22:13:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.291+0000 7ffbbea0e740 1 -- 172.21.15.123:0/134675991 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffba40035f0 con 0x55fdb3595050 2024-08-18T22:13:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.291+0000 7ffb9d7fa640 1 -- 172.21.15.123:0/134675991 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ffba40043b0 con 0x55fdb3595050 2024-08-18T22:13:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.291+0000 7ffb9d7fa640 1 -- 172.21.15.123:0/134675991 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffba402f050 con 0x55fdb3595050 2024-08-18T22:13:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.291+0000 7ffbbea0e740 10 client.25742 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.291+0000 7ffbbea0e740 1 -- 172.21.15.123:0/134675991 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fdb35a4210 con 0x55fdb3595050 2024-08-18T22:13:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.292+0000 7ffb9d7fa640 1 -- 172.21.15.123:0/134675991 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffba40035f0 con 0x55fdb3595050 2024-08-18T22:13:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.292+0000 7ffb9d7fa640 1 -- 172.21.15.123:0/134675991 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ffba4026480 con 0x55fdb3595050 2024-08-18T22:13:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.292+0000 7ffbbea0e740 10 client.25742 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.292+0000 7ffbbea0e740 10 client.25742 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.292+0000 7ffbbea0e740 20 client.25742 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.292+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/134675991 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fdb35a5680 0x55fdb35a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.292+0000 7ffbbea0e740 4 client.25742 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:13:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.292+0000 7ffbbea0e740 1 -- 172.21.15.123:0/134675991 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdb3500100 con 0x55fdb35a5680 2024-08-18T22:13:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.292+0000 7ffbb99ea640 1 --2- 172.21.15.123:0/134675991 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fdb35a5680 0x55fdb35a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.292+0000 7ffb9d7fa640 10 client.25742 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.292+0000 7ffbb99ea640 1 --2- 172.21.15.123:0/134675991 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fdb35a5680 0x55fdb35a7a70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=affb78ea8d93b4fd server_cookie=b1afaffc43d9d7f1 in_seq=0 out_seq=0 2024-08-18T22:13:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.296+0000 7ffb9d7fa640 1 -- 172.21.15.123:0/134675991 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fdb3500100 con 0x55fdb35a5680 2024-08-18T22:13:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.296+0000 7ffb9d7fa640 10 client.25742 handle_command_reply: tid=0 2024-08-18T22:13:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.296+0000 7ffbbea0e740 1 client.25742 shutdown 2024-08-18T22:13:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.296+0000 7ffbbea0e740 1 -- 172.21.15.123:0/134675991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb3595050 msgr2=0x55fdb359a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.296+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/134675991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb3595050 0x55fdb359a0e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffba4017000 tx=0x7ffba4005db0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.296+0000 7ffbbea0e740 1 -- 172.21.15.123:0/134675991 shutdown_connections 2024-08-18T22:13:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.296+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/134675991 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fdb35a5680 0x55fdb35a7a70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.296+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/134675991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb359f030 0x55fdb35a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.296+0000 7ffb9d7fa640 0 client.25742 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.296+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/134675991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb3595050 0x55fdb359a0e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.296+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/134675991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb358ffc0 0x55fdb3599ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.297+0000 7ffbbea0e740 1 -- 172.21.15.123:0/134675991 >> 172.21.15.123:0/134675991 conn(0x55fdb358acf0 msgr2=0x55fdb358c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.297+0000 7ffbbea0e740 1 -- 172.21.15.123:0/134675991 shutdown_connections 2024-08-18T22:13:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.297+0000 7ffbbea0e740 1 -- 172.21.15.123:0/134675991 wait complete. 2024-08-18T22:13:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.297+0000 7ffbbea0e740 20 client.25742 trim_cache size 0 max 16384 2024-08-18T22:13:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbbea0e740 1 Processor -- start 2024-08-18T22:13:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbbea0e740 1 -- start start 2024-08-18T22:13:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbbea0e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb358ffc0 0x55fdb358c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbbea0e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb3595050 0x55fdb35ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbbea0e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb359f030 0x55fdb35ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbbea0e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb41b3290 con 0x55fdb358ffc0 2024-08-18T22:13:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbbea0e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb41b0b60 con 0x55fdb359f030 2024-08-18T22:13:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbbea0e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb41ae9b0 con 0x55fdb3595050 2024-08-18T22:13:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbb99ea640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb358ffc0 0x55fdb358c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbb99ea640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb358ffc0 0x55fdb358c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54112/0 (socket says 172.21.15.123:54112) 2024-08-18T22:13:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbb99ea640 1 -- 172.21.15.123:0/1655801164 learned_addr learned my addr 172.21.15.123:0/1655801164 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbba1eb640 1 --2- 172.21.15.123:0/1655801164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb359f030 0x55fdb35ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbb91e9640 1 --2- 172.21.15.123:0/1655801164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb3595050 0x55fdb35ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbb99ea640 1 -- 172.21.15.123:0/1655801164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb3595050 msgr2=0x55fdb35ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbb99ea640 1 --2- 172.21.15.123:0/1655801164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb3595050 0x55fdb35ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbb99ea640 1 -- 172.21.15.123:0/1655801164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb359f030 msgr2=0x55fdb35ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbb99ea640 1 --2- 172.21.15.123:0/1655801164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb359f030 0x55fdb35ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbb99ea640 1 -- 172.21.15.123:0/1655801164 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb35a7de0 con 0x55fdb358ffc0 2024-08-18T22:13:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.317+0000 7ffbba1eb640 1 --2- 172.21.15.123:0/1655801164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb359f030 0x55fdb35ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.318+0000 7ffbb99ea640 1 --2- 172.21.15.123:0/1655801164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb358ffc0 0x55fdb358c390 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x55fdb358bb70 tx=0x7ffbb001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974e644359f9ecc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.318+0000 7ffb9f7fe640 1 -- 172.21.15.123:0/1655801164 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0005020 con 0x55fdb358ffc0 2024-08-18T22:13:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.318+0000 7ffb9f7fe640 1 -- 172.21.15.123:0/1655801164 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbb00047a0 con 0x55fdb358ffc0 2024-08-18T22:13:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.318+0000 7ffb9f7fe640 1 -- 172.21.15.123:0/1655801164 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb002b680 con 0x55fdb358ffc0 2024-08-18T22:13:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.319+0000 7ffbbea0e740 1 -- 172.21.15.123:0/1655801164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb358ffc0 msgr2=0x55fdb358c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.319+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/1655801164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb358ffc0 0x55fdb358c390 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x55fdb358bb70 tx=0x7ffbb001a000 comp rx=0 tx=0).stop 2024-08-18T22:13:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.319+0000 7ffbbea0e740 1 -- 172.21.15.123:0/1655801164 shutdown_connections 2024-08-18T22:13:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.319+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/1655801164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb359f030 0x55fdb35ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.319+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/1655801164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb3595050 0x55fdb35ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.319+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/1655801164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb358ffc0 0x55fdb358c390 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.319+0000 7ffbbea0e740 1 -- 172.21.15.123:0/1655801164 >> 172.21.15.123:0/1655801164 conn(0x55fdb358acf0 msgr2=0x55fdb358bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.319+0000 7ffbbea0e740 1 -- 172.21.15.123:0/1655801164 shutdown_connections 2024-08-18T22:13:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.319+0000 7ffbbea0e740 1 -- 172.21.15.123:0/1655801164 wait complete. 2024-08-18T22:13:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.319+0000 7ffbbea0e740 1 -- start start 2024-08-18T22:13:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.319+0000 7ffbbea0e740 1 Processor -- start 2024-08-18T22:13:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbbea0e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb358ffc0 0x55fdb35b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbbea0e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb3595050 0x55fdb35b7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbbea0e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb359f030 0x55fdb35b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbbea0e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb41af020 con 0x55fdb359f030 2024-08-18T22:13:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbbea0e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb41b0490 con 0x55fdb3595050 2024-08-18T22:13:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbbea0e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb41af6f0 con 0x55fdb358ffc0 2024-08-18T22:13:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbbea0e740 10 client.0 _ll_register_callbacks cb 0x7ffbb0009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbba1eb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb359f030 0x55fdb35b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbba1eb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb359f030 0x55fdb35b87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54124/0 (socket says 172.21.15.123:54124) 2024-08-18T22:13:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbb91e9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb3595050 0x55fdb35b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbba1eb640 1 -- 172.21.15.123:0/836214722 learned_addr learned my addr 172.21.15.123:0/836214722 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbb99ea640 1 --2- 172.21.15.123:0/836214722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb358ffc0 0x55fdb35b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbb91e9640 1 -- 172.21.15.123:0/836214722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb358ffc0 msgr2=0x55fdb35b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbb91e9640 1 --2- 172.21.15.123:0/836214722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb358ffc0 0x55fdb35b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbb91e9640 1 -- 172.21.15.123:0/836214722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb359f030 msgr2=0x55fdb35b87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbb91e9640 1 --2- 172.21.15.123:0/836214722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb359f030 0x55fdb35b87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbb91e9640 1 -- 172.21.15.123:0/836214722 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb35b8db0 con 0x55fdb3595050 2024-08-18T22:13:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbba1eb640 1 --2- 172.21.15.123:0/836214722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb359f030 0x55fdb35b87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffbb91e9640 1 --2- 172.21.15.123:0/836214722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb3595050 0x55fdb35b7790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffba40059f0 tx=0x7ffba4003730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76e1e51b758b0ea3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.320+0000 7ffb9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:13:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.321+0000 7ffb9d7fa640 1 -- 172.21.15.123:0/836214722 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba402c040 con 0x55fdb3595050 2024-08-18T22:13:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.321+0000 7ffb9d7fa640 1 -- 172.21.15.123:0/836214722 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ffba400d3f0 con 0x55fdb3595050 2024-08-18T22:13:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.321+0000 7ffbbea0e740 1 -- 172.21.15.123:0/836214722 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbb00047a0 con 0x55fdb3595050 2024-08-18T22:13:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.321+0000 7ffb9d7fa640 1 -- 172.21.15.123:0/836214722 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffba4043050 con 0x55fdb3595050 2024-08-18T22:13:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.321+0000 7ffbbea0e740 10 client.25748 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.321+0000 7ffbbea0e740 1 -- 172.21.15.123:0/836214722 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fdb3610370 con 0x55fdb3595050 2024-08-18T22:13:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.321+0000 7ffb9d7fa640 1 -- 172.21.15.123:0/836214722 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbb00047a0 con 0x55fdb3595050 2024-08-18T22:13:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.321+0000 7ffb9d7fa640 1 -- 172.21.15.123:0/836214722 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ffba401d460 con 0x55fdb3595050 2024-08-18T22:13:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.321+0000 7ffbbea0e740 10 client.25748 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.321+0000 7ffbbea0e740 10 client.25748 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.321+0000 7ffbbea0e740 20 client.25748 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.321+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/836214722 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fdb3610db0 0x55fdb36131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.321+0000 7ffbbea0e740 4 client.25748 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:13:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.321+0000 7ffbbea0e740 1 -- 172.21.15.123:0/836214722 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fdb34fa450 con 0x55fdb3610db0 2024-08-18T22:13:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.322+0000 7ffbb99ea640 1 --2- 172.21.15.123:0/836214722 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fdb3610db0 0x55fdb36131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.322+0000 7ffbb99ea640 1 --2- 172.21.15.123:0/836214722 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fdb3610db0 0x55fdb36131d0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=158866e1061337c7 server_cookie=6ecac38948ad9c23 in_seq=0 out_seq=0 2024-08-18T22:13:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:05.322+0000 7ffb9d7fa640 10 client.25748 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:05.642 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:05 smithi123 ceph-mon[18462]: pgmap v499: 129 pgs: 129 active+clean; 37 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 1.02k op/s 2024-08-18T22:13:05.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:05 smithi130 ceph-mon[21698]: pgmap v499: 129 pgs: 129 active+clean; 37 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 1.02k op/s 2024-08-18T22:13:05.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.774+0000 7f617f107640 1 -- 172.21.15.123:0/446549417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f617810d260 msgr2=0x7f6178114de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:05.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.774+0000 7f617f107640 1 --2- 172.21.15.123:0/446549417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f617810d260 0x7f6178114de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6170009be0 tx=0x7f617002a710 comp rx=0 tx=0).stop 2024-08-18T22:13:05.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.775+0000 7f617f107640 1 -- 172.21.15.123:0/446549417 shutdown_connections 2024-08-18T22:13:05.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.775+0000 7f617f107640 1 --2- 172.21.15.123:0/446549417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f617810d260 0x7f6178114de0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.775+0000 7f617f107640 1 --2- 172.21.15.123:0/446549417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6178108b30 0x7f617810cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.775+0000 7f617f107640 1 --2- 172.21.15.123:0/446549417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6178108180 0x7f6178108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.775+0000 7f617f107640 1 -- 172.21.15.123:0/446549417 >> 172.21.15.123:0/446549417 conn(0x7f61780778d0 msgr2=0x7f6178079cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:05.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.779+0000 7f617f107640 1 -- 172.21.15.123:0/446549417 shutdown_connections 2024-08-18T22:13:05.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.781+0000 7f617f107640 1 -- 172.21.15.123:0/446549417 wait complete. 2024-08-18T22:13:05.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.782+0000 7f617f107640 1 Processor -- start 2024-08-18T22:13:05.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.783+0000 7f617f107640 1 -- start start 2024-08-18T22:13:05.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.783+0000 7f617f107640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6178108180 0x7f617806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.783+0000 7f617f107640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6178108b30 0x7f617806dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.783+0000 7f617f107640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f617810d260 0x7f6178071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.784+0000 7f617f107640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f617806bf50 con 0x7f617810d260 2024-08-18T22:13:05.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.784+0000 7f617f107640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f617806bdd0 con 0x7f6178108180 2024-08-18T22:13:05.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.784+0000 7f6177fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6178108b30 0x7f617806dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.784+0000 7f6177fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6178108b30 0x7f617806dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:32904/0 (socket says 172.21.15.123:32904) 2024-08-18T22:13:05.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.784+0000 7f6177fff640 1 -- 172.21.15.123:0/1137768490 learned_addr learned my addr 172.21.15.123:0/1137768490 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:05.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.784+0000 7f617f107640 1 -- 172.21.15.123:0/1137768490 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f617806c0d0 con 0x7f6178108b30 2024-08-18T22:13:05.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.784+0000 7f617d6a4640 1 --2- 172.21.15.123:0/1137768490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f617810d260 0x7f6178071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.784+0000 7f6177fff640 1 -- 172.21.15.123:0/1137768490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6178108180 msgr2=0x7f617806d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:05.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.784+0000 7f6177fff640 1 --2- 172.21.15.123:0/1137768490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6178108180 0x7f617806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.784+0000 7f6177fff640 1 -- 172.21.15.123:0/1137768490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f617810d260 msgr2=0x7f6178071fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:05.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.784+0000 7f6177fff640 1 --2- 172.21.15.123:0/1137768490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f617810d260 0x7f6178071fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.784+0000 7f6177fff640 1 -- 172.21.15.123:0/1137768490 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61780726e0 con 0x7f6178108b30 2024-08-18T22:13:05.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.784+0000 7f6177fff640 1 --2- 172.21.15.123:0/1137768490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6178108b30 0x7f617806dbc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f616400e9f0 tx=0x7f616400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:05.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.785+0000 7f6175ffb640 1 -- 172.21.15.123:0/1137768490 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616400cd80 con 0x7f6178108b30 2024-08-18T22:13:05.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.785+0000 7f617f107640 1 -- 172.21.15.123:0/1137768490 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6178072910 con 0x7f6178108b30 2024-08-18T22:13:05.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.785+0000 7f617f107640 1 -- 172.21.15.123:0/1137768490 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61780808e0 con 0x7f6178108b30 2024-08-18T22:13:05.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.785+0000 7f6175ffb640 1 -- 172.21.15.123:0/1137768490 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6164010910 con 0x7f6178108b30 2024-08-18T22:13:05.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.786+0000 7f6175ffb640 1 -- 172.21.15.123:0/1137768490 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6164018950 con 0x7f6178108b30 2024-08-18T22:13:05.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.791+0000 7f6175ffb640 1 -- 172.21.15.123:0/1137768490 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f6164010430 con 0x7f6178108b30 2024-08-18T22:13:05.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.793+0000 7f6175ffb640 1 --2- 172.21.15.123:0/1137768490 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f61680c4c10 0x7f61680c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.793+0000 7f6175ffb640 1 -- 172.21.15.123:0/1137768490 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f61640cf7c0 con 0x7f6178108b30 2024-08-18T22:13:05.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.796+0000 7f617cea3640 1 --2- 172.21.15.123:0/1137768490 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f61680c4c10 0x7f61680c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.796+0000 7f6181505740 1 Processor -- start 2024-08-18T22:13:05.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.796+0000 7f6181505740 1 -- start start 2024-08-18T22:13:05.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.797+0000 7f6181505740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe7204210 0x55afe72045f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.797+0000 7f6181505740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 0x55afe720eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.797+0000 7f6181505740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe720f3f0 0x55afe72117e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.797+0000 7f6177fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 0x55afe720eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.797+0000 7f6177fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 0x55afe720eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:32908/0 (socket says 172.21.15.123:32908) 2024-08-18T22:13:05.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.798+0000 7f6177fff640 1 -- 172.21.15.123:0/67931130 learned_addr learned my addr 172.21.15.123:0/67931130 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:05.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.798+0000 7f6181505740 1 -- 172.21.15.123:0/67931130 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55afe7169980 con 0x55afe7204210 2024-08-18T22:13:05.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.798+0000 7f6181505740 1 -- 172.21.15.123:0/67931130 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55afe7101a70 con 0x55afe720f3f0 2024-08-18T22:13:05.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.798+0000 7f6181505740 1 -- 172.21.15.123:0/67931130 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55afe7165940 con 0x55afe7204b30 2024-08-18T22:13:05.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.801+0000 7f617d6a4640 1 --2- 172.21.15.123:0/67931130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe720f3f0 0x55afe72117e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.802+0000 7f617cea3640 1 --2- 172.21.15.123:0/67931130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe7204210 0x55afe72045f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.803+0000 7f617cea3640 1 --2- 172.21.15.123:0/1137768490 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f61680c4c10 0x7f61680c70d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f616c0058c0 tx=0x7f616c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:05.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.804+0000 7f617cea3640 1 -- 172.21.15.123:0/67931130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 msgr2=0x55afe720eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.804+0000 7f617cea3640 1 --2- 172.21.15.123:0/67931130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 0x55afe720eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.804+0000 7f617cea3640 1 -- 172.21.15.123:0/67931130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe720f3f0 msgr2=0x55afe72117e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.804+0000 7f617cea3640 1 --2- 172.21.15.123:0/67931130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe720f3f0 0x55afe72117e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.804+0000 7f617cea3640 1 -- 172.21.15.123:0/67931130 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afe71646e0 con 0x55afe7204210 2024-08-18T22:13:05.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.811+0000 7f617cea3640 1 --2- 172.21.15.123:0/67931130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe7204210 0x55afe72045f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f616c005fd0 tx=0x7f616c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c860da9d7bf56a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:05.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.815+0000 7f6162ffd640 1 -- 172.21.15.123:0/67931130 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c024430 con 0x55afe7204210 2024-08-18T22:13:05.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.815+0000 7f6162ffd640 1 -- 172.21.15.123:0/67931130 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f616c01b910 con 0x55afe7204210 2024-08-18T22:13:05.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.816+0000 7f6181505740 1 -- 172.21.15.123:0/67931130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe7204210 msgr2=0x55afe72045f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:05.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.816+0000 7f6181505740 1 --2- 172.21.15.123:0/67931130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe7204210 0x55afe72045f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f616c005fd0 tx=0x7f616c019000 comp rx=0 tx=0).stop 2024-08-18T22:13:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.819+0000 7f6181505740 1 -- 172.21.15.123:0/67931130 shutdown_connections 2024-08-18T22:13:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.819+0000 7f6181505740 1 --2- 172.21.15.123:0/67931130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe720f3f0 0x55afe72117e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.819+0000 7f6181505740 1 --2- 172.21.15.123:0/67931130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 0x55afe720eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.819+0000 7f6181505740 1 --2- 172.21.15.123:0/67931130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe7204210 0x55afe72045f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.819+0000 7f6181505740 1 -- 172.21.15.123:0/67931130 >> 172.21.15.123:0/67931130 conn(0x55afe72007a0 msgr2=0x55afe7200b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:05.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.819+0000 7f6181505740 1 -- 172.21.15.123:0/67931130 shutdown_connections 2024-08-18T22:13:05.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.819+0000 7f6181505740 1 -- 172.21.15.123:0/67931130 wait complete. 2024-08-18T22:13:05.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.820+0000 7f6181505740 1 -- start start 2024-08-18T22:13:05.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.820+0000 7f6181505740 1 Processor -- start 2024-08-18T22:13:05.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.821+0000 7f6181505740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204210 0x55afe720c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.821+0000 7f6181505740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 0x55afe720c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.821+0000 7f617cea3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204210 0x55afe720c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.821+0000 7f617cea3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204210 0x55afe720c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:47332/0 (socket says 172.21.15.123:47332) 2024-08-18T22:13:05.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.822+0000 7f6177fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 0x55afe720c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.822+0000 7f6177fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 0x55afe720c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:32924/0 (socket says 172.21.15.123:32924) 2024-08-18T22:13:05.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.822+0000 7f617cea3640 1 -- 172.21.15.123:0/1749489365 learned_addr learned my addr 172.21.15.123:0/1749489365 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:05.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.822+0000 7f6181505740 1 --2- 172.21.15.123:0/1749489365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 0x55afe720ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.822+0000 7f6181505740 1 -- 172.21.15.123:0/1749489365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55afe7212010 con 0x55afe720f3f0 2024-08-18T22:13:05.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.822+0000 7f6181505740 1 -- 172.21.15.123:0/1749489365 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55afe7124aa0 con 0x55afe7204210 2024-08-18T22:13:05.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.822+0000 7f6181505740 1 -- 172.21.15.123:0/1749489365 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55afe7212190 con 0x55afe7204b30 2024-08-18T22:13:05.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.822+0000 7f6181505740 10 client.0 _ll_register_callbacks cb 0x55afe7113e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:05.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.823+0000 7f6177fff640 1 -- 172.21.15.123:0/1749489365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204210 msgr2=0x55afe720c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.823+0000 7f6177fff640 1 --2- 172.21.15.123:0/1749489365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204210 0x55afe720c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.823+0000 7f6177fff640 1 -- 172.21.15.123:0/1749489365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 msgr2=0x55afe720ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.823+0000 7f6177fff640 1 --2- 172.21.15.123:0/1749489365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 0x55afe720ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.823+0000 7f6177fff640 1 -- 172.21.15.123:0/1749489365 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afe7108650 con 0x55afe7204b30 2024-08-18T22:13:05.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.823+0000 7f6177fff640 1 --2- 172.21.15.123:0/1749489365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 0x55afe720c780 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f61640980f0 tx=0x7f616409bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9b487384f646fa2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:05.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.823+0000 7f6157fff640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-08-18T22:13:05.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.823+0000 7f6181505740 1 -- 172.21.15.123:0/1749489365 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55afe7176ef0 con 0x55afe7204b30 2024-08-18T22:13:05.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.825+0000 7f6157fff640 1 -- 172.21.15.123:0/1749489365 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61640a4670 con 0x55afe7204b30 2024-08-18T22:13:05.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.825+0000 7f6157fff640 1 -- 172.21.15.123:0/1749489365 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f616409b0e0 con 0x55afe7204b30 2024-08-18T22:13:05.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.825+0000 7f6157fff640 1 -- 172.21.15.123:0/1749489365 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f616409b2e0 con 0x55afe7204b30 2024-08-18T22:13:05.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.827+0000 7f6181505740 10 client.25822 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:05.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.828+0000 7f6181505740 1 -- 172.21.15.123:0/1749489365 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55afe6edb3c0 con 0x55afe7204b30 2024-08-18T22:13:05.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.828+0000 7f6157fff640 1 -- 172.21.15.123:0/1749489365 <== mon.1 v2:172.21.15.183:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f61640ba3b0 con 0x55afe7204b30 2024-08-18T22:13:05.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.828+0000 7f6181505740 10 client.25822 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:05.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.828+0000 7f6181505740 10 client.25822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:05.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.829+0000 7f6181505740 20 client.25822 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:05.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.829+0000 7f6181505740 1 --2- 172.21.15.123:0/1749489365 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55afe721edf0 0x55afe7221260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.829+0000 7f6181505740 4 client.25822 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:13:05.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.829+0000 7f6181505740 1 -- 172.21.15.123:0/1749489365 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afe7176ef0 con 0x55afe721edf0 2024-08-18T22:13:05.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.834+0000 7f617cea3640 1 --2- 172.21.15.123:0/1749489365 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55afe721edf0 0x55afe7221260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.848+0000 7f617cea3640 1 --2- 172.21.15.123:0/1749489365 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55afe721edf0 0x55afe7221260 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7933fc4c2323d82f server_cookie=a4de5bd771488919 in_seq=0 out_seq=0 2024-08-18T22:13:05.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.848+0000 7f6157fff640 10 client.25822 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:05.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.852+0000 7f6157fff640 1 -- 172.21.15.123:0/1749489365 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55afe7176ef0 con 0x55afe721edf0 2024-08-18T22:13:05.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.852+0000 7f6157fff640 10 client.25822 handle_command_reply: tid=0 2024-08-18T22:13:05.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.852+0000 7f6181505740 1 client.25822 shutdown 2024-08-18T22:13:05.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.854+0000 7f6181505740 1 -- 172.21.15.123:0/1749489365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 msgr2=0x55afe720c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:05.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.854+0000 7f6181505740 1 --2- 172.21.15.123:0/1749489365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 0x55afe720c780 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f61640980f0 tx=0x7f616409bdd0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.855+0000 7f6181505740 1 -- 172.21.15.123:0/1749489365 shutdown_connections 2024-08-18T22:13:05.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.855+0000 7f6181505740 1 --2- 172.21.15.123:0/1749489365 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55afe721edf0 0x55afe7221260 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.855+0000 7f6181505740 1 --2- 172.21.15.123:0/1749489365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 0x55afe720ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.855+0000 7f6181505740 1 --2- 172.21.15.123:0/1749489365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 0x55afe720c780 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.855+0000 7f6181505740 1 --2- 172.21.15.123:0/1749489365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204210 0x55afe720c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.855+0000 7f6181505740 1 -- 172.21.15.123:0/1749489365 >> 172.21.15.123:0/1749489365 conn(0x55afe72007a0 msgr2=0x55afe71ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:05.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.855+0000 7f6157fff640 0 client.25822 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:05.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.855+0000 7f6181505740 1 -- 172.21.15.123:0/1749489365 shutdown_connections 2024-08-18T22:13:05.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.856+0000 7f6181505740 1 -- 172.21.15.123:0/1749489365 wait complete. 2024-08-18T22:13:05.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.856+0000 7f6181505740 20 client.25822 trim_cache size 0 max 16384 2024-08-18T22:13:05.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.894+0000 7f6181505740 1 Processor -- start 2024-08-18T22:13:05.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.895+0000 7f6181505740 1 -- start start 2024-08-18T22:13:05.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.895+0000 7f6181505740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204210 0x55afe7226b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.895+0000 7f6181505740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 0x55afe72270b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.895+0000 7f6181505740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 0x55afe720c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.895+0000 7f6181505740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f615c012570 con 0x55afe720f3f0 2024-08-18T22:13:05.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.896+0000 7f6181505740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f615c00fe40 con 0x55afe7204210 2024-08-18T22:13:05.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.896+0000 7f6181505740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f615c00dc90 con 0x55afe7204b30 2024-08-18T22:13:05.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.896+0000 7f6177fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 0x55afe72270b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.897+0000 7f617cea3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204210 0x55afe7226b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.897+0000 7f617cea3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204210 0x55afe7226b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:47344/0 (socket says 172.21.15.123:47344) 2024-08-18T22:13:05.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.897+0000 7f617cea3640 1 -- 172.21.15.123:0/1635428780 learned_addr learned my addr 172.21.15.123:0/1635428780 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:05.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.897+0000 7f617d6a4640 1 --2- 172.21.15.123:0/1635428780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 0x55afe720c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.899+0000 7f617cea3640 1 -- 172.21.15.123:0/1635428780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 msgr2=0x55afe72270b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.899+0000 7f617cea3640 1 --2- 172.21.15.123:0/1635428780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 0x55afe72270b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.899+0000 7f617cea3640 1 -- 172.21.15.123:0/1635428780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 msgr2=0x55afe720c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.899+0000 7f617cea3640 1 --2- 172.21.15.123:0/1635428780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 0x55afe720c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.899+0000 7f617cea3640 1 -- 172.21.15.123:0/1635428780 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afe70a9330 con 0x55afe7204210 2024-08-18T22:13:05.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.902+0000 7f617cea3640 1 --2- 172.21.15.123:0/1635428780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204210 0x55afe7226b70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f616c005fd0 tx=0x7f616c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e465eb582ce7cbda server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:05.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.904+0000 7f61627fc640 1 -- 172.21.15.123:0/1635428780 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c023490 con 0x55afe7204210 2024-08-18T22:13:05.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.905+0000 7f61627fc640 1 -- 172.21.15.123:0/1635428780 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f616c032070 con 0x55afe7204210 2024-08-18T22:13:05.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.906+0000 7f6181505740 1 -- 172.21.15.123:0/1635428780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204210 msgr2=0x55afe7226b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:05.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.906+0000 7f6181505740 1 --2- 172.21.15.123:0/1635428780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204210 0x55afe7226b70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f616c005fd0 tx=0x7f616c019000 comp rx=0 tx=0).stop 2024-08-18T22:13:05.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.906+0000 7f6181505740 1 -- 172.21.15.123:0/1635428780 shutdown_connections 2024-08-18T22:13:05.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.906+0000 7f6181505740 1 --2- 172.21.15.123:0/1635428780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 0x55afe720c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.906+0000 7f6181505740 1 --2- 172.21.15.123:0/1635428780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204b30 0x55afe72270b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.906+0000 7f6181505740 1 --2- 172.21.15.123:0/1635428780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204210 0x55afe7226b70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.906+0000 7f6181505740 1 -- 172.21.15.123:0/1635428780 >> 172.21.15.123:0/1635428780 conn(0x55afe72007a0 msgr2=0x55afe720b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:05.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.906+0000 7f6181505740 1 -- 172.21.15.123:0/1635428780 shutdown_connections 2024-08-18T22:13:05.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.906+0000 7f6181505740 1 -- 172.21.15.123:0/1635428780 wait complete. 2024-08-18T22:13:05.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.907+0000 7f6181505740 1 -- start start 2024-08-18T22:13:05.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.907+0000 7f6181505740 1 Processor -- start 2024-08-18T22:13:05.908 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:05 smithi183 ceph-mon[22097]: pgmap v499: 129 pgs: 129 active+clean; 37 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 1.02k op/s 2024-08-18T22:13:05.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.907+0000 7f6181505740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204210 0x55afe7208490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.908+0000 7f6181505740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204b30 0x55afe72089d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.908+0000 7f6181505740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 0x55afe7208f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.908+0000 7f6181505740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f615c00e300 con 0x55afe720f3f0 2024-08-18T22:13:05.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.908+0000 7f6181505740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f615c00f770 con 0x55afe7204b30 2024-08-18T22:13:05.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.908+0000 7f6181505740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f615c00e9d0 con 0x55afe7204210 2024-08-18T22:13:05.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.908+0000 7f6181505740 10 client.0 _ll_register_callbacks cb 0x7f616409c3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:05.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.908+0000 7f617d6a4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 0x55afe7208f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.909+0000 7f617d6a4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 0x55afe7208f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54184/0 (socket says 172.21.15.123:54184) 2024-08-18T22:13:05.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.909+0000 7f617d6a4640 1 -- 172.21.15.123:0/3565801259 learned_addr learned my addr 172.21.15.123:0/3565801259 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:05.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.909+0000 7f6177fff640 1 --2- 172.21.15.123:0/3565801259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204b30 0x55afe72089d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.909+0000 7f617cea3640 1 --2- 172.21.15.123:0/3565801259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204210 0x55afe7208490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.909+0000 7f617d6a4640 1 -- 172.21.15.123:0/3565801259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204210 msgr2=0x55afe7208490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.909+0000 7f617d6a4640 1 --2- 172.21.15.123:0/3565801259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204210 0x55afe7208490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.909+0000 7f617d6a4640 1 -- 172.21.15.123:0/3565801259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204b30 msgr2=0x55afe72089d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:05.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.909+0000 7f617d6a4640 1 --2- 172.21.15.123:0/3565801259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204b30 0x55afe72089d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.909+0000 7f617d6a4640 1 -- 172.21.15.123:0/3565801259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afe7216490 con 0x55afe720f3f0 2024-08-18T22:13:05.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.910+0000 7f617d6a4640 1 --2- 172.21.15.123:0/3565801259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 0x55afe7208f10 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6170009b30 tx=0x7f6170030e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e123c72d63475314 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:05.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.912+0000 7f6157fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:13:05.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.912+0000 7f6157fff640 1 -- 172.21.15.123:0/3565801259 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170036040 con 0x55afe720f3f0 2024-08-18T22:13:05.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.912+0000 7f6181505740 1 -- 172.21.15.123:0/3565801259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f616c032070 con 0x55afe720f3f0 2024-08-18T22:13:05.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.912+0000 7f6157fff640 1 -- 172.21.15.123:0/3565801259 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f61700305b0 con 0x55afe720f3f0 2024-08-18T22:13:05.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.912+0000 7f6157fff640 1 -- 172.21.15.123:0/3565801259 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6170052050 con 0x55afe720f3f0 2024-08-18T22:13:05.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.912+0000 7f6181505740 10 client.16437 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:05.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.912+0000 7f6181505740 1 -- 172.21.15.123:0/3565801259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55afe72177b0 con 0x55afe720f3f0 2024-08-18T22:13:05.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.913+0000 7f6157fff640 1 -- 172.21.15.123:0/3565801259 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f616c032070 con 0x55afe720f3f0 2024-08-18T22:13:05.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.913+0000 7f6157fff640 1 -- 172.21.15.123:0/3565801259 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f617004d030 con 0x55afe720f3f0 2024-08-18T22:13:05.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.913+0000 7f6181505740 10 client.16437 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:05.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.913+0000 7f6181505740 10 client.16437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:05.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.913+0000 7f6181505740 20 client.16437 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:05.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.913+0000 7f6181505740 1 --2- 172.21.15.123:0/3565801259 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55afe7289b40 0x55afe728bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:05.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.913+0000 7f6181505740 4 client.16437 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:13:05.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.913+0000 7f6181505740 1 -- 172.21.15.123:0/3565801259 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55afe7171400 con 0x55afe7289b40 2024-08-18T22:13:05.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.916+0000 7f617cea3640 1 --2- 172.21.15.123:0/3565801259 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55afe7289b40 0x55afe728bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:05.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.917+0000 7f617cea3640 1 --2- 172.21.15.123:0/3565801259 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55afe7289b40 0x55afe728bf30 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50f202e8bd736bfb server_cookie=dcaf3077f074dd8b in_seq=0 out_seq=0 2024-08-18T22:13:05.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.917+0000 7f6157fff640 10 client.16437 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:05.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.918+0000 7f6157fff640 1 -- 172.21.15.123:0/3565801259 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55afe7171400 con 0x55afe7289b40 2024-08-18T22:13:05.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.918+0000 7f6157fff640 10 client.16437 handle_command_reply: tid=0 2024-08-18T22:13:05.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.918+0000 7f6181505740 1 client.16437 shutdown 2024-08-18T22:13:05.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.919+0000 7f6181505740 1 -- 172.21.15.123:0/3565801259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 msgr2=0x55afe7208f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:05.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.919+0000 7f6181505740 1 --2- 172.21.15.123:0/3565801259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 0x55afe7208f10 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6170009b30 tx=0x7f6170030e40 comp rx=0 tx=0).stop 2024-08-18T22:13:05.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.919+0000 7f6181505740 1 -- 172.21.15.123:0/3565801259 shutdown_connections 2024-08-18T22:13:05.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.919+0000 7f6181505740 1 --2- 172.21.15.123:0/3565801259 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55afe7289b40 0x55afe728bf30 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.919+0000 7f6181505740 1 --2- 172.21.15.123:0/3565801259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55afe720f3f0 0x55afe7208f10 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.919+0000 7f6181505740 1 --2- 172.21.15.123:0/3565801259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55afe7204b30 0x55afe72089d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.919+0000 7f6181505740 1 --2- 172.21.15.123:0/3565801259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afe7204210 0x55afe7208490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.919+0000 7f6181505740 1 -- 172.21.15.123:0/3565801259 >> 172.21.15.123:0/3565801259 conn(0x55afe72007a0 msgr2=0x55afe720d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:05.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.919+0000 7f6157fff640 0 client.16437 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:05.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.920+0000 7f6181505740 1 -- 172.21.15.123:0/3565801259 shutdown_connections 2024-08-18T22:13:05.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.924+0000 7f6181505740 1 -- 172.21.15.123:0/3565801259 wait complete. 2024-08-18T22:13:05.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.926+0000 7f6181505740 20 client.16437 trim_cache size 0 max 16384 2024-08-18T22:13:05.927 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:13:05.927 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "no active scrubs running", 2024-08-18T22:13:05.927 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-08-18T22:13:05.927 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:13:05.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.930+0000 7f617f107640 1 -- 172.21.15.123:0/1137768490 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f61680c4c10 msgr2=0x7f61680c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:05.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.930+0000 7f617f107640 1 --2- 172.21.15.123:0/1137768490 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f61680c4c10 0x7f61680c70d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f616c0058c0 tx=0x7f616c005850 comp rx=0 tx=0).stop 2024-08-18T22:13:05.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.930+0000 7f617f107640 1 -- 172.21.15.123:0/1137768490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6178108b30 msgr2=0x7f617806dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:05.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.930+0000 7f617f107640 1 --2- 172.21.15.123:0/1137768490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6178108b30 0x7f617806dbc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f616400e9f0 tx=0x7f616400eeb0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.931+0000 7f617f107640 1 -- 172.21.15.123:0/1137768490 shutdown_connections 2024-08-18T22:13:05.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.931+0000 7f617f107640 1 --2- 172.21.15.123:0/1137768490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f617810d260 0x7f6178071fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.931+0000 7f617f107640 1 --2- 172.21.15.123:0/1137768490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6178108b30 0x7f617806dbc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.931+0000 7f617f107640 1 --2- 172.21.15.123:0/1137768490 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f61680c4c10 0x7f61680c70d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.931+0000 7f617f107640 1 --2- 172.21.15.123:0/1137768490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6178108180 0x7f617806d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:05.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.931+0000 7f617f107640 1 -- 172.21.15.123:0/1137768490 >> 172.21.15.123:0/1137768490 conn(0x7f61780778d0 msgr2=0x7f6178078430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:05.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.931+0000 7f617f107640 1 -- 172.21.15.123:0/1137768490 shutdown_connections 2024-08-18T22:13:05.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:05.931+0000 7f617f107640 1 -- 172.21.15.123:0/1137768490 wait complete. 2024-08-18T22:13:06.780 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-18T22:13:06.781 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:13:07.382 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:13:07.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:07 smithi123 ceph-mon[18462]: pgmap v500: 129 pgs: 129 active+clean; 42 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 389 op/s 2024-08-18T22:13:07.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:07 smithi130 ceph-mon[21698]: pgmap v500: 129 pgs: 129 active+clean; 42 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 389 op/s 2024-08-18T22:13:07.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:07 smithi183 ceph-mon[22097]: pgmap v500: 129 pgs: 129 active+clean; 42 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 389 op/s 2024-08-18T22:13:08.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.088+0000 7f5d998ef640 1 -- 172.21.15.123:0/2983676808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d94102c20 msgr2=0x7f5d9410d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:08.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.088+0000 7f5d998ef640 1 --2- 172.21.15.123:0/2983676808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d94102c20 0x7f5d9410d770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009890 tx=0x7f5d8c02a410 comp rx=0 tx=0).stop 2024-08-18T22:13:08.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.088+0000 7f5d998ef640 1 -- 172.21.15.123:0/2983676808 shutdown_connections 2024-08-18T22:13:08.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.088+0000 7f5d998ef640 1 --2- 172.21.15.123:0/2983676808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d94102c20 0x7f5d9410d770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.088+0000 7f5d998ef640 1 --2- 172.21.15.123:0/2983676808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d941022a0 0x7f5d941026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.088+0000 7f5d998ef640 1 --2- 172.21.15.123:0/2983676808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d94100b50 0x7f5d94100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.088+0000 7f5d998ef640 1 -- 172.21.15.123:0/2983676808 >> 172.21.15.123:0/2983676808 conn(0x7f5d940fc500 msgr2=0x7f5d940fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:08.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.088+0000 7f5d998ef640 1 -- 172.21.15.123:0/2983676808 shutdown_connections 2024-08-18T22:13:08.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.088+0000 7f5d998ef640 1 -- 172.21.15.123:0/2983676808 wait complete. 2024-08-18T22:13:08.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.089+0000 7f5d998ef640 1 Processor -- start 2024-08-18T22:13:08.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.089+0000 7f5d998ef640 1 -- start start 2024-08-18T22:13:08.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.089+0000 7f5d998ef640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d94100b50 0x7f5d94198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:08.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d998ef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d941022a0 0x7f5d941985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:08.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d998ef640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d94102c20 0x7f5d9419c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:08.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d998ef640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5d94110d20 con 0x7f5d941022a0 2024-08-18T22:13:08.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d998ef640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5d94110ba0 con 0x7f5d94100b50 2024-08-18T22:13:08.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d998ef640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5d94110ea0 con 0x7f5d94102c20 2024-08-18T22:13:08.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d92ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d94100b50 0x7f5d94198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:08.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d8a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d941022a0 0x7f5d941985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:08.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d92ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d94100b50 0x7f5d94198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:47376/0 (socket says 172.21.15.123:47376) 2024-08-18T22:13:08.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d92ffd640 1 -- 172.21.15.123:0/694662963 learned_addr learned my addr 172.21.15.123:0/694662963 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:08.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d937fe640 1 --2- 172.21.15.123:0/694662963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d94102c20 0x7f5d9419c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:08.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d8a7fc640 1 -- 172.21.15.123:0/694662963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d94102c20 msgr2=0x7f5d9419c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d8a7fc640 1 --2- 172.21.15.123:0/694662963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d94102c20 0x7f5d9419c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d8a7fc640 1 -- 172.21.15.123:0/694662963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d94100b50 msgr2=0x7f5d94198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d8a7fc640 1 --2- 172.21.15.123:0/694662963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d94100b50 0x7f5d94198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d8a7fc640 1 -- 172.21.15.123:0/694662963 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9419d040 con 0x7f5d941022a0 2024-08-18T22:13:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d92ffd640 1 --2- 172.21.15.123:0/694662963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d94100b50 0x7f5d94198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d8a7fc640 1 --2- 172.21.15.123:0/694662963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d941022a0 0x7f5d941985d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00b3f0 tx=0x7f5d7c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.090+0000 7f5d988ed640 1 -- 172.21.15.123:0/694662963 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c015020 con 0x7f5d941022a0 2024-08-18T22:13:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.091+0000 7f5d998ef640 1 -- 172.21.15.123:0/694662963 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9419d330 con 0x7f5d941022a0 2024-08-18T22:13:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.091+0000 7f5d998ef640 1 -- 172.21.15.123:0/694662963 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d941a4c10 con 0x7f5d941022a0 2024-08-18T22:13:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.091+0000 7f5d988ed640 1 -- 172.21.15.123:0/694662963 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d7c011d10 con 0x7f5d941022a0 2024-08-18T22:13:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.091+0000 7f5d988ed640 1 -- 172.21.15.123:0/694662963 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00f2e0 con 0x7f5d941022a0 2024-08-18T22:13:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.092+0000 7f5d998ef640 1 -- 172.21.15.123:0/694662963 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d74005290 con 0x7f5d941022a0 2024-08-18T22:13:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.094+0000 7f5d988ed640 1 -- 172.21.15.123:0/694662963 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f5d7c018020 con 0x7f5d941022a0 2024-08-18T22:13:08.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.095+0000 7f5d988ed640 1 --2- 172.21.15.123:0/694662963 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5d800a2c00 0x7f5d800a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:08.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.095+0000 7f5d988ed640 1 -- 172.21.15.123:0/694662963 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f5d7c0cf0a0 con 0x7f5d941022a0 2024-08-18T22:13:08.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.095+0000 7f5d92ffd640 1 --2- 172.21.15.123:0/694662963 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5d800a2c00 0x7f5d800a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:08.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.096+0000 7f5d92ffd640 1 --2- 172.21.15.123:0/694662963 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5d800a2c00 0x7f5d800a50c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400e860 tx=0x7f5d84010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:08.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.101+0000 7f5d988ed640 1 -- 172.21.15.123:0/694662963 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5d7c01f020 con 0x7f5d941022a0 2024-08-18T22:13:08.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.395+0000 7f5d998ef640 1 -- 172.21.15.123:0/694662963 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d74005580 con 0x7f5d941022a0 2024-08-18T22:13:08.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.396+0000 7f5d988ed640 1 -- 172.21.15.123:0/694662963 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f5d7c09bc10 con 0x7f5d941022a0 2024-08-18T22:13:08.397 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:13:08.397 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":27,"btime":"2024-08-18T22:11:43:088943+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:11:42.650261+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24448,24458,24466]},"id":1}]} 2024-08-18T22:13:08.397 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 27 2024-08-18T22:13:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.398+0000 7f5d998ef640 1 -- 172.21.15.123:0/694662963 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5d800a2c00 msgr2=0x7f5d800a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.398+0000 7f5d998ef640 1 --2- 172.21.15.123:0/694662963 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5d800a2c00 0x7f5d800a50c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400e860 tx=0x7f5d84010040 comp rx=0 tx=0).stop 2024-08-18T22:13:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.398+0000 7f5d998ef640 1 -- 172.21.15.123:0/694662963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d941022a0 msgr2=0x7f5d941985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.398+0000 7f5d998ef640 1 --2- 172.21.15.123:0/694662963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d941022a0 0x7f5d941985d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00b3f0 tx=0x7f5d7c00b8b0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.398+0000 7f5d998ef640 1 -- 172.21.15.123:0/694662963 shutdown_connections 2024-08-18T22:13:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.398+0000 7f5d998ef640 1 --2- 172.21.15.123:0/694662963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d94102c20 0x7f5d9419c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.398+0000 7f5d998ef640 1 --2- 172.21.15.123:0/694662963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d941022a0 0x7f5d941985d0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.398+0000 7f5d998ef640 1 --2- 172.21.15.123:0/694662963 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5d800a2c00 0x7f5d800a50c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.398+0000 7f5d998ef640 1 --2- 172.21.15.123:0/694662963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d94100b50 0x7f5d94198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.398+0000 7f5d998ef640 1 -- 172.21.15.123:0/694662963 >> 172.21.15.123:0/694662963 conn(0x7f5d940fc500 msgr2=0x7f5d94069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.399+0000 7f5d998ef640 1 -- 172.21.15.123:0/694662963 shutdown_connections 2024-08-18T22:13:08.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:08.399+0000 7f5d998ef640 1 -- 172.21.15.123:0/694662963 wait complete. 2024-08-18T22:13:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.739+0000 7ffb9d7fa640 1 -- 172.21.15.123:0/836214722 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fdb34fa450 con 0x55fdb3610db0 2024-08-18T22:13:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.739+0000 7ffb9d7fa640 10 client.25748 handle_command_reply: tid=0 2024-08-18T22:13:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.739+0000 7ffbbea0e740 1 client.25748 shutdown 2024-08-18T22:13:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.739+0000 7ffbbea0e740 1 -- 172.21.15.123:0/836214722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb3595050 msgr2=0x55fdb35b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.739+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/836214722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb3595050 0x55fdb35b7790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffba40059f0 tx=0x7ffba4003730 comp rx=0 tx=0).stop 2024-08-18T22:13:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.739+0000 7ffbbea0e740 1 -- 172.21.15.123:0/836214722 shutdown_connections 2024-08-18T22:13:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.739+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/836214722 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fdb3610db0 0x55fdb36131d0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.739+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/836214722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fdb359f030 0x55fdb35b87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.739+0000 7ffb9d7fa640 0 client.25748 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.739+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/836214722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fdb3595050 0x55fdb35b7790 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.739+0000 7ffbbea0e740 1 --2- 172.21.15.123:0/836214722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fdb358ffc0 0x55fdb35b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.739+0000 7ffbbea0e740 1 -- 172.21.15.123:0/836214722 >> 172.21.15.123:0/836214722 conn(0x55fdb358acf0 msgr2=0x55fdb3589ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.739+0000 7ffbbea0e740 1 -- 172.21.15.123:0/836214722 shutdown_connections 2024-08-18T22:13:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.739+0000 7ffbbea0e740 1 -- 172.21.15.123:0/836214722 wait complete. 2024-08-18T22:13:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.739+0000 7ffbbea0e740 20 client.25748 trim_cache size 0 max 16384 2024-08-18T22:13:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:13:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:13:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:13:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:13:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.740+0000 7ffbbbc4e640 1 -- 172.21.15.123:0/4266095965 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ffba00a2c30 msgr2=0x7ffba00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.740+0000 7ffbbbc4e640 1 --2- 172.21.15.123:0/4266095965 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ffba00a2c30 0x7ffba00a50f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009fd0 tx=0x7ffbb0005f90 comp rx=0 tx=0).stop 2024-08-18T22:13:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.740+0000 7ffbbbc4e640 1 -- 172.21.15.123:0/4266095965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbb4102e60 msgr2=0x7ffbb41a5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.740+0000 7ffbbbc4e640 1 --2- 172.21.15.123:0/4266095965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbb4102e60 0x7ffbb41a5690 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ffbac030f60 tx=0x7ffbac030f90 comp rx=0 tx=0).stop 2024-08-18T22:13:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.740+0000 7ffbbbc4e640 1 -- 172.21.15.123:0/4266095965 shutdown_connections 2024-08-18T22:13:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.740+0000 7ffbbbc4e640 1 --2- 172.21.15.123:0/4266095965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbb4102e60 0x7ffbb41a5690 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.740+0000 7ffbbbc4e640 1 --2- 172.21.15.123:0/4266095965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbb4100290 0x7ffbb419e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.740+0000 7ffbbbc4e640 1 --2- 172.21.15.123:0/4266095965 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ffba00a2c30 0x7ffba00a50f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.740+0000 7ffbbbc4e640 1 --2- 172.21.15.123:0/4266095965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbb40ff8d0 0x7ffbb419e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.740+0000 7ffbbbc4e640 1 -- 172.21.15.123:0/4266095965 >> 172.21.15.123:0/4266095965 conn(0x7ffbb40fb660 msgr2=0x7ffbb4105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.740+0000 7ffbbbc4e640 1 -- 172.21.15.123:0/4266095965 shutdown_connections 2024-08-18T22:13:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:08.740+0000 7ffbbbc4e640 1 -- 172.21.15.123:0/4266095965 wait complete. 2024-08-18T22:13:08.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:08 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/694662963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:13:08.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:08 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/694662963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:13:08.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:08 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/694662963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:13:09.212 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-18T22:13:09.469 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:09 smithi123 ceph-mon[18462]: pgmap v501: 129 pgs: 129 active+clean; 45 MiB data, 983 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 543 op/s 2024-08-18T22:13:09.488 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:13:09.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:09 smithi130 ceph-mon[21698]: pgmap v501: 129 pgs: 129 active+clean; 45 MiB data, 983 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 543 op/s 2024-08-18T22:13:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:09 smithi183 ceph-mon[22097]: pgmap v501: 129 pgs: 129 active+clean; 45 MiB data, 983 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 543 op/s 2024-08-18T22:13:09.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.986+0000 7f64383e6640 1 -- 172.21.15.123:0/3962803734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6430102c20 msgr2=0x7f643010d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:09.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.986+0000 7f64383e6640 1 --2- 172.21.15.123:0/3962803734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6430102c20 0x7f643010d770 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6428009ca0 tx=0x7f642802a950 comp rx=0 tx=0).stop 2024-08-18T22:13:09.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.986+0000 7f64383e6640 1 -- 172.21.15.123:0/3962803734 shutdown_connections 2024-08-18T22:13:09.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.986+0000 7f64383e6640 1 --2- 172.21.15.123:0/3962803734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6430102c20 0x7f643010d770 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:09.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.986+0000 7f64383e6640 1 --2- 172.21.15.123:0/3962803734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64301022a0 0x7f64301026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:09.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.986+0000 7f64383e6640 1 --2- 172.21.15.123:0/3962803734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6430100b50 0x7f6430100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:09.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.986+0000 7f64383e6640 1 -- 172.21.15.123:0/3962803734 >> 172.21.15.123:0/3962803734 conn(0x7f64300fc500 msgr2=0x7f64300fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:09.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.986+0000 7f64383e6640 1 -- 172.21.15.123:0/3962803734 shutdown_connections 2024-08-18T22:13:09.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.986+0000 7f64383e6640 1 -- 172.21.15.123:0/3962803734 wait complete. 2024-08-18T22:13:09.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.987+0000 7f64383e6640 1 Processor -- start 2024-08-18T22:13:09.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.987+0000 7f64383e6640 1 -- start start 2024-08-18T22:13:09.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.987+0000 7f64383e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6430100b50 0x7f643010e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:09.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.987+0000 7f64383e6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64301022a0 0x7f643010e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:09.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.987+0000 7f64383e6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6430102c20 0x7f643010ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:09.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.987+0000 7f64383e6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6430111dd0 con 0x7f6430100b50 2024-08-18T22:13:09.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.987+0000 7f64383e6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6430111c50 con 0x7f6430102c20 2024-08-18T22:13:09.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.987+0000 7f64383e6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6430111f50 con 0x7f64301022a0 2024-08-18T22:13:09.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.987+0000 7f6436182640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6430100b50 0x7f643010e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:09.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.987+0000 7f6436182640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6430100b50 0x7f643010e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54210/0 (socket says 172.21.15.123:54210) 2024-08-18T22:13:09.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.987+0000 7f6436182640 1 -- 172.21.15.123:0/86840001 learned_addr learned my addr 172.21.15.123:0/86840001 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:09.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.987+0000 7f6435981640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64301022a0 0x7f643010e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:09.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.987+0000 7f6436983640 1 --2- 172.21.15.123:0/86840001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6430102c20 0x7f643010ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:09.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.988+0000 7f6436182640 1 -- 172.21.15.123:0/86840001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64301022a0 msgr2=0x7f643010e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:09.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.988+0000 7f6436182640 1 --2- 172.21.15.123:0/86840001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64301022a0 0x7f643010e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:09.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.988+0000 7f6436182640 1 -- 172.21.15.123:0/86840001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6430102c20 msgr2=0x7f643010ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:09.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.988+0000 7f6436182640 1 --2- 172.21.15.123:0/86840001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6430102c20 0x7f643010ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:09.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.988+0000 7f6436182640 1 -- 172.21.15.123:0/86840001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64301a6650 con 0x7f6430100b50 2024-08-18T22:13:09.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.988+0000 7f6436182640 1 --2- 172.21.15.123:0/86840001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6430100b50 0x7f643010e200 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f642c00e9f0 tx=0x7f642c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:09.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.988+0000 7f64277fe640 1 -- 172.21.15.123:0/86840001 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c00cd80 con 0x7f6430100b50 2024-08-18T22:13:09.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.988+0000 7f64383e6640 1 -- 172.21.15.123:0/86840001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64301a6940 con 0x7f6430100b50 2024-08-18T22:13:09.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.988+0000 7f64277fe640 1 -- 172.21.15.123:0/86840001 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f642c010910 con 0x7f6430100b50 2024-08-18T22:13:09.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.988+0000 7f64277fe640 1 -- 172.21.15.123:0/86840001 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c0188f0 con 0x7f6430100b50 2024-08-18T22:13:09.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.988+0000 7f64383e6640 1 -- 172.21.15.123:0/86840001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64301a6ed0 con 0x7f6430100b50 2024-08-18T22:13:09.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.991+0000 7f64277fe640 1 -- 172.21.15.123:0/86840001 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f642c010ac0 con 0x7f6430100b50 2024-08-18T22:13:09.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.991+0000 7f643a7e4740 1 Processor -- start 2024-08-18T22:13:09.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f643a7e4740 1 -- start start 2024-08-18T22:13:09.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f643a7e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883dfff0 0x5606883e03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:09.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f643a7e4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883e0910 0x5606883eac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:09.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f643a7e4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:09.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f643a7e4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x560688345a40 con 0x5606883eb1d0 2024-08-18T22:13:09.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f643a7e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5606882dd9d0 con 0x5606883dfff0 2024-08-18T22:13:09.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f643a7e4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560688341a00 con 0x5606883e0910 2024-08-18T22:13:09.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f64277fe640 1 --2- 172.21.15.123:0/86840001 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f641c0a2b80 0x7f641c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:09.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f6435981640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:09.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f6435981640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883ed5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54216/0 (socket says 172.21.15.123:54216) 2024-08-18T22:13:09.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f6435981640 1 -- 172.21.15.123:0/2827767452 learned_addr learned my addr 172.21.15.123:0/2827767452 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:09.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f6436182640 1 --2- 172.21.15.123:0/2827767452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883e0910 0x5606883eac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:09.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f6436983640 1 --2- 172.21.15.123:0/2827767452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883dfff0 0x5606883e03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:09.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f64277fe640 1 -- 172.21.15.123:0/86840001 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f642c0cf760 con 0x7f6430100b50 2024-08-18T22:13:09.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f6436983640 1 --2- 172.21.15.123:0/86840001 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f641c0a2b80 0x7f641c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:09.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.992+0000 7f6435981640 1 -- 172.21.15.123:0/2827767452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883e0910 msgr2=0x5606883eac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:09.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.993+0000 7f6435981640 1 --2- 172.21.15.123:0/2827767452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883e0910 0x5606883eac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:09.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.993+0000 7f6435981640 1 -- 172.21.15.123:0/2827767452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883dfff0 msgr2=0x5606883e03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:09.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.993+0000 7f6435981640 1 --2- 172.21.15.123:0/2827767452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883dfff0 0x5606883e03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:09.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.993+0000 7f6435981640 1 -- 172.21.15.123:0/2827767452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606882e4650 con 0x5606883eb1d0 2024-08-18T22:13:09.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.993+0000 7f6436983640 1 --2- 172.21.15.123:0/2827767452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883dfff0 0x5606883e03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:13:10.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.993+0000 7f6435981640 1 --2- 172.21.15.123:0/2827767452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883ed5c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6420009c10 tx=0x7f6420011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d554012da70074c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:10.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.993+0000 7f6436983640 1 --2- 172.21.15.123:0/86840001 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f641c0a2b80 0x7f641c0a5040 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6428009430 tx=0x7f6428005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:10.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.993+0000 7f6424dea640 1 -- 172.21.15.123:0/2827767452 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420004230 con 0x5606883eb1d0 2024-08-18T22:13:10.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.993+0000 7f6424dea640 1 -- 172.21.15.123:0/2827767452 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64200043d0 con 0x5606883eb1d0 2024-08-18T22:13:10.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.993+0000 7f6424dea640 1 -- 172.21.15.123:0/2827767452 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420004e60 con 0x5606883eb1d0 2024-08-18T22:13:10.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.994+0000 7f643a7e4740 1 -- 172.21.15.123:0/2827767452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 msgr2=0x5606883ed5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:10.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.994+0000 7f643a7e4740 1 --2- 172.21.15.123:0/2827767452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883ed5c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6420009c10 tx=0x7f6420011810 comp rx=0 tx=0).stop 2024-08-18T22:13:10.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.994+0000 7f643a7e4740 1 -- 172.21.15.123:0/2827767452 shutdown_connections 2024-08-18T22:13:10.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.994+0000 7f643a7e4740 1 --2- 172.21.15.123:0/2827767452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883ed5c0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.994+0000 7f643a7e4740 1 --2- 172.21.15.123:0/2827767452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883e0910 0x5606883eac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.994+0000 7f643a7e4740 1 --2- 172.21.15.123:0/2827767452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883dfff0 0x5606883e03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.994+0000 7f643a7e4740 1 -- 172.21.15.123:0/2827767452 >> 172.21.15.123:0/2827767452 conn(0x5606883dc580 msgr2=0x5606883dc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:10.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.995+0000 7f643a7e4740 1 -- 172.21.15.123:0/2827767452 shutdown_connections 2024-08-18T22:13:10.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.995+0000 7f643a7e4740 1 -- 172.21.15.123:0/2827767452 wait complete. 2024-08-18T22:13:10.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.995+0000 7f643a7e4740 1 -- start start 2024-08-18T22:13:10.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.995+0000 7f643a7e4740 1 Processor -- start 2024-08-18T22:13:10.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.995+0000 7f643a7e4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883dfff0 0x5606883e80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:10.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.995+0000 7f643a7e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883e0910 0x5606883e8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:10.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.995+0000 7f643a7e4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883e8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:10.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.995+0000 7f643a7e4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5606883edda0 con 0x5606883eb1d0 2024-08-18T22:13:10.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f643a7e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560688300b20 con 0x5606883e0910 2024-08-18T22:13:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f643a7e4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5606883edf20 con 0x5606883dfff0 2024-08-18T22:13:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6436983640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883e8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6435981640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883e0910 0x5606883e8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6436983640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883e8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54218/0 (socket says 172.21.15.123:54218) 2024-08-18T22:13:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f643a7e4740 10 client.0 _ll_register_callbacks cb 0x5606882febb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6436983640 1 -- 172.21.15.123:0/3422711602 learned_addr learned my addr 172.21.15.123:0/3422711602 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6436182640 1 --2- 172.21.15.123:0/3422711602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883dfff0 0x5606883e80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6435981640 1 -- 172.21.15.123:0/3422711602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883dfff0 msgr2=0x5606883e80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6435981640 1 --2- 172.21.15.123:0/3422711602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883dfff0 0x5606883e80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6435981640 1 -- 172.21.15.123:0/3422711602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 msgr2=0x5606883e8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6435981640 1 --2- 172.21.15.123:0/3422711602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883e8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6435981640 1 -- 172.21.15.123:0/3422711602 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606880b73c0 con 0x5606883e0910 2024-08-18T22:13:10.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6436182640 1 --2- 172.21.15.123:0/3422711602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883dfff0 0x5606883e80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6436983640 1 --2- 172.21.15.123:0/3422711602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883e8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6435981640 1 --2- 172.21.15.123:0/3422711602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883e0910 0x5606883e8630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6420000c00 tx=0x7f6420019b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=791ebc053d1aee93 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6419ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:13:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6419ffb640 1 -- 172.21.15.123:0/3422711602 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420028020 con 0x5606883e0910 2024-08-18T22:13:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f6419ffb640 1 -- 172.21.15.123:0/3422711602 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f6420024420 con 0x5606883e0910 2024-08-18T22:13:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.996+0000 7f643a7e4740 1 -- 172.21.15.123:0/3422711602 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64200043d0 con 0x5606883e0910 2024-08-18T22:13:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.997+0000 7f6419ffb640 1 -- 172.21.15.123:0/3422711602 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6420033050 con 0x5606883e0910 2024-08-18T22:13:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.997+0000 7f643a7e4740 10 client.25781 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.997+0000 7f643a7e4740 1 -- 172.21.15.123:0/3422711602 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5606883f99c0 con 0x5606883e0910 2024-08-18T22:13:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.997+0000 7f6419ffb640 1 -- 172.21.15.123:0/3422711602 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64200043d0 con 0x5606883e0910 2024-08-18T22:13:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.997+0000 7f6419ffb640 1 -- 172.21.15.123:0/3422711602 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6420018070 con 0x5606883e0910 2024-08-18T22:13:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.997+0000 7f643a7e4740 10 client.25781 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:10.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.997+0000 7f643a7e4740 10 client.25781 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-18T22:13:10.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.997+0000 7f643a7e4740 20 client.25781 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:10.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.997+0000 7f643a7e4740 1 --2- 172.21.15.123:0/3422711602 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5606883fadd0 0x5606883fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:10.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.997+0000 7f643a7e4740 4 client.25781 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:13:10.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.997+0000 7f643a7e4740 1 -- 172.21.15.123:0/3422711602 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560688352fb0 con 0x5606883fadd0 2024-08-18T22:13:10.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.998+0000 7f6436182640 1 --2- 172.21.15.123:0/3422711602 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5606883fadd0 0x5606883fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:10.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.998+0000 7f6419ffb640 10 client.25781 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:13:10.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:09.998+0000 7f6436182640 1 --2- 172.21.15.123:0/3422711602 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5606883fadd0 0x5606883fd1c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8a6d8847906854b4 server_cookie=373577105165edb in_seq=0 out_seq=0 2024-08-18T22:13:10.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.004+0000 7f6419ffb640 1 -- 172.21.15.123:0/3422711602 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560688352fb0 con 0x5606883fadd0 2024-08-18T22:13:10.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.004+0000 7f6419ffb640 10 client.25781 handle_command_reply: tid=0 2024-08-18T22:13:10.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.005+0000 7f643a7e4740 1 client.25781 shutdown 2024-08-18T22:13:10.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.005+0000 7f643a7e4740 1 -- 172.21.15.123:0/3422711602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883e0910 msgr2=0x5606883e8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:10.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.005+0000 7f643a7e4740 1 --2- 172.21.15.123:0/3422711602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883e0910 0x5606883e8630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6420000c00 tx=0x7f6420019b00 comp rx=0 tx=0).stop 2024-08-18T22:13:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.005+0000 7f643a7e4740 1 -- 172.21.15.123:0/3422711602 shutdown_connections 2024-08-18T22:13:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.005+0000 7f643a7e4740 1 --2- 172.21.15.123:0/3422711602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883e8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.005+0000 7f643a7e4740 1 --2- 172.21.15.123:0/3422711602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883e0910 0x5606883e8630 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.005+0000 7f643a7e4740 1 --2- 172.21.15.123:0/3422711602 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5606883fadd0 0x5606883fd1c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.005+0000 7f643a7e4740 1 --2- 172.21.15.123:0/3422711602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883dfff0 0x5606883e80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.005+0000 7f643a7e4740 1 -- 172.21.15.123:0/3422711602 >> 172.21.15.123:0/3422711602 conn(0x5606883dc580 msgr2=0x5606883e2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.005+0000 7f6419ffb640 0 client.25781 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:13:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.005+0000 7f643a7e4740 1 -- 172.21.15.123:0/3422711602 shutdown_connections 2024-08-18T22:13:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.005+0000 7f643a7e4740 1 -- 172.21.15.123:0/3422711602 wait complete. 2024-08-18T22:13:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.005+0000 7f643a7e4740 20 client.25781 trim_cache size 0 max 16384 2024-08-18T22:13:10.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.022+0000 7f643a7e4740 1 Processor -- start 2024-08-18T22:13:10.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.022+0000 7f643a7e4740 1 -- start start 2024-08-18T22:13:10.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.022+0000 7f643a7e4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883dfff0 0x5606883e9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:10.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.022+0000 7f643a7e4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883e0910 0x5606883e9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:10.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.022+0000 7f643a7e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883eb1d0 0x5606883ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:10.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.022+0000 7f643a7e4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f64301b3560 con 0x5606883e0910 2024-08-18T22:13:10.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f643a7e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64301b0e30 con 0x5606883eb1d0 2024-08-18T22:13:10.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f643a7e4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f64301aec80 con 0x5606883dfff0 2024-08-18T22:13:10.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f6435981640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883e0910 0x5606883e9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:10.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f6435981640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883e0910 0x5606883e9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54226/0 (socket says 172.21.15.123:54226) 2024-08-18T22:13:10.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f6435981640 1 -- 172.21.15.123:0/1691072615 learned_addr learned my addr 172.21.15.123:0/1691072615 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:10.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f6436182640 1 --2- 172.21.15.123:0/1691072615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883dfff0 0x5606883e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:10.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f6436983640 1 --2- 172.21.15.123:0/1691072615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883eb1d0 0x5606883ea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:10.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f6435981640 1 -- 172.21.15.123:0/1691072615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883dfff0 msgr2=0x5606883e9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:10.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f6435981640 1 --2- 172.21.15.123:0/1691072615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883dfff0 0x5606883e9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f6435981640 1 -- 172.21.15.123:0/1691072615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883eb1d0 msgr2=0x5606883ea2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:10.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f6435981640 1 --2- 172.21.15.123:0/1691072615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883eb1d0 0x5606883ea2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f6435981640 1 -- 172.21.15.123:0/1691072615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606883dd210 con 0x5606883e0910 2024-08-18T22:13:10.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f6435981640 1 --2- 172.21.15.123:0/1691072615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883e0910 0x5606883e9d80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6420018360 tx=0x7f64200096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67c38b150ee002f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:10.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f641bfff640 1 -- 172.21.15.123:0/1691072615 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420028050 con 0x5606883e0910 2024-08-18T22:13:10.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f641bfff640 1 -- 172.21.15.123:0/1691072615 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f642001f040 con 0x5606883e0910 2024-08-18T22:13:10.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.023+0000 7f641bfff640 1 -- 172.21.15.123:0/1691072615 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420019b70 con 0x5606883e0910 2024-08-18T22:13:10.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.024+0000 7f643a7e4740 1 -- 172.21.15.123:0/1691072615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883e0910 msgr2=0x5606883e9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:10.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.024+0000 7f643a7e4740 1 --2- 172.21.15.123:0/1691072615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883e0910 0x5606883e9d80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6420018360 tx=0x7f64200096c0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.024+0000 7f643a7e4740 1 -- 172.21.15.123:0/1691072615 shutdown_connections 2024-08-18T22:13:10.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.024+0000 7f643a7e4740 1 --2- 172.21.15.123:0/1691072615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883eb1d0 0x5606883ea2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.024+0000 7f643a7e4740 1 --2- 172.21.15.123:0/1691072615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883e0910 0x5606883e9d80 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.024+0000 7f643a7e4740 1 --2- 172.21.15.123:0/1691072615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883dfff0 0x5606883e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.024+0000 7f643a7e4740 1 -- 172.21.15.123:0/1691072615 >> 172.21.15.123:0/1691072615 conn(0x5606883dc580 msgr2=0x5606883fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:10.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.024+0000 7f643a7e4740 1 -- 172.21.15.123:0/1691072615 shutdown_connections 2024-08-18T22:13:10.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.024+0000 7f643a7e4740 1 -- 172.21.15.123:0/1691072615 wait complete. 2024-08-18T22:13:10.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f643a7e4740 1 -- start start 2024-08-18T22:13:10.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f643a7e4740 1 Processor -- start 2024-08-18T22:13:10.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f643a7e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883dfff0 0x5606883f3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:10.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f643a7e4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883e0910 0x5606883f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:10.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f643a7e4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883e4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:10.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f643a7e4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f64301af2f0 con 0x5606883eb1d0 2024-08-18T22:13:10.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f643a7e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64301b0760 con 0x5606883dfff0 2024-08-18T22:13:10.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f643a7e4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f64301af9c0 con 0x5606883e0910 2024-08-18T22:13:10.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f643a7e4740 10 client.0 _ll_register_callbacks cb 0x7f642c00cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:10.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f6436182640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883dfff0 0x5606883f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:10.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f6436983640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883e4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:10.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f6436182640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883dfff0 0x5606883f3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:47424/0 (socket says 172.21.15.123:47424) 2024-08-18T22:13:10.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f6436182640 1 -- 172.21.15.123:0/1146322209 learned_addr learned my addr 172.21.15.123:0/1146322209 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:10.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f6435981640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883e0910 0x5606883f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:10.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f6436983640 1 -- 172.21.15.123:0/1146322209 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883e0910 msgr2=0x5606883f36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:10.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f6436983640 1 --2- 172.21.15.123:0/1146322209 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883e0910 0x5606883f36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f6436983640 1 -- 172.21.15.123:0/1146322209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883dfff0 msgr2=0x5606883f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:10.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f6436983640 1 --2- 172.21.15.123:0/1146322209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883dfff0 0x5606883f3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f6436983640 1 -- 172.21.15.123:0/1146322209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606883f3cf0 con 0x5606883eb1d0 2024-08-18T22:13:10.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.025+0000 7f6435981640 1 --2- 172.21.15.123:0/1146322209 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883e0910 0x5606883f36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:10.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.026+0000 7f6436983640 1 --2- 172.21.15.123:0/1146322209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883e4360 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6428005cc0 tx=0x7f642802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab6ba265a1431be server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:10.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.026+0000 7f6419ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:13:10.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.026+0000 7f6419ffb640 1 -- 172.21.15.123:0/1146322209 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428034040 con 0x5606883eb1d0 2024-08-18T22:13:10.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.026+0000 7f6419ffb640 1 -- 172.21.15.123:0/1146322209 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f642804b440 con 0x5606883eb1d0 2024-08-18T22:13:10.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.026+0000 7f643a7e4740 1 -- 172.21.15.123:0/1146322209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f642001f040 con 0x5606883eb1d0 2024-08-18T22:13:10.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.026+0000 7f6419ffb640 1 -- 172.21.15.123:0/1146322209 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f642802fec0 con 0x5606883eb1d0 2024-08-18T22:13:10.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.026+0000 7f643a7e4740 10 client.16461 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:10.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.026+0000 7f643a7e4740 1 -- 172.21.15.123:0/1146322209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5606883e5890 con 0x5606883eb1d0 2024-08-18T22:13:10.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.026+0000 7f6419ffb640 1 -- 172.21.15.123:0/1146322209 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f642001f040 con 0x5606883eb1d0 2024-08-18T22:13:10.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.027+0000 7f6419ffb640 1 -- 172.21.15.123:0/1146322209 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6428052020 con 0x5606883eb1d0 2024-08-18T22:13:10.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.027+0000 7f643a7e4740 10 client.16461 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:10.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.027+0000 7f643a7e4740 10 client.16461 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-18T22:13:10.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.027+0000 7f643a7e4740 20 client.16461 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:10.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.027+0000 7f643a7e4740 1 --2- 172.21.15.123:0/1146322209 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x560688464980 0x560688466d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:10.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.027+0000 7f643a7e4740 4 client.16461 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:13:10.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.027+0000 7f643a7e4740 1 -- 172.21.15.123:0/1146322209 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56068834d4c0 con 0x560688464980 2024-08-18T22:13:10.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.027+0000 7f6436182640 1 --2- 172.21.15.123:0/1146322209 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x560688464980 0x560688466d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:10.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.027+0000 7f6419ffb640 10 client.16461 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:13:10.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.027+0000 7f6436182640 1 --2- 172.21.15.123:0/1146322209 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x560688464980 0x560688466d70 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c5ea073af75ca38e server_cookie=4043565808a745f4 in_seq=0 out_seq=0 2024-08-18T22:13:10.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.030+0000 7f6419ffb640 1 -- 172.21.15.123:0/1146322209 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56068834d4c0 con 0x560688464980 2024-08-18T22:13:10.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.030+0000 7f6419ffb640 10 client.16461 handle_command_reply: tid=0 2024-08-18T22:13:10.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.030+0000 7f643a7e4740 1 client.16461 shutdown 2024-08-18T22:13:10.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.031+0000 7f643a7e4740 1 -- 172.21.15.123:0/1146322209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 msgr2=0x5606883e4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:10.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.031+0000 7f643a7e4740 1 --2- 172.21.15.123:0/1146322209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883e4360 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6428005cc0 tx=0x7f642802a950 comp rx=0 tx=0).stop 2024-08-18T22:13:10.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.031+0000 7f643a7e4740 1 -- 172.21.15.123:0/1146322209 shutdown_connections 2024-08-18T22:13:10.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.031+0000 7f643a7e4740 1 --2- 172.21.15.123:0/1146322209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5606883eb1d0 0x5606883e4360 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.031+0000 7f643a7e4740 1 --2- 172.21.15.123:0/1146322209 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x560688464980 0x560688466d70 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.031+0000 7f643a7e4740 1 --2- 172.21.15.123:0/1146322209 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606883e0910 0x5606883f36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.031+0000 7f6419ffb640 0 client.16461 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:13:10.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.031+0000 7f643a7e4740 1 --2- 172.21.15.123:0/1146322209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606883dfff0 0x5606883f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.031+0000 7f643a7e4740 1 -- 172.21.15.123:0/1146322209 >> 172.21.15.123:0/1146322209 conn(0x5606883dc580 msgr2=0x5606883e80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:10.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.031+0000 7f643a7e4740 1 -- 172.21.15.123:0/1146322209 shutdown_connections 2024-08-18T22:13:10.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.031+0000 7f643a7e4740 1 -- 172.21.15.123:0/1146322209 wait complete. 2024-08-18T22:13:10.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.031+0000 7f643a7e4740 20 client.16461 trim_cache size 0 max 16384 2024-08-18T22:13:10.035 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:13:10.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.032+0000 7f64383e6640 1 -- 172.21.15.123:0/86840001 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f641c0a2b80 msgr2=0x7f641c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:10.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.032+0000 7f64383e6640 1 --2- 172.21.15.123:0/86840001 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f641c0a2b80 0x7f641c0a5040 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6428009430 tx=0x7f6428005c50 comp rx=0 tx=0).stop 2024-08-18T22:13:10.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.032+0000 7f64383e6640 1 -- 172.21.15.123:0/86840001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6430100b50 msgr2=0x7f643010e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:10.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.032+0000 7f64383e6640 1 --2- 172.21.15.123:0/86840001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6430100b50 0x7f643010e200 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f642c00e9f0 tx=0x7f642c00eeb0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.032+0000 7f64383e6640 1 -- 172.21.15.123:0/86840001 shutdown_connections 2024-08-18T22:13:10.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.032+0000 7f64383e6640 1 --2- 172.21.15.123:0/86840001 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f641c0a2b80 0x7f641c0a5040 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.032+0000 7f64383e6640 1 --2- 172.21.15.123:0/86840001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6430102c20 0x7f643010ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.032+0000 7f64383e6640 1 --2- 172.21.15.123:0/86840001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64301022a0 0x7f643010e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.032+0000 7f64383e6640 1 --2- 172.21.15.123:0/86840001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6430100b50 0x7f643010e200 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:10.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.032+0000 7f64383e6640 1 -- 172.21.15.123:0/86840001 >> 172.21.15.123:0/86840001 conn(0x7f64300fc500 msgr2=0x7f64301065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:10.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.032+0000 7f64383e6640 1 -- 172.21.15.123:0/86840001 shutdown_connections 2024-08-18T22:13:10.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:10.032+0000 7f64383e6640 1 -- 172.21.15.123:0/86840001 wait complete. 2024-08-18T22:13:10.847 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-18T22:13:11.128 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:13:11.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:11 smithi123 ceph-mon[18462]: pgmap v502: 129 pgs: 129 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.9 MiB/s wr, 1.43k op/s 2024-08-18T22:13:11.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.624+0000 7efea000f640 1 -- 172.21.15.123:0/2879414067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe981022a0 msgr2=0x7efe981026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:11.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.624+0000 7efea000f640 1 --2- 172.21.15.123:0/2879414067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe981022a0 0x7efe981026e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7efe88009900 tx=0x7efe8802a480 comp rx=0 tx=0).stop 2024-08-18T22:13:11.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.624+0000 7efea000f640 1 -- 172.21.15.123:0/2879414067 shutdown_connections 2024-08-18T22:13:11.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.624+0000 7efea000f640 1 --2- 172.21.15.123:0/2879414067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe98102c20 0x7efe9810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.624+0000 7efea000f640 1 --2- 172.21.15.123:0/2879414067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe981022a0 0x7efe981026e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.624+0000 7efea000f640 1 --2- 172.21.15.123:0/2879414067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe98100b50 0x7efe98100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.624+0000 7efea000f640 1 -- 172.21.15.123:0/2879414067 >> 172.21.15.123:0/2879414067 conn(0x7efe980fc500 msgr2=0x7efe980fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:11.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.624+0000 7efea000f640 1 -- 172.21.15.123:0/2879414067 shutdown_connections 2024-08-18T22:13:11.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.624+0000 7efea000f640 1 -- 172.21.15.123:0/2879414067 wait complete. 2024-08-18T22:13:11.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.625+0000 7efea000f640 1 Processor -- start 2024-08-18T22:13:11.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.625+0000 7efea000f640 1 -- start start 2024-08-18T22:13:11.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.625+0000 7efea000f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe98100b50 0x7efe98198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.625+0000 7efea000f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe981022a0 0x7efe981987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.625+0000 7efea000f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe98102c20 0x7efe9819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.625+0000 7efea000f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efe98110cd0 con 0x7efe98102c20 2024-08-18T22:13:11.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.625+0000 7efea000f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efe98110b50 con 0x7efe981022a0 2024-08-18T22:13:11.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.625+0000 7efea000f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efe98110e50 con 0x7efe98100b50 2024-08-18T22:13:11.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.625+0000 7efe9e5ac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe98102c20 0x7efe9819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.625+0000 7efe9ddab640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe98100b50 0x7efe98198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.625+0000 7efe9d5aa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe981022a0 0x7efe981987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.625+0000 7efe9ddab640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe98100b50 0x7efe98198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:33034/0 (socket says 172.21.15.123:33034) 2024-08-18T22:13:11.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.625+0000 7efe9e5ac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe98102c20 0x7efe9819cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54262/0 (socket says 172.21.15.123:54262) 2024-08-18T22:13:11.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.625+0000 7efe9ddab640 1 -- 172.21.15.123:0/2828741379 learned_addr learned my addr 172.21.15.123:0/2828741379 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:11.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.626+0000 7efe9e5ac640 1 -- 172.21.15.123:0/2828741379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe98100b50 msgr2=0x7efe98198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:11.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.626+0000 7efe9e5ac640 1 --2- 172.21.15.123:0/2828741379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe98100b50 0x7efe98198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.626+0000 7efe9e5ac640 1 -- 172.21.15.123:0/2828741379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe981022a0 msgr2=0x7efe981987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:11.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.626+0000 7efe9e5ac640 1 --2- 172.21.15.123:0/2828741379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe981022a0 0x7efe981987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.626+0000 7efe9e5ac640 1 -- 172.21.15.123:0/2828741379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9819d220 con 0x7efe98102c20 2024-08-18T22:13:11.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.626+0000 7efe9ddab640 1 --2- 172.21.15.123:0/2828741379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe98100b50 0x7efe98198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:11.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.626+0000 7efe9d5aa640 1 --2- 172.21.15.123:0/2828741379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe981022a0 0x7efe981987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:11.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.626+0000 7efe9e5ac640 1 --2- 172.21.15.123:0/2828741379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe98102c20 0x7efe9819cb40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7efe9000da10 tx=0x7efe9000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:11.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.626+0000 7efe8effd640 1 -- 172.21.15.123:0/2828741379 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9000bd70 con 0x7efe98102c20 2024-08-18T22:13:11.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.626+0000 7efe8effd640 1 -- 172.21.15.123:0/2828741379 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe90003e50 con 0x7efe98102c20 2024-08-18T22:13:11.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.626+0000 7efea000f640 1 -- 172.21.15.123:0/2828741379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9819d510 con 0x7efe98102c20 2024-08-18T22:13:11.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.626+0000 7efe8effd640 1 -- 172.21.15.123:0/2828741379 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe900106a0 con 0x7efe98102c20 2024-08-18T22:13:11.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.626+0000 7efea000f640 1 -- 172.21.15.123:0/2828741379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe981a4df0 con 0x7efe98102c20 2024-08-18T22:13:11.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.628+0000 7efe8effd640 1 -- 172.21.15.123:0/2828741379 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7efe90003970 con 0x7efe98102c20 2024-08-18T22:13:11.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.629+0000 7efea240d740 1 Processor -- start 2024-08-18T22:13:11.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.629+0000 7efea240d740 1 -- start start 2024-08-18T22:13:11.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.629+0000 7efea240d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6b6ed0 0x563e2e6b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.629+0000 7efea240d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b77f0 0x563e2e6c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.629+0000 7efea240d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6c65e0 0x563e2e6c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.629+0000 7efea240d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x563e2e61ca40 con 0x563e2e6b6ed0 2024-08-18T22:13:11.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.629+0000 7efea240d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563e2e5b49d0 con 0x563e2e6b77f0 2024-08-18T22:13:11.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.629+0000 7efea240d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563e2e618a00 con 0x563e2e6c65e0 2024-08-18T22:13:11.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.629+0000 7efe8effd640 1 --2- 172.21.15.123:0/2828741379 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efe840a2b80 0x7efe840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.629+0000 7efe9d5aa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6b6ed0 0x563e2e6b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.630+0000 7efe9d5aa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6b6ed0 0x563e2e6b72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54272/0 (socket says 172.21.15.123:54272) 2024-08-18T22:13:11.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.630+0000 7efe9d5aa640 1 -- 172.21.15.123:0/3985450521 learned_addr learned my addr 172.21.15.123:0/3985450521 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:11.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.630+0000 7efe9d5aa640 1 --2- 172.21.15.123:0/3985450521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6c65e0 0x563e2e6c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.630+0000 7efe9e5ac640 1 --2- 172.21.15.123:0/2828741379 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efe840a2b80 0x7efe840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.630+0000 7efe8effd640 1 -- 172.21.15.123:0/2828741379 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7efe900cf770 con 0x7efe98102c20 2024-08-18T22:13:11.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.630+0000 7efe9d5aa640 1 -- 172.21.15.123:0/3985450521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b77f0 msgr2=0x563e2e6c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:11.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.630+0000 7efe9d5aa640 1 --2- 172.21.15.123:0/3985450521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b77f0 0x563e2e6c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.630+0000 7efe9d5aa640 1 -- 172.21.15.123:0/3985450521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6b6ed0 msgr2=0x563e2e6b72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:11.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.630+0000 7efe9d5aa640 1 --2- 172.21.15.123:0/3985450521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6b6ed0 0x563e2e6b72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.630+0000 7efe9d5aa640 1 -- 172.21.15.123:0/3985450521 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e2e5bb650 con 0x563e2e6c65e0 2024-08-18T22:13:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.630+0000 7efe9e5ac640 1 --2- 172.21.15.123:0/2828741379 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efe840a2b80 0x7efe840a5040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efe9000bf50 tx=0x7efe9006ab60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.630+0000 7efe9d5aa640 1 --2- 172.21.15.123:0/3985450521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6c65e0 0x563e2e6c89d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efe88005ec0 tx=0x7efe8802a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2792fe8ca8c02601 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.630+0000 7efe83fff640 1 -- 172.21.15.123:0/3985450521 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe88041020 con 0x563e2e6c65e0 2024-08-18T22:13:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.630+0000 7efe83fff640 1 -- 172.21.15.123:0/3985450521 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe88004e40 con 0x563e2e6c65e0 2024-08-18T22:13:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.630+0000 7efe83fff640 1 -- 172.21.15.123:0/3985450521 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe88035040 con 0x563e2e6c65e0 2024-08-18T22:13:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.631+0000 7efea240d740 1 -- 172.21.15.123:0/3985450521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6c65e0 msgr2=0x563e2e6c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.631+0000 7efea240d740 1 --2- 172.21.15.123:0/3985450521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6c65e0 0x563e2e6c89d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efe88005ec0 tx=0x7efe8802a480 comp rx=0 tx=0).stop 2024-08-18T22:13:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.631+0000 7efea240d740 1 -- 172.21.15.123:0/3985450521 shutdown_connections 2024-08-18T22:13:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.631+0000 7efea240d740 1 --2- 172.21.15.123:0/3985450521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6c65e0 0x563e2e6c89d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.631+0000 7efea240d740 1 --2- 172.21.15.123:0/3985450521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b77f0 0x563e2e6c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.631+0000 7efea240d740 1 --2- 172.21.15.123:0/3985450521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6b6ed0 0x563e2e6b72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.631+0000 7efea240d740 1 -- 172.21.15.123:0/3985450521 >> 172.21.15.123:0/3985450521 conn(0x563e2e6b3580 msgr2=0x563e2e6b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.631+0000 7efea240d740 1 -- 172.21.15.123:0/3985450521 shutdown_connections 2024-08-18T22:13:11.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.631+0000 7efea240d740 1 -- 172.21.15.123:0/3985450521 wait complete. 2024-08-18T22:13:11.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.632+0000 7efea240d740 1 -- start start 2024-08-18T22:13:11.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.632+0000 7efea240d740 1 Processor -- start 2024-08-18T22:13:11.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.632+0000 7efea240d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6b6ed0 0x563e2e6c3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.632+0000 7efea240d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b77f0 0x563e2e6c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.632+0000 7efea240d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6c65e0 0x563e2e6c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.632+0000 7efea240d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x563e2e6c91b0 con 0x563e2e6b6ed0 2024-08-18T22:13:11.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.632+0000 7efea240d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563e2e5d7b20 con 0x563e2e6b77f0 2024-08-18T22:13:11.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.632+0000 7efea240d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563e2e6c9330 con 0x563e2e6c65e0 2024-08-18T22:13:11.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.632+0000 7efea240d740 10 client.0 _ll_register_callbacks cb 0x563e2e5d5bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:11.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.632+0000 7efe9d5aa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6b6ed0 0x563e2e6c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efe9d5aa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6b6ed0 0x563e2e6c3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54282/0 (socket says 172.21.15.123:54282) 2024-08-18T22:13:11.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efe9d5aa640 1 -- 172.21.15.123:0/2078174618 learned_addr learned my addr 172.21.15.123:0/2078174618 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efe9d5aa640 1 --2- 172.21.15.123:0/2078174618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6c65e0 0x563e2e6c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efe9ddab640 1 --2- 172.21.15.123:0/2078174618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b77f0 0x563e2e6c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efe9d5aa640 1 -- 172.21.15.123:0/2078174618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6c65e0 msgr2=0x563e2e6c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efe9d5aa640 1 --2- 172.21.15.123:0/2078174618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6c65e0 0x563e2e6c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efe9d5aa640 1 -- 172.21.15.123:0/2078174618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b77f0 msgr2=0x563e2e6c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efe9d5aa640 1 --2- 172.21.15.123:0/2078174618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b77f0 0x563e2e6c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efe9d5aa640 1 -- 172.21.15.123:0/2078174618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e2e38e3c0 con 0x563e2e6b6ed0 2024-08-18T22:13:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efe9d5aa640 1 --2- 172.21.15.123:0/2078174618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6b6ed0 0x563e2e6c3520 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7efe88005ab0 tx=0x7efe880039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2894988fc50a0db server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efe817fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:13:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efe817fa640 1 -- 172.21.15.123:0/2078174618 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe88035070 con 0x563e2e6b6ed0 2024-08-18T22:13:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efe817fa640 1 -- 172.21.15.123:0/2078174618 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7efe88004760 con 0x563e2e6b6ed0 2024-08-18T22:13:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efea240d740 1 -- 172.21.15.123:0/2078174618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563e2e629fb0 con 0x563e2e6b6ed0 2024-08-18T22:13:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efe817fa640 1 -- 172.21.15.123:0/2078174618 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efe88041070 con 0x563e2e6b6ed0 2024-08-18T22:13:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efea240d740 10 client.16473 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.633+0000 7efea240d740 1 -- 172.21.15.123:0/2078174618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563e2e6d4e50 con 0x563e2e6b6ed0 2024-08-18T22:13:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.634+0000 7efe817fa640 1 -- 172.21.15.123:0/2078174618 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563e2e629fb0 con 0x563e2e6b6ed0 2024-08-18T22:13:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.634+0000 7efe817fa640 1 -- 172.21.15.123:0/2078174618 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7efe880319a0 con 0x563e2e6b6ed0 2024-08-18T22:13:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.634+0000 7efea240d740 10 client.16473 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.634+0000 7efea240d740 10 client.16473 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-18T22:13:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.634+0000 7efea240d740 20 client.16473 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.634+0000 7efea240d740 1 --2- 172.21.15.123:0/2078174618 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x563e2e6d61a0 0x563e2e6d8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.634+0000 7efea240d740 4 client.16473 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:13:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.634+0000 7efea240d740 1 -- 172.21.15.123:0/2078174618 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e2e6244c0 con 0x563e2e6d61a0 2024-08-18T22:13:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.634+0000 7efe9ddab640 1 --2- 172.21.15.123:0/2078174618 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x563e2e6d61a0 0x563e2e6d8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.635+0000 7efe9ddab640 1 --2- 172.21.15.123:0/2078174618 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x563e2e6d61a0 0x563e2e6d8590 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3a0a8db62d921917 server_cookie=63f825d5e118df00 in_seq=0 out_seq=0 2024-08-18T22:13:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.635+0000 7efe817fa640 10 client.16473 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:13:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.635+0000 7efe817fa640 1 -- 172.21.15.123:0/2078174618 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e2e6244c0 con 0x563e2e6d61a0 2024-08-18T22:13:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.635+0000 7efe817fa640 10 client.16473 handle_command_reply: tid=0 2024-08-18T22:13:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.635+0000 7efea240d740 1 client.16473 shutdown 2024-08-18T22:13:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.635+0000 7efea240d740 1 -- 172.21.15.123:0/2078174618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6b6ed0 msgr2=0x563e2e6c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.635+0000 7efea240d740 1 --2- 172.21.15.123:0/2078174618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6b6ed0 0x563e2e6c3520 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7efe88005ab0 tx=0x7efe880039c0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.636+0000 7efea240d740 1 -- 172.21.15.123:0/2078174618 shutdown_connections 2024-08-18T22:13:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.636+0000 7efea240d740 1 --2- 172.21.15.123:0/2078174618 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x563e2e6d61a0 0x563e2e6d8590 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.636+0000 7efea240d740 1 --2- 172.21.15.123:0/2078174618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6c65e0 0x563e2e6c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.636+0000 7efea240d740 1 --2- 172.21.15.123:0/2078174618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b77f0 0x563e2e6c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.636+0000 7efea240d740 1 --2- 172.21.15.123:0/2078174618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6b6ed0 0x563e2e6c3520 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.636+0000 7efe817fa640 0 client.16473 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:13:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.636+0000 7efea240d740 1 -- 172.21.15.123:0/2078174618 >> 172.21.15.123:0/2078174618 conn(0x563e2e6b3580 msgr2=0x563e2e6b92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.636+0000 7efea240d740 1 -- 172.21.15.123:0/2078174618 shutdown_connections 2024-08-18T22:13:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.636+0000 7efea240d740 1 -- 172.21.15.123:0/2078174618 wait complete. 2024-08-18T22:13:11.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.636+0000 7efea240d740 20 client.16473 trim_cache size 0 max 16384 2024-08-18T22:13:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.649+0000 7efea240d740 1 Processor -- start 2024-08-18T22:13:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.649+0000 7efea240d740 1 -- start start 2024-08-18T22:13:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.649+0000 7efea240d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b6ed0 0x563e2e6c0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.649+0000 7efea240d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6b77f0 0x563e2e6c0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.649+0000 7efea240d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6c65e0 0x563e2e6d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.649+0000 7efea240d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efe981af0e0 con 0x563e2e6c65e0 2024-08-18T22:13:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.649+0000 7efea240d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efe981ac9b0 con 0x563e2e6b6ed0 2024-08-18T22:13:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.649+0000 7efea240d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efe981aa800 con 0x563e2e6b77f0 2024-08-18T22:13:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.649+0000 7efe9d5aa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6c65e0 0x563e2e6d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.649+0000 7efe9d5aa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6c65e0 0x563e2e6d15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54288/0 (socket says 172.21.15.123:54288) 2024-08-18T22:13:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.649+0000 7efe9d5aa640 1 -- 172.21.15.123:0/3172585548 learned_addr learned my addr 172.21.15.123:0/3172585548 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.649+0000 7efe9ddab640 1 --2- 172.21.15.123:0/3172585548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6b77f0 0x563e2e6c0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.649+0000 7efe9d5aa640 1 --2- 172.21.15.123:0/3172585548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b6ed0 0x563e2e6c0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.650+0000 7efe9ddab640 1 -- 172.21.15.123:0/3172585548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b6ed0 msgr2=0x563e2e6c0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.650+0000 7efe9ddab640 1 --2- 172.21.15.123:0/3172585548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b6ed0 0x563e2e6c0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.650+0000 7efe9ddab640 1 -- 172.21.15.123:0/3172585548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6c65e0 msgr2=0x563e2e6d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.650+0000 7efe9ddab640 1 --2- 172.21.15.123:0/3172585548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6c65e0 0x563e2e6d15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.650+0000 7efe9ddab640 1 -- 172.21.15.123:0/3172585548 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e2e6b7620 con 0x563e2e6b77f0 2024-08-18T22:13:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.650+0000 7efe9d5aa640 1 --2- 172.21.15.123:0/3172585548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6c65e0 0x563e2e6d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.650+0000 7efe9ddab640 1 --2- 172.21.15.123:0/3172585548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6b77f0 0x563e2e6c0cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x563e2e6c4b60 tx=0x7efe940039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c700822bc8c53fb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.650+0000 7efe837fe640 1 -- 172.21.15.123:0/3172585548 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9401c6e0 con 0x563e2e6b77f0 2024-08-18T22:13:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.650+0000 7efe837fe640 1 -- 172.21.15.123:0/3172585548 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe94011500 con 0x563e2e6b77f0 2024-08-18T22:13:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.650+0000 7efe837fe640 1 -- 172.21.15.123:0/3172585548 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe94010690 con 0x563e2e6b77f0 2024-08-18T22:13:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.651+0000 7efea240d740 1 -- 172.21.15.123:0/3172585548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6b77f0 msgr2=0x563e2e6c0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.651+0000 7efea240d740 1 --2- 172.21.15.123:0/3172585548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6b77f0 0x563e2e6c0cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x563e2e6c4b60 tx=0x7efe940039c0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.651+0000 7efea240d740 1 -- 172.21.15.123:0/3172585548 shutdown_connections 2024-08-18T22:13:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.651+0000 7efea240d740 1 --2- 172.21.15.123:0/3172585548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6c65e0 0x563e2e6d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.651+0000 7efea240d740 1 --2- 172.21.15.123:0/3172585548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6b77f0 0x563e2e6c0cc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.651+0000 7efea240d740 1 --2- 172.21.15.123:0/3172585548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b6ed0 0x563e2e6c0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.651+0000 7efea240d740 1 -- 172.21.15.123:0/3172585548 >> 172.21.15.123:0/3172585548 conn(0x563e2e6b3580 msgr2=0x563e2e6c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.651+0000 7efea240d740 1 -- 172.21.15.123:0/3172585548 shutdown_connections 2024-08-18T22:13:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.651+0000 7efea240d740 1 -- 172.21.15.123:0/3172585548 wait complete. 2024-08-18T22:13:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.651+0000 7efea240d740 1 -- start start 2024-08-18T22:13:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.651+0000 7efea240d740 1 Processor -- start 2024-08-18T22:13:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efea240d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b6ed0 0x563e2e6d8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efea240d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6b77f0 0x563e2e6d8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efea240d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6c65e0 0x563e2e73ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efea240d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efe981aae70 con 0x563e2e6c65e0 2024-08-18T22:13:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efea240d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efe981ac2e0 con 0x563e2e6b6ed0 2024-08-18T22:13:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efea240d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efe981ab540 con 0x563e2e6b77f0 2024-08-18T22:13:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efea240d740 10 client.0 _ll_register_callbacks cb 0x7efe88005e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efe9d5aa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6c65e0 0x563e2e73ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efe9ddab640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6b77f0 0x563e2e6d8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efe9d5aa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6c65e0 0x563e2e73ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54290/0 (socket says 172.21.15.123:54290) 2024-08-18T22:13:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efe9d5aa640 1 -- 172.21.15.123:0/2406431925 learned_addr learned my addr 172.21.15.123:0/2406431925 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efe9d5aa640 1 --2- 172.21.15.123:0/2406431925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b6ed0 0x563e2e6d8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efe9ddab640 1 -- 172.21.15.123:0/2406431925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b6ed0 msgr2=0x563e2e6d8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efe9ddab640 1 --2- 172.21.15.123:0/2406431925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b6ed0 0x563e2e6d8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efe9ddab640 1 -- 172.21.15.123:0/2406431925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6c65e0 msgr2=0x563e2e73ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efe9ddab640 1 --2- 172.21.15.123:0/2406431925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6c65e0 0x563e2e73ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efe9ddab640 1 -- 172.21.15.123:0/2406431925 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e2e73f010 con 0x563e2e6b77f0 2024-08-18T22:13:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efe9d5aa640 1 --2- 172.21.15.123:0/2406431925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6c65e0 0x563e2e73ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efe9ddab640 1 --2- 172.21.15.123:0/2406431925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6b77f0 0x563e2e6d8c90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efe9400b4e0 tx=0x7efe94004420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adf8c7839804b627 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.652+0000 7efe817fa640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-08-18T22:13:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.653+0000 7efe817fa640 1 -- 172.21.15.123:0/2406431925 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe94011980 con 0x563e2e6b77f0 2024-08-18T22:13:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.653+0000 7efe817fa640 1 -- 172.21.15.123:0/2406431925 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7efe94011b20 con 0x563e2e6b77f0 2024-08-18T22:13:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.653+0000 7efea240d740 1 -- 172.21.15.123:0/2406431925 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe94011500 con 0x563e2e6b77f0 2024-08-18T22:13:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.653+0000 7efe817fa640 1 -- 172.21.15.123:0/2406431925 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efe9401c4e0 con 0x563e2e6b77f0 2024-08-18T22:13:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.653+0000 7efea240d740 10 client.25867 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.653+0000 7efea240d740 1 -- 172.21.15.123:0/2406431925 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563e2e7401d0 con 0x563e2e6b77f0 2024-08-18T22:13:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.653+0000 7efe817fa640 1 -- 172.21.15.123:0/2406431925 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe94011500 con 0x563e2e6b77f0 2024-08-18T22:13:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.653+0000 7efe817fa640 1 -- 172.21.15.123:0/2406431925 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7efe94025900 con 0x563e2e6b77f0 2024-08-18T22:13:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.653+0000 7efea240d740 10 client.25867 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.653+0000 7efea240d740 10 client.25867 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-18T22:13:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.653+0000 7efea240d740 20 client.25867 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.653+0000 7efea240d740 1 --2- 172.21.15.123:0/2406431925 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x563e2e7408b0 0x563e2e742cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.653+0000 7efea240d740 4 client.25867 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:13:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.653+0000 7efea240d740 1 -- 172.21.15.123:0/2406431925 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563e2e5a1170 con 0x563e2e7408b0 2024-08-18T22:13:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efe9d5aa640 1 --2- 172.21.15.123:0/2406431925 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x563e2e7408b0 0x563e2e742cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efe9d5aa640 1 --2- 172.21.15.123:0/2406431925 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x563e2e7408b0 0x563e2e742cd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b2817f61dda0bc9f server_cookie=fb6c43f114148fb in_seq=0 out_seq=0 2024-08-18T22:13:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efe817fa640 10 client.25867 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:13:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efe817fa640 1 -- 172.21.15.123:0/2406431925 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563e2e5a1170 con 0x563e2e7408b0 2024-08-18T22:13:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efe817fa640 10 client.25867 handle_command_reply: tid=0 2024-08-18T22:13:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efea240d740 1 client.25867 shutdown 2024-08-18T22:13:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efea240d740 1 -- 172.21.15.123:0/2406431925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6b77f0 msgr2=0x563e2e6d8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efea240d740 1 --2- 172.21.15.123:0/2406431925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6b77f0 0x563e2e6d8c90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efe9400b4e0 tx=0x7efe94004420 comp rx=0 tx=0).stop 2024-08-18T22:13:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efea240d740 1 -- 172.21.15.123:0/2406431925 shutdown_connections 2024-08-18T22:13:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efea240d740 1 --2- 172.21.15.123:0/2406431925 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x563e2e7408b0 0x563e2e742cd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efea240d740 1 --2- 172.21.15.123:0/2406431925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563e2e6c65e0 0x563e2e73ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efea240d740 1 --2- 172.21.15.123:0/2406431925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e2e6b77f0 0x563e2e6d8c90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efe817fa640 0 client.25867 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:13:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efea240d740 1 --2- 172.21.15.123:0/2406431925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563e2e6b6ed0 0x563e2e6d8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efea240d740 1 -- 172.21.15.123:0/2406431925 >> 172.21.15.123:0/2406431925 conn(0x563e2e6b3580 msgr2=0x563e2e6c4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efea240d740 1 -- 172.21.15.123:0/2406431925 shutdown_connections 2024-08-18T22:13:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.654+0000 7efea240d740 1 -- 172.21.15.123:0/2406431925 wait complete. 2024-08-18T22:13:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.655+0000 7efea240d740 20 client.25867 trim_cache size 0 max 16384 2024-08-18T22:13:11.665 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:13:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.655+0000 7efea000f640 1 -- 172.21.15.123:0/2828741379 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efe840a2b80 msgr2=0x7efe840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.655+0000 7efea000f640 1 --2- 172.21.15.123:0/2828741379 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efe840a2b80 0x7efe840a5040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efe9000bf50 tx=0x7efe9006ab60 comp rx=0 tx=0).stop 2024-08-18T22:13:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.655+0000 7efea000f640 1 -- 172.21.15.123:0/2828741379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe98102c20 msgr2=0x7efe9819cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:11.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.655+0000 7efea000f640 1 --2- 172.21.15.123:0/2828741379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe98102c20 0x7efe9819cb40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7efe9000da10 tx=0x7efe9000ded0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.655+0000 7efea000f640 1 -- 172.21.15.123:0/2828741379 shutdown_connections 2024-08-18T22:13:11.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.655+0000 7efea000f640 1 --2- 172.21.15.123:0/2828741379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe98102c20 0x7efe9819cb40 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.655+0000 7efea000f640 1 --2- 172.21.15.123:0/2828741379 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efe840a2b80 0x7efe840a5040 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.655+0000 7efea000f640 1 --2- 172.21.15.123:0/2828741379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe981022a0 0x7efe981987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.655+0000 7efea000f640 1 --2- 172.21.15.123:0/2828741379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe98100b50 0x7efe98198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:11.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.655+0000 7efea000f640 1 -- 172.21.15.123:0/2828741379 >> 172.21.15.123:0/2828741379 conn(0x7efe980fc500 msgr2=0x7efe98069f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:11.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.655+0000 7efea000f640 1 -- 172.21.15.123:0/2828741379 shutdown_connections 2024-08-18T22:13:11.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:11.655+0000 7efea000f640 1 -- 172.21.15.123:0/2828741379 wait complete. 2024-08-18T22:13:11.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:11 smithi130 ceph-mon[21698]: pgmap v502: 129 pgs: 129 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.9 MiB/s wr, 1.43k op/s 2024-08-18T22:13:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:11 smithi183 ceph-mon[22097]: pgmap v502: 129 pgs: 129 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.9 MiB/s wr, 1.43k op/s 2024-08-18T22:13:12.456 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-18T22:13:12.731 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:13:13.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.447+0000 7fe12c6b9640 1 -- 172.21.15.123:0/4199389733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1241007c0 msgr2=0x7fe124100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:13.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.447+0000 7fe12c6b9640 1 --2- 172.21.15.123:0/4199389733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1241007c0 0x7fe124100c20 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe114009900 tx=0x7fe11402a410 comp rx=0 tx=0).stop 2024-08-18T22:13:13.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.447+0000 7fe12c6b9640 1 -- 172.21.15.123:0/4199389733 shutdown_connections 2024-08-18T22:13:13.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.447+0000 7fe12c6b9640 1 --2- 172.21.15.123:0/4199389733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe124101160 0x7fe12410d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.447+0000 7fe12c6b9640 1 --2- 172.21.15.123:0/4199389733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1241007c0 0x7fe124100c20 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.447+0000 7fe12c6b9640 1 --2- 172.21.15.123:0/4199389733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1241067c0 0x7fe124106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.447+0000 7fe12c6b9640 1 -- 172.21.15.123:0/4199389733 >> 172.21.15.123:0/4199389733 conn(0x7fe1240fc500 msgr2=0x7fe1240fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.447+0000 7fe12c6b9640 1 -- 172.21.15.123:0/4199389733 shutdown_connections 2024-08-18T22:13:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.447+0000 7fe12c6b9640 1 -- 172.21.15.123:0/4199389733 wait complete. 2024-08-18T22:13:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.448+0000 7fe12c6b9640 1 Processor -- start 2024-08-18T22:13:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.448+0000 7fe12c6b9640 1 -- start start 2024-08-18T22:13:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.448+0000 7fe12c6b9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1241007c0 0x7fe124198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.448+0000 7fe12c6b9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe124101160 0x7fe1241986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.448+0000 7fe12c6b9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1241067c0 0x7fe12419ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.448+0000 7fe12c6b9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe124111d20 con 0x7fe1241067c0 2024-08-18T22:13:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.448+0000 7fe12c6b9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe124111ba0 con 0x7fe124101160 2024-08-18T22:13:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.448+0000 7fe12c6b9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe124111ea0 con 0x7fe1241007c0 2024-08-18T22:13:13.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.448+0000 7fe12ac56640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1241067c0 0x7fe12419ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.448+0000 7fe12a455640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1241007c0 0x7fe124198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.448+0000 7fe12a455640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1241007c0 0x7fe124198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:52566/0 (socket says 172.21.15.123:52566) 2024-08-18T22:13:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.448+0000 7fe12ac56640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1241067c0 0x7fe12419ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40488/0 (socket says 172.21.15.123:40488) 2024-08-18T22:13:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.448+0000 7fe12a455640 1 -- 172.21.15.123:0/2136157928 learned_addr learned my addr 172.21.15.123:0/2136157928 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.449+0000 7fe129c54640 1 --2- 172.21.15.123:0/2136157928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe124101160 0x7fe1241986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.449+0000 7fe12a455640 1 -- 172.21.15.123:0/2136157928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe124101160 msgr2=0x7fe1241986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.449+0000 7fe12a455640 1 --2- 172.21.15.123:0/2136157928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe124101160 0x7fe1241986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.449+0000 7fe12a455640 1 -- 172.21.15.123:0/2136157928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1241067c0 msgr2=0x7fe12419ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.449+0000 7fe12a455640 1 --2- 172.21.15.123:0/2136157928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1241067c0 0x7fe12419ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.449+0000 7fe12a455640 1 -- 172.21.15.123:0/2136157928 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe12419d120 con 0x7fe1241007c0 2024-08-18T22:13:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.449+0000 7fe12a455640 1 --2- 172.21.15.123:0/2136157928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1241007c0 0x7fe124198170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe12000ea60 tx=0x7fe12000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.449+0000 7fe11b7fe640 1 -- 172.21.15.123:0/2136157928 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12000cde0 con 0x7fe1241007c0 2024-08-18T22:13:13.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.449+0000 7fe12c6b9640 1 -- 172.21.15.123:0/2136157928 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe12419d410 con 0x7fe1241007c0 2024-08-18T22:13:13.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.449+0000 7fe11b7fe640 1 -- 172.21.15.123:0/2136157928 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1200035f0 con 0x7fe1241007c0 2024-08-18T22:13:13.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.449+0000 7fe11b7fe640 1 -- 172.21.15.123:0/2136157928 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe120010670 con 0x7fe1241007c0 2024-08-18T22:13:13.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.449+0000 7fe12c6b9640 1 -- 172.21.15.123:0/2136157928 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe12410dd50 con 0x7fe1241007c0 2024-08-18T22:13:13.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.452+0000 7fe12eab7740 1 Processor -- start 2024-08-18T22:13:13.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.452+0000 7fe12eab7740 1 -- start start 2024-08-18T22:13:13.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.452+0000 7fe11b7fe640 1 -- 172.21.15.123:0/2136157928 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fe1200037a0 con 0x7fe1241007c0 2024-08-18T22:13:13.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.452+0000 7fe12eab7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c0963d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.452+0000 7fe12eab7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c096910 0x56354c0a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.452+0000 7fe12eab7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c0a11d0 0x56354c0a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.452+0000 7fe12eab7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56354bffba40 con 0x56354c095ff0 2024-08-18T22:13:13.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.452+0000 7fe12eab7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56354bf939d0 con 0x56354c096910 2024-08-18T22:13:13.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.452+0000 7fe12eab7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56354bff7a00 con 0x56354c0a11d0 2024-08-18T22:13:13.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.453+0000 7fe12a455640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c096910 0x56354c0a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.453+0000 7fe12ac56640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c0963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.453+0000 7fe129c54640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c0a11d0 0x56354c0a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.453+0000 7fe12a455640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c096910 0x56354c0a0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:38166/0 (socket says 172.21.15.123:38166) 2024-08-18T22:13:13.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.453+0000 7fe12a455640 1 -- 172.21.15.123:0/1199635968 learned_addr learned my addr 172.21.15.123:0/1199635968 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:13.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.453+0000 7fe12ac56640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c0963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40494/0 (socket says 172.21.15.123:40494) 2024-08-18T22:13:13.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.453+0000 7fe12ac56640 1 -- 172.21.15.123:0/1199635968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c0a11d0 msgr2=0x56354c0a35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:13.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.453+0000 7fe12ac56640 1 --2- 172.21.15.123:0/1199635968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c0a11d0 0x56354c0a35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.453+0000 7fe12ac56640 1 -- 172.21.15.123:0/1199635968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c096910 msgr2=0x56354c0a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:13.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.453+0000 7fe12ac56640 1 --2- 172.21.15.123:0/1199635968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c096910 0x56354c0a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.453+0000 7fe12ac56640 1 -- 172.21.15.123:0/1199635968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56354bf9a650 con 0x56354c095ff0 2024-08-18T22:13:13.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.453+0000 7fe12ac56640 1 --2- 172.21.15.123:0/1199635968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c0963d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe11c009f00 tx=0x7fe11c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0eedc235fb59609 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:13.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.453+0000 7fe11b7fe640 1 --2- 172.21.15.123:0/2136157928 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe1100a2b80 0x7fe1100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.453+0000 7fe118ff9640 1 -- 172.21.15.123:0/1199635968 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c003c30 con 0x56354c095ff0 2024-08-18T22:13:13.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.453+0000 7fe12a455640 1 --2- 172.21.15.123:0/2136157928 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe1100a2b80 0x7fe1100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.454+0000 7fe118ff9640 1 -- 172.21.15.123:0/1199635968 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe11c01f070 con 0x56354c095ff0 2024-08-18T22:13:13.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.454+0000 7fe118ff9640 1 -- 172.21.15.123:0/1199635968 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c00b990 con 0x56354c095ff0 2024-08-18T22:13:13.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.454+0000 7fe11b7fe640 1 -- 172.21.15.123:0/2136157928 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe1200cf620 con 0x7fe1241007c0 2024-08-18T22:13:13.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.454+0000 7fe12eab7740 1 -- 172.21.15.123:0/1199635968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 msgr2=0x56354c0963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:13.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.454+0000 7fe12a455640 1 --2- 172.21.15.123:0/2136157928 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe1100a2b80 0x7fe1100a5040 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe120000c00 tx=0x7fe1200d5550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:13.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.454+0000 7fe12eab7740 1 --2- 172.21.15.123:0/1199635968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c0963d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe11c009f00 tx=0x7fe11c009500 comp rx=0 tx=0).stop 2024-08-18T22:13:13.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 1 -- 172.21.15.123:0/1199635968 shutdown_connections 2024-08-18T22:13:13.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 1 --2- 172.21.15.123:0/1199635968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c0a11d0 0x56354c0a35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 1 --2- 172.21.15.123:0/1199635968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c096910 0x56354c0a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 1 --2- 172.21.15.123:0/1199635968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c0963d0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 1 -- 172.21.15.123:0/1199635968 >> 172.21.15.123:0/1199635968 conn(0x56354c092580 msgr2=0x56354c092960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:13.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 1 -- 172.21.15.123:0/1199635968 shutdown_connections 2024-08-18T22:13:13.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 1 -- 172.21.15.123:0/1199635968 wait complete. 2024-08-18T22:13:13.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 1 -- start start 2024-08-18T22:13:13.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 1 Processor -- start 2024-08-18T22:13:13.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c09e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c096910 0x56354c09e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c0a11d0 0x56354c09eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56354c0a3da0 con 0x56354c095ff0 2024-08-18T22:13:13.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56354bfb6b20 con 0x56354c0a11d0 2024-08-18T22:13:13.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56354c0a3f20 con 0x56354c096910 2024-08-18T22:13:13.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.455+0000 7fe12eab7740 10 client.0 _ll_register_callbacks cb 0x56354bfb4bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:13.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.456+0000 7fe12ac56640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c09e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.456+0000 7fe129c54640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c096910 0x56354c09e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.456+0000 7fe12ac56640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c09e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40496/0 (socket says 172.21.15.123:40496) 2024-08-18T22:13:13.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.456+0000 7fe12ac56640 1 -- 172.21.15.123:0/1778445703 learned_addr learned my addr 172.21.15.123:0/1778445703 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:13.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.456+0000 7fe12ac56640 1 --2- 172.21.15.123:0/1778445703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c0a11d0 0x56354c09eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.456+0000 7fe129c54640 1 -- 172.21.15.123:0/1778445703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c0a11d0 msgr2=0x56354c09eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:13.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.456+0000 7fe129c54640 1 --2- 172.21.15.123:0/1778445703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c0a11d0 0x56354c09eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.456+0000 7fe129c54640 1 -- 172.21.15.123:0/1778445703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 msgr2=0x56354c09e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:13.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.456+0000 7fe129c54640 1 --2- 172.21.15.123:0/1778445703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c09e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.456+0000 7fe129c54640 1 -- 172.21.15.123:0/1778445703 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56354bd6d3c0 con 0x56354c096910 2024-08-18T22:13:13.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.456+0000 7fe129c54640 1 --2- 172.21.15.123:0/1778445703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c096910 0x56354c09e5b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe11402aa00 tx=0x7fe114004390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fb71d941f124f15 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:13.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.456+0000 7fe10dffb640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-08-18T22:13:13.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.456+0000 7fe10dffb640 1 -- 172.21.15.123:0/1778445703 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe114035040 con 0x56354c096910 2024-08-18T22:13:13.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.456+0000 7fe10dffb640 1 -- 172.21.15.123:0/1778445703 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe114005450 con 0x56354c096910 2024-08-18T22:13:13.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.456+0000 7fe12eab7740 1 -- 172.21.15.123:0/1778445703 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe11c01f070 con 0x56354c096910 2024-08-18T22:13:13.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.457+0000 7fe10dffb640 1 -- 172.21.15.123:0/1778445703 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe11404f050 con 0x56354c096910 2024-08-18T22:13:13.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.457+0000 7fe12eab7740 10 client.25879 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:13.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.457+0000 7fe12eab7740 1 -- 172.21.15.123:0/1778445703 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56354c0af970 con 0x56354c096910 2024-08-18T22:13:13.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.457+0000 7fe10dffb640 1 -- 172.21.15.123:0/1778445703 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe11c01f070 con 0x56354c096910 2024-08-18T22:13:13.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.457+0000 7fe10dffb640 1 -- 172.21.15.123:0/1778445703 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe1140038f0 con 0x56354c096910 2024-08-18T22:13:13.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.457+0000 7fe12eab7740 10 client.25879 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:13.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.457+0000 7fe12eab7740 10 client.25879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:13.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.457+0000 7fe12eab7740 20 client.25879 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:13.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.457+0000 7fe12eab7740 1 --2- 172.21.15.123:0/1778445703 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56354c0b0e30 0x56354c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.457+0000 7fe12eab7740 4 client.25879 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:13:13.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.457+0000 7fe12eab7740 1 -- 172.21.15.123:0/1778445703 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56354c008fb0 con 0x56354c0b0e30 2024-08-18T22:13:13.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.458+0000 7fe12ac56640 1 --2- 172.21.15.123:0/1778445703 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56354c0b0e30 0x56354c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.458+0000 7fe12ac56640 1 --2- 172.21.15.123:0/1778445703 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56354c0b0e30 0x56354c0b3220 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbce112d3c5e0d7c server_cookie=20cdfd52e42f653 in_seq=0 out_seq=0 2024-08-18T22:13:13.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.458+0000 7fe10dffb640 10 client.25879 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:13.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.459+0000 7fe10dffb640 1 -- 172.21.15.123:0/1778445703 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56354c008fb0 con 0x56354c0b0e30 2024-08-18T22:13:13.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.459+0000 7fe10dffb640 10 client.25879 handle_command_reply: tid=0 2024-08-18T22:13:13.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.459+0000 7fe12eab7740 1 client.25879 shutdown 2024-08-18T22:13:13.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.459+0000 7fe12eab7740 1 -- 172.21.15.123:0/1778445703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c096910 msgr2=0x56354c09e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:13.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.459+0000 7fe12eab7740 1 --2- 172.21.15.123:0/1778445703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c096910 0x56354c09e5b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe11402aa00 tx=0x7fe114004390 comp rx=0 tx=0).stop 2024-08-18T22:13:13.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.459+0000 7fe12eab7740 1 -- 172.21.15.123:0/1778445703 shutdown_connections 2024-08-18T22:13:13.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.459+0000 7fe12eab7740 1 --2- 172.21.15.123:0/1778445703 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56354c0b0e30 0x56354c0b3220 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.459+0000 7fe12eab7740 1 --2- 172.21.15.123:0/1778445703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c0a11d0 0x56354c09eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.459+0000 7fe12eab7740 1 --2- 172.21.15.123:0/1778445703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c096910 0x56354c09e5b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.459+0000 7fe10dffb640 0 client.25879 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:13.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.459+0000 7fe12eab7740 1 --2- 172.21.15.123:0/1778445703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c09e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.459+0000 7fe12eab7740 1 -- 172.21.15.123:0/1778445703 >> 172.21.15.123:0/1778445703 conn(0x56354c092580 msgr2=0x56354c0982b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:13.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.459+0000 7fe12eab7740 1 -- 172.21.15.123:0/1778445703 shutdown_connections 2024-08-18T22:13:13.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.459+0000 7fe12eab7740 1 -- 172.21.15.123:0/1778445703 wait complete. 2024-08-18T22:13:13.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.459+0000 7fe12eab7740 20 client.25879 trim_cache size 0 max 16384 2024-08-18T22:13:13.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.475+0000 7fe12eab7740 1 Processor -- start 2024-08-18T22:13:13.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.475+0000 7fe12eab7740 1 -- start start 2024-08-18T22:13:13.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.475+0000 7fe12eab7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c098a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.475+0000 7fe12eab7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c096910 0x56354c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.475+0000 7fe12eab7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c0a11d0 0x56354c0b9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.475+0000 7fe12eab7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe1241af0f0 con 0x56354c095ff0 2024-08-18T22:13:13.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.475+0000 7fe12eab7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe1241ac9c0 con 0x56354c0a11d0 2024-08-18T22:13:13.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.475+0000 7fe12eab7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe1241aa810 con 0x56354c096910 2024-08-18T22:13:13.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.476+0000 7fe129c54640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c096910 0x56354c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.476+0000 7fe129c54640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c096910 0x56354c0b8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:52596/0 (socket says 172.21.15.123:52596) 2024-08-18T22:13:13.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.476+0000 7fe129c54640 1 -- 172.21.15.123:0/991810485 learned_addr learned my addr 172.21.15.123:0/991810485 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:13.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.476+0000 7fe12ac56640 1 --2- 172.21.15.123:0/991810485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c098a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.476+0000 7fe129c54640 1 -- 172.21.15.123:0/991810485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c0a11d0 msgr2=0x56354c0b9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:13.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.476+0000 7fe129c54640 1 --2- 172.21.15.123:0/991810485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c0a11d0 0x56354c0b9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.476+0000 7fe129c54640 1 -- 172.21.15.123:0/991810485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 msgr2=0x56354c098a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:13.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.476+0000 7fe129c54640 1 --2- 172.21.15.123:0/991810485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c098a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.476+0000 7fe129c54640 1 -- 172.21.15.123:0/991810485 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56354c093210 con 0x56354c096910 2024-08-18T22:13:13.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.476+0000 7fe12ac56640 1 --2- 172.21.15.123:0/991810485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c098a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:13.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.476+0000 7fe129c54640 1 --2- 172.21.15.123:0/991810485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c096910 0x56354c0b8b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe114000c00 tx=0x7fe114005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb4e3c11ad5ea8d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:13.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.482+0000 7fe10ffff640 1 -- 172.21.15.123:0/991810485 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe114058070 con 0x56354c096910 2024-08-18T22:13:13.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.482+0000 7fe10ffff640 1 -- 172.21.15.123:0/991810485 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe114041070 con 0x56354c096910 2024-08-18T22:13:13.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.482+0000 7fe10ffff640 1 -- 172.21.15.123:0/991810485 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe114003af0 con 0x56354c096910 2024-08-18T22:13:13.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.483+0000 7fe12eab7740 1 -- 172.21.15.123:0/991810485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c096910 msgr2=0x56354c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:13.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.483+0000 7fe12eab7740 1 --2- 172.21.15.123:0/991810485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c096910 0x56354c0b8b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe114000c00 tx=0x7fe114005d50 comp rx=0 tx=0).stop 2024-08-18T22:13:13.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.483+0000 7fe12eab7740 1 -- 172.21.15.123:0/991810485 shutdown_connections 2024-08-18T22:13:13.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.483+0000 7fe12eab7740 1 --2- 172.21.15.123:0/991810485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c0a11d0 0x56354c0b9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.483+0000 7fe12eab7740 1 --2- 172.21.15.123:0/991810485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c096910 0x56354c0b8b30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.483+0000 7fe12eab7740 1 --2- 172.21.15.123:0/991810485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c095ff0 0x56354c098a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.483+0000 7fe12eab7740 1 -- 172.21.15.123:0/991810485 >> 172.21.15.123:0/991810485 conn(0x56354c092580 msgr2=0x56354c09c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:13.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.483+0000 7fe12eab7740 1 -- 172.21.15.123:0/991810485 shutdown_connections 2024-08-18T22:13:13.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.483+0000 7fe12eab7740 1 -- 172.21.15.123:0/991810485 wait complete. 2024-08-18T22:13:13.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.483+0000 7fe12eab7740 1 -- start start 2024-08-18T22:13:13.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.483+0000 7fe12eab7740 1 Processor -- start 2024-08-18T22:13:13.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe12eab7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c095ff0 0x56354c0a9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe12eab7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c096910 0x56354c0a9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe12eab7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c0a11d0 0x56354c09a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe12eab7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe1241aae80 con 0x56354c096910 2024-08-18T22:13:13.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe12eab7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe1241ac2f0 con 0x56354c0a11d0 2024-08-18T22:13:13.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe12eab7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe1241ab550 con 0x56354c095ff0 2024-08-18T22:13:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe12eab7740 10 client.0 _ll_register_callbacks cb 0x7fe114009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe129c54640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c096910 0x56354c0a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe129c54640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c096910 0x56354c0a9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40522/0 (socket says 172.21.15.123:40522) 2024-08-18T22:13:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe129c54640 1 -- 172.21.15.123:0/3309713058 learned_addr learned my addr 172.21.15.123:0/3309713058 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe12ac56640 1 --2- 172.21.15.123:0/3309713058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c095ff0 0x56354c0a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe12ac56640 1 --2- 172.21.15.123:0/3309713058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c0a11d0 0x56354c09a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe12ac56640 1 -- 172.21.15.123:0/3309713058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c095ff0 msgr2=0x56354c0a9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe12ac56640 1 --2- 172.21.15.123:0/3309713058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c095ff0 0x56354c0a9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe12ac56640 1 -- 172.21.15.123:0/3309713058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c096910 msgr2=0x56354c0a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe12ac56640 1 --2- 172.21.15.123:0/3309713058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c096910 0x56354c0a9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe12ac56640 1 -- 172.21.15.123:0/3309713058 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56354c09ad00 con 0x56354c0a11d0 2024-08-18T22:13:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.484+0000 7fe129c54640 1 --2- 172.21.15.123:0/3309713058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c096910 0x56354c0a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.485+0000 7fe12ac56640 1 --2- 172.21.15.123:0/3309713058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c0a11d0 0x56354c09a6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe11c010f40 tx=0x7fe11c009a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ff9d87097fbccb6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.485+0000 7fe10dffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:13:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.485+0000 7fe10dffb640 1 -- 172.21.15.123:0/3309713058 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c004310 con 0x56354c0a11d0 2024-08-18T22:13:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.485+0000 7fe10dffb640 1 -- 172.21.15.123:0/3309713058 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fe11c0044b0 con 0x56354c0a11d0 2024-08-18T22:13:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.485+0000 7fe12eab7740 1 -- 172.21.15.123:0/3309713058 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe114041070 con 0x56354c0a11d0 2024-08-18T22:13:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.485+0000 7fe10dffb640 1 -- 172.21.15.123:0/3309713058 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe11c042050 con 0x56354c0a11d0 2024-08-18T22:13:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.485+0000 7fe12eab7740 10 client.25817 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.485+0000 7fe12eab7740 1 -- 172.21.15.123:0/3309713058 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56354c11b400 con 0x56354c0a11d0 2024-08-18T22:13:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.485+0000 7fe10dffb640 1 -- 172.21.15.123:0/3309713058 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe114041070 con 0x56354c0a11d0 2024-08-18T22:13:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.485+0000 7fe10dffb640 1 -- 172.21.15.123:0/3309713058 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe11c027430 con 0x56354c0a11d0 2024-08-18T22:13:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.486+0000 7fe12eab7740 10 client.25817 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.486+0000 7fe12eab7740 10 client.25817 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.486+0000 7fe12eab7740 20 client.25817 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.486+0000 7fe12eab7740 1 --2- 172.21.15.123:0/3309713058 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56354c11bb50 0x56354c11df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.486+0000 7fe12eab7740 4 client.25817 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:13:13.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.486+0000 7fe12eab7740 1 -- 172.21.15.123:0/3309713058 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56354c0034c0 con 0x56354c11bb50 2024-08-18T22:13:13.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.486+0000 7fe129c54640 1 --2- 172.21.15.123:0/3309713058 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56354c11bb50 0x56354c11df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:13.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.487+0000 7fe129c54640 1 --2- 172.21.15.123:0/3309713058 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56354c11bb50 0x56354c11df70 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=533e1f4ed9fbd5d2 server_cookie=76784702cb1cd1a2 in_seq=0 out_seq=0 2024-08-18T22:13:13.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.487+0000 7fe10dffb640 10 client.25817 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:13.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.489+0000 7fe10dffb640 1 -- 172.21.15.123:0/3309713058 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56354c0034c0 con 0x56354c11bb50 2024-08-18T22:13:13.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.489+0000 7fe10dffb640 10 client.25817 handle_command_reply: tid=0 2024-08-18T22:13:13.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.489+0000 7fe12eab7740 1 client.25817 shutdown 2024-08-18T22:13:13.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.489+0000 7fe12eab7740 1 -- 172.21.15.123:0/3309713058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c0a11d0 msgr2=0x56354c09a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:13.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.490+0000 7fe12eab7740 1 --2- 172.21.15.123:0/3309713058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c0a11d0 0x56354c09a6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe11c010f40 tx=0x7fe11c009a50 comp rx=0 tx=0).stop 2024-08-18T22:13:13.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.490+0000 7fe12eab7740 1 -- 172.21.15.123:0/3309713058 shutdown_connections 2024-08-18T22:13:13.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.490+0000 7fe12eab7740 1 --2- 172.21.15.123:0/3309713058 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56354c11bb50 0x56354c11df70 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.490+0000 7fe12eab7740 1 --2- 172.21.15.123:0/3309713058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56354c0a11d0 0x56354c09a6c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.490+0000 7fe12eab7740 1 --2- 172.21.15.123:0/3309713058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56354c096910 0x56354c0a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.490+0000 7fe12eab7740 1 --2- 172.21.15.123:0/3309713058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56354c095ff0 0x56354c0a9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.490+0000 7fe12eab7740 1 -- 172.21.15.123:0/3309713058 >> 172.21.15.123:0/3309713058 conn(0x56354c092580 msgr2=0x56354c0abff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:13.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.490+0000 7fe10dffb640 0 client.25817 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:13.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.490+0000 7fe12eab7740 1 -- 172.21.15.123:0/3309713058 shutdown_connections 2024-08-18T22:13:13.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.490+0000 7fe12eab7740 1 -- 172.21.15.123:0/3309713058 wait complete. 2024-08-18T22:13:13.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.490+0000 7fe12eab7740 20 client.25817 trim_cache size 0 max 16384 2024-08-18T22:13:13.493 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:13:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.491+0000 7fe12c6b9640 1 -- 172.21.15.123:0/2136157928 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe1100a2b80 msgr2=0x7fe1100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.491+0000 7fe12c6b9640 1 --2- 172.21.15.123:0/2136157928 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe1100a2b80 0x7fe1100a5040 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe120000c00 tx=0x7fe1200d5550 comp rx=0 tx=0).stop 2024-08-18T22:13:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.491+0000 7fe12c6b9640 1 -- 172.21.15.123:0/2136157928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1241007c0 msgr2=0x7fe124198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.491+0000 7fe12c6b9640 1 --2- 172.21.15.123:0/2136157928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1241007c0 0x7fe124198170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe12000ea60 tx=0x7fe12000ef20 comp rx=0 tx=0).stop 2024-08-18T22:13:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.491+0000 7fe12c6b9640 1 -- 172.21.15.123:0/2136157928 shutdown_connections 2024-08-18T22:13:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.491+0000 7fe12c6b9640 1 --2- 172.21.15.123:0/2136157928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1241067c0 0x7fe12419ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.491+0000 7fe12c6b9640 1 --2- 172.21.15.123:0/2136157928 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe1100a2b80 0x7fe1100a5040 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.491+0000 7fe12c6b9640 1 --2- 172.21.15.123:0/2136157928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe124101160 0x7fe1241986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.491+0000 7fe12c6b9640 1 --2- 172.21.15.123:0/2136157928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1241007c0 0x7fe124198170 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.491+0000 7fe12c6b9640 1 -- 172.21.15.123:0/2136157928 >> 172.21.15.123:0/2136157928 conn(0x7fe1240fc500 msgr2=0x7fe1240fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.491+0000 7fe12c6b9640 1 -- 172.21.15.123:0/2136157928 shutdown_connections 2024-08-18T22:13:13.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:13.491+0000 7fe12c6b9640 1 -- 172.21.15.123:0/2136157928 wait complete. 2024-08-18T22:13:13.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:13 smithi123 ceph-mon[18462]: pgmap v503: 129 pgs: 129 active+clean; 45 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.0 MiB/s wr, 2.02k op/s 2024-08-18T22:13:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:13 smithi130 ceph-mon[21698]: pgmap v503: 129 pgs: 129 active+clean; 45 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.0 MiB/s wr, 2.02k op/s 2024-08-18T22:13:13.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:13 smithi183 ceph-mon[22097]: pgmap v503: 129 pgs: 129 active+clean; 45 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.0 MiB/s wr, 2.02k op/s 2024-08-18T22:13:15.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:15 smithi123 ceph-mon[18462]: pgmap v504: 129 pgs: 129 active+clean; 42 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.5 MiB/s wr, 2.22k op/s 2024-08-18T22:13:15.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:15 smithi130 ceph-mon[21698]: pgmap v504: 129 pgs: 129 active+clean; 42 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.5 MiB/s wr, 2.22k op/s 2024-08-18T22:13:15.810 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-18T22:13:15.810 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-18T22:13:15.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:15 smithi183 ceph-mon[22097]: pgmap v504: 129 pgs: 129 active+clean; 42 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.5 MiB/s wr, 2.22k op/s 2024-08-18T22:13:16.077 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:13:16.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.570+0000 7facbcdd2640 1 -- 172.21.15.123:0/465291350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facb81067b0 msgr2=0x7facb8106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:16.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.570+0000 7facbcdd2640 1 --2- 172.21.15.123:0/465291350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facb81067b0 0x7facb8106b90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7faca8009930 tx=0x7faca802a420 comp rx=0 tx=0).stop 2024-08-18T22:13:16.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.571+0000 7facbcdd2640 1 -- 172.21.15.123:0/465291350 shutdown_connections 2024-08-18T22:13:16.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.571+0000 7facbcdd2640 1 --2- 172.21.15.123:0/465291350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facb8101150 0x7facb810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.571+0000 7facbcdd2640 1 --2- 172.21.15.123:0/465291350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facb81007b0 0x7facb8100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.571+0000 7facbcdd2640 1 --2- 172.21.15.123:0/465291350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facb81067b0 0x7facb8106b90 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.571+0000 7facbcdd2640 1 -- 172.21.15.123:0/465291350 >> 172.21.15.123:0/465291350 conn(0x7facb80fc4d0 msgr2=0x7facb80fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:16.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.571+0000 7facbcdd2640 1 -- 172.21.15.123:0/465291350 shutdown_connections 2024-08-18T22:13:16.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.571+0000 7facbcdd2640 1 -- 172.21.15.123:0/465291350 wait complete. 2024-08-18T22:13:16.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.571+0000 7facbcdd2640 1 Processor -- start 2024-08-18T22:13:16.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.571+0000 7facbcdd2640 1 -- start start 2024-08-18T22:13:16.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facbcdd2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facb81007b0 0x7facb8197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facbcdd2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facb8101150 0x7facb81975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facbcdd2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facb81067b0 0x7facb819b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facbcdd2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7facb8110b70 con 0x7facb81067b0 2024-08-18T22:13:16.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facbcdd2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7facb81109f0 con 0x7facb81007b0 2024-08-18T22:13:16.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facbcdd2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7facb8110cf0 con 0x7facb8101150 2024-08-18T22:13:16.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facb659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facb81007b0 0x7facb8197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facb6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facb81067b0 0x7facb819b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facb6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facb81067b0 0x7facb819b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40540/0 (socket says 172.21.15.123:40540) 2024-08-18T22:13:16.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facb6d9d640 1 -- 172.21.15.123:0/3978938168 learned_addr learned my addr 172.21.15.123:0/3978938168 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:16.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facb5d9b640 1 --2- 172.21.15.123:0/3978938168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facb8101150 0x7facb81975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facb6d9d640 1 -- 172.21.15.123:0/3978938168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facb8101150 msgr2=0x7facb81975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:16.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facb6d9d640 1 --2- 172.21.15.123:0/3978938168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facb8101150 0x7facb81975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facb6d9d640 1 -- 172.21.15.123:0/3978938168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facb81007b0 msgr2=0x7facb8197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:16.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facb6d9d640 1 --2- 172.21.15.123:0/3978938168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facb81007b0 0x7facb8197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.572+0000 7facb6d9d640 1 -- 172.21.15.123:0/3978938168 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb819c020 con 0x7facb81067b0 2024-08-18T22:13:16.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.573+0000 7facb6d9d640 1 --2- 172.21.15.123:0/3978938168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facb81067b0 0x7facb819b940 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7facb000eca0 tx=0x7facb000b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:16.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.573+0000 7faca77fe640 1 -- 172.21.15.123:0/3978938168 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb0004b20 con 0x7facb81067b0 2024-08-18T22:13:16.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.573+0000 7facbcdd2640 1 -- 172.21.15.123:0/3978938168 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb819c310 con 0x7facb81067b0 2024-08-18T22:13:16.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.573+0000 7facbcdd2640 1 -- 172.21.15.123:0/3978938168 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb806a4c0 con 0x7facb81067b0 2024-08-18T22:13:16.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.573+0000 7faca77fe640 1 -- 172.21.15.123:0/3978938168 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facb0004cc0 con 0x7facb81067b0 2024-08-18T22:13:16.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.573+0000 7faca77fe640 1 -- 172.21.15.123:0/3978938168 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb0017650 con 0x7facb81067b0 2024-08-18T22:13:16.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.576+0000 7faca77fe640 1 -- 172.21.15.123:0/3978938168 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7facb00177f0 con 0x7facb81067b0 2024-08-18T22:13:16.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.576+0000 7facbf1d0740 1 Processor -- start 2024-08-18T22:13:16.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.576+0000 7facbf1d0740 1 -- start start 2024-08-18T22:13:16.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.576+0000 7facbf1d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d60c0 0x5651e27d64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.576+0000 7facbf1d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27e52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.576+0000 7facbf1d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27e57f0 0x5651e27e7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.576+0000 7facbf1d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5651e2799e40 con 0x5651e27d69e0 2024-08-18T22:13:16.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.576+0000 7facbf1d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5651e273b7f0 con 0x5651e27d60c0 2024-08-18T22:13:16.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.576+0000 7facbf1d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5651e26e2fb0 con 0x5651e27e57f0 2024-08-18T22:13:16.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7facb5d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d60c0 0x5651e27d64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7facb659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27e52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7facb5d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d60c0 0x5651e27d64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:38228/0 (socket says 172.21.15.123:38228) 2024-08-18T22:13:16.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7facb5d9b640 1 -- 172.21.15.123:0/2957523304 learned_addr learned my addr 172.21.15.123:0/2957523304 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:16.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7facb5d9b640 1 --2- 172.21.15.123:0/2957523304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27e57f0 0x5651e27e7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7faca77fe640 1 --2- 172.21.15.123:0/3978938168 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faca00a2b80 0x7faca00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7facb5d9b640 1 -- 172.21.15.123:0/2957523304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27e57f0 msgr2=0x5651e27e7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:16.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7facb5d9b640 1 --2- 172.21.15.123:0/2957523304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27e57f0 0x5651e27e7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7faca77fe640 1 -- 172.21.15.123:0/3978938168 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7facb00d0d30 con 0x7facb81067b0 2024-08-18T22:13:16.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7facb5d9b640 1 -- 172.21.15.123:0/2957523304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 msgr2=0x5651e27e52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:16.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7facb5d9b640 1 --2- 172.21.15.123:0/2957523304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27e52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7facb5d9b640 1 -- 172.21.15.123:0/2957523304 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651e24ad6a0 con 0x5651e27d60c0 2024-08-18T22:13:16.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7facb6d9d640 1 --2- 172.21.15.123:0/3978938168 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faca00a2b80 0x7faca00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7facb659c640 1 --2- 172.21.15.123:0/2957523304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27e52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:16.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7facb5d9b640 1 --2- 172.21.15.123:0/2957523304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d60c0 0x5651e27d64a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7facac0149c0 tx=0x7facac00c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2323d1cd7cb83a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:16.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.577+0000 7faca4ff9640 1 -- 172.21.15.123:0/2957523304 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac0142d0 con 0x5651e27d60c0 2024-08-18T22:13:16.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.578+0000 7facb6d9d640 1 --2- 172.21.15.123:0/3978938168 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faca00a2b80 0x7faca00a5040 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7facb000bfd0 tx=0x7facb000ef70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:16.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.578+0000 7faca4ff9640 1 -- 172.21.15.123:0/2957523304 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facac00fc40 con 0x5651e27d60c0 2024-08-18T22:13:16.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.578+0000 7faca4ff9640 1 -- 172.21.15.123:0/2957523304 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac012b20 con 0x5651e27d60c0 2024-08-18T22:13:16.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.578+0000 7facbf1d0740 1 -- 172.21.15.123:0/2957523304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d60c0 msgr2=0x5651e27d64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:16.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.578+0000 7facbf1d0740 1 --2- 172.21.15.123:0/2957523304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d60c0 0x5651e27d64a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7facac0149c0 tx=0x7facac00c4d0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.579+0000 7facbf1d0740 1 -- 172.21.15.123:0/2957523304 shutdown_connections 2024-08-18T22:13:16.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.579+0000 7facbf1d0740 1 --2- 172.21.15.123:0/2957523304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27e57f0 0x5651e27e7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.579+0000 7facbf1d0740 1 --2- 172.21.15.123:0/2957523304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27e52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.579+0000 7facbf1d0740 1 --2- 172.21.15.123:0/2957523304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d60c0 0x5651e27d64a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.579+0000 7facbf1d0740 1 -- 172.21.15.123:0/2957523304 >> 172.21.15.123:0/2957523304 conn(0x5651e27d2790 msgr2=0x5651e27d2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:16.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.579+0000 7facbf1d0740 1 -- 172.21.15.123:0/2957523304 shutdown_connections 2024-08-18T22:13:16.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.579+0000 7facbf1d0740 1 -- 172.21.15.123:0/2957523304 wait complete. 2024-08-18T22:13:16.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.579+0000 7facbf1d0740 1 -- start start 2024-08-18T22:13:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.579+0000 7facbf1d0740 1 Processor -- start 2024-08-18T22:13:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.579+0000 7facbf1d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27d60c0 0x5651e27e2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.579+0000 7facbf1d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d69e0 0x5651e27e2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facbf1d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27e57f0 0x5651e27e3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facbf1d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5651e26f6cb0 con 0x5651e27e57f0 2024-08-18T22:13:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facbf1d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5651e27377b0 con 0x5651e27d69e0 2024-08-18T22:13:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facbf1d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5651e27e83c0 con 0x5651e27d60c0 2024-08-18T22:13:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facbf1d0740 10 client.0 _ll_register_callbacks cb 0x5651e244aba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facb5d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27d60c0 0x5651e27e2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facb659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d69e0 0x5651e27e2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facb5d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27d60c0 0x5651e27e2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:52648/0 (socket says 172.21.15.123:52648) 2024-08-18T22:13:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facb5d9b640 1 -- 172.21.15.123:0/3761152769 learned_addr learned my addr 172.21.15.123:0/3761152769 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facb5d9b640 1 --2- 172.21.15.123:0/3761152769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27e57f0 0x5651e27e3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facb659c640 1 -- 172.21.15.123:0/3761152769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27d60c0 msgr2=0x5651e27e2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facb659c640 1 --2- 172.21.15.123:0/3761152769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27d60c0 0x5651e27e2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facb659c640 1 -- 172.21.15.123:0/3761152769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27e57f0 msgr2=0x5651e27e3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facb659c640 1 --2- 172.21.15.123:0/3761152769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27e57f0 0x5651e27e3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facb659c640 1 -- 172.21.15.123:0/3761152769 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651e26f5bc0 con 0x5651e27d69e0 2024-08-18T22:13:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facb659c640 1 --2- 172.21.15.123:0/3761152769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d69e0 0x5651e27e2c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faca8005940 tx=0x7faca80317e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac1ed8a989cc1b3d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7fac9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:13:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7fac9dffb640 1 -- 172.21.15.123:0/3761152769 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8035040 con 0x5651e27d69e0 2024-08-18T22:13:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7facbf1d0740 1 -- 172.21.15.123:0/3761152769 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facac00fc40 con 0x5651e27d69e0 2024-08-18T22:13:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.580+0000 7fac9dffb640 1 -- 172.21.15.123:0/3761152769 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7faca8004240 con 0x5651e27d69e0 2024-08-18T22:13:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.581+0000 7fac9dffb640 1 -- 172.21.15.123:0/3761152769 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faca804f050 con 0x5651e27d69e0 2024-08-18T22:13:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.581+0000 7facbf1d0740 10 client.25829 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.581+0000 7facbf1d0740 1 -- 172.21.15.123:0/3761152769 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5651e27f4330 con 0x5651e27d69e0 2024-08-18T22:13:16.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.581+0000 7fac9dffb640 1 -- 172.21.15.123:0/3761152769 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facac00fc40 con 0x5651e27d69e0 2024-08-18T22:13:16.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.581+0000 7fac9dffb640 1 -- 172.21.15.123:0/3761152769 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7faca8046510 con 0x5651e27d69e0 2024-08-18T22:13:16.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.581+0000 7facbf1d0740 10 client.25829 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:16.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.581+0000 7facbf1d0740 10 client.25829 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:16.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.581+0000 7facbf1d0740 20 client.25829 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:16.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.581+0000 7facbf1d0740 1 --2- 172.21.15.123:0/3761152769 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5651e27f5840 0x5651e27f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.581+0000 7facbf1d0740 4 client.25829 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:13:16.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.581+0000 7facbf1d0740 1 -- 172.21.15.123:0/3761152769 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651e2748d60 con 0x5651e27f5840 2024-08-18T22:13:16.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.581+0000 7facb5d9b640 1 --2- 172.21.15.123:0/3761152769 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5651e27f5840 0x5651e27f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.582+0000 7facb5d9b640 1 --2- 172.21.15.123:0/3761152769 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5651e27f5840 0x5651e27f7c60 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e633ed171d7baa8 server_cookie=6a1e9adb56188966 in_seq=0 out_seq=0 2024-08-18T22:13:16.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.582+0000 7fac9dffb640 10 client.25829 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:16.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.582+0000 7fac9dffb640 1 -- 172.21.15.123:0/3761152769 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651e2748d60 con 0x5651e27f5840 2024-08-18T22:13:16.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.582+0000 7fac9dffb640 10 client.25829 handle_command_reply: tid=0 2024-08-18T22:13:16.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.582+0000 7facbf1d0740 1 client.25829 shutdown 2024-08-18T22:13:16.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.583+0000 7facbf1d0740 1 -- 172.21.15.123:0/3761152769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d69e0 msgr2=0x5651e27e2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:16.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.583+0000 7facbf1d0740 1 --2- 172.21.15.123:0/3761152769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d69e0 0x5651e27e2c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faca8005940 tx=0x7faca80317e0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.583+0000 7facbf1d0740 1 -- 172.21.15.123:0/3761152769 shutdown_connections 2024-08-18T22:13:16.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.583+0000 7facbf1d0740 1 --2- 172.21.15.123:0/3761152769 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5651e27f5840 0x5651e27f7c60 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.583+0000 7facbf1d0740 1 --2- 172.21.15.123:0/3761152769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27e57f0 0x5651e27e3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.583+0000 7facbf1d0740 1 --2- 172.21.15.123:0/3761152769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d69e0 0x5651e27e2c40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.583+0000 7fac9dffb640 0 client.25829 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:16.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.583+0000 7facbf1d0740 1 --2- 172.21.15.123:0/3761152769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27d60c0 0x5651e27e2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.583+0000 7facbf1d0740 1 -- 172.21.15.123:0/3761152769 >> 172.21.15.123:0/3761152769 conn(0x5651e27d2790 msgr2=0x5651e27d84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:16.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.583+0000 7facbf1d0740 1 -- 172.21.15.123:0/3761152769 shutdown_connections 2024-08-18T22:13:16.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.583+0000 7facbf1d0740 1 -- 172.21.15.123:0/3761152769 wait complete. 2024-08-18T22:13:16.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.583+0000 7facbf1d0740 20 client.25829 trim_cache size 0 max 16384 2024-08-18T22:13:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.601+0000 7facbf1d0740 1 Processor -- start 2024-08-18T22:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.601+0000 7facbf1d0740 1 -- start start 2024-08-18T22:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.601+0000 7facbf1d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d60c0 0x5651e27e2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.601+0000 7facbf1d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27fd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.601+0000 7facbf1d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27e57f0 0x5651e27fda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.601+0000 7facbf1d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fac98012460 con 0x5651e27d69e0 2024-08-18T22:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.601+0000 7facbf1d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac9800fd30 con 0x5651e27d60c0 2024-08-18T22:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.601+0000 7facbf1d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fac9800db80 con 0x5651e27e57f0 2024-08-18T22:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.602+0000 7facb659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27fd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.602+0000 7facb5d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27e57f0 0x5651e27fda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.602+0000 7facb659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27fd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40568/0 (socket says 172.21.15.123:40568) 2024-08-18T22:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.602+0000 7facb5d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27e57f0 0x5651e27fda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:52654/0 (socket says 172.21.15.123:52654) 2024-08-18T22:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.602+0000 7facb659c640 1 -- 172.21.15.123:0/3292796468 learned_addr learned my addr 172.21.15.123:0/3292796468 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.602+0000 7facb5d9b640 1 --2- 172.21.15.123:0/3292796468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d60c0 0x5651e27e2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.602+0000 7facb659c640 1 -- 172.21.15.123:0/3292796468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27e57f0 msgr2=0x5651e27fda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.602+0000 7facb659c640 1 --2- 172.21.15.123:0/3292796468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27e57f0 0x5651e27fda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.602+0000 7facb659c640 1 -- 172.21.15.123:0/3292796468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d60c0 msgr2=0x5651e27e2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.602+0000 7facb659c640 1 --2- 172.21.15.123:0/3292796468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d60c0 0x5651e27e2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.602+0000 7facb659c640 1 -- 172.21.15.123:0/3292796468 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651e27f7fd0 con 0x5651e27d69e0 2024-08-18T22:13:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.602+0000 7facb659c640 1 --2- 172.21.15.123:0/3292796468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27fd530 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7faca8001eb0 tx=0x7faca8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05dfd9093eeff5e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.602+0000 7fac9ffff640 1 -- 172.21.15.123:0/3292796468 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8000e60 con 0x5651e27d69e0 2024-08-18T22:13:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.602+0000 7fac9ffff640 1 -- 172.21.15.123:0/3292796468 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faca8046680 con 0x5651e27d69e0 2024-08-18T22:13:16.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.602+0000 7fac9ffff640 1 -- 172.21.15.123:0/3292796468 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8035030 con 0x5651e27d69e0 2024-08-18T22:13:16.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.603+0000 7facbf1d0740 1 -- 172.21.15.123:0/3292796468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 msgr2=0x5651e27fd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:16.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.603+0000 7facbf1d0740 1 --2- 172.21.15.123:0/3292796468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27fd530 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7faca8001eb0 tx=0x7faca8000bc0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.603+0000 7facbf1d0740 1 -- 172.21.15.123:0/3292796468 shutdown_connections 2024-08-18T22:13:16.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.603+0000 7facbf1d0740 1 --2- 172.21.15.123:0/3292796468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27e57f0 0x5651e27fda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.603+0000 7facbf1d0740 1 --2- 172.21.15.123:0/3292796468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27fd530 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.603+0000 7facbf1d0740 1 --2- 172.21.15.123:0/3292796468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27d60c0 0x5651e27e2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.603+0000 7facbf1d0740 1 -- 172.21.15.123:0/3292796468 >> 172.21.15.123:0/3292796468 conn(0x5651e27d2790 msgr2=0x5651e27d18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:16.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.603+0000 7facbf1d0740 1 -- 172.21.15.123:0/3292796468 shutdown_connections 2024-08-18T22:13:16.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.603+0000 7facbf1d0740 1 -- 172.21.15.123:0/3292796468 wait complete. 2024-08-18T22:13:16.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facbf1d0740 1 -- start start 2024-08-18T22:13:16.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facbf1d0740 1 Processor -- start 2024-08-18T22:13:16.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facbf1d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27d60c0 0x5651e27edc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facbf1d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27e9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facbf1d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27e57f0 0x5651e27e9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facbf1d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fac9800e1f0 con 0x5651e27d69e0 2024-08-18T22:13:16.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facbf1d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac9800f660 con 0x5651e27e57f0 2024-08-18T22:13:16.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facbf1d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fac9800e8c0 con 0x5651e27d60c0 2024-08-18T22:13:16.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facbf1d0740 10 client.0 _ll_register_callbacks cb 0x7faca8005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:16.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facb659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facb5d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27d60c0 0x5651e27edc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facb5d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27d60c0 0x5651e27edc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:52666/0 (socket says 172.21.15.123:52666) 2024-08-18T22:13:16.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facb5d9b640 1 -- 172.21.15.123:0/1175388469 learned_addr learned my addr 172.21.15.123:0/1175388469 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:16.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facb5d9b640 1 --2- 172.21.15.123:0/1175388469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27e57f0 0x5651e27e9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facb659c640 1 -- 172.21.15.123:0/1175388469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27d60c0 msgr2=0x5651e27edc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:16.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facb659c640 1 --2- 172.21.15.123:0/1175388469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27d60c0 0x5651e27edc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facb659c640 1 -- 172.21.15.123:0/1175388469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27e57f0 msgr2=0x5651e27e9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:16.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facb659c640 1 --2- 172.21.15.123:0/1175388469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27e57f0 0x5651e27e9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facb659c640 1 -- 172.21.15.123:0/1175388469 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651e27e9b90 con 0x5651e27d69e0 2024-08-18T22:13:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.604+0000 7facb5d9b640 1 --2- 172.21.15.123:0/1175388469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27d60c0 0x5651e27edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.605+0000 7facb659c640 1 --2- 172.21.15.123:0/1175388469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27e9010 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x5651e27e3db0 tx=0x7faca803d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697792552c737fff server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.605+0000 7fac9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:13:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.605+0000 7fac9dffb640 1 -- 172.21.15.123:0/1175388469 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8060060 con 0x5651e27d69e0 2024-08-18T22:13:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.605+0000 7fac9dffb640 1 -- 172.21.15.123:0/1175388469 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7faca803da00 con 0x5651e27d69e0 2024-08-18T22:13:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.605+0000 7facbf1d0740 1 -- 172.21.15.123:0/1175388469 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faca8046680 con 0x5651e27d69e0 2024-08-18T22:13:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.605+0000 7fac9dffb640 1 -- 172.21.15.123:0/1175388469 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faca8067050 con 0x5651e27d69e0 2024-08-18T22:13:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.605+0000 7facbf1d0740 10 client.16515 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.605+0000 7facbf1d0740 1 -- 172.21.15.123:0/1175388469 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5651e2860350 con 0x5651e27d69e0 2024-08-18T22:13:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.605+0000 7fac9dffb640 1 -- 172.21.15.123:0/1175388469 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faca8046680 con 0x5651e27d69e0 2024-08-18T22:13:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.605+0000 7fac9dffb640 1 -- 172.21.15.123:0/1175388469 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7faca803dc40 con 0x5651e27d69e0 2024-08-18T22:13:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.606+0000 7facbf1d0740 10 client.16515 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:16.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.606+0000 7facbf1d0740 10 client.16515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:16.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.606+0000 7facbf1d0740 20 client.16515 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:16.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.606+0000 7facbf1d0740 1 --2- 172.21.15.123:0/1175388469 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5651e28609c0 0x5651e2862de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:16.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.606+0000 7facbf1d0740 4 client.16515 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-18T22:13:16.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.606+0000 7facbf1d0740 1 -- 172.21.15.123:0/1175388469 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5651e2743270 con 0x5651e28609c0 2024-08-18T22:13:16.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.606+0000 7facb5d9b640 1 --2- 172.21.15.123:0/1175388469 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5651e28609c0 0x5651e2862de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:16.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.606+0000 7facb5d9b640 1 --2- 172.21.15.123:0/1175388469 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5651e28609c0 0x5651e2862de0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf6abfec9514e51c server_cookie=d883d2f00b0f37f4 in_seq=0 out_seq=0 2024-08-18T22:13:16.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.606+0000 7fac9dffb640 10 client.16515 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:16.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.609+0000 7fac9dffb640 1 -- 172.21.15.123:0/1175388469 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5651e2743270 con 0x5651e28609c0 2024-08-18T22:13:16.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.609+0000 7fac9dffb640 10 client.16515 handle_command_reply: tid=0 2024-08-18T22:13:16.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.609+0000 7facbf1d0740 1 client.16515 shutdown 2024-08-18T22:13:16.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.609+0000 7facbf1d0740 1 -- 172.21.15.123:0/1175388469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 msgr2=0x5651e27e9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:16.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.609+0000 7facbf1d0740 1 --2- 172.21.15.123:0/1175388469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27e9010 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x5651e27e3db0 tx=0x7faca803d680 comp rx=0 tx=0).stop 2024-08-18T22:13:16.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.609+0000 7facbf1d0740 1 -- 172.21.15.123:0/1175388469 shutdown_connections 2024-08-18T22:13:16.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.609+0000 7facbf1d0740 1 --2- 172.21.15.123:0/1175388469 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5651e28609c0 0x5651e2862de0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.609+0000 7fac9dffb640 0 client.16515 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:16.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.609+0000 7facbf1d0740 1 --2- 172.21.15.123:0/1175388469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651e27e57f0 0x5651e27e9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.609+0000 7facbf1d0740 1 --2- 172.21.15.123:0/1175388469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5651e27d69e0 0x5651e27e9010 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.609+0000 7facbf1d0740 1 --2- 172.21.15.123:0/1175388469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651e27d60c0 0x5651e27edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.609+0000 7facbf1d0740 1 -- 172.21.15.123:0/1175388469 >> 172.21.15.123:0/1175388469 conn(0x5651e27d2790 msgr2=0x5651e27d10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:16.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.609+0000 7facbf1d0740 1 -- 172.21.15.123:0/1175388469 shutdown_connections 2024-08-18T22:13:16.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.609+0000 7facbf1d0740 1 -- 172.21.15.123:0/1175388469 wait complete. 2024-08-18T22:13:16.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.609+0000 7facbf1d0740 20 client.16515 trim_cache size 0 max 16384 2024-08-18T22:13:16.614 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:13:16.615 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-08-18T22:13:16.615 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "866ef279-02bd-40d8-80eb-1c218cf47e2d", 2024-08-18T22:13:16.615 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-08-18T22:13:16.615 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:13:16.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.610+0000 7facbcdd2640 1 -- 172.21.15.123:0/3978938168 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faca00a2b80 msgr2=0x7faca00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:16.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.610+0000 7facbcdd2640 1 --2- 172.21.15.123:0/3978938168 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faca00a2b80 0x7faca00a5040 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7facb000bfd0 tx=0x7facb000ef70 comp rx=0 tx=0).stop 2024-08-18T22:13:16.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.610+0000 7facbcdd2640 1 -- 172.21.15.123:0/3978938168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facb81067b0 msgr2=0x7facb819b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:16.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.610+0000 7facbcdd2640 1 --2- 172.21.15.123:0/3978938168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facb81067b0 0x7facb819b940 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7facb000eca0 tx=0x7facb000b690 comp rx=0 tx=0).stop 2024-08-18T22:13:16.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.610+0000 7facbcdd2640 1 -- 172.21.15.123:0/3978938168 shutdown_connections 2024-08-18T22:13:16.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.610+0000 7facbcdd2640 1 --2- 172.21.15.123:0/3978938168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facb81067b0 0x7facb819b940 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.610+0000 7facbcdd2640 1 --2- 172.21.15.123:0/3978938168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facb8101150 0x7facb81975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.610+0000 7facbcdd2640 1 --2- 172.21.15.123:0/3978938168 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7faca00a2b80 0x7faca00a5040 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.610+0000 7facbcdd2640 1 --2- 172.21.15.123:0/3978938168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facb81007b0 0x7facb8197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:16.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.610+0000 7facbcdd2640 1 -- 172.21.15.123:0/3978938168 >> 172.21.15.123:0/3978938168 conn(0x7facb80fc4d0 msgr2=0x7facb80fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:16.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.610+0000 7facbcdd2640 1 -- 172.21.15.123:0/3978938168 shutdown_connections 2024-08-18T22:13:16.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:16.610+0000 7facbcdd2640 1 -- 172.21.15.123:0/3978938168 wait complete. 2024-08-18T22:13:17.322 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-18T22:13:17.603 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:13:17.729 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:17 smithi123 ceph-mon[18462]: pgmap v505: 129 pgs: 129 active+clean; 45 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.1 MiB/s wr, 2.25k op/s 2024-08-18T22:13:17.729 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:17 smithi123 ceph-mon[18462]: scrub queued for path: / 2024-08-18T22:13:17.729 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:17 smithi123 ceph-mon[18462]: scrub summary: idle+waiting paths [/] 2024-08-18T22:13:17.729 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:17 smithi123 ceph-mon[18462]: scrub summary: active paths [/] 2024-08-18T22:13:17.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-mon[21698]: pgmap v505: 129 pgs: 129 active+clean; 45 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.1 MiB/s wr, 2.25k op/s 2024-08-18T22:13:17.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-mon[21698]: scrub queued for path: / 2024-08-18T22:13:17.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-mon[21698]: scrub summary: idle+waiting paths [/] 2024-08-18T22:13:17.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-mon[21698]: scrub summary: active paths [/] 2024-08-18T22:13:17.774 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.407+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000050c4 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5001 auth v2955 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73190c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000050c4:[<0x10000000271/file5001 v2955>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000050c4:[<0x10000000271/file5001 v2955>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.774 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.408+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004b0a [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4351 auth v2945 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73183080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004b0a:[<0x10000000271/file4351 v2945>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004b0a:[<0x10000000271/file4351 v2945>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.774 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.408+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004a78 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4278 auth v2941 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be7138ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004a78:[<0x10000000271/file4278 v2941>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004a78:[<0x10000000271/file4278 v2941>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.774 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.408+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000053c6 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5337 auth v2975 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6cc1d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000053c6:[<0x10000000271/file5337 v2975>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000053c6:[<0x10000000271/file5337 v2975>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.774 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.408+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005805 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5811 auth v2985 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be7138b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005805:[<0x10000000271/file5811 v2985>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005805:[<0x10000000271/file5811 v2985>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.774 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.409+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004e99 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4762 auth v2951 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be7316b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004e99:[<0x10000000271/file4762 v2951>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004e99:[<0x10000000271/file4762 v2951>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.774 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.409+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000550d [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5478 auth v2981 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6e174580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000550d:[<0x10000000271/file5478 v2981>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000550d:[<0x10000000271/file5478 v2981>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.774 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.409+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004761 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3931 auth v2939 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6e174b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004761:[<0x10000000271/file3931 v2939>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004761:[<0x10000000271/file3931 v2939>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.774 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.410+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004285 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3556 auth v2922 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6e175080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004285:[<0x10000000271/file3556 v2922>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004285:[<0x10000000271/file3556 v2922>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.775 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.410+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005c50 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6296 auth v2999 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6e176c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005c50:[<0x10000000271/file6296 v2999>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005c50:[<0x10000000271/file6296 v2999>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.775 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.410+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000045f2 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3761 auth v2931 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6e177180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000045f2:[<0x10000000271/file3761 v2931>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000045f2:[<0x10000000271/file3761 v2931>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.775 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.410+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000523c [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5172 auth v2963 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6e177700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000523c:[<0x10000000271/file5172 v2963>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000523c:[<0x10000000271/file5172 v2963>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.775 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.410+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005845 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5843 auth v2987 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f4d4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005845:[<0x10000000271/file5843 v2987>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005845:[<0x10000000271/file5843 v2987>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.775 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.410+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000059a5 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5998 auth v2989 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f4d4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000059a5:[<0x10000000271/file5998 v2989>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000059a5:[<0x10000000271/file5998 v2989>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.775 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.411+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005430 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5384 auth v2977 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f4d5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005430:[<0x10000000271/file5384 v2977>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005430:[<0x10000000271/file5384 v2977>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.775 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.411+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004af0 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4338 auth v2943 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f4d5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004af0:[<0x10000000271/file4338 v2943>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004af0:[<0x10000000271/file4338 v2943>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.775 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.411+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000006438 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7198 auth{0=1} v3028 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be6f4d7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000006438:[<0x10000000271/file7198 v3028>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000006438:[<0x10000000271/file7198 v3028>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.775 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.412+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000006266 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6962 auth{0=1} v3016 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be6f4d6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000006266:[<0x10000000271/file6962 v3016>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000006266:[<0x10000000271/file6962 v3016>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.775 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.412+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000052a0 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5216 auth v2969 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f4d7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000052a0:[<0x10000000271/file5216 v2969>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000052a0:[<0x10000000271/file5216 v2969>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.775 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.412+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005c88 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6320 auth v3001 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f4da000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005c88:[<0x10000000271/file6320 v3001>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005c88:[<0x10000000271/file6320 v3001>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.776 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.412+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005f32 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6617 auth v3005 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f4dab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005f32:[<0x10000000271/file6617 v3005>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005f32:[<0x10000000271/file6617 v3005>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.776 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.412+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000063d8 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7149 auth{0=1} v3026 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be6f4dbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000063d8:[<0x10000000271/file7149 v3026>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000063d8:[<0x10000000271/file7149 v3026>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.776 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.413+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000052a5 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5218 auth v2971 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f4dc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000052a5:[<0x10000000271/file5218 v2971>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000052a5:[<0x10000000271/file5218 v2971>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.776 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.413+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000513b [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5057 auth v2957 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f4dc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000513b:[<0x10000000271/file5057 v2957>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000513b:[<0x10000000271/file5057 v2957>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.776 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.413+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000052fa [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5252 auth v2973 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f4dd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000052fa:[<0x10000000271/file5252 v2973>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000052fa:[<0x10000000271/file5252 v2973>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.776 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.413+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000051fe [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5145 auth v2961 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f4dcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000051fe:[<0x10000000271/file5145 v2961>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000051fe:[<0x10000000271/file5145 v2961>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.776 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.413+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005afe [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6150 auth v2995 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6ddc4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005afe:[<0x10000000271/file6150 v2995>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005afe:[<0x10000000271/file6150 v2995>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.776 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.414+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000525a [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5184 auth v2965 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6ddc4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000525a:[<0x10000000271/file5184 v2965>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000525a:[<0x10000000271/file5184 v2965>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.776 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.414+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000633f [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7069 auth{0=1} v3020 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be6ddc5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000633f:[<0x10000000271/file7069 v3020>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000633f:[<0x10000000271/file7069 v3020>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.777 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.414+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005a9a [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6107 auth v2993 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6ddc6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005a9a:[<0x10000000271/file6107 v2993>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005a9a:[<0x10000000271/file6107 v2993>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.777 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.414+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004bab [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4428 auth v2947 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6ddc7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004bab:[<0x10000000271/file4428 v2947>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004bab:[<0x10000000271/file4428 v2947>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.777 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.414+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000063d4 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7147 auth{0=1} v3024 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be6ddc7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000063d4:[<0x10000000271/file7147 v3024>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000063d4:[<0x10000000271/file7147 v3024>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.777 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.415+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000516a [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5078 auth v2959 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6fcec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000516a:[<0x10000000271/file5078 v2959>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000516a:[<0x10000000271/file5078 v2959>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.777 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.416+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000046d9 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3871 auth v2937 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6fcef700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000046d9:[<0x10000000271/file3871 v2937>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000046d9:[<0x10000000271/file3871 v2937>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.777 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.416+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005276 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5196 auth v2967 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6fcf2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005276:[<0x10000000271/file5196 v2967>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005276:[<0x10000000271/file5196 v2967>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.777 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.416+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005f39 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6620 auth v3007 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6fcf3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005f39:[<0x10000000271/file6620 v3007>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005f39:[<0x10000000271/file6620 v3007>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.777 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.416+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000446b [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3650 auth v2926 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6fcf3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000446b:[<0x10000000271/file3650 v2926>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000446b:[<0x10000000271/file3650 v2926>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.777 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.417+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000623b [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6941 auth{0=1} v3014 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be6fcf5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000623b:[<0x10000000271/file6941 v3014>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000623b:[<0x10000000271/file6941 v3014>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.777 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.417+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000043e4 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3623 auth v2924 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6fcfe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000043e4:[<0x10000000271/file3623 v2924>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000043e4:[<0x10000000271/file3623 v2924>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.778 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.418+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004cc4 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4555 auth v2949 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6fcff080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004cc4:[<0x10000000271/file4555 v2949>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004cc4:[<0x10000000271/file4555 v2949>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.778 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.418+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005ea4 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6559 auth v3003 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6fcff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005ea4:[<0x10000000271/file6559 v3003>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005ea4:[<0x10000000271/file6559 v3003>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.778 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.418+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000006347 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7073 auth{0=1} v3022 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be6fd00100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000006347:[<0x10000000271/file7073 v3022>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000006347:[<0x10000000271/file7073 v3022>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.778 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.418+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000054dc [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5455 auth v2979 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6fd01180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000054dc:[<0x10000000271/file5455 v2979>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000054dc:[<0x10000000271/file5455 v2979>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.778 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.419+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004660 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3815 auth v2933 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73809080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004660:[<0x10000000271/file3815 v2933>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004660:[<0x10000000271/file3815 v2933>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.778 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.419+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005b43 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6182 auth v2997 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73809600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005b43:[<0x10000000271/file6182 v2997>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005b43:[<0x10000000271/file6182 v2997>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.778 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.420+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000055b5 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5552 auth v2983 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be7380a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000055b5:[<0x10000000271/file5552 v2983>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000055b5:[<0x10000000271/file5552 v2983>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.778 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.420+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004fd0 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4896 auth v2953 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be7380a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004fd0:[<0x10000000271/file4896 v2953>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004fd0:[<0x10000000271/file4896 v2953>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.778 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.420+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000061bf [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6879 auth{0=1} v3012 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be7380b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000061bf:[<0x10000000271/file6879 v3012>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000061bf:[<0x10000000271/file6879 v3012>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.778 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.420+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000059d3 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6019 auth v2991 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be7380b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000059d3:[<0x10000000271/file6019 v2991>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000059d3:[<0x10000000271/file6019 v2991>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.778 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.421+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000062cf [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7015 auth{0=1} v3018 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be73811600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000062cf:[<0x10000000271/file7015 v3018>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000062cf:[<0x10000000271/file7015 v3018>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.779 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.421+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000006179 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6855 auth{0=1} v3010 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be73811b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000006179:[<0x10000000271/file6855 v3010>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000006179:[<0x10000000271/file6855 v3010>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.779 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.421+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000045b6 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3731 auth v2929 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73812100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000045b6:[<0x10000000271/file3731 v2929>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000045b6:[<0x10000000271/file3731 v2929>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.779 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.421+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000046aa [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3849 auth v2935 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73812680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000046aa:[<0x10000000271/file3849 v2935>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000046aa:[<0x10000000271/file3849 v2935>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.779 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.421+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004f2e [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4826 auth v1100 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f31a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004f2e:[<0x10000000271/file4826 v1100>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004f2e:[<0x10000000271/file4826 v1100>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.779 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.421+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004d09 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4585 auth v1092 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f31b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004d09:[<0x10000000271/file4585 v1092>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004d09:[<0x10000000271/file4585 v1092>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.779 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.421+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005b48 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6184 auth v1144 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f31ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005b48:[<0x10000000271/file6184 v1144>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005b48:[<0x10000000271/file6184 v1144>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.779 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.422+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000065a2 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7329 auth{0=1} v1169 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be6f31bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000065a2:[<0x10000000271/file7329 v1169>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000065a2:[<0x10000000271/file7329 v1169>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.779 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.422+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005b52 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6188 auth v1146 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f31c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005b52:[<0x10000000271/file6188 v1146>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005b52:[<0x10000000271/file6188 v1146>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.779 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.422+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f77 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3399 auth v1051 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f31cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000003f77:[<0x10000000271/file3399 v1051>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000003f77:[<0x10000000271/file3399 v1051>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.779 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.423+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000006005 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6707 auth v1160 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f31d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000006005:[<0x10000000271/file6707 v1160>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000006005:[<0x10000000271/file6707 v1160>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.779 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.423+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004e35 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4722 auth v1094 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be736dc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004e35:[<0x10000000271/file4722 v1094>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004e35:[<0x10000000271/file4722 v1094>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.780 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.423+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005901 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5930 auth v1130 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be736dc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005901:[<0x10000000271/file5930 v1130>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005901:[<0x10000000271/file5930 v1130>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.780 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.423+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000064ad [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7261 auth{0=1} v1167 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be736dcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000064ad:[<0x10000000271/file7261 v1167>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000064ad:[<0x10000000271/file7261 v1167>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.780 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.423+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000060bd [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6798 auth v1162 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be736ddb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000060bd:[<0x10000000271/file6798 v1162>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000060bd:[<0x10000000271/file6798 v1162>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.780 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.424+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004b7c [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4406 auth v1090 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be736dec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004b7c:[<0x10000000271/file4406 v1090>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004b7c:[<0x10000000271/file4406 v1090>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.780 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.424+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000514f [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5066 auth v1106 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be736de680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000514f:[<0x10000000271/file5066 v1106>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000514f:[<0x10000000271/file5066 v1106>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.780 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.424+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004a06 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4227 auth v1086 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be736e4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004a06:[<0x10000000271/file4227 v1086>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004a06:[<0x10000000271/file4227 v1086>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.780 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.424+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000040b2 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3462 auth v1055 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be736e5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000040b2:[<0x10000000271/file3462 v1055>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000040b2:[<0x10000000271/file3462 v1055>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.780 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.425+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005a52 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6076 auth v1140 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be736e6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005a52:[<0x10000000271/file6076 v1140>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005a52:[<0x10000000271/file6076 v1140>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.780 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.425+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000458f [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3716 auth v1070 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be736e6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000458f:[<0x10000000271/file3716 v1070>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000458f:[<0x10000000271/file3716 v1070>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.780 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.425+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000053e3 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5351 auth v1116 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be736e7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000053e3:[<0x10000000271/file5351 v1116>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000053e3:[<0x10000000271/file5351 v1116>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.780 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.425+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004538 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3689 auth v1068 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be736e6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004538:[<0x10000000271/file3689 v1068>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004538:[<0x10000000271/file3689 v1068>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.781 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.425+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000040b7 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3463 auth v1057 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737a2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000040b7:[<0x10000000271/file3463 v1057>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000040b7:[<0x10000000271/file3463 v1057>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.781 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.426+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005594 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5537 auth v1122 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737a3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005594:[<0x10000000271/file5537 v1122>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005594:[<0x10000000271/file5537 v1122>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.781 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.426+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005e14 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6495 auth v1152 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737a4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005e14:[<0x10000000271/file6495 v1152>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005e14:[<0x10000000271/file6495 v1152>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.781 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.426+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004f5c [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4847 auth v1102 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737a4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004f5c:[<0x10000000271/file4847 v1102>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004f5c:[<0x10000000271/file4847 v1102>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.781 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.426+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000042ac [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3563 auth v1061 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737a5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000042ac:[<0x10000000271/file3563 v1061>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000042ac:[<0x10000000271/file3563 v1061>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.781 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.427+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005360 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5294 auth v1112 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737aa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005360:[<0x10000000271/file5294 v1112>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005360:[<0x10000000271/file5294 v1112>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.781 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.427+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000464c [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3805 auth v1074 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737aa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000464c:[<0x10000000271/file3805 v1074>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000464c:[<0x10000000271/file3805 v1074>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.781 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.427+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005a37 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6063 auth v1138 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737abb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005a37:[<0x10000000271/file6063 v1138>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005a37:[<0x10000000271/file6063 v1138>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.781 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.427+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000059df [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6024 auth v1134 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737ac680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000059df:[<0x10000000271/file6024 v1134>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000059df:[<0x10000000271/file6024 v1134>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.781 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.428+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005f27 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6612 auth v1156 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737ad180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005f27:[<0x10000000271/file6612 v1156>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005f27:[<0x10000000271/file6612 v1156>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.781 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.428+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000511b [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5041 auth v1104 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737b8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000511b:[<0x10000000271/file5041 v1104>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000511b:[<0x10000000271/file5041 v1104>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.781 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.428+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000057f1 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5802 auth v1128 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737b8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000057f1:[<0x10000000271/file5802 v1128>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000057f1:[<0x10000000271/file5802 v1128>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.782 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.428+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005e6a [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6533 auth v1154 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737b9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005e6a:[<0x10000000271/file6533 v1154>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005e6a:[<0x10000000271/file6533 v1154>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.782 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.429+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004652 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3808 auth v1076 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737bb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004652:[<0x10000000271/file3808 v1076>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004652:[<0x10000000271/file3808 v1076>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.782 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.429+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004475 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3652 auth v1065 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737bac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004475:[<0x10000000271/file3652 v1065>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004475:[<0x10000000271/file3652 v1065>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.782 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.429+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000461c [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3782 auth v1072 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737bb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000461c:[<0x10000000271/file3782 v1072>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000461c:[<0x10000000271/file3782 v1072>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.782 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.430+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005dae [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6449 auth v1150 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737c4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005dae:[<0x10000000271/file6449 v1150>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005dae:[<0x10000000271/file6449 v1150>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.782 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.430+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004993 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4176 auth v1084 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737c5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004993:[<0x10000000271/file4176 v1084>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004993:[<0x10000000271/file4176 v1084>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.782 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.430+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005a1e [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6052 auth v1136 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737c5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005a1e:[<0x10000000271/file6052 v1136>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005a1e:[<0x10000000271/file6052 v1136>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.782 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.430+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004a72 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4275 auth v1088 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737c6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004a72:[<0x10000000271/file4275 v1088>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004a72:[<0x10000000271/file4275 v1088>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.782 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.430+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005c42 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6290 auth v1148 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737c6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005c42:[<0x10000000271/file6290 v1148>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005c42:[<0x10000000271/file6290 v1148>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.782 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.430+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000057c2 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5781 auth v1126 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737c7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000057c2:[<0x10000000271/file5781 v1126>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000057c2:[<0x10000000271/file5781 v1126>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.782 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.431+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000403f [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3439 auth v1053 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737c7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000403f:[<0x10000000271/file3439 v1053>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000403f:[<0x10000000271/file3439 v1053>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.783 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.431+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004416 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3633 auth v1063 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737d0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004416:[<0x10000000271/file3633 v1063>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004416:[<0x10000000271/file3633 v1063>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.783 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.431+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000063bc [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7135 auth{0=1} v1165 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be737d1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000063bc:[<0x10000000271/file7135 v1165>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000063bc:[<0x10000000271/file7135 v1165>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.783 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.431+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005ad7 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6134 auth v1142 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737d1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005ad7:[<0x10000000271/file6134 v1142>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005ad7:[<0x10000000271/file6134 v1142>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.783 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.431+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000529a [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5213 auth v1108 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737d2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000529a:[<0x10000000271/file5213 v1108>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000529a:[<0x10000000271/file5213 v1108>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.783 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.432+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000047ed [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3992 auth v1078 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737d2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000047ed:[<0x10000000271/file3992 v1078>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000047ed:[<0x10000000271/file3992 v1078>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.783 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.432+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000053ca [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5339 auth v1114 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737d2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000053ca:[<0x10000000271/file5339 v1114>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000053ca:[<0x10000000271/file5339 v1114>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.783 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.432+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005656 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5625 auth v1124 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737d3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005656:[<0x10000000271/file5625 v1124>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005656:[<0x10000000271/file5625 v1124>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.783 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.432+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005fd9 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6688 auth v1158 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737d9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005fd9:[<0x10000000271/file6688 v1158>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005fd9:[<0x10000000271/file6688 v1158>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.783 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.433+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005540 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5500 auth v1118 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737d9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005540:[<0x10000000271/file5500 v1118>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005540:[<0x10000000271/file5500 v1118>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.783 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.433+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005994 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5991 auth v1132 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737d9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005994:[<0x10000000271/file5991 v1132>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005994:[<0x10000000271/file5991 v1132>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.783 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.433+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004ee6 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4795 auth v1098 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737da100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004ee6:[<0x10000000271/file4795 v1098>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004ee6:[<0x10000000271/file4795 v1098>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.783 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.433+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004949 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4146 auth v1082 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737da680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004949:[<0x10000000271/file4146 v1082>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004949:[<0x10000000271/file4146 v1082>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.784 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.433+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005547 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5503 auth v1120 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737db700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005547:[<0x10000000271/file5503 v1120>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005547:[<0x10000000271/file5503 v1120>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.784 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.434+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004927 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4131 auth v1080 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737e6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004927:[<0x10000000271/file4131 v1080>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004927:[<0x10000000271/file4131 v1080>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.784 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.434+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000041d9 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3521 auth v1059 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737e6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000041d9:[<0x10000000271/file3521 v1059>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000041d9:[<0x10000000271/file3521 v1059>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.784 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.434+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004e57 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4736 auth v1096 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737e7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004e57:[<0x10000000271/file4736 v1096>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004e57:[<0x10000000271/file4736 v1096>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.784 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.435+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000534a [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5286 auth v1110 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be737e8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000534a:[<0x10000000271/file5286 v1110>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000534a:[<0x10000000271/file5286 v1110>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.784 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.435+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000054d8 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5453 auth v1126 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be72c6ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000054d8:[<0x10000000271/file5453 v1126>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000054d8:[<0x10000000271/file5453 v1126>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.784 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.435+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005722 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5715 auth v1132 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be72656c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005722:[<0x10000000271/file5715 v1132>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005722:[<0x10000000271/file5715 v1132>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.784 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.436+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000064ef [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7279 auth{0=1} v1191 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be6f8d3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000064ef:[<0x10000000271/file7279 v1191>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000064ef:[<0x10000000271/file7279 v1191>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.784 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.436+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000060b7 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6795 auth v1170 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be7294ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000060b7:[<0x10000000271/file6795 v1170>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000060b7:[<0x10000000271/file6795 v1170>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.784 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.436+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005cad [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6336 auth v1158 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be70f62100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005cad:[<0x10000000271/file6336 v1158>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005cad:[<0x10000000271/file6336 v1158>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.784 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.436+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000651b [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7302 auth{0=1} v1193 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be732a3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000651b:[<0x10000000271/file7302 v1193>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000651b:[<0x10000000271/file7302 v1193>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.784 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.436+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000057ae [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5773 auth v1134 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be732a3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000057ae:[<0x10000000271/file5773 v1134>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000057ae:[<0x10000000271/file5773 v1134>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.785 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.436+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000006369 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7091 auth{0=1} v1181 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be73173600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000006369:[<0x10000000271/file7091 v1181>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000006369:[<0x10000000271/file7091 v1181>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.785 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.437+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000049f8 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4221 auth v1098 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be730be680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000049f8:[<0x10000000271/file4221 v1098>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000049f8:[<0x10000000271/file4221 v1098>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.785 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.437+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005352 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5289 auth v1120 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be730feb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005352:[<0x10000000271/file5289 v1120>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005352:[<0x10000000271/file5289 v1120>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.785 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.437+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000627e [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6974 auth{0=1} v1179 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be73222b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000627e:[<0x10000000271/file6974 v1179>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000627e:[<0x10000000271/file6974 v1179>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.785 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.437+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000060bf [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6799 auth v1172 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73218b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000060bf:[<0x10000000271/file6799 v1172>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000060bf:[<0x10000000271/file6799 v1172>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.785 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.438+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004d77 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4635 auth v1108 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be70f75700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004d77:[<0x10000000271/file4635 v1108>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004d77:[<0x10000000271/file4635 v1108>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.785 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.438+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004925 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4130 auth v1092 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be70533700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004925:[<0x10000000271/file4130 v1092>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004925:[<0x10000000271/file4130 v1092>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.785 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.438+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000505e [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4957 auth v1112 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be70f73600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000505e:[<0x10000000271/file4957 v1112>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000505e:[<0x10000000271/file4957 v1112>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.785 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.439+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005e67 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6532 auth v1166 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be731bd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005e67:[<0x10000000271/file6532 v1166>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005e67:[<0x10000000271/file6532 v1166>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.786 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.439+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000006419 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7182 auth{0=1} v1189 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be728ff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000006419:[<0x10000000271/file7182 v1189>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000006419:[<0x10000000271/file7182 v1189>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.786 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.440+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004d3b [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4608 auth v1106 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be70f5ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004d3b:[<0x10000000271/file4608 v1106>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004d3b:[<0x10000000271/file4608 v1106>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.786 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.440+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000480d [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4007 auth v1090 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be7318a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000480d:[<0x10000000271/file4007 v1090>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000480d:[<0x10000000271/file4007 v1090>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.786 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.440+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000589f [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5888 auth v1138 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be732acc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000589f:[<0x10000000271/file5888 v1138>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000589f:[<0x10000000271/file5888 v1138>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.786 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.440+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000051aa [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5106 auth v1118 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be732a5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000051aa:[<0x10000000271/file5106 v1118>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000051aa:[<0x10000000271/file5106 v1118>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.786 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.440+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004085 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3453 auth v1073 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be70f66c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004085:[<0x10000000271/file3453 v1073>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004085:[<0x10000000271/file3453 v1073>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.786 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.440+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000056a8 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5660 auth v1130 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73173080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000056a8:[<0x10000000271/file5660 v1130>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000056a8:[<0x10000000271/file5660 v1130>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.786 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.440+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f6d [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3397 auth v1071 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73165b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000003f6d:[<0x10000000271/file3397 v1071>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000003f6d:[<0x10000000271/file3397 v1071>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.787 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.441+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000063ba [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7134 auth{0=1} v1185 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be7313f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000063ba:[<0x10000000271/file7134 v1185>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000063ba:[<0x10000000271/file7134 v1185>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.787 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.441+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005923 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5944 auth v1142 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be71872c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005923:[<0x10000000271/file5944 v1142>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005923:[<0x10000000271/file5944 v1142>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.787 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.441+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000006163 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6844 auth{0=1} v1175 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be72869600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000006163:[<0x10000000271/file6844 v1175>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000006163:[<0x10000000271/file6844 v1175>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.787 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.441+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000045fa [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3765 auth v1082 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be727dc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000045fa:[<0x10000000271/file3765 v1082>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000045fa:[<0x10000000271/file3765 v1082>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.787 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.442+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005b73 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6203 auth v1148 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73156680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005b73:[<0x10000000271/file6203 v1148>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005b73:[<0x10000000271/file6203 v1148>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.787 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.442+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005cba [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6342 auth v1160 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be71850580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005cba:[<0x10000000271/file6342 v1160>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005cba:[<0x10000000271/file6342 v1160>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.787 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.442+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000045da [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3749 auth v1080 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be7313ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000045da:[<0x10000000271/file3749 v1080>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000045da:[<0x10000000271/file3749 v1080>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.787 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.443+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005c6e [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6309 auth v1156 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be7325db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005c6e:[<0x10000000271/file6309 v1156>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005c6e:[<0x10000000271/file6309 v1156>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.787 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.443+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004542 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3692 auth v1078 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73268680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004542:[<0x10000000271/file3692 v1078>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004542:[<0x10000000271/file3692 v1078>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.787 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.443+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004d38 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4607 auth v1104 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73259600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004d38:[<0x10000000271/file4607 v1104>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004d38:[<0x10000000271/file4607 v1104>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.787 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.444+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000046a1 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3845 auth v1084 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be7324a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000046a1:[<0x10000000271/file3845 v1084>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000046a1:[<0x10000000271/file3845 v1084>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.788 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.444+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005ce1 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6360 auth v1164 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be727db180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005ce1:[<0x10000000271/file6360 v1164>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005ce1:[<0x10000000271/file6360 v1164>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.788 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.445+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000049b9 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4193 auth v1096 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73107b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000049b9:[<0x10000000271/file4193 v1096>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000049b9:[<0x10000000271/file4193 v1096>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.788 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.445+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000063ea [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7158 auth{0=1} v1187 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be7352e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000063ea:[<0x10000000271/file7158 v1187>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000063ea:[<0x10000000271/file7158 v1187>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.788 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.445+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005471 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5410 auth v1124 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be7352f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005471:[<0x10000000271/file5410 v1124>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005471:[<0x10000000271/file5410 v1124>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.788 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.445+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005cde [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6359 auth v1162 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be7352fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005cde:[<0x10000000271/file6359 v1162>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005cde:[<0x10000000271/file6359 v1162>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.788 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.446+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005c47 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6292 auth v1154 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be7352f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005c47:[<0x10000000271/file6292 v1154>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005c47:[<0x10000000271/file6292 v1154>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.788 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.446+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000046d2 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3868 auth v1086 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73530100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000046d2:[<0x10000000271/file3868 v1086>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000046d2:[<0x10000000271/file3868 v1086>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.788 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.446+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000639d [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7116 auth{0=1} v1183 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be73530680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000639d:[<0x10000000271/file7116 v1183>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000639d:[<0x10000000271/file7116 v1183>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.788 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.446+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005065 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4960 auth v1114 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73530c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005065:[<0x10000000271/file4960 v1114>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005065:[<0x10000000271/file4960 v1114>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.788 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.446+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005101 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5028 auth v1116 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be73531180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005101:[<0x10000000271/file5028 v1116>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005101:[<0x10000000271/file5028 v1116>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.788 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.446+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000058ea [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5921 auth v1140 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f8be580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000058ea:[<0x10000000271/file5921 v1140>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000058ea:[<0x10000000271/file5921 v1140>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.788 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.447+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004df1 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4688 auth v1110 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f8bf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004df1:[<0x10000000271/file4688 v1110>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004df1:[<0x10000000271/file4688 v1110>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.789 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.447+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004466 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3649 auth v1075 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f8bf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004466:[<0x10000000271/file3649 v1075>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004466:[<0x10000000271/file3649 v1075>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.789 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.447+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000006171 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6851 auth{0=1} v1177 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55be6f8bfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000006171:[<0x10000000271/file6851 v1177>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000006171:[<0x10000000271/file6851 v1177>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.789 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.447+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004c92 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4533 auth v1102 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f8c0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004c92:[<0x10000000271/file4533 v1102>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004c92:[<0x10000000271/file4533 v1102>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.789 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.447+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000055fd [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5584 auth v1128 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f8c0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000055fd:[<0x10000000271/file5584 v1128>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000055fd:[<0x10000000271/file5584 v1128>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.789 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.448+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000059b6 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6006 auth v1144 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f300b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000059b6:[<0x10000000271/file6006 v1144>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000059b6:[<0x10000000271/file6006 v1144>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.789 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.448+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005fac [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6669 auth v1168 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f8c1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005fac:[<0x10000000271/file6669 v1168>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005fac:[<0x10000000271/file6669 v1168>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.789 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.449+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000047ea [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3991 auth v1088 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f300000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000047ea:[<0x10000000271/file3991 v1088>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x100000047ea:[<0x10000000271/file3991 v1088>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.789 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.449+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005b62 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6195 auth v1146 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f302100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005b62:[<0x10000000271/file6195 v1146>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005b62:[<0x10000000271/file6195 v1146>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.789 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.449+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004980 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4168 auth v1094 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f302c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004980:[<0x10000000271/file4168 v1094>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004980:[<0x10000000271/file4168 v1094>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.789 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.449+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005c19 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6271 auth v1150 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f303180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005c19:[<0x10000000271/file6271 v1150>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005c19:[<0x10000000271/file6271 v1150>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.789 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.450+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005467 [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5406 auth v1122 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f1aab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005467:[<0x10000000271/file5406 v1122>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005467:[<0x10000000271/file5406 v1122>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.790 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.450+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000005c1e [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6273 auth v1152 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f1ab080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000005c1e:[<0x10000000271/file6273 v1152>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000005c1e:[<0x10000000271/file6273 v1152>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.790 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.450+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000580d [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5815 auth v1136 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f1acc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000580d:[<0x10000000271/file5815 v1136>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x1000000580d:[<0x10000000271/file5815 v1136>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.790 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:13:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:13:17.451+0000 7fafe46fa640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004bff [2,head] /volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4466 auth v1100 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15225=0-4194304@1} caps={15225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15225 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55be6f1ac680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000004bff:[<0x10000000271/file4466 v1100>,<0x10000000270/dir2 v22923>,<0x1000000026f/dir1 v23603>,<0x1000000026e/testdir v175>,<0x10000000005/tmp v410>,<0x100000001fb/client.0 v369>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v363>,<0x10000000001/sv_1 v376>,<0x10000000000/qa v358>,<0x1/volumes v341>]//[3]","memoryvalue":"(4)0x10000004bff:[<0x10000000271/file4466 v1100>,<0x10000000270/dir2 v24224>,<0x1000000026f/dir1 v28688>,<0x1000000026e/testdir v266>,<0x10000000005/tmp v414>,<0x100000001fb/client.0 v355>,<0x100000001fa/3c5bf679-9fc9-4b23-a362-547f70607235 v379>,<0x10000000001/sv_1 v392>,<0x10000000000/qa v374>,<0x1/volumes v357>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:13:17.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:17 smithi183 ceph-mon[22097]: pgmap v505: 129 pgs: 129 active+clean; 45 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.1 MiB/s wr, 2.25k op/s 2024-08-18T22:13:17.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:17 smithi183 ceph-mon[22097]: scrub queued for path: / 2024-08-18T22:13:17.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:17 smithi183 ceph-mon[22097]: scrub summary: idle+waiting paths [/] 2024-08-18T22:13:17.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:17 smithi183 ceph-mon[22097]: scrub summary: active paths [/] 2024-08-18T22:13:18.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.139+0000 7efecf198640 1 -- 172.21.15.123:0/3176338292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efec81068b0 msgr2=0x7efec8106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:18.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.139+0000 7efecf198640 1 --2- 172.21.15.123:0/3176338292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efec81068b0 0x7efec8106c90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7efec4009ca0 tx=0x7efec402a8c0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.139+0000 7efecf198640 1 -- 172.21.15.123:0/3176338292 shutdown_connections 2024-08-18T22:13:18.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.139+0000 7efecf198640 1 --2- 172.21.15.123:0/3176338292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efec81007d0 0x7efec810e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.139+0000 7efecf198640 1 --2- 172.21.15.123:0/3176338292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efec80ffe30 0x7efec8100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.139+0000 7efecf198640 1 --2- 172.21.15.123:0/3176338292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efec81068b0 0x7efec8106c90 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.139+0000 7efecf198640 1 -- 172.21.15.123:0/3176338292 >> 172.21.15.123:0/3176338292 conn(0x7efec8076f60 msgr2=0x7efec80fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:18.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.140+0000 7efecf198640 1 -- 172.21.15.123:0/3176338292 shutdown_connections 2024-08-18T22:13:18.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.140+0000 7efecf198640 1 -- 172.21.15.123:0/3176338292 wait complete. 2024-08-18T22:13:18.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.141+0000 7efecf198640 1 Processor -- start 2024-08-18T22:13:18.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.141+0000 7efecf198640 1 -- start start 2024-08-18T22:13:18.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.141+0000 7efecf198640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efec80ffe30 0x7efec8101010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.141+0000 7efecf198640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efec81007d0 0x7efec8101550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.141+0000 7efecf198640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efec81068b0 0x7efec8101a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.141+0000 7efecf198640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efec8111dd0 con 0x7efec81068b0 2024-08-18T22:13:18.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.141+0000 7efecf198640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efec8111c50 con 0x7efec80ffe30 2024-08-18T22:13:18.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.141+0000 7efecf198640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efec8111f50 con 0x7efec81007d0 2024-08-18T22:13:18.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.141+0000 7efecd735640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efec81068b0 0x7efec8101a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.141+0000 7efecd735640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efec81068b0 0x7efec8101a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40586/0 (socket says 172.21.15.123:40586) 2024-08-18T22:13:18.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.141+0000 7efecd735640 1 -- 172.21.15.123:0/2085267418 learned_addr learned my addr 172.21.15.123:0/2085267418 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:18.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.141+0000 7efeccf34640 1 --2- 172.21.15.123:0/2085267418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efec80ffe30 0x7efec8101010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.141+0000 7efebffff640 1 --2- 172.21.15.123:0/2085267418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efec81007d0 0x7efec8101550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.142+0000 7efecd735640 1 -- 172.21.15.123:0/2085267418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efec81007d0 msgr2=0x7efec8101550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:18.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.142+0000 7efecd735640 1 --2- 172.21.15.123:0/2085267418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efec81007d0 0x7efec8101550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.142+0000 7efecd735640 1 -- 172.21.15.123:0/2085267418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efec80ffe30 msgr2=0x7efec8101010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:18.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.142+0000 7efecd735640 1 --2- 172.21.15.123:0/2085267418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efec80ffe30 0x7efec8101010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.142+0000 7efecd735640 1 -- 172.21.15.123:0/2085267418 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec81aabb0 con 0x7efec81068b0 2024-08-18T22:13:18.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.142+0000 7efecd735640 1 --2- 172.21.15.123:0/2085267418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efec81068b0 0x7efec8101a90 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7efec000e970 tx=0x7efec000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:18.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.142+0000 7efebdffb640 1 -- 172.21.15.123:0/2085267418 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec000ccc0 con 0x7efec81068b0 2024-08-18T22:13:18.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.142+0000 7efecf198640 1 -- 172.21.15.123:0/2085267418 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec81aade0 con 0x7efec81068b0 2024-08-18T22:13:18.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.142+0000 7efebdffb640 1 -- 172.21.15.123:0/2085267418 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efec0005500 con 0x7efec81068b0 2024-08-18T22:13:18.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.142+0000 7efebdffb640 1 -- 172.21.15.123:0/2085267418 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec0010690 con 0x7efec81068b0 2024-08-18T22:13:18.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.142+0000 7efecf198640 1 -- 172.21.15.123:0/2085267418 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec81ab2e0 con 0x7efec81068b0 2024-08-18T22:13:18.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.145+0000 7efebdffb640 1 -- 172.21.15.123:0/2085267418 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7efec00046c0 con 0x7efec81068b0 2024-08-18T22:13:18.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efed1596740 1 Processor -- start 2024-08-18T22:13:18.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efed1596740 1 -- start start 2024-08-18T22:13:18.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efebdffb640 1 --2- 172.21.15.123:0/2085267418 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efeb00a2c40 0x7efeb00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efed1596740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244400210 0x55e2444005f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efed1596740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 0x55e24440aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efed1596740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e24440b3f0 0x55e24440d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efed1596740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e244365980 con 0x55e244400210 2024-08-18T22:13:18.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efed1596740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e2442fda70 con 0x55e244400b30 2024-08-18T22:13:18.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efebdffb640 1 -- 172.21.15.123:0/2085267418 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7efec00cf700 con 0x7efec81068b0 2024-08-18T22:13:18.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efed1596740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e244361940 con 0x55e24440b3f0 2024-08-18T22:13:18.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efeccf34640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244400210 0x55e2444005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efeccf34640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244400210 0x55e2444005f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40596/0 (socket says 172.21.15.123:40596) 2024-08-18T22:13:18.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efeccf34640 1 -- 172.21.15.123:0/4065039137 learned_addr learned my addr 172.21.15.123:0/4065039137 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:18.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efecd735640 1 --2- 172.21.15.123:0/4065039137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e24440b3f0 0x55e24440d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efebffff640 1 --2- 172.21.15.123:0/2085267418 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efeb00a2c40 0x7efeb00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efeccf34640 1 -- 172.21.15.123:0/4065039137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e24440b3f0 msgr2=0x55e24440d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:18.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efeccf34640 1 --2- 172.21.15.123:0/4065039137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e24440b3f0 0x55e24440d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efeccf34640 1 -- 172.21.15.123:0/4065039137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 msgr2=0x55e24440aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:18.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efeccf34640 1 --2- 172.21.15.123:0/4065039137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 0x55e24440aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.146+0000 7efeccf34640 1 -- 172.21.15.123:0/4065039137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2443606e0 con 0x55e244400210 2024-08-18T22:13:18.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.147+0000 7efeccf34640 1 --2- 172.21.15.123:0/4065039137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244400210 0x55e2444005f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7efec4009ca0 tx=0x7efec4009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110ec7307e33b8ab server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:18.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.147+0000 7efeaeffd640 1 -- 172.21.15.123:0/4065039137 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec4031db0 con 0x55e244400210 2024-08-18T22:13:18.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.147+0000 7efeaeffd640 1 -- 172.21.15.123:0/4065039137 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efec4036030 con 0x55e244400210 2024-08-18T22:13:18.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.147+0000 7efeaeffd640 1 -- 172.21.15.123:0/4065039137 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec40042d0 con 0x55e244400210 2024-08-18T22:13:18.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.148+0000 7efebffff640 1 --2- 172.21.15.123:0/2085267418 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efeb00a2c40 0x7efeb00a5100 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55e2443fd600 tx=0x7efeb80096c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:18.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.148+0000 7efed1596740 1 -- 172.21.15.123:0/4065039137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244400210 msgr2=0x55e2444005f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:18.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.148+0000 7efed1596740 1 --2- 172.21.15.123:0/4065039137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244400210 0x55e2444005f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7efec4009ca0 tx=0x7efec4009870 comp rx=0 tx=0).stop 2024-08-18T22:13:18.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.148+0000 7efed1596740 1 -- 172.21.15.123:0/4065039137 shutdown_connections 2024-08-18T22:13:18.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.148+0000 7efed1596740 1 --2- 172.21.15.123:0/4065039137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e24440b3f0 0x55e24440d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.148+0000 7efed1596740 1 --2- 172.21.15.123:0/4065039137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 0x55e24440aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.148+0000 7efed1596740 1 --2- 172.21.15.123:0/4065039137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244400210 0x55e2444005f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.148+0000 7efed1596740 1 -- 172.21.15.123:0/4065039137 >> 172.21.15.123:0/4065039137 conn(0x55e2443fc7a0 msgr2=0x55e2443fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:18.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.148+0000 7efed1596740 1 -- 172.21.15.123:0/4065039137 shutdown_connections 2024-08-18T22:13:18.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.148+0000 7efed1596740 1 -- 172.21.15.123:0/4065039137 wait complete. 2024-08-18T22:13:18.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.148+0000 7efed1596740 1 -- start start 2024-08-18T22:13:18.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.148+0000 7efed1596740 1 Processor -- start 2024-08-18T22:13:18.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.149+0000 7efed1596740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 0x55e244408470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.149+0000 7efed1596740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e24440b3f0 0x55e2444089b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.149+0000 7efed1596740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244408ef0 0x55e244428260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.149+0000 7efed1596740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e24441edf0 con 0x55e244408ef0 2024-08-18T22:13:18.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.149+0000 7efed1596740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e244320aa0 con 0x55e244400b30 2024-08-18T22:13:18.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.149+0000 7efed1596740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e24441ef70 con 0x55e24440b3f0 2024-08-18T22:13:18.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.149+0000 7efed1596740 10 client.0 _ll_register_callbacks cb 0x55e24430fe60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:18.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.149+0000 7efeccf34640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 0x55e244408470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.149+0000 7efeccf34640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 0x55e244408470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:38274/0 (socket says 172.21.15.123:38274) 2024-08-18T22:13:18.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.149+0000 7efecd735640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244408ef0 0x55e244428260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.149+0000 7efeccf34640 1 -- 172.21.15.123:0/3299922742 learned_addr learned my addr 172.21.15.123:0/3299922742 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:18.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.150+0000 7efebffff640 1 --2- 172.21.15.123:0/3299922742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e24440b3f0 0x55e2444089b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.150+0000 7efeccf34640 1 -- 172.21.15.123:0/3299922742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e24440b3f0 msgr2=0x55e2444089b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:18.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.150+0000 7efeccf34640 1 --2- 172.21.15.123:0/3299922742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e24440b3f0 0x55e2444089b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.150+0000 7efeccf34640 1 -- 172.21.15.123:0/3299922742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244408ef0 msgr2=0x55e244428260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:18.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.150+0000 7efeccf34640 1 --2- 172.21.15.123:0/3299922742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244408ef0 0x55e244428260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.150+0000 7efeccf34640 1 -- 172.21.15.123:0/3299922742 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e244304650 con 0x55e244400b30 2024-08-18T22:13:18.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.150+0000 7efeccf34640 1 --2- 172.21.15.123:0/3299922742 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 0x55e244408470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efec402aeb0 tx=0x7efec40316b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c72fcc4f0960d8a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:18.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.150+0000 7efea7fff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:13:18.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.150+0000 7efea7fff640 1 -- 172.21.15.123:0/3299922742 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec404a040 con 0x55e244400b30 2024-08-18T22:13:18.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.150+0000 7efed1596740 1 -- 172.21.15.123:0/3299922742 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efec4036030 con 0x55e244400b30 2024-08-18T22:13:18.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.150+0000 7efea7fff640 1 -- 172.21.15.123:0/3299922742 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7efec4003b70 con 0x55e244400b30 2024-08-18T22:13:18.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.150+0000 7efea7fff640 1 -- 172.21.15.123:0/3299922742 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efec405c050 con 0x55e244400b30 2024-08-18T22:13:18.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.150+0000 7efed1596740 10 client.25844 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:18.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.150+0000 7efed1596740 1 -- 172.21.15.123:0/3299922742 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e2440d73c0 con 0x55e244400b30 2024-08-18T22:13:18.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.151+0000 7efea7fff640 1 -- 172.21.15.123:0/3299922742 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efec4036030 con 0x55e244400b30 2024-08-18T22:13:18.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.151+0000 7efea7fff640 1 -- 172.21.15.123:0/3299922742 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7efec404d070 con 0x55e244400b30 2024-08-18T22:13:18.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.151+0000 7efed1596740 10 client.25844 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:18.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.151+0000 7efed1596740 10 client.25844 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:18.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.151+0000 7efed1596740 20 client.25844 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:18.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.151+0000 7efed1596740 1 --2- 172.21.15.123:0/3299922742 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e24442c180 0x55e24442e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.151+0000 7efed1596740 4 client.25844 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:13:18.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.151+0000 7efed1596740 1 -- 172.21.15.123:0/3299922742 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e244372ef0 con 0x55e24442c180 2024-08-18T22:13:18.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.151+0000 7efebffff640 1 --2- 172.21.15.123:0/3299922742 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e24442c180 0x55e24442e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.152+0000 7efebffff640 1 --2- 172.21.15.123:0/3299922742 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e24442c180 0x55e24442e570 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87110c004413ce16 server_cookie=16fd645b4f9a2e2f in_seq=0 out_seq=0 2024-08-18T22:13:18.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.152+0000 7efea7fff640 10 client.25844 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:18.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.156+0000 7efea7fff640 1 -- 172.21.15.123:0/3299922742 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e244372ef0 con 0x55e24442c180 2024-08-18T22:13:18.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.156+0000 7efea7fff640 10 client.25844 handle_command_reply: tid=0 2024-08-18T22:13:18.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.156+0000 7efed1596740 1 client.25844 shutdown 2024-08-18T22:13:18.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.156+0000 7efed1596740 1 -- 172.21.15.123:0/3299922742 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 msgr2=0x55e244408470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:18.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.156+0000 7efed1596740 1 --2- 172.21.15.123:0/3299922742 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 0x55e244408470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efec402aeb0 tx=0x7efec40316b0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.156+0000 7efed1596740 1 -- 172.21.15.123:0/3299922742 shutdown_connections 2024-08-18T22:13:18.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.156+0000 7efed1596740 1 --2- 172.21.15.123:0/3299922742 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e24442c180 0x55e24442e570 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.156+0000 7efed1596740 1 --2- 172.21.15.123:0/3299922742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244408ef0 0x55e244428260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.156+0000 7efea7fff640 0 client.25844 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:18.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.156+0000 7efed1596740 1 --2- 172.21.15.123:0/3299922742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e24440b3f0 0x55e2444089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.156+0000 7efed1596740 1 --2- 172.21.15.123:0/3299922742 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 0x55e244408470 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.157+0000 7efed1596740 1 -- 172.21.15.123:0/3299922742 >> 172.21.15.123:0/3299922742 conn(0x55e2443fc7a0 msgr2=0x55e2444024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:18.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.157+0000 7efed1596740 1 -- 172.21.15.123:0/3299922742 shutdown_connections 2024-08-18T22:13:18.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.157+0000 7efed1596740 1 -- 172.21.15.123:0/3299922742 wait complete. 2024-08-18T22:13:18.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.157+0000 7efed1596740 20 client.25844 trim_cache size 0 max 16384 2024-08-18T22:13:18.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efed1596740 1 Processor -- start 2024-08-18T22:13:18.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efed1596740 1 -- start start 2024-08-18T22:13:18.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efed1596740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e244400b30 0x55e244428050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efed1596740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244408ef0 0x55e244433c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efed1596740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e24440b3f0 0x55e244434160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efed1596740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efec81af1f0 con 0x55e24440b3f0 2024-08-18T22:13:18.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efed1596740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efec81acac0 con 0x55e244408ef0 2024-08-18T22:13:18.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efed1596740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efec81a3f50 con 0x55e244400b30 2024-08-18T22:13:18.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efecd735640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e24440b3f0 0x55e244434160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efecd735640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e24440b3f0 0x55e244434160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40612/0 (socket says 172.21.15.123:40612) 2024-08-18T22:13:18.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efeccf34640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e244400b30 0x55e244428050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efecd735640 1 -- 172.21.15.123:0/3051169553 learned_addr learned my addr 172.21.15.123:0/3051169553 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:18.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efebffff640 1 --2- 172.21.15.123:0/3051169553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244408ef0 0x55e244433c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efecd735640 1 -- 172.21.15.123:0/3051169553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e244400b30 msgr2=0x55e244428050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:18.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efecd735640 1 --2- 172.21.15.123:0/3051169553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e244400b30 0x55e244428050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efecd735640 1 -- 172.21.15.123:0/3051169553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244408ef0 msgr2=0x55e244433c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:18.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efecd735640 1 --2- 172.21.15.123:0/3051169553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244408ef0 0x55e244433c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.177+0000 7efecd735640 1 -- 172.21.15.123:0/3051169553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2443fd430 con 0x55e24440b3f0 2024-08-18T22:13:18.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.178+0000 7efecd735640 1 --2- 172.21.15.123:0/3051169553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e24440b3f0 0x55e244434160 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efec0097fd0 tx=0x7efec0009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fa27795a861516 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:18.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.178+0000 7efeae7fc640 1 -- 172.21.15.123:0/3051169553 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec00b9070 con 0x55e24440b3f0 2024-08-18T22:13:18.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.178+0000 7efeae7fc640 1 -- 172.21.15.123:0/3051169553 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efec009c270 con 0x55e24440b3f0 2024-08-18T22:13:18.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.178+0000 7efeae7fc640 1 -- 172.21.15.123:0/3051169553 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec00cf3b0 con 0x55e24440b3f0 2024-08-18T22:13:18.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.179+0000 7efed1596740 1 -- 172.21.15.123:0/3051169553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e24440b3f0 msgr2=0x55e244434160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:18.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.179+0000 7efed1596740 1 --2- 172.21.15.123:0/3051169553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e24440b3f0 0x55e244434160 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efec0097fd0 tx=0x7efec0009740 comp rx=0 tx=0).stop 2024-08-18T22:13:18.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.179+0000 7efed1596740 1 -- 172.21.15.123:0/3051169553 shutdown_connections 2024-08-18T22:13:18.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.179+0000 7efed1596740 1 --2- 172.21.15.123:0/3051169553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e24440b3f0 0x55e244434160 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.179+0000 7efed1596740 1 --2- 172.21.15.123:0/3051169553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244408ef0 0x55e244433c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.179+0000 7efed1596740 1 --2- 172.21.15.123:0/3051169553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e244400b30 0x55e244428050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.179+0000 7efed1596740 1 -- 172.21.15.123:0/3051169553 >> 172.21.15.123:0/3051169553 conn(0x55e2443fc7a0 msgr2=0x55e244406d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:18.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.179+0000 7efed1596740 1 -- 172.21.15.123:0/3051169553 shutdown_connections 2024-08-18T22:13:18.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.179+0000 7efed1596740 1 -- 172.21.15.123:0/3051169553 wait complete. 2024-08-18T22:13:18.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.180+0000 7efed1596740 1 -- start start 2024-08-18T22:13:18.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.180+0000 7efed1596740 1 Processor -- start 2024-08-18T22:13:18.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.180+0000 7efed1596740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 0x55e244405500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.180+0000 7efed1596740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244408ef0 0x55e244405a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.180+0000 7efed1596740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e24440b3f0 0x55e244405f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.180+0000 7efed1596740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efec81a45a0 con 0x55e244408ef0 2024-08-18T22:13:18.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.180+0000 7efed1596740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efec81ac3f0 con 0x55e244400b30 2024-08-18T22:13:18.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.180+0000 7efed1596740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efec81ab650 con 0x55e24440b3f0 2024-08-18T22:13:18.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.180+0000 7efebffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244408ef0 0x55e244405a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.180+0000 7efed1596740 10 client.0 _ll_register_callbacks cb 0x7efec000ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:18.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.180+0000 7efeccf34640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 0x55e244405500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.180+0000 7efecd735640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e24440b3f0 0x55e244405f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.180+0000 7efeccf34640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 0x55e244405500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:38284/0 (socket says 172.21.15.123:38284) 2024-08-18T22:13:18.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.180+0000 7efeccf34640 1 -- 172.21.15.123:0/4030833812 learned_addr learned my addr 172.21.15.123:0/4030833812 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.181+0000 7efeccf34640 1 -- 172.21.15.123:0/4030833812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e24440b3f0 msgr2=0x55e244405f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.181+0000 7efeccf34640 1 --2- 172.21.15.123:0/4030833812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e24440b3f0 0x55e244405f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.181+0000 7efeccf34640 1 -- 172.21.15.123:0/4030833812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244408ef0 msgr2=0x55e244405a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.181+0000 7efeccf34640 1 --2- 172.21.15.123:0/4030833812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244408ef0 0x55e244405a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.181+0000 7efeccf34640 1 -- 172.21.15.123:0/4030833812 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e244495c40 con 0x55e244400b30 2024-08-18T22:13:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.181+0000 7efeccf34640 1 --2- 172.21.15.123:0/4030833812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 0x55e244405500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efec402aeb0 tx=0x7efec402f400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b10718c3cdd1c1f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.181+0000 7efea7fff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:13:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.181+0000 7efea7fff640 1 -- 172.21.15.123:0/4030833812 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec402fad0 con 0x55e244400b30 2024-08-18T22:13:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.181+0000 7efea7fff640 1 -- 172.21.15.123:0/4030833812 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7efec402fc70 con 0x55e244400b30 2024-08-18T22:13:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.181+0000 7efed1596740 1 -- 172.21.15.123:0/4030833812 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efec009c270 con 0x55e244400b30 2024-08-18T22:13:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.181+0000 7efea7fff640 1 -- 172.21.15.123:0/4030833812 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efec4068050 con 0x55e244400b30 2024-08-18T22:13:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.181+0000 7efed1596740 10 client.25850 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.181+0000 7efed1596740 1 -- 172.21.15.123:0/4030833812 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e244496f50 con 0x55e244400b30 2024-08-18T22:13:18.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.182+0000 7efea7fff640 1 -- 172.21.15.123:0/4030833812 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efec009c270 con 0x55e244400b30 2024-08-18T22:13:18.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.182+0000 7efea7fff640 1 -- 172.21.15.123:0/4030833812 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7efec404d040 con 0x55e244400b30 2024-08-18T22:13:18.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.182+0000 7efed1596740 10 client.25850 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:18.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.182+0000 7efed1596740 10 client.25850 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:18.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.182+0000 7efed1596740 20 client.25850 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:18.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.182+0000 7efed1596740 1 --2- 172.21.15.123:0/4030833812 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e24442c180 0x55e244499680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:18.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.182+0000 7efed1596740 4 client.25850 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:13:18.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.182+0000 7efed1596740 1 -- 172.21.15.123:0/4030833812 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e24436d400 con 0x55e24442c180 2024-08-18T22:13:18.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.182+0000 7efebffff640 1 --2- 172.21.15.123:0/4030833812 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e24442c180 0x55e244499680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:18.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.183+0000 7efebffff640 1 --2- 172.21.15.123:0/4030833812 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e24442c180 0x55e244499680 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aabd59b43fa5c65b server_cookie=d25895dba24e0c33 in_seq=0 out_seq=0 2024-08-18T22:13:18.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.183+0000 7efea7fff640 10 client.25850 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:18.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.184+0000 7efea7fff640 1 -- 172.21.15.123:0/4030833812 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x55e24436d400 con 0x55e24442c180 2024-08-18T22:13:18.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.184+0000 7efea7fff640 10 client.25850 handle_command_reply: tid=0 2024-08-18T22:13:18.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.184+0000 7efed1596740 1 client.25850 shutdown 2024-08-18T22:13:18.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.184+0000 7efed1596740 1 -- 172.21.15.123:0/4030833812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 msgr2=0x55e244405500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:18.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.184+0000 7efed1596740 1 --2- 172.21.15.123:0/4030833812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 0x55e244405500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efec402aeb0 tx=0x7efec402f400 comp rx=0 tx=0).stop 2024-08-18T22:13:18.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.184+0000 7efed1596740 1 -- 172.21.15.123:0/4030833812 shutdown_connections 2024-08-18T22:13:18.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.184+0000 7efed1596740 1 --2- 172.21.15.123:0/4030833812 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55e24442c180 0x55e244499680 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.184+0000 7efed1596740 1 --2- 172.21.15.123:0/4030833812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e24440b3f0 0x55e244405f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.184+0000 7efed1596740 1 --2- 172.21.15.123:0/4030833812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e244408ef0 0x55e244405a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.184+0000 7efea7fff640 0 client.25850 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:18.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.184+0000 7efed1596740 1 --2- 172.21.15.123:0/4030833812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e244400b30 0x55e244405500 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.184+0000 7efed1596740 1 -- 172.21.15.123:0/4030833812 >> 172.21.15.123:0/4030833812 conn(0x55e2443fc7a0 msgr2=0x55e2443fb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:18.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.184+0000 7efed1596740 1 -- 172.21.15.123:0/4030833812 shutdown_connections 2024-08-18T22:13:18.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.184+0000 7efed1596740 1 -- 172.21.15.123:0/4030833812 wait complete. 2024-08-18T22:13:18.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.184+0000 7efed1596740 20 client.25850 trim_cache size 0 max 16384 2024-08-18T22:13:18.189 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:13:18.189 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "scrub active (10124 inodes in the stack)", 2024-08-18T22:13:18.189 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": { 2024-08-18T22:13:18.189 INFO:teuthology.orchestra.run.smithi123.stdout: "866ef279-02bd-40d8-80eb-1c218cf47e2d": { 2024-08-18T22:13:18.189 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/", 2024-08-18T22:13:18.189 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "866ef279-02bd-40d8-80eb-1c218cf47e2d", 2024-08-18T22:13:18.189 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "recursive,force" 2024-08-18T22:13:18.189 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:13:18.190 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:13:18.190 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:13:18.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.185+0000 7efecf198640 1 -- 172.21.15.123:0/2085267418 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efeb00a2c40 msgr2=0x7efeb00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:18.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.185+0000 7efecf198640 1 --2- 172.21.15.123:0/2085267418 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efeb00a2c40 0x7efeb00a5100 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55e2443fd600 tx=0x7efeb80096c0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.185+0000 7efecf198640 1 -- 172.21.15.123:0/2085267418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efec81068b0 msgr2=0x7efec8101a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:18.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.185+0000 7efecf198640 1 --2- 172.21.15.123:0/2085267418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efec81068b0 0x7efec8101a90 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7efec000e970 tx=0x7efec000ee30 comp rx=0 tx=0).stop 2024-08-18T22:13:18.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.185+0000 7efecf198640 1 -- 172.21.15.123:0/2085267418 shutdown_connections 2024-08-18T22:13:18.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.185+0000 7efecf198640 1 --2- 172.21.15.123:0/2085267418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efec81068b0 0x7efec8101a90 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.185+0000 7efecf198640 1 --2- 172.21.15.123:0/2085267418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efec81007d0 0x7efec8101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.185+0000 7efecf198640 1 --2- 172.21.15.123:0/2085267418 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7efeb00a2c40 0x7efeb00a5100 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.185+0000 7efecf198640 1 --2- 172.21.15.123:0/2085267418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efec80ffe30 0x7efec8101010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:18.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.185+0000 7efecf198640 1 -- 172.21.15.123:0/2085267418 >> 172.21.15.123:0/2085267418 conn(0x7efec8076f60 msgr2=0x7efec8104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:18.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.186+0000 7efecf198640 1 -- 172.21.15.123:0/2085267418 shutdown_connections 2024-08-18T22:13:18.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:18.186+0000 7efecf198640 1 -- 172.21.15.123:0/2085267418 wait complete. 2024-08-18T22:13:18.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: scrub summary: active paths [/] 2024-08-18T22:13:18.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000050c4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5001) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004b0a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4351) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004a78 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4278) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000053c6 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5337) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005805 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5811) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004e99 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4762) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000550d (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5478) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004761 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3931) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004285 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3556) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005c50 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6296) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000045f2 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3761) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000523c (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5172) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005845 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5843) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000059a5 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5998) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005430 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5384) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004af0 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4338) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000006438 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7198) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.762 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000006266 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6962) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000052a0 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5216) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005c88 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6320) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005f32 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6617) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000063d8 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7149) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000052a5 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5218) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000513b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5057) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000052fa (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5252) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000051fe (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5145) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005afe (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6150) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000525a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5184) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000633f (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7069) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.763 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005a9a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6107) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.764 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004bab (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4428) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.764 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000063d4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7147) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.764 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000516a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5078) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.764 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000046d9 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3871) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.764 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005276 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5196) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.764 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005f39 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6620) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.764 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000446b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3650) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.764 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000623b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6941) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.764 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000043e4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3623) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.765 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004cc4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4555) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.765 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005ea4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6559) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.765 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000006347 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7073) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.765 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000054dc (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5455) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.765 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004660 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3815) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.765 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005b43 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6182) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.765 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000055b5 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5552) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.765 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004fd0 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4896) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.765 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000061bf (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6879) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.765 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000059d3 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6019) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.765 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000062cf (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7015) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.765 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000006179 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6855) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.766 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000045b6 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3731) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.766 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000046aa (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3849) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.766 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004f2e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4826) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.766 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004d09 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4585) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.766 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005b48 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6184) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.766 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000065a2 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7329) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.766 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005b52 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6188) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.766 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000003f77 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3399) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.766 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000006005 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6707) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.766 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004e35 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4722) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.766 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005901 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5930) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.767 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000064ad (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7261) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.767 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000060bd (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6798) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.767 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004b7c (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4406) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.767 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000514f (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5066) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.767 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004a06 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4227) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.767 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000040b2 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3462) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.767 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005a52 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6076) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.767 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000458f (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3716) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.767 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000053e3 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5351) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.767 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004538 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3689) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.767 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000040b7 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3463) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.767 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005594 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5537) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.768 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005e14 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6495) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.768 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004f5c (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4847) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.768 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000042ac (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3563) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.768 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005360 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5294) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.768 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000464c (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3805) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.768 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005a37 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6063) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.768 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000059df (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6024) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.768 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005f27 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6612) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.768 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000511b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5041) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.768 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000057f1 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5802) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.768 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005e6a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6533) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.769 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004652 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3808) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.769 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004475 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3652) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.769 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000461c (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3782) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.769 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005dae (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6449) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.769 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004993 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4176) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.769 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005a1e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6052) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.771 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004a72 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4275) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.771 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005c42 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6290) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.771 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000057c2 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5781) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.771 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000403f (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3439) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.771 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004416 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3633) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.771 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000063bc (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7135) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005ad7 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6134) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000529a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5213) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000047ed (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3992) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000053ca (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5339) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005656 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5625) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005fd9 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6688) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005540 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5500) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005994 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5991) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004ee6 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4795) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004949 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4146) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005547 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5503) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004927 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4131) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000041d9 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3521) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004e57 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4736) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000534a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5286) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000054d8 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5453) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005722 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5715) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000064ef (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7279) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000060b7 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6795) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005cad (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6336) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000651b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7302) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000057ae (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5773) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000006369 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7091) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.774 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000049f8 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4221) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.774 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005352 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5289) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.774 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000627e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6974) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.774 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000060bf (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6799) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.774 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004d77 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4635) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.774 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004925 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4130) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.774 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000505e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4957) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.774 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005e67 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6532) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.774 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000006419 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7182) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.774 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004d3b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4608) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.775 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000480d (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4007) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.775 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000589f (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5888) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.775 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000051aa (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5106) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.775 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004085 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3453) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.775 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000056a8 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5660) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.775 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000003f6d (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3397) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.775 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000063ba (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7134) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.775 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005923 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5944) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.775 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000006163 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6844) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.775 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000045fa (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3765) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.776 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005b73 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6203) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.776 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005cba (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6342) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.776 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000045da (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3749) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.776 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005c6e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6309) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.776 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004542 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3692) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.776 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004d38 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4607) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.776 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000046a1 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3845) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.776 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005ce1 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6360) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.776 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000049b9 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4193) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.776 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000063ea (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7158) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.776 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005471 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5410) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.777 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005cde (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6359) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.777 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005c47 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6292) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.777 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000046d2 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3868) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.777 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000639d (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7116) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.777 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005065 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4960) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.777 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005101 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5028) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.777 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000058ea (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5921) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.777 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004df1 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4688) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.777 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004466 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3649) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.777 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000006171 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6851) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.777 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004c92 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4533) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.777 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000055fd (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5584) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.778 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000059b6 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6006) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.778 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005fac (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6669) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.778 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x100000047ea (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3991) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.778 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005b62 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6195) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.778 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004980 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4168) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.778 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005c19 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6271) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.778 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005467 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5406) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.778 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000005c1e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6273) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.778 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: scrub summary: active paths [/] 2024-08-18T22:13:18.778 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x1000000580d (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5815) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.779 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: Scrub error on inode 0x10000004bff (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4466) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.779 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:18 smithi123 ceph-mon[18462]: scrub summary: idle+waiting paths [/] 2024-08-18T22:13:18.779 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: scrub summary: active paths [/] 2024-08-18T22:13:18.779 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000050c4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5001) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004b0a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4351) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004a78 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4278) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000053c6 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5337) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005805 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5811) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004e99 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4762) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000550d (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5478) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004761 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3931) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004285 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3556) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005c50 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6296) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000045f2 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3761) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000523c (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5172) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005845 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5843) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.781 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000059a5 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5998) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.781 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005430 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5384) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.781 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004af0 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4338) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.781 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000006438 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7198) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.781 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000006266 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6962) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.781 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000052a0 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5216) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.781 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005c88 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6320) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.781 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005f32 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6617) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.781 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000063d8 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7149) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.781 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000052a5 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5218) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.781 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000513b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5057) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.782 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000052fa (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5252) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.782 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000051fe (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5145) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.782 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005afe (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6150) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.782 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000525a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5184) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.782 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000633f (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7069) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.782 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005a9a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6107) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.782 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004bab (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4428) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.782 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000063d4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7147) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.782 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000516a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5078) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.782 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000046d9 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3871) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.783 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005276 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5196) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.783 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005f39 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6620) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.783 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000446b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3650) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.783 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000623b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6941) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.783 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000043e4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3623) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.783 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004cc4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4555) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.783 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005ea4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6559) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.783 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000006347 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7073) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.783 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000054dc (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5455) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.783 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004660 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3815) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.783 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005b43 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6182) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000055b5 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5552) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004fd0 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4896) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000061bf (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6879) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000059d3 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6019) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000062cf (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7015) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000006179 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6855) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000045b6 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3731) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000046aa (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3849) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004f2e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4826) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004d09 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4585) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005b48 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6184) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000065a2 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7329) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005b52 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6188) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000003f77 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3399) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000006005 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6707) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004e35 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4722) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005901 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5930) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000064ad (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7261) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000060bd (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6798) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004b7c (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4406) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000514f (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5066) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004a06 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4227) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000040b2 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3462) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005a52 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6076) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000458f (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3716) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000053e3 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5351) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004538 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3689) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000040b7 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3463) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005594 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5537) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005e14 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6495) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004f5c (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4847) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000042ac (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3563) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005360 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5294) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000464c (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3805) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005a37 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6063) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000059df (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6024) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005f27 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6612) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000511b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5041) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000057f1 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5802) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005e6a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6533) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.788 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004652 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3808) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.788 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004475 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3652) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.788 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000461c (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3782) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.788 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005dae (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6449) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.788 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004993 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4176) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.788 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005a1e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6052) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.788 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004a72 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4275) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.788 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005c42 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6290) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.788 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000057c2 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5781) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.788 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000403f (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3439) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.788 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004416 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3633) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.789 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000063bc (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7135) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.789 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005ad7 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6134) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.789 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000529a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5213) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.789 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000047ed (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3992) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.789 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000053ca (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5339) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.789 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005656 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5625) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.789 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005fd9 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6688) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.789 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005540 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5500) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.789 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005994 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5991) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.789 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004ee6 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4795) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.789 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004949 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4146) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.790 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005547 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5503) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.790 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004927 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4131) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.790 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000041d9 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3521) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.790 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004e57 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4736) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.790 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000534a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5286) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.790 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000054d8 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5453) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.790 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005722 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5715) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.790 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000064ef (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7279) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.790 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000060b7 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6795) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.790 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005cad (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6336) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.790 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000651b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7302) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.791 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000057ae (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5773) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.791 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000006369 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7091) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.791 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000049f8 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4221) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.791 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005352 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5289) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.791 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000627e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6974) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.791 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000060bf (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6799) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.791 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004d77 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4635) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.791 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004925 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4130) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.791 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000505e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4957) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.791 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005e67 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6532) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.791 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000006419 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7182) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.792 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004d3b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4608) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.792 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000480d (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4007) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.792 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000589f (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5888) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.792 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000051aa (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5106) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.792 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004085 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3453) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.792 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000056a8 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5660) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.792 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000003f6d (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3397) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.792 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000063ba (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7134) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.792 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005923 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5944) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.792 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000006163 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6844) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.792 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000045fa (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3765) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005b73 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6203) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005cba (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6342) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000045da (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3749) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005c6e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6309) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004542 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3692) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004d38 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4607) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000046a1 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3845) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005ce1 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6360) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000049b9 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4193) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000063ea (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7158) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005471 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5410) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005cde (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6359) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005c47 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6292) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000046d2 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3868) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000639d (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7116) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005065 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4960) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005101 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5028) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000058ea (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5921) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004df1 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4688) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004466 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3649) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000006171 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6851) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004c92 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4533) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000055fd (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5584) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000059b6 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6006) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005fac (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6669) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x100000047ea (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3991) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005b62 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6195) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004980 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4168) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005c19 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6271) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005467 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5406) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000005c1e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6273) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: scrub summary: active paths [/] 2024-08-18T22:13:18.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x1000000580d (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5815) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: Scrub error on inode 0x10000004bff (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4466) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:18 smithi130 ceph-mon[21698]: scrub summary: idle+waiting paths [/] 2024-08-18T22:13:18.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: scrub summary: active paths [/] 2024-08-18T22:13:18.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000050c4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5001) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004b0a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4351) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004a78 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4278) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000053c6 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5337) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005805 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5811) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004e99 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4762) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000550d (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5478) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004761 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3931) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004285 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3556) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005c50 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6296) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000045f2 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3761) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000523c (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5172) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.911 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005845 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5843) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.911 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000059a5 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5998) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.911 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005430 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5384) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.911 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004af0 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4338) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.911 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000006438 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7198) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.911 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000006266 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6962) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.912 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000052a0 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5216) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.912 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005c88 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6320) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.912 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005f32 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6617) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.912 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000063d8 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7149) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.912 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000052a5 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5218) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.912 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000513b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5057) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.912 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000052fa (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5252) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.912 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000051fe (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5145) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.912 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005afe (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6150) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000525a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5184) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000633f (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7069) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005a9a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6107) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004bab (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4428) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000063d4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7147) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000516a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5078) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000046d9 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3871) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005276 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5196) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005f39 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6620) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000446b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3650) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000623b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6941) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000043e4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3623) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004cc4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4555) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005ea4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6559) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000006347 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7073) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000054dc (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5455) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004660 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3815) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005b43 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6182) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000055b5 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5552) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004fd0 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4896) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000061bf (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6879) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000059d3 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6019) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000062cf (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7015) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000006179 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6855) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000045b6 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3731) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000046aa (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3849) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004f2e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4826) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004d09 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4585) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005b48 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6184) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000065a2 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7329) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005b52 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6188) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000003f77 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3399) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000006005 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6707) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004e35 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4722) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005901 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5930) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000064ad (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7261) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000060bd (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6798) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004b7c (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4406) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000514f (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5066) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004a06 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4227) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000040b2 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3462) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005a52 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6076) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000458f (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3716) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.917 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000053e3 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5351) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.917 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004538 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3689) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.917 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000040b7 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3463) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.917 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005594 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5537) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.917 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005e14 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6495) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.917 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004f5c (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4847) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.917 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000042ac (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3563) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.917 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005360 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5294) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.917 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000464c (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3805) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.917 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005a37 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6063) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.917 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000059df (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6024) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.917 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005f27 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6612) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000511b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5041) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000057f1 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5802) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005e6a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6533) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004652 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3808) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004475 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3652) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000461c (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3782) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005dae (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6449) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004993 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4176) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005a1e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6052) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004a72 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4275) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005c42 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6290) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000057c2 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5781) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000403f (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3439) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004416 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3633) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000063bc (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7135) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005ad7 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6134) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000529a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5213) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000047ed (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3992) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000053ca (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5339) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005656 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5625) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005fd9 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6688) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005540 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5500) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005994 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5991) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004ee6 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4795) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004949 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4146) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005547 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5503) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004927 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4131) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000041d9 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3521) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004e57 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4736) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000534a (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5286) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000054d8 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5453) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005722 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5715) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000064ef (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7279) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000060b7 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6795) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005cad (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6336) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.921 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000651b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7302) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.921 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000057ae (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5773) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.921 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000006369 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7091) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.921 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000049f8 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4221) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.921 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005352 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5289) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.921 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000627e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6974) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.921 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000060bf (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6799) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.921 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004d77 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4635) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.921 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004925 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4130) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.921 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000505e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4957) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.921 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005e67 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6532) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.922 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000006419 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7182) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.922 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004d3b (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4608) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.922 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000480d (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4007) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.922 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000589f (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5888) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.922 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000051aa (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5106) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.922 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004085 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3453) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.923 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000056a8 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5660) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.923 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000003f6d (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3397) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.923 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000063ba (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7134) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.923 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005923 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5944) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.923 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000006163 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6844) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.923 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000045fa (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3765) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.923 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005b73 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6203) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.923 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005cba (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6342) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.923 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000045da (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3749) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.923 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005c6e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6309) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.923 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004542 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3692) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.923 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004d38 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4607) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000046a1 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3845) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005ce1 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6360) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000049b9 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4193) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000063ea (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7158) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005471 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5410) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005cde (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6359) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005c47 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6292) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000046d2 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3868) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000639d (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7116) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005065 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4960) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005101 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5028) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000058ea (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5921) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.925 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004df1 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4688) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.925 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004466 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3649) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.925 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000006171 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6851) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.925 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004c92 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4533) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.925 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000055fd (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5584) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.925 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000059b6 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6006) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.925 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005fac (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6669) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.925 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x100000047ea (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3991) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.925 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005b62 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6195) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.925 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004980 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4168) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.925 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005c19 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6271) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.925 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005467 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5406) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000005c1e (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6273) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: scrub summary: active paths [/] 2024-08-18T22:13:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x1000000580d (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5815) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: Scrub error on inode 0x10000004bff (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4466) see mds.b log and `damage ls` output for details 2024-08-18T22:13:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:18 smithi183 ceph-mon[22097]: scrub summary: idle+waiting paths [/] 2024-08-18T22:13:19.620 INFO:tasks.cephfs.filesystem:scrub status for tag:866ef279-02bd-40d8-80eb-1c218cf47e2d - {'path': '/', 'tag': '866ef279-02bd-40d8-80eb-1c218cf47e2d', 'options': 'recursive,force'} 2024-08-18T22:13:19.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:19 smithi123 ceph-mon[18462]: pgmap v506: 129 pgs: 129 active+clean; 49 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 2.28k op/s 2024-08-18T22:13:19.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:19 smithi130 ceph-mon[21698]: pgmap v506: 129 pgs: 129 active+clean; 49 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 2.28k op/s 2024-08-18T22:13:19.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:19 smithi183 ceph-mon[22097]: pgmap v506: 129 pgs: 129 active+clean; 49 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 2.28k op/s 2024-08-18T22:13:21.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:21 smithi123 ceph-mon[18462]: pgmap v507: 129 pgs: 129 active+clean; 54 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 2.29k op/s 2024-08-18T22:13:21.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:21 smithi123 ceph-mon[18462]: scrub summary: idle+waiting paths [/] 2024-08-18T22:13:21.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:21 smithi130 ceph-mon[21698]: pgmap v507: 129 pgs: 129 active+clean; 54 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 2.29k op/s 2024-08-18T22:13:21.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:21 smithi130 ceph-mon[21698]: scrub summary: idle+waiting paths [/] 2024-08-18T22:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.842+0000 7f2cbff81640 1 -- 172.21.15.123:0/1764178903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb8100780 msgr2=0x7f2cb8100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.842+0000 7f2cbff81640 1 --2- 172.21.15.123:0/1764178903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb8100780 0x7f2cb8100b80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009900 tx=0x7f2cb402a410 comp rx=0 tx=0).stop 2024-08-18T22:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.842+0000 7f2cbff81640 1 -- 172.21.15.123:0/1764178903 shutdown_connections 2024-08-18T22:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.842+0000 7f2cbff81640 1 --2- 172.21.15.123:0/1764178903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb8102330 0x7f2cb8108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.842+0000 7f2cbff81640 1 --2- 172.21.15.123:0/1764178903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cb8101970 0x7f2cb8101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.842+0000 7f2cbff81640 1 --2- 172.21.15.123:0/1764178903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb8100780 0x7f2cb8100b80 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.842+0000 7f2cbff81640 1 -- 172.21.15.123:0/1764178903 >> 172.21.15.123:0/1764178903 conn(0x7f2cb80fbee0 msgr2=0x7f2cb80fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.842+0000 7f2cbff81640 1 -- 172.21.15.123:0/1764178903 shutdown_connections 2024-08-18T22:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.842+0000 7f2cbff81640 1 -- 172.21.15.123:0/1764178903 wait complete. 2024-08-18T22:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.842+0000 7f2cbff81640 1 Processor -- start 2024-08-18T22:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.842+0000 7f2cbff81640 1 -- start start 2024-08-18T22:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.842+0000 7f2cbff81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb8100780 0x7f2cb8195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbff81640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cb8101970 0x7f2cb8195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbff81640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb8102330 0x7f2cb819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbff81640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb810b380 con 0x7f2cb8100780 2024-08-18T22:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbff81640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb810b200 con 0x7f2cb8102330 2024-08-18T22:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbff81640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb810b500 con 0x7f2cb8101970 2024-08-18T22:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbdd1d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb8100780 0x7f2cb8195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbdd1d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb8100780 0x7f2cb8195990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40642/0 (socket says 172.21.15.123:40642) 2024-08-18T22:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbdd1d640 1 -- 172.21.15.123:0/3983457727 learned_addr learned my addr 172.21.15.123:0/3983457727 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbe51e640 1 --2- 172.21.15.123:0/3983457727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb8102330 0x7f2cb819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbd51c640 1 --2- 172.21.15.123:0/3983457727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cb8101970 0x7f2cb8195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbdd1d640 1 -- 172.21.15.123:0/3983457727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cb8101970 msgr2=0x7f2cb8195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbdd1d640 1 --2- 172.21.15.123:0/3983457727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cb8101970 0x7f2cb8195ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbdd1d640 1 -- 172.21.15.123:0/3983457727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb8102330 msgr2=0x7f2cb819cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbdd1d640 1 --2- 172.21.15.123:0/3983457727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb8102330 0x7f2cb819cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbdd1d640 1 -- 172.21.15.123:0/3983457727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb819d5b0 con 0x7f2cb8100780 2024-08-18T22:13:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbdd1d640 1 --2- 172.21.15.123:0/3983457727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb8100780 0x7f2cb8195990 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4031610 tx=0x7f2cb4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2caeffd640 1 -- 172.21.15.123:0/3983457727 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb403f030 con 0x7f2cb8100780 2024-08-18T22:13:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbff81640 1 -- 172.21.15.123:0/3983457727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb819d840 con 0x7f2cb8100780 2024-08-18T22:13:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2caeffd640 1 -- 172.21.15.123:0/3983457727 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cb4003ce0 con 0x7f2cb8100780 2024-08-18T22:13:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2caeffd640 1 -- 172.21.15.123:0/3983457727 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4035070 con 0x7f2cb8100780 2024-08-18T22:13:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.843+0000 7f2cbff81640 1 -- 172.21.15.123:0/3983457727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb819dd30 con 0x7f2cb8100780 2024-08-18T22:13:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.846+0000 7f2caeffd640 1 -- 172.21.15.123:0/3983457727 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f2cb4042030 con 0x7f2cb8100780 2024-08-18T22:13:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.846+0000 7f2cc2e1c740 1 Processor -- start 2024-08-18T22:13:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.846+0000 7f2cc2e1c740 1 -- start start 2024-08-18T22:13:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.846+0000 7f2cc2e1c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x557563588e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.846+0000 7f2cc2e1c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 0x55756358de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.846+0000 7f2cc2e1c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x557563590920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.846+0000 7f2cc2e1c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5575634e79d0 con 0x557563588a90 2024-08-18T22:13:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.846+0000 7f2cc2e1c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55756348f820 con 0x55756358e460 2024-08-18T22:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.846+0000 7f2cc2e1c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5575634e3990 con 0x5575635893d0 2024-08-18T22:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2cbe51e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x557563588e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2cbdd1d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 0x55756358de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2cbd51c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x557563590920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2cbd51c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x557563590920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:38330/0 (socket says 172.21.15.123:38330) 2024-08-18T22:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2cbe51e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x557563588e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40644/0 (socket says 172.21.15.123:40644) 2024-08-18T22:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2cbd51c640 1 -- 172.21.15.123:0/3827575741 learned_addr learned my addr 172.21.15.123:0/3827575741 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2cbdd1d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 0x55756358de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:52752/0 (socket says 172.21.15.123:52752) 2024-08-18T22:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2caeffd640 1 --2- 172.21.15.123:0/3983457727 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2ca40a2c30 0x7f2ca40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2cbe51e640 1 --2- 172.21.15.123:0/3983457727 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2ca40a2c30 0x7f2ca40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2cbd51c640 1 -- 172.21.15.123:0/3827575741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 msgr2=0x55756358de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2cbd51c640 1 --2- 172.21.15.123:0/3827575741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 0x55756358de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2cbd51c640 1 -- 172.21.15.123:0/3827575741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 msgr2=0x557563588e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2cbd51c640 1 --2- 172.21.15.123:0/3827575741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x557563588e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2cbd51c640 1 -- 172.21.15.123:0/3827575741 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575631fb210 con 0x55756358e460 2024-08-18T22:13:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2caeffd640 1 -- 172.21.15.123:0/3983457727 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f2cb40ef7d0 con 0x7f2cb8100780 2024-08-18T22:13:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2cbd51c640 1 --2- 172.21.15.123:0/3827575741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x557563590920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009c30 tx=0x7f2ca80117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2b41abdb1c26df4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2cbe51e640 1 --2- 172.21.15.123:0/3983457727 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2ca40a2c30 0x7f2ca40a50f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0005c40 tx=0x7f2cb0004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2ca3fff640 1 -- 172.21.15.123:0/3827575741 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8012450 con 0x55756358e460 2024-08-18T22:13:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2ca3fff640 1 -- 172.21.15.123:0/3827575741 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ca8012ad0 con 0x55756358e460 2024-08-18T22:13:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.847+0000 7f2ca3fff640 1 -- 172.21.15.123:0/3827575741 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca800fbf0 con 0x55756358e460 2024-08-18T22:13:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.848+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3827575741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 msgr2=0x557563590920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.848+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/3827575741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x557563590920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009c30 tx=0x7f2ca80117b0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.848+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3827575741 shutdown_connections 2024-08-18T22:13:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.848+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/3827575741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x557563590920 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.848+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/3827575741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 0x55756358de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.848+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/3827575741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x557563588e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.848+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3827575741 >> 172.21.15.123:0/3827575741 conn(0x55756357fcf0 msgr2=0x5575635800f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.848+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3827575741 shutdown_connections 2024-08-18T22:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.848+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3827575741 wait complete. 2024-08-18T22:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.848+0000 7f2cc2e1c740 1 -- start start 2024-08-18T22:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cc2e1c740 1 Processor -- start 2024-08-18T22:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cc2e1c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x557563592bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cc2e1c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 0x5575635930f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cc2e1c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x55756359a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cc2e1c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557563591430 con 0x557563588a90 2024-08-18T22:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cc2e1c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5575634a3520 con 0x55756358e460 2024-08-18T22:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cc2e1c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5575635915b0 con 0x5575635893d0 2024-08-18T22:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cc2e1c740 10 client.0 _ll_register_callbacks cb 0x5575631faa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cbdd1d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x557563592bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cbdd1d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x557563592bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40656/0 (socket says 172.21.15.123:40656) 2024-08-18T22:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cbdd1d640 1 -- 172.21.15.123:0/1010533057 learned_addr learned my addr 172.21.15.123:0/1010533057 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cbd51c640 1 --2- 172.21.15.123:0/1010533057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 0x5575635930f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cbe51e640 1 --2- 172.21.15.123:0/1010533057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x55756359a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cbdd1d640 1 -- 172.21.15.123:0/1010533057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 msgr2=0x5575635930f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cbdd1d640 1 --2- 172.21.15.123:0/1010533057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 0x5575635930f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cbdd1d640 1 -- 172.21.15.123:0/1010533057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 msgr2=0x55756359a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cbdd1d640 1 --2- 172.21.15.123:0/1010533057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x55756359a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.849+0000 7f2cbdd1d640 1 -- 172.21.15.123:0/1010533057 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575632c7620 con 0x557563588a90 2024-08-18T22:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2cbdd1d640 1 --2- 172.21.15.123:0/1010533057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x557563592bb0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40b8670 tx=0x7f2cb4005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d21131b5864d10 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2ca17fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2ca17fa640 1 -- 172.21.15.123:0/1010533057 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4049040 con 0x557563588a90 2024-08-18T22:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2ca17fa640 1 -- 172.21.15.123:0/1010533057 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f2cb40ec010 con 0x557563588a90 2024-08-18T22:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/1010533057 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ca8012ad0 con 0x557563588a90 2024-08-18T22:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2ca17fa640 1 -- 172.21.15.123:0/1010533057 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2cb40bb7e0 con 0x557563588a90 2024-08-18T22:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2cc2e1c740 10 client.16545 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/1010533057 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55756359cf20 con 0x557563588a90 2024-08-18T22:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2ca17fa640 1 -- 172.21.15.123:0/1010533057 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ca8012ad0 con 0x557563588a90 2024-08-18T22:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2ca17fa640 1 -- 172.21.15.123:0/1010533057 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2cb40ec390 con 0x557563588a90 2024-08-18T22:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2cc2e1c740 10 client.16545 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2cc2e1c740 10 client.16545 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2cc2e1c740 20 client.16545 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/1010533057 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55756359e880 0x5575635a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2cc2e1c740 4 client.16545 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/1010533057 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575634f5100 con 0x55756359e880 2024-08-18T22:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.850+0000 7f2cbd51c640 1 --2- 172.21.15.123:0/1010533057 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55756359e880 0x5575635a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.851+0000 7f2ca17fa640 10 client.16545 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.851+0000 7f2cbd51c640 1 --2- 172.21.15.123:0/1010533057 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55756359e880 0x5575635a0d20 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21b480201bbe0f1f server_cookie=435a867acafea63 in_seq=0 out_seq=0 2024-08-18T22:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.852+0000 7f2ca17fa640 1 -- 172.21.15.123:0/1010533057 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575634f5100 con 0x55756359e880 2024-08-18T22:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.852+0000 7f2ca17fa640 10 client.16545 handle_command_reply: tid=0 2024-08-18T22:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.852+0000 7f2cc2e1c740 1 client.16545 shutdown 2024-08-18T22:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.852+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/1010533057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 msgr2=0x557563592bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.852+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/1010533057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x557563592bb0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40b8670 tx=0x7f2cb4005b50 comp rx=0 tx=0).stop 2024-08-18T22:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.852+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/1010533057 shutdown_connections 2024-08-18T22:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.852+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/1010533057 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55756359e880 0x5575635a0d20 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.852+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/1010533057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x55756359a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.852+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/1010533057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 0x5575635930f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.852+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/1010533057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x557563592bb0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.852+0000 7f2ca17fa640 0 client.16545 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:21.861 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.852+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/1010533057 >> 172.21.15.123:0/1010533057 conn(0x55756357fcf0 msgr2=0x557563581500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:21.861 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.852+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/1010533057 shutdown_connections 2024-08-18T22:13:21.861 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.852+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/1010533057 wait complete. 2024-08-18T22:13:21.861 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.852+0000 7f2cc2e1c740 20 client.16545 trim_cache size 0 max 16384 2024-08-18T22:13:21.869 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.867+0000 7f2cc2e1c740 1 Processor -- start 2024-08-18T22:13:21.869 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.867+0000 7f2cc2e1c740 1 -- start start 2024-08-18T22:13:21.869 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.867+0000 7f2cc2e1c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557563588a90 0x557563593070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.869 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.867+0000 7f2cc2e1c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575635893d0 0x55756359a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.869 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.867+0000 7f2cc2e1c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x557563580ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.869 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.867+0000 7f2cc2e1c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb81aaae0 con 0x5575635893d0 2024-08-18T22:13:21.869 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.867+0000 7f2cc2e1c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb81a83b0 con 0x55756358e460 2024-08-18T22:13:21.869 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.867+0000 7f2cc2e1c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb81a6200 con 0x557563588a90 2024-08-18T22:13:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.867+0000 7f2cbd51c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575635893d0 0x55756359a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.867+0000 7f2cbd51c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575635893d0 0x55756359a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40668/0 (socket says 172.21.15.123:40668) 2024-08-18T22:13:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.867+0000 7f2cbd51c640 1 -- 172.21.15.123:0/3317308986 learned_addr learned my addr 172.21.15.123:0/3317308986 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.867+0000 7f2cbdd1d640 1 --2- 172.21.15.123:0/3317308986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557563588a90 0x557563593070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.867+0000 7f2cbe51e640 1 --2- 172.21.15.123:0/3317308986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x557563580ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.867+0000 7f2cbd51c640 1 -- 172.21.15.123:0/3317308986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557563588a90 msgr2=0x557563593070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.868+0000 7f2cbd51c640 1 --2- 172.21.15.123:0/3317308986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557563588a90 0x557563593070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.868+0000 7f2cbd51c640 1 -- 172.21.15.123:0/3317308986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 msgr2=0x557563580ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.868+0000 7f2cbd51c640 1 --2- 172.21.15.123:0/3317308986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x557563580ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.868+0000 7f2cbd51c640 1 -- 172.21.15.123:0/3317308986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55756357fb10 con 0x5575635893d0 2024-08-18T22:13:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.868+0000 7f2cbd51c640 1 --2- 172.21.15.123:0/3317308986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575635893d0 0x55756359a0f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009f40 tx=0x7f2ca8009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e477ddff614b585 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.868+0000 7f2ca37fe640 1 -- 172.21.15.123:0/3317308986 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca800f930 con 0x5575635893d0 2024-08-18T22:13:21.871 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.868+0000 7f2ca37fe640 1 -- 172.21.15.123:0/3317308986 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ca8005040 con 0x5575635893d0 2024-08-18T22:13:21.871 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.868+0000 7f2ca37fe640 1 -- 172.21.15.123:0/3317308986 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8003830 con 0x5575635893d0 2024-08-18T22:13:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3317308986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575635893d0 msgr2=0x55756359a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/3317308986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575635893d0 0x55756359a0f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009f40 tx=0x7f2ca8009d60 comp rx=0 tx=0).stop 2024-08-18T22:13:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3317308986 shutdown_connections 2024-08-18T22:13:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/3317308986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x557563580ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/3317308986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575635893d0 0x55756359a0f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/3317308986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557563588a90 0x557563593070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3317308986 >> 172.21.15.123:0/3317308986 conn(0x55756357fcf0 msgr2=0x557563592960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3317308986 shutdown_connections 2024-08-18T22:13:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3317308986 wait complete. 2024-08-18T22:13:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 -- start start 2024-08-18T22:13:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 Processor -- start 2024-08-18T22:13:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x5575635974b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 0x5575635979f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x557563598990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb81a6870 con 0x557563588a90 2024-08-18T22:13:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb81a7ce0 con 0x55756358e460 2024-08-18T22:13:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb81a6f40 con 0x5575635893d0 2024-08-18T22:13:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.869+0000 7f2cc2e1c740 10 client.0 _ll_register_callbacks cb 0x7f2cb40f5240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2cbdd1d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x5575635974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2cbdd1d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x5575635974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40674/0 (socket says 172.21.15.123:40674) 2024-08-18T22:13:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2cbdd1d640 1 -- 172.21.15.123:0/3979135025 learned_addr learned my addr 172.21.15.123:0/3979135025 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2cbd51c640 1 --2- 172.21.15.123:0/3979135025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 0x5575635979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2cbe51e640 1 --2- 172.21.15.123:0/3979135025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x557563598990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2cbdd1d640 1 -- 172.21.15.123:0/3979135025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 msgr2=0x5575635979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2cbdd1d640 1 --2- 172.21.15.123:0/3979135025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 0x5575635979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2cbdd1d640 1 -- 172.21.15.123:0/3979135025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 msgr2=0x557563598990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2cbdd1d640 1 --2- 172.21.15.123:0/3979135025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x557563598990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2cbdd1d640 1 -- 172.21.15.123:0/3979135025 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557563598fa0 con 0x557563588a90 2024-08-18T22:13:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2cbe51e640 1 --2- 172.21.15.123:0/3979135025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x557563598990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:13:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2cbdd1d640 1 --2- 172.21.15.123:0/3979135025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x5575635974b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40b8100 tx=0x7f2cb402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27f1de1850bbb8e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2ca17fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:13:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2ca17fa640 1 -- 172.21.15.123:0/3979135025 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4049070 con 0x557563588a90 2024-08-18T22:13:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2ca17fa640 1 -- 172.21.15.123:0/3979135025 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f2cb403bbf0 con 0x557563588a90 2024-08-18T22:13:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3979135025 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ca8005040 con 0x557563588a90 2024-08-18T22:13:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2ca17fa640 1 -- 172.21.15.123:0/3979135025 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2cb40bb600 con 0x557563588a90 2024-08-18T22:13:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2cc2e1c740 10 client.16551 fetch_fsmap learned FSMap version 27 2024-08-18T22:13:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.870+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3979135025 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55756359a2b0 con 0x557563588a90 2024-08-18T22:13:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.871+0000 7f2ca17fa640 1 -- 172.21.15.123:0/3979135025 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ca8005040 con 0x557563588a90 2024-08-18T22:13:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.871+0000 7f2ca17fa640 1 -- 172.21.15.123:0/3979135025 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2cb40eca90 con 0x557563588a90 2024-08-18T22:13:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.871+0000 7f2cc2e1c740 10 client.16551 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:13:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.871+0000 7f2cc2e1c740 10 client.16551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.871+0000 7f2cc2e1c740 20 client.16551 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.871+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/3979135025 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5575636099e0 0x55756360be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.871+0000 7f2cc2e1c740 4 client.16551 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:13:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.871+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3979135025 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5575634ef450 con 0x5575636099e0 2024-08-18T22:13:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.871+0000 7f2cbd51c640 1 --2- 172.21.15.123:0/3979135025 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5575636099e0 0x55756360be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.871+0000 7f2ca17fa640 10 client.16551 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:21.871+0000 7f2cbd51c640 1 --2- 172.21.15.123:0/3979135025 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5575636099e0 0x55756360be00 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62740fc2599e814f server_cookie=8427e8d79fb1e7e5 in_seq=0 out_seq=0 2024-08-18T22:13:21.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:21 smithi183 ceph-mon[22097]: pgmap v507: 129 pgs: 129 active+clean; 54 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 2.29k op/s 2024-08-18T22:13:21.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:21 smithi183 ceph-mon[22097]: scrub summary: idle+waiting paths [/] 2024-08-18T22:13:23.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:23 smithi123 ceph-mon[18462]: pgmap v508: 129 pgs: 129 active+clean; 55 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 1.76k op/s 2024-08-18T22:13:23.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:23 smithi130 ceph-mon[21698]: pgmap v508: 129 pgs: 129 active+clean; 55 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 1.76k op/s 2024-08-18T22:13:23.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:23 smithi183 ceph-mon[22097]: pgmap v508: 129 pgs: 129 active+clean; 55 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 1.76k op/s 2024-08-18T22:13:24.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:24 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a[18458]: 2024-08-18T22:13:24.492+0000 7f9a304bb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-18T22:13:24.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:24 smithi123 ceph-mon[18462]: pgmap v509: 129 pgs: 129 active+clean; 66 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 1.77k op/s 2024-08-18T22:13:24.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:24 smithi123 ceph-mon[18462]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-18T22:13:24.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:24 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] up:active 2024-08-18T22:13:24.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:24 smithi123 ceph-mon[18462]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:13:24.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:24 smithi183 ceph-mon[22097]: pgmap v509: 129 pgs: 129 active+clean; 66 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 1.77k op/s 2024-08-18T22:13:24.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:24 smithi183 ceph-mon[22097]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-18T22:13:24.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:24 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] up:active 2024-08-18T22:13:24.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:24 smithi183 ceph-mon[22097]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:13:25.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:24 smithi130 ceph-mon[21698]: pgmap v509: 129 pgs: 129 active+clean; 66 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 1.77k op/s 2024-08-18T22:13:25.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:24 smithi130 ceph-mon[21698]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-18T22:13:25.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:24 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] up:active 2024-08-18T22:13:25.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:24 smithi130 ceph-mon[21698]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:13:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.383+0000 7f2ca17fa640 1 -- 172.21.15.123:0/3979135025 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5575634ef450 con 0x5575636099e0 2024-08-18T22:13:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.383+0000 7f2ca17fa640 10 client.16551 handle_command_reply: tid=0 2024-08-18T22:13:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.383+0000 7f2cc2e1c740 1 client.16551 shutdown 2024-08-18T22:13:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.384+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3979135025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 msgr2=0x5575635974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.384+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/3979135025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x5575635974b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40b8100 tx=0x7f2cb402a410 comp rx=0 tx=0).stop 2024-08-18T22:13:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.384+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3979135025 shutdown_connections 2024-08-18T22:13:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.384+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/3979135025 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5575636099e0 0x55756360be00 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.384+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/3979135025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55756358e460 0x557563598990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.384+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/3979135025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575635893d0 0x5575635979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.384+0000 7f2cc2e1c740 1 --2- 172.21.15.123:0/3979135025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557563588a90 0x5575635974b0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.384+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3979135025 >> 172.21.15.123:0/3979135025 conn(0x55756357fcf0 msgr2=0x55756357e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.384+0000 7f2ca17fa640 0 client.16551 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.384+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3979135025 shutdown_connections 2024-08-18T22:13:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.384+0000 7f2cc2e1c740 1 -- 172.21.15.123:0/3979135025 wait complete. 2024-08-18T22:13:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.384+0000 7f2cc2e1c740 20 client.16551 trim_cache size 0 max 16384 2024-08-18T22:13:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:13:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:13:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:13:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:13:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.384+0000 7f2cbff81640 1 -- 172.21.15.123:0/3983457727 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2ca40a2c30 msgr2=0x7f2ca40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.384+0000 7f2cbff81640 1 --2- 172.21.15.123:0/3983457727 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2ca40a2c30 0x7f2ca40a50f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0005c40 tx=0x7f2cb0004ab0 comp rx=0 tx=0).stop 2024-08-18T22:13:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.385+0000 7f2cbff81640 1 -- 172.21.15.123:0/3983457727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb8100780 msgr2=0x7f2cb8195990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.385+0000 7f2cbff81640 1 --2- 172.21.15.123:0/3983457727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb8100780 0x7f2cb8195990 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4031610 tx=0x7f2cb4032ce0 comp rx=0 tx=0).stop 2024-08-18T22:13:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.385+0000 7f2cbff81640 1 -- 172.21.15.123:0/3983457727 shutdown_connections 2024-08-18T22:13:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.385+0000 7f2cbff81640 1 --2- 172.21.15.123:0/3983457727 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2ca40a2c30 0x7f2ca40a50f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.385+0000 7f2cbff81640 1 --2- 172.21.15.123:0/3983457727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb8102330 0x7f2cb819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.385+0000 7f2cbff81640 1 --2- 172.21.15.123:0/3983457727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cb8101970 0x7f2cb8195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.385+0000 7f2cbff81640 1 --2- 172.21.15.123:0/3983457727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb8100780 0x7f2cb8195990 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.385+0000 7f2cbff81640 1 -- 172.21.15.123:0/3983457727 >> 172.21.15.123:0/3983457727 conn(0x7f2cb80fbee0 msgr2=0x7f2cb8104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.385+0000 7f2cbff81640 1 -- 172.21.15.123:0/3983457727 shutdown_connections 2024-08-18T22:13:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:25.385+0000 7f2cbff81640 1 -- 172.21.15.123:0/3983457727 wait complete. 2024-08-18T22:13:25.909 INFO:tasks.workunit.client.0.smithi123.stdout:created hierarchy, now cleaning up 2024-08-18T22:13:27.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:27 smithi183 ceph-mon[22097]: pgmap v510: 129 pgs: 129 active+clean; 70 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 1.86k op/s 2024-08-18T22:13:27.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:27 smithi123 ceph-mon[18462]: pgmap v510: 129 pgs: 129 active+clean; 70 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 1.86k op/s 2024-08-18T22:13:27.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:27 smithi130 ceph-mon[21698]: pgmap v510: 129 pgs: 129 active+clean; 70 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 1.86k op/s 2024-08-18T22:13:29.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:29 smithi183 ceph-mon[22097]: pgmap v511: 129 pgs: 129 active+clean; 70 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 2.31k op/s 2024-08-18T22:13:29.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:29 smithi183 ceph-mon[22097]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:13:29.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:29 smithi183 ceph-mon[22097]: scrub summary: active paths [/] 2024-08-18T22:13:29.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:29 smithi123 ceph-mon[18462]: pgmap v511: 129 pgs: 129 active+clean; 70 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 2.31k op/s 2024-08-18T22:13:29.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:29 smithi123 ceph-mon[18462]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:13:29.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:29 smithi123 ceph-mon[18462]: scrub summary: active paths [/] 2024-08-18T22:13:29.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:29 smithi130 ceph-mon[21698]: pgmap v511: 129 pgs: 129 active+clean; 70 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 2.31k op/s 2024-08-18T22:13:29.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:29 smithi130 ceph-mon[21698]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:13:29.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:29 smithi130 ceph-mon[21698]: scrub summary: active paths [/] 2024-08-18T22:13:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:31 smithi183 ceph-mon[22097]: pgmap v512: 129 pgs: 129 active+clean; 62 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 2.81k op/s 2024-08-18T22:13:31.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:31 smithi123 ceph-mon[18462]: pgmap v512: 129 pgs: 129 active+clean; 62 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 2.81k op/s 2024-08-18T22:13:31.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:31 smithi130 ceph-mon[21698]: pgmap v512: 129 pgs: 129 active+clean; 62 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 2.81k op/s 2024-08-18T22:13:32.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:32 smithi183 ceph-mon[22097]: scrub summary: idle+waiting paths [/] 2024-08-18T22:13:32.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:32 smithi123 ceph-mon[18462]: scrub summary: idle+waiting paths [/] 2024-08-18T22:13:32.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:32 smithi130 ceph-mon[21698]: scrub summary: idle+waiting paths [/] 2024-08-18T22:13:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:33 smithi183 ceph-mon[22097]: pgmap v513: 129 pgs: 129 active+clean; 66 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.5 MiB/s wr, 2.57k op/s 2024-08-18T22:13:33.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:33 smithi123 ceph-mon[18462]: pgmap v513: 129 pgs: 129 active+clean; 66 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.5 MiB/s wr, 2.57k op/s 2024-08-18T22:13:33.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:33 smithi130 ceph-mon[21698]: pgmap v513: 129 pgs: 129 active+clean; 66 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.5 MiB/s wr, 2.57k op/s 2024-08-18T22:13:34.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:34 smithi183 ceph-mon[22097]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:13:34.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:34 smithi123 ceph-mon[18462]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:13:34.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:34 smithi130 ceph-mon[21698]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:13:35.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:35 smithi183 ceph-mon[22097]: pgmap v514: 129 pgs: 129 active+clean; 77 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.2 MiB/s wr, 2.41k op/s 2024-08-18T22:13:35.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:35 smithi123 ceph-mon[18462]: pgmap v514: 129 pgs: 129 active+clean; 77 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.2 MiB/s wr, 2.41k op/s 2024-08-18T22:13:35.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:35 smithi130 ceph-mon[21698]: pgmap v514: 129 pgs: 129 active+clean; 77 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.2 MiB/s wr, 2.41k op/s 2024-08-18T22:13:37.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:37 smithi183 ceph-mon[22097]: pgmap v515: 129 pgs: 129 active+clean; 85 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.8 MiB/s wr, 1.84k op/s 2024-08-18T22:13:37.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:37 smithi123 ceph-mon[18462]: pgmap v515: 129 pgs: 129 active+clean; 85 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.8 MiB/s wr, 1.84k op/s 2024-08-18T22:13:37.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:37 smithi130 ceph-mon[21698]: pgmap v515: 129 pgs: 129 active+clean; 85 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.8 MiB/s wr, 1.84k op/s 2024-08-18T22:13:38.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:38 smithi183 ceph-mon[22097]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:13:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.472+0000 7f2caad5b640 1 -- 172.21.15.123:0/431086894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca4100770 msgr2=0x7f2ca4100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.472+0000 7f2caad5b640 1 --2- 172.21.15.123:0/431086894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca4100770 0x7f2ca4100b70 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009900 tx=0x7f2c9402a410 comp rx=0 tx=0).stop 2024-08-18T22:13:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2caad5b640 1 -- 172.21.15.123:0/431086894 shutdown_connections 2024-08-18T22:13:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2caad5b640 1 --2- 172.21.15.123:0/431086894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ca4102320 0x7f2ca4108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2caad5b640 1 --2- 172.21.15.123:0/431086894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca4101960 0x7f2ca4101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2caad5b640 1 --2- 172.21.15.123:0/431086894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca4100770 0x7f2ca4100b70 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2caad5b640 1 -- 172.21.15.123:0/431086894 >> 172.21.15.123:0/431086894 conn(0x7f2ca40fbf10 msgr2=0x7f2ca40fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2caad5b640 1 -- 172.21.15.123:0/431086894 shutdown_connections 2024-08-18T22:13:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2caad5b640 1 -- 172.21.15.123:0/431086894 wait complete. 2024-08-18T22:13:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2caad5b640 1 Processor -- start 2024-08-18T22:13:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2caad5b640 1 -- start start 2024-08-18T22:13:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2caad5b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ca4100770 0x7f2ca406a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2caad5b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca4101960 0x7f2ca419c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2caad5b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca4102320 0x7f2ca419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2caad5b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca410c3f0 con 0x7f2ca4102320 2024-08-18T22:13:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2caad5b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca410c270 con 0x7f2ca4101960 2024-08-18T22:13:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2caad5b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca410c570 con 0x7f2ca4100770 2024-08-18T22:13:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2ca92f8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca4102320 0x7f2ca419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2ca92f8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca4102320 0x7f2ca419ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38652/0 (socket says 172.21.15.123:38652) 2024-08-18T22:13:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2ca92f8640 1 -- 172.21.15.123:0/1458830349 learned_addr learned my addr 172.21.15.123:0/1458830349 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2ca8af7640 1 --2- 172.21.15.123:0/1458830349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ca4100770 0x7f2ca406a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.473+0000 7f2ca3fff640 1 --2- 172.21.15.123:0/1458830349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca4101960 0x7f2ca419c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.474+0000 7f2ca92f8640 1 -- 172.21.15.123:0/1458830349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ca4100770 msgr2=0x7f2ca406a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.474+0000 7f2ca92f8640 1 --2- 172.21.15.123:0/1458830349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ca4100770 0x7f2ca406a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.474+0000 7f2ca92f8640 1 -- 172.21.15.123:0/1458830349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca4101960 msgr2=0x7f2ca419c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.474+0000 7f2ca92f8640 1 --2- 172.21.15.123:0/1458830349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca4101960 0x7f2ca419c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.474+0000 7f2ca92f8640 1 -- 172.21.15.123:0/1458830349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca419f790 con 0x7f2ca4102320 2024-08-18T22:13:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.474+0000 7f2ca92f8640 1 --2- 172.21.15.123:0/1458830349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca4102320 0x7f2ca419ee80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00e970 tx=0x7f2c9c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.474+0000 7f2ca1ffb640 1 -- 172.21.15.123:0/1458830349 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c00ccc0 con 0x7f2ca4102320 2024-08-18T22:13:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.474+0000 7f2ca1ffb640 1 -- 172.21.15.123:0/1458830349 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c9c00ce60 con 0x7f2ca4102320 2024-08-18T22:13:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.474+0000 7f2caad5b640 1 -- 172.21.15.123:0/1458830349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca419fa20 con 0x7f2ca4102320 2024-08-18T22:13:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.474+0000 7f2ca1ffb640 1 -- 172.21.15.123:0/1458830349 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c010490 con 0x7f2ca4102320 2024-08-18T22:13:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.474+0000 7f2caad5b640 1 -- 172.21.15.123:0/1458830349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca419ff70 con 0x7f2ca4102320 2024-08-18T22:13:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.476+0000 7f2ca1ffb640 1 -- 172.21.15.123:0/1458830349 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f2c9c005020 con 0x7f2ca4102320 2024-08-18T22:13:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2cadbf6740 1 Processor -- start 2024-08-18T22:13:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2cadbf6740 1 -- start start 2024-08-18T22:13:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2cadbf6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bea90 0x55cae11bee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2cadbf6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2cadbf6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2cadbf6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55cae111d9d0 con 0x55cae11bf3d0 2024-08-18T22:13:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2cadbf6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cae10c5820 con 0x55cae11bea90 2024-08-18T22:13:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2cadbf6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cae1119990 con 0x55cae11c4460 2024-08-18T22:13:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2ca1ffb640 1 --2- 172.21.15.123:0/1458830349 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2c8c0a2c30 0x7f2c8c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2ca8af7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2ca8af7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11c3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38656/0 (socket says 172.21.15.123:38656) 2024-08-18T22:13:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2ca8af7640 1 -- 172.21.15.123:0/2836948187 learned_addr learned my addr 172.21.15.123:0/2836948187 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2ca92f8640 1 --2- 172.21.15.123:0/1458830349 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2c8c0a2c30 0x7f2c8c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2ca3fff640 1 --2- 172.21.15.123:0/2836948187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2ca3fff640 1 --2- 172.21.15.123:0/2836948187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bea90 0x55cae11bee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2ca1ffb640 1 -- 172.21.15.123:0/1458830349 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f2c9c0cf7c0 con 0x7f2ca4102320 2024-08-18T22:13:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2ca8af7640 1 -- 172.21.15.123:0/2836948187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 msgr2=0x55cae11c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2ca8af7640 1 --2- 172.21.15.123:0/2836948187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2ca8af7640 1 -- 172.21.15.123:0/2836948187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bea90 msgr2=0x55cae11bee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2ca8af7640 1 --2- 172.21.15.123:0/2836948187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bea90 0x55cae11bee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.477+0000 7f2ca8af7640 1 -- 172.21.15.123:0/2836948187 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cae0e31210 con 0x55cae11bf3d0 2024-08-18T22:13:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.478+0000 7f2ca8af7640 1 --2- 172.21.15.123:0/2836948187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11c3e90 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2c94031610 tx=0x7f2c94005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a046f414a38105e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.478+0000 7f2ca92f8640 1 --2- 172.21.15.123:0/1458830349 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2c8c0a2c30 0x7f2c8c0a50f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c09bc20 tx=0x7f2c9c06dca0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.478+0000 7f2c8affd640 1 -- 172.21.15.123:0/2836948187 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94040070 con 0x55cae11bf3d0 2024-08-18T22:13:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.478+0000 7f2c8affd640 1 -- 172.21.15.123:0/2836948187 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c94004030 con 0x55cae11bf3d0 2024-08-18T22:13:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.478+0000 7f2c8affd640 1 -- 172.21.15.123:0/2836948187 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94035040 con 0x55cae11bf3d0 2024-08-18T22:13:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.478+0000 7f2cadbf6740 1 -- 172.21.15.123:0/2836948187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 msgr2=0x55cae11c3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.478+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/2836948187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11c3e90 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2c94031610 tx=0x7f2c94005de0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 1 -- 172.21.15.123:0/2836948187 shutdown_connections 2024-08-18T22:13:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/2836948187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/2836948187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11c3e90 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/2836948187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bea90 0x55cae11bee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 1 -- 172.21.15.123:0/2836948187 >> 172.21.15.123:0/2836948187 conn(0x55cae11b5cf0 msgr2=0x55cae11b60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 1 -- 172.21.15.123:0/2836948187 shutdown_connections 2024-08-18T22:13:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 1 -- 172.21.15.123:0/2836948187 wait complete. 2024-08-18T22:13:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 1 -- start start 2024-08-18T22:13:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 1 Processor -- start 2024-08-18T22:13:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bea90 0x55cae11c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bf3d0 0x55cae11c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55cae11c73d0 con 0x55cae11bea90 2024-08-18T22:13:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cae10d9520 con 0x55cae11bf3d0 2024-08-18T22:13:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cae11c7550 con 0x55cae11c4460 2024-08-18T22:13:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2cadbf6740 10 client.0 _ll_register_callbacks cb 0x55cae0e30a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bea90 0x55cae11c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.490 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2ca8af7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bf3d0 0x55cae11c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.490 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bea90 0x55cae11c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38670/0 (socket says 172.21.15.123:38670) 2024-08-18T22:13:38.490 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2ca8af7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bf3d0 0x55cae11c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:41688/0 (socket says 172.21.15.123:41688) 2024-08-18T22:13:38.490 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.479+0000 7f2ca3fff640 1 -- 172.21.15.123:0/1812278199 learned_addr learned my addr 172.21.15.123:0/1812278199 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:38.490 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2ca3fff640 1 --2- 172.21.15.123:0/1812278199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.490 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2ca8af7640 1 -- 172.21.15.123:0/1812278199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 msgr2=0x55cae11d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:38.490 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2ca8af7640 1 --2- 172.21.15.123:0/1812278199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.490 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2ca8af7640 1 -- 172.21.15.123:0/1812278199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bea90 msgr2=0x55cae11c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:38.490 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2ca8af7640 1 --2- 172.21.15.123:0/1812278199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bea90 0x55cae11c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.490 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2ca8af7640 1 -- 172.21.15.123:0/1812278199 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cae0efd620 con 0x55cae11bf3d0 2024-08-18T22:13:38.490 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2ca3fff640 1 --2- 172.21.15.123:0/1812278199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bea90 0x55cae11c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:38.490 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2ca8af7640 1 --2- 172.21.15.123:0/1812278199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bf3d0 0x55cae11c90f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c94005ab0 tx=0x7f2c94032ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b8132233001170a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2c83fff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:13:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2c83fff640 1 -- 172.21.15.123:0/1812278199 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9404c020 con 0x55cae11bf3d0 2024-08-18T22:13:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1812278199 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c94004030 con 0x55cae11bf3d0 2024-08-18T22:13:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2c83fff640 1 -- 172.21.15.123:0/1812278199 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f2c940043e0 con 0x55cae11bf3d0 2024-08-18T22:13:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2c83fff640 1 -- 172.21.15.123:0/1812278199 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2c94057050 con 0x55cae11bf3d0 2024-08-18T22:13:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2cadbf6740 10 client.25880 fetch_fsmap learned FSMap version 31 2024-08-18T22:13:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1812278199 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cae11d2f20 con 0x55cae11bf3d0 2024-08-18T22:13:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.480+0000 7f2c83fff640 1 -- 172.21.15.123:0/1812278199 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c94004030 con 0x55cae11bf3d0 2024-08-18T22:13:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.481+0000 7f2c83fff640 1 -- 172.21.15.123:0/1812278199 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f2c940035f0 con 0x55cae11bf3d0 2024-08-18T22:13:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.481+0000 7f2cadbf6740 10 client.25880 fetch_fsmap finished waiting for FSMap version 31 2024-08-18T22:13:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.481+0000 7f2cadbf6740 10 client.25880 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.481+0000 7f2cadbf6740 20 client.25880 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.481+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/1812278199 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55cae11d4270 0x55cae11d6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.481+0000 7f2cadbf6740 4 client.25880 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:13:38.492 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.481+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1812278199 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cae112b100 con 0x55cae11d4270 2024-08-18T22:13:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.481+0000 7f2ca3fff640 1 --2- 172.21.15.123:0/1812278199 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55cae11d4270 0x55cae11d6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.481+0000 7f2c83fff640 10 client.25880 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.481+0000 7f2ca3fff640 1 --2- 172.21.15.123:0/1812278199 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55cae11d4270 0x55cae11d6660 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b30454727679c56a server_cookie=8eb017c7db1495b8 in_seq=0 out_seq=0 2024-08-18T22:13:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.483+0000 7f2c83fff640 1 -- 172.21.15.123:0/1812278199 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cae112b100 con 0x55cae11d4270 2024-08-18T22:13:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.483+0000 7f2c83fff640 10 client.25880 handle_command_reply: tid=0 2024-08-18T22:13:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.483+0000 7f2cadbf6740 1 client.25880 shutdown 2024-08-18T22:13:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.483+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1812278199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bf3d0 msgr2=0x55cae11c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.483+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/1812278199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bf3d0 0x55cae11c90f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c94005ab0 tx=0x7f2c94032ee0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.483+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1812278199 shutdown_connections 2024-08-18T22:13:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.483+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/1812278199 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55cae11d4270 0x55cae11d6660 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.483+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/1812278199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.483+0000 7f2c83fff640 0 client.25880 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.483+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/1812278199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bf3d0 0x55cae11c90f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.483+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/1812278199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bea90 0x55cae11c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.483+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1812278199 >> 172.21.15.123:0/1812278199 conn(0x55cae11b5cf0 msgr2=0x55cae11b7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.483+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1812278199 shutdown_connections 2024-08-18T22:13:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.483+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1812278199 wait complete. 2024-08-18T22:13:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.483+0000 7f2cadbf6740 20 client.25880 trim_cache size 0 max 16384 2024-08-18T22:13:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.497+0000 7f2cadbf6740 1 Processor -- start 2024-08-18T22:13:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.497+0000 7f2cadbf6740 1 -- start start 2024-08-18T22:13:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.497+0000 7f2cadbf6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bea90 0x55cae11b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2cadbf6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2cadbf6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2cadbf6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca41aaaf0 con 0x55cae11bf3d0 2024-08-18T22:13:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2cadbf6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca41a8330 con 0x55cae11bea90 2024-08-18T22:13:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2cadbf6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca41a6180 con 0x55cae11c4460 2024-08-18T22:13:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2ca8af7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2ca8af7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11d00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38672/0 (socket says 172.21.15.123:38672) 2024-08-18T22:13:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2ca8af7640 1 -- 172.21.15.123:0/4142061342 learned_addr learned my addr 172.21.15.123:0/4142061342 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2ca3fff640 1 --2- 172.21.15.123:0/4142061342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bea90 0x55cae11b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2ca3fff640 1 --2- 172.21.15.123:0/4142061342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2ca8af7640 1 -- 172.21.15.123:0/4142061342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 msgr2=0x55cae11b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2ca8af7640 1 --2- 172.21.15.123:0/4142061342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2ca8af7640 1 -- 172.21.15.123:0/4142061342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bea90 msgr2=0x55cae11b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2ca8af7640 1 --2- 172.21.15.123:0/4142061342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bea90 0x55cae11b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2ca8af7640 1 -- 172.21.15.123:0/4142061342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cae11d6ce0 con 0x55cae11bf3d0 2024-08-18T22:13:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2ca3fff640 1 --2- 172.21.15.123:0/4142061342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:13:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2ca8af7640 1 --2- 172.21.15.123:0/4142061342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11d00f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2c9402a930 tx=0x7f2c94005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8006b7b4722c2aa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2c8a7fc640 1 -- 172.21.15.123:0/4142061342 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9404c040 con 0x55cae11bf3d0 2024-08-18T22:13:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2c8a7fc640 1 -- 172.21.15.123:0/4142061342 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c94005680 con 0x55cae11bf3d0 2024-08-18T22:13:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.498+0000 7f2c8a7fc640 1 -- 172.21.15.123:0/4142061342 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94040070 con 0x55cae11bf3d0 2024-08-18T22:13:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.499+0000 7f2cadbf6740 1 -- 172.21.15.123:0/4142061342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 msgr2=0x55cae11d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.499+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/4142061342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11d00f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2c9402a930 tx=0x7f2c94005de0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.499+0000 7f2cadbf6740 1 -- 172.21.15.123:0/4142061342 shutdown_connections 2024-08-18T22:13:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.499+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/4142061342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.499+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/4142061342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11d00f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.499+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/4142061342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bea90 0x55cae11b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.499+0000 7f2cadbf6740 1 -- 172.21.15.123:0/4142061342 >> 172.21.15.123:0/4142061342 conn(0x55cae11b5cf0 msgr2=0x55cae11c0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.499+0000 7f2cadbf6740 1 -- 172.21.15.123:0/4142061342 shutdown_connections 2024-08-18T22:13:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.499+0000 7f2cadbf6740 1 -- 172.21.15.123:0/4142061342 wait complete. 2024-08-18T22:13:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.499+0000 7f2cadbf6740 1 -- start start 2024-08-18T22:13:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.499+0000 7f2cadbf6740 1 Processor -- start 2024-08-18T22:13:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.499+0000 7f2cadbf6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bea90 0x55cae11cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2cadbf6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2cadbf6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2cadbf6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca41a67f0 con 0x55cae11bf3d0 2024-08-18T22:13:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2cadbf6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca41a7c60 con 0x55cae11bea90 2024-08-18T22:13:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2cadbf6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca41a6ec0 con 0x55cae11c4460 2024-08-18T22:13:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2cadbf6740 10 client.0 _ll_register_callbacks cb 0x7f2c980115f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2ca8af7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bea90 0x55cae11cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2ca8af7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38674/0 (socket says 172.21.15.123:38674) 2024-08-18T22:13:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2ca8af7640 1 -- 172.21.15.123:0/1158399675 learned_addr learned my addr 172.21.15.123:0/1158399675 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2ca3fff640 1 --2- 172.21.15.123:0/1158399675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2ca8af7640 1 -- 172.21.15.123:0/1158399675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 msgr2=0x55cae11ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2ca8af7640 1 --2- 172.21.15.123:0/1158399675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2ca8af7640 1 -- 172.21.15.123:0/1158399675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bea90 msgr2=0x55cae11cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2ca8af7640 1 --2- 172.21.15.123:0/1158399675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bea90 0x55cae11cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2ca8af7640 1 -- 172.21.15.123:0/1158399675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cae11cee20 con 0x55cae11bf3d0 2024-08-18T22:13:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2ca8af7640 1 --2- 172.21.15.123:0/1158399675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11cd800 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2c94031610 tx=0x7f2c940328f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61aeed75c01570e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2c83fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:13:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2c83fff640 1 -- 172.21.15.123:0/1158399675 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9404c070 con 0x55cae11bf3d0 2024-08-18T22:13:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2c83fff640 1 -- 172.21.15.123:0/1158399675 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f2c94004070 con 0x55cae11bf3d0 2024-08-18T22:13:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1158399675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c94005680 con 0x55cae11bf3d0 2024-08-18T22:13:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2c83fff640 1 -- 172.21.15.123:0/1158399675 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2c9406d050 con 0x55cae11bf3d0 2024-08-18T22:13:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2cadbf6740 10 client.16569 fetch_fsmap learned FSMap version 31 2024-08-18T22:13:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.500+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1158399675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cae11d0130 con 0x55cae11bf3d0 2024-08-18T22:13:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.501+0000 7f2c83fff640 1 -- 172.21.15.123:0/1158399675 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c94005680 con 0x55cae11bf3d0 2024-08-18T22:13:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.501+0000 7f2c83fff640 1 -- 172.21.15.123:0/1158399675 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f2c94004c60 con 0x55cae11bf3d0 2024-08-18T22:13:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.501+0000 7f2cadbf6740 10 client.16569 fetch_fsmap finished waiting for FSMap version 31 2024-08-18T22:13:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.501+0000 7f2cadbf6740 10 client.16569 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.501+0000 7f2cadbf6740 20 client.16569 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.501+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/1158399675 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55cae123f280 0x55cae1241670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.501+0000 7f2cadbf6740 4 client.16569 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:13:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.501+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1158399675 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cae1125450 con 0x55cae123f280 2024-08-18T22:13:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.501+0000 7f2ca3fff640 1 --2- 172.21.15.123:0/1158399675 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55cae123f280 0x55cae1241670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.501+0000 7f2c83fff640 10 client.16569 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:38.501+0000 7f2ca3fff640 1 --2- 172.21.15.123:0/1158399675 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55cae123f280 0x55cae1241670 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=479dcd7673c257d0 server_cookie=c18a37c32c803e61 in_seq=0 out_seq=0 2024-08-18T22:13:38.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:38 smithi123 ceph-mon[18462]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:13:38.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:38 smithi130 ceph-mon[21698]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:13:39.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:39 smithi183 ceph-mon[22097]: pgmap v516: 129 pgs: 129 active+clean; 85 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 1.57k op/s 2024-08-18T22:13:39.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:39 smithi123 ceph-mon[18462]: pgmap v516: 129 pgs: 129 active+clean; 85 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 1.57k op/s 2024-08-18T22:13:39.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:39 smithi130 ceph-mon[21698]: pgmap v516: 129 pgs: 129 active+clean; 85 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 1.57k op/s 2024-08-18T22:13:41.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:41 smithi183 ceph-mon[22097]: pgmap v517: 129 pgs: 129 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.1 MiB/s wr, 1.13k op/s 2024-08-18T22:13:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.448+0000 7f2c83fff640 1 -- 172.21.15.123:0/1158399675 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cae1125450 con 0x55cae123f280 2024-08-18T22:13:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.448+0000 7f2c83fff640 10 client.16569 handle_command_reply: tid=0 2024-08-18T22:13:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.448+0000 7f2cadbf6740 1 client.16569 shutdown 2024-08-18T22:13:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.448+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1158399675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 msgr2=0x55cae11cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.448+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/1158399675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11cd800 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2c94031610 tx=0x7f2c940328f0 comp rx=0 tx=0).stop 2024-08-18T22:13:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.448+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1158399675 shutdown_connections 2024-08-18T22:13:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.448+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/1158399675 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55cae123f280 0x55cae1241670 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.448+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/1158399675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cae11c4460 0x55cae11ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.448+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/1158399675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55cae11bf3d0 0x55cae11cd800 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.448+0000 7f2cadbf6740 1 --2- 172.21.15.123:0/1158399675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cae11bea90 0x55cae11cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.448+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1158399675 >> 172.21.15.123:0/1158399675 conn(0x55cae11b5cf0 msgr2=0x55cae11c3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.448+0000 7f2c83fff640 0 client.16569 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.448+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1158399675 shutdown_connections 2024-08-18T22:13:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.448+0000 7f2cadbf6740 1 -- 172.21.15.123:0/1158399675 wait complete. 2024-08-18T22:13:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.448+0000 7f2cadbf6740 20 client.16569 trim_cache size 0 max 16384 2024-08-18T22:13:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:13:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:13:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:13:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:13:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.449+0000 7f2caad5b640 1 -- 172.21.15.123:0/1458830349 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2c8c0a2c30 msgr2=0x7f2c8c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.449+0000 7f2caad5b640 1 --2- 172.21.15.123:0/1458830349 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2c8c0a2c30 0x7f2c8c0a50f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c09bc20 tx=0x7f2c9c06dca0 comp rx=0 tx=0).stop 2024-08-18T22:13:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.449+0000 7f2caad5b640 1 -- 172.21.15.123:0/1458830349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca4102320 msgr2=0x7f2ca419ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.449+0000 7f2caad5b640 1 --2- 172.21.15.123:0/1458830349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca4102320 0x7f2ca419ee80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00e970 tx=0x7f2c9c00ed70 comp rx=0 tx=0).stop 2024-08-18T22:13:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.449+0000 7f2caad5b640 1 -- 172.21.15.123:0/1458830349 shutdown_connections 2024-08-18T22:13:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.449+0000 7f2caad5b640 1 --2- 172.21.15.123:0/1458830349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca4102320 0x7f2ca419ee80 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.449+0000 7f2caad5b640 1 --2- 172.21.15.123:0/1458830349 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2c8c0a2c30 0x7f2c8c0a50f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.449+0000 7f2caad5b640 1 --2- 172.21.15.123:0/1458830349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca4101960 0x7f2ca419c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.449+0000 7f2caad5b640 1 --2- 172.21.15.123:0/1458830349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ca4100770 0x7f2ca406a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.449+0000 7f2caad5b640 1 -- 172.21.15.123:0/1458830349 >> 172.21.15.123:0/1458830349 conn(0x7f2ca40fbf10 msgr2=0x7f2ca4104c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.449+0000 7f2caad5b640 1 -- 172.21.15.123:0/1458830349 shutdown_connections 2024-08-18T22:13:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:41.449+0000 7f2caad5b640 1 -- 172.21.15.123:0/1458830349 wait complete. 2024-08-18T22:13:41.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:41 smithi123 ceph-mon[18462]: pgmap v517: 129 pgs: 129 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.1 MiB/s wr, 1.13k op/s 2024-08-18T22:13:41.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:41 smithi130 ceph-mon[21698]: pgmap v517: 129 pgs: 129 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.1 MiB/s wr, 1.13k op/s 2024-08-18T22:13:42.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:42 smithi183 ceph-mon[22097]: scrub summary: idle+waiting paths [/] 2024-08-18T22:13:42.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:42 smithi123 ceph-mon[18462]: scrub summary: idle+waiting paths [/] 2024-08-18T22:13:42.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:42 smithi130 ceph-mon[21698]: scrub summary: idle+waiting paths [/] 2024-08-18T22:13:43.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:43 smithi183 ceph-mon[22097]: pgmap v518: 129 pgs: 129 active+clean; 97 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 724 op/s 2024-08-18T22:13:43.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:43 smithi183 ceph-mon[22097]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:13:43.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:43 smithi123 ceph-mon[18462]: pgmap v518: 129 pgs: 129 active+clean; 97 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 724 op/s 2024-08-18T22:13:43.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:43 smithi123 ceph-mon[18462]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:13:43.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:43 smithi130 ceph-mon[21698]: pgmap v518: 129 pgs: 129 active+clean; 97 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 724 op/s 2024-08-18T22:13:43.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:43 smithi130 ceph-mon[21698]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:13:45.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:45 smithi183 ceph-mon[22097]: pgmap v519: 129 pgs: 129 active+clean; 103 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.1 MiB/s wr, 771 op/s 2024-08-18T22:13:45.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:45 smithi123 ceph-mon[18462]: pgmap v519: 129 pgs: 129 active+clean; 103 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.1 MiB/s wr, 771 op/s 2024-08-18T22:13:45.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:45 smithi130 ceph-mon[21698]: pgmap v519: 129 pgs: 129 active+clean; 103 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.1 MiB/s wr, 771 op/s 2024-08-18T22:13:47.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:47 smithi183 ceph-mon[22097]: pgmap v520: 129 pgs: 129 active+clean; 100 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 570 op/s 2024-08-18T22:13:47.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:47 smithi123 ceph-mon[18462]: pgmap v520: 129 pgs: 129 active+clean; 100 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 570 op/s 2024-08-18T22:13:47.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:47 smithi130 ceph-mon[21698]: pgmap v520: 129 pgs: 129 active+clean; 100 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 570 op/s 2024-08-18T22:13:48.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:48 smithi183 ceph-mon[22097]: scrub summary: idle 2024-08-18T22:13:48.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:48 smithi123 ceph-mon[18462]: scrub summary: idle 2024-08-18T22:13:48.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:48 smithi130 ceph-mon[21698]: scrub summary: idle 2024-08-18T22:13:49.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:49 smithi183 ceph-mon[22097]: scrub summary: idle 2024-08-18T22:13:49.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:49 smithi183 ceph-mon[22097]: scrub summary: idle 2024-08-18T22:13:49.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:49 smithi183 ceph-mon[22097]: pgmap v521: 129 pgs: 129 active+clean; 104 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 645 op/s 2024-08-18T22:13:49.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:49 smithi123 ceph-mon[18462]: scrub summary: idle 2024-08-18T22:13:49.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:49 smithi123 ceph-mon[18462]: scrub summary: idle 2024-08-18T22:13:49.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:49 smithi123 ceph-mon[18462]: pgmap v521: 129 pgs: 129 active+clean; 104 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 645 op/s 2024-08-18T22:13:49.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:49 smithi130 ceph-mon[21698]: scrub summary: idle 2024-08-18T22:13:49.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:49 smithi130 ceph-mon[21698]: scrub summary: idle 2024-08-18T22:13:49.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:49 smithi130 ceph-mon[21698]: pgmap v521: 129 pgs: 129 active+clean; 104 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 645 op/s 2024-08-18T22:13:49.621 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-18T22:13:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:13:50.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.430+0000 7f503aea5640 1 -- 172.21.15.123:0/2062587378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50341022a0 msgr2=0x7f50341026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:50.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.430+0000 7f503aea5640 1 --2- 172.21.15.123:0/2062587378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50341022a0 0x7f50341026e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5020009900 tx=0x7f502002a480 comp rx=0 tx=0).stop 2024-08-18T22:13:50.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.430+0000 7f503aea5640 1 -- 172.21.15.123:0/2062587378 shutdown_connections 2024-08-18T22:13:50.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.430+0000 7f503aea5640 1 --2- 172.21.15.123:0/2062587378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5034102c20 0x7f503410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.430+0000 7f503aea5640 1 --2- 172.21.15.123:0/2062587378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50341022a0 0x7f50341026e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.430+0000 7f503aea5640 1 --2- 172.21.15.123:0/2062587378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5034100b50 0x7f5034100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.430+0000 7f503aea5640 1 -- 172.21.15.123:0/2062587378 >> 172.21.15.123:0/2062587378 conn(0x7f50340fc500 msgr2=0x7f50340fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:50.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.430+0000 7f503aea5640 1 -- 172.21.15.123:0/2062587378 shutdown_connections 2024-08-18T22:13:50.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.430+0000 7f503aea5640 1 -- 172.21.15.123:0/2062587378 wait complete. 2024-08-18T22:13:50.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.431+0000 7f503aea5640 1 Processor -- start 2024-08-18T22:13:50.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.431+0000 7f503aea5640 1 -- start start 2024-08-18T22:13:50.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.431+0000 7f503aea5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5034100b50 0x7f50341982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.431+0000 7f503aea5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50341022a0 0x7f50341987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.431+0000 7f503aea5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5034102c20 0x7f503419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.431+0000 7f503aea5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5034110cb0 con 0x7f50341022a0 2024-08-18T22:13:50.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.431+0000 7f503aea5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5034110b30 con 0x7f5034100b50 2024-08-18T22:13:50.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.431+0000 7f503aea5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5034110e30 con 0x7f5034102c20 2024-08-18T22:13:50.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.431+0000 7f5033fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50341022a0 0x7f50341987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.431+0000 7f5033fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50341022a0 0x7f50341987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54584/0 (socket says 172.21.15.123:54584) 2024-08-18T22:13:50.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.431+0000 7f5033fff640 1 -- 172.21.15.123:0/2647278576 learned_addr learned my addr 172.21.15.123:0/2647278576 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:50.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.431+0000 7f5039442640 1 --2- 172.21.15.123:0/2647278576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5034102c20 0x7f503419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.431+0000 7f5038c41640 1 --2- 172.21.15.123:0/2647278576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5034100b50 0x7f50341982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.432+0000 7f5033fff640 1 -- 172.21.15.123:0/2647278576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5034102c20 msgr2=0x7f503419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:50.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.432+0000 7f5033fff640 1 --2- 172.21.15.123:0/2647278576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5034102c20 0x7f503419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.432+0000 7f5033fff640 1 -- 172.21.15.123:0/2647278576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5034100b50 msgr2=0x7f50341982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:50.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.432+0000 7f5033fff640 1 --2- 172.21.15.123:0/2647278576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5034100b50 0x7f50341982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.432+0000 7f5033fff640 1 -- 172.21.15.123:0/2647278576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503419d1b0 con 0x7f50341022a0 2024-08-18T22:13:50.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.432+0000 7f5033fff640 1 --2- 172.21.15.123:0/2647278576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50341022a0 0x7f50341987e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5020006010 tx=0x7f5020003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:50.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.432+0000 7f5031ffb640 1 -- 172.21.15.123:0/2647278576 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502003f070 con 0x7f50341022a0 2024-08-18T22:13:50.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.432+0000 7f503aea5640 1 -- 172.21.15.123:0/2647278576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f503419d440 con 0x7f50341022a0 2024-08-18T22:13:50.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.432+0000 7f5031ffb640 1 -- 172.21.15.123:0/2647278576 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5020031c30 con 0x7f50341022a0 2024-08-18T22:13:50.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.432+0000 7f5031ffb640 1 -- 172.21.15.123:0/2647278576 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5020035030 con 0x7f50341022a0 2024-08-18T22:13:50.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.432+0000 7f503aea5640 1 -- 172.21.15.123:0/2647278576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50341a4d80 con 0x7f50341022a0 2024-08-18T22:13:50.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.435+0000 7f5031ffb640 1 -- 172.21.15.123:0/2647278576 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f5020042070 con 0x7f50341022a0 2024-08-18T22:13:50.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.435+0000 7f503d2a3740 1 Processor -- start 2024-08-18T22:13:50.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.435+0000 7f503d2a3740 1 -- start start 2024-08-18T22:13:50.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.435+0000 7f503d2a3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3210 0x560f290f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.435+0000 7f503d2a3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290f3b30 0x560f290fdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.435+0000 7f503d2a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290fe3f0 0x560f291007e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f503d2a3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x560f29058980 con 0x560f290f3210 2024-08-18T22:13:50.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f503d2a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560f28ff0a70 con 0x560f290fe3f0 2024-08-18T22:13:50.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f503d2a3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560f29054940 con 0x560f290f3b30 2024-08-18T22:13:50.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5031ffb640 1 --2- 172.21.15.123:0/2647278576 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f50240a2b80 0x7f50240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5039442640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3210 0x560f290f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5033fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290fe3f0 0x560f291007e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5039442640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3210 0x560f290f35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54596/0 (socket says 172.21.15.123:54596) 2024-08-18T22:13:50.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5039442640 1 -- 172.21.15.123:0/2007566471 learned_addr learned my addr 172.21.15.123:0/2007566471 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:50.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5038c41640 1 --2- 172.21.15.123:0/2007566471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290f3b30 0x560f290fdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5039442640 1 --2- 172.21.15.123:0/2647278576 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f50240a2b80 0x7f50240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5031ffb640 1 -- 172.21.15.123:0/2647278576 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f50200efa20 con 0x7f50341022a0 2024-08-18T22:13:50.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5038c41640 1 -- 172.21.15.123:0/2007566471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290fe3f0 msgr2=0x560f291007e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:50.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5038c41640 1 --2- 172.21.15.123:0/2007566471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290fe3f0 0x560f291007e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5038c41640 1 -- 172.21.15.123:0/2007566471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3210 msgr2=0x560f290f35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:50.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5038c41640 1 --2- 172.21.15.123:0/2007566471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3210 0x560f290f35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5038c41640 1 -- 172.21.15.123:0/2007566471 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f290536e0 con 0x560f290f3b30 2024-08-18T22:13:50.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5033fff640 1 --2- 172.21.15.123:0/2007566471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290fe3f0 0x560f291007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:50.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5039442640 1 --2- 172.21.15.123:0/2647278576 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f50240a2b80 0x7f50240a5040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f502c0099e0 tx=0x7f502c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:50.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f5038c41640 1 --2- 172.21.15.123:0/2007566471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290f3b30 0x560f290fdeb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5028005fd0 tx=0x7f50280107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3e8cddda2a6a042 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:50.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.436+0000 7f501effd640 1 -- 172.21.15.123:0/2007566471 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502801c680 con 0x560f290f3b30 2024-08-18T22:13:50.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.437+0000 7f501effd640 1 -- 172.21.15.123:0/2007566471 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f502800be20 con 0x560f290f3b30 2024-08-18T22:13:50.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.437+0000 7f501effd640 1 -- 172.21.15.123:0/2007566471 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5028011cd0 con 0x560f290f3b30 2024-08-18T22:13:50.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.437+0000 7f503d2a3740 1 -- 172.21.15.123:0/2007566471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290f3b30 msgr2=0x560f290fdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:50.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.437+0000 7f503d2a3740 1 --2- 172.21.15.123:0/2007566471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290f3b30 0x560f290fdeb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5028005fd0 tx=0x7f50280107a0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.437+0000 7f503d2a3740 1 -- 172.21.15.123:0/2007566471 shutdown_connections 2024-08-18T22:13:50.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.437+0000 7f503d2a3740 1 --2- 172.21.15.123:0/2007566471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290fe3f0 0x560f291007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.437+0000 7f503d2a3740 1 --2- 172.21.15.123:0/2007566471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290f3b30 0x560f290fdeb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.437+0000 7f503d2a3740 1 --2- 172.21.15.123:0/2007566471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3210 0x560f290f35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.437+0000 7f503d2a3740 1 -- 172.21.15.123:0/2007566471 >> 172.21.15.123:0/2007566471 conn(0x560f290ef7a0 msgr2=0x560f290efb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:50.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.437+0000 7f503d2a3740 1 -- 172.21.15.123:0/2007566471 shutdown_connections 2024-08-18T22:13:50.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.437+0000 7f503d2a3740 1 -- 172.21.15.123:0/2007566471 wait complete. 2024-08-18T22:13:50.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.438+0000 7f503d2a3740 1 -- start start 2024-08-18T22:13:50.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.438+0000 7f503d2a3740 1 Processor -- start 2024-08-18T22:13:50.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.438+0000 7f503d2a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3210 0x560f290fb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.438+0000 7f503d2a3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3b30 0x560f290fb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.438+0000 7f503d2a3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290fe3f0 0x560f290fbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.438+0000 7f503d2a3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x560f291053d0 con 0x560f290f3b30 2024-08-18T22:13:50.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.438+0000 7f503d2a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560f29013aa0 con 0x560f290f3210 2024-08-18T22:13:50.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.438+0000 7f503d2a3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560f29105550 con 0x560f290fe3f0 2024-08-18T22:13:50.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.438+0000 7f503d2a3740 10 client.0 _ll_register_callbacks cb 0x560f29002e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:50.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.438+0000 7f5033fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3b30 0x560f290fb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.438+0000 7f5033fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3b30 0x560f290fb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54598/0 (socket says 172.21.15.123:54598) 2024-08-18T22:13:50.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.438+0000 7f5033fff640 1 -- 172.21.15.123:0/3514765410 learned_addr learned my addr 172.21.15.123:0/3514765410 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:50.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.438+0000 7f5038c41640 1 --2- 172.21.15.123:0/3514765410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3210 0x560f290fb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.439+0000 7f5039442640 1 --2- 172.21.15.123:0/3514765410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290fe3f0 0x560f290fbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.439+0000 7f5033fff640 1 -- 172.21.15.123:0/3514765410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290fe3f0 msgr2=0x560f290fbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:50.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.439+0000 7f5033fff640 1 --2- 172.21.15.123:0/3514765410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290fe3f0 0x560f290fbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.439+0000 7f5033fff640 1 -- 172.21.15.123:0/3514765410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3210 msgr2=0x560f290fb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:50.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.439+0000 7f5033fff640 1 --2- 172.21.15.123:0/3514765410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3210 0x560f290fb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.439+0000 7f5033fff640 1 -- 172.21.15.123:0/3514765410 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f28ff7650 con 0x560f290f3b30 2024-08-18T22:13:50.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.439+0000 7f5033fff640 1 --2- 172.21.15.123:0/3514765410 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3b30 0x560f290fb7e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f5020000c00 tx=0x7f502008be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c443a4f959b725 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:50.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.439+0000 7f5013fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:13:50.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.439+0000 7f5013fff640 1 -- 172.21.15.123:0/3514765410 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5020049040 con 0x560f290f3b30 2024-08-18T22:13:50.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.439+0000 7f5013fff640 1 -- 172.21.15.123:0/3514765410 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f502003b460 con 0x560f290f3b30 2024-08-18T22:13:50.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.439+0000 7f503d2a3740 1 -- 172.21.15.123:0/3514765410 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f502800be20 con 0x560f290f3b30 2024-08-18T22:13:50.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.439+0000 7f5013fff640 1 -- 172.21.15.123:0/3514765410 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f50200c02a0 con 0x560f290f3b30 2024-08-18T22:13:50.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.439+0000 7f503d2a3740 10 client.16581 fetch_fsmap learned FSMap version 32 2024-08-18T22:13:50.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.439+0000 7f503d2a3740 1 -- 172.21.15.123:0/3514765410 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560f28dca3c0 con 0x560f290f3b30 2024-08-18T22:13:50.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.439+0000 7f5013fff640 1 -- 172.21.15.123:0/3514765410 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f502800be20 con 0x560f290f3b30 2024-08-18T22:13:50.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.440+0000 7f5013fff640 1 -- 172.21.15.123:0/3514765410 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f50200c46d0 con 0x560f290f3b30 2024-08-18T22:13:50.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.440+0000 7f503d2a3740 10 client.16581 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:13:50.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.440+0000 7f503d2a3740 10 client.16581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:50.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.440+0000 7f503d2a3740 20 client.16581 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:50.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.440+0000 7f503d2a3740 1 --2- 172.21.15.123:0/3514765410 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560f291124e0 0x560f291149a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.440+0000 7f503d2a3740 4 client.16581 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:13:50.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.440+0000 7f503d2a3740 1 -- 172.21.15.123:0/3514765410 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f29065ef0 con 0x560f291124e0 2024-08-18T22:13:50.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.440+0000 7f5038c41640 1 --2- 172.21.15.123:0/3514765410 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560f291124e0 0x560f291149a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.440+0000 7f5013fff640 10 client.16581 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:50.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.440+0000 7f5038c41640 1 --2- 172.21.15.123:0/3514765410 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560f291124e0 0x560f291149a0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16130a1c9fadda08 server_cookie=4a74e591d745652d in_seq=0 out_seq=0 2024-08-18T22:13:50.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.441+0000 7f5013fff640 1 -- 172.21.15.123:0/3514765410 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f29065ef0 con 0x560f291124e0 2024-08-18T22:13:50.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.441+0000 7f5013fff640 10 client.16581 handle_command_reply: tid=0 2024-08-18T22:13:50.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.441+0000 7f503d2a3740 1 client.16581 shutdown 2024-08-18T22:13:50.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.441+0000 7f503d2a3740 1 -- 172.21.15.123:0/3514765410 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3b30 msgr2=0x560f290fb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:50.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.441+0000 7f503d2a3740 1 --2- 172.21.15.123:0/3514765410 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3b30 0x560f290fb7e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f5020000c00 tx=0x7f502008be50 comp rx=0 tx=0).stop 2024-08-18T22:13:50.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.441+0000 7f503d2a3740 1 -- 172.21.15.123:0/3514765410 shutdown_connections 2024-08-18T22:13:50.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.441+0000 7f503d2a3740 1 --2- 172.21.15.123:0/3514765410 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560f291124e0 0x560f291149a0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.441+0000 7f503d2a3740 1 --2- 172.21.15.123:0/3514765410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290fe3f0 0x560f290fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.441+0000 7f503d2a3740 1 --2- 172.21.15.123:0/3514765410 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3b30 0x560f290fb7e0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.441+0000 7f503d2a3740 1 --2- 172.21.15.123:0/3514765410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3210 0x560f290fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.441+0000 7f503d2a3740 1 -- 172.21.15.123:0/3514765410 >> 172.21.15.123:0/3514765410 conn(0x560f290ef7a0 msgr2=0x560f290f54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:50.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.441+0000 7f5013fff640 0 client.16581 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:50.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.442+0000 7f503d2a3740 1 -- 172.21.15.123:0/3514765410 shutdown_connections 2024-08-18T22:13:50.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.442+0000 7f503d2a3740 1 -- 172.21.15.123:0/3514765410 wait complete. 2024-08-18T22:13:50.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.442+0000 7f503d2a3740 20 client.16581 trim_cache size 0 max 16384 2024-08-18T22:13:50.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.460+0000 7f503d2a3740 1 Processor -- start 2024-08-18T22:13:50.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.460+0000 7f503d2a3740 1 -- start start 2024-08-18T22:13:50.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.460+0000 7f503d2a3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3210 0x560f290fd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.460+0000 7f503d2a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3b30 0x560f2911a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.460+0000 7f503d2a3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290fe3f0 0x560f2911a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.460+0000 7f503d2a3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f50341af0f0 con 0x560f290f3210 2024-08-18T22:13:50.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.460+0000 7f503d2a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f50341ac900 con 0x560f290f3b30 2024-08-18T22:13:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.460+0000 7f503d2a3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f50341aa750 con 0x560f290fe3f0 2024-08-18T22:13:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.460+0000 7f5038c41640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3210 0x560f290fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.460+0000 7f5038c41640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3210 0x560f290fd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54602/0 (socket says 172.21.15.123:54602) 2024-08-18T22:13:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.460+0000 7f5038c41640 1 -- 172.21.15.123:0/1184975941 learned_addr learned my addr 172.21.15.123:0/1184975941 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.460+0000 7f5033fff640 1 --2- 172.21.15.123:0/1184975941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3b30 0x560f2911a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.460+0000 7f5039442640 1 --2- 172.21.15.123:0/1184975941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290fe3f0 0x560f2911a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.461+0000 7f5033fff640 1 -- 172.21.15.123:0/1184975941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290fe3f0 msgr2=0x560f2911a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.461+0000 7f5033fff640 1 --2- 172.21.15.123:0/1184975941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290fe3f0 0x560f2911a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.461+0000 7f5033fff640 1 -- 172.21.15.123:0/1184975941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3210 msgr2=0x560f290fd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.461+0000 7f5033fff640 1 --2- 172.21.15.123:0/1184975941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3210 0x560f290fd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.461+0000 7f5033fff640 1 -- 172.21.15.123:0/1184975941 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f290f3960 con 0x560f290f3b30 2024-08-18T22:13:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.461+0000 7f5038c41640 1 --2- 172.21.15.123:0/1184975941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3210 0x560f290fd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.461+0000 7f5033fff640 1 --2- 172.21.15.123:0/1184975941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3b30 0x560f2911a2b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f50200b8400 tx=0x7f502002a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c9a0594b5614b79 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.461+0000 7f501e7fc640 1 -- 172.21.15.123:0/1184975941 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5020049070 con 0x560f290f3b30 2024-08-18T22:13:50.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.461+0000 7f501e7fc640 1 -- 172.21.15.123:0/1184975941 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50200bbfa0 con 0x560f290f3b30 2024-08-18T22:13:50.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.461+0000 7f501e7fc640 1 -- 172.21.15.123:0/1184975941 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50200d7070 con 0x560f290f3b30 2024-08-18T22:13:50.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.462+0000 7f503d2a3740 1 -- 172.21.15.123:0/1184975941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3b30 msgr2=0x560f2911a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:50.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.462+0000 7f503d2a3740 1 --2- 172.21.15.123:0/1184975941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3b30 0x560f2911a2b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f50200b8400 tx=0x7f502002a480 comp rx=0 tx=0).stop 2024-08-18T22:13:50.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.462+0000 7f503d2a3740 1 -- 172.21.15.123:0/1184975941 shutdown_connections 2024-08-18T22:13:50.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.462+0000 7f503d2a3740 1 --2- 172.21.15.123:0/1184975941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290fe3f0 0x560f2911a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.462+0000 7f503d2a3740 1 --2- 172.21.15.123:0/1184975941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3b30 0x560f2911a2b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.462+0000 7f503d2a3740 1 --2- 172.21.15.123:0/1184975941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290f3210 0x560f290fd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.462+0000 7f503d2a3740 1 -- 172.21.15.123:0/1184975941 >> 172.21.15.123:0/1184975941 conn(0x560f290ef7a0 msgr2=0x560f290fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:50.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.462+0000 7f503d2a3740 1 -- 172.21.15.123:0/1184975941 shutdown_connections 2024-08-18T22:13:50.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.462+0000 7f503d2a3740 1 -- 172.21.15.123:0/1184975941 wait complete. 2024-08-18T22:13:50.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.462+0000 7f503d2a3740 1 -- start start 2024-08-18T22:13:50.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.462+0000 7f503d2a3740 1 Processor -- start 2024-08-18T22:13:50.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f503d2a3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290f3210 0x560f29105d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f503d2a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3b30 0x560f29106240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f503d2a3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290fe3f0 0x560f2917b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f503d2a3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f50341aadc0 con 0x560f290fe3f0 2024-08-18T22:13:50.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f503d2a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f50341ac230 con 0x560f290f3b30 2024-08-18T22:13:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f503d2a3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f50341ab490 con 0x560f290f3210 2024-08-18T22:13:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f503d2a3740 10 client.0 _ll_register_callbacks cb 0x7f5020009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f5039442640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290fe3f0 0x560f2917b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f5033fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3b30 0x560f29106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f5038c41640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290f3210 0x560f29105d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f5039442640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290fe3f0 0x560f2917b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54608/0 (socket says 172.21.15.123:54608) 2024-08-18T22:13:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f5038c41640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290f3210 0x560f29105d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:50494/0 (socket says 172.21.15.123:50494) 2024-08-18T22:13:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f5033fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3b30 0x560f29106240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:51918/0 (socket says 172.21.15.123:51918) 2024-08-18T22:13:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f5039442640 1 -- 172.21.15.123:0/4015361703 learned_addr learned my addr 172.21.15.123:0/4015361703 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f5039442640 1 -- 172.21.15.123:0/4015361703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290f3210 msgr2=0x560f29105d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f5039442640 1 --2- 172.21.15.123:0/4015361703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290f3210 0x560f29105d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f5039442640 1 -- 172.21.15.123:0/4015361703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3b30 msgr2=0x560f29106240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f5039442640 1 --2- 172.21.15.123:0/4015361703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3b30 0x560f29106240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f5039442640 1 -- 172.21.15.123:0/4015361703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f2917b7b0 con 0x560f290fe3f0 2024-08-18T22:13:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f5033fff640 1 --2- 172.21.15.123:0/4015361703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3b30 0x560f29106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f5039442640 1 --2- 172.21.15.123:0/4015361703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290fe3f0 0x560f2917b270 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f502c00fc20 tx=0x7f502c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f03d4c0ccfb9a70 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.463+0000 7f5013fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:13:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.464+0000 7f5013fff640 1 -- 172.21.15.123:0/4015361703 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c004b20 con 0x560f290fe3f0 2024-08-18T22:13:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.464+0000 7f5013fff640 1 -- 172.21.15.123:0/4015361703 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f502c004cc0 con 0x560f290fe3f0 2024-08-18T22:13:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.464+0000 7f503d2a3740 1 -- 172.21.15.123:0/4015361703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50200bbfa0 con 0x560f290fe3f0 2024-08-18T22:13:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.464+0000 7f5013fff640 1 -- 172.21.15.123:0/4015361703 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f502c035050 con 0x560f290fe3f0 2024-08-18T22:13:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.464+0000 7f503d2a3740 10 client.16587 fetch_fsmap learned FSMap version 32 2024-08-18T22:13:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.464+0000 7f503d2a3740 1 -- 172.21.15.123:0/4015361703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560f2917c9d0 con 0x560f290fe3f0 2024-08-18T22:13:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.464+0000 7f5013fff640 1 -- 172.21.15.123:0/4015361703 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50200bbfa0 con 0x560f290fe3f0 2024-08-18T22:13:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.464+0000 7f5013fff640 1 -- 172.21.15.123:0/4015361703 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f502c01d040 con 0x560f290fe3f0 2024-08-18T22:13:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.464+0000 7f503d2a3740 10 client.16587 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:13:50.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.464+0000 7f503d2a3740 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:50.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.464+0000 7f503d2a3740 20 client.16587 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:50.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.464+0000 7f503d2a3740 1 --2- 172.21.15.123:0/4015361703 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560f2917d200 0x560f2917f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:50.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.464+0000 7f503d2a3740 4 client.16587 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:13:50.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.464+0000 7f503d2a3740 1 -- 172.21.15.123:0/4015361703 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560f29060400 con 0x560f2917d200 2024-08-18T22:13:50.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.465+0000 7f5038c41640 1 --2- 172.21.15.123:0/4015361703 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560f2917d200 0x560f2917f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:50.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.465+0000 7f5038c41640 1 --2- 172.21.15.123:0/4015361703 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560f2917d200 0x560f2917f620 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec5cb3a742be27db server_cookie=3c648e4d69e38c26 in_seq=0 out_seq=0 2024-08-18T22:13:50.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.465+0000 7f5013fff640 10 client.16587 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:50.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.466+0000 7f5013fff640 1 -- 172.21.15.123:0/4015361703 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560f29060400 con 0x560f2917d200 2024-08-18T22:13:50.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.466+0000 7f5013fff640 10 client.16587 handle_command_reply: tid=0 2024-08-18T22:13:50.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.466+0000 7f503d2a3740 1 client.16587 shutdown 2024-08-18T22:13:50.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.466+0000 7f503d2a3740 1 -- 172.21.15.123:0/4015361703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290fe3f0 msgr2=0x560f2917b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:50.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.466+0000 7f503d2a3740 1 --2- 172.21.15.123:0/4015361703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290fe3f0 0x560f2917b270 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f502c00fc20 tx=0x7f502c004ab0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.466+0000 7f503d2a3740 1 -- 172.21.15.123:0/4015361703 shutdown_connections 2024-08-18T22:13:50.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.466+0000 7f503d2a3740 1 --2- 172.21.15.123:0/4015361703 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560f2917d200 0x560f2917f620 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.466+0000 7f503d2a3740 1 --2- 172.21.15.123:0/4015361703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560f290fe3f0 0x560f2917b270 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.466+0000 7f503d2a3740 1 --2- 172.21.15.123:0/4015361703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560f290f3b30 0x560f29106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.466+0000 7f5013fff640 0 client.16587 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:50.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.466+0000 7f503d2a3740 1 --2- 172.21.15.123:0/4015361703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560f290f3210 0x560f29105d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.466+0000 7f503d2a3740 1 -- 172.21.15.123:0/4015361703 >> 172.21.15.123:0/4015361703 conn(0x560f290ef7a0 msgr2=0x560f290ee900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:50.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.466+0000 7f503d2a3740 1 -- 172.21.15.123:0/4015361703 shutdown_connections 2024-08-18T22:13:50.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.466+0000 7f503d2a3740 1 -- 172.21.15.123:0/4015361703 wait complete. 2024-08-18T22:13:50.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.466+0000 7f503d2a3740 20 client.16587 trim_cache size 0 max 16384 2024-08-18T22:13:50.472 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:13:50.472 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "no active scrubs running", 2024-08-18T22:13:50.473 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-08-18T22:13:50.473 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:13:50.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.467+0000 7f503aea5640 1 -- 172.21.15.123:0/2647278576 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f50240a2b80 msgr2=0x7f50240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:50.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.467+0000 7f503aea5640 1 --2- 172.21.15.123:0/2647278576 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f50240a2b80 0x7f50240a5040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f502c0099e0 tx=0x7f502c009500 comp rx=0 tx=0).stop 2024-08-18T22:13:50.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.467+0000 7f503aea5640 1 -- 172.21.15.123:0/2647278576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50341022a0 msgr2=0x7f50341987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:50.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.467+0000 7f503aea5640 1 --2- 172.21.15.123:0/2647278576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50341022a0 0x7f50341987e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5020006010 tx=0x7f5020003c10 comp rx=0 tx=0).stop 2024-08-18T22:13:50.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.467+0000 7f503aea5640 1 -- 172.21.15.123:0/2647278576 shutdown_connections 2024-08-18T22:13:50.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.467+0000 7f503aea5640 1 --2- 172.21.15.123:0/2647278576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5034102c20 0x7f503419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.467+0000 7f503aea5640 1 --2- 172.21.15.123:0/2647278576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50341022a0 0x7f50341987e0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.467+0000 7f503aea5640 1 --2- 172.21.15.123:0/2647278576 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f50240a2b80 0x7f50240a5040 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.467+0000 7f503aea5640 1 --2- 172.21.15.123:0/2647278576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5034100b50 0x7f50341982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:50.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.467+0000 7f503aea5640 1 -- 172.21.15.123:0/2647278576 >> 172.21.15.123:0/2647278576 conn(0x7f50340fc500 msgr2=0x7f503406a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:50.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.467+0000 7f503aea5640 1 -- 172.21.15.123:0/2647278576 shutdown_connections 2024-08-18T22:13:50.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:50.467+0000 7f503aea5640 1 -- 172.21.15.123:0/2647278576 wait complete. 2024-08-18T22:13:51.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:51 smithi183 ceph-mon[22097]: pgmap v522: 129 pgs: 129 active+clean; 120 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.6 MiB/s wr, 793 op/s 2024-08-18T22:13:51.487 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:51 smithi123 ceph-mon[18462]: pgmap v522: 129 pgs: 129 active+clean; 120 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.6 MiB/s wr, 793 op/s 2024-08-18T22:13:51.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:51 smithi130 ceph-mon[21698]: pgmap v522: 129 pgs: 129 active+clean; 120 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.6 MiB/s wr, 793 op/s 2024-08-18T22:13:51.517 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-18T22:13:51.517 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:13:51.796 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:13:52.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.379+0000 7f03df0c7640 1 -- 172.21.15.123:0/1329767289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d8100f40 msgr2=0x7f03d81013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:52.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.379+0000 7f03df0c7640 1 --2- 172.21.15.123:0/1329767289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d8100f40 0x7f03d81013c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f03c4009930 tx=0x7f03c402a420 comp rx=0 tx=0).stop 2024-08-18T22:13:52.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.379+0000 7f03df0c7640 1 -- 172.21.15.123:0/1329767289 shutdown_connections 2024-08-18T22:13:52.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.379+0000 7f03df0c7640 1 --2- 172.21.15.123:0/1329767289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03d8101900 0x7f03d810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:52.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.379+0000 7f03df0c7640 1 --2- 172.21.15.123:0/1329767289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d8100f40 0x7f03d81013c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.379+0000 7f03df0c7640 1 --2- 172.21.15.123:0/1329767289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03d8106810 0x7f03d8106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.379+0000 7f03df0c7640 1 -- 172.21.15.123:0/1329767289 >> 172.21.15.123:0/1329767289 conn(0x7f03d8076f60 msgr2=0x7f03d80fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.379+0000 7f03df0c7640 1 -- 172.21.15.123:0/1329767289 shutdown_connections 2024-08-18T22:13:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.379+0000 7f03df0c7640 1 -- 172.21.15.123:0/1329767289 wait complete. 2024-08-18T22:13:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03df0c7640 1 Processor -- start 2024-08-18T22:13:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03df0c7640 1 -- start start 2024-08-18T22:13:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03df0c7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d8100f40 0x7f03d8102870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03df0c7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03d8101900 0x7f03d8102db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03df0c7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03d8106810 0x7f03d81032f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03df0c7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f03d8110b70 con 0x7f03d8100f40 2024-08-18T22:13:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03df0c7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f03d81109f0 con 0x7f03d8101900 2024-08-18T22:13:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03df0c7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f03d8110cf0 con 0x7f03d8106810 2024-08-18T22:13:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03dce63640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d8100f40 0x7f03d8102870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03dce63640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d8100f40 0x7f03d8102870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54628/0 (socket says 172.21.15.123:54628) 2024-08-18T22:13:52.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03dce63640 1 -- 172.21.15.123:0/639442155 learned_addr learned my addr 172.21.15.123:0/639442155 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:52.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03d7fff640 1 --2- 172.21.15.123:0/639442155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03d8101900 0x7f03d8102db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:52.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03dd664640 1 --2- 172.21.15.123:0/639442155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03d8106810 0x7f03d81032f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:52.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03dce63640 1 -- 172.21.15.123:0/639442155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03d8106810 msgr2=0x7f03d81032f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:52.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03dce63640 1 --2- 172.21.15.123:0/639442155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03d8106810 0x7f03d81032f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:52.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03dce63640 1 -- 172.21.15.123:0/639442155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03d8101900 msgr2=0x7f03d8102db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:52.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03dce63640 1 --2- 172.21.15.123:0/639442155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03d8101900 0x7f03d8102db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:52.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03dce63640 1 -- 172.21.15.123:0/639442155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d81a6560 con 0x7f03d8100f40 2024-08-18T22:13:52.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.380+0000 7f03d7fff640 1 --2- 172.21.15.123:0/639442155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03d8101900 0x7f03d8102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:52.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.381+0000 7f03dce63640 1 --2- 172.21.15.123:0/639442155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d8100f40 0x7f03d8102870 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f03cc00e9f0 tx=0x7f03cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:52.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.381+0000 7f03d5ffb640 1 -- 172.21.15.123:0/639442155 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc00cd80 con 0x7f03d8100f40 2024-08-18T22:13:52.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.381+0000 7f03df0c7640 1 -- 172.21.15.123:0/639442155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d81a6850 con 0x7f03d8100f40 2024-08-18T22:13:52.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.381+0000 7f03d5ffb640 1 -- 172.21.15.123:0/639442155 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03cc010910 con 0x7f03d8100f40 2024-08-18T22:13:52.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.381+0000 7f03d5ffb640 1 -- 172.21.15.123:0/639442155 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc0188f0 con 0x7f03d8100f40 2024-08-18T22:13:52.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.381+0000 7f03df0c7640 1 -- 172.21.15.123:0/639442155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d81a6db0 con 0x7f03d8100f40 2024-08-18T22:13:52.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.382+0000 7f03df0c7640 1 -- 172.21.15.123:0/639442155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d81013c0 con 0x7f03d8100f40 2024-08-18T22:13:52.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.384+0000 7f03d5ffb640 1 -- 172.21.15.123:0/639442155 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f03cc010ac0 con 0x7f03d8100f40 2024-08-18T22:13:52.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.384+0000 7f03d5ffb640 1 --2- 172.21.15.123:0/639442155 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f03c80a2b80 0x7f03c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:52.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.384+0000 7f03d7fff640 1 --2- 172.21.15.123:0/639442155 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f03c80a2b80 0x7f03c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:52.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.384+0000 7f03d5ffb640 1 -- 172.21.15.123:0/639442155 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f03cc0cf770 con 0x7f03d8100f40 2024-08-18T22:13:52.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.385+0000 7f03d7fff640 1 --2- 172.21.15.123:0/639442155 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f03c80a2b80 0x7f03c80a5040 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f03c4009900 tx=0x7f03c40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:52.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.389+0000 7f03d5ffb640 1 -- 172.21.15.123:0/639442155 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f03cc09bc90 con 0x7f03d8100f40 2024-08-18T22:13:52.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.605+0000 7f03df0c7640 1 -- 172.21.15.123:0/639442155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03d81a7080 con 0x7f03d8100f40 2024-08-18T22:13:52.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.605+0000 7f03d5ffb640 1 -- 172.21.15.123:0/639442155 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11928 (secure 0 0 0) 0x7f03cc09ff90 con 0x7f03d8100f40 2024-08-18T22:13:52.607 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:13:52.607 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":32,"btime":"2024-08-18T22:13:42:106357+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:13:41.668028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":125,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:13:52.608 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 32 2024-08-18T22:13:52.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.608+0000 7f03df0c7640 1 -- 172.21.15.123:0/639442155 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f03c80a2b80 msgr2=0x7f03c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:52.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.608+0000 7f03df0c7640 1 --2- 172.21.15.123:0/639442155 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f03c80a2b80 0x7f03c80a5040 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f03c4009900 tx=0x7f03c40058d0 comp rx=0 tx=0).stop 2024-08-18T22:13:52.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.608+0000 7f03df0c7640 1 -- 172.21.15.123:0/639442155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d8100f40 msgr2=0x7f03d8102870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:52.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.608+0000 7f03df0c7640 1 --2- 172.21.15.123:0/639442155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d8100f40 0x7f03d8102870 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f03cc00e9f0 tx=0x7f03cc00eeb0 comp rx=0 tx=0).stop 2024-08-18T22:13:52.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.608+0000 7f03df0c7640 1 -- 172.21.15.123:0/639442155 shutdown_connections 2024-08-18T22:13:52.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.608+0000 7f03df0c7640 1 --2- 172.21.15.123:0/639442155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03d8106810 0x7f03d81032f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:52.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.608+0000 7f03df0c7640 1 --2- 172.21.15.123:0/639442155 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f03c80a2b80 0x7f03c80a5040 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:52.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.608+0000 7f03df0c7640 1 --2- 172.21.15.123:0/639442155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03d8101900 0x7f03d8102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:52.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.608+0000 7f03df0c7640 1 --2- 172.21.15.123:0/639442155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d8100f40 0x7f03d8102870 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:52.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.608+0000 7f03df0c7640 1 -- 172.21.15.123:0/639442155 >> 172.21.15.123:0/639442155 conn(0x7f03d8076f60 msgr2=0x7f03d8104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:52.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.608+0000 7f03df0c7640 1 -- 172.21.15.123:0/639442155 shutdown_connections 2024-08-18T22:13:52.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:52.608+0000 7f03df0c7640 1 -- 172.21.15.123:0/639442155 wait complete. 2024-08-18T22:13:53.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:53 smithi183 ceph-mon[22097]: pgmap v523: 129 pgs: 129 active+clean; 127 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.5 MiB/s wr, 854 op/s 2024-08-18T22:13:53.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:13:53.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:53 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/639442155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:13:53.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:13:53.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:13:53.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:13:53.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:13:53.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:13:53.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:13:53.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:13:53.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:53 smithi123 ceph-mon[18462]: pgmap v523: 129 pgs: 129 active+clean; 127 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.5 MiB/s wr, 854 op/s 2024-08-18T22:13:53.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:13:53.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:53 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/639442155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:13:53.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:13:53.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:13:53.423 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:13:53.423 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:13:53.423 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:13:53.423 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:13:53.423 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:13:53.474 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-18T22:13:53.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:53 smithi130 ceph-mon[21698]: pgmap v523: 129 pgs: 129 active+clean; 127 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.5 MiB/s wr, 854 op/s 2024-08-18T22:13:53.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:13:53.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:53 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/639442155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:13:53.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:13:53.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:13:53.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:13:53.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:13:53.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:13:53.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:13:53.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:13:53.850 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:13:54.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:54 smithi123 ceph-mon[18462]: Adjusting osd_memory_target on smithi123 to 176.0M 2024-08-18T22:13:54.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:54 smithi123 ceph-mon[18462]: Unable to set osd_memory_target on smithi123 to 184593920: error parsing value: Value '184593920' is below minimum 939524096 2024-08-18T22:13:54.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.394+0000 7f8e92ffd640 1 -- 172.21.15.123:0/1972477383 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e880319b0 con 0x7f8e941018c0 2024-08-18T22:13:54.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.395+0000 7f8e9a3f7640 1 -- 172.21.15.123:0/1972477383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e941018c0 msgr2=0x7f8e94101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:54.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.395+0000 7f8e9a3f7640 1 --2- 172.21.15.123:0/1972477383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e941018c0 0x7f8e94101d20 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009930 tx=0x7f8e8802a420 comp rx=0 tx=0).stop 2024-08-18T22:13:54.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.395+0000 7f8e9a3f7640 1 -- 172.21.15.123:0/1972477383 shutdown_connections 2024-08-18T22:13:54.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.395+0000 7f8e9a3f7640 1 --2- 172.21.15.123:0/1972477383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e94102260 0x7f8e9410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.395+0000 7f8e9a3f7640 1 --2- 172.21.15.123:0/1972477383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e941018c0 0x7f8e94101d20 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.395+0000 7f8e9a3f7640 1 --2- 172.21.15.123:0/1972477383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e941078c0 0x7f8e94107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.395+0000 7f8e9a3f7640 1 -- 172.21.15.123:0/1972477383 >> 172.21.15.123:0/1972477383 conn(0x7f8e940fd620 msgr2=0x7f8e940ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:54.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.395+0000 7f8e9a3f7640 1 -- 172.21.15.123:0/1972477383 shutdown_connections 2024-08-18T22:13:54.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.395+0000 7f8e9a3f7640 1 -- 172.21.15.123:0/1972477383 wait complete. 2024-08-18T22:13:54.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.396+0000 7f8e9a3f7640 1 Processor -- start 2024-08-18T22:13:54.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.396+0000 7f8e9a3f7640 1 -- start start 2024-08-18T22:13:54.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.396+0000 7f8e9a3f7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e941018c0 0x7f8e9419ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.397+0000 7f8e9a3f7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e94102260 0x7f8e9419f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.397+0000 7f8e9a3f7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e941078c0 0x7f8e9410c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.397+0000 7f8e9a3f7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8e94111d10 con 0x7f8e94102260 2024-08-18T22:13:54.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.397+0000 7f8e9a3f7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8e94111b90 con 0x7f8e941018c0 2024-08-18T22:13:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.397+0000 7f8e9a3f7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8e94111e90 con 0x7f8e941078c0 2024-08-18T22:13:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.397+0000 7f8e937fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e94102260 0x7f8e9419f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.397+0000 7f8e937fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e94102260 0x7f8e9419f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47712/0 (socket says 172.21.15.123:47712) 2024-08-18T22:13:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.397+0000 7f8e937fe640 1 -- 172.21.15.123:0/1462998509 learned_addr learned my addr 172.21.15.123:0/1462998509 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.397+0000 7f8e98994640 1 --2- 172.21.15.123:0/1462998509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e941078c0 0x7f8e9410c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.398+0000 7f8e93fff640 1 --2- 172.21.15.123:0/1462998509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e941018c0 0x7f8e9419ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.398+0000 7f8e98994640 1 -- 172.21.15.123:0/1462998509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e941018c0 msgr2=0x7f8e9419ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.398+0000 7f8e98994640 1 --2- 172.21.15.123:0/1462998509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e941018c0 0x7f8e9419ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.398+0000 7f8e98994640 1 -- 172.21.15.123:0/1462998509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e94102260 msgr2=0x7f8e9419f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.398+0000 7f8e98994640 1 --2- 172.21.15.123:0/1462998509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e94102260 0x7f8e9419f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.398+0000 7f8e98994640 1 -- 172.21.15.123:0/1462998509 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e9410d020 con 0x7f8e941078c0 2024-08-18T22:13:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.398+0000 7f8e98994640 1 --2- 172.21.15.123:0/1462998509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e941078c0 0x7f8e9410c760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009fd0 tx=0x7f8e8c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:54.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.399+0000 7f8e917fa640 1 -- 172.21.15.123:0/1462998509 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c00ce20 con 0x7f8e941078c0 2024-08-18T22:13:54.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.399+0000 7f8e917fa640 1 -- 172.21.15.123:0/1462998509 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e8c005020 con 0x7f8e941078c0 2024-08-18T22:13:54.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.399+0000 7f8e917fa640 1 -- 172.21.15.123:0/1462998509 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c010720 con 0x7f8e941078c0 2024-08-18T22:13:54.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.400+0000 7f8e9a3f7640 1 -- 172.21.15.123:0/1462998509 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e9410d310 con 0x7f8e941078c0 2024-08-18T22:13:54.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.400+0000 7f8e9a3f7640 1 -- 172.21.15.123:0/1462998509 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e9419a990 con 0x7f8e941078c0 2024-08-18T22:13:54.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.404+0000 7f8e9c7f5740 1 Processor -- start 2024-08-18T22:13:54.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.404+0000 7f8e917fa640 1 -- 172.21.15.123:0/1462998509 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f8e8c005540 con 0x7f8e941078c0 2024-08-18T22:13:54.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.404+0000 7f8e9c7f5740 1 -- start start 2024-08-18T22:13:54.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.405+0000 7f8e9c7f5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96f9ff0 0x5566d96fa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.405+0000 7f8e9c7f5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d96fa910 0x5566d9704c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.405+0000 7f8e9c7f5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d97075c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.405+0000 7f8e9c7f5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5566d965fa40 con 0x5566d97051d0 2024-08-18T22:13:54.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.405+0000 7f8e9c7f5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5566d95f79d0 con 0x5566d96f9ff0 2024-08-18T22:13:54.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.405+0000 7f8e9c7f5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5566d965ba00 con 0x5566d96fa910 2024-08-18T22:13:54.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.405+0000 7f8e93fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d96fa910 0x5566d9704c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.405+0000 7f8e937fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96f9ff0 0x5566d96fa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.405+0000 7f8e937fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d97075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.405+0000 7f8e937fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d97075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47722/0 (socket says 172.21.15.123:47722) 2024-08-18T22:13:54.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.405+0000 7f8e937fe640 1 -- 172.21.15.123:0/1274885888 learned_addr learned my addr 172.21.15.123:0/1274885888 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:54.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.406+0000 7f8e917fa640 1 --2- 172.21.15.123:0/1462998509 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8e7c0a2cd0 0x7f8e7c0a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.406+0000 7f8e937fe640 1 -- 172.21.15.123:0/1274885888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d96fa910 msgr2=0x5566d9704c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:54.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.406+0000 7f8e937fe640 1 --2- 172.21.15.123:0/1274885888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d96fa910 0x5566d9704c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.406+0000 7f8e937fe640 1 -- 172.21.15.123:0/1274885888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 msgr2=0x5566d97075c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:54.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.406+0000 7f8e937fe640 1 --2- 172.21.15.123:0/1274885888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d97075c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.406+0000 7f8e937fe640 1 -- 172.21.15.123:0/1274885888 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566d95fe650 con 0x5566d96f9ff0 2024-08-18T22:13:54.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.406+0000 7f8e917fa640 1 -- 172.21.15.123:0/1462998509 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8e8c0cf710 con 0x7f8e941078c0 2024-08-18T22:13:54.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.406+0000 7f8e98994640 1 --2- 172.21.15.123:0/1462998509 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8e7c0a2cd0 0x7f8e7c0a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.406+0000 7f8e937fe640 1 --2- 172.21.15.123:0/1274885888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96f9ff0 0x5566d96fa3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x5566d96f7900 tx=0x7f8e88009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5517718f17e45e37 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:54.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.407+0000 7f8e7a7fc640 1 -- 172.21.15.123:0/1274885888 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e88035040 con 0x5566d96f9ff0 2024-08-18T22:13:54.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.407+0000 7f8e7a7fc640 1 -- 172.21.15.123:0/1274885888 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e880047a0 con 0x5566d96f9ff0 2024-08-18T22:13:54.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.407+0000 7f8e7a7fc640 1 -- 172.21.15.123:0/1274885888 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e88005280 con 0x5566d96f9ff0 2024-08-18T22:13:54.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:54 smithi183 ceph-mon[22097]: Adjusting osd_memory_target on smithi123 to 176.0M 2024-08-18T22:13:54.410 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:54 smithi183 ceph-mon[22097]: Unable to set osd_memory_target on smithi123 to 184593920: error parsing value: Value '184593920' is below minimum 939524096 2024-08-18T22:13:54.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.408+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1274885888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96f9ff0 msgr2=0x5566d96fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:54.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.408+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1274885888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96f9ff0 0x5566d96fa3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x5566d96f7900 tx=0x7f8e88009260 comp rx=0 tx=0).stop 2024-08-18T22:13:54.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.408+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1274885888 shutdown_connections 2024-08-18T22:13:54.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.408+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1274885888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d97075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.408+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1274885888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d96fa910 0x5566d9704c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.408+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1274885888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96f9ff0 0x5566d96fa3d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.408+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1274885888 >> 172.21.15.123:0/1274885888 conn(0x5566d96f6580 msgr2=0x5566d96f6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:54.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.409+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1274885888 shutdown_connections 2024-08-18T22:13:54.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.409+0000 7f8e98994640 1 --2- 172.21.15.123:0/1462998509 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8e7c0a2cd0 0x7f8e7c0a5190 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c098550 tx=0x7f8e8c0054b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:54.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.409+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1274885888 wait complete. 2024-08-18T22:13:54.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.409+0000 7f8e9c7f5740 1 -- start start 2024-08-18T22:13:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.410+0000 7f8e9c7f5740 1 Processor -- start 2024-08-18T22:13:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.410+0000 7f8e9c7f5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96fa910 0x5566d9702240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.410+0000 7f8e9c7f5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d9702780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.410+0000 7f8e9c7f5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d9702cc0 0x5566d9711210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.410+0000 7f8e9c7f5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5566d9707da0 con 0x5566d97051d0 2024-08-18T22:13:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.410+0000 7f8e9c7f5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5566d961ab20 con 0x5566d96fa910 2024-08-18T22:13:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.410+0000 7f8e9c7f5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5566d9707f20 con 0x5566d9702cc0 2024-08-18T22:13:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.410+0000 7f8e9c7f5740 10 client.0 _ll_register_callbacks cb 0x5566d9618bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.411+0000 7f8e93fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d9702780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.411+0000 7f8e93fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d9702780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47726/0 (socket says 172.21.15.123:47726) 2024-08-18T22:13:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.411+0000 7f8e93fff640 1 -- 172.21.15.123:0/1878841587 learned_addr learned my addr 172.21.15.123:0/1878841587 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.411+0000 7f8e93fff640 1 -- 172.21.15.123:0/1878841587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d9702cc0 msgr2=0x5566d9711210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T22:13:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.411+0000 7f8e93fff640 1 --2- 172.21.15.123:0/1878841587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d9702cc0 0x5566d9711210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.411+0000 7f8e937fe640 1 --2- 172.21.15.123:0/1878841587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96fa910 0x5566d9702240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.411+0000 7f8e93fff640 1 -- 172.21.15.123:0/1878841587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96fa910 msgr2=0x5566d9702240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:54.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.411+0000 7f8e93fff640 1 --2- 172.21.15.123:0/1878841587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96fa910 0x5566d9702240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.411+0000 7f8e93fff640 1 -- 172.21.15.123:0/1878841587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566d93d13c0 con 0x5566d97051d0 2024-08-18T22:13:54.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.411+0000 7f8e93fff640 1 --2- 172.21.15.123:0/1878841587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d9702780 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400ce10 tx=0x7f8e840039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2357408bdd69788 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:54.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.412+0000 7f8e737fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:13:54.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.412+0000 7f8e737fe640 1 -- 172.21.15.123:0/1878841587 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e84011970 con 0x5566d97051d0 2024-08-18T22:13:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.412+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1878841587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e880047a0 con 0x5566d97051d0 2024-08-18T22:13:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.413+0000 7f8e737fe640 1 -- 172.21.15.123:0/1878841587 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8e84011b10 con 0x5566d97051d0 2024-08-18T22:13:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.413+0000 7f8e737fe640 1 -- 172.21.15.123:0/1878841587 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8e84011d10 con 0x5566d97051d0 2024-08-18T22:13:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.413+0000 7f8e9c7f5740 10 client.16605 fetch_fsmap learned FSMap version 32 2024-08-18T22:13:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.413+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1878841587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5566d9714050 con 0x5566d97051d0 2024-08-18T22:13:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.413+0000 7f8e737fe640 1 -- 172.21.15.123:0/1878841587 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e880047a0 con 0x5566d97051d0 2024-08-18T22:13:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.414+0000 7f8e737fe640 1 -- 172.21.15.123:0/1878841587 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f8e84018070 con 0x5566d97051d0 2024-08-18T22:13:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.414+0000 7f8e9c7f5740 10 client.16605 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:13:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.414+0000 7f8e9c7f5740 10 client.16605 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-18T22:13:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.414+0000 7f8e9c7f5740 20 client.16605 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.414+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1878841587 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5566d9715510 0x5566d9717940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.414+0000 7f8e9c7f5740 4 client.16605 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:13:54.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.414+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1878841587 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566d966cfb0 con 0x5566d9715510 2024-08-18T22:13:54.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.414+0000 7f8e937fe640 1 --2- 172.21.15.123:0/1878841587 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5566d9715510 0x5566d9717940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.415+0000 7f8e737fe640 10 client.16605 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:13:54.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.416+0000 7f8e937fe640 1 --2- 172.21.15.123:0/1878841587 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5566d9715510 0x5566d9717940 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a62cd3e9796875a4 server_cookie=f257e51587a6036f in_seq=0 out_seq=0 2024-08-18T22:13:54.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.420+0000 7f8e737fe640 1 -- 172.21.15.123:0/1878841587 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5566d966cfb0 con 0x5566d9715510 2024-08-18T22:13:54.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.420+0000 7f8e737fe640 10 client.16605 handle_command_reply: tid=0 2024-08-18T22:13:54.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.420+0000 7f8e9c7f5740 1 client.16605 shutdown 2024-08-18T22:13:54.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.421+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1878841587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 msgr2=0x5566d9702780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:54.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.421+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1878841587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d9702780 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400ce10 tx=0x7f8e840039c0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.421+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1878841587 shutdown_connections 2024-08-18T22:13:54.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.421+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1878841587 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5566d9715510 0x5566d9717940 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.421+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1878841587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d9702cc0 0x5566d9711210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.421+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1878841587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d9702780 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.421+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1878841587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96fa910 0x5566d9702240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.421+0000 7f8e737fe640 0 client.16605 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:13:54.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.421+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1878841587 >> 172.21.15.123:0/1878841587 conn(0x5566d96f6580 msgr2=0x5566d96fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:54.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.421+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1878841587 shutdown_connections 2024-08-18T22:13:54.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.421+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1878841587 wait complete. 2024-08-18T22:13:54.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.421+0000 7f8e9c7f5740 20 client.16605 trim_cache size 0 max 16384 2024-08-18T22:13:54.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.445+0000 7f8e9c7f5740 1 Processor -- start 2024-08-18T22:13:54.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.445+0000 7f8e9c7f5740 1 -- start start 2024-08-18T22:13:54.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.445+0000 7f8e9c7f5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96fa910 0x5566d9711000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.445+0000 7f8e9c7f5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d9702cc0 0x5566d9700b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.445+0000 7f8e9c7f5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d9701050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.446+0000 7f8e9c7f5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8e941c0200 con 0x5566d97051d0 2024-08-18T22:13:54.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.446+0000 7f8e9c7f5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8e941bda10 con 0x5566d96fa910 2024-08-18T22:13:54.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.446+0000 7f8e9c7f5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8e941bb860 con 0x5566d9702cc0 2024-08-18T22:13:54.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.446+0000 7f8e937fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96fa910 0x5566d9711000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.446+0000 7f8e937fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96fa910 0x5566d9711000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:49776/0 (socket says 172.21.15.123:49776) 2024-08-18T22:13:54.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.446+0000 7f8e937fe640 1 -- 172.21.15.123:0/1384015351 learned_addr learned my addr 172.21.15.123:0/1384015351 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:54.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.446+0000 7f8e937fe640 1 --2- 172.21.15.123:0/1384015351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d9701050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.447+0000 7f8e937fe640 1 -- 172.21.15.123:0/1384015351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d9702cc0 msgr2=0x5566d9700b10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T22:13:54.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.447+0000 7f8e937fe640 1 --2- 172.21.15.123:0/1384015351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d9702cc0 0x5566d9700b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.447+0000 7f8e937fe640 1 -- 172.21.15.123:0/1384015351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96fa910 msgr2=0x5566d9711000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:54.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.447+0000 7f8e937fe640 1 --2- 172.21.15.123:0/1384015351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96fa910 0x5566d9711000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.447+0000 7f8e937fe640 1 -- 172.21.15.123:0/1384015351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566d96fa740 con 0x5566d97051d0 2024-08-18T22:13:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.447+0000 7f8e937fe640 1 --2- 172.21.15.123:0/1384015351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d9701050 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009230 tx=0x7f8e8802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf66681f5ae86f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.448+0000 7f8e79ffb640 1 -- 172.21.15.123:0/1384015351 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8804e020 con 0x5566d97051d0 2024-08-18T22:13:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.448+0000 7f8e79ffb640 1 -- 172.21.15.123:0/1384015351 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e88031a60 con 0x5566d97051d0 2024-08-18T22:13:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.448+0000 7f8e79ffb640 1 -- 172.21.15.123:0/1384015351 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e88041040 con 0x5566d97051d0 2024-08-18T22:13:54.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.449+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1384015351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 msgr2=0x5566d9701050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:54.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.449+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1384015351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d9701050 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009230 tx=0x7f8e8802a420 comp rx=0 tx=0).stop 2024-08-18T22:13:54.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.449+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1384015351 shutdown_connections 2024-08-18T22:13:54.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.449+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1384015351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d97051d0 0x5566d9701050 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.449+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1384015351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d9702cc0 0x5566d9700b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.449+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1384015351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96fa910 0x5566d9711000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.449+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1384015351 >> 172.21.15.123:0/1384015351 conn(0x5566d96f6580 msgr2=0x5566d9702200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:54.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.450+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1384015351 shutdown_connections 2024-08-18T22:13:54.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.450+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1384015351 wait complete. 2024-08-18T22:13:54.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.450+0000 7f8e9c7f5740 1 -- start start 2024-08-18T22:13:54.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.451+0000 7f8e9c7f5740 1 Processor -- start 2024-08-18T22:13:54.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.451+0000 7f8e9c7f5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d96fa910 0x5566d970d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.451+0000 7f8e9c7f5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d97051d0 0x5566d970d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.451+0000 7f8e9c7f5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96feaa0 0x5566d96fef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.451+0000 7f8e9c7f5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8e941bbed0 con 0x5566d96fa910 2024-08-18T22:13:54.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.451+0000 7f8e9c7f5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8e941bd340 con 0x5566d96feaa0 2024-08-18T22:13:54.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.451+0000 7f8e9c7f5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8e941bc5a0 con 0x5566d97051d0 2024-08-18T22:13:54.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.451+0000 7f8e9c7f5740 10 client.0 _ll_register_callbacks cb 0x7f8e840040c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:54.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.452+0000 7f8e937fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d96fa910 0x5566d970d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.452+0000 7f8e937fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d96fa910 0x5566d970d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47754/0 (socket says 172.21.15.123:47754) 2024-08-18T22:13:54.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.452+0000 7f8e937fe640 1 -- 172.21.15.123:0/1988547846 learned_addr learned my addr 172.21.15.123:0/1988547846 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:54.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.452+0000 7f8e93fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d97051d0 0x5566d970d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.452+0000 7f8e937fe640 1 --2- 172.21.15.123:0/1988547846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96feaa0 0x5566d96fef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.452+0000 7f8e93fff640 1 -- 172.21.15.123:0/1988547846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96feaa0 msgr2=0x5566d96fef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:54.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.452+0000 7f8e93fff640 1 --2- 172.21.15.123:0/1988547846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96feaa0 0x5566d96fef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.452+0000 7f8e93fff640 1 -- 172.21.15.123:0/1988547846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d96fa910 msgr2=0x5566d970d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:54.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.452+0000 7f8e93fff640 1 --2- 172.21.15.123:0/1988547846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d96fa910 0x5566d970d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.452+0000 7f8e93fff640 1 -- 172.21.15.123:0/1988547846 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566d96ff750 con 0x5566d97051d0 2024-08-18T22:13:54.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.453+0000 7f8e93fff640 1 --2- 172.21.15.123:0/1988547846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d97051d0 0x5566d970d890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5566d9707dc0 tx=0x7f8e8400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=826a3f2711098797 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:54.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.453+0000 7f8e737fe640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-08-18T22:13:54.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.454+0000 7f8e737fe640 1 -- 172.21.15.123:0/1988547846 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8402d060 con 0x5566d97051d0 2024-08-18T22:13:54.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.454+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1988547846 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5566d96674c0 con 0x5566d97051d0 2024-08-18T22:13:54.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.454+0000 7f8e737fe640 1 -- 172.21.15.123:0/1988547846 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8e84005070 con 0x5566d97051d0 2024-08-18T22:13:54.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.456+0000 7f8e737fe640 1 -- 172.21.15.123:0/1988547846 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8e84034050 con 0x5566d97051d0 2024-08-18T22:13:54.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.456+0000 7f8e9c7f5740 10 client.25993 fetch_fsmap learned FSMap version 32 2024-08-18T22:13:54.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.456+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1988547846 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5566d97800a0 con 0x5566d97051d0 2024-08-18T22:13:54.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.456+0000 7f8e737fe640 1 -- 172.21.15.123:0/1988547846 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5566d96674c0 con 0x5566d97051d0 2024-08-18T22:13:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.456+0000 7f8e737fe640 1 -- 172.21.15.123:0/1988547846 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f8e84018030 con 0x5566d97051d0 2024-08-18T22:13:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.456+0000 7f8e9c7f5740 10 client.25993 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:13:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.456+0000 7f8e9c7f5740 10 client.25993 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-18T22:13:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.456+0000 7f8e9c7f5740 20 client.25993 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.456+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1988547846 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5566d9780800 0x5566d9782c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.457+0000 7f8e9c7f5740 4 client.25993 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:13:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.457+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1988547846 --> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5566d95e4170 con 0x5566d9780800 2024-08-18T22:13:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.457+0000 7f8e937fe640 1 --2- 172.21.15.123:0/1988547846 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5566d9780800 0x5566d9782c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.459+0000 7f8e937fe640 1 --2- 172.21.15.123:0/1988547846 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5566d9780800 0x5566d9782c20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c37a2bea85cd0a49 server_cookie=97da049e7564d89f in_seq=0 out_seq=0 2024-08-18T22:13:54.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.459+0000 7f8e737fe640 10 client.25993 ms_handle_connect on v2:172.21.15.183:6836/1468802140 2024-08-18T22:13:54.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.465+0000 7f8e737fe640 1 -- 172.21.15.123:0/1988547846 <== mds.2 v2:172.21.15.183:6836/1468802140 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5566d95e4170 con 0x5566d9780800 2024-08-18T22:13:54.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.465+0000 7f8e737fe640 10 client.25993 handle_command_reply: tid=0 2024-08-18T22:13:54.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.465+0000 7f8e9c7f5740 1 client.25993 shutdown 2024-08-18T22:13:54.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.465+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1988547846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d97051d0 msgr2=0x5566d970d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:54.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.465+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1988547846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d97051d0 0x5566d970d890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5566d9707dc0 tx=0x7f8e8400edf0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.466+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1988547846 shutdown_connections 2024-08-18T22:13:54.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.466+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1988547846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566d96feaa0 0x5566d96fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.466+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1988547846 >> [v2:172.21.15.183:6836/1468802140,v1:172.21.15.183:6837/1468802140] conn(0x5566d9780800 0x5566d9782c20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.466+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1988547846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5566d97051d0 0x5566d970d890 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.466+0000 7f8e9c7f5740 1 --2- 172.21.15.123:0/1988547846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5566d96fa910 0x5566d970d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.466+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1988547846 >> 172.21.15.123:0/1988547846 conn(0x5566d96f6580 msgr2=0x5566d9700ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:54.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.466+0000 7f8e737fe640 0 client.25993 ms_handle_reset on v2:172.21.15.183:6836/1468802140 2024-08-18T22:13:54.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.466+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1988547846 shutdown_connections 2024-08-18T22:13:54.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.467+0000 7f8e9c7f5740 1 -- 172.21.15.123:0/1988547846 wait complete. 2024-08-18T22:13:54.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.467+0000 7f8e9c7f5740 20 client.25993 trim_cache size 0 max 16384 2024-08-18T22:13:54.469 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:13:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.468+0000 7f8e9a3f7640 1 -- 172.21.15.123:0/1462998509 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8e7c0a2cd0 msgr2=0x7f8e7c0a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.468+0000 7f8e9a3f7640 1 --2- 172.21.15.123:0/1462998509 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8e7c0a2cd0 0x7f8e7c0a5190 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c098550 tx=0x7f8e8c0054b0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.468+0000 7f8e9a3f7640 1 -- 172.21.15.123:0/1462998509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e941078c0 msgr2=0x7f8e9410c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.468+0000 7f8e9a3f7640 1 --2- 172.21.15.123:0/1462998509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e941078c0 0x7f8e9410c760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009fd0 tx=0x7f8e8c00ef10 comp rx=0 tx=0).stop 2024-08-18T22:13:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.469+0000 7f8e9a3f7640 1 -- 172.21.15.123:0/1462998509 shutdown_connections 2024-08-18T22:13:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.469+0000 7f8e9a3f7640 1 --2- 172.21.15.123:0/1462998509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e941078c0 0x7f8e9410c760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.469+0000 7f8e9a3f7640 1 --2- 172.21.15.123:0/1462998509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e94102260 0x7f8e9419f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.469+0000 7f8e9a3f7640 1 --2- 172.21.15.123:0/1462998509 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f8e7c0a2cd0 0x7f8e7c0a5190 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.469+0000 7f8e9a3f7640 1 --2- 172.21.15.123:0/1462998509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e941018c0 0x7f8e9419ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.469+0000 7f8e9a3f7640 1 -- 172.21.15.123:0/1462998509 >> 172.21.15.123:0/1462998509 conn(0x7f8e940fd620 msgr2=0x7f8e94074530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:54.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.470+0000 7f8e9a3f7640 1 -- 172.21.15.123:0/1462998509 shutdown_connections 2024-08-18T22:13:54.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:54.470+0000 7f8e9a3f7640 1 -- 172.21.15.123:0/1462998509 wait complete. 2024-08-18T22:13:54.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:54 smithi130 ceph-mon[21698]: Adjusting osd_memory_target on smithi123 to 176.0M 2024-08-18T22:13:54.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:54 smithi130 ceph-mon[21698]: Unable to set osd_memory_target on smithi123 to 184593920: error parsing value: Value '184593920' is below minimum 939524096 2024-08-18T22:13:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.590+0000 7f3220e2d640 1 -- 172.21.15.123:0/2873543371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f321c109870 msgr2=0x7f321c110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.590+0000 7f3220e2d640 1 --2- 172.21.15.123:0/2873543371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f321c109870 0x7f321c110100 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3210009900 tx=0x7f321002a3f0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.591+0000 7f3220e2d640 1 -- 172.21.15.123:0/2873543371 shutdown_connections 2024-08-18T22:13:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.591+0000 7f3220e2d640 1 --2- 172.21.15.123:0/2873543371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f321c109870 0x7f321c110100 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.593 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.591+0000 7f3220e2d640 1 --2- 172.21.15.123:0/2873543371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f321c108eb0 0x7f321c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.593 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.591+0000 7f3220e2d640 1 --2- 172.21.15.123:0/2873543371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f321c1081a0 0x7f321c1085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.593 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.591+0000 7f3220e2d640 1 -- 172.21.15.123:0/2873543371 >> 172.21.15.123:0/2873543371 conn(0x7f321c0771a0 msgr2=0x7f321c0795e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:54.593 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.591+0000 7f3220e2d640 1 -- 172.21.15.123:0/2873543371 shutdown_connections 2024-08-18T22:13:54.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.591+0000 7f3220e2d640 1 -- 172.21.15.123:0/2873543371 wait complete. 2024-08-18T22:13:54.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.592+0000 7f3220e2d640 1 Processor -- start 2024-08-18T22:13:54.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.592+0000 7f3220e2d640 1 -- start start 2024-08-18T22:13:54.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.593+0000 7f3220e2d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f321c1081a0 0x7f321c07f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.593+0000 7f3220e2d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f321c108eb0 0x7f321c07fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.595 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.593+0000 7f3220e2d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f321c109870 0x7f321c1ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.593+0000 7f3220e2d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f321c113940 con 0x7f321c1081a0 2024-08-18T22:13:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.593+0000 7f3220e2d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f321c1137c0 con 0x7f321c109870 2024-08-18T22:13:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.593+0000 7f3220e2d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f321c113ac0 con 0x7f321c108eb0 2024-08-18T22:13:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.593+0000 7f321b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f321c1081a0 0x7f321c07f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.593+0000 7f321bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f321c109870 0x7f321c1ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.593+0000 7f321bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f321c109870 0x7f321c1ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:49784/0 (socket says 172.21.15.123:49784) 2024-08-18T22:13:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.593+0000 7f321bfff640 1 -- 172.21.15.123:0/230601929 learned_addr learned my addr 172.21.15.123:0/230601929 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.593+0000 7f321affd640 1 --2- 172.21.15.123:0/230601929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f321c108eb0 0x7f321c07fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.594+0000 7f321affd640 1 -- 172.21.15.123:0/230601929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f321c109870 msgr2=0x7f321c1ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.594+0000 7f321affd640 1 --2- 172.21.15.123:0/230601929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f321c109870 0x7f321c1ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.594+0000 7f321affd640 1 -- 172.21.15.123:0/230601929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f321c1081a0 msgr2=0x7f321c07f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.594+0000 7f321affd640 1 --2- 172.21.15.123:0/230601929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f321c1081a0 0x7f321c07f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.594+0000 7f321affd640 1 -- 172.21.15.123:0/230601929 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321c082d10 con 0x7f321c108eb0 2024-08-18T22:13:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.594+0000 7f321bfff640 1 --2- 172.21.15.123:0/230601929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f321c109870 0x7f321c1ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.594+0000 7f321b7fe640 1 --2- 172.21.15.123:0/230601929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f321c1081a0 0x7f321c07f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:13:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.595+0000 7f321affd640 1 --2- 172.21.15.123:0/230601929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f321c108eb0 0x7f321c07fb90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f320c00c970 tx=0x7f320c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.595+0000 7f3218ff9640 1 -- 172.21.15.123:0/230601929 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c007bb0 con 0x7f321c108eb0 2024-08-18T22:13:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.595+0000 7f3220e2d640 1 -- 172.21.15.123:0/230601929 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321c1ae650 con 0x7f321c108eb0 2024-08-18T22:13:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.595+0000 7f3220e2d640 1 -- 172.21.15.123:0/230601929 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f321c1aebc0 con 0x7f321c108eb0 2024-08-18T22:13:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.595+0000 7f3218ff9640 1 -- 172.21.15.123:0/230601929 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f320c007d50 con 0x7f321c108eb0 2024-08-18T22:13:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.595+0000 7f3218ff9640 1 -- 172.21.15.123:0/230601929 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c004e60 con 0x7f321c108eb0 2024-08-18T22:13:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.599+0000 7f3224e4f740 1 Processor -- start 2024-08-18T22:13:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.599+0000 7f3224e4f740 1 -- start start 2024-08-18T22:13:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.599+0000 7f3224e4f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeac7860 0x55ddeeac7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.599+0000 7f3224e4f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac81a0 0x55ddeeaccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.599+0000 7f3224e4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeacd230 0x55ddeeacf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.599+0000 7f3224e4f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ddeea2a9d0 con 0x55ddeeac81a0 2024-08-18T22:13:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.599+0000 7f3224e4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ddee9d2820 con 0x55ddeeacd230 2024-08-18T22:13:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.599+0000 7f3224e4f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ddeea26990 con 0x55ddeeac7860 2024-08-18T22:13:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.599+0000 7f321bfff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeac7860 0x55ddeeac7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.600+0000 7f3218ff9640 1 -- 172.21.15.123:0/230601929 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f320c00f450 con 0x7f321c108eb0 2024-08-18T22:13:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.600+0000 7f321bfff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeac7860 0x55ddeeac7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:59088/0 (socket says 172.21.15.123:59088) 2024-08-18T22:13:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.600+0000 7f321bfff640 1 -- 172.21.15.123:0/3493154797 learned_addr learned my addr 172.21.15.123:0/3493154797 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.600+0000 7f321b7fe640 1 --2- 172.21.15.123:0/3493154797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac81a0 0x55ddeeaccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.600+0000 7f321affd640 1 --2- 172.21.15.123:0/3493154797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeacd230 0x55ddeeacf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.600+0000 7f321b7fe640 1 -- 172.21.15.123:0/3493154797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeac7860 msgr2=0x55ddeeac7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.600+0000 7f321b7fe640 1 --2- 172.21.15.123:0/3493154797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeac7860 0x55ddeeac7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.600+0000 7f321b7fe640 1 -- 172.21.15.123:0/3493154797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeacd230 msgr2=0x55ddeeacf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.600+0000 7f321b7fe640 1 --2- 172.21.15.123:0/3493154797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeacd230 0x55ddeeacf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.600+0000 7f321b7fe640 1 -- 172.21.15.123:0/3493154797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddee73e210 con 0x55ddeeac81a0 2024-08-18T22:13:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.600+0000 7f321b7fe640 1 --2- 172.21.15.123:0/3493154797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac81a0 0x55ddeeaccc60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3214005fd0 tx=0x7f3214009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11506a9727f6c54 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.601+0000 7f3218ff9640 1 --2- 172.21.15.123:0/230601929 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f32040a2bc0 0x7f32040a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.601+0000 7f3201ffb640 1 -- 172.21.15.123:0/3493154797 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3214003b70 con 0x55ddeeac81a0 2024-08-18T22:13:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.601+0000 7f3218ff9640 1 -- 172.21.15.123:0/230601929 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f320c0cf3d0 con 0x7f321c108eb0 2024-08-18T22:13:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.601+0000 7f3201ffb640 1 -- 172.21.15.123:0/3493154797 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3214003d10 con 0x55ddeeac81a0 2024-08-18T22:13:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.601+0000 7f3201ffb640 1 -- 172.21.15.123:0/3493154797 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3214011b30 con 0x55ddeeac81a0 2024-08-18T22:13:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.601+0000 7f321bfff640 1 --2- 172.21.15.123:0/230601929 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f32040a2bc0 0x7f32040a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.602+0000 7f3224e4f740 1 -- 172.21.15.123:0/3493154797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac81a0 msgr2=0x55ddeeaccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.602+0000 7f3224e4f740 1 --2- 172.21.15.123:0/3493154797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac81a0 0x55ddeeaccc60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3214005fd0 tx=0x7f3214009f90 comp rx=0 tx=0).stop 2024-08-18T22:13:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.602+0000 7f321bfff640 1 --2- 172.21.15.123:0/230601929 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f32040a2bc0 0x7f32040a5080 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3210004650 tx=0x7f3210031540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.602+0000 7f3224e4f740 1 -- 172.21.15.123:0/3493154797 shutdown_connections 2024-08-18T22:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.602+0000 7f3224e4f740 1 --2- 172.21.15.123:0/3493154797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeacd230 0x55ddeeacf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.602+0000 7f3224e4f740 1 --2- 172.21.15.123:0/3493154797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac81a0 0x55ddeeaccc60 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.602+0000 7f3224e4f740 1 --2- 172.21.15.123:0/3493154797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeac7860 0x55ddeeac7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.602+0000 7f3224e4f740 1 -- 172.21.15.123:0/3493154797 >> 172.21.15.123:0/3493154797 conn(0x55ddeeac2ed0 msgr2=0x55ddeeac32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.602+0000 7f3224e4f740 1 -- 172.21.15.123:0/3493154797 shutdown_connections 2024-08-18T22:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.602+0000 7f3224e4f740 1 -- 172.21.15.123:0/3493154797 wait complete. 2024-08-18T22:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.603+0000 7f3224e4f740 1 -- start start 2024-08-18T22:13:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.603+0000 7f3224e4f740 1 Processor -- start 2024-08-18T22:13:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.603+0000 7f3224e4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeac7860 0x55ddeead19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.603+0000 7f3224e4f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac81a0 0x55ddeead1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.603+0000 7f3224e4f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeacd230 0x55ddeead8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.603+0000 7f3224e4f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ddeead0200 con 0x55ddeeac81a0 2024-08-18T22:13:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.603+0000 7f3224e4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ddee9e6520 con 0x55ddeeac7860 2024-08-18T22:13:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.603+0000 7f3224e4f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ddeead0380 con 0x55ddeeacd230 2024-08-18T22:13:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.603+0000 7f321affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac81a0 0x55ddeead1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.603+0000 7f321b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeac7860 0x55ddeead19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.603+0000 7f321b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeac7860 0x55ddeead19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:49808/0 (socket says 172.21.15.123:49808) 2024-08-18T22:13:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.603+0000 7f321affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac81a0 0x55ddeead1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47802/0 (socket says 172.21.15.123:47802) 2024-08-18T22:13:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.603+0000 7f321b7fe640 1 -- 172.21.15.123:0/3907278453 learned_addr learned my addr 172.21.15.123:0/3907278453 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.604+0000 7f3224e4f740 10 client.0 _ll_register_callbacks cb 0x55ddee73da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.604+0000 7f321bfff640 1 --2- 172.21.15.123:0/3907278453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeacd230 0x55ddeead8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.604+0000 7f321b7fe640 1 -- 172.21.15.123:0/3907278453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeacd230 msgr2=0x55ddeead8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.604+0000 7f321b7fe640 1 --2- 172.21.15.123:0/3907278453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeacd230 0x55ddeead8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.604+0000 7f321b7fe640 1 -- 172.21.15.123:0/3907278453 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac81a0 msgr2=0x55ddeead1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.604+0000 7f321b7fe640 1 --2- 172.21.15.123:0/3907278453 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac81a0 0x55ddeead1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.604+0000 7f321b7fe640 1 -- 172.21.15.123:0/3907278453 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddee80a620 con 0x55ddeeac7860 2024-08-18T22:13:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.604+0000 7f321b7fe640 1 --2- 172.21.15.123:0/3907278453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeac7860 0x55ddeead19e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3214010d70 tx=0x7f3214003970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a83378fef5e7520 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.604+0000 7f31faffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:13:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.604+0000 7f31faffd640 1 -- 172.21.15.123:0/3907278453 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3214027030 con 0x55ddeeac7860 2024-08-18T22:13:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.604+0000 7f3224e4f740 1 -- 172.21.15.123:0/3907278453 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3214003d10 con 0x55ddeeac7860 2024-08-18T22:13:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.604+0000 7f31faffd640 1 -- 172.21.15.123:0/3907278453 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f321401f070 con 0x55ddeeac7860 2024-08-18T22:13:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.605+0000 7f31faffd640 1 -- 172.21.15.123:0/3907278453 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3214031050 con 0x55ddeeac7860 2024-08-18T22:13:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.605+0000 7f3224e4f740 10 client.25931 fetch_fsmap learned FSMap version 32 2024-08-18T22:13:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.605+0000 7f3224e4f740 1 -- 172.21.15.123:0/3907278453 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ddeeadbd80 con 0x55ddeeac7860 2024-08-18T22:13:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.605+0000 7f31faffd640 1 -- 172.21.15.123:0/3907278453 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3214003d10 con 0x55ddeeac7860 2024-08-18T22:13:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.606+0000 7f31faffd640 1 -- 172.21.15.123:0/3907278453 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f32140040a0 con 0x55ddeeac7860 2024-08-18T22:13:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.606+0000 7f3224e4f740 10 client.25931 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:13:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.606+0000 7f3224e4f740 10 client.25931 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.606+0000 7f3224e4f740 20 client.25931 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.606+0000 7f3224e4f740 1 --2- 172.21.15.123:0/3907278453 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ddeeadd190 0x55ddeeadf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.606+0000 7f3224e4f740 4 client.25931 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:13:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.606+0000 7f3224e4f740 1 -- 172.21.15.123:0/3907278453 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddeea38100 con 0x55ddeeadd190 2024-08-18T22:13:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.607+0000 7f321affd640 1 --2- 172.21.15.123:0/3907278453 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ddeeadd190 0x55ddeeadf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.609+0000 7f321affd640 1 --2- 172.21.15.123:0/3907278453 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ddeeadd190 0x55ddeeadf5a0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14af0a758cf37d55 server_cookie=1898f295e0593c3e in_seq=0 out_seq=0 2024-08-18T22:13:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.609+0000 7f31faffd640 10 client.25931 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.614+0000 7f31faffd640 1 -- 172.21.15.123:0/3907278453 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ddeea38100 con 0x55ddeeadd190 2024-08-18T22:13:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.614+0000 7f31faffd640 10 client.25931 handle_command_reply: tid=0 2024-08-18T22:13:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.614+0000 7f3224e4f740 1 client.25931 shutdown 2024-08-18T22:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.615+0000 7f3224e4f740 1 -- 172.21.15.123:0/3907278453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeac7860 msgr2=0x55ddeead19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.615+0000 7f3224e4f740 1 --2- 172.21.15.123:0/3907278453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeac7860 0x55ddeead19e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3214010d70 tx=0x7f3214003970 comp rx=0 tx=0).stop 2024-08-18T22:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.615+0000 7f3224e4f740 1 -- 172.21.15.123:0/3907278453 shutdown_connections 2024-08-18T22:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.615+0000 7f3224e4f740 1 --2- 172.21.15.123:0/3907278453 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ddeeadd190 0x55ddeeadf5a0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.615+0000 7f31faffd640 0 client.25931 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.615+0000 7f3224e4f740 1 --2- 172.21.15.123:0/3907278453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeacd230 0x55ddeead8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.615+0000 7f3224e4f740 1 --2- 172.21.15.123:0/3907278453 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac81a0 0x55ddeead1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.615+0000 7f3224e4f740 1 --2- 172.21.15.123:0/3907278453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeac7860 0x55ddeead19e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.615+0000 7f3224e4f740 1 -- 172.21.15.123:0/3907278453 >> 172.21.15.123:0/3907278453 conn(0x55ddeeac2ed0 msgr2=0x55ddeeac46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.616+0000 7f3224e4f740 1 -- 172.21.15.123:0/3907278453 shutdown_connections 2024-08-18T22:13:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.616+0000 7f3224e4f740 1 -- 172.21.15.123:0/3907278453 wait complete. 2024-08-18T22:13:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.616+0000 7f3224e4f740 20 client.25931 trim_cache size 0 max 16384 2024-08-18T22:13:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f3224e4f740 1 Processor -- start 2024-08-18T22:13:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f3224e4f740 1 -- start start 2024-08-18T22:13:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f3224e4f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac7860 0x55ddeeac42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f3224e4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeac81a0 0x55ddeead8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f3224e4f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeacd230 0x55ddeeac4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f3224e4f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3208012520 con 0x55ddeeac7860 2024-08-18T22:13:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f3224e4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f320800fd30 con 0x55ddeeac81a0 2024-08-18T22:13:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f3224e4f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f320800db80 con 0x55ddeeacd230 2024-08-18T22:13:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f321b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac7860 0x55ddeeac42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f321b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac7860 0x55ddeeac42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47806/0 (socket says 172.21.15.123:47806) 2024-08-18T22:13:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f321b7fe640 1 -- 172.21.15.123:0/2829335752 learned_addr learned my addr 172.21.15.123:0/2829335752 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f321affd640 1 --2- 172.21.15.123:0/2829335752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeac81a0 0x55ddeead8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f321bfff640 1 --2- 172.21.15.123:0/2829335752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeacd230 0x55ddeeac4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f321b7fe640 1 -- 172.21.15.123:0/2829335752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeacd230 msgr2=0x55ddeeac4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f321b7fe640 1 --2- 172.21.15.123:0/2829335752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeacd230 0x55ddeeac4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f321b7fe640 1 -- 172.21.15.123:0/2829335752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeac81a0 msgr2=0x55ddeead8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f321b7fe640 1 --2- 172.21.15.123:0/2829335752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeac81a0 0x55ddeead8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f321b7fe640 1 -- 172.21.15.123:0/2829335752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddeeac2cf0 con 0x55ddeeac7860 2024-08-18T22:13:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.631+0000 7f321b7fe640 1 --2- 172.21.15.123:0/2829335752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac7860 0x55ddeeac42c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3214009dd0 tx=0x7f3214011500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9793c9e8748b34 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.632+0000 7f32017fa640 1 -- 172.21.15.123:0/2829335752 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321403a070 con 0x55ddeeac7860 2024-08-18T22:13:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.632+0000 7f32017fa640 1 -- 172.21.15.123:0/2829335752 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3214003d10 con 0x55ddeeac7860 2024-08-18T22:13:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.632+0000 7f32017fa640 1 -- 172.21.15.123:0/2829335752 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3214027040 con 0x55ddeeac7860 2024-08-18T22:13:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.632+0000 7f3224e4f740 1 -- 172.21.15.123:0/2829335752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac7860 msgr2=0x55ddeeac42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.632+0000 7f3224e4f740 1 --2- 172.21.15.123:0/2829335752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac7860 0x55ddeeac42c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3214009dd0 tx=0x7f3214011500 comp rx=0 tx=0).stop 2024-08-18T22:13:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.632+0000 7f3224e4f740 1 -- 172.21.15.123:0/2829335752 shutdown_connections 2024-08-18T22:13:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.632+0000 7f3224e4f740 1 --2- 172.21.15.123:0/2829335752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeacd230 0x55ddeeac4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.632+0000 7f3224e4f740 1 --2- 172.21.15.123:0/2829335752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeac81a0 0x55ddeead8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.632+0000 7f3224e4f740 1 --2- 172.21.15.123:0/2829335752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac7860 0x55ddeeac42c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.632+0000 7f3224e4f740 1 -- 172.21.15.123:0/2829335752 >> 172.21.15.123:0/2829335752 conn(0x55ddeeac2ed0 msgr2=0x55ddeead0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f3224e4f740 1 -- 172.21.15.123:0/2829335752 shutdown_connections 2024-08-18T22:13:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f3224e4f740 1 -- 172.21.15.123:0/2829335752 wait complete. 2024-08-18T22:13:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f3224e4f740 1 -- start start 2024-08-18T22:13:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f3224e4f740 1 Processor -- start 2024-08-18T22:13:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f3224e4f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac7860 0x55ddeead62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f3224e4f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeac81a0 0x55ddeead67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f3224e4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeacd230 0x55ddeead77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f3224e4f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f320800e1f0 con 0x55ddeeac7860 2024-08-18T22:13:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f3224e4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f320800f660 con 0x55ddeeacd230 2024-08-18T22:13:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f3224e4f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f320800e8c0 con 0x55ddeeac81a0 2024-08-18T22:13:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f3224e4f740 10 client.0 _ll_register_callbacks cb 0x7f3214009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f321b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac7860 0x55ddeead62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f321b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac7860 0x55ddeead62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47812/0 (socket says 172.21.15.123:47812) 2024-08-18T22:13:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f321b7fe640 1 -- 172.21.15.123:0/426596278 learned_addr learned my addr 172.21.15.123:0/426596278 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f321affd640 1 --2- 172.21.15.123:0/426596278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeac81a0 0x55ddeead67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.633+0000 7f321bfff640 1 --2- 172.21.15.123:0/426596278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeacd230 0x55ddeead77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f321b7fe640 1 -- 172.21.15.123:0/426596278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeac81a0 msgr2=0x55ddeead67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f321b7fe640 1 --2- 172.21.15.123:0/426596278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeac81a0 0x55ddeead67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f321b7fe640 1 -- 172.21.15.123:0/426596278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeacd230 msgr2=0x55ddeead77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f321b7fe640 1 --2- 172.21.15.123:0/426596278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeacd230 0x55ddeead77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f321b7fe640 1 -- 172.21.15.123:0/426596278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddeead7e00 con 0x55ddeeac7860 2024-08-18T22:13:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f321bfff640 1 --2- 172.21.15.123:0/426596278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeacd230 0x55ddeead77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:13:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f321b7fe640 1 --2- 172.21.15.123:0/426596278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac7860 0x55ddeead62a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f32140045b0 tx=0x7f3214009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e0d39a3f474d62 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f31faffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:13:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f31faffd640 1 -- 172.21.15.123:0/426596278 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321403a070 con 0x55ddeeac7860 2024-08-18T22:13:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f31faffd640 1 -- 172.21.15.123:0/426596278 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f3214004630 con 0x55ddeeac7860 2024-08-18T22:13:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f3224e4f740 1 -- 172.21.15.123:0/426596278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3214003d10 con 0x55ddeeac7860 2024-08-18T22:13:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f31faffd640 1 -- 172.21.15.123:0/426596278 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3214047050 con 0x55ddeeac7860 2024-08-18T22:13:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f3224e4f740 10 client.16629 fetch_fsmap learned FSMap version 32 2024-08-18T22:13:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f3224e4f740 1 -- 172.21.15.123:0/426596278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ddeead9110 con 0x55ddeeac7860 2024-08-18T22:13:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f31faffd640 1 -- 172.21.15.123:0/426596278 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3214003d10 con 0x55ddeeac7860 2024-08-18T22:13:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f31faffd640 1 -- 172.21.15.123:0/426596278 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f32140119a0 con 0x55ddeeac7860 2024-08-18T22:13:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f3224e4f740 10 client.16629 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:13:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f3224e4f740 10 client.16629 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:13:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f3224e4f740 20 client.16629 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.634+0000 7f3224e4f740 1 --2- 172.21.15.123:0/426596278 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ddeeadd190 0x55ddeeb4a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.635+0000 7f3224e4f740 4 client.16629 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:13:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.635+0000 7f3224e4f740 1 -- 172.21.15.123:0/426596278 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ddeea32450 con 0x55ddeeadd190 2024-08-18T22:13:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.635+0000 7f321affd640 1 --2- 172.21.15.123:0/426596278 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ddeeadd190 0x55ddeeb4a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.635+0000 7f31faffd640 10 client.16629 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:54.635+0000 7f321affd640 1 --2- 172.21.15.123:0/426596278 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ddeeadd190 0x55ddeeb4a490 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a36eecbf0153093 server_cookie=8ce41651715e0e1 in_seq=0 out_seq=0 2024-08-18T22:13:55.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:55 smithi183 ceph-mon[22097]: pgmap v524: 129 pgs: 129 active+clean; 141 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 867 op/s 2024-08-18T22:13:55.500 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:55 smithi123 ceph-mon[18462]: pgmap v524: 129 pgs: 129 active+clean; 141 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 867 op/s 2024-08-18T22:13:55.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:55 smithi130 ceph-mon[21698]: pgmap v524: 129 pgs: 129 active+clean; 141 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 867 op/s 2024-08-18T22:13:55.549 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-18T22:13:55.831 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:13:56.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.657+0000 7ff9b87af640 1 -- 172.21.15.123:0/471097516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9b01067b0 msgr2=0x7ff9b0106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:56.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.657+0000 7ff9b87af640 1 --2- 172.21.15.123:0/471097516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9b01067b0 0x7ff9b0106b90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009900 tx=0x7ff9ac02a3f0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.657+0000 7ff9b87af640 1 -- 172.21.15.123:0/471097516 shutdown_connections 2024-08-18T22:13:56.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.657+0000 7ff9b87af640 1 --2- 172.21.15.123:0/471097516 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9b0101150 0x7ff9b010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.657+0000 7ff9b87af640 1 --2- 172.21.15.123:0/471097516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b01007b0 0x7ff9b0100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.657+0000 7ff9b87af640 1 --2- 172.21.15.123:0/471097516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9b01067b0 0x7ff9b0106b90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.657+0000 7ff9b87af640 1 -- 172.21.15.123:0/471097516 >> 172.21.15.123:0/471097516 conn(0x7ff9b00fc4d0 msgr2=0x7ff9b00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:56.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.657+0000 7ff9b87af640 1 -- 172.21.15.123:0/471097516 shutdown_connections 2024-08-18T22:13:56.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.657+0000 7ff9b87af640 1 -- 172.21.15.123:0/471097516 wait complete. 2024-08-18T22:13:56.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.658+0000 7ff9b87af640 1 Processor -- start 2024-08-18T22:13:56.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.658+0000 7ff9b87af640 1 -- start start 2024-08-18T22:13:56.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.658+0000 7ff9b87af640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9b01007b0 0x7ff9b010c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.658+0000 7ff9b87af640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9b0101150 0x7ff9b010c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.658+0000 7ff9b87af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b01067b0 0x7ff9b01a2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.658+0000 7ff9b87af640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b006a970 con 0x7ff9b01067b0 2024-08-18T22:13:56.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.658+0000 7ff9b87af640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b006a7f0 con 0x7ff9b01007b0 2024-08-18T22:13:56.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.658+0000 7ff9b87af640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b006aaf0 con 0x7ff9b0101150 2024-08-18T22:13:56.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.658+0000 7ff9b654b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9b01007b0 0x7ff9b010c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.658+0000 7ff9b6d4c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b01067b0 0x7ff9b01a2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.658+0000 7ff9b654b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9b01007b0 0x7ff9b010c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:49848/0 (socket says 172.21.15.123:49848) 2024-08-18T22:13:56.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.658+0000 7ff9b654b640 1 -- 172.21.15.123:0/764826414 learned_addr learned my addr 172.21.15.123:0/764826414 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.659+0000 7ff9b5d4a640 1 --2- 172.21.15.123:0/764826414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9b0101150 0x7ff9b010c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.659+0000 7ff9b654b640 1 -- 172.21.15.123:0/764826414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9b0101150 msgr2=0x7ff9b010c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.659+0000 7ff9b654b640 1 --2- 172.21.15.123:0/764826414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9b0101150 0x7ff9b010c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.659+0000 7ff9b654b640 1 -- 172.21.15.123:0/764826414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b01067b0 msgr2=0x7ff9b01a2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.659+0000 7ff9b654b640 1 --2- 172.21.15.123:0/764826414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b01067b0 0x7ff9b01a2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.659+0000 7ff9b654b640 1 -- 172.21.15.123:0/764826414 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b01a3630 con 0x7ff9b01007b0 2024-08-18T22:13:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.659+0000 7ff9b6d4c640 1 --2- 172.21.15.123:0/764826414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b01067b0 0x7ff9b01a2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.659+0000 7ff9b654b640 1 --2- 172.21.15.123:0/764826414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9b01007b0 0x7ff9b010c360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009850 tx=0x7ff9ac030650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.659+0000 7ff9a77fe640 1 -- 172.21.15.123:0/764826414 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac03f070 con 0x7ff9b01007b0 2024-08-18T22:13:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.659+0000 7ff9a77fe640 1 -- 172.21.15.123:0/764826414 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9ac004460 con 0x7ff9b01007b0 2024-08-18T22:13:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.659+0000 7ff9a77fe640 1 -- 172.21.15.123:0/764826414 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac035030 con 0x7ff9b01007b0 2024-08-18T22:13:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.659+0000 7ff9b87af640 1 -- 172.21.15.123:0/764826414 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b01a38c0 con 0x7ff9b01007b0 2024-08-18T22:13:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.660+0000 7ff9b87af640 1 -- 172.21.15.123:0/764826414 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b01a3d50 con 0x7ff9b01007b0 2024-08-18T22:13:56.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.662+0000 7ff9a77fe640 1 -- 172.21.15.123:0/764826414 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7ff9ac042070 con 0x7ff9b01007b0 2024-08-18T22:13:56.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.662+0000 7ff9babad740 1 Processor -- start 2024-08-18T22:13:56.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.662+0000 7ff9babad740 1 -- start start 2024-08-18T22:13:56.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.662+0000 7ff9babad740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1948ff0 0x5595d19493d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.662+0000 7ff9babad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1949910 0x5595d1953c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.662+0000 7ff9babad740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d19541d0 0x5595d19565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.662+0000 7ff9babad740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5595d18aea40 con 0x5595d1948ff0 2024-08-18T22:13:56.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.662+0000 7ff9babad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5595d18469d0 con 0x5595d1949910 2024-08-18T22:13:56.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.663+0000 7ff9babad740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5595d18aaa00 con 0x5595d19541d0 2024-08-18T22:13:56.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.663+0000 7ff9a77fe640 1 --2- 172.21.15.123:0/764826414 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff99c0a2b80 0x7ff99c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.663+0000 7ff9b6d4c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1948ff0 0x5595d19493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.663+0000 7ff9b654b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1949910 0x5595d1953c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.663+0000 7ff9b6d4c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1948ff0 0x5595d19493d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47824/0 (socket says 172.21.15.123:47824) 2024-08-18T22:13:56.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.663+0000 7ff9b6d4c640 1 -- 172.21.15.123:0/3492474594 learned_addr learned my addr 172.21.15.123:0/3492474594 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:56.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.663+0000 7ff9b5d4a640 1 --2- 172.21.15.123:0/3492474594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d19541d0 0x5595d19565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.663+0000 7ff9b6d4c640 1 --2- 172.21.15.123:0/764826414 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff99c0a2b80 0x7ff99c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.663+0000 7ff9a77fe640 1 -- 172.21.15.123:0/764826414 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ff9ac0efff0 con 0x7ff9b01007b0 2024-08-18T22:13:56.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.664+0000 7ff9b654b640 1 -- 172.21.15.123:0/3492474594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d19541d0 msgr2=0x5595d19565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:56.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.664+0000 7ff9b654b640 1 --2- 172.21.15.123:0/3492474594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d19541d0 0x5595d19565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.664+0000 7ff9b654b640 1 -- 172.21.15.123:0/3492474594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1948ff0 msgr2=0x5595d19493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:56.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.664+0000 7ff9b654b640 1 --2- 172.21.15.123:0/3492474594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1948ff0 0x5595d19493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.664+0000 7ff9b654b640 1 -- 172.21.15.123:0/3492474594 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d184d650 con 0x5595d1949910 2024-08-18T22:13:56.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.664+0000 7ff9b6d4c640 1 --2- 172.21.15.123:0/764826414 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff99c0a2b80 0x7ff99c0a5040 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800a780 tx=0x7ff9a800aeb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:56.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.664+0000 7ff9b654b640 1 --2- 172.21.15.123:0/3492474594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1949910 0x5595d1953c90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0b8f40 tx=0x7ff9ac0b88d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd721889a58d8c00 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:56.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.664+0000 7ff9a4ff9640 1 -- 172.21.15.123:0/3492474594 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac049030 con 0x5595d1949910 2024-08-18T22:13:56.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.664+0000 7ff9a4ff9640 1 -- 172.21.15.123:0/3492474594 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9ac0bc570 con 0x5595d1949910 2024-08-18T22:13:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.664+0000 7ff9a4ff9640 1 -- 172.21.15.123:0/3492474594 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0b8be0 con 0x5595d1949910 2024-08-18T22:13:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.665+0000 7ff9babad740 1 -- 172.21.15.123:0/3492474594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1949910 msgr2=0x5595d1953c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.665+0000 7ff9babad740 1 --2- 172.21.15.123:0/3492474594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1949910 0x5595d1953c90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0b8f40 tx=0x7ff9ac0b88d0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.665+0000 7ff9babad740 1 -- 172.21.15.123:0/3492474594 shutdown_connections 2024-08-18T22:13:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.665+0000 7ff9babad740 1 --2- 172.21.15.123:0/3492474594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d19541d0 0x5595d19565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.666+0000 7ff9babad740 1 --2- 172.21.15.123:0/3492474594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1949910 0x5595d1953c90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.666+0000 7ff9babad740 1 --2- 172.21.15.123:0/3492474594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1948ff0 0x5595d19493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.666+0000 7ff9babad740 1 -- 172.21.15.123:0/3492474594 >> 172.21.15.123:0/3492474594 conn(0x5595d1945580 msgr2=0x5595d1945960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.666+0000 7ff9babad740 1 -- 172.21.15.123:0/3492474594 shutdown_connections 2024-08-18T22:13:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.666+0000 7ff9babad740 1 -- 172.21.15.123:0/3492474594 wait complete. 2024-08-18T22:13:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.666+0000 7ff9babad740 1 -- start start 2024-08-18T22:13:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.667+0000 7ff9babad740 1 Processor -- start 2024-08-18T22:13:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.667+0000 7ff9babad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1948ff0 0x5595d1951010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.667+0000 7ff9babad740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1949910 0x5595d1951550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.667+0000 7ff9babad740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d19541d0 0x5595d1951a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.667+0000 7ff9babad740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5595d1956b60 con 0x5595d1949910 2024-08-18T22:13:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.667+0000 7ff9babad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5595d1869b20 con 0x5595d1948ff0 2024-08-18T22:13:56.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.667+0000 7ff9babad740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5595d1956ce0 con 0x5595d19541d0 2024-08-18T22:13:56.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.667+0000 7ff9babad740 10 client.0 _ll_register_callbacks cb 0x5595d1867bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.667+0000 7ff9b5d4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1949910 0x5595d1951550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.667+0000 7ff9b5d4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1949910 0x5595d1951550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47836/0 (socket says 172.21.15.123:47836) 2024-08-18T22:13:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.667+0000 7ff9b5d4a640 1 -- 172.21.15.123:0/446470463 learned_addr learned my addr 172.21.15.123:0/446470463 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.667+0000 7ff9b6d4c640 1 --2- 172.21.15.123:0/446470463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d19541d0 0x5595d1951a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.668+0000 7ff9b654b640 1 --2- 172.21.15.123:0/446470463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1948ff0 0x5595d1951010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.668+0000 7ff9b5d4a640 1 -- 172.21.15.123:0/446470463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d19541d0 msgr2=0x5595d1951a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.668+0000 7ff9b5d4a640 1 --2- 172.21.15.123:0/446470463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d19541d0 0x5595d1951a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.668+0000 7ff9b5d4a640 1 -- 172.21.15.123:0/446470463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1948ff0 msgr2=0x5595d1951010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:56.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.668+0000 7ff9b5d4a640 1 --2- 172.21.15.123:0/446470463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1948ff0 0x5595d1951010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.668+0000 7ff9b5d4a640 1 -- 172.21.15.123:0/446470463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d16203c0 con 0x5595d1949910 2024-08-18T22:13:56.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.668+0000 7ff9b5d4a640 1 --2- 172.21.15.123:0/446470463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1949910 0x5595d1951550 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0012720 tx=0x7ff9a0012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71614a218f104eba server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:56.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.668+0000 7ff999ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:13:56.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.668+0000 7ff999ffb640 1 -- 172.21.15.123:0/446470463 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000f920 con 0x5595d1949910 2024-08-18T22:13:56.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.668+0000 7ff999ffb640 1 -- 172.21.15.123:0/446470463 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ff9a000fac0 con 0x5595d1949910 2024-08-18T22:13:56.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.668+0000 7ff9babad740 1 -- 172.21.15.123:0/446470463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9ac0bc570 con 0x5595d1949910 2024-08-18T22:13:56.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.669+0000 7ff999ffb640 1 -- 172.21.15.123:0/446470463 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff9a000fd00 con 0x5595d1949910 2024-08-18T22:13:56.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.669+0000 7ff9babad740 10 client.16641 fetch_fsmap learned FSMap version 32 2024-08-18T22:13:56.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.669+0000 7ff9babad740 1 -- 172.21.15.123:0/446470463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5595d19626f0 con 0x5595d1949910 2024-08-18T22:13:56.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.670+0000 7ff999ffb640 1 -- 172.21.15.123:0/446470463 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9ac0bc570 con 0x5595d1949910 2024-08-18T22:13:56.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.670+0000 7ff999ffb640 1 -- 172.21.15.123:0/446470463 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7ff9a00105d0 con 0x5595d1949910 2024-08-18T22:13:56.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.670+0000 7ff9babad740 10 client.16641 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:13:56.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.670+0000 7ff9babad740 10 client.16641 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-18T22:13:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.670+0000 7ff9babad740 20 client.16641 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.670+0000 7ff9babad740 1 --2- 172.21.15.123:0/446470463 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5595d1964000 0x5595d1966480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.670+0000 7ff9babad740 4 client.16641 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:13:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.670+0000 7ff9babad740 1 -- 172.21.15.123:0/446470463 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595d18bbfb0 con 0x5595d1964000 2024-08-18T22:13:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.670+0000 7ff9b654b640 1 --2- 172.21.15.123:0/446470463 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5595d1964000 0x5595d1966480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.671+0000 7ff9b654b640 1 --2- 172.21.15.123:0/446470463 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5595d1964000 0x5595d1966480 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5c4cfd6b93f0ea7f server_cookie=2176ae756794f271 in_seq=0 out_seq=0 2024-08-18T22:13:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.671+0000 7ff999ffb640 10 client.16641 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:13:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.672+0000 7ff999ffb640 1 -- 172.21.15.123:0/446470463 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5595d18bbfb0 con 0x5595d1964000 2024-08-18T22:13:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.672+0000 7ff999ffb640 10 client.16641 handle_command_reply: tid=0 2024-08-18T22:13:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.672+0000 7ff9babad740 1 client.16641 shutdown 2024-08-18T22:13:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.672+0000 7ff9babad740 1 -- 172.21.15.123:0/446470463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1949910 msgr2=0x5595d1951550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.672+0000 7ff9babad740 1 --2- 172.21.15.123:0/446470463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1949910 0x5595d1951550 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0012720 tx=0x7ff9a0012be0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.672+0000 7ff9babad740 1 -- 172.21.15.123:0/446470463 shutdown_connections 2024-08-18T22:13:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.672+0000 7ff9babad740 1 --2- 172.21.15.123:0/446470463 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5595d1964000 0x5595d1966480 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.672+0000 7ff999ffb640 0 client.16641 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:13:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.672+0000 7ff9babad740 1 --2- 172.21.15.123:0/446470463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d19541d0 0x5595d1951a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.672+0000 7ff9babad740 1 --2- 172.21.15.123:0/446470463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1949910 0x5595d1951550 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.672+0000 7ff9babad740 1 --2- 172.21.15.123:0/446470463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1948ff0 0x5595d1951010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.672+0000 7ff9babad740 1 -- 172.21.15.123:0/446470463 >> 172.21.15.123:0/446470463 conn(0x5595d1945580 msgr2=0x5595d194b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.673+0000 7ff9babad740 1 -- 172.21.15.123:0/446470463 shutdown_connections 2024-08-18T22:13:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.673+0000 7ff9babad740 1 -- 172.21.15.123:0/446470463 wait complete. 2024-08-18T22:13:56.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.673+0000 7ff9babad740 20 client.16641 trim_cache size 0 max 16384 2024-08-18T22:13:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.690+0000 7ff9babad740 1 Processor -- start 2024-08-18T22:13:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.690+0000 7ff9babad740 1 -- start start 2024-08-18T22:13:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.690+0000 7ff9babad740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1948ff0 0x5595d196bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.690+0000 7ff9babad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1949910 0x5595d196c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.690+0000 7ff9babad740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d19541d0 0x5595d1943d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.690+0000 7ff9babad740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01b7a00 con 0x5595d1948ff0 2024-08-18T22:13:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.690+0000 7ff9babad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01b5210 con 0x5595d1949910 2024-08-18T22:13:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.690+0000 7ff9babad740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01b3060 con 0x5595d19541d0 2024-08-18T22:13:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.690+0000 7ff9b654b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1948ff0 0x5595d196bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.690+0000 7ff9b5d4a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1949910 0x5595d196c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.690+0000 7ff9b654b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1948ff0 0x5595d196bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47852/0 (socket says 172.21.15.123:47852) 2024-08-18T22:13:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.690+0000 7ff9b654b640 1 -- 172.21.15.123:0/526633354 learned_addr learned my addr 172.21.15.123:0/526633354 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.690+0000 7ff9b6d4c640 1 --2- 172.21.15.123:0/526633354 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d19541d0 0x5595d1943d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.691+0000 7ff9b654b640 1 -- 172.21.15.123:0/526633354 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d19541d0 msgr2=0x5595d1943d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.691+0000 7ff9b654b640 1 --2- 172.21.15.123:0/526633354 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d19541d0 0x5595d1943d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.691+0000 7ff9b654b640 1 -- 172.21.15.123:0/526633354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1949910 msgr2=0x5595d196c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.691+0000 7ff9b654b640 1 --2- 172.21.15.123:0/526633354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1949910 0x5595d196c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.691+0000 7ff9b654b640 1 -- 172.21.15.123:0/526633354 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d195fdc0 con 0x5595d1948ff0 2024-08-18T22:13:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.691+0000 7ff9b5d4a640 1 --2- 172.21.15.123:0/526633354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1949910 0x5595d196c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.691+0000 7ff9b654b640 1 --2- 172.21.15.123:0/526633354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1948ff0 0x5595d196bd90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0306c0 tx=0x7ff9ac0b8940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78bf72bbdf0f2272 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.691+0000 7ff99bfff640 1 -- 172.21.15.123:0/526633354 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac049040 con 0x5595d1948ff0 2024-08-18T22:13:56.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.691+0000 7ff99bfff640 1 -- 172.21.15.123:0/526633354 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9ac0bc570 con 0x5595d1948ff0 2024-08-18T22:13:56.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.691+0000 7ff99bfff640 1 -- 172.21.15.123:0/526633354 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0bca30 con 0x5595d1948ff0 2024-08-18T22:13:56.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.692+0000 7ff9babad740 1 -- 172.21.15.123:0/526633354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1948ff0 msgr2=0x5595d196bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:56.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.692+0000 7ff9babad740 1 --2- 172.21.15.123:0/526633354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1948ff0 0x5595d196bd90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0306c0 tx=0x7ff9ac0b8940 comp rx=0 tx=0).stop 2024-08-18T22:13:56.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.692+0000 7ff9babad740 1 -- 172.21.15.123:0/526633354 shutdown_connections 2024-08-18T22:13:56.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.692+0000 7ff9babad740 1 --2- 172.21.15.123:0/526633354 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d19541d0 0x5595d1943d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.692+0000 7ff9babad740 1 --2- 172.21.15.123:0/526633354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d1949910 0x5595d196c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.692+0000 7ff9babad740 1 --2- 172.21.15.123:0/526633354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1948ff0 0x5595d196bd90 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.692+0000 7ff9babad740 1 -- 172.21.15.123:0/526633354 >> 172.21.15.123:0/526633354 conn(0x5595d1945580 msgr2=0x5595d194f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:56.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.692+0000 7ff9babad740 1 -- 172.21.15.123:0/526633354 shutdown_connections 2024-08-18T22:13:56.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.692+0000 7ff9babad740 1 -- 172.21.15.123:0/526633354 wait complete. 2024-08-18T22:13:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.693+0000 7ff9babad740 1 -- start start 2024-08-18T22:13:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.693+0000 7ff9babad740 1 Processor -- start 2024-08-18T22:13:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.693+0000 7ff9babad740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d1948ff0 0x5595d1954970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.693+0000 7ff9babad740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1949910 0x5595d1954eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.693+0000 7ff9babad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d19541d0 0x5595d195af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9babad740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01b36d0 con 0x5595d1949910 2024-08-18T22:13:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9babad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01b4b40 con 0x5595d19541d0 2024-08-18T22:13:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9babad740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01b3da0 con 0x5595d1948ff0 2024-08-18T22:13:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9b654b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d1948ff0 0x5595d1954970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9b5d4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1949910 0x5595d1954eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9b5d4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1949910 0x5595d1954eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47866/0 (socket says 172.21.15.123:47866) 2024-08-18T22:13:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9b5d4a640 1 -- 172.21.15.123:0/2850512017 learned_addr learned my addr 172.21.15.123:0/2850512017 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:13:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9b6d4c640 1 --2- 172.21.15.123:0/2850512017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d19541d0 0x5595d195af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9babad740 10 client.0 _ll_register_callbacks cb 0x7ff9a0009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:13:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9b5d4a640 1 -- 172.21.15.123:0/2850512017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d1948ff0 msgr2=0x5595d1954970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9b5d4a640 1 --2- 172.21.15.123:0/2850512017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d1948ff0 0x5595d1954970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9b5d4a640 1 -- 172.21.15.123:0/2850512017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d19541d0 msgr2=0x5595d195af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:13:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9b5d4a640 1 --2- 172.21.15.123:0/2850512017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d19541d0 0x5595d195af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9b5d4a640 1 -- 172.21.15.123:0/2850512017 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d195b470 con 0x5595d1949910 2024-08-18T22:13:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9b6d4c640 1 --2- 172.21.15.123:0/2850512017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d19541d0 0x5595d195af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:13:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff9b5d4a640 1 --2- 172.21.15.123:0/2850512017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1949910 0x5595d1954eb0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x5595d1952650 tx=0x7ff9a000fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e43c9c7cfdc0949 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:13:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.694+0000 7ff999ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:13:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.695+0000 7ff999ffb640 1 -- 172.21.15.123:0/2850512017 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0010640 con 0x5595d1949910 2024-08-18T22:13:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.695+0000 7ff999ffb640 1 -- 172.21.15.123:0/2850512017 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ff9a0005110 con 0x5595d1949910 2024-08-18T22:13:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.695+0000 7ff9babad740 1 -- 172.21.15.123:0/2850512017 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9ac0bc570 con 0x5595d1949910 2024-08-18T22:13:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.695+0000 7ff999ffb640 1 -- 172.21.15.123:0/2850512017 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff9a0005310 con 0x5595d1949910 2024-08-18T22:13:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.695+0000 7ff9babad740 10 client.16647 fetch_fsmap learned FSMap version 32 2024-08-18T22:13:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.695+0000 7ff9babad740 1 -- 172.21.15.123:0/2850512017 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5595d195c740 con 0x5595d1949910 2024-08-18T22:13:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.695+0000 7ff999ffb640 1 -- 172.21.15.123:0/2850512017 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9ac0bc570 con 0x5595d1949910 2024-08-18T22:13:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.696+0000 7ff999ffb640 1 -- 172.21.15.123:0/2850512017 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7ff9a0003bd0 con 0x5595d1949910 2024-08-18T22:13:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.696+0000 7ff9babad740 10 client.16647 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:13:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.696+0000 7ff9babad740 10 client.16647 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-18T22:13:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.696+0000 7ff9babad740 20 client.16647 populate_metadata read hostname 'smithi123' 2024-08-18T22:13:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.696+0000 7ff9babad740 1 --2- 172.21.15.123:0/2850512017 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5595d1964000 0x5595d19d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:13:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.696+0000 7ff9babad740 4 client.16647 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:13:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.696+0000 7ff9babad740 1 -- 172.21.15.123:0/2850512017 --> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5595d18b64c0 con 0x5595d1964000 2024-08-18T22:13:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.696+0000 7ff9b654b640 1 --2- 172.21.15.123:0/2850512017 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5595d1964000 0x5595d19d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:13:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.697+0000 7ff9b654b640 1 --2- 172.21.15.123:0/2850512017 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5595d1964000 0x5595d19d0d70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7e5dbc887e9422d2 server_cookie=aa7431b73b09bfee in_seq=0 out_seq=0 2024-08-18T22:13:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.697+0000 7ff999ffb640 10 client.16647 ms_handle_connect on v2:172.21.15.130:6838/991946562 2024-08-18T22:13:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.700+0000 7ff999ffb640 1 -- 172.21.15.123:0/2850512017 <== mds.1 v2:172.21.15.130:6838/991946562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+37513 (crc 0 0 0) 0x5595d18b64c0 con 0x5595d1964000 2024-08-18T22:13:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.700+0000 7ff999ffb640 10 client.16647 handle_command_reply: tid=0 2024-08-18T22:13:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.700+0000 7ff9babad740 1 client.16647 shutdown 2024-08-18T22:13:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.700+0000 7ff9babad740 1 -- 172.21.15.123:0/2850512017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1949910 msgr2=0x5595d1954eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.700+0000 7ff9babad740 1 --2- 172.21.15.123:0/2850512017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1949910 0x5595d1954eb0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x5595d1952650 tx=0x7ff9a000fbd0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.700+0000 7ff9babad740 1 -- 172.21.15.123:0/2850512017 shutdown_connections 2024-08-18T22:13:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.700+0000 7ff9babad740 1 --2- 172.21.15.123:0/2850512017 >> [v2:172.21.15.130:6838/991946562,v1:172.21.15.130:6839/991946562] conn(0x5595d1964000 0x5595d19d0d70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.700+0000 7ff9babad740 1 --2- 172.21.15.123:0/2850512017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595d19541d0 0x5595d195af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.700+0000 7ff9babad740 1 --2- 172.21.15.123:0/2850512017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595d1949910 0x5595d1954eb0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.700+0000 7ff9babad740 1 --2- 172.21.15.123:0/2850512017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5595d1948ff0 0x5595d1954970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.700+0000 7ff9babad740 1 -- 172.21.15.123:0/2850512017 >> 172.21.15.123:0/2850512017 conn(0x5595d1945580 msgr2=0x5595d1943d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.700+0000 7ff999ffb640 0 client.16647 ms_handle_reset on v2:172.21.15.130:6838/991946562 2024-08-18T22:13:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.700+0000 7ff9babad740 1 -- 172.21.15.123:0/2850512017 shutdown_connections 2024-08-18T22:13:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.700+0000 7ff9babad740 1 -- 172.21.15.123:0/2850512017 wait complete. 2024-08-18T22:13:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.700+0000 7ff9babad740 20 client.16647 trim_cache size 0 max 16384 2024-08-18T22:13:56.705 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-08-18T22:13:56.705 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.705 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.705 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1930011, 2024-08-18T22:13:56.705 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648591, 2024-08-18T22:13:56.705 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5066" 2024-08-18T22:13:56.705 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.705 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.705 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.705 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 25015563, 2024-08-18T22:13:56.705 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645682, 2024-08-18T22:13:56.705 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3761" 2024-08-18T22:13:56.706 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.706 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.706 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.706 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 39866975, 2024-08-18T22:13:56.706 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650871, 2024-08-18T22:13:56.706 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6063" 2024-08-18T22:13:56.706 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.706 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.706 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.706 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 84267719, 2024-08-18T22:13:56.706 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651946, 2024-08-18T22:13:56.706 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6533" 2024-08-18T22:13:56.706 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.707 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.707 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.707 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 169391740, 2024-08-18T22:13:56.707 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653306, 2024-08-18T22:13:56.707 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7134" 2024-08-18T22:13:56.707 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.707 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.707 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.707 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 214628590, 2024-08-18T22:13:56.707 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652153, 2024-08-18T22:13:56.707 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6620" 2024-08-18T22:13:56.707 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.707 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.708 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.708 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 230182084, 2024-08-18T22:13:56.708 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648452, 2024-08-18T22:13:56.708 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5001" 2024-08-18T22:13:56.708 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.708 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.708 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.708 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 249109358, 2024-08-18T22:13:56.708 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649496, 2024-08-18T22:13:56.708 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5453" 2024-08-18T22:13:56.708 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.708 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.708 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.708 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 259677478, 2024-08-18T22:13:56.709 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652541, 2024-08-18T22:13:56.709 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6798" 2024-08-18T22:13:56.709 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.709 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.709 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.709 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 292514121, 2024-08-18T22:13:56.709 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649878, 2024-08-18T22:13:56.709 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5625" 2024-08-18T22:13:56.709 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.709 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.709 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.709 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 325889740, 2024-08-18T22:13:56.709 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648350, 2024-08-18T22:13:56.710 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4957" 2024-08-18T22:13:56.710 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.710 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.710 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.710 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 350011419, 2024-08-18T22:13:56.710 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651408, 2024-08-18T22:13:56.710 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6296" 2024-08-18T22:13:56.710 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.710 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.710 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.710 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 364370574, 2024-08-18T22:13:56.710 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653659, 2024-08-18T22:13:56.710 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7302" 2024-08-18T22:13:56.711 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.711 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.711 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.711 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 468695823, 2024-08-18T22:13:56.711 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511647100, 2024-08-18T22:13:56.711 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4406" 2024-08-18T22:13:56.711 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.711 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.711 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.711 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 517824446, 2024-08-18T22:13:56.711 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651758, 2024-08-18T22:13:56.711 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6449" 2024-08-18T22:13:56.711 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.711 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.712 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.712 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 590625099, 2024-08-18T22:13:56.712 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651353, 2024-08-18T22:13:56.712 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6271" 2024-08-18T22:13:56.712 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.712 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.712 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.712 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 615946772, 2024-08-18T22:13:56.712 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651358, 2024-08-18T22:13:56.712 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6273" 2024-08-18T22:13:56.712 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.712 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.712 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.713 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 626641147, 2024-08-18T22:13:56.713 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651399, 2024-08-18T22:13:56.713 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6292" 2024-08-18T22:13:56.713 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.713 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.713 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.713 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 636164133, 2024-08-18T22:13:56.713 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511647607, 2024-08-18T22:13:56.713 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4635" 2024-08-18T22:13:56.713 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.713 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.713 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.713 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 676053780, 2024-08-18T22:13:56.714 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645772, 2024-08-18T22:13:56.714 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3805" 2024-08-18T22:13:56.714 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.714 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.714 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.714 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 688599488, 2024-08-18T22:13:56.714 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649717, 2024-08-18T22:13:56.714 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5552" 2024-08-18T22:13:56.714 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.714 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.714 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.714 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 765347609, 2024-08-18T22:13:56.714 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650595, 2024-08-18T22:13:56.714 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5944" 2024-08-18T22:13:56.715 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.715 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.715 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.715 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 766715121, 2024-08-18T22:13:56.715 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648682, 2024-08-18T22:13:56.715 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5106" 2024-08-18T22:13:56.715 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.715 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.715 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.715 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 771006116, 2024-08-18T22:13:56.715 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646592, 2024-08-18T22:13:56.715 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4168" 2024-08-18T22:13:56.715 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.715 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.716 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.716 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 779470914, 2024-08-18T22:13:56.716 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511644844, 2024-08-18T22:13:56.716 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3563" 2024-08-18T22:13:56.716 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.716 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.716 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.716 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 897726853, 2024-08-18T22:13:56.716 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651438, 2024-08-18T22:13:56.716 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6309" 2024-08-18T22:13:56.716 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.716 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.716 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.717 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1002409763, 2024-08-18T22:13:56.717 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651501, 2024-08-18T22:13:56.717 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6336" 2024-08-18T22:13:56.717 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.717 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.717 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.717 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1015296738, 2024-08-18T22:13:56.717 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650463, 2024-08-18T22:13:56.717 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5888" 2024-08-18T22:13:56.717 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.717 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.717 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.717 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1049774969, 2024-08-18T22:13:56.717 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646649, 2024-08-18T22:13:56.717 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4193" 2024-08-18T22:13:56.718 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.718 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.718 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.718 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1085511211, 2024-08-18T22:13:56.718 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645583, 2024-08-18T22:13:56.718 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3716" 2024-08-18T22:13:56.718 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.718 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.718 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.718 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1094292744, 2024-08-18T22:13:56.718 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646726, 2024-08-18T22:13:56.718 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4227" 2024-08-18T22:13:56.718 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.719 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.719 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.719 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1106079388, 2024-08-18T22:13:56.719 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648513, 2024-08-18T22:13:56.719 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5028" 2024-08-18T22:13:56.719 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.719 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.719 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.719 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1114382331, 2024-08-18T22:13:56.719 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646712, 2024-08-18T22:13:56.719 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4221" 2024-08-18T22:13:56.719 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.719 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.719 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.720 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1121055407, 2024-08-18T22:13:56.720 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653401, 2024-08-18T22:13:56.720 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7182" 2024-08-18T22:13:56.720 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.720 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.720 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.720 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1134847022, 2024-08-18T22:13:56.720 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653183, 2024-08-18T22:13:56.720 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7069" 2024-08-18T22:13:56.720 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.720 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.720 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.720 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1164596628, 2024-08-18T22:13:56.720 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651070, 2024-08-18T22:13:56.721 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6150" 2024-08-18T22:13:56.721 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.721 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.721 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.721 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1188314693, 2024-08-18T22:13:56.721 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652535, 2024-08-18T22:13:56.721 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6795" 2024-08-18T22:13:56.721 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.721 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.721 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.721 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1200762471, 2024-08-18T22:13:56.721 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646960, 2024-08-18T22:13:56.721 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4338" 2024-08-18T22:13:56.721 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1208584953, 2024-08-18T22:13:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646189, 2024-08-18T22:13:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3992" 2024-08-18T22:13:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1215039169, 2024-08-18T22:13:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645506, 2024-08-18T22:13:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3692" 2024-08-18T22:13:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.722 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1218513321, 2024-08-18T22:13:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645906, 2024-08-18T22:13:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3868" 2024-08-18T22:13:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1219787304, 2024-08-18T22:13:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648933, 2024-08-18T22:13:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5218" 2024-08-18T22:13:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.723 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1236764490, 2024-08-18T22:13:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650846, 2024-08-18T22:13:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6052" 2024-08-18T22:13:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1256194314, 2024-08-18T22:13:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652990, 2024-08-18T22:13:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6974" 2024-08-18T22:13:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1263114075, 2024-08-18T22:13:56.724 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645496, 2024-08-18T22:13:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3689" 2024-08-18T22:13:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1270991109, 2024-08-18T22:13:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651170, 2024-08-18T22:13:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6195" 2024-08-18T22:13:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1286123357, 2024-08-18T22:13:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652729, 2024-08-18T22:13:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6855" 2024-08-18T22:13:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.726 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.726 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.726 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1306787357, 2024-08-18T22:13:56.726 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652313, 2024-08-18T22:13:56.726 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6688" 2024-08-18T22:13:56.726 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.726 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.726 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.726 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1336481591, 2024-08-18T22:13:56.726 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650309, 2024-08-18T22:13:56.726 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5811" 2024-08-18T22:13:56.726 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.726 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.727 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.727 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1350412489, 2024-08-18T22:13:56.727 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651394, 2024-08-18T22:13:56.727 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6290" 2024-08-18T22:13:56.727 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.727 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.727 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.727 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1399468726, 2024-08-18T22:13:56.727 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511647797, 2024-08-18T22:13:56.727 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4722" 2024-08-18T22:13:56.727 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.727 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.727 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.727 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1441575396, 2024-08-18T22:13:56.728 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511644805, 2024-08-18T22:13:56.728 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3556" 2024-08-18T22:13:56.728 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.728 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.728 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.728 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1458767595, 2024-08-18T22:13:56.728 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645206, 2024-08-18T22:13:56.728 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3633" 2024-08-18T22:13:56.728 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.728 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.728 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.728 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1465997282, 2024-08-18T22:13:56.728 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511647729, 2024-08-18T22:13:56.728 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4688" 2024-08-18T22:13:56.729 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.729 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.729 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.729 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1502324869, 2024-08-18T22:13:56.729 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648208, 2024-08-18T22:13:56.729 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4896" 2024-08-18T22:13:56.729 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.729 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.729 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.729 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1526681733, 2024-08-18T22:13:56.729 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648618, 2024-08-18T22:13:56.729 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5078" 2024-08-18T22:13:56.729 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.730 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.730 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.730 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1564956134, 2024-08-18T22:13:56.730 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648828, 2024-08-18T22:13:56.730 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5172" 2024-08-18T22:13:56.730 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.730 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.730 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.730 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1572283949, 2024-08-18T22:13:56.730 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649098, 2024-08-18T22:13:56.730 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5286" 2024-08-18T22:13:56.730 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.730 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.730 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.731 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1588080433, 2024-08-18T22:13:56.731 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649328, 2024-08-18T22:13:56.731 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5384" 2024-08-18T22:13:56.731 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.731 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.731 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.731 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1638391795, 2024-08-18T22:13:56.731 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511647147, 2024-08-18T22:13:56.731 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4428" 2024-08-18T22:13:56.731 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.731 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.731 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.731 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1708313447, 2024-08-18T22:13:56.731 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651550, 2024-08-18T22:13:56.732 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6359" 2024-08-18T22:13:56.732 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.732 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.732 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.732 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1721828736, 2024-08-18T22:13:56.732 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652135, 2024-08-18T22:13:56.732 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6612" 2024-08-18T22:13:56.732 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.732 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.732 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.732 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1753483954, 2024-08-18T22:13:56.732 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645622, 2024-08-18T22:13:56.732 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3731" 2024-08-18T22:13:56.733 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.733 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.733 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.733 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1810321612, 2024-08-18T22:13:56.733 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650783, 2024-08-18T22:13:56.733 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6024" 2024-08-18T22:13:56.733 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.733 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.733 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.733 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1830180586, 2024-08-18T22:13:56.733 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646049, 2024-08-18T22:13:56.733 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3931" 2024-08-18T22:13:56.733 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.733 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.733 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.734 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1840658592, 2024-08-18T22:13:56.734 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650898, 2024-08-18T22:13:56.734 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6076" 2024-08-18T22:13:56.734 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.734 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.734 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.734 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1851011556, 2024-08-18T22:13:56.734 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651031, 2024-08-18T22:13:56.734 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6134" 2024-08-18T22:13:56.734 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.734 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.734 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.734 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1855182429, 2024-08-18T22:13:56.734 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651860, 2024-08-18T22:13:56.735 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6495" 2024-08-18T22:13:56.735 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.735 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.735 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.735 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1899934329, 2024-08-18T22:13:56.735 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511647497, 2024-08-18T22:13:56.735 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4585" 2024-08-18T22:13:56.735 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.735 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.735 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.735 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1902199010, 2024-08-18T22:13:56.735 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648357, 2024-08-18T22:13:56.735 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4960" 2024-08-18T22:13:56.735 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.736 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.736 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.736 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1908372131, 2024-08-18T22:13:56.736 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650742, 2024-08-18T22:13:56.736 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6006" 2024-08-18T22:13:56.736 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.736 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.736 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.736 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1931042699, 2024-08-18T22:13:56.736 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653336, 2024-08-18T22:13:56.736 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7149" 2024-08-18T22:13:56.736 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.736 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.736 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.737 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1996595375, 2024-08-18T22:13:56.737 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646611, 2024-08-18T22:13:56.737 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4176" 2024-08-18T22:13:56.737 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.737 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.737 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.737 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2082391365, 2024-08-18T22:13:56.737 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511644633, 2024-08-18T22:13:56.737 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3521" 2024-08-18T22:13:56.737 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.737 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.737 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.737 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2090801881, 2024-08-18T22:13:56.737 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651154, 2024-08-18T22:13:56.738 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6188" 2024-08-18T22:13:56.738 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.738 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.738 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.738 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2097372823, 2024-08-18T22:13:56.738 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649607, 2024-08-18T22:13:56.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.701+0000 7ff9b87af640 1 -- 172.21.15.123:0/764826414 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff99c0a2b80 msgr2=0x7ff99c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:56.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.701+0000 7ff9b87af640 1 --2- 172.21.15.123:0/764826414 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff99c0a2b80 0x7ff99c0a5040 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800a780 tx=0x7ff9a800aeb0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.701+0000 7ff9b87af640 1 -- 172.21.15.123:0/764826414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9b01007b0 msgr2=0x7ff9b010c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:56.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.701+0000 7ff9b87af640 1 --2- 172.21.15.123:0/764826414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9b01007b0 0x7ff9b010c360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009850 tx=0x7ff9ac030650 comp rx=0 tx=0).stop 2024-08-18T22:13:56.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.701+0000 7ff9b87af640 1 -- 172.21.15.123:0/764826414 shutdown_connections 2024-08-18T22:13:56.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.701+0000 7ff9b87af640 1 --2- 172.21.15.123:0/764826414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b01067b0 0x7ff9b01a2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.701+0000 7ff9b87af640 1 --2- 172.21.15.123:0/764826414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9b0101150 0x7ff9b010c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.701+0000 7ff9b87af640 1 --2- 172.21.15.123:0/764826414 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff99c0a2b80 0x7ff99c0a5040 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.701+0000 7ff9b87af640 1 --2- 172.21.15.123:0/764826414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9b01007b0 0x7ff9b010c360 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:56.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.701+0000 7ff9b87af640 1 -- 172.21.15.123:0/764826414 >> 172.21.15.123:0/764826414 conn(0x7ff9b00fc4d0 msgr2=0x7ff9b01022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:56.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.702+0000 7ff9b87af640 1 -- 172.21.15.123:0/764826414 shutdown_connections 2024-08-18T22:13:56.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:13:56.702+0000 7ff9b87af640 1 -- 172.21.15.123:0/764826414 wait complete. 2024-08-18T22:13:56.740 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5503" 2024-08-18T22:13:56.740 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.740 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.740 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.740 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2155749878, 2024-08-18T22:13:56.740 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511644023, 2024-08-18T22:13:56.740 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3399" 2024-08-18T22:13:56.740 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.740 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.740 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.740 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2185473585, 2024-08-18T22:13:56.741 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511644223, 2024-08-18T22:13:56.741 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3439" 2024-08-18T22:13:56.741 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.741 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.741 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.741 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2203665665, 2024-08-18T22:13:56.741 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648046, 2024-08-18T22:13:56.741 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4826" 2024-08-18T22:13:56.741 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.741 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.741 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.741 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2207362047, 2024-08-18T22:13:56.741 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511647974, 2024-08-18T22:13:56.742 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4795" 2024-08-18T22:13:56.742 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.742 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.742 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.742 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2211288232, 2024-08-18T22:13:56.742 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645286, 2024-08-18T22:13:56.742 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3649" 2024-08-18T22:13:56.742 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.742 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.742 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.742 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2231027911, 2024-08-18T22:13:56.742 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649222, 2024-08-18T22:13:56.742 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5337" 2024-08-18T22:13:56.743 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.743 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.743 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.743 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2296884512, 2024-08-18T22:13:56.743 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646186, 2024-08-18T22:13:56.743 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3991" 2024-08-18T22:13:56.743 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.743 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.743 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.743 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2317729372, 2024-08-18T22:13:56.743 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511647428, 2024-08-18T22:13:56.743 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4555" 2024-08-18T22:13:56.743 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.743 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.744 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.744 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2321494120, 2024-08-18T22:13:56.744 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649120, 2024-08-18T22:13:56.744 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5294" 2024-08-18T22:13:56.744 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.744 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.744 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.744 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2337797818, 2024-08-18T22:13:56.744 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650082, 2024-08-18T22:13:56.744 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5715" 2024-08-18T22:13:56.744 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.744 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.744 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.745 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2342200341, 2024-08-18T22:13:56.745 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651139, 2024-08-18T22:13:56.745 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6182" 2024-08-18T22:13:56.745 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.745 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.745 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.745 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2356011924, 2024-08-18T22:13:56.745 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649106, 2024-08-18T22:13:56.745 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5289" 2024-08-18T22:13:56.745 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.745 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.745 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.745 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2363070028, 2024-08-18T22:13:56.746 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653794, 2024-08-18T22:13:56.746 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7329" 2024-08-18T22:13:56.746 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.746 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.746 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.746 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2372569362, 2024-08-18T22:13:56.746 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648571, 2024-08-18T22:13:56.746 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5057" 2024-08-18T22:13:56.746 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.746 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.746 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.746 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2417996271, 2024-08-18T22:13:56.746 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651553, 2024-08-18T22:13:56.746 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6360" 2024-08-18T22:13:56.747 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.747 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.747 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.747 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2435978550, 2024-08-18T22:13:56.747 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650317, 2024-08-18T22:13:56.747 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5815" 2024-08-18T22:13:56.747 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.747 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.747 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.747 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2460195455, 2024-08-18T22:13:56.747 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511647547, 2024-08-18T22:13:56.747 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4608" 2024-08-18T22:13:56.747 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.747 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.748 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.748 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2465211436, 2024-08-18T22:13:56.748 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653191, 2024-08-18T22:13:56.748 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7073" 2024-08-18T22:13:56.748 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.748 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.748 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.748 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2479945346, 2024-08-18T22:13:56.748 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653225, 2024-08-18T22:13:56.748 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7091" 2024-08-18T22:13:56.748 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.748 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.748 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.749 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2501493011, 2024-08-18T22:13:56.749 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651514, 2024-08-18T22:13:56.749 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6342" 2024-08-18T22:13:56.749 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.749 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.749 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.749 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2558784919, 2024-08-18T22:13:56.749 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652966, 2024-08-18T22:13:56.749 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6962" 2024-08-18T22:13:56.749 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.749 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.749 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.749 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2571264810, 2024-08-18T22:13:56.749 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652268, 2024-08-18T22:13:56.750 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6669" 2024-08-18T22:13:56.750 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.750 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.750 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.750 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2574535914, 2024-08-18T22:13:56.750 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653277, 2024-08-18T22:13:56.750 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7116" 2024-08-18T22:13:56.750 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.750 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.750 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.750 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2609597693, 2024-08-18T22:13:56.750 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511644013, 2024-08-18T22:13:56.750 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3397" 2024-08-18T22:13:56.750 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.751 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.751 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.751 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2657495913, 2024-08-18T22:13:56.751 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511647231, 2024-08-18T22:13:56.751 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4466" 2024-08-18T22:13:56.751 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.751 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.751 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.751 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2673340537, 2024-08-18T22:13:56.751 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511647378, 2024-08-18T22:13:56.751 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4533" 2024-08-18T22:13:56.751 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.751 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.751 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.752 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2678702850, 2024-08-18T22:13:56.752 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652721, 2024-08-18T22:13:56.752 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6851" 2024-08-18T22:13:56.752 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.752 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.752 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.752 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2684018416, 2024-08-18T22:13:56.752 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650289, 2024-08-18T22:13:56.752 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5802" 2024-08-18T22:13:56.752 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.752 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.752 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.752 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2702423141, 2024-08-18T22:13:56.752 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511644338, 2024-08-18T22:13:56.753 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3462" 2024-08-18T22:13:56.753 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.753 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.753 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.753 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2702742436, 2024-08-18T22:13:56.753 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649960, 2024-08-18T22:13:56.753 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5660" 2024-08-18T22:13:56.753 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.753 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.753 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.753 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2708603159, 2024-08-18T22:13:56.753 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650561, 2024-08-18T22:13:56.753 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5930" 2024-08-18T22:13:56.753 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.754 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.754 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.754 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2734797771, 2024-08-18T22:13:56.754 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645156, 2024-08-18T22:13:56.754 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3623" 2024-08-18T22:13:56.754 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.754 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.754 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.754 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2739837752, 2024-08-18T22:13:56.754 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649383, 2024-08-18T22:13:56.754 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5406" 2024-08-18T22:13:56.754 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.754 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.754 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.755 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2756934906, 2024-08-18T22:13:56.755 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511644293, 2024-08-18T22:13:56.755 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3453" 2024-08-18T22:13:56.755 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.755 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.755 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.755 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2771857949, 2024-08-18T22:13:56.755 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651464, 2024-08-18T22:13:56.755 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6320" 2024-08-18T22:13:56.755 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.755 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.755 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.755 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2778407071, 2024-08-18T22:13:56.755 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652707, 2024-08-18T22:13:56.756 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6844" 2024-08-18T22:13:56.756 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.756 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.756 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.756 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2858477436, 2024-08-18T22:13:56.756 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646986, 2024-08-18T22:13:56.756 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4351" 2024-08-18T22:13:56.756 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.756 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.756 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.756 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2860591141, 2024-08-18T22:13:56.756 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511647831, 2024-08-18T22:13:56.756 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4736" 2024-08-18T22:13:56.756 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.757 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.757 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.757 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2877208814, 2024-08-18T22:13:56.757 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650538, 2024-08-18T22:13:56.757 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5921" 2024-08-18T22:13:56.757 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.757 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.757 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.757 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2901364163, 2024-08-18T22:13:56.757 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653308, 2024-08-18T22:13:56.757 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7135" 2024-08-18T22:13:56.757 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.757 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.757 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.758 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2913702959, 2024-08-18T22:13:56.758 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649018, 2024-08-18T22:13:56.758 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5252" 2024-08-18T22:13:56.758 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.758 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.758 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.758 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2939294987, 2024-08-18T22:13:56.758 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653615, 2024-08-18T22:13:56.758 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7279" 2024-08-18T22:13:56.758 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.758 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.758 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.758 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2942923006, 2024-08-18T22:13:56.758 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652004, 2024-08-18T22:13:56.759 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6559" 2024-08-18T22:13:56.759 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.759 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.759 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.759 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2952008472, 2024-08-18T22:13:56.759 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648539, 2024-08-18T22:13:56.759 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5041" 2024-08-18T22:13:56.759 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.759 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.759 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.759 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2972605674, 2024-08-18T22:13:56.759 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650771, 2024-08-18T22:13:56.759 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6019" 2024-08-18T22:13:56.759 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.760 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.760 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.760 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 2975270942, 2024-08-18T22:13:56.760 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651144, 2024-08-18T22:13:56.760 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6184" 2024-08-18T22:13:56.760 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.760 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.760 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.760 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3016380501, 2024-08-18T22:13:56.760 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648922, 2024-08-18T22:13:56.760 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5213" 2024-08-18T22:13:56.760 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.760 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.760 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.761 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3017049908, 2024-08-18T22:13:56.761 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645301, 2024-08-18T22:13:56.761 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3652" 2024-08-18T22:13:56.761 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.761 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.761 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.761 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3049979503, 2024-08-18T22:13:56.761 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646503, 2024-08-18T22:13:56.761 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4131" 2024-08-18T22:13:56.761 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.761 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.761 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.761 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3101534044, 2024-08-18T22:13:56.761 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648092, 2024-08-18T22:13:56.762 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4847" 2024-08-18T22:13:56.762 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.762 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.762 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.762 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3110404174, 2024-08-18T22:13:56.762 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648766, 2024-08-18T22:13:56.762 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5145" 2024-08-18T22:13:56.762 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.762 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.762 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.762 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3121410109, 2024-08-18T22:13:56.762 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649789, 2024-08-18T22:13:56.762 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5584" 2024-08-18T22:13:56.763 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.763 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.763 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.763 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3121999158, 2024-08-18T22:13:56.763 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653071, 2024-08-18T22:13:56.763 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7015" 2024-08-18T22:13:56.763 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.763 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.763 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.763 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3156476423, 2024-08-18T22:13:56.763 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650725, 2024-08-18T22:13:56.763 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5998" 2024-08-18T22:13:56.763 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.763 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.764 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.764 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3179209989, 2024-08-18T22:13:56.764 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653354, 2024-08-18T22:13:56.764 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7158" 2024-08-18T22:13:56.764 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.764 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.764 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.764 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3197460725, 2024-08-18T22:13:56.764 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645913, 2024-08-18T22:13:56.764 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3871" 2024-08-18T22:13:56.764 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.764 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.764 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.764 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3222659242, 2024-08-18T22:13:56.765 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645778, 2024-08-18T22:13:56.765 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3808" 2024-08-18T22:13:56.765 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.765 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.765 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.765 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3334612962, 2024-08-18T22:13:56.765 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649549, 2024-08-18T22:13:56.765 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5478" 2024-08-18T22:13:56.765 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.765 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.765 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.765 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3342831759, 2024-08-18T22:13:56.765 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646537, 2024-08-18T22:13:56.765 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4146" 2024-08-18T22:13:56.766 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.766 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.766 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.766 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3368316489, 2024-08-18T22:13:56.766 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645690, 2024-08-18T22:13:56.766 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3765" 2024-08-18T22:13:56.766 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.766 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.766 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.766 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3385924666, 2024-08-18T22:13:56.766 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645291, 2024-08-18T22:13:56.766 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3650" 2024-08-18T22:13:56.766 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.766 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.767 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.767 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3393846136, 2024-08-18T22:13:56.767 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648928, 2024-08-18T22:13:56.767 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5216" 2024-08-18T22:13:56.767 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.767 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.767 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.767 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3417036351, 2024-08-18T22:13:56.767 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645792, 2024-08-18T22:13:56.767 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3815" 2024-08-18T22:13:56.767 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.767 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.767 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.767 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3418290914, 2024-08-18T22:13:56.768 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649684, 2024-08-18T22:13:56.768 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5537" 2024-08-18T22:13:56.768 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.768 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.768 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.768 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3420503121, 2024-08-18T22:13:56.768 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649226, 2024-08-18T22:13:56.768 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5339" 2024-08-18T22:13:56.768 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.768 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.768 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.768 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3436293449, 2024-08-18T22:13:56.768 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646834, 2024-08-18T22:13:56.768 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4275" 2024-08-18T22:13:56.769 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.769 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.769 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.769 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3460701909, 2024-08-18T22:13:56.769 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650708, 2024-08-18T22:13:56.769 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5991" 2024-08-18T22:13:56.769 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.769 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.769 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.769 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3463157380, 2024-08-18T22:13:56.769 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645857, 2024-08-18T22:13:56.769 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3845" 2024-08-18T22:13:56.769 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.769 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.770 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.770 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3487295297, 2024-08-18T22:13:56.770 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650222, 2024-08-18T22:13:56.770 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5773" 2024-08-18T22:13:56.770 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.770 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.770 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.770 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3532120841, 2024-08-18T22:13:56.770 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649600, 2024-08-18T22:13:56.770 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5500" 2024-08-18T22:13:56.770 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.770 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.770 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.770 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3539277450, 2024-08-18T22:13:56.771 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652923, 2024-08-18T22:13:56.771 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6941" 2024-08-18T22:13:56.771 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.771 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.771 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.771 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3546922754, 2024-08-18T22:13:56.771 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646840, 2024-08-18T22:13:56.771 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4278" 2024-08-18T22:13:56.771 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.771 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.771 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.771 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3548073740, 2024-08-18T22:13:56.771 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653432, 2024-08-18T22:13:56.771 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7198" 2024-08-18T22:13:56.772 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.772 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.772 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.772 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3559771058, 2024-08-18T22:13:56.772 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648858, 2024-08-18T22:13:56.772 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5184" 2024-08-18T22:13:56.772 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.772 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.772 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.772 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3592997493, 2024-08-18T22:13:56.772 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652543, 2024-08-18T22:13:56.772 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6799" 2024-08-18T22:13:56.772 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.772 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.773 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.773 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3628331763, 2024-08-18T22:13:56.773 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650242, 2024-08-18T22:13:56.773 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5781" 2024-08-18T22:13:56.773 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.773 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.773 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.773 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3659785251, 2024-08-18T22:13:56.773 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511648886, 2024-08-18T22:13:56.773 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5196" 2024-08-18T22:13:56.773 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.773 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.773 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.774 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3671529849, 2024-08-18T22:13:56.774 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651943, 2024-08-18T22:13:56.774 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6532" 2024-08-18T22:13:56.774 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.774 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.774 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.774 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3714157112, 2024-08-18T22:13:56.774 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511644343, 2024-08-18T22:13:56.774 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3463" 2024-08-18T22:13:56.774 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.774 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.774 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.774 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3769968538, 2024-08-18T22:13:56.774 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653549, 2024-08-18T22:13:56.775 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7261" 2024-08-18T22:13:56.775 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.775 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.775 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.775 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3805687436, 2024-08-18T22:13:56.775 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650373, 2024-08-18T22:13:56.775 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5843" 2024-08-18T22:13:56.775 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.775 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.775 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.775 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3832180316, 2024-08-18T22:13:56.775 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649393, 2024-08-18T22:13:56.775 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5410" 2024-08-18T22:13:56.775 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.776 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.776 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.776 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3890990587, 2024-08-18T22:13:56.776 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511650970, 2024-08-18T22:13:56.776 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6107" 2024-08-18T22:13:56.776 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.776 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.776 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.776 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3894775242, 2024-08-18T22:13:56.776 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646221, 2024-08-18T22:13:56.776 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4007" 2024-08-18T22:13:56.776 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.776 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.776 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.777 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3902791252, 2024-08-18T22:13:56.777 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652799, 2024-08-18T22:13:56.777 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6879" 2024-08-18T22:13:56.777 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.777 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.777 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.777 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3932230712, 2024-08-18T22:13:56.777 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649251, 2024-08-18T22:13:56.777 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5351" 2024-08-18T22:13:56.777 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.777 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.777 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.777 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3985643683, 2024-08-18T22:13:56.777 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652357, 2024-08-18T22:13:56.778 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6707" 2024-08-18T22:13:56.778 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.778 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.778 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.778 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3993791734, 2024-08-18T22:13:56.778 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511649500, 2024-08-18T22:13:56.778 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5455" 2024-08-18T22:13:56.778 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.778 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.778 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.778 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4034990298, 2024-08-18T22:13:56.778 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645724, 2024-08-18T22:13:56.778 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3782" 2024-08-18T22:13:56.778 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.779 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.779 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.779 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4126580683, 2024-08-18T22:13:56.779 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511652146, 2024-08-18T22:13:56.779 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6617" 2024-08-18T22:13:56.779 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.779 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.779 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.779 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4137751782, 2024-08-18T22:13:56.779 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511647897, 2024-08-18T22:13:56.779 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4762" 2024-08-18T22:13:56.779 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.779 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.779 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.780 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4142729067, 2024-08-18T22:13:56.780 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511647544, 2024-08-18T22:13:56.780 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4607" 2024-08-18T22:13:56.780 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.780 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.780 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.780 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4202796829, 2024-08-18T22:13:56.780 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511651187, 2024-08-18T22:13:56.780 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6203" 2024-08-18T22:13:56.780 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.780 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.780 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.780 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4204235345, 2024-08-18T22:13:56.780 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511653332, 2024-08-18T22:13:56.781 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7147" 2024-08-18T22:13:56.781 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.781 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.781 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.781 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4260751156, 2024-08-18T22:13:56.781 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511646501, 2024-08-18T22:13:56.781 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4130" 2024-08-18T22:13:56.781 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.781 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.781 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.781 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4263251640, 2024-08-18T22:13:56.781 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645866, 2024-08-18T22:13:56.781 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3849" 2024-08-18T22:13:56.781 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:13:56.782 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:13:56.782 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-08-18T22:13:56.782 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4264053403, 2024-08-18T22:13:56.782 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511645658, 2024-08-18T22:13:56.782 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3749" 2024-08-18T22:13:56.782 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:13:56.782 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-08-18T22:13:57.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:57 smithi183 ceph-mon[22097]: pgmap v525: 129 pgs: 129 active+clean; 145 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 706 op/s 2024-08-18T22:13:57.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:57 smithi123 ceph-mon[18462]: pgmap v525: 129 pgs: 129 active+clean; 145 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 706 op/s 2024-08-18T22:13:57.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:57 smithi130 ceph-mon[21698]: pgmap v525: 129 pgs: 129 active+clean; 145 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 706 op/s 2024-08-18T22:13:57.542 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.540+0000 7f31faffd640 1 -- 172.21.15.123:0/426596278 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ddeea32450 con 0x55ddeeadd190 2024-08-18T22:13:57.542 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.540+0000 7f31faffd640 10 client.16629 handle_command_reply: tid=0 2024-08-18T22:13:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.540+0000 7f3224e4f740 1 client.16629 shutdown 2024-08-18T22:13:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.541+0000 7f3224e4f740 1 -- 172.21.15.123:0/426596278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac7860 msgr2=0x55ddeead62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.541+0000 7f3224e4f740 1 --2- 172.21.15.123:0/426596278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac7860 0x55ddeead62a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f32140045b0 tx=0x7f3214009bf0 comp rx=0 tx=0).stop 2024-08-18T22:13:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.541+0000 7f3224e4f740 1 -- 172.21.15.123:0/426596278 shutdown_connections 2024-08-18T22:13:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.541+0000 7f3224e4f740 1 --2- 172.21.15.123:0/426596278 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ddeeadd190 0x55ddeeb4a490 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.541+0000 7f3224e4f740 1 --2- 172.21.15.123:0/426596278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ddeeacd230 0x55ddeead77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.541+0000 7f3224e4f740 1 --2- 172.21.15.123:0/426596278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ddeeac81a0 0x55ddeead67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.541+0000 7f3224e4f740 1 --2- 172.21.15.123:0/426596278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ddeeac7860 0x55ddeead62a0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.541+0000 7f31faffd640 0 client.16629 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:13:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.541+0000 7f3224e4f740 1 -- 172.21.15.123:0/426596278 >> 172.21.15.123:0/426596278 conn(0x55ddeeac2ed0 msgr2=0x55ddeead1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.541+0000 7f3224e4f740 1 -- 172.21.15.123:0/426596278 shutdown_connections 2024-08-18T22:13:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.541+0000 7f3224e4f740 1 -- 172.21.15.123:0/426596278 wait complete. 2024-08-18T22:13:57.544 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.541+0000 7f3224e4f740 20 client.16629 trim_cache size 0 max 16384 2024-08-18T22:13:57.544 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:13:57.544 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:13:57.544 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:13:57.544 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:13:57.545 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.542+0000 7f3220e2d640 1 -- 172.21.15.123:0/230601929 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f32040a2bc0 msgr2=0x7f32040a5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:57.545 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.542+0000 7f3220e2d640 1 --2- 172.21.15.123:0/230601929 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f32040a2bc0 0x7f32040a5080 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3210004650 tx=0x7f3210031540 comp rx=0 tx=0).stop 2024-08-18T22:13:57.545 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.542+0000 7f3220e2d640 1 -- 172.21.15.123:0/230601929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f321c108eb0 msgr2=0x7f321c07fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:13:57.545 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.542+0000 7f3220e2d640 1 --2- 172.21.15.123:0/230601929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f321c108eb0 0x7f321c07fb90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f320c00c970 tx=0x7f320c00ce30 comp rx=0 tx=0).stop 2024-08-18T22:13:57.545 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.542+0000 7f3220e2d640 1 -- 172.21.15.123:0/230601929 shutdown_connections 2024-08-18T22:13:57.545 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.542+0000 7f3220e2d640 1 --2- 172.21.15.123:0/230601929 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f32040a2bc0 0x7f32040a5080 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.542+0000 7f3220e2d640 1 --2- 172.21.15.123:0/230601929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f321c109870 0x7f321c1ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.542+0000 7f3220e2d640 1 --2- 172.21.15.123:0/230601929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f321c108eb0 0x7f321c07fb90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.542+0000 7f3220e2d640 1 --2- 172.21.15.123:0/230601929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f321c1081a0 0x7f321c07f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:13:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.542+0000 7f3220e2d640 1 -- 172.21.15.123:0/230601929 >> 172.21.15.123:0/230601929 conn(0x7f321c0771a0 msgr2=0x7f321c10c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:13:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.542+0000 7f3220e2d640 1 -- 172.21.15.123:0/230601929 shutdown_connections 2024-08-18T22:13:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:13:57.542+0000 7f3220e2d640 1 -- 172.21.15.123:0/230601929 wait complete. 2024-08-18T22:13:59.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:13:59 smithi183 ceph-mon[22097]: pgmap v526: 129 pgs: 129 active+clean; 152 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.4 MiB/s wr, 769 op/s 2024-08-18T22:13:59.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:13:59 smithi123 ceph-mon[18462]: pgmap v526: 129 pgs: 129 active+clean; 152 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.4 MiB/s wr, 769 op/s 2024-08-18T22:13:59.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:13:59 smithi130 ceph-mon[21698]: pgmap v526: 129 pgs: 129 active+clean; 152 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.4 MiB/s wr, 769 op/s 2024-08-18T22:13:59.575 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-18T22:13:59.849 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:14:01.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:01 smithi183 ceph-mon[22097]: pgmap v527: 129 pgs: 129 active+clean; 137 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.6 MiB/s wr, 927 op/s 2024-08-18T22:14:01.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:01 smithi123 ceph-mon[18462]: pgmap v527: 129 pgs: 129 active+clean; 137 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.6 MiB/s wr, 927 op/s 2024-08-18T22:14:01.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.826+0000 7f54d051b640 1 -- 172.21.15.123:0/2707084609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c8102c20 msgr2=0x7f54c810d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:01.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.826+0000 7f54d051b640 1 --2- 172.21.15.123:0/2707084609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c8102c20 0x7f54c810d770 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009ca0 tx=0x7f54c002a950 comp rx=0 tx=0).stop 2024-08-18T22:14:01.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.826+0000 7f54d051b640 1 -- 172.21.15.123:0/2707084609 shutdown_connections 2024-08-18T22:14:01.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.826+0000 7f54d051b640 1 --2- 172.21.15.123:0/2707084609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c8102c20 0x7f54c810d770 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.826+0000 7f54d051b640 1 --2- 172.21.15.123:0/2707084609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c81022a0 0x7f54c81026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.826+0000 7f54d051b640 1 --2- 172.21.15.123:0/2707084609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54c8100b50 0x7f54c8100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.826+0000 7f54d051b640 1 -- 172.21.15.123:0/2707084609 >> 172.21.15.123:0/2707084609 conn(0x7f54c80fc500 msgr2=0x7f54c80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:01.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.826+0000 7f54d051b640 1 -- 172.21.15.123:0/2707084609 shutdown_connections 2024-08-18T22:14:01.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.826+0000 7f54d051b640 1 -- 172.21.15.123:0/2707084609 wait complete. 2024-08-18T22:14:01.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.827+0000 7f54d051b640 1 Processor -- start 2024-08-18T22:14:01.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.827+0000 7f54d051b640 1 -- start start 2024-08-18T22:14:01.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.827+0000 7f54d051b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54c8100b50 0x7f54c80fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.827+0000 7f54d051b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c81022a0 0x7f54c80fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.827+0000 7f54d051b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c8102c20 0x7f54c80fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.827+0000 7f54d051b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f54c8110cb0 con 0x7f54c81022a0 2024-08-18T22:14:01.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.827+0000 7f54d051b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54c8110b30 con 0x7f54c8100b50 2024-08-18T22:14:01.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.827+0000 7f54d051b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f54c8110e30 con 0x7f54c8102c20 2024-08-18T22:14:01.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.827+0000 7f54cdab6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c81022a0 0x7f54c80fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.827+0000 7f54ceab8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c8102c20 0x7f54c80fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.827+0000 7f54cdab6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c81022a0 0x7f54c80fcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47884/0 (socket says 172.21.15.123:47884) 2024-08-18T22:14:01.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.827+0000 7f54cdab6640 1 -- 172.21.15.123:0/3610886174 learned_addr learned my addr 172.21.15.123:0/3610886174 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:01.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.828+0000 7f54ce2b7640 1 --2- 172.21.15.123:0/3610886174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54c8100b50 0x7f54c80fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.828+0000 7f54cdab6640 1 -- 172.21.15.123:0/3610886174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c8102c20 msgr2=0x7f54c80fd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:01.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.828+0000 7f54cdab6640 1 --2- 172.21.15.123:0/3610886174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c8102c20 0x7f54c80fd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.828+0000 7f54cdab6640 1 -- 172.21.15.123:0/3610886174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54c8100b50 msgr2=0x7f54c80fc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:01.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.828+0000 7f54cdab6640 1 --2- 172.21.15.123:0/3610886174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54c8100b50 0x7f54c80fc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.828+0000 7f54cdab6640 1 -- 172.21.15.123:0/3610886174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c81a66c0 con 0x7f54c81022a0 2024-08-18T22:14:01.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.828+0000 7f54ce2b7640 1 --2- 172.21.15.123:0/3610886174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54c8100b50 0x7f54c80fc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:14:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.828+0000 7f54cdab6640 1 --2- 172.21.15.123:0/3610886174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c81022a0 0x7f54c80fcef0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f54b800e9f0 tx=0x7f54b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.828+0000 7f54bf7fe640 1 -- 172.21.15.123:0/3610886174 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b800cd80 con 0x7f54c81022a0 2024-08-18T22:14:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.828+0000 7f54d051b640 1 -- 172.21.15.123:0/3610886174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c81a69b0 con 0x7f54c81022a0 2024-08-18T22:14:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.828+0000 7f54bf7fe640 1 -- 172.21.15.123:0/3610886174 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b8005500 con 0x7f54c81022a0 2024-08-18T22:14:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.828+0000 7f54bf7fe640 1 -- 172.21.15.123:0/3610886174 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b8010690 con 0x7f54c81022a0 2024-08-18T22:14:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.828+0000 7f54d051b640 1 -- 172.21.15.123:0/3610886174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c81a6ef0 con 0x7f54c81022a0 2024-08-18T22:14:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.830+0000 7f54bf7fe640 1 -- 172.21.15.123:0/3610886174 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f54b8010830 con 0x7f54c81022a0 2024-08-18T22:14:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.831+0000 7f54d2919740 1 Processor -- start 2024-08-18T22:14:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.831+0000 7f54d2919740 1 -- start start 2024-08-18T22:14:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.831+0000 7f54d2919740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110daff0 0x5647110db3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.831+0000 7f54d2919740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110db910 0x5647110e5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.831+0000 7f54d2919740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110e61d0 0x5647110e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.831+0000 7f54d2919740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x564711040a40 con 0x5647110db910 2024-08-18T22:14:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.831+0000 7f54d2919740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564710fd89d0 con 0x5647110daff0 2024-08-18T22:14:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.831+0000 7f54d2919740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56471103ca00 con 0x5647110e61d0 2024-08-18T22:14:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.831+0000 7f54ce2b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110db910 0x5647110e5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.831+0000 7f54ce2b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110db910 0x5647110e5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47894/0 (socket says 172.21.15.123:47894) 2024-08-18T22:14:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.831+0000 7f54ce2b7640 1 -- 172.21.15.123:0/392246480 learned_addr learned my addr 172.21.15.123:0/392246480 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.831+0000 7f54ceab8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110daff0 0x5647110db3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.831+0000 7f54cdab6640 1 --2- 172.21.15.123:0/392246480 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110e61d0 0x5647110e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.832+0000 7f54ce2b7640 1 -- 172.21.15.123:0/392246480 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110e61d0 msgr2=0x5647110e85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.832+0000 7f54ce2b7640 1 --2- 172.21.15.123:0/392246480 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110e61d0 0x5647110e85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.832+0000 7f54ce2b7640 1 -- 172.21.15.123:0/392246480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110daff0 msgr2=0x5647110db3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.832+0000 7f54ce2b7640 1 --2- 172.21.15.123:0/392246480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110daff0 0x5647110db3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.832+0000 7f54ce2b7640 1 -- 172.21.15.123:0/392246480 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564710fdf650 con 0x5647110db910 2024-08-18T22:14:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.832+0000 7f54bf7fe640 1 --2- 172.21.15.123:0/3610886174 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54b40a2b80 0x7f54b40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.832+0000 7f54ceab8640 1 --2- 172.21.15.123:0/3610886174 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54b40a2b80 0x7f54b40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.832+0000 7f54bf7fe640 1 -- 172.21.15.123:0/3610886174 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f54b80cf7d0 con 0x7f54c81022a0 2024-08-18T22:14:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.832+0000 7f54ce2b7640 1 --2- 172.21.15.123:0/392246480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110db910 0x5647110e5c90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f54c400bcc0 tx=0x7f54c400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f9af1694c7e6d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.832+0000 7f54bcff9640 1 -- 172.21.15.123:0/392246480 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4005020 con 0x5647110db910 2024-08-18T22:14:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.832+0000 7f54bcff9640 1 -- 172.21.15.123:0/392246480 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54c40047a0 con 0x5647110db910 2024-08-18T22:14:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.832+0000 7f54bcff9640 1 -- 172.21.15.123:0/392246480 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4011760 con 0x5647110db910 2024-08-18T22:14:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.833+0000 7f54d2919740 1 -- 172.21.15.123:0/392246480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110db910 msgr2=0x5647110e5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.833+0000 7f54ceab8640 1 --2- 172.21.15.123:0/3610886174 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54b40a2b80 0x7f54b40a5040 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f54c0005e30 tx=0x7f54c0005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.833+0000 7f54d2919740 1 --2- 172.21.15.123:0/392246480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110db910 0x5647110e5c90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f54c400bcc0 tx=0x7f54c400f730 comp rx=0 tx=0).stop 2024-08-18T22:14:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.833+0000 7f54d2919740 1 -- 172.21.15.123:0/392246480 shutdown_connections 2024-08-18T22:14:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.833+0000 7f54d2919740 1 --2- 172.21.15.123:0/392246480 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110e61d0 0x5647110e85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.833+0000 7f54d2919740 1 --2- 172.21.15.123:0/392246480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110db910 0x5647110e5c90 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.833+0000 7f54d2919740 1 --2- 172.21.15.123:0/392246480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110daff0 0x5647110db3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.833+0000 7f54d2919740 1 -- 172.21.15.123:0/392246480 >> 172.21.15.123:0/392246480 conn(0x5647110d7580 msgr2=0x5647110d7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:01.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.833+0000 7f54d2919740 1 -- 172.21.15.123:0/392246480 shutdown_connections 2024-08-18T22:14:01.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.833+0000 7f54d2919740 1 -- 172.21.15.123:0/392246480 wait complete. 2024-08-18T22:14:01.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54d2919740 1 -- start start 2024-08-18T22:14:01.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54d2919740 1 Processor -- start 2024-08-18T22:14:01.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54d2919740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110daff0 0x5647110e5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54d2919740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110db910 0x5647110e2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54d2919740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110e61d0 0x5647110e3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54d2919740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5647110e8df0 con 0x5647110e61d0 2024-08-18T22:14:01.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54d2919740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564710ffbb20 con 0x5647110db910 2024-08-18T22:14:01.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54d2919740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5647110e8f70 con 0x5647110daff0 2024-08-18T22:14:01.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54d2919740 10 client.0 _ll_register_callbacks cb 0x564710ff9bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:14:01.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54ceab8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110e61d0 0x5647110e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54ce2b7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110daff0 0x5647110e5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54ceab8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110e61d0 0x5647110e3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47906/0 (socket says 172.21.15.123:47906) 2024-08-18T22:14:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54ceab8640 1 -- 172.21.15.123:0/310660012 learned_addr learned my addr 172.21.15.123:0/310660012 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54cdab6640 1 --2- 172.21.15.123:0/310660012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110db910 0x5647110e2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54ceab8640 1 -- 172.21.15.123:0/310660012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110daff0 msgr2=0x5647110e5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54ceab8640 1 --2- 172.21.15.123:0/310660012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110daff0 0x5647110e5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54ceab8640 1 -- 172.21.15.123:0/310660012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110db910 msgr2=0x5647110e2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54ceab8640 1 --2- 172.21.15.123:0/310660012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110db910 0x5647110e2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54ceab8640 1 -- 172.21.15.123:0/310660012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564710db23c0 con 0x5647110e61d0 2024-08-18T22:14:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.834+0000 7f54cdab6640 1 --2- 172.21.15.123:0/310660012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110db910 0x5647110e2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:14:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.835+0000 7f54ceab8640 1 --2- 172.21.15.123:0/310660012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110e61d0 0x5647110e3770 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009ca0 tx=0x7f54c00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c4c676267215e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.835+0000 7f54b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:14:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.835+0000 7f54b1ffb640 1 -- 172.21.15.123:0/310660012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c0055060 con 0x5647110e61d0 2024-08-18T22:14:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.835+0000 7f54b1ffb640 1 -- 172.21.15.123:0/310660012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f54c0003fc0 con 0x5647110e61d0 2024-08-18T22:14:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.835+0000 7f54d2919740 1 -- 172.21.15.123:0/310660012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54c40047a0 con 0x5647110e61d0 2024-08-18T22:14:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.835+0000 7f54b1ffb640 1 -- 172.21.15.123:0/310660012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f54c005c050 con 0x5647110e61d0 2024-08-18T22:14:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.835+0000 7f54d2919740 10 client.16659 fetch_fsmap learned FSMap version 32 2024-08-18T22:14:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.835+0000 7f54d2919740 1 -- 172.21.15.123:0/310660012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5647110f4950 con 0x5647110e61d0 2024-08-18T22:14:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.835+0000 7f54b1ffb640 1 -- 172.21.15.123:0/310660012 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54c40047a0 con 0x5647110e61d0 2024-08-18T22:14:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.835+0000 7f54b1ffb640 1 -- 172.21.15.123:0/310660012 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f54c0030a10 con 0x5647110e61d0 2024-08-18T22:14:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.835+0000 7f54d2919740 10 client.16659 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:14:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.835+0000 7f54d2919740 10 client.16659 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:14:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.835+0000 7f54d2919740 20 client.16659 populate_metadata read hostname 'smithi123' 2024-08-18T22:14:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.836+0000 7f54d2919740 1 --2- 172.21.15.123:0/310660012 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5647110f5e10 0x5647110f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.836+0000 7f54d2919740 4 client.16659 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:14:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.836+0000 7f54d2919740 1 -- 172.21.15.123:0/310660012 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56471104dfb0 con 0x5647110f5e10 2024-08-18T22:14:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.836+0000 7f54ce2b7640 1 --2- 172.21.15.123:0/310660012 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5647110f5e10 0x5647110f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.836+0000 7f54b1ffb640 10 client.16659 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.836+0000 7f54ce2b7640 1 --2- 172.21.15.123:0/310660012 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5647110f5e10 0x5647110f82b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a6cad06dff64e6f server_cookie=20fb74da357bfa25 in_seq=0 out_seq=0 2024-08-18T22:14:01.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.840+0000 7f54b1ffb640 1 -- 172.21.15.123:0/310660012 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56471104dfb0 con 0x5647110f5e10 2024-08-18T22:14:01.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.840+0000 7f54b1ffb640 10 client.16659 handle_command_reply: tid=0 2024-08-18T22:14:01.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.840+0000 7f54d2919740 1 client.16659 shutdown 2024-08-18T22:14:01.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.840+0000 7f54d2919740 1 -- 172.21.15.123:0/310660012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110e61d0 msgr2=0x5647110e3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:01.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.840+0000 7f54d2919740 1 --2- 172.21.15.123:0/310660012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110e61d0 0x5647110e3770 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009ca0 tx=0x7f54c00095c0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.840+0000 7f54d2919740 1 -- 172.21.15.123:0/310660012 shutdown_connections 2024-08-18T22:14:01.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.840+0000 7f54d2919740 1 --2- 172.21.15.123:0/310660012 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5647110f5e10 0x5647110f82b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.840+0000 7f54d2919740 1 --2- 172.21.15.123:0/310660012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110e61d0 0x5647110e3770 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.840+0000 7f54d2919740 1 --2- 172.21.15.123:0/310660012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110db910 0x5647110e2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.840+0000 7f54b1ffb640 0 client.16659 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:01.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.840+0000 7f54d2919740 1 --2- 172.21.15.123:0/310660012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110daff0 0x5647110e5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.840+0000 7f54d2919740 1 -- 172.21.15.123:0/310660012 >> 172.21.15.123:0/310660012 conn(0x5647110d7580 msgr2=0x5647110dd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:01.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.840+0000 7f54d2919740 1 -- 172.21.15.123:0/310660012 shutdown_connections 2024-08-18T22:14:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.840+0000 7f54d2919740 1 -- 172.21.15.123:0/310660012 wait complete. 2024-08-18T22:14:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.840+0000 7f54d2919740 20 client.16659 trim_cache size 0 max 16384 2024-08-18T22:14:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.853+0000 7f54d2919740 1 Processor -- start 2024-08-18T22:14:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.853+0000 7f54d2919740 1 -- start start 2024-08-18T22:14:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.853+0000 7f54d2919740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110daff0 0x5647110de2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.853+0000 7f54d2919740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110db910 0x5647110de7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.853+0000 7f54d2919740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110e61d0 0x5647110e18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.853+0000 7f54d2919740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f54c81b35c0 con 0x5647110daff0 2024-08-18T22:14:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.853+0000 7f54d2919740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54c81b0dd0 con 0x5647110e61d0 2024-08-18T22:14:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.853+0000 7f54d2919740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f54c81aec20 con 0x5647110db910 2024-08-18T22:14:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.853+0000 7f54ce2b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110daff0 0x5647110de2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.853+0000 7f54ce2b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110daff0 0x5647110de2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47920/0 (socket says 172.21.15.123:47920) 2024-08-18T22:14:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.853+0000 7f54ce2b7640 1 -- 172.21.15.123:0/1893862359 learned_addr learned my addr 172.21.15.123:0/1893862359 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.853+0000 7f54cdab6640 1 --2- 172.21.15.123:0/1893862359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110db910 0x5647110de7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.853+0000 7f54ceab8640 1 --2- 172.21.15.123:0/1893862359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110e61d0 0x5647110e18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.854+0000 7f54ce2b7640 1 -- 172.21.15.123:0/1893862359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110db910 msgr2=0x5647110de7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.854+0000 7f54ce2b7640 1 --2- 172.21.15.123:0/1893862359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110db910 0x5647110de7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.854+0000 7f54ce2b7640 1 -- 172.21.15.123:0/1893862359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110e61d0 msgr2=0x5647110e18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.854+0000 7f54ce2b7640 1 --2- 172.21.15.123:0/1893862359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110e61d0 0x5647110e18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.854+0000 7f54ce2b7640 1 -- 172.21.15.123:0/1893862359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647110d5b30 con 0x5647110daff0 2024-08-18T22:14:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.854+0000 7f54ce2b7640 1 --2- 172.21.15.123:0/1893862359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110daff0 0x5647110de2b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f54c400bcc0 tx=0x7f54c400b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc7bf42e69dfb36 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.854+0000 7f54b3fff640 1 -- 172.21.15.123:0/1893862359 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c402c020 con 0x5647110daff0 2024-08-18T22:14:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.854+0000 7f54b3fff640 1 -- 172.21.15.123:0/1893862359 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54c40035f0 con 0x5647110daff0 2024-08-18T22:14:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.854+0000 7f54b3fff640 1 -- 172.21.15.123:0/1893862359 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c40055a0 con 0x5647110daff0 2024-08-18T22:14:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.855+0000 7f54d2919740 1 -- 172.21.15.123:0/1893862359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110daff0 msgr2=0x5647110de2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.855+0000 7f54d2919740 1 --2- 172.21.15.123:0/1893862359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110daff0 0x5647110de2b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f54c400bcc0 tx=0x7f54c400b5e0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.855+0000 7f54d2919740 1 -- 172.21.15.123:0/1893862359 shutdown_connections 2024-08-18T22:14:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.855+0000 7f54d2919740 1 --2- 172.21.15.123:0/1893862359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110e61d0 0x5647110e18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.855+0000 7f54d2919740 1 --2- 172.21.15.123:0/1893862359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110db910 0x5647110de7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.855+0000 7f54d2919740 1 --2- 172.21.15.123:0/1893862359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110daff0 0x5647110de2b0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.855+0000 7f54d2919740 1 -- 172.21.15.123:0/1893862359 >> 172.21.15.123:0/1893862359 conn(0x5647110d7580 msgr2=0x5647110d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:01.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.855+0000 7f54d2919740 1 -- 172.21.15.123:0/1893862359 shutdown_connections 2024-08-18T22:14:01.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.855+0000 7f54d2919740 1 -- 172.21.15.123:0/1893862359 wait complete. 2024-08-18T22:14:01.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.855+0000 7f54d2919740 1 -- start start 2024-08-18T22:14:01.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.855+0000 7f54d2919740 1 Processor -- start 2024-08-18T22:14:01.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54d2919740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110daff0 0x5647110e6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54d2919740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110db910 0x5647110e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54d2919740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110e61d0 0x5647110ed1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54d2919740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f54c81af290 con 0x5647110daff0 2024-08-18T22:14:01.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54d2919740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54c81b0700 con 0x5647110db910 2024-08-18T22:14:01.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54d2919740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f54c81af960 con 0x5647110e61d0 2024-08-18T22:14:01.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54ce2b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110daff0 0x5647110e6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54d2919740 10 client.0 _ll_register_callbacks cb 0x7f54c0009380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:14:01.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54cdab6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110db910 0x5647110e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54cdab6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110db910 0x5647110e6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:49946/0 (socket says 172.21.15.123:49946) 2024-08-18T22:14:01.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54cdab6640 1 -- 172.21.15.123:0/3402865085 learned_addr learned my addr 172.21.15.123:0/3402865085 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:01.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54ce2b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110daff0 0x5647110e6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47934/0 (socket says 172.21.15.123:47934) 2024-08-18T22:14:01.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54ceab8640 1 --2- 172.21.15.123:0/3402865085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110e61d0 0x5647110ed1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54cdab6640 1 -- 172.21.15.123:0/3402865085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110e61d0 msgr2=0x5647110ed1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:01.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54cdab6640 1 --2- 172.21.15.123:0/3402865085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110e61d0 0x5647110ed1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54cdab6640 1 -- 172.21.15.123:0/3402865085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110daff0 msgr2=0x5647110e6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:01.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54cdab6640 1 --2- 172.21.15.123:0/3402865085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110daff0 0x5647110e6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54cdab6640 1 -- 172.21.15.123:0/3402865085 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647110e7770 con 0x5647110db910 2024-08-18T22:14:01.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54ce2b7640 1 --2- 172.21.15.123:0/3402865085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110daff0 0x5647110e6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:14:01.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54cdab6640 1 --2- 172.21.15.123:0/3402865085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110db910 0x5647110e6eb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f54b809bb60 tx=0x7f54b8004ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=539958d422c985a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:01.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.856+0000 7f54b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:14:01.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.857+0000 7f54b1ffb640 1 -- 172.21.15.123:0/3402865085 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b809b9a0 con 0x5647110db910 2024-08-18T22:14:01.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.857+0000 7f54d2919740 1 -- 172.21.15.123:0/3402865085 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54c40035f0 con 0x5647110db910 2024-08-18T22:14:01.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.857+0000 7f54b1ffb640 1 -- 172.21.15.123:0/3402865085 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f54b8010b20 con 0x5647110db910 2024-08-18T22:14:01.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.857+0000 7f54b1ffb640 1 -- 172.21.15.123:0/3402865085 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f54b809b7c0 con 0x5647110db910 2024-08-18T22:14:01.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.857+0000 7f54d2919740 10 client.25973 fetch_fsmap learned FSMap version 32 2024-08-18T22:14:01.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.857+0000 7f54d2919740 1 -- 172.21.15.123:0/3402865085 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5647110ee8d0 con 0x5647110db910 2024-08-18T22:14:01.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.858+0000 7f54b1ffb640 1 -- 172.21.15.123:0/3402865085 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54c40035f0 con 0x5647110db910 2024-08-18T22:14:01.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.858+0000 7f54b1ffb640 1 -- 172.21.15.123:0/3402865085 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f54b809ad20 con 0x5647110db910 2024-08-18T22:14:01.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.858+0000 7f54d2919740 10 client.25973 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:14:01.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.858+0000 7f54d2919740 10 client.25973 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-18T22:14:01.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.858+0000 7f54d2919740 20 client.25973 populate_metadata read hostname 'smithi123' 2024-08-18T22:14:01.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.858+0000 7f54d2919740 1 --2- 172.21.15.123:0/3402865085 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x564711160b50 0x564711162f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:01.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.858+0000 7f54d2919740 4 client.25973 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:14:01.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.858+0000 7f54d2919740 1 -- 172.21.15.123:0/3402865085 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5647110484c0 con 0x564711160b50 2024-08-18T22:14:01.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.858+0000 7f54ce2b7640 1 --2- 172.21.15.123:0/3402865085 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x564711160b50 0x564711162f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:01.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.858+0000 7f54b1ffb640 10 client.25973 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:01.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.858+0000 7f54ce2b7640 1 --2- 172.21.15.123:0/3402865085 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x564711160b50 0x564711162f70 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=498502cfd0e4507d server_cookie=e9221d4b58dd99f3 in_seq=0 out_seq=0 2024-08-18T22:14:01.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.861+0000 7f54b1ffb640 1 -- 172.21.15.123:0/3402865085 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5647110484c0 con 0x564711160b50 2024-08-18T22:14:01.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.861+0000 7f54b1ffb640 10 client.25973 handle_command_reply: tid=0 2024-08-18T22:14:01.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.861+0000 7f54d2919740 1 client.25973 shutdown 2024-08-18T22:14:01.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.861+0000 7f54d2919740 1 -- 172.21.15.123:0/3402865085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110db910 msgr2=0x5647110e6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:01.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.861+0000 7f54d2919740 1 --2- 172.21.15.123:0/3402865085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110db910 0x5647110e6eb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f54b809bb60 tx=0x7f54b8004ba0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.861+0000 7f54d2919740 1 -- 172.21.15.123:0/3402865085 shutdown_connections 2024-08-18T22:14:01.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.861+0000 7f54d2919740 1 --2- 172.21.15.123:0/3402865085 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x564711160b50 0x564711162f70 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.861+0000 7f54b1ffb640 0 client.25973 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:01.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.861+0000 7f54d2919740 1 --2- 172.21.15.123:0/3402865085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5647110e61d0 0x5647110ed1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.861+0000 7f54d2919740 1 --2- 172.21.15.123:0/3402865085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647110db910 0x5647110e6eb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.861+0000 7f54d2919740 1 --2- 172.21.15.123:0/3402865085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647110daff0 0x5647110e6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.861+0000 7f54d2919740 1 -- 172.21.15.123:0/3402865085 >> 172.21.15.123:0/3402865085 conn(0x5647110d7580 msgr2=0x5647110de2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:01.528 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-08-18T22:14:01.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.861+0000 7f54d2919740 1 -- 172.21.15.123:0/3402865085 shutdown_connections 2024-08-18T22:14:01.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.861+0000 7f54d2919740 1 -- 172.21.15.123:0/3402865085 wait complete. 2024-08-18T22:14:01.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.862+0000 7f54d2919740 20 client.25973 trim_cache size 0 max 16384 2024-08-18T22:14:01.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.865+0000 7f54d051b640 1 -- 172.21.15.123:0/3610886174 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54b40a2b80 msgr2=0x7f54b40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:01.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.865+0000 7f54d051b640 1 --2- 172.21.15.123:0/3610886174 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54b40a2b80 0x7f54b40a5040 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f54c0005e30 tx=0x7f54c0005c50 comp rx=0 tx=0).stop 2024-08-18T22:14:01.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.865+0000 7f54d051b640 1 -- 172.21.15.123:0/3610886174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c81022a0 msgr2=0x7f54c80fcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:01.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.865+0000 7f54d051b640 1 --2- 172.21.15.123:0/3610886174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c81022a0 0x7f54c80fcef0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f54b800e9f0 tx=0x7f54b800edf0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.865+0000 7f54d051b640 1 -- 172.21.15.123:0/3610886174 shutdown_connections 2024-08-18T22:14:01.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.865+0000 7f54d051b640 1 --2- 172.21.15.123:0/3610886174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c8102c20 0x7f54c80fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.865+0000 7f54d051b640 1 --2- 172.21.15.123:0/3610886174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c81022a0 0x7f54c80fcef0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.865+0000 7f54d051b640 1 --2- 172.21.15.123:0/3610886174 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f54b40a2b80 0x7f54b40a5040 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.865+0000 7f54d051b640 1 --2- 172.21.15.123:0/3610886174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54c8100b50 0x7f54c80fc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:01.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.865+0000 7f54d051b640 1 -- 172.21.15.123:0/3610886174 >> 172.21.15.123:0/3610886174 conn(0x7f54c80fc500 msgr2=0x7f54c8069f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:01.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.866+0000 7f54d051b640 1 -- 172.21.15.123:0/3610886174 shutdown_connections 2024-08-18T22:14:01.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:00.867+0000 7f54d051b640 1 -- 172.21.15.123:0/3610886174 wait complete. 2024-08-18T22:14:01.529 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:01 smithi130 ceph-mon[21698]: pgmap v527: 129 pgs: 129 active+clean; 137 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.6 MiB/s wr, 927 op/s 2024-08-18T22:14:03.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:03 smithi183 ceph-mon[22097]: pgmap v528: 129 pgs: 129 active+clean; 142 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 915 op/s 2024-08-18T22:14:03.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:03 smithi123 ceph-mon[18462]: pgmap v528: 129 pgs: 129 active+clean; 142 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 915 op/s 2024-08-18T22:14:03.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:03 smithi130 ceph-mon[21698]: pgmap v528: 129 pgs: 129 active+clean; 142 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 915 op/s 2024-08-18T22:14:04.203 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 1930011, 'ino': 1099511648591, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5066'}, {'damage_type': 'backtrace', 'id': 25015563, 'ino': 1099511645682, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3761'}, {'damage_type': 'backtrace', 'id': 39866975, 'ino': 1099511650871, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6063'}, {'damage_type': 'backtrace', 'id': 84267719, 'ino': 1099511651946, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6533'}, {'damage_type': 'backtrace', 'id': 169391740, 'ino': 1099511653306, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7134'}, {'damage_type': 'backtrace', 'id': 214628590, 'ino': 1099511652153, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6620'}, {'damage_type': 'backtrace', 'id': 230182084, 'ino': 1099511648452, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5001'}, {'damage_type': 'backtrace', 'id': 249109358, 'ino': 1099511649496, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5453'}, {'damage_type': 'backtrace', 'id': 259677478, 'ino': 1099511652541, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6798'}, {'damage_type': 'backtrace', 'id': 292514121, 'ino': 1099511649878, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5625'}, {'damage_type': 'backtrace', 'id': 325889740, 'ino': 1099511648350, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4957'}, {'damage_type': 'backtrace', 'id': 350011419, 'ino': 1099511651408, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6296'}, {'damage_type': 'backtrace', 'id': 364370574, 'ino': 1099511653659, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7302'}, {'damage_type': 'backtrace', 'id': 468695823, 'ino': 1099511647100, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4406'}, {'damage_type': 'backtrace', 'id': 517824446, 'ino': 1099511651758, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6449'}, {'damage_type': 'backtrace', 'id': 590625099, 'ino': 1099511651353, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6271'}, {'damage_type': 'backtrace', 'id': 615946772, 'ino': 1099511651358, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6273'}, {'damage_type': 'backtrace', 'id': 626641147, 'ino': 1099511651399, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6292'}, {'damage_type': 'backtrace', 'id': 636164133, 'ino': 1099511647607, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4635'}, {'damage_type': 'backtrace', 'id': 676053780, 'ino': 1099511645772, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3805'}, {'damage_type': 'backtrace', 'id': 688599488, 'ino': 1099511649717, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5552'}, {'damage_type': 'backtrace', 'id': 765347609, 'ino': 1099511650595, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5944'}, {'damage_type': 'backtrace', 'id': 766715121, 'ino': 1099511648682, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5106'}, {'damage_type': 'backtrace', 'id': 771006116, 'ino': 1099511646592, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4168'}, {'damage_type': 'backtrace', 'id': 779470914, 'ino': 1099511644844, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3563'}, {'damage_type': 'backtrace', 'id': 897726853, 'ino': 1099511651438, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6309'}, {'damage_type': 'backtrace', 'id': 1002409763, 'ino': 1099511651501, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6336'}, {'damage_type': 'backtrace', 'id': 1015296738, 'ino': 1099511650463, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5888'}, {'damage_type': 'backtrace', 'id': 1049774969, 'ino': 1099511646649, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4193'}, {'damage_type': 'backtrace', 'id': 1085511211, 'ino': 1099511645583, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3716'}, {'damage_type': 'backtrace', 'id': 1094292744, 'ino': 1099511646726, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4227'}, {'damage_type': 'backtrace', 'id': 1106079388, 'ino': 1099511648513, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5028'}, {'damage_type': 'backtrace', 'id': 1114382331, 'ino': 1099511646712, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4221'}, {'damage_type': 'backtrace', 'id': 1121055407, 'ino': 1099511653401, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7182'}, {'damage_type': 'backtrace', 'id': 1134847022, 'ino': 1099511653183, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7069'}, {'damage_type': 'backtrace', 'id': 1164596628, 'ino': 1099511651070, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6150'}, {'damage_type': 'backtrace', 'id': 1188314693, 'ino': 1099511652535, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6795'}, {'damage_type': 'backtrace', 'id': 1200762471, 'ino': 1099511646960, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4338'}, {'damage_type': 'backtrace', 'id': 1208584953, 'ino': 1099511646189, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3992'}, {'damage_type': 'backtrace', 'id': 1215039169, 'ino': 1099511645506, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3692'}, {'damage_type': 'backtrace', 'id': 1218513321, 'ino': 1099511645906, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3868'}, {'damage_type': 'backtrace', 'id': 1219787304, 'ino': 1099511648933, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5218'}, {'damage_type': 'backtrace', 'id': 1236764490, 'ino': 1099511650846, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6052'}, {'damage_type': 'backtrace', 'id': 1256194314, 'ino': 1099511652990, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6974'}, {'damage_type': 'backtrace', 'id': 1263114075, 'ino': 1099511645496, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3689'}, {'damage_type': 'backtrace', 'id': 1270991109, 'ino': 1099511651170, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6195'}, {'damage_type': 'backtrace', 'id': 1286123357, 'ino': 1099511652729, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6855'}, {'damage_type': 'backtrace', 'id': 1306787357, 'ino': 1099511652313, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6688'}, {'damage_type': 'backtrace', 'id': 1336481591, 'ino': 1099511650309, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5811'}, {'damage_type': 'backtrace', 'id': 1350412489, 'ino': 1099511651394, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6290'}, {'damage_type': 'backtrace', 'id': 1399468726, 'ino': 1099511647797, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4722'}, {'damage_type': 'backtrace', 'id': 1441575396, 'ino': 1099511644805, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3556'}, {'damage_type': 'backtrace', 'id': 1458767595, 'ino': 1099511645206, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3633'}, {'damage_type': 'backtrace', 'id': 1465997282, 'ino': 1099511647729, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4688'}, {'damage_type': 'backtrace', 'id': 1502324869, 'ino': 1099511648208, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4896'}, {'damage_type': 'backtrace', 'id': 1526681733, 'ino': 1099511648618, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5078'}, {'damage_type': 'backtrace', 'id': 1564956134, 'ino': 1099511648828, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5172'}, {'damage_type': 'backtrace', 'id': 1572283949, 'ino': 1099511649098, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5286'}, {'damage_type': 'backtrace', 'id': 1588080433, 'ino': 1099511649328, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5384'}, {'damage_type': 'backtrace', 'id': 1638391795, 'ino': 1099511647147, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4428'}, {'damage_type': 'backtrace', 'id': 1708313447, 'ino': 1099511651550, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6359'}, {'damage_type': 'backtrace', 'id': 1721828736, 'ino': 1099511652135, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6612'}, {'damage_type': 'backtrace', 'id': 1753483954, 'ino': 1099511645622, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3731'}, {'damage_type': 'backtrace', 'id': 1810321612, 'ino': 1099511650783, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6024'}, {'damage_type': 'backtrace', 'id': 1830180586, 'ino': 1099511646049, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3931'}, {'damage_type': 'backtrace', 'id': 1840658592, 'ino': 1099511650898, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6076'}, {'damage_type': 'backtrace', 'id': 1851011556, 'ino': 1099511651031, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6134'}, {'damage_type': 'backtrace', 'id': 1855182429, 'ino': 1099511651860, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6495'}, {'damage_type': 'backtrace', 'id': 1899934329, 'ino': 1099511647497, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4585'}, {'damage_type': 'backtrace', 'id': 1902199010, 'ino': 1099511648357, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4960'}, {'damage_type': 'backtrace', 'id': 1908372131, 'ino': 1099511650742, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6006'}, {'damage_type': 'backtrace', 'id': 1931042699, 'ino': 1099511653336, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7149'}, {'damage_type': 'backtrace', 'id': 1996595375, 'ino': 1099511646611, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4176'}, {'damage_type': 'backtrace', 'id': 2082391365, 'ino': 1099511644633, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3521'}, {'damage_type': 'backtrace', 'id': 2090801881, 'ino': 1099511651154, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6188'}, {'damage_type': 'backtrace', 'id': 2097372823, 'ino': 1099511649607, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5503'}, {'damage_type': 'backtrace', 'id': 2155749878, 'ino': 1099511644023, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3399'}, {'damage_type': 'backtrace', 'id': 2185473585, 'ino': 1099511644223, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3439'}, {'damage_type': 'backtrace', 'id': 2203665665, 'ino': 1099511648046, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4826'}, {'damage_type': 'backtrace', 'id': 2207362047, 'ino': 1099511647974, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4795'}, {'damage_type': 'backtrace', 'id': 2211288232, 'ino': 1099511645286, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3649'}, {'damage_type': 'backtrace', 'id': 2231027911, 'ino': 1099511649222, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5337'}, {'damage_type': 'backtrace', 'id': 2296884512, 'ino': 1099511646186, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3991'}, {'damage_type': 'backtrace', 'id': 2317729372, 'ino': 1099511647428, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4555'}, {'damage_type': 'backtrace', 'id': 2321494120, 'ino': 1099511649120, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5294'}, {'damage_type': 'backtrace', 'id': 2337797818, 'ino': 1099511650082, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5715'}, {'damage_type': 'backtrace', 'id': 2342200341, 'ino': 1099511651139, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6182'}, {'damage_type': 'backtrace', 'id': 2356011924, 'ino': 1099511649106, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5289'}, {'damage_type': 'backtrace', 'id': 2363070028, 'ino': 1099511653794, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7329'}, {'damage_type': 'backtrace', 'id': 2372569362, 'ino': 1099511648571, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5057'}, {'damage_type': 'backtrace', 'id': 2417996271, 'ino': 1099511651553, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6360'}, {'damage_type': 'backtrace', 'id': 2435978550, 'ino': 1099511650317, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5815'}, {'damage_type': 'backtrace', 'id': 2460195455, 'ino': 1099511647547, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4608'}, {'damage_type': 'backtrace', 'id': 2465211436, 'ino': 1099511653191, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7073'}, {'damage_type': 'backtrace', 'id': 2479945346, 'ino': 1099511653225, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7091'}, {'damage_type': 'backtrace', 'id': 2501493011, 'ino': 1099511651514, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6342'}, {'damage_type': 'backtrace', 'id': 2558784919, 'ino': 1099511652966, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6962'}, {'damage_type': 'backtrace', 'id': 2571264810, 'ino': 1099511652268, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6669'}, {'damage_type': 'backtrace', 'id': 2574535914, 'ino': 1099511653277, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7116'}, {'damage_type': 'backtrace', 'id': 2609597693, 'ino': 1099511644013, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3397'}, {'damage_type': 'backtrace', 'id': 2657495913, 'ino': 1099511647231, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4466'}, {'damage_type': 'backtrace', 'id': 2673340537, 'ino': 1099511647378, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4533'}, {'damage_type': 'backtrace', 'id': 2678702850, 'ino': 1099511652721, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6851'}, {'damage_type': 'backtrace', 'id': 2684018416, 'ino': 1099511650289, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5802'}, {'damage_type': 'backtrace', 'id': 2702423141, 'ino': 1099511644338, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3462'}, {'damage_type': 'backtrace', 'id': 2702742436, 'ino': 1099511649960, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5660'}, {'damage_type': 'backtrace', 'id': 2708603159, 'ino': 1099511650561, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5930'}, {'damage_type': 'backtrace', 'id': 2734797771, 'ino': 1099511645156, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3623'}, {'damage_type': 'backtrace', 'id': 2739837752, 'ino': 1099511649383, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5406'}, {'damage_type': 'backtrace', 'id': 2756934906, 'ino': 1099511644293, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3453'}, {'damage_type': 'backtrace', 'id': 2771857949, 'ino': 1099511651464, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6320'}, {'damage_type': 'backtrace', 'id': 2778407071, 'ino': 1099511652707, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6844'}, {'damage_type': 'backtrace', 'id': 2858477436, 'ino': 1099511646986, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4351'}, {'damage_type': 'backtrace', 'id': 2860591141, 'ino': 1099511647831, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4736'}, {'damage_type': 'backtrace', 'id': 2877208814, 'ino': 1099511650538, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5921'}, {'damage_type': 'backtrace', 'id': 2901364163, 'ino': 1099511653308, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7135'}, {'damage_type': 'backtrace', 'id': 2913702959, 'ino': 1099511649018, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5252'}, {'damage_type': 'backtrace', 'id': 2939294987, 'ino': 1099511653615, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7279'}, {'damage_type': 'backtrace', 'id': 2942923006, 'ino': 1099511652004, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6559'}, {'damage_type': 'backtrace', 'id': 2952008472, 'ino': 1099511648539, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5041'}, {'damage_type': 'backtrace', 'id': 2972605674, 'ino': 1099511650771, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6019'}, {'damage_type': 'backtrace', 'id': 2975270942, 'ino': 1099511651144, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6184'}, {'damage_type': 'backtrace', 'id': 3016380501, 'ino': 1099511648922, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5213'}, {'damage_type': 'backtrace', 'id': 3017049908, 'ino': 1099511645301, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3652'}, {'damage_type': 'backtrace', 'id': 3049979503, 'ino': 1099511646503, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4131'}, {'damage_type': 'backtrace', 'id': 3101534044, 'ino': 1099511648092, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4847'}, {'damage_type': 'backtrace', 'id': 3110404174, 'ino': 1099511648766, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5145'}, {'damage_type': 'backtrace', 'id': 3121410109, 'ino': 1099511649789, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5584'}, {'damage_type': 'backtrace', 'id': 3121999158, 'ino': 1099511653071, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7015'}, {'damage_type': 'backtrace', 'id': 3156476423, 'ino': 1099511650725, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5998'}, {'damage_type': 'backtrace', 'id': 3179209989, 'ino': 1099511653354, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7158'}, {'damage_type': 'backtrace', 'id': 3197460725, 'ino': 1099511645913, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3871'}, {'damage_type': 'backtrace', 'id': 3222659242, 'ino': 1099511645778, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3808'}, {'damage_type': 'backtrace', 'id': 3334612962, 'ino': 1099511649549, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5478'}, {'damage_type': 'backtrace', 'id': 3342831759, 'ino': 1099511646537, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4146'}, {'damage_type': 'backtrace', 'id': 3368316489, 'ino': 1099511645690, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3765'}, {'damage_type': 'backtrace', 'id': 3385924666, 'ino': 1099511645291, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3650'}, {'damage_type': 'backtrace', 'id': 3393846136, 'ino': 1099511648928, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5216'}, {'damage_type': 'backtrace', 'id': 3417036351, 'ino': 1099511645792, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3815'}, {'damage_type': 'backtrace', 'id': 3418290914, 'ino': 1099511649684, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5537'}, {'damage_type': 'backtrace', 'id': 3420503121, 'ino': 1099511649226, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5339'}, {'damage_type': 'backtrace', 'id': 3436293449, 'ino': 1099511646834, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4275'}, {'damage_type': 'backtrace', 'id': 3460701909, 'ino': 1099511650708, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5991'}, {'damage_type': 'backtrace', 'id': 3463157380, 'ino': 1099511645857, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3845'}, {'damage_type': 'backtrace', 'id': 3487295297, 'ino': 1099511650222, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5773'}, {'damage_type': 'backtrace', 'id': 3532120841, 'ino': 1099511649600, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5500'}, {'damage_type': 'backtrace', 'id': 3539277450, 'ino': 1099511652923, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6941'}, {'damage_type': 'backtrace', 'id': 3546922754, 'ino': 1099511646840, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4278'}, {'damage_type': 'backtrace', 'id': 3548073740, 'ino': 1099511653432, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7198'}, {'damage_type': 'backtrace', 'id': 3559771058, 'ino': 1099511648858, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5184'}, {'damage_type': 'backtrace', 'id': 3592997493, 'ino': 1099511652543, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6799'}, {'damage_type': 'backtrace', 'id': 3628331763, 'ino': 1099511650242, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5781'}, {'damage_type': 'backtrace', 'id': 3659785251, 'ino': 1099511648886, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5196'}, {'damage_type': 'backtrace', 'id': 3671529849, 'ino': 1099511651943, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6532'}, {'damage_type': 'backtrace', 'id': 3714157112, 'ino': 1099511644343, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3463'}, {'damage_type': 'backtrace', 'id': 3769968538, 'ino': 1099511653549, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7261'}, {'damage_type': 'backtrace', 'id': 3805687436, 'ino': 1099511650373, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5843'}, {'damage_type': 'backtrace', 'id': 3832180316, 'ino': 1099511649393, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5410'}, {'damage_type': 'backtrace', 'id': 3890990587, 'ino': 1099511650970, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6107'}, {'damage_type': 'backtrace', 'id': 3894775242, 'ino': 1099511646221, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4007'}, {'damage_type': 'backtrace', 'id': 3902791252, 'ino': 1099511652799, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6879'}, {'damage_type': 'backtrace', 'id': 3932230712, 'ino': 1099511649251, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5351'}, {'damage_type': 'backtrace', 'id': 3985643683, 'ino': 1099511652357, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6707'}, {'damage_type': 'backtrace', 'id': 3993791734, 'ino': 1099511649500, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5455'}, {'damage_type': 'backtrace', 'id': 4034990298, 'ino': 1099511645724, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3782'}, {'damage_type': 'backtrace', 'id': 4126580683, 'ino': 1099511652146, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6617'}, {'damage_type': 'backtrace', 'id': 4137751782, 'ino': 1099511647897, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4762'}, {'damage_type': 'backtrace', 'id': 4142729067, 'ino': 1099511647544, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4607'}, {'damage_type': 'backtrace', 'id': 4202796829, 'ino': 1099511651187, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file6203'}, {'damage_type': 'backtrace', 'id': 4204235345, 'ino': 1099511653332, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file7147'}, {'damage_type': 'backtrace', 'id': 4260751156, 'ino': 1099511646501, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file4130'}, {'damage_type': 'backtrace', 'id': 4263251640, 'ino': 1099511645866, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3849'}, {'damage_type': 'backtrace', 'id': 4264053403, 'ino': 1099511645658, 'path': '/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file3749'}] 2024-08-18T22:14:04.204 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/fwd_scrub.py", line 70, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/fwd_scrub.py", line 81, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-08-18T22:14:05.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:05 smithi183 ceph-mon[22097]: pgmap v529: 129 pgs: 129 active+clean; 142 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 1.00k op/s 2024-08-18T22:14:05.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:05 smithi123 ceph-mon[18462]: pgmap v529: 129 pgs: 129 active+clean; 142 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 1.00k op/s 2024-08-18T22:14:05.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:05 smithi130 ceph-mon[21698]: pgmap v529: 129 pgs: 129 active+clean; 142 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 1.00k op/s 2024-08-18T22:14:07.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:07 smithi123 ceph-mon[18462]: pgmap v530: 129 pgs: 129 active+clean; 150 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 913 op/s 2024-08-18T22:14:07.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:07 smithi130 ceph-mon[21698]: pgmap v530: 129 pgs: 129 active+clean; 150 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 913 op/s 2024-08-18T22:14:07.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:07 smithi183 ceph-mon[22097]: pgmap v530: 129 pgs: 129 active+clean; 150 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 913 op/s 2024-08-18T22:14:09.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:09 smithi123 ceph-mon[18462]: pgmap v531: 129 pgs: 129 active+clean; 158 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 975 op/s 2024-08-18T22:14:09.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:09 smithi130 ceph-mon[21698]: pgmap v531: 129 pgs: 129 active+clean; 158 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 975 op/s 2024-08-18T22:14:09.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:09 smithi183 ceph-mon[22097]: pgmap v531: 129 pgs: 129 active+clean; 158 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 975 op/s 2024-08-18T22:14:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.645+0000 7f8737230640 1 -- 172.21.15.123:0/3096931086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8730102320 msgr2=0x7f8730108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.645+0000 7f8737230640 1 --2- 172.21.15.123:0/3096931086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8730102320 0x7f8730108bb0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8728009ca0 tx=0x7f872802a8c0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.645+0000 7f8737230640 1 -- 172.21.15.123:0/3096931086 shutdown_connections 2024-08-18T22:14:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.645+0000 7f8737230640 1 --2- 172.21.15.123:0/3096931086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8730102320 0x7f8730108bb0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.645+0000 7f8737230640 1 --2- 172.21.15.123:0/3096931086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8730101960 0x7f8730101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.645+0000 7f8737230640 1 --2- 172.21.15.123:0/3096931086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8730100770 0x7f8730100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.645+0000 7f8737230640 1 -- 172.21.15.123:0/3096931086 >> 172.21.15.123:0/3096931086 conn(0x7f87300fbf10 msgr2=0x7f87300fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.645+0000 7f8737230640 1 -- 172.21.15.123:0/3096931086 shutdown_connections 2024-08-18T22:14:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.645+0000 7f8737230640 1 -- 172.21.15.123:0/3096931086 wait complete. 2024-08-18T22:14:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.646+0000 7f8737230640 1 Processor -- start 2024-08-18T22:14:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.646+0000 7f8737230640 1 -- start start 2024-08-18T22:14:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.646+0000 7f8737230640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8730100770 0x7f8730197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.646+0000 7f8737230640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8730101960 0x7f8730198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.646+0000 7f8737230640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8730102320 0x7f873019f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.646+0000 7f8737230640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f873010c3f0 con 0x7f8730102320 2024-08-18T22:14:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.646+0000 7f8737230640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f873010c270 con 0x7f8730100770 2024-08-18T22:14:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.646+0000 7f8737230640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f873010c570 con 0x7f8730101960 2024-08-18T22:14:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.646+0000 7f8734fcc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8730100770 0x7f8730197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.646+0000 7f8734fcc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8730100770 0x7f8730197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:55790/0 (socket says 172.21.15.123:55790) 2024-08-18T22:14:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.646+0000 7f8734fcc640 1 -- 172.21.15.123:0/1543534632 learned_addr learned my addr 172.21.15.123:0/1543534632 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.647+0000 7f872ffff640 1 --2- 172.21.15.123:0/1543534632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8730101960 0x7f8730198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.647+0000 7f87357cd640 1 --2- 172.21.15.123:0/1543534632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8730102320 0x7f873019f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.647+0000 7f8734fcc640 1 -- 172.21.15.123:0/1543534632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8730101960 msgr2=0x7f8730198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.647+0000 7f8734fcc640 1 --2- 172.21.15.123:0/1543534632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8730101960 0x7f8730198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.647+0000 7f8734fcc640 1 -- 172.21.15.123:0/1543534632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8730102320 msgr2=0x7f873019f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.647+0000 7f8734fcc640 1 --2- 172.21.15.123:0/1543534632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8730102320 0x7f873019f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.647+0000 7f8734fcc640 1 -- 172.21.15.123:0/1543534632 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873019f6f0 con 0x7f8730100770 2024-08-18T22:14:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.647+0000 7f8734fcc640 1 --2- 172.21.15.123:0/1543534632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8730100770 0x7f8730197ad0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f872400e9c0 tx=0x7f872400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.647+0000 7f872dffb640 1 -- 172.21.15.123:0/1543534632 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872400cd80 con 0x7f8730100770 2024-08-18T22:14:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.647+0000 7f872dffb640 1 -- 172.21.15.123:0/1543534632 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87240035f0 con 0x7f8730100770 2024-08-18T22:14:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.647+0000 7f8737230640 1 -- 172.21.15.123:0/1543534632 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f873019f9e0 con 0x7f8730100770 2024-08-18T22:14:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.647+0000 7f872dffb640 1 -- 172.21.15.123:0/1543534632 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724010690 con 0x7f8730100770 2024-08-18T22:14:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.647+0000 7f8737230640 1 -- 172.21.15.123:0/1543534632 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f873019ff30 con 0x7f8730100770 2024-08-18T22:14:10.656 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.650+0000 7f872dffb640 1 -- 172.21.15.123:0/1543534632 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f87240037a0 con 0x7f8730100770 2024-08-18T22:14:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.650+0000 7f8739fea740 1 Processor -- start 2024-08-18T22:14:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.650+0000 7f8739fea740 1 -- start start 2024-08-18T22:14:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.650+0000 7f872dffb640 1 --2- 172.21.15.123:0/1543534632 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f87200a2c30 0x7f87200a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f8739fea740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5680 0x5559d74b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f8739fea740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5fc0 0x5559d74baa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f8739fea740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74bb050 0x5559d74bd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f8739fea740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5559d74189d0 con 0x5559d74b5680 2024-08-18T22:14:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f8739fea740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5559d73c0820 con 0x5559d74b5fc0 2024-08-18T22:14:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f8739fea740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5559d7414990 con 0x5559d74bb050 2024-08-18T22:14:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f872dffb640 1 -- 172.21.15.123:0/1543534632 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f87240cf7a0 con 0x7f8730100770 2024-08-18T22:14:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f87357cd640 1 --2- 172.21.15.123:0/1543534632 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f87200a2c30 0x7f87200a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f872ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5fc0 0x5559d74baa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f872ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5fc0 0x5559d74baa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:55802/0 (socket says 172.21.15.123:55802) 2024-08-18T22:14:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f872ffff640 1 -- 172.21.15.123:0/1907910472 learned_addr learned my addr 172.21.15.123:0/1907910472 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f8734fcc640 1 --2- 172.21.15.123:0/1907910472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5680 0x5559d74b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f87357cd640 1 --2- 172.21.15.123:0/1907910472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74bb050 0x5559d74bd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f872ffff640 1 -- 172.21.15.123:0/1907910472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74bb050 msgr2=0x5559d74bd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f872ffff640 1 --2- 172.21.15.123:0/1907910472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74bb050 0x5559d74bd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f872ffff640 1 -- 172.21.15.123:0/1907910472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5680 msgr2=0x5559d74b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f872ffff640 1 --2- 172.21.15.123:0/1907910472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5680 0x5559d74b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f872ffff640 1 -- 172.21.15.123:0/1907910472 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559d712c210 con 0x5559d74b5fc0 2024-08-18T22:14:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f872ffff640 1 --2- 172.21.15.123:0/1907910472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5fc0 0x5559d74baa80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f871c009ca0 tx=0x7f871c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f01ce8773353dfd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.651+0000 7f87357cd640 1 --2- 172.21.15.123:0/1543534632 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f87200a2c30 0x7f87200a50f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8728006010 tx=0x7f8728005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.652+0000 7f871affd640 1 -- 172.21.15.123:0/1907910472 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c01e070 con 0x5559d74b5fc0 2024-08-18T22:14:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.652+0000 7f871affd640 1 -- 172.21.15.123:0/1907910472 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f871c019b10 con 0x5559d74b5fc0 2024-08-18T22:14:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.652+0000 7f871affd640 1 -- 172.21.15.123:0/1907910472 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c00eae0 con 0x5559d74b5fc0 2024-08-18T22:14:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.652+0000 7f8739fea740 1 -- 172.21.15.123:0/1907910472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5fc0 msgr2=0x5559d74baa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.652+0000 7f8739fea740 1 --2- 172.21.15.123:0/1907910472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5fc0 0x5559d74baa80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f871c009ca0 tx=0x7f871c011810 comp rx=0 tx=0).stop 2024-08-18T22:14:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.652+0000 7f8739fea740 1 -- 172.21.15.123:0/1907910472 shutdown_connections 2024-08-18T22:14:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.652+0000 7f8739fea740 1 --2- 172.21.15.123:0/1907910472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74bb050 0x5559d74bd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.652+0000 7f8739fea740 1 --2- 172.21.15.123:0/1907910472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5fc0 0x5559d74baa80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.652+0000 7f8739fea740 1 --2- 172.21.15.123:0/1907910472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5680 0x5559d74b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.652+0000 7f8739fea740 1 -- 172.21.15.123:0/1907910472 >> 172.21.15.123:0/1907910472 conn(0x5559d74b0cf0 msgr2=0x5559d74b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.652+0000 7f8739fea740 1 -- 172.21.15.123:0/1907910472 shutdown_connections 2024-08-18T22:14:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.653+0000 7f8739fea740 1 -- 172.21.15.123:0/1907910472 wait complete. 2024-08-18T22:14:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.653+0000 7f8739fea740 1 -- start start 2024-08-18T22:14:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.653+0000 7f8739fea740 1 Processor -- start 2024-08-18T22:14:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.653+0000 7f8739fea740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5680 0x5559d74c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.653+0000 7f8739fea740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74b5fc0 0x5559d74c4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.653+0000 7f8739fea740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74bb050 0x5559d74cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.653+0000 7f8739fea740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5559d74c2430 con 0x5559d74bb050 2024-08-18T22:14:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.653+0000 7f8739fea740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5559d73d4520 con 0x5559d74b5680 2024-08-18T22:14:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.653+0000 7f8739fea740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5559d74c25b0 con 0x5559d74b5fc0 2024-08-18T22:14:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.653+0000 7f8739fea740 10 client.0 _ll_register_callbacks cb 0x5559d712ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:14:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.653+0000 7f8734fcc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5680 0x5559d74c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.654+0000 7f8734fcc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5680 0x5559d74c3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:55808/0 (socket says 172.21.15.123:55808) 2024-08-18T22:14:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.654+0000 7f8734fcc640 1 -- 172.21.15.123:0/818633629 learned_addr learned my addr 172.21.15.123:0/818633629 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.654+0000 7f872ffff640 1 --2- 172.21.15.123:0/818633629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74b5fc0 0x5559d74c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.654+0000 7f87357cd640 1 --2- 172.21.15.123:0/818633629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74bb050 0x5559d74cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.654+0000 7f8734fcc640 1 -- 172.21.15.123:0/818633629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74b5fc0 msgr2=0x5559d74c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.654+0000 7f8734fcc640 1 --2- 172.21.15.123:0/818633629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74b5fc0 0x5559d74c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.654+0000 7f8734fcc640 1 -- 172.21.15.123:0/818633629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74bb050 msgr2=0x5559d74cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.654+0000 7f8734fcc640 1 --2- 172.21.15.123:0/818633629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74bb050 0x5559d74cb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.654+0000 7f8734fcc640 1 -- 172.21.15.123:0/818633629 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559d71f8620 con 0x5559d74b5680 2024-08-18T22:14:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.654+0000 7f8734fcc640 1 --2- 172.21.15.123:0/818633629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5680 0x5559d74c3c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f87240ccf10 tx=0x7f872409c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26831ce7b9b17c38 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.654+0000 7f870ffff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:14:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.654+0000 7f870ffff640 1 -- 172.21.15.123:0/818633629 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87240a48e0 con 0x5559d74b5680 2024-08-18T22:14:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.654+0000 7f8739fea740 1 -- 172.21.15.123:0/818633629 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f871c019b10 con 0x5559d74b5680 2024-08-18T22:14:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.654+0000 7f870ffff640 1 -- 172.21.15.123:0/818633629 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f8724003b30 con 0x5559d74b5680 2024-08-18T22:14:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.654+0000 7f870ffff640 1 -- 172.21.15.123:0/818633629 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8724051220 con 0x5559d74b5680 2024-08-18T22:14:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.655+0000 7f8739fea740 10 client.25985 fetch_fsmap learned FSMap version 32 2024-08-18T22:14:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.655+0000 7f8739fea740 1 -- 172.21.15.123:0/818633629 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5559d74ce030 con 0x5559d74b5680 2024-08-18T22:14:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.655+0000 7f870ffff640 1 -- 172.21.15.123:0/818633629 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f871c019b10 con 0x5559d74b5680 2024-08-18T22:14:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.655+0000 7f870ffff640 1 -- 172.21.15.123:0/818633629 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f872409b1c0 con 0x5559d74b5680 2024-08-18T22:14:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.655+0000 7f8739fea740 10 client.25985 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:14:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.655+0000 7f8739fea740 10 client.25985 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:14:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.655+0000 7f8739fea740 20 client.25985 populate_metadata read hostname 'smithi123' 2024-08-18T22:14:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.655+0000 7f8739fea740 1 --2- 172.21.15.123:0/818633629 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5559d74cf720 0x5559d74d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.655+0000 7f8739fea740 4 client.25985 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:14:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.655+0000 7f8739fea740 1 -- 172.21.15.123:0/818633629 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559d7426100 con 0x5559d74cf720 2024-08-18T22:14:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.655+0000 7f872ffff640 1 --2- 172.21.15.123:0/818633629 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5559d74cf720 0x5559d74d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.656+0000 7f872ffff640 1 --2- 172.21.15.123:0/818633629 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5559d74cf720 0x5559d74d1b10 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa0dd4db5befac94 server_cookie=9e508ecc7c5e5a8c in_seq=0 out_seq=0 2024-08-18T22:14:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.656+0000 7f870ffff640 10 client.25985 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.660+0000 7f870ffff640 1 -- 172.21.15.123:0/818633629 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559d7426100 con 0x5559d74cf720 2024-08-18T22:14:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.660+0000 7f870ffff640 10 client.25985 handle_command_reply: tid=0 2024-08-18T22:14:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.660+0000 7f8739fea740 1 client.25985 shutdown 2024-08-18T22:14:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.660+0000 7f8739fea740 1 -- 172.21.15.123:0/818633629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5680 msgr2=0x5559d74c3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.660+0000 7f8739fea740 1 --2- 172.21.15.123:0/818633629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5680 0x5559d74c3c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f87240ccf10 tx=0x7f872409c430 comp rx=0 tx=0).stop 2024-08-18T22:14:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.660+0000 7f8739fea740 1 -- 172.21.15.123:0/818633629 shutdown_connections 2024-08-18T22:14:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.660+0000 7f8739fea740 1 --2- 172.21.15.123:0/818633629 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5559d74cf720 0x5559d74d1b10 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.660+0000 7f8739fea740 1 --2- 172.21.15.123:0/818633629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74bb050 0x5559d74cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.660+0000 7f870ffff640 0 client.25985 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.660+0000 7f8739fea740 1 --2- 172.21.15.123:0/818633629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74b5fc0 0x5559d74c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.660+0000 7f8739fea740 1 --2- 172.21.15.123:0/818633629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5680 0x5559d74c3c50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.660+0000 7f8739fea740 1 -- 172.21.15.123:0/818633629 >> 172.21.15.123:0/818633629 conn(0x5559d74b0cf0 msgr2=0x5559d74b2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.661+0000 7f8739fea740 1 -- 172.21.15.123:0/818633629 shutdown_connections 2024-08-18T22:14:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.661+0000 7f8739fea740 1 -- 172.21.15.123:0/818633629 wait complete. 2024-08-18T22:14:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.661+0000 7f8739fea740 20 client.25985 trim_cache size 0 max 16384 2024-08-18T22:14:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.675+0000 7f8739fea740 1 Processor -- start 2024-08-18T22:14:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.675+0000 7f8739fea740 1 -- start start 2024-08-18T22:14:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.675+0000 7f8739fea740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5680 0x5559d74c4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.675+0000 7f8739fea740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5fc0 0x5559d74cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.675+0000 7f8739fea740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74bb050 0x5559d74ba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f8739fea740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f87301aabc0 con 0x5559d74b5fc0 2024-08-18T22:14:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f8739fea740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f87301a83d0 con 0x5559d74b5680 2024-08-18T22:14:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f8739fea740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f87301a6220 con 0x5559d74bb050 2024-08-18T22:14:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f872ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5fc0 0x5559d74cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f8734fcc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5680 0x5559d74c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f8734fcc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5680 0x5559d74c4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:55810/0 (socket says 172.21.15.123:55810) 2024-08-18T22:14:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f87357cd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74bb050 0x5559d74ba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f8734fcc640 1 -- 172.21.15.123:0/1420246770 learned_addr learned my addr 172.21.15.123:0/1420246770 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f872ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5fc0 0x5559d74cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39246/0 (socket says 172.21.15.123:39246) 2024-08-18T22:14:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f8734fcc640 1 -- 172.21.15.123:0/1420246770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74bb050 msgr2=0x5559d74ba7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f8734fcc640 1 --2- 172.21.15.123:0/1420246770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74bb050 0x5559d74ba7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f8734fcc640 1 -- 172.21.15.123:0/1420246770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5fc0 msgr2=0x5559d74cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f8734fcc640 1 --2- 172.21.15.123:0/1420246770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5fc0 0x5559d74cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f8734fcc640 1 -- 172.21.15.123:0/1420246770 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559d74ba470 con 0x5559d74b5680 2024-08-18T22:14:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f8734fcc640 1 --2- 172.21.15.123:0/1420246770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5680 0x5559d74c4110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f872409b970 tx=0x7f872409a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0ee50e8f84e1590 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f871a7fc640 1 -- 172.21.15.123:0/1420246770 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724057070 con 0x5559d74b5680 2024-08-18T22:14:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f871a7fc640 1 -- 172.21.15.123:0/1420246770 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87240a48e0 con 0x5559d74b5680 2024-08-18T22:14:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.676+0000 7f871a7fc640 1 -- 172.21.15.123:0/1420246770 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87240a11b0 con 0x5559d74b5680 2024-08-18T22:14:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.677+0000 7f8739fea740 1 -- 172.21.15.123:0/1420246770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5680 msgr2=0x5559d74c4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.677+0000 7f8739fea740 1 --2- 172.21.15.123:0/1420246770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5680 0x5559d74c4110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f872409b970 tx=0x7f872409a180 comp rx=0 tx=0).stop 2024-08-18T22:14:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.677+0000 7f8739fea740 1 -- 172.21.15.123:0/1420246770 shutdown_connections 2024-08-18T22:14:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.677+0000 7f8739fea740 1 --2- 172.21.15.123:0/1420246770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74bb050 0x5559d74ba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.677+0000 7f8739fea740 1 --2- 172.21.15.123:0/1420246770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5fc0 0x5559d74cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.677+0000 7f8739fea740 1 --2- 172.21.15.123:0/1420246770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5680 0x5559d74c4110 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.677+0000 7f8739fea740 1 -- 172.21.15.123:0/1420246770 >> 172.21.15.123:0/1420246770 conn(0x5559d74b0cf0 msgr2=0x5559d74c3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.677+0000 7f8739fea740 1 -- 172.21.15.123:0/1420246770 shutdown_connections 2024-08-18T22:14:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.677+0000 7f8739fea740 1 -- 172.21.15.123:0/1420246770 wait complete. 2024-08-18T22:14:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f8739fea740 1 -- start start 2024-08-18T22:14:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f8739fea740 1 Processor -- start 2024-08-18T22:14:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f8739fea740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5680 0x5559d74c8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f8739fea740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5fc0 0x5559d74c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f8739fea740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74bb050 0x5559d74c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f8739fea740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f87301a6890 con 0x5559d74b5680 2024-08-18T22:14:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f8739fea740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f87301a7d00 con 0x5559d74b5fc0 2024-08-18T22:14:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f8739fea740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f87301a6f60 con 0x5559d74bb050 2024-08-18T22:14:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f872ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5fc0 0x5559d74c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f8739fea740 10 client.0 _ll_register_callbacks cb 0x7f872409b5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:14:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f8734fcc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5680 0x5559d74c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f872ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5fc0 0x5559d74c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:55818/0 (socket says 172.21.15.123:55818) 2024-08-18T22:14:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f872ffff640 1 -- 172.21.15.123:0/3717497373 learned_addr learned my addr 172.21.15.123:0/3717497373 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f87357cd640 1 --2- 172.21.15.123:0/3717497373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74bb050 0x5559d74c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f8734fcc640 1 -- 172.21.15.123:0/3717497373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74bb050 msgr2=0x5559d74c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.678+0000 7f8734fcc640 1 --2- 172.21.15.123:0/3717497373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74bb050 0x5559d74c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f8734fcc640 1 -- 172.21.15.123:0/3717497373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5fc0 msgr2=0x5559d74c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f8734fcc640 1 --2- 172.21.15.123:0/3717497373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5fc0 0x5559d74c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f8734fcc640 1 -- 172.21.15.123:0/3717497373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559d74ca3c0 con 0x5559d74b5680 2024-08-18T22:14:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f872ffff640 1 --2- 172.21.15.123:0/3717497373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5fc0 0x5559d74c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:14:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f8734fcc640 1 --2- 172.21.15.123:0/3717497373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5680 0x5559d74c8860 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f87240058c0 tx=0x7f87240a00e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee134532ae2cc8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f870ffff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:14:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f870ffff640 1 -- 172.21.15.123:0/3717497373 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724057070 con 0x5559d74b5680 2024-08-18T22:14:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f870ffff640 1 -- 172.21.15.123:0/3717497373 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f872409ab80 con 0x5559d74b5680 2024-08-18T22:14:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f8739fea740 1 -- 172.21.15.123:0/3717497373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87240a48e0 con 0x5559d74b5680 2024-08-18T22:14:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f870ffff640 1 -- 172.21.15.123:0/3717497373 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8724097f10 con 0x5559d74b5680 2024-08-18T22:14:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f8739fea740 10 client.16683 fetch_fsmap learned FSMap version 32 2024-08-18T22:14:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f8739fea740 1 -- 172.21.15.123:0/3717497373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5559d753a3d0 con 0x5559d74b5680 2024-08-18T22:14:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f870ffff640 1 -- 172.21.15.123:0/3717497373 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87240a48e0 con 0x5559d74b5680 2024-08-18T22:14:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f870ffff640 1 -- 172.21.15.123:0/3717497373 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f872405d070 con 0x5559d74b5680 2024-08-18T22:14:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f8739fea740 10 client.16683 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:14:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f8739fea740 10 client.16683 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:14:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f8739fea740 20 client.16683 populate_metadata read hostname 'smithi123' 2024-08-18T22:14:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f8739fea740 1 --2- 172.21.15.123:0/3717497373 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5559d753a9f0 0x5559d753ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f8739fea740 4 client.16683 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:14:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.679+0000 7f8739fea740 1 -- 172.21.15.123:0/3717497373 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5559d7420450 con 0x5559d753a9f0 2024-08-18T22:14:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.680+0000 7f872ffff640 1 --2- 172.21.15.123:0/3717497373 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5559d753a9f0 0x5559d753ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.680+0000 7f872ffff640 1 --2- 172.21.15.123:0/3717497373 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5559d753a9f0 0x5559d753ce10 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d236380e826156b server_cookie=208c6660c0f99e14 in_seq=0 out_seq=0 2024-08-18T22:14:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:10.680+0000 7f870ffff640 10 client.16683 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:11.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:11 smithi123 ceph-mon[18462]: pgmap v532: 129 pgs: 129 active+clean; 167 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 1.00k op/s 2024-08-18T22:14:11.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:11 smithi130 ceph-mon[21698]: pgmap v532: 129 pgs: 129 active+clean; 167 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 1.00k op/s 2024-08-18T22:14:11.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:11 smithi183 ceph-mon[22097]: pgmap v532: 129 pgs: 129 active+clean; 167 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 1.00k op/s 2024-08-18T22:14:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.678+0000 7f870ffff640 1 -- 172.21.15.123:0/3717497373 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5559d7420450 con 0x5559d753a9f0 2024-08-18T22:14:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.678+0000 7f870ffff640 10 client.16683 handle_command_reply: tid=0 2024-08-18T22:14:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.678+0000 7f8739fea740 1 client.16683 shutdown 2024-08-18T22:14:11.682 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.680+0000 7f8739fea740 1 -- 172.21.15.123:0/3717497373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5680 msgr2=0x5559d74c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:11.682 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.680+0000 7f8739fea740 1 --2- 172.21.15.123:0/3717497373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5680 0x5559d74c8860 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f87240058c0 tx=0x7f87240a00e0 comp rx=0 tx=0).stop 2024-08-18T22:14:11.682 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.680+0000 7f8739fea740 1 -- 172.21.15.123:0/3717497373 shutdown_connections 2024-08-18T22:14:11.682 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.680+0000 7f8739fea740 1 --2- 172.21.15.123:0/3717497373 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5559d753a9f0 0x5559d753ce10 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.680+0000 7f8739fea740 1 --2- 172.21.15.123:0/3717497373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5559d74bb050 0x5559d74c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.680+0000 7f8739fea740 1 --2- 172.21.15.123:0/3717497373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559d74b5fc0 0x5559d74c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.680+0000 7f8739fea740 1 --2- 172.21.15.123:0/3717497373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5559d74b5680 0x5559d74c8860 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.680+0000 7f8739fea740 1 -- 172.21.15.123:0/3717497373 >> 172.21.15.123:0/3717497373 conn(0x5559d74b0cf0 msgr2=0x5559d74c3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.680+0000 7f870ffff640 0 client.16683 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.681+0000 7f8739fea740 1 -- 172.21.15.123:0/3717497373 shutdown_connections 2024-08-18T22:14:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.681+0000 7f8739fea740 1 -- 172.21.15.123:0/3717497373 wait complete. 2024-08-18T22:14:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.682+0000 7f8739fea740 20 client.16683 trim_cache size 0 max 16384 2024-08-18T22:14:11.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:14:11.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:14:11.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:14:11.684 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:14:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.683+0000 7f8737230640 1 -- 172.21.15.123:0/1543534632 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f87200a2c30 msgr2=0x7f87200a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.683+0000 7f8737230640 1 --2- 172.21.15.123:0/1543534632 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f87200a2c30 0x7f87200a50f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8728006010 tx=0x7f8728005df0 comp rx=0 tx=0).stop 2024-08-18T22:14:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.683+0000 7f8737230640 1 -- 172.21.15.123:0/1543534632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8730100770 msgr2=0x7f8730197ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.683+0000 7f8737230640 1 --2- 172.21.15.123:0/1543534632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8730100770 0x7f8730197ad0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f872400e9c0 tx=0x7f872400ee80 comp rx=0 tx=0).stop 2024-08-18T22:14:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.683+0000 7f8737230640 1 -- 172.21.15.123:0/1543534632 shutdown_connections 2024-08-18T22:14:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.683+0000 7f8737230640 1 --2- 172.21.15.123:0/1543534632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8730102320 0x7f873019f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.683+0000 7f8737230640 1 --2- 172.21.15.123:0/1543534632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8730101960 0x7f8730198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.683+0000 7f8737230640 1 --2- 172.21.15.123:0/1543534632 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f87200a2c30 0x7f87200a50f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.683+0000 7f8737230640 1 --2- 172.21.15.123:0/1543534632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8730100770 0x7f8730197ad0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.683+0000 7f8737230640 1 -- 172.21.15.123:0/1543534632 >> 172.21.15.123:0/1543534632 conn(0x7f87300fbf10 msgr2=0x7f87300fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.683+0000 7f8737230640 1 -- 172.21.15.123:0/1543534632 shutdown_connections 2024-08-18T22:14:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:11.683+0000 7f8737230640 1 -- 172.21.15.123:0/1543534632 wait complete. 2024-08-18T22:14:13.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:13 smithi123 ceph-mon[18462]: pgmap v533: 129 pgs: 129 active+clean; 177 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 914 op/s 2024-08-18T22:14:13.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:13 smithi130 ceph-mon[21698]: pgmap v533: 129 pgs: 129 active+clean; 177 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 914 op/s 2024-08-18T22:14:13.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:13 smithi183 ceph-mon[22097]: pgmap v533: 129 pgs: 129 active+clean; 177 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 914 op/s 2024-08-18T22:14:15.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:15 smithi123 ceph-mon[18462]: pgmap v534: 129 pgs: 129 active+clean; 172 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 1.08k op/s 2024-08-18T22:14:15.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:15 smithi130 ceph-mon[21698]: pgmap v534: 129 pgs: 129 active+clean; 172 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 1.08k op/s 2024-08-18T22:14:15.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:15 smithi183 ceph-mon[22097]: pgmap v534: 129 pgs: 129 active+clean; 172 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 1.08k op/s 2024-08-18T22:14:17.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:17 smithi123 ceph-mon[18462]: pgmap v535: 129 pgs: 129 active+clean; 169 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 980 op/s 2024-08-18T22:14:17.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:17 smithi130 ceph-mon[21698]: pgmap v535: 129 pgs: 129 active+clean; 169 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 980 op/s 2024-08-18T22:14:17.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:17 smithi183 ceph-mon[22097]: pgmap v535: 129 pgs: 129 active+clean; 169 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 980 op/s 2024-08-18T22:14:19.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:19 smithi123 ceph-mon[18462]: pgmap v536: 129 pgs: 129 active+clean; 162 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 1.02k op/s 2024-08-18T22:14:19.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:19 smithi130 ceph-mon[21698]: pgmap v536: 129 pgs: 129 active+clean; 162 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 1.02k op/s 2024-08-18T22:14:19.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:19 smithi183 ceph-mon[22097]: pgmap v536: 129 pgs: 129 active+clean; 162 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 1.02k op/s 2024-08-18T22:14:21.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:21 smithi123 ceph-mon[18462]: pgmap v537: 129 pgs: 129 active+clean; 168 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 1.05k op/s 2024-08-18T22:14:21.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:21 smithi130 ceph-mon[21698]: pgmap v537: 129 pgs: 129 active+clean; 168 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 1.05k op/s 2024-08-18T22:14:21.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:21 smithi183 ceph-mon[22097]: pgmap v537: 129 pgs: 129 active+clean; 168 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 1.05k op/s 2024-08-18T22:14:23.460 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:23 smithi183 ceph-mon[22097]: pgmap v538: 129 pgs: 129 active+clean; 182 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 1.03k op/s 2024-08-18T22:14:23.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:23 smithi123 ceph-mon[18462]: pgmap v538: 129 pgs: 129 active+clean; 182 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 1.03k op/s 2024-08-18T22:14:23.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:23 smithi130 ceph-mon[21698]: pgmap v538: 129 pgs: 129 active+clean; 182 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 1.03k op/s 2024-08-18T22:14:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.784+0000 7fdc94a5c640 1 -- 172.21.15.123:0/326736947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc90102320 msgr2=0x7fdc90108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.784+0000 7fdc94a5c640 1 --2- 172.21.15.123:0/326736947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc90102320 0x7fdc90108bb0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009ca0 tx=0x7fdc8802a8c0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.784+0000 7fdc94a5c640 1 -- 172.21.15.123:0/326736947 shutdown_connections 2024-08-18T22:14:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.784+0000 7fdc94a5c640 1 --2- 172.21.15.123:0/326736947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc90102320 0x7fdc90108bb0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.784+0000 7fdc94a5c640 1 --2- 172.21.15.123:0/326736947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc90101960 0x7fdc90101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.784+0000 7fdc94a5c640 1 --2- 172.21.15.123:0/326736947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc90100770 0x7fdc90100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.784+0000 7fdc94a5c640 1 -- 172.21.15.123:0/326736947 >> 172.21.15.123:0/326736947 conn(0x7fdc900fbf10 msgr2=0x7fdc900fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.784+0000 7fdc94a5c640 1 -- 172.21.15.123:0/326736947 shutdown_connections 2024-08-18T22:14:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.784+0000 7fdc94a5c640 1 -- 172.21.15.123:0/326736947 wait complete. 2024-08-18T22:14:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc94a5c640 1 Processor -- start 2024-08-18T22:14:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc94a5c640 1 -- start start 2024-08-18T22:14:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc94a5c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc90100770 0x7fdc90199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc94a5c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc90101960 0x7fdc9019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc94a5c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc90102320 0x7fdc901a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc94a5c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9010b370 con 0x7fdc90100770 2024-08-18T22:14:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc94a5c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9010b1f0 con 0x7fdc90101960 2024-08-18T22:14:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc94a5c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9010b4f0 con 0x7fdc90102320 2024-08-18T22:14:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc8e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc90100770 0x7fdc90199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc8dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc90101960 0x7fdc9019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc8e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc90100770 0x7fdc90199cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38372/0 (socket says 172.21.15.123:38372) 2024-08-18T22:14:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc8e59c640 1 -- 172.21.15.123:0/2766146443 learned_addr learned my addr 172.21.15.123:0/2766146443 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc8ed9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc90102320 0x7fdc901a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc8dd9b640 1 -- 172.21.15.123:0/2766146443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc90102320 msgr2=0x7fdc901a1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:24.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc8dd9b640 1 --2- 172.21.15.123:0/2766146443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc90102320 0x7fdc901a1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc8dd9b640 1 -- 172.21.15.123:0/2766146443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc90100770 msgr2=0x7fdc90199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:24.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc8dd9b640 1 --2- 172.21.15.123:0/2766146443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc90100770 0x7fdc90199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc8dd9b640 1 -- 172.21.15.123:0/2766146443 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc901a18f0 con 0x7fdc90101960 2024-08-18T22:14:24.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc8e59c640 1 --2- 172.21.15.123:0/2766146443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc90100770 0x7fdc90199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:14:24.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.785+0000 7fdc8ed9d640 1 --2- 172.21.15.123:0/2766146443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc90102320 0x7fdc901a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:14:24.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.786+0000 7fdc8dd9b640 1 --2- 172.21.15.123:0/2766146443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc90101960 0x7fdc9019a1f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdc840097d0 tx=0x7fdc84009c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:24.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.786+0000 7fdc7f7fe640 1 -- 172.21.15.123:0/2766146443 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84005020 con 0x7fdc90101960 2024-08-18T22:14:24.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.786+0000 7fdc94a5c640 1 -- 172.21.15.123:0/2766146443 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc901a1be0 con 0x7fdc90101960 2024-08-18T22:14:24.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.786+0000 7fdc7f7fe640 1 -- 172.21.15.123:0/2766146443 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc840056a0 con 0x7fdc90101960 2024-08-18T22:14:24.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.786+0000 7fdc7f7fe640 1 -- 172.21.15.123:0/2766146443 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8400eb00 con 0x7fdc90101960 2024-08-18T22:14:24.790 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.786+0000 7fdc94a5c640 1 -- 172.21.15.123:0/2766146443 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc901a2130 con 0x7fdc90101960 2024-08-18T22:14:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.788+0000 7fdc7f7fe640 1 -- 172.21.15.123:0/2766146443 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fdc8401b020 con 0x7fdc90101960 2024-08-18T22:14:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc97819740 1 Processor -- start 2024-08-18T22:14:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc7f7fe640 1 --2- 172.21.15.123:0/2766146443 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdc780a2c30 0x7fdc780a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc7f7fe640 1 -- 172.21.15.123:0/2766146443 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fdc840ceae0 con 0x7fdc90101960 2024-08-18T22:14:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc8ed9d640 1 --2- 172.21.15.123:0/2766146443 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdc780a2c30 0x7fdc780a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc97819740 1 -- start start 2024-08-18T22:14:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc97819740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 0x55d19ce8ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc97819740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce8bfc0 0x55d19ce90a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc97819740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce91050 0x55d19ce93510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc97819740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d19cdee9d0 con 0x55d19ce91050 2024-08-18T22:14:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc97819740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d19cd96820 con 0x55d19ce8bfc0 2024-08-18T22:14:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc97819740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d19cdea990 con 0x55d19ce8b680 2024-08-18T22:14:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc8e59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 0x55d19ce8ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc8dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce8bfc0 0x55d19ce90a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc8e59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 0x55d19ce8ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:51216/0 (socket says 172.21.15.123:51216) 2024-08-18T22:14:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc8e59c640 1 -- 172.21.15.123:0/56798013 learned_addr learned my addr 172.21.15.123:0/56798013 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.789+0000 7fdc8ed9d640 1 --2- 172.21.15.123:0/56798013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce91050 0x55d19ce93510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.790+0000 7fdc8e59c640 1 -- 172.21.15.123:0/56798013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce8bfc0 msgr2=0x55d19ce90a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.790+0000 7fdc8e59c640 1 --2- 172.21.15.123:0/56798013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce8bfc0 0x55d19ce90a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.790+0000 7fdc8e59c640 1 -- 172.21.15.123:0/56798013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce91050 msgr2=0x55d19ce93510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.790+0000 7fdc8e59c640 1 --2- 172.21.15.123:0/56798013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce91050 0x55d19ce93510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.790+0000 7fdc8e59c640 1 -- 172.21.15.123:0/56798013 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d19cb02210 con 0x55d19ce8b680 2024-08-18T22:14:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.790+0000 7fdc8ed9d640 1 --2- 172.21.15.123:0/2766146443 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdc780a2c30 0x7fdc780a50f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdc88005e30 tx=0x7fdc88031530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.790+0000 7fdc8e59c640 1 --2- 172.21.15.123:0/56798013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 0x55d19ce8ba80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdc80011570 tx=0x7fdc80011a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95d99976aa70a6a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.790+0000 7fdc7cff9640 1 -- 172.21.15.123:0/56798013 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8001e070 con 0x55d19ce8b680 2024-08-18T22:14:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.790+0000 7fdc7cff9640 1 -- 172.21.15.123:0/56798013 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc8000fb60 con 0x55d19ce8b680 2024-08-18T22:14:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.790+0000 7fdc7cff9640 1 -- 172.21.15.123:0/56798013 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc80019bb0 con 0x55d19ce8b680 2024-08-18T22:14:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.791+0000 7fdc97819740 1 -- 172.21.15.123:0/56798013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 msgr2=0x55d19ce8ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.791+0000 7fdc97819740 1 --2- 172.21.15.123:0/56798013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 0x55d19ce8ba80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdc80011570 tx=0x7fdc80011a30 comp rx=0 tx=0).stop 2024-08-18T22:14:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.791+0000 7fdc97819740 1 -- 172.21.15.123:0/56798013 shutdown_connections 2024-08-18T22:14:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.791+0000 7fdc97819740 1 --2- 172.21.15.123:0/56798013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce91050 0x55d19ce93510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.791+0000 7fdc97819740 1 --2- 172.21.15.123:0/56798013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce8bfc0 0x55d19ce90a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.791+0000 7fdc97819740 1 --2- 172.21.15.123:0/56798013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 0x55d19ce8ba80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.791+0000 7fdc97819740 1 -- 172.21.15.123:0/56798013 >> 172.21.15.123:0/56798013 conn(0x55d19ce86cf0 msgr2=0x55d19ce870f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.791+0000 7fdc97819740 1 -- 172.21.15.123:0/56798013 shutdown_connections 2024-08-18T22:14:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.791+0000 7fdc97819740 1 -- 172.21.15.123:0/56798013 wait complete. 2024-08-18T22:14:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.791+0000 7fdc97819740 1 -- start start 2024-08-18T22:14:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc97819740 1 Processor -- start 2024-08-18T22:14:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc97819740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8b680 0x55d19ce957b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc97819740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce8bfc0 0x55d19ce95cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc97819740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce91050 0x55d19ce9cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc97819740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d19ce94020 con 0x55d19ce8b680 2024-08-18T22:14:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc97819740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d19cdaa520 con 0x55d19ce8bfc0 2024-08-18T22:14:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc97819740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d19ce941a0 con 0x55d19ce91050 2024-08-18T22:14:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc97819740 10 client.0 _ll_register_callbacks cb 0x55d19cb01a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:14:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc8e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8b680 0x55d19ce957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc8e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8b680 0x55d19ce957b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38390/0 (socket says 172.21.15.123:38390) 2024-08-18T22:14:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc8e59c640 1 -- 172.21.15.123:0/718179039 learned_addr learned my addr 172.21.15.123:0/718179039 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc8dd9b640 1 --2- 172.21.15.123:0/718179039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce8bfc0 0x55d19ce95cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc8ed9d640 1 --2- 172.21.15.123:0/718179039 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce91050 0x55d19ce9cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc8e59c640 1 -- 172.21.15.123:0/718179039 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce91050 msgr2=0x55d19ce9cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc8e59c640 1 --2- 172.21.15.123:0/718179039 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce91050 0x55d19ce9cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc8e59c640 1 -- 172.21.15.123:0/718179039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce8bfc0 msgr2=0x55d19ce95cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc8e59c640 1 --2- 172.21.15.123:0/718179039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce8bfc0 0x55d19ce95cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc8e59c640 1 -- 172.21.15.123:0/718179039 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d19cbce620 con 0x55d19ce8b680 2024-08-18T22:14:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc8e59c640 1 --2- 172.21.15.123:0/718179039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8b680 0x55d19ce957b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fdc80011540 tx=0x7fdc8000f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be60d89516d5ec30 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.792+0000 7fdc75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:14:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.793+0000 7fdc75ffb640 1 -- 172.21.15.123:0/718179039 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8001e040 con 0x55d19ce8b680 2024-08-18T22:14:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.793+0000 7fdc75ffb640 1 -- 172.21.15.123:0/718179039 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fdc80016040 con 0x55d19ce8b680 2024-08-18T22:14:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.793+0000 7fdc97819740 1 -- 172.21.15.123:0/718179039 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc8000fb60 con 0x55d19ce8b680 2024-08-18T22:14:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.793+0000 7fdc75ffb640 1 -- 172.21.15.123:0/718179039 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdc8002f050 con 0x55d19ce8b680 2024-08-18T22:14:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.793+0000 7fdc97819740 10 client.16695 fetch_fsmap learned FSMap version 32 2024-08-18T22:14:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.793+0000 7fdc97819740 1 -- 172.21.15.123:0/718179039 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d19ce9fb20 con 0x55d19ce8b680 2024-08-18T22:14:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.793+0000 7fdc75ffb640 1 -- 172.21.15.123:0/718179039 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc8000fb60 con 0x55d19ce8b680 2024-08-18T22:14:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.793+0000 7fdc75ffb640 1 -- 172.21.15.123:0/718179039 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fdc80005050 con 0x55d19ce8b680 2024-08-18T22:14:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.793+0000 7fdc97819740 10 client.16695 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:14:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.793+0000 7fdc97819740 10 client.16695 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:14:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.793+0000 7fdc97819740 20 client.16695 populate_metadata read hostname 'smithi123' 2024-08-18T22:14:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.793+0000 7fdc97819740 1 --2- 172.21.15.123:0/718179039 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d19cea0ff0 0x55d19cea3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.793+0000 7fdc97819740 4 client.16695 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:14:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.793+0000 7fdc97819740 1 -- 172.21.15.123:0/718179039 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d19cdfc100 con 0x55d19cea0ff0 2024-08-18T22:14:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.793+0000 7fdc8dd9b640 1 --2- 172.21.15.123:0/718179039 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d19cea0ff0 0x55d19cea3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.794+0000 7fdc8dd9b640 1 --2- 172.21.15.123:0/718179039 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d19cea0ff0 0x55d19cea3470 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fd4ca9d7733891b server_cookie=8416cc18d909db9d in_seq=0 out_seq=0 2024-08-18T22:14:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.794+0000 7fdc75ffb640 10 client.16695 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.797+0000 7fdc75ffb640 1 -- 172.21.15.123:0/718179039 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d19cdfc100 con 0x55d19cea0ff0 2024-08-18T22:14:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.797+0000 7fdc75ffb640 10 client.16695 handle_command_reply: tid=0 2024-08-18T22:14:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.797+0000 7fdc97819740 1 client.16695 shutdown 2024-08-18T22:14:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.797+0000 7fdc97819740 1 -- 172.21.15.123:0/718179039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8b680 msgr2=0x55d19ce957b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.797+0000 7fdc97819740 1 --2- 172.21.15.123:0/718179039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8b680 0x55d19ce957b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fdc80011540 tx=0x7fdc8000f930 comp rx=0 tx=0).stop 2024-08-18T22:14:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.798+0000 7fdc97819740 1 -- 172.21.15.123:0/718179039 shutdown_connections 2024-08-18T22:14:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.798+0000 7fdc97819740 1 --2- 172.21.15.123:0/718179039 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d19cea0ff0 0x55d19cea3470 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.798+0000 7fdc97819740 1 --2- 172.21.15.123:0/718179039 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce91050 0x55d19ce9cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.798+0000 7fdc97819740 1 --2- 172.21.15.123:0/718179039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce8bfc0 0x55d19ce95cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.798+0000 7fdc75ffb640 0 client.16695 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.798+0000 7fdc97819740 1 --2- 172.21.15.123:0/718179039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8b680 0x55d19ce957b0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.798+0000 7fdc97819740 1 -- 172.21.15.123:0/718179039 >> 172.21.15.123:0/718179039 conn(0x55d19ce86cf0 msgr2=0x55d19ce88500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.798+0000 7fdc97819740 1 -- 172.21.15.123:0/718179039 shutdown_connections 2024-08-18T22:14:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.798+0000 7fdc97819740 1 -- 172.21.15.123:0/718179039 wait complete. 2024-08-18T22:14:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.798+0000 7fdc97819740 20 client.16695 trim_cache size 0 max 16384 2024-08-18T22:14:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.813+0000 7fdc97819740 1 Processor -- start 2024-08-18T22:14:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.813+0000 7fdc97819740 1 -- start start 2024-08-18T22:14:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.813+0000 7fdc97819740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 0x55d19ce870d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.813+0000 7fdc97819740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8bfc0 0x55d19ce9ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.813+0000 7fdc97819740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce91050 0x55d19ce87610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.813+0000 7fdc97819740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdc901aefc0 con 0x55d19ce8bfc0 2024-08-18T22:14:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.813+0000 7fdc97819740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc901ac7d0 con 0x55d19ce91050 2024-08-18T22:14:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.813+0000 7fdc97819740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdc901aa620 con 0x55d19ce8b680 2024-08-18T22:14:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.813+0000 7fdc8dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8bfc0 0x55d19ce9ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.813+0000 7fdc8e59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 0x55d19ce870d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.813+0000 7fdc8dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8bfc0 0x55d19ce9ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38406/0 (socket says 172.21.15.123:38406) 2024-08-18T22:14:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.813+0000 7fdc8ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce91050 0x55d19ce87610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.813+0000 7fdc8e59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 0x55d19ce870d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:51222/0 (socket says 172.21.15.123:51222) 2024-08-18T22:14:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.813+0000 7fdc8dd9b640 1 -- 172.21.15.123:0/3534980761 learned_addr learned my addr 172.21.15.123:0/3534980761 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.814+0000 7fdc8dd9b640 1 -- 172.21.15.123:0/3534980761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 msgr2=0x55d19ce870d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.814+0000 7fdc8dd9b640 1 --2- 172.21.15.123:0/3534980761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 0x55d19ce870d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.814+0000 7fdc8dd9b640 1 -- 172.21.15.123:0/3534980761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce91050 msgr2=0x55d19ce87610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.814+0000 7fdc8dd9b640 1 --2- 172.21.15.123:0/3534980761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce91050 0x55d19ce87610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.814+0000 7fdc8dd9b640 1 -- 172.21.15.123:0/3534980761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d19ce93f00 con 0x55d19ce8bfc0 2024-08-18T22:14:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.814+0000 7fdc8dd9b640 1 --2- 172.21.15.123:0/3534980761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8bfc0 0x55d19ce9ccf0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fdc840cc2a0 tx=0x7fdc84097250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0fa7eb93745ca6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.814+0000 7fdc77fff640 1 -- 172.21.15.123:0/3534980761 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84099050 con 0x55d19ce8bfc0 2024-08-18T22:14:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.814+0000 7fdc77fff640 1 -- 172.21.15.123:0/3534980761 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc840b3030 con 0x55d19ce8bfc0 2024-08-18T22:14:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.814+0000 7fdc77fff640 1 -- 172.21.15.123:0/3534980761 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84004ac0 con 0x55d19ce8bfc0 2024-08-18T22:14:24.820 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.815+0000 7fdc97819740 1 -- 172.21.15.123:0/3534980761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8bfc0 msgr2=0x55d19ce9ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:24.820 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.815+0000 7fdc97819740 1 --2- 172.21.15.123:0/3534980761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8bfc0 0x55d19ce9ccf0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fdc840cc2a0 tx=0x7fdc84097250 comp rx=0 tx=0).stop 2024-08-18T22:14:24.820 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.815+0000 7fdc97819740 1 -- 172.21.15.123:0/3534980761 shutdown_connections 2024-08-18T22:14:24.820 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.815+0000 7fdc97819740 1 --2- 172.21.15.123:0/3534980761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce91050 0x55d19ce87610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.820 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.815+0000 7fdc97819740 1 --2- 172.21.15.123:0/3534980761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8bfc0 0x55d19ce9ccf0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.820 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.815+0000 7fdc97819740 1 --2- 172.21.15.123:0/3534980761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 0x55d19ce870d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.820 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.815+0000 7fdc97819740 1 -- 172.21.15.123:0/3534980761 >> 172.21.15.123:0/3534980761 conn(0x55d19ce86cf0 msgr2=0x55d19ce95560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.815+0000 7fdc97819740 1 -- 172.21.15.123:0/3534980761 shutdown_connections 2024-08-18T22:14:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.815+0000 7fdc97819740 1 -- 172.21.15.123:0/3534980761 wait complete. 2024-08-18T22:14:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.815+0000 7fdc97819740 1 -- start start 2024-08-18T22:14:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.815+0000 7fdc97819740 1 Processor -- start 2024-08-18T22:14:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.815+0000 7fdc97819740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 0x55d19ce99b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc97819740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8bfc0 0x55d19ce9a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc97819740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce91050 0x55d19cf09d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc97819740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdc901aac90 con 0x55d19ce8bfc0 2024-08-18T22:14:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc97819740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc901ac100 con 0x55d19ce91050 2024-08-18T22:14:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc97819740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdc901ab360 con 0x55d19ce8b680 2024-08-18T22:14:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc97819740 10 client.0 _ll_register_callbacks cb 0x7fdc8001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:14:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc8dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8bfc0 0x55d19ce9a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc8dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8bfc0 0x55d19ce9a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38422/0 (socket says 172.21.15.123:38422) 2024-08-18T22:14:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc8dd9b640 1 -- 172.21.15.123:0/3391760358 learned_addr learned my addr 172.21.15.123:0/3391760358 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc8e59c640 1 --2- 172.21.15.123:0/3391760358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 0x55d19ce99b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc8ed9d640 1 --2- 172.21.15.123:0/3391760358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce91050 0x55d19cf09d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc8dd9b640 1 -- 172.21.15.123:0/3391760358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 msgr2=0x55d19ce99b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc8dd9b640 1 --2- 172.21.15.123:0/3391760358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 0x55d19ce99b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc8dd9b640 1 -- 172.21.15.123:0/3391760358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce91050 msgr2=0x55d19cf09d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc8dd9b640 1 --2- 172.21.15.123:0/3391760358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce91050 0x55d19cf09d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc8dd9b640 1 -- 172.21.15.123:0/3391760358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d19cf0a240 con 0x55d19ce8bfc0 2024-08-18T22:14:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc8dd9b640 1 --2- 172.21.15.123:0/3391760358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8bfc0 0x55d19ce9a0b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400e490 tx=0x7fdc840bb050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d655d969e68727 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:14:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc75ffb640 1 -- 172.21.15.123:0/3391760358 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84004ac0 con 0x55d19ce8bfc0 2024-08-18T22:14:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc75ffb640 1 -- 172.21.15.123:0/3391760358 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fdc8400eca0 con 0x55d19ce8bfc0 2024-08-18T22:14:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc97819740 1 -- 172.21.15.123:0/3391760358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc840b3030 con 0x55d19ce8bfc0 2024-08-18T22:14:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc75ffb640 1 -- 172.21.15.123:0/3391760358 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdc8400eea0 con 0x55d19ce8bfc0 2024-08-18T22:14:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc97819740 10 client.16701 fetch_fsmap learned FSMap version 32 2024-08-18T22:14:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.816+0000 7fdc97819740 1 -- 172.21.15.123:0/3391760358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d19cf0b4d0 con 0x55d19ce8bfc0 2024-08-18T22:14:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.817+0000 7fdc75ffb640 1 -- 172.21.15.123:0/3391760358 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc840b3030 con 0x55d19ce8bfc0 2024-08-18T22:14:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.817+0000 7fdc75ffb640 1 -- 172.21.15.123:0/3391760358 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fdc8409e040 con 0x55d19ce8bfc0 2024-08-18T22:14:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.817+0000 7fdc97819740 10 client.16701 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:14:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.817+0000 7fdc97819740 10 client.16701 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:14:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.817+0000 7fdc97819740 20 client.16701 populate_metadata read hostname 'smithi123' 2024-08-18T22:14:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.817+0000 7fdc97819740 1 --2- 172.21.15.123:0/3391760358 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d19cf0bed0 0x55d19cf0e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.817+0000 7fdc97819740 4 client.16701 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:14:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.817+0000 7fdc97819740 1 -- 172.21.15.123:0/3391760358 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d19cdf6450 con 0x55d19cf0bed0 2024-08-18T22:14:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.817+0000 7fdc8e59c640 1 --2- 172.21.15.123:0/3391760358 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d19cf0bed0 0x55d19cf0e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.817+0000 7fdc8e59c640 1 --2- 172.21.15.123:0/3391760358 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d19cf0bed0 0x55d19cf0e2f0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=872422568e0686ab server_cookie=a73714bb058a67c4 in_seq=0 out_seq=0 2024-08-18T22:14:24.824 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:24.817+0000 7fdc75ffb640 10 client.16701 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:25.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:25 smithi123 ceph-mon[18462]: pgmap v539: 129 pgs: 129 active+clean; 186 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 1.10k op/s 2024-08-18T22:14:25.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:25 smithi130 ceph-mon[21698]: pgmap v539: 129 pgs: 129 active+clean; 186 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 1.10k op/s 2024-08-18T22:14:25.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:25 smithi183 ceph-mon[22097]: pgmap v539: 129 pgs: 129 active+clean; 186 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 1.10k op/s 2024-08-18T22:14:26.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.243+0000 7fdc75ffb640 1 -- 172.21.15.123:0/3391760358 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d19cdf6450 con 0x55d19cf0bed0 2024-08-18T22:14:26.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.243+0000 7fdc75ffb640 10 client.16701 handle_command_reply: tid=0 2024-08-18T22:14:26.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.244+0000 7fdc97819740 1 client.16701 shutdown 2024-08-18T22:14:26.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.245+0000 7fdc97819740 1 -- 172.21.15.123:0/3391760358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8bfc0 msgr2=0x55d19ce9a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:26.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.245+0000 7fdc97819740 1 --2- 172.21.15.123:0/3391760358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8bfc0 0x55d19ce9a0b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400e490 tx=0x7fdc840bb050 comp rx=0 tx=0).stop 2024-08-18T22:14:26.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.245+0000 7fdc97819740 1 -- 172.21.15.123:0/3391760358 shutdown_connections 2024-08-18T22:14:26.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.245+0000 7fdc97819740 1 --2- 172.21.15.123:0/3391760358 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55d19cf0bed0 0x55d19cf0e2f0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:26.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.245+0000 7fdc97819740 1 --2- 172.21.15.123:0/3391760358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19ce91050 0x55d19cf09d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:26.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.245+0000 7fdc97819740 1 --2- 172.21.15.123:0/3391760358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d19ce8bfc0 0x55d19ce9a0b0 secure :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400e490 tx=0x7fdc840bb050 comp rx=0 tx=0).stop 2024-08-18T22:14:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.245+0000 7fdc97819740 1 --2- 172.21.15.123:0/3391760358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d19ce8b680 0x55d19ce99b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.245+0000 7fdc97819740 1 -- 172.21.15.123:0/3391760358 >> 172.21.15.123:0/3391760358 conn(0x55d19ce86cf0 msgr2=0x55d19ce85680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.245+0000 7fdc75ffb640 0 client.16701 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.245+0000 7fdc97819740 1 -- 172.21.15.123:0/3391760358 shutdown_connections 2024-08-18T22:14:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.245+0000 7fdc97819740 1 -- 172.21.15.123:0/3391760358 wait complete. 2024-08-18T22:14:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.245+0000 7fdc97819740 20 client.16701 trim_cache size 0 max 16384 2024-08-18T22:14:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:14:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:14:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:14:26.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:14:26.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.247+0000 7fdc94a5c640 1 -- 172.21.15.123:0/2766146443 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdc780a2c30 msgr2=0x7fdc780a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:26.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.247+0000 7fdc94a5c640 1 --2- 172.21.15.123:0/2766146443 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdc780a2c30 0x7fdc780a50f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdc88005e30 tx=0x7fdc88031530 comp rx=0 tx=0).stop 2024-08-18T22:14:26.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.247+0000 7fdc94a5c640 1 -- 172.21.15.123:0/2766146443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc90101960 msgr2=0x7fdc9019a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:26.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.247+0000 7fdc94a5c640 1 --2- 172.21.15.123:0/2766146443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc90101960 0x7fdc9019a1f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdc840097d0 tx=0x7fdc84009c90 comp rx=0 tx=0).stop 2024-08-18T22:14:26.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.247+0000 7fdc94a5c640 1 -- 172.21.15.123:0/2766146443 shutdown_connections 2024-08-18T22:14:26.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.247+0000 7fdc94a5c640 1 --2- 172.21.15.123:0/2766146443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc90102320 0x7fdc901a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.247+0000 7fdc94a5c640 1 --2- 172.21.15.123:0/2766146443 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fdc780a2c30 0x7fdc780a50f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.247+0000 7fdc94a5c640 1 --2- 172.21.15.123:0/2766146443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc90101960 0x7fdc9019a1f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.247+0000 7fdc94a5c640 1 --2- 172.21.15.123:0/2766146443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc90100770 0x7fdc90199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.248+0000 7fdc94a5c640 1 -- 172.21.15.123:0/2766146443 >> 172.21.15.123:0/2766146443 conn(0x7fdc900fbf10 msgr2=0x7fdc90104c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.248+0000 7fdc94a5c640 1 -- 172.21.15.123:0/2766146443 shutdown_connections 2024-08-18T22:14:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:26.248+0000 7fdc94a5c640 1 -- 172.21.15.123:0/2766146443 wait complete. 2024-08-18T22:14:27.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:27 smithi123 ceph-mon[18462]: pgmap v540: 129 pgs: 129 active+clean; 189 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 849 op/s 2024-08-18T22:14:27.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:27 smithi130 ceph-mon[21698]: pgmap v540: 129 pgs: 129 active+clean; 189 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 849 op/s 2024-08-18T22:14:27.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:27 smithi183 ceph-mon[22097]: pgmap v540: 129 pgs: 129 active+clean; 189 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 849 op/s 2024-08-18T22:14:29.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:29 smithi123 ceph-mon[18462]: pgmap v541: 129 pgs: 129 active+clean; 192 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 892 op/s 2024-08-18T22:14:29.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:29 smithi130 ceph-mon[21698]: pgmap v541: 129 pgs: 129 active+clean; 192 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 892 op/s 2024-08-18T22:14:29.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:29 smithi183 ceph-mon[22097]: pgmap v541: 129 pgs: 129 active+clean; 192 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 892 op/s 2024-08-18T22:14:31.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:31 smithi123 ceph-mon[18462]: pgmap v542: 129 pgs: 129 active+clean; 192 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 968 op/s 2024-08-18T22:14:31.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:31 smithi130 ceph-mon[21698]: pgmap v542: 129 pgs: 129 active+clean; 192 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 968 op/s 2024-08-18T22:14:31.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:31 smithi183 ceph-mon[22097]: pgmap v542: 129 pgs: 129 active+clean; 192 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 968 op/s 2024-08-18T22:14:33.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:33 smithi123 ceph-mon[18462]: pgmap v543: 129 pgs: 129 active+clean; 192 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 964 op/s 2024-08-18T22:14:33.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:33 smithi130 ceph-mon[21698]: pgmap v543: 129 pgs: 129 active+clean; 192 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 964 op/s 2024-08-18T22:14:33.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:33 smithi183 ceph-mon[22097]: pgmap v543: 129 pgs: 129 active+clean; 192 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 964 op/s 2024-08-18T22:14:35.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:35 smithi123 ceph-mon[18462]: pgmap v544: 129 pgs: 129 active+clean; 196 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 1.06k op/s 2024-08-18T22:14:35.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:35 smithi130 ceph-mon[21698]: pgmap v544: 129 pgs: 129 active+clean; 196 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 1.06k op/s 2024-08-18T22:14:35.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:35 smithi183 ceph-mon[22097]: pgmap v544: 129 pgs: 129 active+clean; 196 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 1.06k op/s 2024-08-18T22:14:37.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:37 smithi123 ceph-mon[18462]: pgmap v545: 129 pgs: 129 active+clean; 205 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 902 op/s 2024-08-18T22:14:37.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:37 smithi130 ceph-mon[21698]: pgmap v545: 129 pgs: 129 active+clean; 205 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 902 op/s 2024-08-18T22:14:37.599 INFO:tasks.quiescer.fs.[cephfs]:Total duration (38.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-18T22:14:37.599 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.2 2024-08-18T22:14:37.599 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:14:37.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:37 smithi183 ceph-mon[22097]: pgmap v545: 129 pgs: 129 active+clean; 205 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 902 op/s 2024-08-18T22:14:37.886 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:14:38.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.474+0000 7ff445756640 1 -- 172.21.15.123:0/2857034674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff440102a80 msgr2=0x7ff440102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:38.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.474+0000 7ff445756640 1 --2- 172.21.15.123:0/2857034674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff440102a80 0x7ff440102e60 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ff430009900 tx=0x7ff43002a480 comp rx=0 tx=0).stop 2024-08-18T22:14:38.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.474+0000 7ff445756640 1 -- 172.21.15.123:0/2857034674 shutdown_connections 2024-08-18T22:14:38.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.474+0000 7ff445756640 1 --2- 172.21.15.123:0/2857034674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff44010beb0 0x7ff44010e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:38.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.474+0000 7ff445756640 1 --2- 172.21.15.123:0/2857034674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4401033a0 0x7ff44010b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:38.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.474+0000 7ff445756640 1 --2- 172.21.15.123:0/2857034674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff440102a80 0x7ff440102e60 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:38.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.474+0000 7ff445756640 1 -- 172.21.15.123:0/2857034674 >> 172.21.15.123:0/2857034674 conn(0x7ff4400fc500 msgr2=0x7ff4400fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:38.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.474+0000 7ff445756640 1 -- 172.21.15.123:0/2857034674 shutdown_connections 2024-08-18T22:14:38.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.474+0000 7ff445756640 1 -- 172.21.15.123:0/2857034674 wait complete. 2024-08-18T22:14:38.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.474+0000 7ff445756640 1 Processor -- start 2024-08-18T22:14:38.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.475+0000 7ff445756640 1 -- start start 2024-08-18T22:14:38.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.475+0000 7ff445756640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff440102a80 0x7ff440198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:38.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.475+0000 7ff445756640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4401033a0 0x7ff440198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:38.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.475+0000 7ff445756640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff44010beb0 0x7ff44019ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:38.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.475+0000 7ff445756640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff440111d00 con 0x7ff4401033a0 2024-08-18T22:14:38.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.475+0000 7ff445756640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff440111b80 con 0x7ff440102a80 2024-08-18T22:14:38.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.475+0000 7ff445756640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff440111e80 con 0x7ff44010beb0 2024-08-18T22:14:38.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.475+0000 7ff43e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4401033a0 0x7ff440198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:38.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.475+0000 7ff43effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff440102a80 0x7ff440198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:38.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.475+0000 7ff43e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4401033a0 0x7ff440198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36560/0 (socket says 172.21.15.123:36560) 2024-08-18T22:14:38.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.475+0000 7ff43effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff440102a80 0x7ff440198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:52914/0 (socket says 172.21.15.123:52914) 2024-08-18T22:14:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.475+0000 7ff43e7fc640 1 -- 172.21.15.123:0/3993150895 learned_addr learned my addr 172.21.15.123:0/3993150895 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.475+0000 7ff43f7fe640 1 --2- 172.21.15.123:0/3993150895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff44010beb0 0x7ff44019ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.475+0000 7ff43effd640 1 -- 172.21.15.123:0/3993150895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff44010beb0 msgr2=0x7ff44019ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.475+0000 7ff43effd640 1 --2- 172.21.15.123:0/3993150895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff44010beb0 0x7ff44019ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.476+0000 7ff43effd640 1 -- 172.21.15.123:0/3993150895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4401033a0 msgr2=0x7ff440198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.476+0000 7ff43effd640 1 --2- 172.21.15.123:0/3993150895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4401033a0 0x7ff440198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.476+0000 7ff43effd640 1 -- 172.21.15.123:0/3993150895 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff44019d0e0 con 0x7ff440102a80 2024-08-18T22:14:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.476+0000 7ff43e7fc640 1 --2- 172.21.15.123:0/3993150895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4401033a0 0x7ff440198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:14:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.476+0000 7ff43effd640 1 --2- 172.21.15.123:0/3993150895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff440102a80 0x7ff440198130 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff43002a9a0 tx=0x7ff430003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.476+0000 7ff427fff640 1 -- 172.21.15.123:0/3993150895 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43003f070 con 0x7ff440102a80 2024-08-18T22:14:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.476+0000 7ff427fff640 1 -- 172.21.15.123:0/3993150895 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff430031c90 con 0x7ff440102a80 2024-08-18T22:14:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.476+0000 7ff427fff640 1 -- 172.21.15.123:0/3993150895 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430035030 con 0x7ff440102a80 2024-08-18T22:14:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.476+0000 7ff445756640 1 -- 172.21.15.123:0/3993150895 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff44019d370 con 0x7ff440102a80 2024-08-18T22:14:38.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.476+0000 7ff445756640 1 -- 172.21.15.123:0/3993150895 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff440100610 con 0x7ff440102a80 2024-08-18T22:14:38.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.477+0000 7ff445756640 1 -- 172.21.15.123:0/3993150895 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff44006ada0 con 0x7ff440102a80 2024-08-18T22:14:38.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.479+0000 7ff427fff640 1 -- 172.21.15.123:0/3993150895 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7ff430042070 con 0x7ff440102a80 2024-08-18T22:14:38.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.479+0000 7ff427fff640 1 --2- 172.21.15.123:0/3993150895 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff4280a2c00 0x7ff4280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:38.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.479+0000 7ff427fff640 1 -- 172.21.15.123:0/3993150895 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ff4300f0230 con 0x7ff440102a80 2024-08-18T22:14:38.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.479+0000 7ff43e7fc640 1 --2- 172.21.15.123:0/3993150895 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff4280a2c00 0x7ff4280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:38.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.480+0000 7ff43e7fc640 1 --2- 172.21.15.123:0/3993150895 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff4280a2c00 0x7ff4280a50c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff44010d2f0 tx=0x7ff434005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:38.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.483+0000 7ff427fff640 1 -- 172.21.15.123:0/3993150895 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff4300bc7b0 con 0x7ff440102a80 2024-08-18T22:14:38.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.702+0000 7ff445756640 1 -- 172.21.15.123:0/3993150895 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff440106f50 con 0x7ff440102a80 2024-08-18T22:14:38.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.703+0000 7ff427fff640 1 -- 172.21.15.123:0/3993150895 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11928 (secure 0 0 0) 0x7ff4300c0ab0 con 0x7ff440102a80 2024-08-18T22:14:38.704 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:14:38.704 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":32,"btime":"2024-08-18T22:13:42:106357+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:13:41.668028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":125,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:14:38.704 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 32 2024-08-18T22:14:38.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.705+0000 7ff445756640 1 -- 172.21.15.123:0/3993150895 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff4280a2c00 msgr2=0x7ff4280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:38.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.705+0000 7ff445756640 1 --2- 172.21.15.123:0/3993150895 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff4280a2c00 0x7ff4280a50c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff44010d2f0 tx=0x7ff434005f90 comp rx=0 tx=0).stop 2024-08-18T22:14:38.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.705+0000 7ff445756640 1 -- 172.21.15.123:0/3993150895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff440102a80 msgr2=0x7ff440198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:38.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.705+0000 7ff445756640 1 --2- 172.21.15.123:0/3993150895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff440102a80 0x7ff440198130 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff43002a9a0 tx=0x7ff430003b20 comp rx=0 tx=0).stop 2024-08-18T22:14:38.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.705+0000 7ff445756640 1 -- 172.21.15.123:0/3993150895 shutdown_connections 2024-08-18T22:14:38.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.705+0000 7ff445756640 1 --2- 172.21.15.123:0/3993150895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff44010beb0 0x7ff44019ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:38.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.705+0000 7ff445756640 1 --2- 172.21.15.123:0/3993150895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4401033a0 0x7ff440198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:38.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.705+0000 7ff445756640 1 --2- 172.21.15.123:0/3993150895 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7ff4280a2c00 0x7ff4280a50c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:38.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.705+0000 7ff445756640 1 --2- 172.21.15.123:0/3993150895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff440102a80 0x7ff440198130 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:38.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.705+0000 7ff445756640 1 -- 172.21.15.123:0/3993150895 >> 172.21.15.123:0/3993150895 conn(0x7ff4400fc500 msgr2=0x7ff4400fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:38.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.705+0000 7ff445756640 1 -- 172.21.15.123:0/3993150895 shutdown_connections 2024-08-18T22:14:38.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:38.705+0000 7ff445756640 1 -- 172.21.15.123:0/3993150895 wait complete. 2024-08-18T22:14:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.353+0000 7f934f54b640 1 -- 172.21.15.123:0/866193070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93481000e0 msgr2=0x7f93481024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.353+0000 7f934f54b640 1 --2- 172.21.15.123:0/866193070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93481000e0 0x7f93481024f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9344009900 tx=0x7f934402a410 comp rx=0 tx=0).stop 2024-08-18T22:14:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.353+0000 7f934f54b640 1 -- 172.21.15.123:0/866193070 shutdown_connections 2024-08-18T22:14:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.353+0000 7f934f54b640 1 --2- 172.21.15.123:0/866193070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93481053e0 0x7f9348105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.353+0000 7f934f54b640 1 --2- 172.21.15.123:0/866193070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9348102a30 0x7f9348104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.353+0000 7f934f54b640 1 --2- 172.21.15.123:0/866193070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93481000e0 0x7f93481024f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.353+0000 7f934f54b640 1 -- 172.21.15.123:0/866193070 >> 172.21.15.123:0/866193070 conn(0x7f93480fbf10 msgr2=0x7f93480fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.353+0000 7f934f54b640 1 -- 172.21.15.123:0/866193070 shutdown_connections 2024-08-18T22:14:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.353+0000 7f934f54b640 1 -- 172.21.15.123:0/866193070 wait complete. 2024-08-18T22:14:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.354+0000 7f934f54b640 1 Processor -- start 2024-08-18T22:14:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.354+0000 7f934f54b640 1 -- start start 2024-08-18T22:14:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.354+0000 7f934f54b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93481000e0 0x7f934819e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.354+0000 7f934f54b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9348102a30 0x7f934819e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.354+0000 7f934f54b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93481053e0 0x7f93481a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.354+0000 7f934f54b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9348113ac0 con 0x7f93481053e0 2024-08-18T22:14:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.354+0000 7f934f54b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9348113940 con 0x7f93481000e0 2024-08-18T22:14:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.354+0000 7f934f54b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9348113c40 con 0x7f9348102a30 2024-08-18T22:14:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.354+0000 7f934dae8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93481053e0 0x7f93481a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.354+0000 7f934dae8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93481053e0 0x7f93481a56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36588/0 (socket says 172.21.15.123:36588) 2024-08-18T22:14:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.354+0000 7f934dae8640 1 -- 172.21.15.123:0/2495334048 learned_addr learned my addr 172.21.15.123:0/2495334048 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.354+0000 7f934cae6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9348102a30 0x7f934819e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.354+0000 7f934d2e7640 1 --2- 172.21.15.123:0/2495334048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93481000e0 0x7f934819e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.355+0000 7f934dae8640 1 -- 172.21.15.123:0/2495334048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9348102a30 msgr2=0x7f934819e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.355+0000 7f934dae8640 1 --2- 172.21.15.123:0/2495334048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9348102a30 0x7f934819e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.355+0000 7f934dae8640 1 -- 172.21.15.123:0/2495334048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93481000e0 msgr2=0x7f934819e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.355+0000 7f934dae8640 1 --2- 172.21.15.123:0/2495334048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93481000e0 0x7f934819e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.355+0000 7f934dae8640 1 -- 172.21.15.123:0/2495334048 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93481a5d30 con 0x7f93481053e0 2024-08-18T22:14:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.355+0000 7f934dae8640 1 --2- 172.21.15.123:0/2495334048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93481053e0 0x7f93481a56c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f934000eb10 tx=0x7f934000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.355+0000 7f933e7fc640 1 -- 172.21.15.123:0/2495334048 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340004b20 con 0x7f93481053e0 2024-08-18T22:14:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.355+0000 7f933e7fc640 1 -- 172.21.15.123:0/2495334048 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9340004cc0 con 0x7f93481053e0 2024-08-18T22:14:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.355+0000 7f934f54b640 1 -- 172.21.15.123:0/2495334048 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93481a5fc0 con 0x7f93481053e0 2024-08-18T22:14:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.355+0000 7f933e7fc640 1 -- 172.21.15.123:0/2495334048 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340010760 con 0x7f93481053e0 2024-08-18T22:14:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.355+0000 7f934f54b640 1 -- 172.21.15.123:0/2495334048 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93481a6490 con 0x7f93481053e0 2024-08-18T22:14:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.358+0000 7f933e7fc640 1 -- 172.21.15.123:0/2495334048 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f9340005020 con 0x7f93481053e0 2024-08-18T22:14:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.358+0000 7f93523e0740 1 Processor -- start 2024-08-18T22:14:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.358+0000 7f93523e0740 1 -- start start 2024-08-18T22:14:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.358+0000 7f93523e0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013c680 0x56048013ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.358+0000 7f93523e0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56048013cfc0 0x560480141a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.358+0000 7f93523e0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560480142050 0x560480144510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.358+0000 7f93523e0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56048009f9d0 con 0x56048013c680 2024-08-18T22:14:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.358+0000 7f93523e0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560480047820 con 0x56048013cfc0 2024-08-18T22:14:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.358+0000 7f93523e0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56048009b990 con 0x560480142050 2024-08-18T22:14:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.358+0000 7f934cae6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013c680 0x56048013ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.358+0000 7f934cae6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013c680 0x56048013ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36598/0 (socket says 172.21.15.123:36598) 2024-08-18T22:14:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.358+0000 7f934cae6640 1 -- 172.21.15.123:0/4026913093 learned_addr learned my addr 172.21.15.123:0/4026913093 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.358+0000 7f934d2e7640 1 --2- 172.21.15.123:0/4026913093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56048013cfc0 0x560480141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.358+0000 7f934cae6640 1 --2- 172.21.15.123:0/4026913093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560480142050 0x560480144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.359+0000 7f933e7fc640 1 --2- 172.21.15.123:0/2495334048 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f93340a2c30 0x7f93340a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.359+0000 7f934d2e7640 1 -- 172.21.15.123:0/4026913093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560480142050 msgr2=0x560480144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.359+0000 7f934d2e7640 1 --2- 172.21.15.123:0/4026913093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560480142050 0x560480144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.359+0000 7f934d2e7640 1 -- 172.21.15.123:0/4026913093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013c680 msgr2=0x56048013ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.359+0000 7f934d2e7640 1 --2- 172.21.15.123:0/4026913093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013c680 0x56048013ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.359+0000 7f934d2e7640 1 -- 172.21.15.123:0/4026913093 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56047fdb3210 con 0x56048013cfc0 2024-08-18T22:14:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.359+0000 7f934cae6640 1 --2- 172.21.15.123:0/4026913093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013c680 0x56048013ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:14:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.359+0000 7f934dae8640 1 --2- 172.21.15.123:0/2495334048 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f93340a2c30 0x7f93340a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.359+0000 7f933e7fc640 1 -- 172.21.15.123:0/2495334048 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f93400cf960 con 0x7f93481053e0 2024-08-18T22:14:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.359+0000 7f934d2e7640 1 --2- 172.21.15.123:0/4026913093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56048013cfc0 0x560480141a80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9344031440 tx=0x7f9344005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d92b8b880f3f73 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.359+0000 7f93337fe640 1 -- 172.21.15.123:0/4026913093 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344040070 con 0x56048013cfc0 2024-08-18T22:14:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.359+0000 7f93337fe640 1 -- 172.21.15.123:0/4026913093 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9344004030 con 0x56048013cfc0 2024-08-18T22:14:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.359+0000 7f93337fe640 1 -- 172.21.15.123:0/4026913093 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344035040 con 0x56048013cfc0 2024-08-18T22:14:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.360+0000 7f93523e0740 1 -- 172.21.15.123:0/4026913093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56048013cfc0 msgr2=0x560480141a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.360+0000 7f934dae8640 1 --2- 172.21.15.123:0/2495334048 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f93340a2c30 0x7f93340a50f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f934009bdc0 tx=0x7f9340005b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.360+0000 7f93523e0740 1 --2- 172.21.15.123:0/4026913093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56048013cfc0 0x560480141a80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9344031440 tx=0x7f9344005e00 comp rx=0 tx=0).stop 2024-08-18T22:14:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.360+0000 7f93523e0740 1 -- 172.21.15.123:0/4026913093 shutdown_connections 2024-08-18T22:14:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.360+0000 7f93523e0740 1 --2- 172.21.15.123:0/4026913093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560480142050 0x560480144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.360+0000 7f93523e0740 1 --2- 172.21.15.123:0/4026913093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56048013cfc0 0x560480141a80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.360+0000 7f93523e0740 1 --2- 172.21.15.123:0/4026913093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013c680 0x56048013ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.360+0000 7f93523e0740 1 -- 172.21.15.123:0/4026913093 >> 172.21.15.123:0/4026913093 conn(0x560480137cf0 msgr2=0x5604801380f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.360+0000 7f93523e0740 1 -- 172.21.15.123:0/4026913093 shutdown_connections 2024-08-18T22:14:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.360+0000 7f93523e0740 1 -- 172.21.15.123:0/4026913093 wait complete. 2024-08-18T22:14:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.360+0000 7f93523e0740 1 -- start start 2024-08-18T22:14:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f93523e0740 1 Processor -- start 2024-08-18T22:14:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f93523e0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56048013c680 0x560480146800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f93523e0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013cfc0 0x560480146d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f93523e0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560480142050 0x56048014dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f93523e0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x560480144fc0 con 0x560480142050 2024-08-18T22:14:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f93523e0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56048005b520 con 0x56048013c680 2024-08-18T22:14:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f93523e0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560480145140 con 0x56048013cfc0 2024-08-18T22:14:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f93523e0740 10 client.0 _ll_register_callbacks cb 0x56047fdb2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:14:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f934cae6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56048013c680 0x560480146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f934cae6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56048013c680 0x560480146800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:52954/0 (socket says 172.21.15.123:52954) 2024-08-18T22:14:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f934cae6640 1 -- 172.21.15.123:0/994922357 learned_addr learned my addr 172.21.15.123:0/994922357 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f934cae6640 1 --2- 172.21.15.123:0/994922357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560480142050 0x56048014dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f934d2e7640 1 --2- 172.21.15.123:0/994922357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013cfc0 0x560480146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f934cae6640 1 -- 172.21.15.123:0/994922357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013cfc0 msgr2=0x560480146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f934cae6640 1 --2- 172.21.15.123:0/994922357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013cfc0 0x560480146d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f934cae6640 1 -- 172.21.15.123:0/994922357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560480142050 msgr2=0x56048014dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f934cae6640 1 --2- 172.21.15.123:0/994922357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560480142050 0x56048014dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.361+0000 7f934cae6640 1 -- 172.21.15.123:0/994922357 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56047fe7f620 con 0x56048013c680 2024-08-18T22:14:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f934cae6640 1 --2- 172.21.15.123:0/994922357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56048013c680 0x560480146800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9338013fd0 tx=0x7f9338009950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15b6a46bbcef2325 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f9330ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:14:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f9330ff9640 1 -- 172.21.15.123:0/994922357 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338005020 con 0x56048013c680 2024-08-18T22:14:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f93523e0740 1 -- 172.21.15.123:0/994922357 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9344004030 con 0x56048013c680 2024-08-18T22:14:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f9330ff9640 1 -- 172.21.15.123:0/994922357 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f93380051c0 con 0x56048013c680 2024-08-18T22:14:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f9330ff9640 1 -- 172.21.15.123:0/994922357 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f933802a050 con 0x56048013c680 2024-08-18T22:14:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f93523e0740 10 client.26027 fetch_fsmap learned FSMap version 32 2024-08-18T22:14:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f93523e0740 1 -- 172.21.15.123:0/994922357 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560480150c30 con 0x56048013c680 2024-08-18T22:14:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f9330ff9640 1 -- 172.21.15.123:0/994922357 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9344004030 con 0x56048013c680 2024-08-18T22:14:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f9330ff9640 1 -- 172.21.15.123:0/994922357 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f933800f5d0 con 0x56048013c680 2024-08-18T22:14:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f93523e0740 10 client.26027 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:14:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f93523e0740 10 client.26027 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:14:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f93523e0740 20 client.26027 populate_metadata read hostname 'smithi123' 2024-08-18T22:14:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f93523e0740 1 --2- 172.21.15.123:0/994922357 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560480152330 0x560480154790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f93523e0740 4 client.26027 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:14:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.362+0000 7f93523e0740 1 -- 172.21.15.123:0/994922357 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604800ad100 con 0x560480152330 2024-08-18T22:14:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.363+0000 7f934d2e7640 1 --2- 172.21.15.123:0/994922357 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560480152330 0x560480154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.363+0000 7f9330ff9640 10 client.26027 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.363+0000 7f934d2e7640 1 --2- 172.21.15.123:0/994922357 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560480152330 0x560480154790 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f187b70b43e995b6 server_cookie=32832c02b970f8fb in_seq=0 out_seq=0 2024-08-18T22:14:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.364+0000 7f9330ff9640 1 -- 172.21.15.123:0/994922357 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604800ad100 con 0x560480152330 2024-08-18T22:14:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.364+0000 7f9330ff9640 10 client.26027 handle_command_reply: tid=0 2024-08-18T22:14:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.364+0000 7f93523e0740 1 client.26027 shutdown 2024-08-18T22:14:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.364+0000 7f93523e0740 1 -- 172.21.15.123:0/994922357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56048013c680 msgr2=0x560480146800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.364+0000 7f93523e0740 1 --2- 172.21.15.123:0/994922357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56048013c680 0x560480146800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9338013fd0 tx=0x7f9338009950 comp rx=0 tx=0).stop 2024-08-18T22:14:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.364+0000 7f93523e0740 1 -- 172.21.15.123:0/994922357 shutdown_connections 2024-08-18T22:14:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.364+0000 7f93523e0740 1 --2- 172.21.15.123:0/994922357 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x560480152330 0x560480154790 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.364+0000 7f93523e0740 1 --2- 172.21.15.123:0/994922357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560480142050 0x56048014dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.364+0000 7f93523e0740 1 --2- 172.21.15.123:0/994922357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013cfc0 0x560480146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.364+0000 7f93523e0740 1 --2- 172.21.15.123:0/994922357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56048013c680 0x560480146800 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.364+0000 7f9330ff9640 0 client.26027 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.364+0000 7f93523e0740 1 -- 172.21.15.123:0/994922357 >> 172.21.15.123:0/994922357 conn(0x560480137cf0 msgr2=0x560480139500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.364+0000 7f93523e0740 1 -- 172.21.15.123:0/994922357 shutdown_connections 2024-08-18T22:14:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.364+0000 7f93523e0740 1 -- 172.21.15.123:0/994922357 wait complete. 2024-08-18T22:14:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.364+0000 7f93523e0740 20 client.26027 trim_cache size 0 max 16384 2024-08-18T22:14:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.380+0000 7f93523e0740 1 Processor -- start 2024-08-18T22:14:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.380+0000 7f93523e0740 1 -- start start 2024-08-18T22:14:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.380+0000 7f93523e0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013c680 0x560480136680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.380+0000 7f93523e0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013cfc0 0x56048014dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.380+0000 7f93523e0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560480142050 0x560480136bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.380+0000 7f93523e0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f93481b33d0 con 0x56048013c680 2024-08-18T22:14:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.380+0000 7f93523e0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f93481b0be0 con 0x560480142050 2024-08-18T22:14:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.380+0000 7f93523e0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f93481aea30 con 0x56048013cfc0 2024-08-18T22:14:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.380+0000 7f934cae6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013c680 0x560480136680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.380+0000 7f934cae6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013c680 0x560480136680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36608/0 (socket says 172.21.15.123:36608) 2024-08-18T22:14:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.380+0000 7f934d2e7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013cfc0 0x56048014dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.380+0000 7f934cae6640 1 -- 172.21.15.123:0/1259273557 learned_addr learned my addr 172.21.15.123:0/1259273557 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.380+0000 7f934cae6640 1 --2- 172.21.15.123:0/1259273557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560480142050 0x560480136bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.381+0000 7f934d2e7640 1 -- 172.21.15.123:0/1259273557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560480142050 msgr2=0x560480136bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.381+0000 7f934d2e7640 1 --2- 172.21.15.123:0/1259273557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560480142050 0x560480136bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.381+0000 7f934d2e7640 1 -- 172.21.15.123:0/1259273557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013c680 msgr2=0x560480136680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.381+0000 7f934d2e7640 1 --2- 172.21.15.123:0/1259273557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013c680 0x560480136680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.381+0000 7f934d2e7640 1 -- 172.21.15.123:0/1259273557 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560480150a30 con 0x56048013cfc0 2024-08-18T22:14:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.381+0000 7f934cae6640 1 --2- 172.21.15.123:0/1259273557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013c680 0x560480136680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:14:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.381+0000 7f934d2e7640 1 --2- 172.21.15.123:0/1259273557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013cfc0 0x56048014dcf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f934402a930 tx=0x7f93440315d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46439a84679dc679 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.381+0000 7f9332ffd640 1 -- 172.21.15.123:0/1259273557 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344040050 con 0x56048013cfc0 2024-08-18T22:14:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.381+0000 7f9332ffd640 1 -- 172.21.15.123:0/1259273557 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93440318b0 con 0x56048013cfc0 2024-08-18T22:14:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.381+0000 7f9332ffd640 1 -- 172.21.15.123:0/1259273557 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344035040 con 0x56048013cfc0 2024-08-18T22:14:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.382+0000 7f93523e0740 1 -- 172.21.15.123:0/1259273557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013cfc0 msgr2=0x56048014dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.382+0000 7f93523e0740 1 --2- 172.21.15.123:0/1259273557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013cfc0 0x56048014dcf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f934402a930 tx=0x7f93440315d0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.382+0000 7f93523e0740 1 -- 172.21.15.123:0/1259273557 shutdown_connections 2024-08-18T22:14:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.382+0000 7f93523e0740 1 --2- 172.21.15.123:0/1259273557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560480142050 0x560480136bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.382+0000 7f93523e0740 1 --2- 172.21.15.123:0/1259273557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013cfc0 0x56048014dcf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.382+0000 7f93523e0740 1 --2- 172.21.15.123:0/1259273557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013c680 0x560480136680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.382+0000 7f93523e0740 1 -- 172.21.15.123:0/1259273557 >> 172.21.15.123:0/1259273557 conn(0x560480137cf0 msgr2=0x5604801465b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.382+0000 7f93523e0740 1 -- 172.21.15.123:0/1259273557 shutdown_connections 2024-08-18T22:14:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.382+0000 7f93523e0740 1 -- 172.21.15.123:0/1259273557 wait complete. 2024-08-18T22:14:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.382+0000 7f93523e0740 1 -- start start 2024-08-18T22:14:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.382+0000 7f93523e0740 1 Processor -- start 2024-08-18T22:14:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f93523e0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013c680 0x56048014b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f93523e0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013cfc0 0x56048014bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f93523e0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560480142050 0x56048014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f93523e0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f93481af0a0 con 0x56048013cfc0 2024-08-18T22:14:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f93523e0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f93481b0510 con 0x560480142050 2024-08-18T22:14:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f93523e0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f93481af770 con 0x56048013c680 2024-08-18T22:14:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f93523e0740 10 client.0 _ll_register_callbacks cb 0x7f9338013be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:14:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f934d2e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013cfc0 0x56048014bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f934d2e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013cfc0 0x56048014bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36624/0 (socket says 172.21.15.123:36624) 2024-08-18T22:14:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f934d2e7640 1 -- 172.21.15.123:0/3080760094 learned_addr learned my addr 172.21.15.123:0/3080760094 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f934cae6640 1 --2- 172.21.15.123:0/3080760094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560480142050 0x56048014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f934cae6640 1 --2- 172.21.15.123:0/3080760094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013c680 0x56048014b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f934d2e7640 1 -- 172.21.15.123:0/3080760094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013c680 msgr2=0x56048014b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f934d2e7640 1 --2- 172.21.15.123:0/3080760094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013c680 0x56048014b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f934d2e7640 1 -- 172.21.15.123:0/3080760094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560480142050 msgr2=0x56048014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f934d2e7640 1 --2- 172.21.15.123:0/3080760094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560480142050 0x56048014ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f934d2e7640 1 -- 172.21.15.123:0/3080760094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56048014d080 con 0x56048013cfc0 2024-08-18T22:14:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f934d2e7640 1 --2- 172.21.15.123:0/3080760094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013cfc0 0x56048014bad0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f93440096c0 tx=0x7f93440058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76167715216fec71 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f9330ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:14:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f9330ff9640 1 -- 172.21.15.123:0/3080760094 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344035070 con 0x56048013cfc0 2024-08-18T22:14:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f9330ff9640 1 -- 172.21.15.123:0/3080760094 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f9344005030 con 0x56048013cfc0 2024-08-18T22:14:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.383+0000 7f93523e0740 1 -- 172.21.15.123:0/3080760094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93440318b0 con 0x56048013cfc0 2024-08-18T22:14:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.384+0000 7f9330ff9640 1 -- 172.21.15.123:0/3080760094 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9344040040 con 0x56048013cfc0 2024-08-18T22:14:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.384+0000 7f93523e0740 10 client.16725 fetch_fsmap learned FSMap version 32 2024-08-18T22:14:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.384+0000 7f93523e0740 1 -- 172.21.15.123:0/3080760094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5604801bd030 con 0x56048013cfc0 2024-08-18T22:14:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.384+0000 7f9330ff9640 1 -- 172.21.15.123:0/3080760094 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93440318b0 con 0x56048013cfc0 2024-08-18T22:14:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.384+0000 7f9330ff9640 1 -- 172.21.15.123:0/3080760094 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f934405b030 con 0x56048013cfc0 2024-08-18T22:14:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.384+0000 7f93523e0740 10 client.16725 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:14:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.384+0000 7f93523e0740 10 client.16725 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:14:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.384+0000 7f93523e0740 20 client.16725 populate_metadata read hostname 'smithi123' 2024-08-18T22:14:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.384+0000 7f93523e0740 1 --2- 172.21.15.123:0/3080760094 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5604801bd650 0x5604801bfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.384+0000 7f93523e0740 4 client.16725 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:14:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.384+0000 7f93523e0740 1 -- 172.21.15.123:0/3080760094 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5604800a7450 con 0x5604801bd650 2024-08-18T22:14:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.384+0000 7f934cae6640 1 --2- 172.21.15.123:0/3080760094 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5604801bd650 0x5604801bfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.385+0000 7f9330ff9640 10 client.16725 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:39.385+0000 7f934cae6640 1 --2- 172.21.15.123:0/3080760094 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5604801bd650 0x5604801bfa40 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b56b9c238204140b server_cookie=4fc9dc235c012534 in_seq=0 out_seq=0 2024-08-18T22:14:39.450 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:39 smithi123 ceph-mon[18462]: pgmap v546: 129 pgs: 129 active+clean; 208 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 931 op/s 2024-08-18T22:14:39.450 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:39 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3993150895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:14:39.483 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db / --timeout 90 --expiration 139.2 --await-for 45.0' 2024-08-18T22:14:39.483 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24466 quiesce db / --timeout 90 --expiration 139.2 --await-for 45.0 2024-08-18T22:14:39.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:39 smithi130 ceph-mon[21698]: pgmap v546: 129 pgs: 129 active+clean; 208 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 931 op/s 2024-08-18T22:14:39.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:39 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3993150895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:14:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:39 smithi183 ceph-mon[22097]: pgmap v546: 129 pgs: 129 active+clean; 208 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 931 op/s 2024-08-18T22:14:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:39 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3993150895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:14:39.891 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:14:40.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.693+0000 7f0177fff640 1 -- 172.21.15.123:0/2822591512 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c003650 con 0x7f018011ae70 2024-08-18T22:14:40.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.694+0000 7f0187537640 1 -- 172.21.15.123:0/2822591512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f018011ae70 msgr2=0x7f018011d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:40.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.694+0000 7f0187537640 1 --2- 172.21.15.123:0/2822591512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f018011ae70 0x7f018011d260 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f017c009900 tx=0x7f017c02a440 comp rx=0 tx=0).stop 2024-08-18T22:14:40.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.694+0000 7f0187537640 1 -- 172.21.15.123:0/2822591512 shutdown_connections 2024-08-18T22:14:40.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.694+0000 7f0187537640 1 --2- 172.21.15.123:0/2822591512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f018011ae70 0x7f018011d260 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.694+0000 7f0187537640 1 --2- 172.21.15.123:0/2822591512 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0180109560 0x7f01801099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.694+0000 7f0187537640 1 --2- 172.21.15.123:0/2822591512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0180109180 0x7f018010ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.694+0000 7f0187537640 1 -- 172.21.15.123:0/2822591512 >> 172.21.15.123:0/2822591512 conn(0x7f018006de70 msgr2=0x7f018006e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:40.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.694+0000 7f0187537640 1 -- 172.21.15.123:0/2822591512 shutdown_connections 2024-08-18T22:14:40.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.694+0000 7f0187537640 1 -- 172.21.15.123:0/2822591512 wait complete. 2024-08-18T22:14:40.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.695+0000 7f0187537640 1 Processor -- start 2024-08-18T22:14:40.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.695+0000 7f0187537640 1 -- start start 2024-08-18T22:14:40.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.695+0000 7f0187537640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0180109180 0x7f0180118390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.695+0000 7f0187537640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0180109560 0x7f01801188d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.695+0000 7f0187537640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f018011ae70 0x7f01801115b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.695+0000 7f0187537640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0180120b10 con 0x7f0180109560 2024-08-18T22:14:40.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.695+0000 7f0187537640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0180120990 con 0x7f0180109180 2024-08-18T22:14:40.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.695+0000 7f0187537640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0180120c90 con 0x7f018011ae70 2024-08-18T22:14:40.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.696+0000 7f0184ad2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0180109560 0x7f01801188d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:40.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.696+0000 7f0184ad2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0180109560 0x7f01801188d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36656/0 (socket says 172.21.15.123:36656) 2024-08-18T22:14:40.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.696+0000 7f0184ad2640 1 -- 172.21.15.123:0/2325711476 learned_addr learned my addr 172.21.15.123:0/2325711476 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:40.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.696+0000 7f0185ad4640 1 --2- 172.21.15.123:0/2325711476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f018011ae70 0x7f01801115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:40.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.697+0000 7f0184ad2640 1 -- 172.21.15.123:0/2325711476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f018011ae70 msgr2=0x7f01801115b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:40.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.697+0000 7f0184ad2640 1 --2- 172.21.15.123:0/2325711476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f018011ae70 0x7f01801115b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.697+0000 7f0184ad2640 1 -- 172.21.15.123:0/2325711476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0180109180 msgr2=0x7f0180118390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:40.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.697+0000 7f0184ad2640 1 --2- 172.21.15.123:0/2325711476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0180109180 0x7f0180118390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.697+0000 7f0184ad2640 1 -- 172.21.15.123:0/2325711476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0180111e70 con 0x7f0180109560 2024-08-18T22:14:40.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.697+0000 7f0184ad2640 1 --2- 172.21.15.123:0/2325711476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0180109560 0x7f01801188d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f017000e9f0 tx=0x7f017000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:40.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.698+0000 7f01767fc640 1 -- 172.21.15.123:0/2325711476 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017000cd80 con 0x7f0180109560 2024-08-18T22:14:40.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.698+0000 7f01767fc640 1 -- 172.21.15.123:0/2325711476 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0170010910 con 0x7f0180109560 2024-08-18T22:14:40.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.698+0000 7f01767fc640 1 -- 172.21.15.123:0/2325711476 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170018980 con 0x7f0180109560 2024-08-18T22:14:40.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.698+0000 7f0187537640 1 -- 172.21.15.123:0/2325711476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0180112160 con 0x7f0180109560 2024-08-18T22:14:40.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.698+0000 7f0187537640 1 -- 172.21.15.123:0/2325711476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0180116140 con 0x7f0180109560 2024-08-18T22:14:40.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.702+0000 7f0189935740 1 Processor -- start 2024-08-18T22:14:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.704+0000 7f0189935740 1 -- start start 2024-08-18T22:14:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.704+0000 7f01767fc640 1 -- 172.21.15.123:0/2325711476 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f0170018b20 con 0x7f0180109560 2024-08-18T22:14:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.704+0000 7f0189935740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b562b130 0x55f8b562b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.704+0000 7f0189935740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562ba50 0x55f8b5635dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.704+0000 7f0189935740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b5638700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.704+0000 7f0189935740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f8b5590a70 con 0x55f8b5636310 2024-08-18T22:14:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.704+0000 7f0189935740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f8b5528780 con 0x55f8b562ba50 2024-08-18T22:14:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.704+0000 7f0189935740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f8b558ca30 con 0x55f8b562b130 2024-08-18T22:14:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.704+0000 7f0184ad2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b5638700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.705+0000 7f0185ad4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b562b130 0x55f8b562b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.705+0000 7f0185ad4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b562b130 0x55f8b562b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:40732/0 (socket says 172.21.15.123:40732) 2024-08-18T22:14:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.705+0000 7f01852d3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562ba50 0x55f8b5635dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.705+0000 7f01852d3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562ba50 0x55f8b5635dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:52990/0 (socket says 172.21.15.123:52990) 2024-08-18T22:14:40.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.705+0000 7f01852d3640 1 -- 172.21.15.123:0/569874834 learned_addr learned my addr 172.21.15.123:0/569874834 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:40.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.705+0000 7f0184ad2640 1 -- 172.21.15.123:0/569874834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b562b130 msgr2=0x55f8b562b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:40.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.705+0000 7f0184ad2640 1 --2- 172.21.15.123:0/569874834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b562b130 0x55f8b562b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.705+0000 7f0184ad2640 1 -- 172.21.15.123:0/569874834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562ba50 msgr2=0x55f8b5635dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:40.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.705+0000 7f0184ad2640 1 --2- 172.21.15.123:0/569874834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562ba50 0x55f8b5635dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.705+0000 7f0184ad2640 1 -- 172.21.15.123:0/569874834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b5302b90 con 0x55f8b5636310 2024-08-18T22:14:40.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.706+0000 7f0184ad2640 1 --2- 172.21.15.123:0/569874834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b5638700 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f01700ccd80 tx=0x7f01700d5bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200a78b61eccaac6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:40.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.706+0000 7f01767fc640 1 --2- 172.21.15.123:0/2325711476 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f016c0a2d90 0x7f016c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.706+0000 7f016b7fe640 1 -- 172.21.15.123:0/569874834 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01700e2070 con 0x55f8b5636310 2024-08-18T22:14:40.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.706+0000 7f016b7fe640 1 -- 172.21.15.123:0/569874834 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01700a47b0 con 0x55f8b5636310 2024-08-18T22:14:40.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.706+0000 7f016b7fe640 1 -- 172.21.15.123:0/569874834 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170099e40 con 0x55f8b5636310 2024-08-18T22:14:40.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.707+0000 7f01767fc640 1 -- 172.21.15.123:0/2325711476 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f01700cf6d0 con 0x7f0180109560 2024-08-18T22:14:40.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.707+0000 7f0189935740 1 -- 172.21.15.123:0/569874834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 msgr2=0x55f8b5638700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:40.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.707+0000 7f0189935740 1 --2- 172.21.15.123:0/569874834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b5638700 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f01700ccd80 tx=0x7f01700d5bb0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.710+0000 7f0189935740 1 -- 172.21.15.123:0/569874834 shutdown_connections 2024-08-18T22:14:40.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.710+0000 7f0189935740 1 --2- 172.21.15.123:0/569874834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b5638700 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.710+0000 7f0189935740 1 --2- 172.21.15.123:0/569874834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562ba50 0x55f8b5635dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.710+0000 7f0189935740 1 --2- 172.21.15.123:0/569874834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b562b130 0x55f8b562b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.710+0000 7f0189935740 1 -- 172.21.15.123:0/569874834 >> 172.21.15.123:0/569874834 conn(0x55f8b56276c0 msgr2=0x55f8b5627aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:40.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.710+0000 7f0185ad4640 1 --2- 172.21.15.123:0/2325711476 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f016c0a2d90 0x7f016c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:40.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.711+0000 7f0189935740 1 -- 172.21.15.123:0/569874834 shutdown_connections 2024-08-18T22:14:40.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.711+0000 7f0189935740 1 -- 172.21.15.123:0/569874834 wait complete. 2024-08-18T22:14:40.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.711+0000 7f0189935740 1 -- start start 2024-08-18T22:14:40.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.711+0000 7f0185ad4640 1 --2- 172.21.15.123:0/2325711476 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f016c0a2d90 0x7f016c0a5250 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f017c02aa30 tx=0x7f017c02a940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:40.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.711+0000 7f0189935740 1 Processor -- start 2024-08-18T22:14:40.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.712+0000 7f0189935740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562b130 0x55f8b56331f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.712+0000 7f0189935740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b562ba50 0x55f8b5633730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.712+0000 7f0189935740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b5633c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.712+0000 7f0189935740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f8b5638ee0 con 0x55f8b5636310 2024-08-18T22:14:40.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.712+0000 7f0189935740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f8b554b990 con 0x55f8b562b130 2024-08-18T22:14:40.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.712+0000 7f0189935740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f8b5639060 con 0x55f8b562ba50 2024-08-18T22:14:40.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.712+0000 7f0189935740 10 client.0 _ll_register_callbacks cb 0x55f8b52a0090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:14:40.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.712+0000 7f0185ad4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b5633c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:40.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.712+0000 7f0185ad4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b5633c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36686/0 (socket says 172.21.15.123:36686) 2024-08-18T22:14:40.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.712+0000 7f0185ad4640 1 -- 172.21.15.123:0/1965729338 learned_addr learned my addr 172.21.15.123:0/1965729338 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:40.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.713+0000 7f0185ad4640 1 -- 172.21.15.123:0/1965729338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b562ba50 msgr2=0x55f8b5633730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T22:14:40.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.713+0000 7f0185ad4640 1 --2- 172.21.15.123:0/1965729338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b562ba50 0x55f8b5633730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.713+0000 7f0185ad4640 1 -- 172.21.15.123:0/1965729338 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562b130 msgr2=0x55f8b56331f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T22:14:40.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.713+0000 7f0185ad4640 1 --2- 172.21.15.123:0/1965729338 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562b130 0x55f8b56331f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.713+0000 7f0185ad4640 1 -- 172.21.15.123:0/1965729338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8b554a6c0 con 0x55f8b5636310 2024-08-18T22:14:40.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.714+0000 7f0185ad4640 1 --2- 172.21.15.123:0/1965729338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b5633c70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f017c032000 tx=0x7f017c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4b546b25fcd9fb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:40.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.714+0000 7f0168ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:14:40.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.714+0000 7f0168ff9640 1 -- 172.21.15.123:0/1965729338 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c005570 con 0x55f8b5636310 2024-08-18T22:14:40.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.714+0000 7f0168ff9640 1 -- 172.21.15.123:0/1965729338 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f017c0035f0 con 0x55f8b5636310 2024-08-18T22:14:40.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.714+0000 7f0189935740 1 -- 172.21.15.123:0/1965729338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01700a47b0 con 0x55f8b5636310 2024-08-18T22:14:40.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.715+0000 7f0168ff9640 1 -- 172.21.15.123:0/1965729338 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f017c0037f0 con 0x55f8b5636310 2024-08-18T22:14:40.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.715+0000 7f0189935740 10 client.16737 fetch_fsmap learned FSMap version 32 2024-08-18T22:14:40.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.715+0000 7f0189935740 1 -- 172.21.15.123:0/1965729338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f8b5644c20 con 0x55f8b5636310 2024-08-18T22:14:40.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.716+0000 7f0168ff9640 1 -- 172.21.15.123:0/1965729338 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01700a47b0 con 0x55f8b5636310 2024-08-18T22:14:40.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.716+0000 7f0168ff9640 1 -- 172.21.15.123:0/1965729338 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f017c044030 con 0x55f8b5636310 2024-08-18T22:14:40.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.716+0000 7f0189935740 10 client.16737 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:14:40.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.716+0000 7f0189935740 10 client.16737 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:14:40.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.716+0000 7f0189935740 20 client.16737 populate_metadata read hostname 'smithi123' 2024-08-18T22:14:40.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.716+0000 7f0189935740 1 --2- 172.21.15.123:0/1965729338 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f8b5646550 0x55f8b5648a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.716+0000 7f0189935740 4 client.16737 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:14:40.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.716+0000 7f0189935740 1 -- 172.21.15.123:0/1965729338 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8b559e1a0 con 0x55f8b5646550 2024-08-18T22:14:40.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.722+0000 7f01852d3640 1 --2- 172.21.15.123:0/1965729338 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f8b5646550 0x55f8b5648a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:40.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.725+0000 7f01852d3640 1 --2- 172.21.15.123:0/1965729338 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f8b5646550 0x55f8b5648a10 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e3f494940cd436e server_cookie=f52f26c5807c1339 in_seq=0 out_seq=0 2024-08-18T22:14:40.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.725+0000 7f0168ff9640 10 client.16737 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:40.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.726+0000 7f0168ff9640 1 -- 172.21.15.123:0/1965729338 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f8b559e1a0 con 0x55f8b5646550 2024-08-18T22:14:40.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.727+0000 7f0168ff9640 10 client.16737 handle_command_reply: tid=0 2024-08-18T22:14:40.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.727+0000 7f0189935740 1 client.16737 shutdown 2024-08-18T22:14:40.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.728+0000 7f0189935740 1 -- 172.21.15.123:0/1965729338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 msgr2=0x55f8b5633c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:40.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.728+0000 7f0189935740 1 --2- 172.21.15.123:0/1965729338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b5633c70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f017c032000 tx=0x7f017c009260 comp rx=0 tx=0).stop 2024-08-18T22:14:40.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.728+0000 7f0189935740 1 -- 172.21.15.123:0/1965729338 shutdown_connections 2024-08-18T22:14:40.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.728+0000 7f0189935740 1 --2- 172.21.15.123:0/1965729338 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f8b5646550 0x55f8b5648a10 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.728+0000 7f0189935740 1 --2- 172.21.15.123:0/1965729338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b5633c70 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.728+0000 7f0189935740 1 --2- 172.21.15.123:0/1965729338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b562ba50 0x55f8b5633730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.728+0000 7f0189935740 1 --2- 172.21.15.123:0/1965729338 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562b130 0x55f8b56331f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.728+0000 7f0189935740 1 -- 172.21.15.123:0/1965729338 >> 172.21.15.123:0/1965729338 conn(0x55f8b56276c0 msgr2=0x55f8b562d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:40.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.729+0000 7f0168ff9640 0 client.16737 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:40.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.729+0000 7f0189935740 1 -- 172.21.15.123:0/1965729338 shutdown_connections 2024-08-18T22:14:40.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.729+0000 7f0189935740 1 -- 172.21.15.123:0/1965729338 wait complete. 2024-08-18T22:14:40.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.729+0000 7f0189935740 20 client.16737 trim_cache size 0 max 16384 2024-08-18T22:14:40.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.764+0000 7f0189935740 1 Processor -- start 2024-08-18T22:14:40.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.764+0000 7f0189935740 1 -- start start 2024-08-18T22:14:40.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.764+0000 7f0189935740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562b130 0x55f8b56265e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.764+0000 7f0189935740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b562ba50 0x55f8b564e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.764+0000 7f0189935740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b564e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.764+0000 7f0189935740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0164012660 con 0x55f8b5636310 2024-08-18T22:14:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.764+0000 7f0189935740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f016400fe70 con 0x55f8b562b130 2024-08-18T22:14:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.764+0000 7f0189935740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f016400dcc0 con 0x55f8b562ba50 2024-08-18T22:14:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.764+0000 7f0185ad4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b564e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.765+0000 7f0185ad4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b564e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36688/0 (socket says 172.21.15.123:36688) 2024-08-18T22:14:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.765+0000 7f0185ad4640 1 -- 172.21.15.123:0/1022332858 learned_addr learned my addr 172.21.15.123:0/1022332858 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.765+0000 7f0185ad4640 1 -- 172.21.15.123:0/1022332858 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b562ba50 msgr2=0x55f8b564e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.765+0000 7f0185ad4640 1 --2- 172.21.15.123:0/1022332858 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b562ba50 0x55f8b564e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.765+0000 7f0185ad4640 1 -- 172.21.15.123:0/1022332858 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562b130 msgr2=0x55f8b56265e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T22:14:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.765+0000 7f0185ad4640 1 --2- 172.21.15.123:0/1022332858 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562b130 0x55f8b56265e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.765+0000 7f0185ad4640 1 -- 172.21.15.123:0/1022332858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b56321a0 con 0x55f8b5636310 2024-08-18T22:14:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.766+0000 7f0185ad4640 1 --2- 172.21.15.123:0/1022332858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b564e860 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f017c0096c0 tx=0x7f017c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248974aa666f5fea server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.768+0000 7f016affd640 1 -- 172.21.15.123:0/1022332858 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c031440 con 0x55f8b5636310 2024-08-18T22:14:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.768+0000 7f016affd640 1 -- 172.21.15.123:0/1022332858 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f017c04c070 con 0x55f8b5636310 2024-08-18T22:14:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.768+0000 7f016affd640 1 -- 172.21.15.123:0/1022332858 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c0056f0 con 0x55f8b5636310 2024-08-18T22:14:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.769+0000 7f0189935740 1 -- 172.21.15.123:0/1022332858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 msgr2=0x55f8b564e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.769+0000 7f0189935740 1 --2- 172.21.15.123:0/1022332858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b564e860 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f017c0096c0 tx=0x7f017c009780 comp rx=0 tx=0).stop 2024-08-18T22:14:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.770+0000 7f0189935740 1 -- 172.21.15.123:0/1022332858 shutdown_connections 2024-08-18T22:14:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.770+0000 7f0189935740 1 --2- 172.21.15.123:0/1022332858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b5636310 0x55f8b564e860 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.770+0000 7f0189935740 1 --2- 172.21.15.123:0/1022332858 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b562ba50 0x55f8b564e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.770+0000 7f0189935740 1 --2- 172.21.15.123:0/1022332858 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562b130 0x55f8b56265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.770+0000 7f0189935740 1 -- 172.21.15.123:0/1022332858 >> 172.21.15.123:0/1022332858 conn(0x55f8b56276c0 msgr2=0x55f8b5625ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.770+0000 7f0189935740 1 -- 172.21.15.123:0/1022332858 shutdown_connections 2024-08-18T22:14:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.770+0000 7f0189935740 1 -- 172.21.15.123:0/1022332858 wait complete. 2024-08-18T22:14:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.771+0000 7f0189935740 1 -- start start 2024-08-18T22:14:40.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.771+0000 7f0189935740 1 Processor -- start 2024-08-18T22:14:40.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.772+0000 7f0189935740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562b130 0x55f8b563a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.772+0000 7f0189935740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b562ba50 0x55f8b563a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.772+0000 7f0189935740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b5636310 0x55f8b563ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.773+0000 7f0189935740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f016400e330 con 0x55f8b562ba50 2024-08-18T22:14:40.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.773+0000 7f0189935740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f016400f7a0 con 0x55f8b562b130 2024-08-18T22:14:40.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.773+0000 7f0189935740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f016400ea00 con 0x55f8b5636310 2024-08-18T22:14:40.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.773+0000 7f0189935740 10 client.0 _ll_register_callbacks cb 0x7f0170005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:14:40.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.773+0000 7f0184ad2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b562ba50 0x55f8b563a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:40.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.774+0000 7f0184ad2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b562ba50 0x55f8b563a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36690/0 (socket says 172.21.15.123:36690) 2024-08-18T22:14:40.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.774+0000 7f0184ad2640 1 -- 172.21.15.123:0/2107077980 learned_addr learned my addr 172.21.15.123:0/2107077980 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:40.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.775+0000 7f0184ad2640 1 -- 172.21.15.123:0/2107077980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b5636310 msgr2=0x55f8b563ae00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T22:14:40.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.775+0000 7f0184ad2640 1 --2- 172.21.15.123:0/2107077980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b5636310 0x55f8b563ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.775+0000 7f0184ad2640 1 -- 172.21.15.123:0/2107077980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562b130 msgr2=0x55f8b563a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.775+0000 7f01852d3640 1 --2- 172.21.15.123:0/2107077980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562b130 0x55f8b563a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.775+0000 7f0184ad2640 1 --2- 172.21.15.123:0/2107077980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562b130 0x55f8b563a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.775+0000 7f0184ad2640 1 -- 172.21.15.123:0/2107077980 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8b562b880 con 0x55f8b562ba50 2024-08-18T22:14:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.775+0000 7f0184ad2640 1 --2- 172.21.15.123:0/2107077980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b562ba50 0x55f8b563a8c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0170018530 tx=0x7f0170018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124826a1349fe1f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.775+0000 7f0168ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:14:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.775+0000 7f0168ff9640 1 -- 172.21.15.123:0/2107077980 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170097de0 con 0x55f8b562ba50 2024-08-18T22:14:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.776+0000 7f0189935740 1 -- 172.21.15.123:0/2107077980 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f017c04c070 con 0x55f8b562ba50 2024-08-18T22:14:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.776+0000 7f0168ff9640 1 -- 172.21.15.123:0/2107077980 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0170099e40 con 0x55f8b562ba50 2024-08-18T22:14:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.776+0000 7f0168ff9640 1 -- 172.21.15.123:0/2107077980 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f017009b4a0 con 0x55f8b562ba50 2024-08-18T22:14:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.776+0000 7f0189935740 10 client.16743 fetch_fsmap learned FSMap version 32 2024-08-18T22:14:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.776+0000 7f0189935740 1 -- 172.21.15.123:0/2107077980 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f8b56b1680 con 0x55f8b562ba50 2024-08-18T22:14:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.777+0000 7f0168ff9640 1 -- 172.21.15.123:0/2107077980 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01700d5340 con 0x55f8b562ba50 2024-08-18T22:14:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.777+0000 7f0168ff9640 1 -- 172.21.15.123:0/2107077980 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f017009bda0 con 0x55f8b562ba50 2024-08-18T22:14:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.777+0000 7f0189935740 10 client.16743 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:14:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.777+0000 7f0189935740 10 client.16743 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:14:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.777+0000 7f0189935740 20 client.16743 populate_metadata read hostname 'smithi123' 2024-08-18T22:14:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.777+0000 7f0189935740 1 --2- 172.21.15.123:0/2107077980 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f8b56b1a90 0x55f8b56b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.777+0000 7f0189935740 4 client.16743 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.2, "await_for": 45.0}] 2024-08-18T22:14:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.777+0000 7f0189935740 1 -- 172.21.15.123:0/2107077980 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.2, "await_for": 45.0}) -- 0x7f017c04c070 con 0x55f8b56b1a90 2024-08-18T22:14:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.780+0000 7f01852d3640 1 --2- 172.21.15.123:0/2107077980 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f8b56b1a90 0x55f8b56b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:40.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.784+0000 7f0168ff9640 10 client.16743 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:40.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:40.784+0000 7f01852d3640 1 --2- 172.21.15.123:0/2107077980 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f8b56b1a90 0x55f8b56b3eb0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c12a054d56df45e2 server_cookie=122818414400dbb6 in_seq=0 out_seq=0 2024-08-18T22:14:41.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:41 smithi123 ceph-mon[18462]: pgmap v547: 129 pgs: 129 active+clean; 211 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 883 op/s 2024-08-18T22:14:41.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:41 smithi130 ceph-mon[21698]: pgmap v547: 129 pgs: 129 active+clean; 211 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 883 op/s 2024-08-18T22:14:41.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:41 smithi183 ceph-mon[22097]: pgmap v547: 129 pgs: 129 active+clean; 211 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 883 op/s 2024-08-18T22:14:43.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.401+0000 7f9330ff9640 1 -- 172.21.15.123:0/3080760094 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5604800a7450 con 0x5604801bd650 2024-08-18T22:14:43.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.401+0000 7f9330ff9640 10 client.16725 handle_command_reply: tid=0 2024-08-18T22:14:43.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.401+0000 7f93523e0740 1 client.16725 shutdown 2024-08-18T22:14:43.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.402+0000 7f93523e0740 1 -- 172.21.15.123:0/3080760094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013cfc0 msgr2=0x56048014bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:43.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.402+0000 7f93523e0740 1 --2- 172.21.15.123:0/3080760094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013cfc0 0x56048014bad0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f93440096c0 tx=0x7f93440058e0 comp rx=0 tx=0).stop 2024-08-18T22:14:43.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.402+0000 7f93523e0740 1 -- 172.21.15.123:0/3080760094 shutdown_connections 2024-08-18T22:14:43.403 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.402+0000 7f93523e0740 1 --2- 172.21.15.123:0/3080760094 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5604801bd650 0x5604801bfa40 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.402+0000 7f93523e0740 1 --2- 172.21.15.123:0/3080760094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560480142050 0x56048014ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.402+0000 7f93523e0740 1 --2- 172.21.15.123:0/3080760094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56048013cfc0 0x56048014bad0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.402+0000 7f93523e0740 1 --2- 172.21.15.123:0/3080760094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56048013c680 0x56048014b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.402+0000 7f93523e0740 1 -- 172.21.15.123:0/3080760094 >> 172.21.15.123:0/3080760094 conn(0x560480137cf0 msgr2=0x560480136680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.402+0000 7f9330ff9640 0 client.16725 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.402+0000 7f93523e0740 1 -- 172.21.15.123:0/3080760094 shutdown_connections 2024-08-18T22:14:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.402+0000 7f93523e0740 1 -- 172.21.15.123:0/3080760094 wait complete. 2024-08-18T22:14:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.402+0000 7f93523e0740 20 client.16725 trim_cache size 0 max 16384 2024-08-18T22:14:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:14:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:14:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:14:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:14:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.403+0000 7f934f54b640 1 -- 172.21.15.123:0/2495334048 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f93340a2c30 msgr2=0x7f93340a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.403+0000 7f934f54b640 1 --2- 172.21.15.123:0/2495334048 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f93340a2c30 0x7f93340a50f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f934009bdc0 tx=0x7f9340005b40 comp rx=0 tx=0).stop 2024-08-18T22:14:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.403+0000 7f934f54b640 1 -- 172.21.15.123:0/2495334048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93481053e0 msgr2=0x7f93481a56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.403+0000 7f934f54b640 1 --2- 172.21.15.123:0/2495334048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93481053e0 0x7f93481a56c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f934000eb10 tx=0x7f934000c2d0 comp rx=0 tx=0).stop 2024-08-18T22:14:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.403+0000 7f934f54b640 1 -- 172.21.15.123:0/2495334048 shutdown_connections 2024-08-18T22:14:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.403+0000 7f934f54b640 1 --2- 172.21.15.123:0/2495334048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93481053e0 0x7f93481a56c0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.403+0000 7f934f54b640 1 --2- 172.21.15.123:0/2495334048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9348102a30 0x7f934819e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.403+0000 7f934f54b640 1 --2- 172.21.15.123:0/2495334048 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f93340a2c30 0x7f93340a50f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.403+0000 7f934f54b640 1 --2- 172.21.15.123:0/2495334048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93481000e0 0x7f934819e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.403+0000 7f934f54b640 1 -- 172.21.15.123:0/2495334048 >> 172.21.15.123:0/2495334048 conn(0x7f93480fbf10 msgr2=0x7f9348100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.403+0000 7f934f54b640 1 -- 172.21.15.123:0/2495334048 shutdown_connections 2024-08-18T22:14:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:43.403+0000 7f934f54b640 1 -- 172.21.15.123:0/2495334048 wait complete. 2024-08-18T22:14:43.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:43 smithi123 ceph-mon[18462]: pgmap v548: 129 pgs: 129 active+clean; 215 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 802 op/s 2024-08-18T22:14:43.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:43 smithi130 ceph-mon[21698]: pgmap v548: 129 pgs: 129 active+clean; 215 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 802 op/s 2024-08-18T22:14:43.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:43 smithi183 ceph-mon[22097]: pgmap v548: 129 pgs: 129 active+clean; 215 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 802 op/s 2024-08-18T22:14:44.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.529+0000 7f0168ff9640 1 -- 172.21.15.123:0/2107077980 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f017c04c070 con 0x55f8b56b1a90 2024-08-18T22:14:44.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.529+0000 7f0168ff9640 10 client.16743 handle_command_reply: tid=0 2024-08-18T22:14:44.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.529+0000 7f0189935740 1 client.16743 shutdown 2024-08-18T22:14:44.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.529+0000 7f0189935740 1 -- 172.21.15.123:0/2107077980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b562ba50 msgr2=0x55f8b563a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:44.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.529+0000 7f0189935740 1 --2- 172.21.15.123:0/2107077980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b562ba50 0x55f8b563a8c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0170018530 tx=0x7f0170018420 comp rx=0 tx=0).stop 2024-08-18T22:14:44.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.529+0000 7f0189935740 1 -- 172.21.15.123:0/2107077980 shutdown_connections 2024-08-18T22:14:44.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.529+0000 7f0189935740 1 --2- 172.21.15.123:0/2107077980 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55f8b56b1a90 0x55f8b56b3eb0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:44.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.529+0000 7f0189935740 1 --2- 172.21.15.123:0/2107077980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8b5636310 0x55f8b563ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:44.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.529+0000 7f0189935740 1 --2- 172.21.15.123:0/2107077980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f8b562ba50 0x55f8b563a8c0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:44.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.529+0000 7f0189935740 1 --2- 172.21.15.123:0/2107077980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b562b130 0x55f8b563a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:44.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.529+0000 7f0168ff9640 0 client.16743 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:44.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.529+0000 7f0189935740 1 -- 172.21.15.123:0/2107077980 >> 172.21.15.123:0/2107077980 conn(0x55f8b56276c0 msgr2=0x55f8b56266f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:44.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.529+0000 7f0189935740 1 -- 172.21.15.123:0/2107077980 shutdown_connections 2024-08-18T22:14:44.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.529+0000 7f0189935740 1 -- 172.21.15.123:0/2107077980 wait complete. 2024-08-18T22:14:44.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.530+0000 7f0189935740 20 client.16743 trim_cache size 0 max 16384 2024-08-18T22:14:44.532 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:14:44.532 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 32, 2024-08-18T22:14:44.532 INFO:teuthology.orchestra.run.smithi123.stdout: "leader": 24466, 2024-08-18T22:14:44.532 INFO:teuthology.orchestra.run.smithi123.stdout: "set_version": 18, 2024-08-18T22:14:44.533 INFO:teuthology.orchestra.run.smithi123.stdout: "sets": { 2024-08-18T22:14:44.533 INFO:teuthology.orchestra.run.smithi123.stdout: "fd804fe6": { 2024-08-18T22:14:44.533 INFO:teuthology.orchestra.run.smithi123.stdout: "version": 18, 2024-08-18T22:14:44.533 INFO:teuthology.orchestra.run.smithi123.stdout: "age_ref": 0.0, 2024-08-18T22:14:44.533 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:14:44.533 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "QUIESCED", 2024-08-18T22:14:44.533 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:14:44.533 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:14:44.533 INFO:teuthology.orchestra.run.smithi123.stdout: "timeout": 90.0, 2024-08-18T22:14:44.533 INFO:teuthology.orchestra.run.smithi123.stdout: "expiration": 139.2, 2024-08-18T22:14:44.533 INFO:teuthology.orchestra.run.smithi123.stdout: "members": { 2024-08-18T22:14:44.533 INFO:teuthology.orchestra.run.smithi123.stdout: "file:/": { 2024-08-18T22:14:44.533 INFO:teuthology.orchestra.run.smithi123.stdout: "excluded": false, 2024-08-18T22:14:44.534 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:14:44.534 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "QUIESCED", 2024-08-18T22:14:44.534 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:14:44.534 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:14:44.534 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:14:44.534 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:14:44.534 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:14:44.534 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:14:44.534 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:14:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.530+0000 7f0187537640 1 -- 172.21.15.123:0/2325711476 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f016c0a2d90 msgr2=0x7f016c0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.530+0000 7f0187537640 1 --2- 172.21.15.123:0/2325711476 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f016c0a2d90 0x7f016c0a5250 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f017c02aa30 tx=0x7f017c02a940 comp rx=0 tx=0).stop 2024-08-18T22:14:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.530+0000 7f0187537640 1 -- 172.21.15.123:0/2325711476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0180109560 msgr2=0x7f01801188d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.530+0000 7f0187537640 1 --2- 172.21.15.123:0/2325711476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0180109560 0x7f01801188d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f017000e9f0 tx=0x7f017000eeb0 comp rx=0 tx=0).stop 2024-08-18T22:14:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.530+0000 7f0187537640 1 -- 172.21.15.123:0/2325711476 shutdown_connections 2024-08-18T22:14:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.530+0000 7f0187537640 1 --2- 172.21.15.123:0/2325711476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f018011ae70 0x7f01801115b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.530+0000 7f0187537640 1 --2- 172.21.15.123:0/2325711476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0180109560 0x7f01801188d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.530+0000 7f0187537640 1 --2- 172.21.15.123:0/2325711476 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f016c0a2d90 0x7f016c0a5250 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.530+0000 7f0187537640 1 --2- 172.21.15.123:0/2325711476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0180109180 0x7f0180118390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.530+0000 7f0187537640 1 -- 172.21.15.123:0/2325711476 >> 172.21.15.123:0/2325711476 conn(0x7f018006de70 msgr2=0x7f018011bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.531+0000 7f0187537640 1 -- 172.21.15.123:0/2325711476 shutdown_connections 2024-08-18T22:14:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:44.531+0000 7f0187537640 1 -- 172.21.15.123:0/2325711476 wait complete. 2024-08-18T22:14:45.263 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fd804fe6', quiesce took 7.7 seconds. Will release after: 11.5 2024-08-18T22:14:45.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:45 smithi123 ceph-mon[18462]: pgmap v549: 129 pgs: 129 active+clean; 214 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 806 op/s 2024-08-18T22:14:45.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:45 smithi130 ceph-mon[21698]: pgmap v549: 129 pgs: 129 active+clean; 214 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 806 op/s 2024-08-18T22:14:45.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:45 smithi183 ceph-mon[22097]: pgmap v549: 129 pgs: 129 active+clean; 214 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 806 op/s 2024-08-18T22:14:47.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:47 smithi123 ceph-mon[18462]: pgmap v550: 129 pgs: 129 active+clean; 216 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 593 op/s 2024-08-18T22:14:47.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:47 smithi130 ceph-mon[21698]: pgmap v550: 129 pgs: 129 active+clean; 216 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 593 op/s 2024-08-18T22:14:47.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:47 smithi183 ceph-mon[22097]: pgmap v550: 129 pgs: 129 active+clean; 216 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 593 op/s 2024-08-18T22:14:49.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:49 smithi123 ceph-mon[18462]: pgmap v551: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 532 op/s 2024-08-18T22:14:49.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:49 smithi130 ceph-mon[21698]: pgmap v551: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 532 op/s 2024-08-18T22:14:49.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:49 smithi183 ceph-mon[22097]: pgmap v551: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 532 op/s 2024-08-18T22:14:51.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:51 smithi123 ceph-mon[18462]: pgmap v552: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 444 op/s 2024-08-18T22:14:51.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:51 smithi130 ceph-mon[21698]: pgmap v552: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 444 op/s 2024-08-18T22:14:51.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:51 smithi183 ceph-mon[22097]: pgmap v552: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 444 op/s 2024-08-18T22:14:53.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:53 smithi123 ceph-mon[18462]: pgmap v553: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 819 KiB/s wr, 338 op/s 2024-08-18T22:14:53.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:53 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:14:53.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:53 smithi130 ceph-mon[21698]: pgmap v553: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 819 KiB/s wr, 338 op/s 2024-08-18T22:14:53.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:53 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:14:53.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:53 smithi183 ceph-mon[22097]: pgmap v553: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 819 KiB/s wr, 338 op/s 2024-08-18T22:14:53.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:53 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:14:54.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:54 smithi123 ceph-mon[18462]: Adjusting osd_memory_target on smithi130 to 176.0M 2024-08-18T22:14:54.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:54 smithi123 ceph-mon[18462]: Adjusting osd_memory_target on smithi183 to 176.0M 2024-08-18T22:14:54.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:54 smithi123 ceph-mon[18462]: Unable to set osd_memory_target on smithi130 to 184579584: error parsing value: Value '184579584' is below minimum 939524096 2024-08-18T22:14:54.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:54 smithi123 ceph-mon[18462]: Unable to set osd_memory_target on smithi183 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-08-18T22:14:54.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:14:54.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:14:54.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:14:54.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:54 smithi130 ceph-mon[21698]: Adjusting osd_memory_target on smithi130 to 176.0M 2024-08-18T22:14:54.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:54 smithi130 ceph-mon[21698]: Adjusting osd_memory_target on smithi183 to 176.0M 2024-08-18T22:14:54.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:54 smithi130 ceph-mon[21698]: Unable to set osd_memory_target on smithi130 to 184579584: error parsing value: Value '184579584' is below minimum 939524096 2024-08-18T22:14:54.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:54 smithi130 ceph-mon[21698]: Unable to set osd_memory_target on smithi183 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-08-18T22:14:54.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:14:54.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:14:54.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:14:54.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:14:54.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:54 smithi183 ceph-mon[22097]: Adjusting osd_memory_target on smithi130 to 176.0M 2024-08-18T22:14:54.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:54 smithi183 ceph-mon[22097]: Adjusting osd_memory_target on smithi183 to 176.0M 2024-08-18T22:14:54.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:54 smithi183 ceph-mon[22097]: Unable to set osd_memory_target on smithi130 to 184579584: error parsing value: Value '184579584' is below minimum 939524096 2024-08-18T22:14:54.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:54 smithi183 ceph-mon[22097]: Unable to set osd_memory_target on smithi183 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-08-18T22:14:54.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:14:54.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:14:54.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:14:55.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:55 smithi183 ceph-mon[22097]: pgmap v554: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 485 KiB/s wr, 229 op/s 2024-08-18T22:14:55.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:55 smithi123 ceph-mon[18462]: pgmap v554: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 485 KiB/s wr, 229 op/s 2024-08-18T22:14:55.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:55 smithi130 ceph-mon[21698]: pgmap v554: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 485 KiB/s wr, 229 op/s 2024-08-18T22:14:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.497+0000 7f5393417640 1 -- 172.21.15.123:0/2050611540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f538c102360 msgr2=0x7f538c104750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.497+0000 7f5393417640 1 --2- 172.21.15.123:0/2050611540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f538c102360 0x7f538c104750 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f537c009900 tx=0x7f537c02a410 comp rx=0 tx=0).stop 2024-08-18T22:14:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.497+0000 7f5393417640 1 -- 172.21.15.123:0/2050611540 shutdown_connections 2024-08-18T22:14:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.498+0000 7f5393417640 1 --2- 172.21.15.123:0/2050611540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f538c1075c0 0x7f538c1099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.498+0000 7f5393417640 1 --2- 172.21.15.123:0/2050611540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f538c104c90 0x7f538c107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.498+0000 7f5393417640 1 --2- 172.21.15.123:0/2050611540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f538c102360 0x7f538c104750 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.498+0000 7f5393417640 1 -- 172.21.15.123:0/2050611540 >> 172.21.15.123:0/2050611540 conn(0x7f538c0fbee0 msgr2=0x7f538c0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.498+0000 7f5393417640 1 -- 172.21.15.123:0/2050611540 shutdown_connections 2024-08-18T22:14:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.498+0000 7f5393417640 1 -- 172.21.15.123:0/2050611540 wait complete. 2024-08-18T22:14:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.498+0000 7f5393417640 1 Processor -- start 2024-08-18T22:14:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.498+0000 7f5393417640 1 -- start start 2024-08-18T22:14:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.498+0000 7f5393417640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f538c102360 0x7f538c197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.498+0000 7f5393417640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f538c104c90 0x7f538c198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.498+0000 7f5393417640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f538c1075c0 0x7f538c19f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.498+0000 7f5393417640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f538c10d5c0 con 0x7f538c1075c0 2024-08-18T22:14:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.498+0000 7f5393417640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f538c10d440 con 0x7f538c104c90 2024-08-18T22:14:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.498+0000 7f5393417640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f538c10d740 con 0x7f538c102360 2024-08-18T22:14:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f53919b4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f538c1075c0 0x7f538c19f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f53919b4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f538c1075c0 0x7f538c19f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60528/0 (socket says 172.21.15.123:60528) 2024-08-18T22:14:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f53919b4640 1 -- 172.21.15.123:0/1862604103 learned_addr learned my addr 172.21.15.123:0/1862604103 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f53909b2640 1 --2- 172.21.15.123:0/1862604103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f538c104c90 0x7f538c198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f53911b3640 1 --2- 172.21.15.123:0/1862604103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f538c102360 0x7f538c197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f53919b4640 1 -- 172.21.15.123:0/1862604103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f538c102360 msgr2=0x7f538c197bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f53919b4640 1 --2- 172.21.15.123:0/1862604103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f538c102360 0x7f538c197bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f53919b4640 1 -- 172.21.15.123:0/1862604103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f538c104c90 msgr2=0x7f538c198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f53919b4640 1 --2- 172.21.15.123:0/1862604103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f538c104c90 0x7f538c198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f53919b4640 1 -- 172.21.15.123:0/1862604103 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538c19f810 con 0x7f538c1075c0 2024-08-18T22:14:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f53919b4640 1 --2- 172.21.15.123:0/1862604103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f538c1075c0 0x7f538c19f1a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f538400cab0 tx=0x7f538400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f538a7fc640 1 -- 172.21.15.123:0/1862604103 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538400ae20 con 0x7f538c1075c0 2024-08-18T22:14:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f538a7fc640 1 -- 172.21.15.123:0/1862604103 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f538400f930 con 0x7f538c1075c0 2024-08-18T22:14:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f5393417640 1 -- 172.21.15.123:0/1862604103 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538c19fb00 con 0x7f538c1075c0 2024-08-18T22:14:56.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f538a7fc640 1 -- 172.21.15.123:0/1862604103 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5384018b80 con 0x7f538c1075c0 2024-08-18T22:14:56.504 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.499+0000 7f5393417640 1 -- 172.21.15.123:0/1862604103 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f538c1a0000 con 0x7f538c1075c0 2024-08-18T22:14:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.501+0000 7f538a7fc640 1 -- 172.21.15.123:0/1862604103 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f538400fae0 con 0x7f538c1075c0 2024-08-18T22:14:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.502+0000 7f53961d5740 1 Processor -- start 2024-08-18T22:14:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.502+0000 7f53961d5740 1 -- start start 2024-08-18T22:14:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.502+0000 7f53961d5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 0x56464551ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.502+0000 7f538a7fc640 1 --2- 172.21.15.123:0/1862604103 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f53740a2c30 0x7f53740a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.502+0000 7f53961d5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56464551cfc0 0x564645521a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.502+0000 7f53961d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564645522050 0x564645524510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.502+0000 7f53961d5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56464547f9d0 con 0x56464551cfc0 2024-08-18T22:14:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.502+0000 7f53961d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564645427820 con 0x564645522050 2024-08-18T22:14:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.502+0000 7f53961d5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56464547b990 con 0x56464551c680 2024-08-18T22:14:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.502+0000 7f53911b3640 1 --2- 172.21.15.123:0/1862604103 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f53740a2c30 0x7f53740a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f53909b2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56464551cfc0 0x564645521a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f53909b2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56464551cfc0 0x564645521a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60530/0 (socket says 172.21.15.123:60530) 2024-08-18T22:14:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f53909b2640 1 -- 172.21.15.123:0/1436876059 learned_addr learned my addr 172.21.15.123:0/1436876059 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f538a7fc640 1 -- 172.21.15.123:0/1862604103 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f53840cfb90 con 0x7f538c1075c0 2024-08-18T22:14:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f53909b2640 1 --2- 172.21.15.123:0/1436876059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 0x56464551ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f53919b4640 1 --2- 172.21.15.123:0/1436876059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564645522050 0x564645524510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f53909b2640 1 -- 172.21.15.123:0/1436876059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 msgr2=0x56464551ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f53909b2640 1 --2- 172.21.15.123:0/1436876059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 0x56464551ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f53909b2640 1 -- 172.21.15.123:0/1436876059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564645522050 msgr2=0x564645524510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f53909b2640 1 --2- 172.21.15.123:0/1436876059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564645522050 0x564645524510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f53909b2640 1 -- 172.21.15.123:0/1436876059 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564645193210 con 0x56464551cfc0 2024-08-18T22:14:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f53909b2640 1 --2- 172.21.15.123:0/1436876059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56464551cfc0 0x564645521a80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f538000ad50 tx=0x7f538000a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747b5ec9cd2c841e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f53911b3640 1 --2- 172.21.15.123:0/1862604103 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f53740a2c30 0x7f53740a50f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f537c031610 tx=0x7f537c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f53737fe640 1 -- 172.21.15.123:0/1436876059 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538001c070 con 0x56464551cfc0 2024-08-18T22:14:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f53737fe640 1 -- 172.21.15.123:0/1436876059 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5380011c70 con 0x56464551cfc0 2024-08-18T22:14:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.503+0000 7f53737fe640 1 -- 172.21.15.123:0/1436876059 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5380017e60 con 0x56464551cfc0 2024-08-18T22:14:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.504+0000 7f53961d5740 1 -- 172.21.15.123:0/1436876059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56464551cfc0 msgr2=0x564645521a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.504+0000 7f53961d5740 1 --2- 172.21.15.123:0/1436876059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56464551cfc0 0x564645521a80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f538000ad50 tx=0x7f538000a290 comp rx=0 tx=0).stop 2024-08-18T22:14:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.504+0000 7f53961d5740 1 -- 172.21.15.123:0/1436876059 shutdown_connections 2024-08-18T22:14:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.504+0000 7f53961d5740 1 --2- 172.21.15.123:0/1436876059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564645522050 0x564645524510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.504+0000 7f53961d5740 1 --2- 172.21.15.123:0/1436876059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56464551cfc0 0x564645521a80 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.504+0000 7f53961d5740 1 --2- 172.21.15.123:0/1436876059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 0x56464551ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.504+0000 7f53961d5740 1 -- 172.21.15.123:0/1436876059 >> 172.21.15.123:0/1436876059 conn(0x564645517cf0 msgr2=0x5646455180f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.504+0000 7f53961d5740 1 -- 172.21.15.123:0/1436876059 shutdown_connections 2024-08-18T22:14:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.504+0000 7f53961d5740 1 -- 172.21.15.123:0/1436876059 wait complete. 2024-08-18T22:14:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.504+0000 7f53961d5740 1 -- start start 2024-08-18T22:14:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53961d5740 1 Processor -- start 2024-08-18T22:14:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53961d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56464551c680 0x564645526900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53961d5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551cfc0 0x564645526e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53961d5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564645522050 0x56464552de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53961d5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x564645525020 con 0x564645522050 2024-08-18T22:14:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53961d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56464543b520 con 0x56464551c680 2024-08-18T22:14:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53961d5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5646455251a0 con 0x56464551cfc0 2024-08-18T22:14:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53961d5740 10 client.0 _ll_register_callbacks cb 0x564645192a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:14:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53919b4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564645522050 0x56464552de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53919b4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564645522050 0x56464552de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60532/0 (socket says 172.21.15.123:60532) 2024-08-18T22:14:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53919b4640 1 -- 172.21.15.123:0/3137840031 learned_addr learned my addr 172.21.15.123:0/3137840031 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53911b3640 1 --2- 172.21.15.123:0/3137840031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56464551c680 0x564645526900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53909b2640 1 --2- 172.21.15.123:0/3137840031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551cfc0 0x564645526e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53919b4640 1 -- 172.21.15.123:0/3137840031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551cfc0 msgr2=0x564645526e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53919b4640 1 --2- 172.21.15.123:0/3137840031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551cfc0 0x564645526e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53919b4640 1 -- 172.21.15.123:0/3137840031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56464551c680 msgr2=0x564645526900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53919b4640 1 --2- 172.21.15.123:0/3137840031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56464551c680 0x564645526900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.505+0000 7f53919b4640 1 -- 172.21.15.123:0/3137840031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56464525f620 con 0x564645522050 2024-08-18T22:14:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f53919b4640 1 --2- 172.21.15.123:0/3137840031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564645522050 0x56464552de80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f53840984c0 tx=0x7f538409d190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68b1355ef1b614b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f5370ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:14:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f5370ff9640 1 -- 172.21.15.123:0/3137840031 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538409c9f0 con 0x564645522050 2024-08-18T22:14:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f53961d5740 1 -- 172.21.15.123:0/3137840031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5380011c70 con 0x564645522050 2024-08-18T22:14:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f5370ff9640 1 -- 172.21.15.123:0/3137840031 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f5384096bd0 con 0x564645522050 2024-08-18T22:14:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f5370ff9640 1 -- 172.21.15.123:0/3137840031 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f538409d390 con 0x564645522050 2024-08-18T22:14:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f53961d5740 10 client.16755 fetch_fsmap learned FSMap version 32 2024-08-18T22:14:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f53961d5740 1 -- 172.21.15.123:0/3137840031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564645530ce0 con 0x564645522050 2024-08-18T22:14:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f5370ff9640 1 -- 172.21.15.123:0/3137840031 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5380011c70 con 0x564645522050 2024-08-18T22:14:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f5370ff9640 1 -- 172.21.15.123:0/3137840031 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f53840a4840 con 0x564645522050 2024-08-18T22:14:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f53961d5740 10 client.16755 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:14:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f53961d5740 10 client.16755 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:14:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f53961d5740 20 client.16755 populate_metadata read hostname 'smithi123' 2024-08-18T22:14:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f53961d5740 1 --2- 172.21.15.123:0/3137840031 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x564645532360 0x5646455347d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f53961d5740 4 client.16755 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:14:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.506+0000 7f53961d5740 1 -- 172.21.15.123:0/3137840031 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56464548d100 con 0x564645532360 2024-08-18T22:14:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.507+0000 7f53911b3640 1 --2- 172.21.15.123:0/3137840031 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x564645532360 0x5646455347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.507+0000 7f5370ff9640 10 client.16755 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.507+0000 7f53911b3640 1 --2- 172.21.15.123:0/3137840031 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x564645532360 0x5646455347d0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2d0bef4c211fa8e server_cookie=2d1d313bfaa2a0eb in_seq=0 out_seq=0 2024-08-18T22:14:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.508+0000 7f5370ff9640 1 -- 172.21.15.123:0/3137840031 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56464548d100 con 0x564645532360 2024-08-18T22:14:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.508+0000 7f5370ff9640 10 client.16755 handle_command_reply: tid=0 2024-08-18T22:14:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.508+0000 7f53961d5740 1 client.16755 shutdown 2024-08-18T22:14:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.508+0000 7f53961d5740 1 -- 172.21.15.123:0/3137840031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564645522050 msgr2=0x56464552de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.508+0000 7f53961d5740 1 --2- 172.21.15.123:0/3137840031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564645522050 0x56464552de80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f53840984c0 tx=0x7f538409d190 comp rx=0 tx=0).stop 2024-08-18T22:14:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.508+0000 7f53961d5740 1 -- 172.21.15.123:0/3137840031 shutdown_connections 2024-08-18T22:14:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.508+0000 7f53961d5740 1 --2- 172.21.15.123:0/3137840031 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x564645532360 0x5646455347d0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.508+0000 7f53961d5740 1 --2- 172.21.15.123:0/3137840031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564645522050 0x56464552de80 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.508+0000 7f5370ff9640 0 client.16755 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.508+0000 7f53961d5740 1 --2- 172.21.15.123:0/3137840031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551cfc0 0x564645526e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.508+0000 7f53961d5740 1 --2- 172.21.15.123:0/3137840031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56464551c680 0x564645526900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.508+0000 7f53961d5740 1 -- 172.21.15.123:0/3137840031 >> 172.21.15.123:0/3137840031 conn(0x564645517cf0 msgr2=0x564645519500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.508+0000 7f53961d5740 1 -- 172.21.15.123:0/3137840031 shutdown_connections 2024-08-18T22:14:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.508+0000 7f53961d5740 1 -- 172.21.15.123:0/3137840031 wait complete. 2024-08-18T22:14:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.508+0000 7f53961d5740 20 client.16755 trim_cache size 0 max 16384 2024-08-18T22:14:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53961d5740 1 Processor -- start 2024-08-18T22:14:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53961d5740 1 -- start start 2024-08-18T22:14:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53961d5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 0x5646455190e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53961d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56464551cfc0 0x564645519620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53961d5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564645522050 0x5646455390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53961d5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f538c1ace30 con 0x564645522050 2024-08-18T22:14:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53961d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f538c1aa640 con 0x56464551cfc0 2024-08-18T22:14:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53961d5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f538c1a8490 con 0x56464551c680 2024-08-18T22:14:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53919b4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564645522050 0x5646455390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53919b4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564645522050 0x5646455390d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60542/0 (socket says 172.21.15.123:60542) 2024-08-18T22:14:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53919b4640 1 -- 172.21.15.123:0/2333447394 learned_addr learned my addr 172.21.15.123:0/2333447394 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53911b3640 1 --2- 172.21.15.123:0/2333447394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 0x5646455190e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53919b4640 1 -- 172.21.15.123:0/2333447394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 msgr2=0x5646455190e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53909b2640 1 --2- 172.21.15.123:0/2333447394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56464551cfc0 0x564645519620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53919b4640 1 --2- 172.21.15.123:0/2333447394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 0x5646455190e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53919b4640 1 -- 172.21.15.123:0/2333447394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56464551cfc0 msgr2=0x564645519620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53919b4640 1 --2- 172.21.15.123:0/2333447394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56464551cfc0 0x564645519620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53919b4640 1 -- 172.21.15.123:0/2333447394 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564645517b10 con 0x564645522050 2024-08-18T22:14:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53911b3640 1 --2- 172.21.15.123:0/2333447394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 0x5646455190e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:14:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f53919b4640 1 --2- 172.21.15.123:0/2333447394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564645522050 0x5646455390d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f53840cd670 tx=0x7f538409c1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf35f50d62018fba server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.523+0000 7f5372ffd640 1 -- 172.21.15.123:0/2333447394 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53840b5020 con 0x564645522050 2024-08-18T22:14:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.524+0000 7f5372ffd640 1 -- 172.21.15.123:0/2333447394 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53840c9040 con 0x564645522050 2024-08-18T22:14:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.524+0000 7f5372ffd640 1 -- 172.21.15.123:0/2333447394 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538409b4b0 con 0x564645522050 2024-08-18T22:14:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.524+0000 7f53961d5740 1 -- 172.21.15.123:0/2333447394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564645522050 msgr2=0x5646455390d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.524+0000 7f53961d5740 1 --2- 172.21.15.123:0/2333447394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564645522050 0x5646455390d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f53840cd670 tx=0x7f538409c1e0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.524+0000 7f53961d5740 1 -- 172.21.15.123:0/2333447394 shutdown_connections 2024-08-18T22:14:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.524+0000 7f53961d5740 1 --2- 172.21.15.123:0/2333447394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564645522050 0x5646455390d0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.524+0000 7f53961d5740 1 --2- 172.21.15.123:0/2333447394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56464551cfc0 0x564645519620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.524+0000 7f53961d5740 1 --2- 172.21.15.123:0/2333447394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 0x5646455190e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.524+0000 7f53961d5740 1 -- 172.21.15.123:0/2333447394 >> 172.21.15.123:0/2333447394 conn(0x564645517cf0 msgr2=0x564645516ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.524+0000 7f53961d5740 1 -- 172.21.15.123:0/2333447394 shutdown_connections 2024-08-18T22:14:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.524+0000 7f53961d5740 1 -- 172.21.15.123:0/2333447394 wait complete. 2024-08-18T22:14:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.524+0000 7f53961d5740 1 -- start start 2024-08-18T22:14:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.524+0000 7f53961d5740 1 Processor -- start 2024-08-18T22:14:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53961d5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 0x564645598a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53961d5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56464551cfc0 0x564645598fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53961d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564645522050 0x56464559fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53961d5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f538c1a8b00 con 0x56464551cfc0 2024-08-18T22:14:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53961d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f538c1a9f70 con 0x564645522050 2024-08-18T22:14:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53961d5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f538c1a91d0 con 0x56464551c680 2024-08-18T22:14:56.534 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53961d5740 10 client.0 _ll_register_callbacks cb 0x7f538409bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:14:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53909b2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56464551cfc0 0x564645598fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53909b2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56464551cfc0 0x564645598fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60544/0 (socket says 172.21.15.123:60544) 2024-08-18T22:14:56.536 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53909b2640 1 -- 172.21.15.123:0/1506920804 learned_addr learned my addr 172.21.15.123:0/1506920804 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:56.536 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53911b3640 1 --2- 172.21.15.123:0/1506920804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 0x564645598a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.536 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53909b2640 1 -- 172.21.15.123:0/1506920804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 msgr2=0x564645598a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:56.536 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53909b2640 1 --2- 172.21.15.123:0/1506920804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 0x564645598a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.536 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53909b2640 1 -- 172.21.15.123:0/1506920804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564645522050 msgr2=0x56464559fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:56.536 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53909b2640 1 --2- 172.21.15.123:0/1506920804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564645522050 0x56464559fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.536 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53909b2640 1 -- 172.21.15.123:0/1506920804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646455a0600 con 0x56464551cfc0 2024-08-18T22:14:56.536 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f53909b2640 1 --2- 172.21.15.123:0/1506920804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56464551cfc0 0x564645598fb0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f538001a040 tx=0x7f538000a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f686e5fc4abcc17 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:56.536 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.525+0000 7f5370ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:14:56.537 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.526+0000 7f5370ff9640 1 -- 172.21.15.123:0/1506920804 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538001c050 con 0x56464551cfc0 2024-08-18T22:14:56.537 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.526+0000 7f5370ff9640 1 -- 172.21.15.123:0/1506920804 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f5380017870 con 0x56464551cfc0 2024-08-18T22:14:56.537 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.526+0000 7f53961d5740 1 -- 172.21.15.123:0/1506920804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53840c9040 con 0x56464551cfc0 2024-08-18T22:14:56.537 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.526+0000 7f5370ff9640 1 -- 172.21.15.123:0/1506920804 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5380031050 con 0x56464551cfc0 2024-08-18T22:14:56.537 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.526+0000 7f53961d5740 10 client.16761 fetch_fsmap learned FSMap version 32 2024-08-18T22:14:56.537 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.526+0000 7f53961d5740 1 -- 172.21.15.123:0/1506920804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5646455a1880 con 0x56464551cfc0 2024-08-18T22:14:56.537 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.526+0000 7f5370ff9640 1 -- 172.21.15.123:0/1506920804 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53840c9040 con 0x56464551cfc0 2024-08-18T22:14:56.538 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.526+0000 7f5370ff9640 1 -- 172.21.15.123:0/1506920804 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f5380015040 con 0x56464551cfc0 2024-08-18T22:14:56.538 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.526+0000 7f53961d5740 10 client.16761 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:14:56.538 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.526+0000 7f53961d5740 10 client.16761 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:14:56.538 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.526+0000 7f53961d5740 20 client.16761 populate_metadata read hostname 'smithi123' 2024-08-18T22:14:56.538 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.526+0000 7f53961d5740 1 --2- 172.21.15.123:0/1506920804 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5646455a1fa0 0x5646455a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:56.538 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.526+0000 7f53961d5740 4 client.16761 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:14:56.538 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.526+0000 7f53961d5740 1 -- 172.21.15.123:0/1506920804 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564645487450 con 0x5646455a1fa0 2024-08-18T22:14:56.538 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.526+0000 7f53911b3640 1 --2- 172.21.15.123:0/1506920804 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5646455a1fa0 0x5646455a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.527+0000 7f5370ff9640 10 client.16761 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.527+0000 7f53911b3640 1 --2- 172.21.15.123:0/1506920804 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5646455a1fa0 0x5646455a43c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9742ec40f83ff47d server_cookie=4f855a48b9c08a9f in_seq=0 out_seq=0 2024-08-18T22:14:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.587+0000 7f5370ff9640 1 -- 172.21.15.123:0/1506920804 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564645487450 con 0x5646455a1fa0 2024-08-18T22:14:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.587+0000 7f5370ff9640 10 client.16761 handle_command_reply: tid=0 2024-08-18T22:14:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.587+0000 7f53961d5740 1 client.16761 shutdown 2024-08-18T22:14:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.587+0000 7f53961d5740 1 -- 172.21.15.123:0/1506920804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56464551cfc0 msgr2=0x564645598fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.587+0000 7f53961d5740 1 --2- 172.21.15.123:0/1506920804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56464551cfc0 0x564645598fb0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f538001a040 tx=0x7f538000a6d0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.587+0000 7f53961d5740 1 -- 172.21.15.123:0/1506920804 shutdown_connections 2024-08-18T22:14:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.587+0000 7f53961d5740 1 --2- 172.21.15.123:0/1506920804 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5646455a1fa0 0x5646455a43c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.587+0000 7f53961d5740 1 --2- 172.21.15.123:0/1506920804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564645522050 0x56464559fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.587+0000 7f53961d5740 1 --2- 172.21.15.123:0/1506920804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56464551cfc0 0x564645598fb0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.587+0000 7f5370ff9640 0 client.16761 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.587+0000 7f53961d5740 1 --2- 172.21.15.123:0/1506920804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56464551c680 0x564645598a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.587+0000 7f53961d5740 1 -- 172.21.15.123:0/1506920804 >> 172.21.15.123:0/1506920804 conn(0x564645517cf0 msgr2=0x564645516ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.587+0000 7f53961d5740 1 -- 172.21.15.123:0/1506920804 shutdown_connections 2024-08-18T22:14:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.587+0000 7f53961d5740 1 -- 172.21.15.123:0/1506920804 wait complete. 2024-08-18T22:14:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.587+0000 7f53961d5740 20 client.16761 trim_cache size 0 max 16384 2024-08-18T22:14:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:14:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:14:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:14:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:14:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.588+0000 7f5393417640 1 -- 172.21.15.123:0/1862604103 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f53740a2c30 msgr2=0x7f53740a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.588+0000 7f5393417640 1 --2- 172.21.15.123:0/1862604103 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f53740a2c30 0x7f53740a50f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f537c031610 tx=0x7f537c000bc0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.588+0000 7f5393417640 1 -- 172.21.15.123:0/1862604103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f538c1075c0 msgr2=0x7f538c19f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.588+0000 7f5393417640 1 --2- 172.21.15.123:0/1862604103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f538c1075c0 0x7f538c19f1a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f538400cab0 tx=0x7f538400cf70 comp rx=0 tx=0).stop 2024-08-18T22:14:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.588+0000 7f5393417640 1 -- 172.21.15.123:0/1862604103 shutdown_connections 2024-08-18T22:14:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.588+0000 7f5393417640 1 --2- 172.21.15.123:0/1862604103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f538c1075c0 0x7f538c19f1a0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.588+0000 7f5393417640 1 --2- 172.21.15.123:0/1862604103 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f53740a2c30 0x7f53740a50f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.588+0000 7f5393417640 1 --2- 172.21.15.123:0/1862604103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f538c104c90 0x7f538c198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.588+0000 7f5393417640 1 --2- 172.21.15.123:0/1862604103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f538c102360 0x7f538c197bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.588+0000 7f5393417640 1 -- 172.21.15.123:0/1862604103 >> 172.21.15.123:0/1862604103 conn(0x7f538c0fbee0 msgr2=0x7f538c102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.588+0000 7f5393417640 1 -- 172.21.15.123:0/1862604103 shutdown_connections 2024-08-18T22:14:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:14:56.588+0000 7f5393417640 1 -- 172.21.15.123:0/1862604103 wait complete. 2024-08-18T22:14:56.764 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:14:57.014 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:14:57.405 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:57 smithi123 ceph-mon[18462]: pgmap v555: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 184 KiB/s wr, 81 op/s 2024-08-18T22:14:57.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.484+0000 7f58cbb76640 1 -- 172.21.15.123:0/2135102653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4103390 msgr2=0x7f58c410b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.484+0000 7f58cbb76640 1 --2- 172.21.15.123:0/2135102653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4103390 0x7f58c410b880 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009ca0 tx=0x7f58c002a950 comp rx=0 tx=0).stop 2024-08-18T22:14:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.484+0000 7f58cbb76640 1 -- 172.21.15.123:0/2135102653 shutdown_connections 2024-08-18T22:14:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.484+0000 7f58cbb76640 1 --2- 172.21.15.123:0/2135102653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58c410bea0 0x7f58c410e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.484+0000 7f58cbb76640 1 --2- 172.21.15.123:0/2135102653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c4103390 0x7f58c410b880 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.484+0000 7f58cbb76640 1 --2- 172.21.15.123:0/2135102653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58c4102a70 0x7f58c4102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.484+0000 7f58cbb76640 1 -- 172.21.15.123:0/2135102653 >> 172.21.15.123:0/2135102653 conn(0x7f58c40fc4d0 msgr2=0x7f58c40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.484+0000 7f58cbb76640 1 -- 172.21.15.123:0/2135102653 shutdown_connections 2024-08-18T22:14:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.484+0000 7f58cbb76640 1 -- 172.21.15.123:0/2135102653 wait complete. 2024-08-18T22:14:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58cbb76640 1 Processor -- start 2024-08-18T22:14:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58cbb76640 1 -- start start 2024-08-18T22:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58cbb76640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58c4102a70 0x7f58c419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58cbb76640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58c4103390 0x7f58c419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58cbb76640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c410bea0 0x7f58c419ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58cbb76640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f58c4111ce0 con 0x7f58c410bea0 2024-08-18T22:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58cbb76640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f58c4111b60 con 0x7f58c4103390 2024-08-18T22:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58cbb76640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f58c4111e60 con 0x7f58c4102a70 2024-08-18T22:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58ca113640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c410bea0 0x7f58c419ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58ca113640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c410bea0 0x7f58c419ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60574/0 (socket says 172.21.15.123:60574) 2024-08-18T22:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58ca113640 1 -- 172.21.15.123:0/2331456967 learned_addr learned my addr 172.21.15.123:0/2331456967 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58c9111640 1 --2- 172.21.15.123:0/2331456967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58c4103390 0x7f58c419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58c9912640 1 --2- 172.21.15.123:0/2331456967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58c4102a70 0x7f58c419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58ca113640 1 -- 172.21.15.123:0/2331456967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58c4102a70 msgr2=0x7f58c419a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58ca113640 1 --2- 172.21.15.123:0/2331456967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58c4102a70 0x7f58c419a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58ca113640 1 -- 172.21.15.123:0/2331456967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58c4103390 msgr2=0x7f58c419a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58ca113640 1 --2- 172.21.15.123:0/2331456967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58c4103390 0x7f58c419a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.485+0000 7f58ca113640 1 -- 172.21.15.123:0/2331456967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c419f390 con 0x7f58c410bea0 2024-08-18T22:14:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.486+0000 7f58ca113640 1 --2- 172.21.15.123:0/2331456967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c410bea0 0x7f58c419ecb0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009fd0 tx=0x7f58bc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.486+0000 7f58baffd640 1 -- 172.21.15.123:0/2331456967 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc011830 con 0x7f58c410bea0 2024-08-18T22:14:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.486+0000 7f58baffd640 1 -- 172.21.15.123:0/2331456967 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58bc016070 con 0x7f58c410bea0 2024-08-18T22:14:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.486+0000 7f58cbb76640 1 -- 172.21.15.123:0/2331456967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c419f680 con 0x7f58c410bea0 2024-08-18T22:14:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.486+0000 7f58baffd640 1 -- 172.21.15.123:0/2331456967 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc00f2e0 con 0x7f58c410bea0 2024-08-18T22:14:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.486+0000 7f58cbb76640 1 -- 172.21.15.123:0/2331456967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c41a6f60 con 0x7f58c410bea0 2024-08-18T22:14:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.487+0000 7f58cbb76640 1 -- 172.21.15.123:0/2331456967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c4102e50 con 0x7f58c410bea0 2024-08-18T22:14:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.488+0000 7f58baffd640 1 -- 172.21.15.123:0/2331456967 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f58bc0119d0 con 0x7f58c410bea0 2024-08-18T22:14:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.489+0000 7f58baffd640 1 --2- 172.21.15.123:0/2331456967 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58b00a2b80 0x7f58b00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.489+0000 7f58c9912640 1 --2- 172.21.15.123:0/2331456967 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58b00a2b80 0x7f58b00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.489+0000 7f58baffd640 1 -- 172.21.15.123:0/2331456967 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f58bc0cf0c0 con 0x7f58c410bea0 2024-08-18T22:14:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.489+0000 7f58c9912640 1 --2- 172.21.15.123:0/2331456967 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58b00a2b80 0x7f58b00a5040 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f58b40058c0 tx=0x7f58b400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.492+0000 7f58baffd640 1 -- 172.21.15.123:0/2331456967 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f58bc09bc30 con 0x7f58c410bea0 2024-08-18T22:14:57.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:57 smithi183 ceph-mon[22097]: pgmap v555: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 184 KiB/s wr, 81 op/s 2024-08-18T22:14:57.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.692+0000 7f58cbb76640 1 -- 172.21.15.123:0/2331456967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58c419b740 con 0x7f58c410bea0 2024-08-18T22:14:57.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.692+0000 7f58baffd640 1 -- 172.21.15.123:0/2331456967 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11928 (secure 0 0 0) 0x7f58bc09b530 con 0x7f58c410bea0 2024-08-18T22:14:57.693 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:14:57.694 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":32,"btime":"2024-08-18T22:13:42:106357+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:13:41.668028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":125,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:14:57.694 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 32 2024-08-18T22:14:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.694+0000 7f58cbb76640 1 -- 172.21.15.123:0/2331456967 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58b00a2b80 msgr2=0x7f58b00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.694+0000 7f58cbb76640 1 --2- 172.21.15.123:0/2331456967 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58b00a2b80 0x7f58b00a5040 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f58b40058c0 tx=0x7f58b400a2d0 comp rx=0 tx=0).stop 2024-08-18T22:14:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.694+0000 7f58cbb76640 1 -- 172.21.15.123:0/2331456967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c410bea0 msgr2=0x7f58c419ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.694+0000 7f58cbb76640 1 --2- 172.21.15.123:0/2331456967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c410bea0 0x7f58c419ecb0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009fd0 tx=0x7f58bc00b8e0 comp rx=0 tx=0).stop 2024-08-18T22:14:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.694+0000 7f58cbb76640 1 -- 172.21.15.123:0/2331456967 shutdown_connections 2024-08-18T22:14:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.694+0000 7f58cbb76640 1 --2- 172.21.15.123:0/2331456967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58c410bea0 0x7f58c419ecb0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.694+0000 7f58cbb76640 1 --2- 172.21.15.123:0/2331456967 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58b00a2b80 0x7f58b00a5040 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.694+0000 7f58cbb76640 1 --2- 172.21.15.123:0/2331456967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58c4103390 0x7f58c419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.694+0000 7f58cbb76640 1 --2- 172.21.15.123:0/2331456967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58c4102a70 0x7f58c419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.694+0000 7f58cbb76640 1 -- 172.21.15.123:0/2331456967 >> 172.21.15.123:0/2331456967 conn(0x7f58c40fc4d0 msgr2=0x7f58c40fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.695+0000 7f58cbb76640 1 -- 172.21.15.123:0/2331456967 shutdown_connections 2024-08-18T22:14:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:57.695+0000 7f58cbb76640 1 -- 172.21.15.123:0/2331456967 wait complete. 2024-08-18T22:14:57.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:57 smithi130 ceph-mon[21698]: pgmap v555: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 184 KiB/s wr, 81 op/s 2024-08-18T22:14:58.373 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db --set-id fd804fe6 --release --await' 2024-08-18T22:14:58.373 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24466 quiesce db --set-id fd804fe6 --release --await 2024-08-18T22:14:58.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:58 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2331456967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:14:58.626 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:14:58.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:58 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2331456967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:14:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:58 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2331456967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:14:59.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.093+0000 7f20f23bc640 1 -- 172.21.15.123:0/924877951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ec1022a0 msgr2=0x7f20ec1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:59.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.093+0000 7f20f23bc640 1 --2- 172.21.15.123:0/924877951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ec1022a0 0x7f20ec1026e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009900 tx=0x7f20e002a480 comp rx=0 tx=0).stop 2024-08-18T22:14:59.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.093+0000 7f20f23bc640 1 -- 172.21.15.123:0/924877951 shutdown_connections 2024-08-18T22:14:59.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.093+0000 7f20f23bc640 1 --2- 172.21.15.123:0/924877951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20ec102c20 0x7f20ec10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.093+0000 7f20f23bc640 1 --2- 172.21.15.123:0/924877951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ec1022a0 0x7f20ec1026e0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.093+0000 7f20f23bc640 1 --2- 172.21.15.123:0/924877951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec100b50 0x7f20ec100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.093+0000 7f20f23bc640 1 -- 172.21.15.123:0/924877951 >> 172.21.15.123:0/924877951 conn(0x7f20ec0fc500 msgr2=0x7f20ec0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.093+0000 7f20f23bc640 1 -- 172.21.15.123:0/924877951 shutdown_connections 2024-08-18T22:14:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.093+0000 7f20f23bc640 1 -- 172.21.15.123:0/924877951 wait complete. 2024-08-18T22:14:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.094+0000 7f20f23bc640 1 Processor -- start 2024-08-18T22:14:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.094+0000 7f20f23bc640 1 -- start start 2024-08-18T22:14:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.094+0000 7f20f23bc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ec100b50 0x7f20ec1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.094+0000 7f20f23bc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec1022a0 0x7f20ec1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.094+0000 7f20f23bc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20ec102c20 0x7f20ec1a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.094+0000 7f20f23bc640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec110d50 con 0x7f20ec100b50 2024-08-18T22:14:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.094+0000 7f20f23bc640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec110bd0 con 0x7f20ec1022a0 2024-08-18T22:14:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.094+0000 7f20f23bc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec110ed0 con 0x7f20ec102c20 2024-08-18T22:14:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.094+0000 7f20ebfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ec100b50 0x7f20ec1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.094+0000 7f20ebfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ec100b50 0x7f20ec1991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60600/0 (socket says 172.21.15.123:60600) 2024-08-18T22:14:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.094+0000 7f20ebfff640 1 -- 172.21.15.123:0/3533097028 learned_addr learned my addr 172.21.15.123:0/3533097028 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.095+0000 7f20eb7fe640 1 --2- 172.21.15.123:0/3533097028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec1022a0 0x7f20ec1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.095+0000 7f20f0959640 1 --2- 172.21.15.123:0/3533097028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20ec102c20 0x7f20ec1a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.095+0000 7f20ebfff640 1 -- 172.21.15.123:0/3533097028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20ec102c20 msgr2=0x7f20ec1a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.095+0000 7f20ebfff640 1 --2- 172.21.15.123:0/3533097028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20ec102c20 0x7f20ec1a4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.095+0000 7f20ebfff640 1 -- 172.21.15.123:0/3533097028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec1022a0 msgr2=0x7f20ec1996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.095+0000 7f20ebfff640 1 --2- 172.21.15.123:0/3533097028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec1022a0 0x7f20ec1996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.095+0000 7f20ebfff640 1 -- 172.21.15.123:0/3533097028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ec1a4760 con 0x7f20ec100b50 2024-08-18T22:14:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.095+0000 7f20f0959640 1 --2- 172.21.15.123:0/3533097028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20ec102c20 0x7f20ec1a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:14:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.095+0000 7f20ebfff640 1 --2- 172.21.15.123:0/3533097028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ec100b50 0x7f20ec1991a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00b4a0 tx=0x7f20dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.095+0000 7f20e97fa640 1 -- 172.21.15.123:0/3533097028 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc014070 con 0x7f20ec100b50 2024-08-18T22:14:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.095+0000 7f20f23bc640 1 -- 172.21.15.123:0/3533097028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ec1a4930 con 0x7f20ec100b50 2024-08-18T22:14:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.095+0000 7f20e97fa640 1 -- 172.21.15.123:0/3533097028 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20dc010af0 con 0x7f20ec100b50 2024-08-18T22:14:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.095+0000 7f20e97fa640 1 -- 172.21.15.123:0/3533097028 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc017d10 con 0x7f20ec100b50 2024-08-18T22:14:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.095+0000 7f20f23bc640 1 -- 172.21.15.123:0/3533097028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ec1a4e90 con 0x7f20ec100b50 2024-08-18T22:14:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.098+0000 7f20e97fa640 1 -- 172.21.15.123:0/3533097028 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f20dc017070 con 0x7f20ec100b50 2024-08-18T22:14:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.098+0000 7f20f47ba740 1 Processor -- start 2024-08-18T22:14:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.098+0000 7f20f47ba740 1 -- start start 2024-08-18T22:14:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.098+0000 7f20f47ba740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6fe990 0x55ec3b6fed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.098+0000 7f20f47ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b709630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.098+0000 7f20f47ba740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b709b70 0x55ec3b70bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.098+0000 7f20f47ba740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ec3b664c60 con 0x55ec3b6fe990 2024-08-18T22:14:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.098+0000 7f20f47ba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ec3b5fcb90 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.098+0000 7f20f47ba740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ec3b660c20 con 0x55ec3b709b70 2024-08-18T22:14:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.098+0000 7f20f0959640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6fe990 0x55ec3b6fed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.098+0000 7f20f0959640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6fe990 0x55ec3b6fed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60606/0 (socket says 172.21.15.123:60606) 2024-08-18T22:14:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.098+0000 7f20f0959640 1 -- 172.21.15.123:0/1353374932 learned_addr learned my addr 172.21.15.123:0/1353374932 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.098+0000 7f20eb7fe640 1 --2- 172.21.15.123:0/1353374932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b709b70 0x55ec3b70bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.098+0000 7f20ebfff640 1 --2- 172.21.15.123:0/1353374932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b709630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.098+0000 7f20e97fa640 1 --2- 172.21.15.123:0/3533097028 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f20d40a2c00 0x7f20d40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.099+0000 7f20f0959640 1 -- 172.21.15.123:0/1353374932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b709b70 msgr2=0x55ec3b70bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.099+0000 7f20f0959640 1 --2- 172.21.15.123:0/1353374932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b709b70 0x55ec3b70bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.099+0000 7f20f0959640 1 -- 172.21.15.123:0/1353374932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b6ff2b0 msgr2=0x55ec3b709630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.099+0000 7f20f0959640 1 --2- 172.21.15.123:0/1353374932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b709630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.099+0000 7f20f0959640 1 -- 172.21.15.123:0/1353374932 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec3b374580 con 0x55ec3b6fe990 2024-08-18T22:14:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.099+0000 7f20e97fa640 1 -- 172.21.15.123:0/3533097028 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f20dc0ce6c0 con 0x7f20ec100b50 2024-08-18T22:14:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.099+0000 7f20f0959640 1 --2- 172.21.15.123:0/3533097028 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f20d40a2c00 0x7f20d40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.099+0000 7f20f0959640 1 --2- 172.21.15.123:0/1353374932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6fe990 0x55ec3b6fed70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f20e400c550 tx=0x7f20e400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a98d39544b081e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.099+0000 7f20d27fc640 1 -- 172.21.15.123:0/1353374932 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e400a600 con 0x55ec3b6fe990 2024-08-18T22:14:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.099+0000 7f20d27fc640 1 -- 172.21.15.123:0/1353374932 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e400ac80 con 0x55ec3b6fe990 2024-08-18T22:14:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.099+0000 7f20d27fc640 1 -- 172.21.15.123:0/1353374932 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4018a80 con 0x55ec3b6fe990 2024-08-18T22:14:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.099+0000 7f20f0959640 1 --2- 172.21.15.123:0/3533097028 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f20d40a2c00 0x7f20d40a50c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f20e401f000 tx=0x7f20e4018000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.100+0000 7f20f47ba740 1 -- 172.21.15.123:0/1353374932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6fe990 msgr2=0x55ec3b6fed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.100+0000 7f20f47ba740 1 --2- 172.21.15.123:0/1353374932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6fe990 0x55ec3b6fed70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f20e400c550 tx=0x7f20e400ca10 comp rx=0 tx=0).stop 2024-08-18T22:14:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.100+0000 7f20f47ba740 1 -- 172.21.15.123:0/1353374932 shutdown_connections 2024-08-18T22:14:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.100+0000 7f20f47ba740 1 --2- 172.21.15.123:0/1353374932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b709b70 0x55ec3b70bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.100+0000 7f20f47ba740 1 --2- 172.21.15.123:0/1353374932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b709630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.100+0000 7f20f47ba740 1 --2- 172.21.15.123:0/1353374932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6fe990 0x55ec3b6fed70 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.100+0000 7f20f47ba740 1 -- 172.21.15.123:0/1353374932 >> 172.21.15.123:0/1353374932 conn(0x55ec3b6faf20 msgr2=0x55ec3b6fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.100+0000 7f20f47ba740 1 -- 172.21.15.123:0/1353374932 shutdown_connections 2024-08-18T22:14:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.100+0000 7f20f47ba740 1 -- 172.21.15.123:0/1353374932 wait complete. 2024-08-18T22:14:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.100+0000 7f20f47ba740 1 -- start start 2024-08-18T22:14:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.101+0000 7f20f47ba740 1 Processor -- start 2024-08-18T22:14:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.101+0000 7f20f47ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b6fe990 0x55ec3b7069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.101+0000 7f20f47ba740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b706f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.101+0000 7f20f47ba740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b709b70 0x55ec3b707450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.101+0000 7f20f47ba740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ec3b70c740 con 0x55ec3b709b70 2024-08-18T22:14:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.101+0000 7f20f47ba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ec3b6027c0 con 0x55ec3b6fe990 2024-08-18T22:14:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.101+0000 7f20f47ba740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ec3b70c8c0 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.101+0000 7f20f47ba740 10 client.0 _ll_register_callbacks cb 0x55ec3b60bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:14:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.101+0000 7f20f0959640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b709b70 0x55ec3b707450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.101+0000 7f20f0959640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b709b70 0x55ec3b707450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60614/0 (socket says 172.21.15.123:60614) 2024-08-18T22:14:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.101+0000 7f20f0959640 1 -- 172.21.15.123:0/2695744670 learned_addr learned my addr 172.21.15.123:0/2695744670 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.101+0000 7f20eb7fe640 1 --2- 172.21.15.123:0/2695744670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b706f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.101+0000 7f20ebfff640 1 --2- 172.21.15.123:0/2695744670 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b6fe990 0x55ec3b7069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.102+0000 7f20f0959640 1 -- 172.21.15.123:0/2695744670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b6ff2b0 msgr2=0x55ec3b706f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.102+0000 7f20f0959640 1 --2- 172.21.15.123:0/2695744670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b706f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.102+0000 7f20f0959640 1 -- 172.21.15.123:0/2695744670 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b6fe990 msgr2=0x55ec3b7069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.102+0000 7f20f0959640 1 --2- 172.21.15.123:0/2695744670 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b6fe990 0x55ec3b7069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.102+0000 7f20f0959640 1 -- 172.21.15.123:0/2695744670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec3b43e960 con 0x55ec3b709b70 2024-08-18T22:14:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.102+0000 7f20f0959640 1 --2- 172.21.15.123:0/2695744670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b709b70 0x55ec3b707450 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f20e4018fd0 tx=0x7f20e40093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee9f9630a432459 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.102+0000 7f20cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:14:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.102+0000 7f20cb7fe640 1 -- 172.21.15.123:0/2695744670 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e400c270 con 0x55ec3b709b70 2024-08-18T22:14:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.102+0000 7f20cb7fe640 1 -- 172.21.15.123:0/2695744670 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f20e400a610 con 0x55ec3b709b70 2024-08-18T22:14:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.102+0000 7f20f47ba740 1 -- 172.21.15.123:0/2695744670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20e400ac80 con 0x55ec3b709b70 2024-08-18T22:14:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.102+0000 7f20cb7fe640 1 -- 172.21.15.123:0/2695744670 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f20e4007e70 con 0x55ec3b709b70 2024-08-18T22:14:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.102+0000 7f20f47ba740 10 client.16779 fetch_fsmap learned FSMap version 32 2024-08-18T22:14:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.102+0000 7f20f47ba740 1 -- 172.21.15.123:0/2695744670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ec3b718700 con 0x55ec3b709b70 2024-08-18T22:14:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.102+0000 7f20cb7fe640 1 -- 172.21.15.123:0/2695744670 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e400ac80 con 0x55ec3b709b70 2024-08-18T22:14:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.103+0000 7f20cb7fe640 1 -- 172.21.15.123:0/2695744670 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f20e4023ab0 con 0x55ec3b709b70 2024-08-18T22:14:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.103+0000 7f20f47ba740 10 client.16779 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:14:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.103+0000 7f20f47ba740 10 client.16779 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:14:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.103+0000 7f20f47ba740 20 client.16779 populate_metadata read hostname 'smithi123' 2024-08-18T22:14:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.103+0000 7f20f47ba740 1 --2- 172.21.15.123:0/2695744670 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ec3b719a50 0x55ec3b71beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.103+0000 7f20f47ba740 4 client.16779 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:14:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.103+0000 7f20f47ba740 1 -- 172.21.15.123:0/2695744670 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec3b6721d0 con 0x55ec3b719a50 2024-08-18T22:14:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.103+0000 7f20ebfff640 1 --2- 172.21.15.123:0/2695744670 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ec3b719a50 0x55ec3b71beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.103+0000 7f20cb7fe640 10 client.16779 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.103+0000 7f20ebfff640 1 --2- 172.21.15.123:0/2695744670 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ec3b719a50 0x55ec3b71beb0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8062893d88e40bc server_cookie=f1e3565340e778e4 in_seq=0 out_seq=0 2024-08-18T22:14:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.104+0000 7f20cb7fe640 1 -- 172.21.15.123:0/2695744670 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec3b6721d0 con 0x55ec3b719a50 2024-08-18T22:14:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.104+0000 7f20cb7fe640 10 client.16779 handle_command_reply: tid=0 2024-08-18T22:14:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.104+0000 7f20f47ba740 1 client.16779 shutdown 2024-08-18T22:14:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.104+0000 7f20f47ba740 1 -- 172.21.15.123:0/2695744670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b709b70 msgr2=0x55ec3b707450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.104+0000 7f20f47ba740 1 --2- 172.21.15.123:0/2695744670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b709b70 0x55ec3b707450 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f20e4018fd0 tx=0x7f20e40093d0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.104+0000 7f20f47ba740 1 -- 172.21.15.123:0/2695744670 shutdown_connections 2024-08-18T22:14:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.104+0000 7f20f47ba740 1 --2- 172.21.15.123:0/2695744670 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ec3b719a50 0x55ec3b71beb0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.105+0000 7f20cb7fe640 0 client.16779 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:59.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.105+0000 7f20f47ba740 1 --2- 172.21.15.123:0/2695744670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b709b70 0x55ec3b707450 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.105+0000 7f20f47ba740 1 --2- 172.21.15.123:0/2695744670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b706f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.105+0000 7f20f47ba740 1 --2- 172.21.15.123:0/2695744670 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b6fe990 0x55ec3b7069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.105+0000 7f20f47ba740 1 -- 172.21.15.123:0/2695744670 >> 172.21.15.123:0/2695744670 conn(0x55ec3b6faf20 msgr2=0x55ec3b6fa080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:59.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.105+0000 7f20f47ba740 1 -- 172.21.15.123:0/2695744670 shutdown_connections 2024-08-18T22:14:59.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.105+0000 7f20f47ba740 1 -- 172.21.15.123:0/2695744670 wait complete. 2024-08-18T22:14:59.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.105+0000 7f20f47ba740 20 client.16779 trim_cache size 0 max 16384 2024-08-18T22:14:59.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20f47ba740 1 Processor -- start 2024-08-18T22:14:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20f47ba740 1 -- start start 2024-08-18T22:14:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20f47ba740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b6fe990 0x55ec3b7013f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20f47ba740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b705910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20f47ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b709b70 0x55ec3b7217d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20f47ba740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec1b1460 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20f47ba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec1aec70 con 0x55ec3b709b70 2024-08-18T22:14:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20f47ba740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec1acac0 con 0x55ec3b6fe990 2024-08-18T22:14:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20eb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b705910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20eb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b705910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60620/0 (socket says 172.21.15.123:60620) 2024-08-18T22:14:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20eb7fe640 1 -- 172.21.15.123:0/804963422 learned_addr learned my addr 172.21.15.123:0/804963422 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20f0959640 1 --2- 172.21.15.123:0/804963422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b709b70 0x55ec3b7217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20ebfff640 1 --2- 172.21.15.123:0/804963422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b6fe990 0x55ec3b7013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20eb7fe640 1 -- 172.21.15.123:0/804963422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b6fe990 msgr2=0x55ec3b7013f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20eb7fe640 1 --2- 172.21.15.123:0/804963422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b6fe990 0x55ec3b7013f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20eb7fe640 1 -- 172.21.15.123:0/804963422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b709b70 msgr2=0x55ec3b7217d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20eb7fe640 1 --2- 172.21.15.123:0/804963422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b709b70 0x55ec3b7217d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.122+0000 7f20eb7fe640 1 -- 172.21.15.123:0/804963422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec3b6ffb30 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.123+0000 7f20eb7fe640 1 --2- 172.21.15.123:0/804963422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b705910 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009900 tx=0x7f20e00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3862b6dad01ba971 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.123+0000 7f20d1ffb640 1 -- 172.21.15.123:0/804963422 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0035040 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.123+0000 7f20d1ffb640 1 -- 172.21.15.123:0/804963422 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e0003ad0 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.123+0000 7f20d1ffb640 1 -- 172.21.15.123:0/804963422 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0031cb0 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.123+0000 7f20f47ba740 1 -- 172.21.15.123:0/804963422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6ff2b0 msgr2=0x55ec3b705910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.123+0000 7f20f47ba740 1 --2- 172.21.15.123:0/804963422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b705910 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009900 tx=0x7f20e00043c0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.124+0000 7f20f47ba740 1 -- 172.21.15.123:0/804963422 shutdown_connections 2024-08-18T22:14:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.124+0000 7f20f47ba740 1 --2- 172.21.15.123:0/804963422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b709b70 0x55ec3b7217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.124+0000 7f20f47ba740 1 --2- 172.21.15.123:0/804963422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b705910 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.124+0000 7f20f47ba740 1 --2- 172.21.15.123:0/804963422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b6fe990 0x55ec3b7013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.124+0000 7f20f47ba740 1 -- 172.21.15.123:0/804963422 >> 172.21.15.123:0/804963422 conn(0x55ec3b6faf20 msgr2=0x55ec3b708a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.124+0000 7f20f47ba740 1 -- 172.21.15.123:0/804963422 shutdown_connections 2024-08-18T22:14:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.124+0000 7f20f47ba740 1 -- 172.21.15.123:0/804963422 wait complete. 2024-08-18T22:14:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.124+0000 7f20f47ba740 1 -- start start 2024-08-18T22:14:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.124+0000 7f20f47ba740 1 Processor -- start 2024-08-18T22:14:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.124+0000 7f20f47ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b6fe990 0x55ec3b711f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.124+0000 7f20f47ba740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b70d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.124+0000 7f20f47ba740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b709b70 0x55ec3b70d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20f47ba740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec1ad130 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20f47ba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec1ae5a0 con 0x55ec3b6fe990 2024-08-18T22:14:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20f47ba740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec1ad800 con 0x55ec3b709b70 2024-08-18T22:14:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20f47ba740 10 client.0 _ll_register_callbacks cb 0x7f20e400c420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:14:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20eb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b70d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20eb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b70d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60626/0 (socket says 172.21.15.123:60626) 2024-08-18T22:14:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20eb7fe640 1 -- 172.21.15.123:0/648313655 learned_addr learned my addr 172.21.15.123:0/648313655 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:14:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20ebfff640 1 --2- 172.21.15.123:0/648313655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b6fe990 0x55ec3b711f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20f0959640 1 --2- 172.21.15.123:0/648313655 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b709b70 0x55ec3b70d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20eb7fe640 1 -- 172.21.15.123:0/648313655 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b709b70 msgr2=0x55ec3b70d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20eb7fe640 1 --2- 172.21.15.123:0/648313655 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b709b70 0x55ec3b70d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20eb7fe640 1 -- 172.21.15.123:0/648313655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b6fe990 msgr2=0x55ec3b711f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:14:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20eb7fe640 1 --2- 172.21.15.123:0/648313655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b6fe990 0x55ec3b711f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20eb7fe640 1 -- 172.21.15.123:0/648313655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec3b70dcf0 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20eb7fe640 1 --2- 172.21.15.123:0/648313655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b70d270 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f20e002a9a0 tx=0x7f20e0003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256d0e099fb8672 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:14:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:14:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20cb7fe640 1 -- 172.21.15.123:0/648313655 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0035030 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20cb7fe640 1 -- 172.21.15.123:0/648313655 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f20e0003800 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.125+0000 7f20f47ba740 1 -- 172.21.15.123:0/648313655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20e0003ad0 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.126+0000 7f20cb7fe640 1 -- 172.21.15.123:0/648313655 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f20e0031930 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.126+0000 7f20f47ba740 10 client.16785 fetch_fsmap learned FSMap version 32 2024-08-18T22:14:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.126+0000 7f20f47ba740 1 -- 172.21.15.123:0/648313655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ec3b7888e0 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.126+0000 7f20cb7fe640 1 -- 172.21.15.123:0/648313655 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e0003ad0 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.126+0000 7f20cb7fe640 1 -- 172.21.15.123:0/648313655 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f20e003cb10 con 0x55ec3b6ff2b0 2024-08-18T22:14:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.126+0000 7f20f47ba740 10 client.16785 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:14:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.126+0000 7f20f47ba740 10 client.16785 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:14:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.126+0000 7f20f47ba740 20 client.16785 populate_metadata read hostname 'smithi123' 2024-08-18T22:14:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.126+0000 7f20f47ba740 1 --2- 172.21.15.123:0/648313655 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ec3b789090 0x55ec3b78b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:14:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.126+0000 7f20f47ba740 4 client.16785 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fd804fe6", "release": true, "await": true}] 2024-08-18T22:14:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.126+0000 7f20f47ba740 1 -- 172.21.15.123:0/648313655 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fd804fe6", "release": true, "await": true}) -- 0x55ec3b66c6e0 con 0x55ec3b789090 2024-08-18T22:14:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.126+0000 7f20ebfff640 1 --2- 172.21.15.123:0/648313655 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ec3b789090 0x55ec3b78b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:14:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.127+0000 7f20ebfff640 1 --2- 172.21.15.123:0/648313655 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ec3b789090 0x55ec3b78b4b0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf3c5a6fa9bc45ba server_cookie=581c97db99fa98ed in_seq=0 out_seq=0 2024-08-18T22:14:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.127+0000 7f20cb7fe640 10 client.16785 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.376+0000 7f20cb7fe640 1 -- 172.21.15.123:0/648313655 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ec3b66c6e0 con 0x55ec3b789090 2024-08-18T22:14:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.376+0000 7f20cb7fe640 10 client.16785 handle_command_reply: tid=0 2024-08-18T22:14:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.376+0000 7f20f47ba740 1 client.16785 shutdown 2024-08-18T22:14:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.376+0000 7f20f47ba740 1 -- 172.21.15.123:0/648313655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6ff2b0 msgr2=0x55ec3b70d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.376+0000 7f20f47ba740 1 --2- 172.21.15.123:0/648313655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b70d270 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f20e002a9a0 tx=0x7f20e0003f30 comp rx=0 tx=0).stop 2024-08-18T22:14:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.376+0000 7f20f47ba740 1 -- 172.21.15.123:0/648313655 shutdown_connections 2024-08-18T22:14:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.376+0000 7f20f47ba740 1 --2- 172.21.15.123:0/648313655 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55ec3b789090 0x55ec3b78b4b0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.376+0000 7f20f47ba740 1 --2- 172.21.15.123:0/648313655 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3b709b70 0x55ec3b70d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.376+0000 7f20f47ba740 1 --2- 172.21.15.123:0/648313655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ec3b6ff2b0 0x55ec3b70d270 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.376+0000 7f20cb7fe640 0 client.16785 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:14:59.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.376+0000 7f20f47ba740 1 --2- 172.21.15.123:0/648313655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec3b6fe990 0x55ec3b711f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.376+0000 7f20f47ba740 1 -- 172.21.15.123:0/648313655 >> 172.21.15.123:0/648313655 conn(0x55ec3b6faf20 msgr2=0x55ec3b706970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:59.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.376+0000 7f20f47ba740 1 -- 172.21.15.123:0/648313655 shutdown_connections 2024-08-18T22:14:59.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.376+0000 7f20f47ba740 1 -- 172.21.15.123:0/648313655 wait complete. 2024-08-18T22:14:59.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.377+0000 7f20f47ba740 20 client.16785 trim_cache size 0 max 16384 2024-08-18T22:14:59.379 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:14:59.379 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 32, 2024-08-18T22:14:59.379 INFO:teuthology.orchestra.run.smithi123.stdout: "leader": 24466, 2024-08-18T22:14:59.380 INFO:teuthology.orchestra.run.smithi123.stdout: "set_version": 20, 2024-08-18T22:14:59.380 INFO:teuthology.orchestra.run.smithi123.stdout: "sets": { 2024-08-18T22:14:59.380 INFO:teuthology.orchestra.run.smithi123.stdout: "fd804fe6": { 2024-08-18T22:14:59.380 INFO:teuthology.orchestra.run.smithi123.stdout: "version": 20, 2024-08-18T22:14:59.380 INFO:teuthology.orchestra.run.smithi123.stdout: "age_ref": 0.0, 2024-08-18T22:14:59.380 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:14:59.380 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RELEASED", 2024-08-18T22:14:59.380 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:14:59.380 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:14:59.380 INFO:teuthology.orchestra.run.smithi123.stdout: "timeout": 90.0, 2024-08-18T22:14:59.380 INFO:teuthology.orchestra.run.smithi123.stdout: "expiration": 139.2, 2024-08-18T22:14:59.380 INFO:teuthology.orchestra.run.smithi123.stdout: "members": { 2024-08-18T22:14:59.380 INFO:teuthology.orchestra.run.smithi123.stdout: "file:/": { 2024-08-18T22:14:59.380 INFO:teuthology.orchestra.run.smithi123.stdout: "excluded": false, 2024-08-18T22:14:59.381 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:14:59.381 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RELEASED", 2024-08-18T22:14:59.381 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:14:59.381 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:14:59.381 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:14:59.381 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:14:59.381 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:14:59.381 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:14:59.381 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:14:59.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.377+0000 7f20f23bc640 1 -- 172.21.15.123:0/3533097028 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f20d40a2c00 msgr2=0x7f20d40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:59.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.377+0000 7f20f23bc640 1 --2- 172.21.15.123:0/3533097028 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f20d40a2c00 0x7f20d40a50c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f20e401f000 tx=0x7f20e4018000 comp rx=0 tx=0).stop 2024-08-18T22:14:59.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.377+0000 7f20f23bc640 1 -- 172.21.15.123:0/3533097028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ec100b50 msgr2=0x7f20ec1991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:14:59.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.377+0000 7f20f23bc640 1 --2- 172.21.15.123:0/3533097028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ec100b50 0x7f20ec1991a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00b4a0 tx=0x7f20dc00b960 comp rx=0 tx=0).stop 2024-08-18T22:14:59.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.377+0000 7f20f23bc640 1 -- 172.21.15.123:0/3533097028 shutdown_connections 2024-08-18T22:14:59.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.377+0000 7f20f23bc640 1 --2- 172.21.15.123:0/3533097028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20ec102c20 0x7f20ec1a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.377+0000 7f20f23bc640 1 --2- 172.21.15.123:0/3533097028 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f20d40a2c00 0x7f20d40a50c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.377+0000 7f20f23bc640 1 --2- 172.21.15.123:0/3533097028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec1022a0 0x7f20ec1996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.377+0000 7f20f23bc640 1 --2- 172.21.15.123:0/3533097028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ec100b50 0x7f20ec1991a0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:14:59.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.377+0000 7f20f23bc640 1 -- 172.21.15.123:0/3533097028 >> 172.21.15.123:0/3533097028 conn(0x7f20ec0fc500 msgr2=0x7f20ec0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:14:59.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.377+0000 7f20f23bc640 1 -- 172.21.15.123:0/3533097028 shutdown_connections 2024-08-18T22:14:59.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:14:59.377+0000 7f20f23bc640 1 -- 172.21.15.123:0/3533097028 wait complete. 2024-08-18T22:14:59.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:14:59 smithi183 ceph-mon[22097]: pgmap v556: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 54 op/s 2024-08-18T22:14:59.693 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:14:59 smithi123 ceph-mon[18462]: pgmap v556: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 54 op/s 2024-08-18T22:14:59.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:14:59 smithi130 ceph-mon[21698]: pgmap v556: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 54 op/s 2024-08-18T22:15:00.024 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fd804fe6', total seconds elapsed: 22.4 2024-08-18T22:15:00.025 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.2 2024-08-18T22:15:00.025 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:15:00.302 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:15:00.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.931+0000 7fc68f651640 1 -- 172.21.15.123:0/1744671790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc688103ac0 msgr2=0x7fc688103f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:00.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.931+0000 7fc68f651640 1 --2- 172.21.15.123:0/1744671790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc688103ac0 0x7fc688103f20 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fc678009930 tx=0x7fc67802a420 comp rx=0 tx=0).stop 2024-08-18T22:15:00.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.931+0000 7fc68f651640 1 -- 172.21.15.123:0/1744671790 shutdown_connections 2024-08-18T22:15:00.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.931+0000 7fc68f651640 1 --2- 172.21.15.123:0/1744671790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc688104460 0x7fc688110990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:00.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.931+0000 7fc68f651640 1 --2- 172.21.15.123:0/1744671790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc688103ac0 0x7fc688103f20 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:00.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.931+0000 7fc68f651640 1 --2- 172.21.15.123:0/1744671790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc688109ac0 0x7fc688109ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.931+0000 7fc68f651640 1 -- 172.21.15.123:0/1744671790 >> 172.21.15.123:0/1744671790 conn(0x7fc6880ff7e0 msgr2=0x7fc688101c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.932+0000 7fc68f651640 1 -- 172.21.15.123:0/1744671790 shutdown_connections 2024-08-18T22:15:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.932+0000 7fc68f651640 1 -- 172.21.15.123:0/1744671790 wait complete. 2024-08-18T22:15:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.932+0000 7fc68f651640 1 Processor -- start 2024-08-18T22:15:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.932+0000 7fc68f651640 1 -- start start 2024-08-18T22:15:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.932+0000 7fc68f651640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc688103ac0 0x7fc68819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.932+0000 7fc68f651640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc688104460 0x7fc68819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.932+0000 7fc68f651640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc688109ac0 0x7fc68819ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.932+0000 7fc68f651640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc688113ec0 con 0x7fc688103ac0 2024-08-18T22:15:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.932+0000 7fc68f651640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc688113d40 con 0x7fc688109ac0 2024-08-18T22:15:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.932+0000 7fc68f651640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc688114040 con 0x7fc688104460 2024-08-18T22:15:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc68d3ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc688103ac0 0x7fc68819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc68d3ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc688103ac0 0x7fc68819a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60640/0 (socket says 172.21.15.123:60640) 2024-08-18T22:15:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc68dbee640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc688109ac0 0x7fc68819ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc68cbec640 1 --2- 172.21.15.123:0/3641867709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc688104460 0x7fc68819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc68d3ed640 1 -- 172.21.15.123:0/3641867709 learned_addr learned my addr 172.21.15.123:0/3641867709 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc68d3ed640 1 -- 172.21.15.123:0/3641867709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc688104460 msgr2=0x7fc68819a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc68d3ed640 1 --2- 172.21.15.123:0/3641867709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc688104460 0x7fc68819a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc68d3ed640 1 -- 172.21.15.123:0/3641867709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc688109ac0 msgr2=0x7fc68819ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc68d3ed640 1 --2- 172.21.15.123:0/3641867709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc688109ac0 0x7fc68819ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc68d3ed640 1 -- 172.21.15.123:0/3641867709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68819f330 con 0x7fc688103ac0 2024-08-18T22:15:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc68dbee640 1 --2- 172.21.15.123:0/3641867709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc688109ac0 0x7fc68819ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:15:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc68cbec640 1 --2- 172.21.15.123:0/3641867709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc688104460 0x7fc68819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:15:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc68d3ed640 1 --2- 172.21.15.123:0/3641867709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc688103ac0 0x7fc68819a380 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fc68400e9f0 tx=0x7fc68400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc67e7fc640 1 -- 172.21.15.123:0/3641867709 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68400cd80 con 0x7fc688103ac0 2024-08-18T22:15:00.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc68f651640 1 -- 172.21.15.123:0/3641867709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc68819f620 con 0x7fc688103ac0 2024-08-18T22:15:00.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc67e7fc640 1 -- 172.21.15.123:0/3641867709 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc684005500 con 0x7fc688103ac0 2024-08-18T22:15:00.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.933+0000 7fc67e7fc640 1 -- 172.21.15.123:0/3641867709 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684010690 con 0x7fc688103ac0 2024-08-18T22:15:00.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.934+0000 7fc68f651640 1 -- 172.21.15.123:0/3641867709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6881a6f00 con 0x7fc688103ac0 2024-08-18T22:15:00.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.934+0000 7fc68f651640 1 -- 172.21.15.123:0/3641867709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc688105200 con 0x7fc688103ac0 2024-08-18T22:15:00.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.936+0000 7fc67e7fc640 1 -- 172.21.15.123:0/3641867709 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fc6840046c0 con 0x7fc688103ac0 2024-08-18T22:15:00.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.937+0000 7fc67e7fc640 1 --2- 172.21.15.123:0/3641867709 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc6740a2b80 0x7fc6740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:00.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.937+0000 7fc68cbec640 1 --2- 172.21.15.123:0/3641867709 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc6740a2b80 0x7fc6740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:00.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.937+0000 7fc67e7fc640 1 -- 172.21.15.123:0/3641867709 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fc6840cf950 con 0x7fc688103ac0 2024-08-18T22:15:00.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.937+0000 7fc68cbec640 1 --2- 172.21.15.123:0/3641867709 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc6740a2b80 0x7fc6740a5040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc678009900 tx=0x7fc6780058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:00.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:00.940+0000 7fc67e7fc640 1 -- 172.21.15.123:0/3641867709 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fc684053df0 con 0x7fc688103ac0 2024-08-18T22:15:01.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:01.156+0000 7fc68f651640 1 -- 172.21.15.123:0/3641867709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc688103f20 con 0x7fc688103ac0 2024-08-18T22:15:01.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:01.157+0000 7fc67e7fc640 1 -- 172.21.15.123:0/3641867709 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11928 (secure 0 0 0) 0x7fc688103f20 con 0x7fc688103ac0 2024-08-18T22:15:01.158 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:15:01.159 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 32 2024-08-18T22:15:01.159 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":32,"btime":"2024-08-18T22:13:42:106357+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:13:41.668028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":125,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:15:01.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:01.159+0000 7fc68f651640 1 -- 172.21.15.123:0/3641867709 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc6740a2b80 msgr2=0x7fc6740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:01.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:01.159+0000 7fc68f651640 1 --2- 172.21.15.123:0/3641867709 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc6740a2b80 0x7fc6740a5040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc678009900 tx=0x7fc6780058d0 comp rx=0 tx=0).stop 2024-08-18T22:15:01.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:01.159+0000 7fc68f651640 1 -- 172.21.15.123:0/3641867709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc688103ac0 msgr2=0x7fc68819a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:01.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:01.159+0000 7fc68f651640 1 --2- 172.21.15.123:0/3641867709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc688103ac0 0x7fc68819a380 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fc68400e9f0 tx=0x7fc68400edf0 comp rx=0 tx=0).stop 2024-08-18T22:15:01.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:01.159+0000 7fc68f651640 1 -- 172.21.15.123:0/3641867709 shutdown_connections 2024-08-18T22:15:01.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:01.159+0000 7fc68f651640 1 --2- 172.21.15.123:0/3641867709 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc6740a2b80 0x7fc6740a5040 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:01.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:01.159+0000 7fc68f651640 1 --2- 172.21.15.123:0/3641867709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc688109ac0 0x7fc68819ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:01.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:01.159+0000 7fc68f651640 1 --2- 172.21.15.123:0/3641867709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc688104460 0x7fc68819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:01.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:01.159+0000 7fc68f651640 1 --2- 172.21.15.123:0/3641867709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc688103ac0 0x7fc68819a380 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:01.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:01.160+0000 7fc68f651640 1 -- 172.21.15.123:0/3641867709 >> 172.21.15.123:0/3641867709 conn(0x7fc6880ff7e0 msgr2=0x7fc6880fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:01.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:01.160+0000 7fc68f651640 1 -- 172.21.15.123:0/3641867709 shutdown_connections 2024-08-18T22:15:01.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:01.160+0000 7fc68f651640 1 -- 172.21.15.123:0/3641867709 wait complete. 2024-08-18T22:15:01.478 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:01 smithi123 ceph-mon[18462]: pgmap v557: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 67 KiB/s wr, 54 op/s 2024-08-18T22:15:01.478 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:01 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3641867709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:15:01.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:01 smithi183 ceph-mon[22097]: pgmap v557: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 67 KiB/s wr, 54 op/s 2024-08-18T22:15:01.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:01 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3641867709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:15:01.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:01 smithi130 ceph-mon[21698]: pgmap v557: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 67 KiB/s wr, 54 op/s 2024-08-18T22:15:01.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:01 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3641867709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:15:01.894 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db / --timeout 90 --expiration 139.2 --await-for 45.0' 2024-08-18T22:15:01.895 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24466 quiesce db / --timeout 90 --expiration 139.2 --await-for 45.0 2024-08-18T22:15:02.216 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:15:02.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.746+0000 7f4d3fe8f640 1 -- 172.21.15.123:0/1795682633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d38074b60 msgr2=0x7f4d3810dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:02.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.746+0000 7f4d3fe8f640 1 --2- 172.21.15.123:0/1795682633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d38074b60 0x7f4d3810dc40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009900 tx=0x7f4d2802a480 comp rx=0 tx=0).stop 2024-08-18T22:15:02.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.747+0000 7f4d3fe8f640 1 -- 172.21.15.123:0/1795682633 shutdown_connections 2024-08-18T22:15:02.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.747+0000 7f4d3fe8f640 1 --2- 172.21.15.123:0/1795682633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d3810e180 0x7f4d38110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.747+0000 7f4d3fe8f640 1 --2- 172.21.15.123:0/1795682633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d38074b60 0x7f4d3810dc40 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.747+0000 7f4d3fe8f640 1 --2- 172.21.15.123:0/1795682633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d38074240 0x7f4d38074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.747+0000 7f4d3fe8f640 1 -- 172.21.15.123:0/1795682633 >> 172.21.15.123:0/1795682633 conn(0x7f4d380fd620 msgr2=0x7f4d380ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.747+0000 7f4d3fe8f640 1 -- 172.21.15.123:0/1795682633 shutdown_connections 2024-08-18T22:15:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.747+0000 7f4d3fe8f640 1 -- 172.21.15.123:0/1795682633 wait complete. 2024-08-18T22:15:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.747+0000 7f4d3fe8f640 1 Processor -- start 2024-08-18T22:15:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.747+0000 7f4d3fe8f640 1 -- start start 2024-08-18T22:15:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3fe8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d38074240 0x7f4d3819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3fe8f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d38074b60 0x7f4d3819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3fe8f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d3810e180 0x7f4d3819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3fe8f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4d38113eb0 con 0x7f4d3810e180 2024-08-18T22:15:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3fe8f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4d38113d30 con 0x7f4d38074b60 2024-08-18T22:15:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3fe8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4d38114030 con 0x7f4d38074240 2024-08-18T22:15:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3e42c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d3810e180 0x7f4d3819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3e42c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d3810e180 0x7f4d3819ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42530/0 (socket says 172.21.15.123:42530) 2024-08-18T22:15:02.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3e42c640 1 -- 172.21.15.123:0/2435054846 learned_addr learned my addr 172.21.15.123:0/2435054846 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:02.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/2435054846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d38074b60 0x7f4d3819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3dc2b640 1 --2- 172.21.15.123:0/2435054846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d38074240 0x7f4d3819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3e42c640 1 -- 172.21.15.123:0/2435054846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d38074240 msgr2=0x7f4d3819a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:02.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3e42c640 1 --2- 172.21.15.123:0/2435054846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d38074240 0x7f4d3819a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3e42c640 1 -- 172.21.15.123:0/2435054846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d38074b60 msgr2=0x7f4d3819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:02.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3e42c640 1 --2- 172.21.15.123:0/2435054846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d38074b60 0x7f4d3819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3e42c640 1 -- 172.21.15.123:0/2435054846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3819f3e0 con 0x7f4d3810e180 2024-08-18T22:15:02.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.748+0000 7f4d3e42c640 1 --2- 172.21.15.123:0/2435054846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d3810e180 0x7f4d3819ed00 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000eb40 tx=0x7f4d3000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:02.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.749+0000 7f4d2effd640 1 -- 172.21.15.123:0/2435054846 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30004b20 con 0x7f4d3810e180 2024-08-18T22:15:02.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.749+0000 7f4d3fe8f640 1 -- 172.21.15.123:0/2435054846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3819f6d0 con 0x7f4d3810e180 2024-08-18T22:15:02.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.749+0000 7f4d3fe8f640 1 -- 172.21.15.123:0/2435054846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d381a6fb0 con 0x7f4d3810e180 2024-08-18T22:15:02.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.749+0000 7f4d2effd640 1 -- 172.21.15.123:0/2435054846 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d30004cc0 con 0x7f4d3810e180 2024-08-18T22:15:02.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.749+0000 7f4d2effd640 1 -- 172.21.15.123:0/2435054846 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30010740 con 0x7f4d3810e180 2024-08-18T22:15:02.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.752+0000 7f4d2effd640 1 -- 172.21.15.123:0/2435054846 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f4d30005020 con 0x7f4d3810e180 2024-08-18T22:15:02.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.752+0000 7f4d4228d740 1 Processor -- start 2024-08-18T22:15:02.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.752+0000 7f4d4228d740 1 -- start start 2024-08-18T22:15:02.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.752+0000 7f4d4228d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65130 0x56391eb65510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.752+0000 7f4d4228d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65a50 0x56391eb6fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.752+0000 7f4d4228d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb72700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.752+0000 7f4d4228d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56391eacaa70 con 0x56391eb70310 2024-08-18T22:15:02.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.752+0000 7f4d4228d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56391ea62780 con 0x56391eb65a50 2024-08-18T22:15:02.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.752+0000 7f4d4228d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56391eac6a30 con 0x56391eb65130 2024-08-18T22:15:02.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.753+0000 7f4d3d42a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65130 0x56391eb65510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.753+0000 7f4d3d42a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb72700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.753+0000 7f4d3d42a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb72700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42542/0 (socket says 172.21.15.123:42542) 2024-08-18T22:15:02.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.753+0000 7f4d3d42a640 1 -- 172.21.15.123:0/3955440496 learned_addr learned my addr 172.21.15.123:0/3955440496 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:02.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.753+0000 7f4d2effd640 1 --2- 172.21.15.123:0/2435054846 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4d240a2b80 0x7f4d240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.753+0000 7f4d3dc2b640 1 --2- 172.21.15.123:0/3955440496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65a50 0x56391eb6fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.753+0000 7f4d2effd640 1 -- 172.21.15.123:0/2435054846 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f4d300cf980 con 0x7f4d3810e180 2024-08-18T22:15:02.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.753+0000 7f4d3d42a640 1 -- 172.21.15.123:0/3955440496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65130 msgr2=0x56391eb65510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:02.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.753+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/3955440496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65130 0x56391eb65510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.753+0000 7f4d3d42a640 1 -- 172.21.15.123:0/3955440496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65a50 msgr2=0x56391eb6fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:02.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.753+0000 7f4d3e42c640 1 --2- 172.21.15.123:0/2435054846 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4d240a2b80 0x7f4d240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.753+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/3955440496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65a50 0x56391eb6fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.753+0000 7f4d3d42a640 1 -- 172.21.15.123:0/3955440496 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391e83cb90 con 0x56391eb70310 2024-08-18T22:15:02.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.753+0000 7f4d3dc2b640 1 --2- 172.21.15.123:0/3955440496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65a50 0x56391eb6fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:15:02.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.753+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/3955440496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb72700 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009900 tx=0x7f4d280058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04bdc0ea78bb94e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:02.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.754+0000 7f4d23fff640 1 -- 172.21.15.123:0/3955440496 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28035050 con 0x56391eb70310 2024-08-18T22:15:02.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.754+0000 7f4d23fff640 1 -- 172.21.15.123:0/3955440496 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d28005020 con 0x56391eb70310 2024-08-18T22:15:02.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.754+0000 7f4d23fff640 1 -- 172.21.15.123:0/3955440496 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28032e60 con 0x56391eb70310 2024-08-18T22:15:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.754+0000 7f4d4228d740 1 -- 172.21.15.123:0/3955440496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 msgr2=0x56391eb72700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.754+0000 7f4d4228d740 1 --2- 172.21.15.123:0/3955440496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb72700 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009900 tx=0x7f4d280058d0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.754+0000 7f4d3e42c640 1 --2- 172.21.15.123:0/2435054846 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4d240a2b80 0x7f4d240a5040 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4d30098820 tx=0x7f4d30005b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.755+0000 7f4d4228d740 1 -- 172.21.15.123:0/3955440496 shutdown_connections 2024-08-18T22:15:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.755+0000 7f4d4228d740 1 --2- 172.21.15.123:0/3955440496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb72700 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.755+0000 7f4d4228d740 1 --2- 172.21.15.123:0/3955440496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65a50 0x56391eb6fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.755+0000 7f4d4228d740 1 --2- 172.21.15.123:0/3955440496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65130 0x56391eb65510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.755+0000 7f4d4228d740 1 -- 172.21.15.123:0/3955440496 >> 172.21.15.123:0/3955440496 conn(0x56391eb616c0 msgr2=0x56391eb61aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.755+0000 7f4d4228d740 1 -- 172.21.15.123:0/3955440496 shutdown_connections 2024-08-18T22:15:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.755+0000 7f4d4228d740 1 -- 172.21.15.123:0/3955440496 wait complete. 2024-08-18T22:15:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.755+0000 7f4d4228d740 1 -- start start 2024-08-18T22:15:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.755+0000 7f4d4228d740 1 Processor -- start 2024-08-18T22:15:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.755+0000 7f4d4228d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65130 0x56391eb6d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d4228d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65a50 0x56391eb6d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d4228d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb6dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d4228d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56391eb72ee0 con 0x56391eb70310 2024-08-18T22:15:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d4228d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56391ea85990 con 0x56391eb65130 2024-08-18T22:15:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d4228d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56391eb73060 con 0x56391eb65a50 2024-08-18T22:15:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d4228d740 10 client.0 _ll_register_callbacks cb 0x56391e7da090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:15:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d3d42a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb6dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d3d42a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb6dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42544/0 (socket says 172.21.15.123:42544) 2024-08-18T22:15:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d3d42a640 1 -- 172.21.15.123:0/196931761 learned_addr learned my addr 172.21.15.123:0/196931761 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/196931761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65130 0x56391eb6d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d3d42a640 1 -- 172.21.15.123:0/196931761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65a50 msgr2=0x56391eb6d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/196931761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65a50 0x56391eb6d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d3d42a640 1 -- 172.21.15.123:0/196931761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65130 msgr2=0x56391eb6d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/196931761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65130 0x56391eb6d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d3d42a640 1 -- 172.21.15.123:0/196931761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56391ea846c0 con 0x56391eb70310 2024-08-18T22:15:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/196931761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb6dbc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f4d2802a9a0 tx=0x7f4d28041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6945fd5abee23fe3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d217fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:15:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d217fa640 1 -- 172.21.15.123:0/196931761 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28051030 con 0x56391eb70310 2024-08-18T22:15:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d217fa640 1 -- 172.21.15.123:0/196931761 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f4d28005290 con 0x56391eb70310 2024-08-18T22:15:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.756+0000 7f4d4228d740 1 -- 172.21.15.123:0/196931761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d28005020 con 0x56391eb70310 2024-08-18T22:15:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.757+0000 7f4d217fa640 1 -- 172.21.15.123:0/196931761 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4d28035070 con 0x56391eb70310 2024-08-18T22:15:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.757+0000 7f4d4228d740 10 client.16803 fetch_fsmap learned FSMap version 32 2024-08-18T22:15:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.757+0000 7f4d4228d740 1 -- 172.21.15.123:0/196931761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56391eb7eb70 con 0x56391eb70310 2024-08-18T22:15:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.757+0000 7f4d217fa640 1 -- 172.21.15.123:0/196931761 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d28005020 con 0x56391eb70310 2024-08-18T22:15:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.757+0000 7f4d217fa640 1 -- 172.21.15.123:0/196931761 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f4d28004b50 con 0x56391eb70310 2024-08-18T22:15:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.757+0000 7f4d4228d740 10 client.16803 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:15:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.757+0000 7f4d4228d740 10 client.16803 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:15:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.757+0000 7f4d4228d740 20 client.16803 populate_metadata read hostname 'smithi123' 2024-08-18T22:15:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.757+0000 7f4d4228d740 1 --2- 172.21.15.123:0/196931761 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56391eb7fec0 0x56391eb822b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.757+0000 7f4d4228d740 4 client.16803 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:15:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.757+0000 7f4d4228d740 1 -- 172.21.15.123:0/196931761 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56391ead81a0 con 0x56391eb7fec0 2024-08-18T22:15:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.757+0000 7f4d3dc2b640 1 --2- 172.21.15.123:0/196931761 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56391eb7fec0 0x56391eb822b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.758+0000 7f4d3dc2b640 1 --2- 172.21.15.123:0/196931761 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56391eb7fec0 0x56391eb822b0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb4c2e231fa554ab server_cookie=82fee8464e909da in_seq=0 out_seq=0 2024-08-18T22:15:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.758+0000 7f4d217fa640 10 client.16803 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.758+0000 7f4d217fa640 1 -- 172.21.15.123:0/196931761 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56391ead81a0 con 0x56391eb7fec0 2024-08-18T22:15:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.758+0000 7f4d217fa640 10 client.16803 handle_command_reply: tid=0 2024-08-18T22:15:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.758+0000 7f4d4228d740 1 client.16803 shutdown 2024-08-18T22:15:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.759+0000 7f4d4228d740 1 -- 172.21.15.123:0/196931761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 msgr2=0x56391eb6dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.759+0000 7f4d4228d740 1 --2- 172.21.15.123:0/196931761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb6dbc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f4d2802a9a0 tx=0x7f4d28041040 comp rx=0 tx=0).stop 2024-08-18T22:15:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.759+0000 7f4d4228d740 1 -- 172.21.15.123:0/196931761 shutdown_connections 2024-08-18T22:15:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.759+0000 7f4d4228d740 1 --2- 172.21.15.123:0/196931761 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56391eb7fec0 0x56391eb822b0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.759+0000 7f4d4228d740 1 --2- 172.21.15.123:0/196931761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb6dbc0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.759+0000 7f4d4228d740 1 --2- 172.21.15.123:0/196931761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65a50 0x56391eb6d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.759+0000 7f4d4228d740 1 --2- 172.21.15.123:0/196931761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65130 0x56391eb6d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.759+0000 7f4d217fa640 0 client.16803 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.759+0000 7f4d4228d740 1 -- 172.21.15.123:0/196931761 >> 172.21.15.123:0/196931761 conn(0x56391eb616c0 msgr2=0x56391eb673a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.759+0000 7f4d4228d740 1 -- 172.21.15.123:0/196931761 shutdown_connections 2024-08-18T22:15:02.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.759+0000 7f4d4228d740 1 -- 172.21.15.123:0/196931761 wait complete. 2024-08-18T22:15:02.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.759+0000 7f4d4228d740 20 client.16803 trim_cache size 0 max 16384 2024-08-18T22:15:02.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.776+0000 7f4d4228d740 1 Processor -- start 2024-08-18T22:15:02.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.776+0000 7f4d4228d740 1 -- start start 2024-08-18T22:15:02.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.776+0000 7f4d4228d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65130 0x56391eb852d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.776+0000 7f4d4228d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65a50 0x56391eb85810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.776+0000 7f4d4228d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb6a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.776+0000 7f4d4228d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c012510 con 0x56391eb70310 2024-08-18T22:15:02.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.776+0000 7f4d4228d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c00fd20 con 0x56391eb65130 2024-08-18T22:15:02.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.776+0000 7f4d4228d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c00db70 con 0x56391eb65a50 2024-08-18T22:15:02.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.776+0000 7f4d3d42a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb6a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.777+0000 7f4d3d42a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb6a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42548/0 (socket says 172.21.15.123:42548) 2024-08-18T22:15:02.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.777+0000 7f4d3d42a640 1 -- 172.21.15.123:0/353877519 learned_addr learned my addr 172.21.15.123:0/353877519 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:02.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.777+0000 7f4d3dc2b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65a50 0x56391eb85810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.777+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/353877519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65130 0x56391eb852d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.777+0000 7f4d3d42a640 1 -- 172.21.15.123:0/353877519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65a50 msgr2=0x56391eb85810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:02.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.777+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/353877519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65a50 0x56391eb85810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.777+0000 7f4d3d42a640 1 -- 172.21.15.123:0/353877519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65130 msgr2=0x56391eb852d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:02.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.777+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/353877519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65130 0x56391eb852d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.777+0000 7f4d3d42a640 1 -- 172.21.15.123:0/353877519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391eb65880 con 0x56391eb70310 2024-08-18T22:15:02.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.777+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/353877519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb6a3e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4d280039a0 tx=0x7f4d28009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9f6a4caf7b9640 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:02.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.777+0000 7f4d237fe640 1 -- 172.21.15.123:0/353877519 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28051040 con 0x56391eb70310 2024-08-18T22:15:02.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.777+0000 7f4d237fe640 1 -- 172.21.15.123:0/353877519 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d28052040 con 0x56391eb70310 2024-08-18T22:15:02.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.777+0000 7f4d237fe640 1 -- 172.21.15.123:0/353877519 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28003ac0 con 0x56391eb70310 2024-08-18T22:15:02.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.778+0000 7f4d4228d740 1 -- 172.21.15.123:0/353877519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 msgr2=0x56391eb6a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:02.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.778+0000 7f4d4228d740 1 --2- 172.21.15.123:0/353877519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb6a3e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4d280039a0 tx=0x7f4d28009620 comp rx=0 tx=0).stop 2024-08-18T22:15:02.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.778+0000 7f4d4228d740 1 -- 172.21.15.123:0/353877519 shutdown_connections 2024-08-18T22:15:02.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.778+0000 7f4d4228d740 1 --2- 172.21.15.123:0/353877519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb70310 0x56391eb6a3e0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.778+0000 7f4d4228d740 1 --2- 172.21.15.123:0/353877519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65a50 0x56391eb85810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.778+0000 7f4d4228d740 1 --2- 172.21.15.123:0/353877519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391eb65130 0x56391eb852d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.778+0000 7f4d4228d740 1 -- 172.21.15.123:0/353877519 >> 172.21.15.123:0/353877519 conn(0x56391eb616c0 msgr2=0x56391eb606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:02.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.778+0000 7f4d4228d740 1 -- 172.21.15.123:0/353877519 shutdown_connections 2024-08-18T22:15:02.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.778+0000 7f4d4228d740 1 -- 172.21.15.123:0/353877519 wait complete. 2024-08-18T22:15:02.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.778+0000 7f4d4228d740 1 -- start start 2024-08-18T22:15:02.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.778+0000 7f4d4228d740 1 Processor -- start 2024-08-18T22:15:02.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d4228d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65130 0x56391eb836c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d4228d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb65a50 0x56391eb83c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d4228d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391ebe77f0 0x56391ebe9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d4228d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c00e1e0 con 0x56391eb65a50 2024-08-18T22:15:02.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d4228d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c00f650 con 0x56391ebe77f0 2024-08-18T22:15:02.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d4228d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c00e8b0 con 0x56391eb65130 2024-08-18T22:15:02.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d4228d740 10 client.0 _ll_register_callbacks cb 0x7f4d340097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:15:02.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d3dc2b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb65a50 0x56391eb83c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d3d42a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65130 0x56391eb836c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d3dc2b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb65a50 0x56391eb83c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42560/0 (socket says 172.21.15.123:42560) 2024-08-18T22:15:02.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d3dc2b640 1 -- 172.21.15.123:0/2064002574 learned_addr learned my addr 172.21.15.123:0/2064002574 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:02.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/2064002574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391ebe77f0 0x56391ebe9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d3d42a640 1 -- 172.21.15.123:0/2064002574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391ebe77f0 msgr2=0x56391ebe9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:02.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/2064002574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391ebe77f0 0x56391ebe9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d3d42a640 1 -- 172.21.15.123:0/2064002574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb65a50 msgr2=0x56391eb83c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:02.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/2064002574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb65a50 0x56391eb83c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:02.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.779+0000 7f4d3d42a640 1 -- 172.21.15.123:0/2064002574 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56391ebea120 con 0x56391eb65130 2024-08-18T22:15:02.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.780+0000 7f4d3d42a640 1 --2- 172.21.15.123:0/2064002574 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65130 0x56391eb836c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x56391eb65760 tx=0x7f4d28041040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b55e777fc490708 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:02.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.780+0000 7f4d217fa640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-08-18T22:15:02.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.780+0000 7f4d217fa640 1 -- 172.21.15.123:0/2064002574 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28051040 con 0x56391eb65130 2024-08-18T22:15:02.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.780+0000 7f4d217fa640 1 -- 172.21.15.123:0/2064002574 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f4d280046c0 con 0x56391eb65130 2024-08-18T22:15:02.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.780+0000 7f4d4228d740 1 -- 172.21.15.123:0/2064002574 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d28052040 con 0x56391eb65130 2024-08-18T22:15:02.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.780+0000 7f4d217fa640 1 -- 172.21.15.123:0/2064002574 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4d28071050 con 0x56391eb65130 2024-08-18T22:15:02.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.780+0000 7f4d4228d740 10 client.26155 fetch_fsmap learned FSMap version 32 2024-08-18T22:15:02.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.780+0000 7f4d4228d740 1 -- 172.21.15.123:0/2064002574 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56391ebeb3b0 con 0x56391eb65130 2024-08-18T22:15:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.780+0000 7f4d217fa640 1 -- 172.21.15.123:0/2064002574 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d28052040 con 0x56391eb65130 2024-08-18T22:15:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.781+0000 7f4d217fa640 1 -- 172.21.15.123:0/2064002574 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f4d280042a0 con 0x56391eb65130 2024-08-18T22:15:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.781+0000 7f4d4228d740 10 client.26155 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:15:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.781+0000 7f4d4228d740 10 client.26155 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:15:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.781+0000 7f4d4228d740 20 client.26155 populate_metadata read hostname 'smithi123' 2024-08-18T22:15:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.781+0000 7f4d4228d740 1 --2- 172.21.15.123:0/2064002574 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56391ebeb800 0x56391ebedbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.781+0000 7f4d4228d740 4 client.26155 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.2, "await_for": 45.0}] 2024-08-18T22:15:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.781+0000 7f4d4228d740 1 -- 172.21.15.123:0/2064002574 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.2, "await_for": 45.0}) -- 0x56391ead24f0 con 0x56391ebeb800 2024-08-18T22:15:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.781+0000 7f4d3dc2b640 1 --2- 172.21.15.123:0/2064002574 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56391ebeb800 0x56391ebedbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.781+0000 7f4d217fa640 10 client.26155 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:02.781+0000 7f4d3dc2b640 1 --2- 172.21.15.123:0/2064002574 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56391ebeb800 0x56391ebedbf0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=618946ae70db2496 server_cookie=c253d3591166013 in_seq=0 out_seq=0 2024-08-18T22:15:03.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:03 smithi183 ceph-mon[22097]: pgmap v558: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 50 op/s 2024-08-18T22:15:03.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:03 smithi123 ceph-mon[18462]: pgmap v558: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 50 op/s 2024-08-18T22:15:03.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:03 smithi130 ceph-mon[21698]: pgmap v558: 129 pgs: 129 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 50 op/s 2024-08-18T22:15:04.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.579+0000 7f4d217fa640 1 -- 172.21.15.123:0/2064002574 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56391ead24f0 con 0x56391ebeb800 2024-08-18T22:15:04.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.579+0000 7f4d217fa640 10 client.26155 handle_command_reply: tid=0 2024-08-18T22:15:04.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.579+0000 7f4d4228d740 1 client.26155 shutdown 2024-08-18T22:15:04.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.579+0000 7f4d4228d740 1 -- 172.21.15.123:0/2064002574 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65130 msgr2=0x56391eb836c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:04.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.579+0000 7f4d4228d740 1 --2- 172.21.15.123:0/2064002574 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65130 0x56391eb836c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x56391eb65760 tx=0x7f4d28041040 comp rx=0 tx=0).stop 2024-08-18T22:15:04.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.579+0000 7f4d4228d740 1 -- 172.21.15.123:0/2064002574 shutdown_connections 2024-08-18T22:15:04.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.580+0000 7f4d4228d740 1 --2- 172.21.15.123:0/2064002574 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56391ebeb800 0x56391ebedbf0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:04.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.580+0000 7f4d217fa640 0 client.26155 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:04.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.580+0000 7f4d4228d740 1 --2- 172.21.15.123:0/2064002574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56391ebe77f0 0x56391ebe9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:04.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.580+0000 7f4d4228d740 1 --2- 172.21.15.123:0/2064002574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56391eb65a50 0x56391eb83c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:04.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.580+0000 7f4d4228d740 1 --2- 172.21.15.123:0/2064002574 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56391eb65130 0x56391eb836c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:04.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.580+0000 7f4d4228d740 1 -- 172.21.15.123:0/2064002574 >> 172.21.15.123:0/2064002574 conn(0x56391eb616c0 msgr2=0x56391eb5fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:04.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.580+0000 7f4d4228d740 1 -- 172.21.15.123:0/2064002574 shutdown_connections 2024-08-18T22:15:04.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.580+0000 7f4d4228d740 1 -- 172.21.15.123:0/2064002574 wait complete. 2024-08-18T22:15:04.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.580+0000 7f4d4228d740 20 client.26155 trim_cache size 0 max 16384 2024-08-18T22:15:04.584 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:15:04.584 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 32, 2024-08-18T22:15:04.584 INFO:teuthology.orchestra.run.smithi123.stdout: "leader": 24466, 2024-08-18T22:15:04.584 INFO:teuthology.orchestra.run.smithi123.stdout: "set_version": 22, 2024-08-18T22:15:04.584 INFO:teuthology.orchestra.run.smithi123.stdout: "sets": { 2024-08-18T22:15:04.584 INFO:teuthology.orchestra.run.smithi123.stdout: "a2771347": { 2024-08-18T22:15:04.584 INFO:teuthology.orchestra.run.smithi123.stdout: "version": 22, 2024-08-18T22:15:04.584 INFO:teuthology.orchestra.run.smithi123.stdout: "age_ref": 0.0, 2024-08-18T22:15:04.584 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:15:04.584 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "QUIESCED", 2024-08-18T22:15:04.584 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:15:04.584 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:15:04.584 INFO:teuthology.orchestra.run.smithi123.stdout: "timeout": 90.0, 2024-08-18T22:15:04.585 INFO:teuthology.orchestra.run.smithi123.stdout: "expiration": 139.2, 2024-08-18T22:15:04.585 INFO:teuthology.orchestra.run.smithi123.stdout: "members": { 2024-08-18T22:15:04.585 INFO:teuthology.orchestra.run.smithi123.stdout: "file:/": { 2024-08-18T22:15:04.585 INFO:teuthology.orchestra.run.smithi123.stdout: "excluded": false, 2024-08-18T22:15:04.585 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:15:04.585 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "QUIESCED", 2024-08-18T22:15:04.585 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:15:04.585 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:15:04.585 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:15:04.585 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:15:04.585 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:15:04.585 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:15:04.585 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:15:04.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.581+0000 7f4d3fe8f640 1 -- 172.21.15.123:0/2435054846 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4d240a2b80 msgr2=0x7f4d240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:04.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.581+0000 7f4d3fe8f640 1 --2- 172.21.15.123:0/2435054846 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4d240a2b80 0x7f4d240a5040 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4d30098820 tx=0x7f4d30005b30 comp rx=0 tx=0).stop 2024-08-18T22:15:04.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.581+0000 7f4d3fe8f640 1 -- 172.21.15.123:0/2435054846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d3810e180 msgr2=0x7f4d3819ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:04.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.581+0000 7f4d3fe8f640 1 --2- 172.21.15.123:0/2435054846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d3810e180 0x7f4d3819ed00 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000eb40 tx=0x7f4d3000c2d0 comp rx=0 tx=0).stop 2024-08-18T22:15:04.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.581+0000 7f4d3fe8f640 1 -- 172.21.15.123:0/2435054846 shutdown_connections 2024-08-18T22:15:04.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.581+0000 7f4d3fe8f640 1 --2- 172.21.15.123:0/2435054846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d3810e180 0x7f4d3819ed00 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:04.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.581+0000 7f4d3fe8f640 1 --2- 172.21.15.123:0/2435054846 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4d240a2b80 0x7f4d240a5040 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:04.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.581+0000 7f4d3fe8f640 1 --2- 172.21.15.123:0/2435054846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d38074b60 0x7f4d3819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:04.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.581+0000 7f4d3fe8f640 1 --2- 172.21.15.123:0/2435054846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d38074240 0x7f4d3819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:04.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.581+0000 7f4d3fe8f640 1 -- 172.21.15.123:0/2435054846 >> 172.21.15.123:0/2435054846 conn(0x7f4d380fd620 msgr2=0x7f4d380fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:04.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.581+0000 7f4d3fe8f640 1 -- 172.21.15.123:0/2435054846 shutdown_connections 2024-08-18T22:15:04.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:04.581+0000 7f4d3fe8f640 1 -- 172.21.15.123:0/2435054846 wait complete. 2024-08-18T22:15:05.408 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a2771347', quiesce took 5.4 seconds. Will release after: 13.799999999999999 2024-08-18T22:15:05.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:05 smithi183 ceph-mon[22097]: pgmap v559: 129 pgs: 129 active+clean; 214 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 486 KiB/s wr, 112 op/s 2024-08-18T22:15:05.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:05 smithi123 ceph-mon[18462]: pgmap v559: 129 pgs: 129 active+clean; 214 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 486 KiB/s wr, 112 op/s 2024-08-18T22:15:05.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:05 smithi130 ceph-mon[21698]: pgmap v559: 129 pgs: 129 active+clean; 214 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 486 KiB/s wr, 112 op/s 2024-08-18T22:15:07.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:07 smithi183 ceph-mon[22097]: pgmap v560: 129 pgs: 129 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 723 KiB/s wr, 149 op/s 2024-08-18T22:15:07.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:07 smithi123 ceph-mon[18462]: pgmap v560: 129 pgs: 129 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 723 KiB/s wr, 149 op/s 2024-08-18T22:15:07.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:07 smithi130 ceph-mon[21698]: pgmap v560: 129 pgs: 129 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 723 KiB/s wr, 149 op/s 2024-08-18T22:15:09.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:09 smithi183 ceph-mon[22097]: pgmap v561: 129 pgs: 129 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 711 KiB/s wr, 194 op/s 2024-08-18T22:15:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.689+0000 7f143c26e640 1 -- 172.21.15.123:0/591607648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1434101870 msgr2=0x7f1434101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.689+0000 7f143c26e640 1 --2- 172.21.15.123:0/591607648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1434101870 0x7f1434101c70 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1430009900 tx=0x7f143002a410 comp rx=0 tx=0).stop 2024-08-18T22:15:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.689+0000 7f143c26e640 1 -- 172.21.15.123:0/591607648 shutdown_connections 2024-08-18T22:15:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.689+0000 7f143c26e640 1 --2- 172.21.15.123:0/591607648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1434103420 0x7f1434109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.689+0000 7f143c26e640 1 --2- 172.21.15.123:0/591607648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1434102a60 0x7f1434102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.689+0000 7f143c26e640 1 --2- 172.21.15.123:0/591607648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1434101870 0x7f1434101c70 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.689+0000 7f143c26e640 1 -- 172.21.15.123:0/591607648 >> 172.21.15.123:0/591607648 conn(0x7f14340fd010 msgr2=0x7f14340ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.689+0000 7f143c26e640 1 -- 172.21.15.123:0/591607648 shutdown_connections 2024-08-18T22:15:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.689+0000 7f143c26e640 1 -- 172.21.15.123:0/591607648 wait complete. 2024-08-18T22:15:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.689+0000 7f143c26e640 1 Processor -- start 2024-08-18T22:15:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.689+0000 7f143c26e640 1 -- start start 2024-08-18T22:15:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f143c26e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1434101870 0x7f1434197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f143c26e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1434102a60 0x7f1434198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f143c26e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1434103420 0x7f143419f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f143c26e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f143410d4d0 con 0x7f1434103420 2024-08-18T22:15:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f143c26e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f143410d350 con 0x7f1434102a60 2024-08-18T22:15:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f143c26e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f143410d650 con 0x7f1434101870 2024-08-18T22:15:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f143a80b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1434103420 0x7f143419f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f143a80b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1434103420 0x7f143419f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42570/0 (socket says 172.21.15.123:42570) 2024-08-18T22:15:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f143a80b640 1 -- 172.21.15.123:0/2558375797 learned_addr learned my addr 172.21.15.123:0/2558375797 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f1439809640 1 --2- 172.21.15.123:0/2558375797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1434102a60 0x7f1434198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f143a00a640 1 --2- 172.21.15.123:0/2558375797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1434101870 0x7f1434197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f143a80b640 1 -- 172.21.15.123:0/2558375797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1434101870 msgr2=0x7f1434197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f143a80b640 1 --2- 172.21.15.123:0/2558375797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1434101870 0x7f1434197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f143a80b640 1 -- 172.21.15.123:0/2558375797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1434102a60 msgr2=0x7f1434198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f143a80b640 1 --2- 172.21.15.123:0/2558375797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1434102a60 0x7f1434198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f143a80b640 1 -- 172.21.15.123:0/2558375797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143419f720 con 0x7f1434103420 2024-08-18T22:15:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.690+0000 7f1439809640 1 --2- 172.21.15.123:0/2558375797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1434102a60 0x7f1434198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:15:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.691+0000 7f143a80b640 1 --2- 172.21.15.123:0/2558375797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1434103420 0x7f143419f0b0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f142c00eb10 tx=0x7f142c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.691+0000 7f142b7fe640 1 -- 172.21.15.123:0/2558375797 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c004b20 con 0x7f1434103420 2024-08-18T22:15:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.691+0000 7f142b7fe640 1 -- 172.21.15.123:0/2558375797 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f142c004cc0 con 0x7f1434103420 2024-08-18T22:15:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.691+0000 7f143c26e640 1 -- 172.21.15.123:0/2558375797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143419fa10 con 0x7f1434103420 2024-08-18T22:15:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.691+0000 7f142b7fe640 1 -- 172.21.15.123:0/2558375797 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c010760 con 0x7f1434103420 2024-08-18T22:15:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.691+0000 7f143c26e640 1 -- 172.21.15.123:0/2558375797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f143419ff10 con 0x7f1434103420 2024-08-18T22:15:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.694+0000 7f143f029740 1 Processor -- start 2024-08-18T22:15:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.694+0000 7f142b7fe640 1 -- 172.21.15.123:0/2558375797 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f142c005020 con 0x7f1434103420 2024-08-18T22:15:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.695+0000 7f143f029740 1 -- start start 2024-08-18T22:15:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.695+0000 7f143f029740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12680 0x5569c9a12a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.695+0000 7f143f029740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a12fc0 0x5569c9a17a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.695+0000 7f143f029740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a18050 0x5569c9a1a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.695+0000 7f143f029740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5569c99759d0 con 0x5569c9a18050 2024-08-18T22:15:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.695+0000 7f143f029740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5569c991d820 con 0x5569c9a12fc0 2024-08-18T22:15:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.695+0000 7f143f029740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5569c9971990 con 0x5569c9a12680 2024-08-18T22:15:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.695+0000 7f1439809640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a18050 0x5569c9a1a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.695+0000 7f1439809640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a18050 0x5569c9a1a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42582/0 (socket says 172.21.15.123:42582) 2024-08-18T22:15:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.695+0000 7f1439809640 1 -- 172.21.15.123:0/1698081745 learned_addr learned my addr 172.21.15.123:0/1698081745 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.695+0000 7f1439809640 1 --2- 172.21.15.123:0/1698081745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12680 0x5569c9a12a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.695+0000 7f143a00a640 1 --2- 172.21.15.123:0/1698081745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a12fc0 0x5569c9a17a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.696+0000 7f142b7fe640 1 --2- 172.21.15.123:0/2558375797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f14200a2c30 0x7f14200a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.696+0000 7f1439809640 1 -- 172.21.15.123:0/1698081745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a12fc0 msgr2=0x5569c9a17a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.696+0000 7f1439809640 1 --2- 172.21.15.123:0/1698081745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a12fc0 0x5569c9a17a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.696+0000 7f1439809640 1 -- 172.21.15.123:0/1698081745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a18050 msgr2=0x5569c9a1a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.696+0000 7f1439809640 1 --2- 172.21.15.123:0/1698081745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a18050 0x5569c9a1a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.696+0000 7f1439809640 1 -- 172.21.15.123:0/1698081745 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569c9689210 con 0x5569c9a12680 2024-08-18T22:15:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.696+0000 7f143a80b640 1 --2- 172.21.15.123:0/2558375797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f14200a2c30 0x7f14200a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.696+0000 7f142b7fe640 1 -- 172.21.15.123:0/2558375797 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f142c0cf980 con 0x7f1434103420 2024-08-18T22:15:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.696+0000 7f1439809640 1 --2- 172.21.15.123:0/1698081745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12680 0x5569c9a12a80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1424011be0 tx=0x7f1424005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe6ef02750f9790a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.696+0000 7f143a80b640 1 --2- 172.21.15.123:0/2558375797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f14200a2c30 0x7f14200a50f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f142c0982b0 tx=0x7f142c091330 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.696+0000 7f1428bfe640 1 -- 172.21.15.123:0/1698081745 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1424011cd0 con 0x5569c9a12680 2024-08-18T22:15:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.697+0000 7f1428bfe640 1 -- 172.21.15.123:0/1698081745 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14240118a0 con 0x5569c9a12680 2024-08-18T22:15:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.697+0000 7f1428bfe640 1 -- 172.21.15.123:0/1698081745 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142401e3a0 con 0x5569c9a12680 2024-08-18T22:15:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.697+0000 7f143f029740 1 -- 172.21.15.123:0/1698081745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12680 msgr2=0x5569c9a12a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.697+0000 7f143f029740 1 --2- 172.21.15.123:0/1698081745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12680 0x5569c9a12a80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1424011be0 tx=0x7f1424005f90 comp rx=0 tx=0).stop 2024-08-18T22:15:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.697+0000 7f143f029740 1 -- 172.21.15.123:0/1698081745 shutdown_connections 2024-08-18T22:15:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.697+0000 7f143f029740 1 --2- 172.21.15.123:0/1698081745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a18050 0x5569c9a1a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.697+0000 7f143f029740 1 --2- 172.21.15.123:0/1698081745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a12fc0 0x5569c9a17a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.697+0000 7f143f029740 1 --2- 172.21.15.123:0/1698081745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12680 0x5569c9a12a80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.697+0000 7f143f029740 1 -- 172.21.15.123:0/1698081745 >> 172.21.15.123:0/1698081745 conn(0x5569c9a0dcf0 msgr2=0x5569c9a0e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.698+0000 7f143f029740 1 -- 172.21.15.123:0/1698081745 shutdown_connections 2024-08-18T22:15:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.698+0000 7f143f029740 1 -- 172.21.15.123:0/1698081745 wait complete. 2024-08-18T22:15:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.698+0000 7f143f029740 1 -- start start 2024-08-18T22:15:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.698+0000 7f143f029740 1 Processor -- start 2024-08-18T22:15:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.698+0000 7f143f029740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a12680 0x5569c9a1c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.698+0000 7f143f029740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12fc0 0x5569c9a1ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.698+0000 7f143f029740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a18050 0x5569c9a23cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.698+0000 7f143f029740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5569c9a1b020 con 0x5569c9a12680 2024-08-18T22:15:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.698+0000 7f143f029740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5569c9931520 con 0x5569c9a18050 2024-08-18T22:15:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.698+0000 7f143f029740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5569c9a1b1a0 con 0x5569c9a12fc0 2024-08-18T22:15:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.698+0000 7f143f029740 10 client.0 _ll_register_callbacks cb 0x5569c9688a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:15:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.699+0000 7f1439809640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a12680 0x5569c9a1c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.699+0000 7f1439809640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a12680 0x5569c9a1c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42586/0 (socket says 172.21.15.123:42586) 2024-08-18T22:15:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.699+0000 7f1439809640 1 -- 172.21.15.123:0/3704289615 learned_addr learned my addr 172.21.15.123:0/3704289615 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.699+0000 7f143a00a640 1 --2- 172.21.15.123:0/3704289615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12fc0 0x5569c9a1ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.699+0000 7f1439809640 1 --2- 172.21.15.123:0/3704289615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a18050 0x5569c9a23cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.699+0000 7f1439809640 1 -- 172.21.15.123:0/3704289615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12fc0 msgr2=0x5569c9a1ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.699+0000 7f1439809640 1 --2- 172.21.15.123:0/3704289615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12fc0 0x5569c9a1ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.699+0000 7f1439809640 1 -- 172.21.15.123:0/3704289615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a18050 msgr2=0x5569c9a23cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.699+0000 7f1439809640 1 --2- 172.21.15.123:0/3704289615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a18050 0x5569c9a23cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.699+0000 7f1439809640 1 -- 172.21.15.123:0/3704289615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569c9755620 con 0x5569c9a12680 2024-08-18T22:15:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.699+0000 7f1439809640 1 --2- 172.21.15.123:0/3704289615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a12680 0x5569c9a1c770 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f142400ead0 tx=0x7f142400ffb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7eb15a876153fc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.699+0000 7f141dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:15:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.699+0000 7f141dffb640 1 -- 172.21.15.123:0/3704289615 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142400e4c0 con 0x5569c9a12680 2024-08-18T22:15:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.699+0000 7f141dffb640 1 -- 172.21.15.123:0/3704289615 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f142400e660 con 0x5569c9a12680 2024-08-18T22:15:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.699+0000 7f143f029740 1 -- 172.21.15.123:0/3704289615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14240118a0 con 0x5569c9a12680 2024-08-18T22:15:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.700+0000 7f141dffb640 1 -- 172.21.15.123:0/3704289615 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1424004030 con 0x5569c9a12680 2024-08-18T22:15:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.700+0000 7f143f029740 10 client.16821 fetch_fsmap learned FSMap version 32 2024-08-18T22:15:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.700+0000 7f143f029740 1 -- 172.21.15.123:0/3704289615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5569c9a26ae0 con 0x5569c9a12680 2024-08-18T22:15:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.700+0000 7f141dffb640 1 -- 172.21.15.123:0/3704289615 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14240118a0 con 0x5569c9a12680 2024-08-18T22:15:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.700+0000 7f141dffb640 1 -- 172.21.15.123:0/3704289615 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f1424027030 con 0x5569c9a12680 2024-08-18T22:15:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.700+0000 7f143f029740 10 client.16821 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:15:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.700+0000 7f143f029740 10 client.16821 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:15:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.700+0000 7f143f029740 20 client.16821 populate_metadata read hostname 'smithi123' 2024-08-18T22:15:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.700+0000 7f143f029740 1 --2- 172.21.15.123:0/3704289615 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5569c9a28060 0x5569c9a2a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.700+0000 7f143f029740 4 client.16821 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:15:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.700+0000 7f143f029740 1 -- 172.21.15.123:0/3704289615 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569c9983100 con 0x5569c9a28060 2024-08-18T22:15:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.700+0000 7f143a00a640 1 --2- 172.21.15.123:0/3704289615 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5569c9a28060 0x5569c9a2a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.701+0000 7f141dffb640 10 client.16821 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.701+0000 7f143a00a640 1 --2- 172.21.15.123:0/3704289615 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5569c9a28060 0x5569c9a2a480 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5ddf456a634b2d6 server_cookie=db78864b9d932795 in_seq=0 out_seq=0 2024-08-18T22:15:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.701+0000 7f141dffb640 1 -- 172.21.15.123:0/3704289615 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569c9983100 con 0x5569c9a28060 2024-08-18T22:15:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.701+0000 7f141dffb640 10 client.16821 handle_command_reply: tid=0 2024-08-18T22:15:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.701+0000 7f143f029740 1 client.16821 shutdown 2024-08-18T22:15:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.702+0000 7f143f029740 1 -- 172.21.15.123:0/3704289615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a12680 msgr2=0x5569c9a1c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.702+0000 7f143f029740 1 --2- 172.21.15.123:0/3704289615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a12680 0x5569c9a1c770 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f142400ead0 tx=0x7f142400ffb0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.702+0000 7f143f029740 1 -- 172.21.15.123:0/3704289615 shutdown_connections 2024-08-18T22:15:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.702+0000 7f143f029740 1 --2- 172.21.15.123:0/3704289615 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5569c9a28060 0x5569c9a2a480 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.702+0000 7f143f029740 1 --2- 172.21.15.123:0/3704289615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a18050 0x5569c9a23cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.702+0000 7f143f029740 1 --2- 172.21.15.123:0/3704289615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12fc0 0x5569c9a1ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.702+0000 7f141dffb640 0 client.16821 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.702+0000 7f143f029740 1 --2- 172.21.15.123:0/3704289615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a12680 0x5569c9a1c770 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.702+0000 7f143f029740 1 -- 172.21.15.123:0/3704289615 >> 172.21.15.123:0/3704289615 conn(0x5569c9a0dcf0 msgr2=0x5569c9a0f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.702+0000 7f143f029740 1 -- 172.21.15.123:0/3704289615 shutdown_connections 2024-08-18T22:15:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.702+0000 7f143f029740 1 -- 172.21.15.123:0/3704289615 wait complete. 2024-08-18T22:15:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.702+0000 7f143f029740 20 client.16821 trim_cache size 0 max 16384 2024-08-18T22:15:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f143f029740 1 Processor -- start 2024-08-18T22:15:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f143f029740 1 -- start start 2024-08-18T22:15:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f143f029740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a12680 0x5569c9a1ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f143f029740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a12fc0 0x5569c9a23cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f143f029740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a18050 0x5569c9a0c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f143f029740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f14341acdd0 con 0x5569c9a12680 2024-08-18T22:15:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f143f029740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f14341aa5e0 con 0x5569c9a12fc0 2024-08-18T22:15:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f143f029740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f14341a8430 con 0x5569c9a18050 2024-08-18T22:15:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f1439809640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a12680 0x5569c9a1ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f1439809640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a12680 0x5569c9a1ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42600/0 (socket says 172.21.15.123:42600) 2024-08-18T22:15:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f1439809640 1 -- 172.21.15.123:0/3634838228 learned_addr learned my addr 172.21.15.123:0/3634838228 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f1439809640 1 -- 172.21.15.123:0/3634838228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a18050 msgr2=0x5569c9a0c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f1439809640 1 --2- 172.21.15.123:0/3634838228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a18050 0x5569c9a0c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f1439809640 1 -- 172.21.15.123:0/3634838228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a12fc0 msgr2=0x5569c9a23cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f1439809640 1 --2- 172.21.15.123:0/3634838228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a12fc0 0x5569c9a23cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.717+0000 7f1439809640 1 -- 172.21.15.123:0/3634838228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569c9a1af00 con 0x5569c9a12680 2024-08-18T22:15:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.718+0000 7f1439809640 1 --2- 172.21.15.123:0/3634838228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a12680 0x5569c9a1ca60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1424004b80 tx=0x7f142400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482d44be8744ab33 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.718+0000 7f141ffff640 1 -- 172.21.15.123:0/3634838228 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14240043d0 con 0x5569c9a12680 2024-08-18T22:15:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.718+0000 7f141ffff640 1 -- 172.21.15.123:0/3634838228 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14240118a0 con 0x5569c9a12680 2024-08-18T22:15:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.718+0000 7f141ffff640 1 -- 172.21.15.123:0/3634838228 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142400e620 con 0x5569c9a12680 2024-08-18T22:15:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 -- 172.21.15.123:0/3634838228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a12680 msgr2=0x5569c9a1ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 --2- 172.21.15.123:0/3634838228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a12680 0x5569c9a1ca60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1424004b80 tx=0x7f142400eb80 comp rx=0 tx=0).stop 2024-08-18T22:15:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 -- 172.21.15.123:0/3634838228 shutdown_connections 2024-08-18T22:15:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 --2- 172.21.15.123:0/3634838228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a18050 0x5569c9a0c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 --2- 172.21.15.123:0/3634838228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a12fc0 0x5569c9a23cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 --2- 172.21.15.123:0/3634838228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a12680 0x5569c9a1ca60 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 -- 172.21.15.123:0/3634838228 >> 172.21.15.123:0/3634838228 conn(0x5569c9a0dcf0 msgr2=0x5569c9a1c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 -- 172.21.15.123:0/3634838228 shutdown_connections 2024-08-18T22:15:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 -- 172.21.15.123:0/3634838228 wait complete. 2024-08-18T22:15:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 -- start start 2024-08-18T22:15:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 Processor -- start 2024-08-18T22:15:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a12680 0x5569c9a20be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12fc0 0x5569c9a21120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a18050 0x5569c9a90d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f14341a8aa0 con 0x5569c9a18050 2024-08-18T22:15:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f14341a9f10 con 0x5569c9a12680 2024-08-18T22:15:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f14341a9170 con 0x5569c9a12fc0 2024-08-18T22:15:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f143f029740 10 client.0 _ll_register_callbacks cb 0x7f1424009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:15:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f1439809640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a18050 0x5569c9a90d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f1439809640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a18050 0x5569c9a90d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42612/0 (socket says 172.21.15.123:42612) 2024-08-18T22:15:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.719+0000 7f1439809640 1 -- 172.21.15.123:0/703300435 learned_addr learned my addr 172.21.15.123:0/703300435 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.720+0000 7f143a00a640 1 --2- 172.21.15.123:0/703300435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12fc0 0x5569c9a21120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.720+0000 7f1439809640 1 --2- 172.21.15.123:0/703300435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a12680 0x5569c9a20be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.720+0000 7f1439809640 1 -- 172.21.15.123:0/703300435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12fc0 msgr2=0x5569c9a21120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.720+0000 7f1439809640 1 --2- 172.21.15.123:0/703300435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12fc0 0x5569c9a21120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.720+0000 7f1439809640 1 -- 172.21.15.123:0/703300435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a12680 msgr2=0x5569c9a20be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.720+0000 7f1439809640 1 --2- 172.21.15.123:0/703300435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a12680 0x5569c9a20be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.720+0000 7f1439809640 1 -- 172.21.15.123:0/703300435 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569c9a91250 con 0x5569c9a18050 2024-08-18T22:15:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.720+0000 7f1439809640 1 --2- 172.21.15.123:0/703300435 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a18050 0x5569c9a90d10 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x5569c9a201b0 tx=0x7f1424005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90870c4b6256901e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.720+0000 7f141dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:15:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.720+0000 7f141dffb640 1 -- 172.21.15.123:0/703300435 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142400e480 con 0x5569c9a18050 2024-08-18T22:15:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.720+0000 7f141dffb640 1 -- 172.21.15.123:0/703300435 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f142400e620 con 0x5569c9a18050 2024-08-18T22:15:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.720+0000 7f143f029740 1 -- 172.21.15.123:0/703300435 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14240118a0 con 0x5569c9a18050 2024-08-18T22:15:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.720+0000 7f141dffb640 1 -- 172.21.15.123:0/703300435 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f14240041d0 con 0x5569c9a18050 2024-08-18T22:15:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.720+0000 7f143f029740 10 client.16827 fetch_fsmap learned FSMap version 32 2024-08-18T22:15:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.720+0000 7f143f029740 1 -- 172.21.15.123:0/703300435 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5569c9a92500 con 0x5569c9a18050 2024-08-18T22:15:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.721+0000 7f141dffb640 1 -- 172.21.15.123:0/703300435 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14240118a0 con 0x5569c9a18050 2024-08-18T22:15:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.721+0000 7f141dffb640 1 -- 172.21.15.123:0/703300435 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f1424027040 con 0x5569c9a18050 2024-08-18T22:15:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.721+0000 7f143f029740 10 client.16827 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:15:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.721+0000 7f143f029740 10 client.16827 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:15:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.721+0000 7f143f029740 20 client.16827 populate_metadata read hostname 'smithi123' 2024-08-18T22:15:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.721+0000 7f143f029740 1 --2- 172.21.15.123:0/703300435 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5569c9a92e50 0x5569c9a95270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.721+0000 7f143f029740 4 client.16827 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:15:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.721+0000 7f143f029740 1 -- 172.21.15.123:0/703300435 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5569c997d450 con 0x5569c9a92e50 2024-08-18T22:15:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.721+0000 7f143a00a640 1 --2- 172.21.15.123:0/703300435 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5569c9a92e50 0x5569c9a95270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.721+0000 7f143a00a640 1 --2- 172.21.15.123:0/703300435 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5569c9a92e50 0x5569c9a95270 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2504c1bea28525d6 server_cookie=8d249a10876d5697 in_seq=0 out_seq=0 2024-08-18T22:15:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.721+0000 7f141dffb640 10 client.16827 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:09.728 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:09 smithi123 ceph-mon[18462]: pgmap v561: 129 pgs: 129 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 711 KiB/s wr, 194 op/s 2024-08-18T22:15:09.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:09 smithi130 ceph-mon[21698]: pgmap v561: 129 pgs: 129 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 711 KiB/s wr, 194 op/s 2024-08-18T22:15:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.781+0000 7f141dffb640 1 -- 172.21.15.123:0/703300435 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5569c997d450 con 0x5569c9a92e50 2024-08-18T22:15:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.781+0000 7f141dffb640 10 client.16827 handle_command_reply: tid=0 2024-08-18T22:15:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.781+0000 7f143f029740 1 client.16827 shutdown 2024-08-18T22:15:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.781+0000 7f143f029740 1 -- 172.21.15.123:0/703300435 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a18050 msgr2=0x5569c9a90d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.781+0000 7f143f029740 1 --2- 172.21.15.123:0/703300435 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a18050 0x5569c9a90d10 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x5569c9a201b0 tx=0x7f1424005970 comp rx=0 tx=0).stop 2024-08-18T22:15:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.781+0000 7f143f029740 1 -- 172.21.15.123:0/703300435 shutdown_connections 2024-08-18T22:15:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.781+0000 7f143f029740 1 --2- 172.21.15.123:0/703300435 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5569c9a92e50 0x5569c9a95270 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.781+0000 7f143f029740 1 --2- 172.21.15.123:0/703300435 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569c9a18050 0x5569c9a90d10 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.781+0000 7f143f029740 1 --2- 172.21.15.123:0/703300435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569c9a12fc0 0x5569c9a21120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.781+0000 7f141dffb640 0 client.16827 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.781+0000 7f143f029740 1 --2- 172.21.15.123:0/703300435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9a12680 0x5569c9a20be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.781+0000 7f143f029740 1 -- 172.21.15.123:0/703300435 >> 172.21.15.123:0/703300435 conn(0x5569c9a0dcf0 msgr2=0x5569c9a1cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.781+0000 7f143f029740 1 -- 172.21.15.123:0/703300435 shutdown_connections 2024-08-18T22:15:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.781+0000 7f143f029740 1 -- 172.21.15.123:0/703300435 wait complete. 2024-08-18T22:15:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.781+0000 7f143f029740 20 client.16827 trim_cache size 0 max 16384 2024-08-18T22:15:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:15:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:15:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:15:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:15:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.782+0000 7f143c26e640 1 -- 172.21.15.123:0/2558375797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f14200a2c30 msgr2=0x7f14200a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.782+0000 7f143c26e640 1 --2- 172.21.15.123:0/2558375797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f14200a2c30 0x7f14200a50f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f142c0982b0 tx=0x7f142c091330 comp rx=0 tx=0).stop 2024-08-18T22:15:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.782+0000 7f143c26e640 1 -- 172.21.15.123:0/2558375797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1434103420 msgr2=0x7f143419f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.782+0000 7f143c26e640 1 --2- 172.21.15.123:0/2558375797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1434103420 0x7f143419f0b0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f142c00eb10 tx=0x7f142c00c2d0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.782+0000 7f143c26e640 1 -- 172.21.15.123:0/2558375797 shutdown_connections 2024-08-18T22:15:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.782+0000 7f143c26e640 1 --2- 172.21.15.123:0/2558375797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1434103420 0x7f143419f0b0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.782+0000 7f143c26e640 1 --2- 172.21.15.123:0/2558375797 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f14200a2c30 0x7f14200a50f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.782+0000 7f143c26e640 1 --2- 172.21.15.123:0/2558375797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1434102a60 0x7f1434198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.782+0000 7f143c26e640 1 --2- 172.21.15.123:0/2558375797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1434101870 0x7f1434197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:09.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.782+0000 7f143c26e640 1 -- 172.21.15.123:0/2558375797 >> 172.21.15.123:0/2558375797 conn(0x7f14340fd010 msgr2=0x7f1434105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:09.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.782+0000 7f143c26e640 1 -- 172.21.15.123:0/2558375797 shutdown_connections 2024-08-18T22:15:09.786 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:09.782+0000 7f143c26e640 1 -- 172.21.15.123:0/2558375797 wait complete. 2024-08-18T22:15:11.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:11 smithi183 ceph-mon[22097]: pgmap v562: 129 pgs: 129 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 745 KiB/s wr, 230 op/s 2024-08-18T22:15:11.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:11 smithi123 ceph-mon[18462]: pgmap v562: 129 pgs: 129 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 745 KiB/s wr, 230 op/s 2024-08-18T22:15:11.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:11 smithi130 ceph-mon[21698]: pgmap v562: 129 pgs: 129 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 745 KiB/s wr, 230 op/s 2024-08-18T22:15:13.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:13 smithi183 ceph-mon[22097]: pgmap v563: 129 pgs: 129 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 771 KiB/s wr, 232 op/s 2024-08-18T22:15:13.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:13 smithi123 ceph-mon[18462]: pgmap v563: 129 pgs: 129 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 771 KiB/s wr, 232 op/s 2024-08-18T22:15:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:13 smithi130 ceph-mon[21698]: pgmap v563: 129 pgs: 129 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 771 KiB/s wr, 232 op/s 2024-08-18T22:15:15.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:15 smithi183 ceph-mon[22097]: pgmap v564: 129 pgs: 129 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 775 KiB/s wr, 235 op/s 2024-08-18T22:15:15.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:15 smithi123 ceph-mon[18462]: pgmap v564: 129 pgs: 129 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 775 KiB/s wr, 235 op/s 2024-08-18T22:15:15.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:15 smithi130 ceph-mon[21698]: pgmap v564: 129 pgs: 129 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 775 KiB/s wr, 235 op/s 2024-08-18T22:15:17.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:17 smithi183 ceph-mon[22097]: pgmap v565: 129 pgs: 129 active+clean; 213 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 320 KiB/s wr, 176 op/s 2024-08-18T22:15:17.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:17 smithi123 ceph-mon[18462]: pgmap v565: 129 pgs: 129 active+clean; 213 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 320 KiB/s wr, 176 op/s 2024-08-18T22:15:17.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:17 smithi130 ceph-mon[21698]: pgmap v565: 129 pgs: 129 active+clean; 213 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 320 KiB/s wr, 176 op/s 2024-08-18T22:15:19.209 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:15:19.475 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:15:19.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:19 smithi123 ceph-mon[18462]: pgmap v566: 129 pgs: 129 active+clean; 213 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 78 KiB/s wr, 137 op/s 2024-08-18T22:15:19.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:19 smithi183 ceph-mon[22097]: pgmap v566: 129 pgs: 129 active+clean; 213 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 78 KiB/s wr, 137 op/s 2024-08-18T22:15:19.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:19 smithi130 ceph-mon[21698]: pgmap v566: 129 pgs: 129 active+clean; 213 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 78 KiB/s wr, 137 op/s 2024-08-18T22:15:19.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.949+0000 7f67e9ac9640 1 -- 172.21.15.123:0/153969308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67e4102ae0 msgr2=0x7f67e4102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:19.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.949+0000 7f67e9ac9640 1 --2- 172.21.15.123:0/153969308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67e4102ae0 0x7f67e4102ec0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009930 tx=0x7f67d402a420 comp rx=0 tx=0).stop 2024-08-18T22:15:19.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.949+0000 7f67e9ac9640 1 -- 172.21.15.123:0/153969308 shutdown_connections 2024-08-18T22:15:19.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.949+0000 7f67e9ac9640 1 --2- 172.21.15.123:0/153969308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67e4108010 0x7f67e410e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:19.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.949+0000 7f67e9ac9640 1 --2- 172.21.15.123:0/153969308 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67e4103490 0x7f67e41078d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:19.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.949+0000 7f67e9ac9640 1 --2- 172.21.15.123:0/153969308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67e4102ae0 0x7f67e4102ec0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.949+0000 7f67e9ac9640 1 -- 172.21.15.123:0/153969308 >> 172.21.15.123:0/153969308 conn(0x7f67e40fc500 msgr2=0x7f67e40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.949+0000 7f67e9ac9640 1 -- 172.21.15.123:0/153969308 shutdown_connections 2024-08-18T22:15:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.949+0000 7f67e9ac9640 1 -- 172.21.15.123:0/153969308 wait complete. 2024-08-18T22:15:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.949+0000 7f67e9ac9640 1 Processor -- start 2024-08-18T22:15:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.949+0000 7f67e9ac9640 1 -- start start 2024-08-18T22:15:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e9ac9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67e4102ae0 0x7f67e4100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e9ac9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67e4103490 0x7f67e4100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e9ac9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67e4108010 0x7f67e41011c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e9ac9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4111de0 con 0x7f67e4103490 2024-08-18T22:15:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e9ac9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4111c60 con 0x7f67e4108010 2024-08-18T22:15:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e9ac9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4111f60 con 0x7f67e4102ae0 2024-08-18T22:15:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67e4103490 0x7f67e4100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67e4103490 0x7f67e4100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60338/0 (socket says 172.21.15.123:60338) 2024-08-18T22:15:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e2ffd640 1 -- 172.21.15.123:0/2149656474 learned_addr learned my addr 172.21.15.123:0/2149656474 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e3fff640 1 --2- 172.21.15.123:0/2149656474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67e4108010 0x7f67e41011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e37fe640 1 --2- 172.21.15.123:0/2149656474 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67e4102ae0 0x7f67e4100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e2ffd640 1 -- 172.21.15.123:0/2149656474 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67e4102ae0 msgr2=0x7f67e4100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e2ffd640 1 --2- 172.21.15.123:0/2149656474 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67e4102ae0 0x7f67e4100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e2ffd640 1 -- 172.21.15.123:0/2149656474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67e4108010 msgr2=0x7f67e41011c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e2ffd640 1 --2- 172.21.15.123:0/2149656474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67e4108010 0x7f67e41011c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e2ffd640 1 -- 172.21.15.123:0/2149656474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e41a6850 con 0x7f67e4103490 2024-08-18T22:15:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.950+0000 7f67e2ffd640 1 --2- 172.21.15.123:0/2149656474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67e4103490 0x7f67e4100c80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f67d800c970 tx=0x7f67d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.951+0000 7f67e0ff9640 1 -- 172.21.15.123:0/2149656474 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d8007bb0 con 0x7f67e4103490 2024-08-18T22:15:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.951+0000 7f67e0ff9640 1 -- 172.21.15.123:0/2149656474 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67d8007d50 con 0x7f67e4103490 2024-08-18T22:15:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.951+0000 7f67e9ac9640 1 -- 172.21.15.123:0/2149656474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e41a6b40 con 0x7f67e4103490 2024-08-18T22:15:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.951+0000 7f67e0ff9640 1 -- 172.21.15.123:0/2149656474 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d800f450 con 0x7f67e4103490 2024-08-18T22:15:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.951+0000 7f67e9ac9640 1 -- 172.21.15.123:0/2149656474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e41a7080 con 0x7f67e4103490 2024-08-18T22:15:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.952+0000 7f67e9ac9640 1 -- 172.21.15.123:0/2149656474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e406a500 con 0x7f67e4103490 2024-08-18T22:15:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.954+0000 7f67e0ff9640 1 -- 172.21.15.123:0/2149656474 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f67d8004f60 con 0x7f67e4103490 2024-08-18T22:15:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.955+0000 7f67e0ff9640 1 --2- 172.21.15.123:0/2149656474 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f67cc0a2b80 0x7f67cc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.955+0000 7f67e37fe640 1 --2- 172.21.15.123:0/2149656474 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f67cc0a2b80 0x7f67cc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.955+0000 7f67e0ff9640 1 -- 172.21.15.123:0/2149656474 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f67d80cf210 con 0x7f67e4103490 2024-08-18T22:15:19.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.955+0000 7f67e37fe640 1 --2- 172.21.15.123:0/2149656474 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f67cc0a2b80 0x7f67cc0a5040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f67d4000c00 tx=0x7f67d4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:19.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:19.959+0000 7f67e0ff9640 1 -- 172.21.15.123:0/2149656474 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f67d8014030 con 0x7f67e4103490 2024-08-18T22:15:20.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:20.169+0000 7f67e9ac9640 1 -- 172.21.15.123:0/2149656474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67e4109ff0 con 0x7f67e4103490 2024-08-18T22:15:20.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:20.170+0000 7f67e0ff9640 1 -- 172.21.15.123:0/2149656474 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11928 (secure 0 0 0) 0x7f67d809bde0 con 0x7f67e4103490 2024-08-18T22:15:20.171 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:15:20.172 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":32,"btime":"2024-08-18T22:13:42:106357+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:13:41.668028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":125,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:15:20.172 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 32 2024-08-18T22:15:20.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:20.172+0000 7f67e9ac9640 1 -- 172.21.15.123:0/2149656474 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f67cc0a2b80 msgr2=0x7f67cc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:20.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:20.172+0000 7f67e9ac9640 1 --2- 172.21.15.123:0/2149656474 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f67cc0a2b80 0x7f67cc0a5040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f67d4000c00 tx=0x7f67d4005a20 comp rx=0 tx=0).stop 2024-08-18T22:15:20.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:20.172+0000 7f67e9ac9640 1 -- 172.21.15.123:0/2149656474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67e4103490 msgr2=0x7f67e4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:20.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:20.172+0000 7f67e9ac9640 1 --2- 172.21.15.123:0/2149656474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67e4103490 0x7f67e4100c80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f67d800c970 tx=0x7f67d800ce30 comp rx=0 tx=0).stop 2024-08-18T22:15:20.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:20.172+0000 7f67e9ac9640 1 -- 172.21.15.123:0/2149656474 shutdown_connections 2024-08-18T22:15:20.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:20.172+0000 7f67e9ac9640 1 --2- 172.21.15.123:0/2149656474 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f67cc0a2b80 0x7f67cc0a5040 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:20.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:20.172+0000 7f67e9ac9640 1 --2- 172.21.15.123:0/2149656474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67e4108010 0x7f67e41011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:20.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:20.172+0000 7f67e9ac9640 1 --2- 172.21.15.123:0/2149656474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67e4103490 0x7f67e4100c80 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:20.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:20.172+0000 7f67e9ac9640 1 --2- 172.21.15.123:0/2149656474 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67e4102ae0 0x7f67e4100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:20.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:20.172+0000 7f67e9ac9640 1 -- 172.21.15.123:0/2149656474 >> 172.21.15.123:0/2149656474 conn(0x7f67e40fc500 msgr2=0x7f67e4105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:20.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:20.172+0000 7f67e9ac9640 1 -- 172.21.15.123:0/2149656474 shutdown_connections 2024-08-18T22:15:20.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:20.172+0000 7f67e9ac9640 1 -- 172.21.15.123:0/2149656474 wait complete. 2024-08-18T22:15:20.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:20 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2149656474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:15:20.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:20 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2149656474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:15:20.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:20 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2149656474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:15:20.851 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db --set-id a2771347 --release --await' 2024-08-18T22:15:20.852 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24466 quiesce db --set-id a2771347 --release --await 2024-08-18T22:15:21.116 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:15:21.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.621+0000 7f429ceaf640 1 -- 172.21.15.123:0/1352244955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4298102250 msgr2=0x7f429810e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:21.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.621+0000 7f429ceaf640 1 --2- 172.21.15.123:0/1352244955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4298102250 0x7f429810e780 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4290009cd0 tx=0x7f429002a8e0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.621+0000 7f429ceaf640 1 -- 172.21.15.123:0/1352244955 shutdown_connections 2024-08-18T22:15:21.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.621+0000 7f429ceaf640 1 --2- 172.21.15.123:0/1352244955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4298102250 0x7f429810e780 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.621+0000 7f429ceaf640 1 --2- 172.21.15.123:0/1352244955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42981018b0 0x7f4298101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.621+0000 7f429ceaf640 1 --2- 172.21.15.123:0/1352244955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42981078b0 0x7f4298107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.621+0000 7f429ceaf640 1 -- 172.21.15.123:0/1352244955 >> 172.21.15.123:0/1352244955 conn(0x7f42980fd5f0 msgr2=0x7f42980ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:21.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.621+0000 7f429ceaf640 1 -- 172.21.15.123:0/1352244955 shutdown_connections 2024-08-18T22:15:21.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.621+0000 7f429ceaf640 1 -- 172.21.15.123:0/1352244955 wait complete. 2024-08-18T22:15:21.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.622+0000 7f429ceaf640 1 Processor -- start 2024-08-18T22:15:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.622+0000 7f429ceaf640 1 -- start start 2024-08-18T22:15:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.622+0000 7f429ceaf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42981018b0 0x7f429819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.622+0000 7f429ceaf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4298102250 0x7f429819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.622+0000 7f429ceaf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42981078b0 0x7f429819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.622+0000 7f429ceaf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4298111cf0 con 0x7f42981018b0 2024-08-18T22:15:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.622+0000 7f429ceaf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4298111b70 con 0x7f4298102250 2024-08-18T22:15:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.622+0000 7f429ceaf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4298111e70 con 0x7f42981078b0 2024-08-18T22:15:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.622+0000 7f429659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42981018b0 0x7f429819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.622+0000 7f429659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42981018b0 0x7f429819a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60354/0 (socket says 172.21.15.123:60354) 2024-08-18T22:15:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.622+0000 7f429659c640 1 -- 172.21.15.123:0/3002552722 learned_addr learned my addr 172.21.15.123:0/3002552722 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.622+0000 7f4296d9d640 1 --2- 172.21.15.123:0/3002552722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42981078b0 0x7f429819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.622+0000 7f4295d9b640 1 --2- 172.21.15.123:0/3002552722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4298102250 0x7f429819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.623+0000 7f429659c640 1 -- 172.21.15.123:0/3002552722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42981078b0 msgr2=0x7f429819eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.623+0000 7f429659c640 1 --2- 172.21.15.123:0/3002552722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42981078b0 0x7f429819eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.623+0000 7f429659c640 1 -- 172.21.15.123:0/3002552722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4298102250 msgr2=0x7f429819a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.623+0000 7f429659c640 1 --2- 172.21.15.123:0/3002552722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4298102250 0x7f429819a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.623+0000 7f429659c640 1 -- 172.21.15.123:0/3002552722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429819f380 con 0x7f42981018b0 2024-08-18T22:15:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.623+0000 7f429659c640 1 --2- 172.21.15.123:0/3002552722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42981018b0 0x7f429819a3d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f428800d770 tx=0x7f428800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.623+0000 7f428f7fe640 1 -- 172.21.15.123:0/3002552722 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288017070 con 0x7f42981018b0 2024-08-18T22:15:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.623+0000 7f429ceaf640 1 -- 172.21.15.123:0/3002552722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429819f670 con 0x7f42981018b0 2024-08-18T22:15:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.623+0000 7f428f7fe640 1 -- 172.21.15.123:0/3002552722 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4288005500 con 0x7f42981018b0 2024-08-18T22:15:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.623+0000 7f428f7fe640 1 -- 172.21.15.123:0/3002552722 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288004e00 con 0x7f42981018b0 2024-08-18T22:15:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.623+0000 7f429ceaf640 1 -- 172.21.15.123:0/3002552722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42981a6f50 con 0x7f42981018b0 2024-08-18T22:15:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.625+0000 7f428f7fe640 1 -- 172.21.15.123:0/3002552722 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f4288004fa0 con 0x7f42981018b0 2024-08-18T22:15:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.625+0000 7f429f2ad740 1 Processor -- start 2024-08-18T22:15:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f429f2ad740 1 -- start start 2024-08-18T22:15:21.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f429f2ad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad77c990 0x558cad77cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f429f2ad740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77d2b0 0x558cad787630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f429f2ad740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad787b70 0x558cad789f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f429f2ad740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x558cad6e2c60 con 0x558cad77d2b0 2024-08-18T22:15:21.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f429f2ad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558cad67ab90 con 0x558cad77c990 2024-08-18T22:15:21.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f429f2ad740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558cad6dec20 con 0x558cad787b70 2024-08-18T22:15:21.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f429659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77d2b0 0x558cad787630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f429659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77d2b0 0x558cad787630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60364/0 (socket says 172.21.15.123:60364) 2024-08-18T22:15:21.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f429659c640 1 -- 172.21.15.123:0/1709784229 learned_addr learned my addr 172.21.15.123:0/1709784229 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:21.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f428f7fe640 1 --2- 172.21.15.123:0/3002552722 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f42840a2b80 0x7f42840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f4296d9d640 1 --2- 172.21.15.123:0/1709784229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad77c990 0x558cad77cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f4295d9b640 1 --2- 172.21.15.123:0/1709784229 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad787b70 0x558cad789f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f4296d9d640 1 --2- 172.21.15.123:0/3002552722 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f42840a2b80 0x7f42840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f428f7fe640 1 -- 172.21.15.123:0/3002552722 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f42880cee00 con 0x7f42981018b0 2024-08-18T22:15:21.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f429659c640 1 -- 172.21.15.123:0/1709784229 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad787b70 msgr2=0x558cad789f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:21.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f429659c640 1 --2- 172.21.15.123:0/1709784229 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad787b70 0x558cad789f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f429659c640 1 -- 172.21.15.123:0/1709784229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad77c990 msgr2=0x558cad77cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:21.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f429659c640 1 --2- 172.21.15.123:0/1709784229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad77c990 0x558cad77cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.626+0000 7f429659c640 1 -- 172.21.15.123:0/1709784229 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cad3f2580 con 0x558cad77d2b0 2024-08-18T22:15:21.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.627+0000 7f429659c640 1 --2- 172.21.15.123:0/1709784229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77d2b0 0x558cad787630 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f428809b260 tx=0x7f4288009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ca7c39961b1423 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:21.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.627+0000 7f428cff9640 1 -- 172.21.15.123:0/1709784229 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288020070 con 0x558cad77d2b0 2024-08-18T22:15:21.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.627+0000 7f4296d9d640 1 --2- 172.21.15.123:0/3002552722 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f42840a2b80 0x7f42840a5040 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4290004ab0 tx=0x7f429002a8e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:21.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.627+0000 7f428cff9640 1 -- 172.21.15.123:0/1709784229 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42880046c0 con 0x558cad77d2b0 2024-08-18T22:15:21.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.627+0000 7f428cff9640 1 -- 172.21.15.123:0/1709784229 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42880995d0 con 0x558cad77d2b0 2024-08-18T22:15:21.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.627+0000 7f429f2ad740 1 -- 172.21.15.123:0/1709784229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77d2b0 msgr2=0x558cad787630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:21.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.627+0000 7f429f2ad740 1 --2- 172.21.15.123:0/1709784229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77d2b0 0x558cad787630 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f428809b260 tx=0x7f4288009c30 comp rx=0 tx=0).stop 2024-08-18T22:15:21.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 1 -- 172.21.15.123:0/1709784229 shutdown_connections 2024-08-18T22:15:21.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 1 --2- 172.21.15.123:0/1709784229 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad787b70 0x558cad789f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 1 --2- 172.21.15.123:0/1709784229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77d2b0 0x558cad787630 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 1 --2- 172.21.15.123:0/1709784229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad77c990 0x558cad77cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 1 -- 172.21.15.123:0/1709784229 >> 172.21.15.123:0/1709784229 conn(0x558cad778f20 msgr2=0x558cad779300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:21.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 1 -- 172.21.15.123:0/1709784229 shutdown_connections 2024-08-18T22:15:21.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 1 -- 172.21.15.123:0/1709784229 wait complete. 2024-08-18T22:15:21.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 1 -- start start 2024-08-18T22:15:21.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 1 Processor -- start 2024-08-18T22:15:21.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77c990 0x558cad784a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad77d2b0 0x558cad784fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad787b70 0x558cad7854f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x558cad78a6e0 con 0x558cad77c990 2024-08-18T22:15:21.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558cad6807c0 con 0x558cad787b70 2024-08-18T22:15:21.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558cad78a860 con 0x558cad77d2b0 2024-08-18T22:15:21.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429f2ad740 10 client.0 _ll_register_callbacks cb 0x558cad689f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:15:21.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77c990 0x558cad784a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77c990 0x558cad784a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60368/0 (socket says 172.21.15.123:60368) 2024-08-18T22:15:21.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.628+0000 7f429659c640 1 -- 172.21.15.123:0/3562797705 learned_addr learned my addr 172.21.15.123:0/3562797705 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:21.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f4296d9d640 1 --2- 172.21.15.123:0/3562797705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad787b70 0x558cad7854f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f4295d9b640 1 --2- 172.21.15.123:0/3562797705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad77d2b0 0x558cad784fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f429659c640 1 -- 172.21.15.123:0/3562797705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad77d2b0 msgr2=0x558cad784fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:21.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f429659c640 1 --2- 172.21.15.123:0/3562797705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad77d2b0 0x558cad784fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f429659c640 1 -- 172.21.15.123:0/3562797705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad787b70 msgr2=0x558cad7854f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:21.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f429659c640 1 --2- 172.21.15.123:0/3562797705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad787b70 0x558cad7854f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f429659c640 1 -- 172.21.15.123:0/3562797705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cad4bc960 con 0x558cad77c990 2024-08-18T22:15:21.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f429659c640 1 --2- 172.21.15.123:0/3562797705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77c990 0x558cad784a70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f42880cc5c0 tx=0x7f428809aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36bea57361c6a957 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:21.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f427dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:15:21.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f427dffb640 1 -- 172.21.15.123:0/3562797705 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288020050 con 0x558cad77c990 2024-08-18T22:15:21.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f427dffb640 1 -- 172.21.15.123:0/3562797705 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f4288009cc0 con 0x558cad77c990 2024-08-18T22:15:21.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f429f2ad740 1 -- 172.21.15.123:0/3562797705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558cad6f01d0 con 0x558cad77c990 2024-08-18T22:15:21.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f427dffb640 1 -- 172.21.15.123:0/3562797705 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f428809f680 con 0x558cad77c990 2024-08-18T22:15:21.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f429f2ad740 10 client.16845 fetch_fsmap learned FSMap version 32 2024-08-18T22:15:21.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f429f2ad740 1 -- 172.21.15.123:0/3562797705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558cad796760 con 0x558cad77c990 2024-08-18T22:15:21.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f427dffb640 1 -- 172.21.15.123:0/3562797705 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558cad6f01d0 con 0x558cad77c990 2024-08-18T22:15:21.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f427dffb640 1 -- 172.21.15.123:0/3562797705 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f428809f170 con 0x558cad77c990 2024-08-18T22:15:21.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f429f2ad740 10 client.16845 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:15:21.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f429f2ad740 10 client.16845 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:15:21.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f429f2ad740 20 client.16845 populate_metadata read hostname 'smithi123' 2024-08-18T22:15:21.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f429f2ad740 1 --2- 172.21.15.123:0/3562797705 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x558cad797ab0 0x558cad799ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f429f2ad740 4 client.16845 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:15:21.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.629+0000 7f429f2ad740 1 -- 172.21.15.123:0/3562797705 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cad6ea6e0 con 0x558cad797ab0 2024-08-18T22:15:21.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.630+0000 7f4295d9b640 1 --2- 172.21.15.123:0/3562797705 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x558cad797ab0 0x558cad799ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.630+0000 7f4295d9b640 1 --2- 172.21.15.123:0/3562797705 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x558cad797ab0 0x558cad799ea0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bba7c665190b6d0 server_cookie=a7e0770063cc2ca in_seq=0 out_seq=0 2024-08-18T22:15:21.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.630+0000 7f427dffb640 10 client.16845 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:21.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.631+0000 7f427dffb640 1 -- 172.21.15.123:0/3562797705 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558cad6ea6e0 con 0x558cad797ab0 2024-08-18T22:15:21.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.631+0000 7f427dffb640 10 client.16845 handle_command_reply: tid=0 2024-08-18T22:15:21.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.631+0000 7f429f2ad740 1 client.16845 shutdown 2024-08-18T22:15:21.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.631+0000 7f429f2ad740 1 -- 172.21.15.123:0/3562797705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77c990 msgr2=0x558cad784a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:21.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.631+0000 7f429f2ad740 1 --2- 172.21.15.123:0/3562797705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77c990 0x558cad784a70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f42880cc5c0 tx=0x7f428809aca0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.631+0000 7f429f2ad740 1 -- 172.21.15.123:0/3562797705 shutdown_connections 2024-08-18T22:15:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.631+0000 7f429f2ad740 1 --2- 172.21.15.123:0/3562797705 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x558cad797ab0 0x558cad799ea0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.631+0000 7f429f2ad740 1 --2- 172.21.15.123:0/3562797705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad787b70 0x558cad7854f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.631+0000 7f427dffb640 0 client.16845 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.631+0000 7f429f2ad740 1 --2- 172.21.15.123:0/3562797705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad77d2b0 0x558cad784fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.631+0000 7f429f2ad740 1 --2- 172.21.15.123:0/3562797705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77c990 0x558cad784a70 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.631+0000 7f429f2ad740 1 -- 172.21.15.123:0/3562797705 >> 172.21.15.123:0/3562797705 conn(0x558cad778f20 msgr2=0x558cad77ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.631+0000 7f429f2ad740 1 -- 172.21.15.123:0/3562797705 shutdown_connections 2024-08-18T22:15:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.631+0000 7f429f2ad740 1 -- 172.21.15.123:0/3562797705 wait complete. 2024-08-18T22:15:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.631+0000 7f429f2ad740 20 client.16845 trim_cache size 0 max 16384 2024-08-18T22:15:21.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.648+0000 7f429f2ad740 1 Processor -- start 2024-08-18T22:15:21.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.648+0000 7f429f2ad740 1 -- start start 2024-08-18T22:15:21.649 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:21 smithi123 ceph-mon[18462]: pgmap v567: 129 pgs: 129 active+clean; 213 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 78 KiB/s wr, 93 op/s 2024-08-18T22:15:21.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.648+0000 7f429f2ad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad77c990 0x558cad7839b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.648+0000 7f429f2ad740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77d2b0 0x558cad77f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.648+0000 7f429f2ad740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad787b70 0x558cad79cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.648+0000 7f429f2ad740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f42981b3680 con 0x558cad77d2b0 2024-08-18T22:15:21.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.648+0000 7f429f2ad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f42981b0e90 con 0x558cad77c990 2024-08-18T22:15:21.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.648+0000 7f429f2ad740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f42981aece0 con 0x558cad787b70 2024-08-18T22:15:21.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.648+0000 7f4295d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77d2b0 0x558cad77f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.648+0000 7f4295d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77d2b0 0x558cad77f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60384/0 (socket says 172.21.15.123:60384) 2024-08-18T22:15:21.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.648+0000 7f4295d9b640 1 -- 172.21.15.123:0/1101686371 learned_addr learned my addr 172.21.15.123:0/1101686371 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:21.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.648+0000 7f429659c640 1 --2- 172.21.15.123:0/1101686371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad77c990 0x558cad7839b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.648+0000 7f4296d9d640 1 --2- 172.21.15.123:0/1101686371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad787b70 0x558cad79cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.649+0000 7f4295d9b640 1 -- 172.21.15.123:0/1101686371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad787b70 msgr2=0x558cad79cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.649+0000 7f4295d9b640 1 --2- 172.21.15.123:0/1101686371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad787b70 0x558cad79cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.649+0000 7f4295d9b640 1 -- 172.21.15.123:0/1101686371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad77c990 msgr2=0x558cad7839b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.649+0000 7f4295d9b640 1 --2- 172.21.15.123:0/1101686371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad77c990 0x558cad7839b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.649+0000 7f4295d9b640 1 -- 172.21.15.123:0/1101686371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cad77c710 con 0x558cad77d2b0 2024-08-18T22:15:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.649+0000 7f4295d9b640 1 --2- 172.21.15.123:0/1101686371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77d2b0 0x558cad77f440 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4280000c00 tx=0x7f428000bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb6df67df33dc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.649+0000 7f427ffff640 1 -- 172.21.15.123:0/1101686371 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280022070 con 0x558cad77d2b0 2024-08-18T22:15:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.649+0000 7f427ffff640 1 -- 172.21.15.123:0/1101686371 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42800143b0 con 0x558cad77d2b0 2024-08-18T22:15:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.649+0000 7f427ffff640 1 -- 172.21.15.123:0/1101686371 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42800255e0 con 0x558cad77d2b0 2024-08-18T22:15:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.650+0000 7f429f2ad740 1 -- 172.21.15.123:0/1101686371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77d2b0 msgr2=0x558cad77f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.650+0000 7f429f2ad740 1 --2- 172.21.15.123:0/1101686371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77d2b0 0x558cad77f440 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4280000c00 tx=0x7f428000bef0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.650+0000 7f429f2ad740 1 -- 172.21.15.123:0/1101686371 shutdown_connections 2024-08-18T22:15:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.650+0000 7f429f2ad740 1 --2- 172.21.15.123:0/1101686371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad787b70 0x558cad79cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.650+0000 7f429f2ad740 1 --2- 172.21.15.123:0/1101686371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77d2b0 0x558cad77f440 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.650+0000 7f429f2ad740 1 --2- 172.21.15.123:0/1101686371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad77c990 0x558cad7839b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.650+0000 7f429f2ad740 1 -- 172.21.15.123:0/1101686371 >> 172.21.15.123:0/1101686371 conn(0x558cad778f20 msgr2=0x558cad786af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.650+0000 7f429f2ad740 1 -- 172.21.15.123:0/1101686371 shutdown_connections 2024-08-18T22:15:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.650+0000 7f429f2ad740 1 -- 172.21.15.123:0/1101686371 wait complete. 2024-08-18T22:15:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.650+0000 7f429f2ad740 1 -- start start 2024-08-18T22:15:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.650+0000 7f429f2ad740 1 Processor -- start 2024-08-18T22:15:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429f2ad740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77c990 0x558cad79d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429f2ad740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad77d2b0 0x558cad79a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429f2ad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad787b70 0x558cad79adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429f2ad740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f42981af350 con 0x558cad77c990 2024-08-18T22:15:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429f2ad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f42981b07c0 con 0x558cad787b70 2024-08-18T22:15:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429f2ad740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f42981afa20 con 0x558cad77d2b0 2024-08-18T22:15:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429f2ad740 10 client.0 _ll_register_callbacks cb 0x7f42880056b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:15:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77c990 0x558cad79d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77c990 0x558cad79d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60396/0 (socket says 172.21.15.123:60396) 2024-08-18T22:15:21.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429659c640 1 -- 172.21.15.123:0/1099229296 learned_addr learned my addr 172.21.15.123:0/1099229296 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:21.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f4296d9d640 1 --2- 172.21.15.123:0/1099229296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad787b70 0x558cad79adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429659c640 1 -- 172.21.15.123:0/1099229296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad77d2b0 msgr2=0x558cad79a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:21.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f4295d9b640 1 --2- 172.21.15.123:0/1099229296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad77d2b0 0x558cad79a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429659c640 1 --2- 172.21.15.123:0/1099229296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad77d2b0 0x558cad79a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429659c640 1 -- 172.21.15.123:0/1099229296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad787b70 msgr2=0x558cad79adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:21.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429659c640 1 --2- 172.21.15.123:0/1099229296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad787b70 0x558cad79adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429659c640 1 -- 172.21.15.123:0/1099229296 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cad79b5d0 con 0x558cad77c990 2024-08-18T22:15:21.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f4296d9d640 1 --2- 172.21.15.123:0/1099229296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad787b70 0x558cad79adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:15:21.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429659c640 1 --2- 172.21.15.123:0/1099229296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77c990 0x558cad79d560 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f42880d2480 tx=0x7f42880cc5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0b4a496e48cac4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:21.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f427dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:15:21.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f427dffb640 1 -- 172.21.15.123:0/1099229296 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288020070 con 0x558cad77c990 2024-08-18T22:15:21.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f427dffb640 1 -- 172.21.15.123:0/1099229296 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f428809f170 con 0x558cad77c990 2024-08-18T22:15:21.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.651+0000 7f429f2ad740 1 -- 172.21.15.123:0/1099229296 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42800143b0 con 0x558cad77c990 2024-08-18T22:15:21.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.652+0000 7f427dffb640 1 -- 172.21.15.123:0/1099229296 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4288097570 con 0x558cad77c990 2024-08-18T22:15:21.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.652+0000 7f429f2ad740 10 client.16851 fetch_fsmap learned FSMap version 32 2024-08-18T22:15:21.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.652+0000 7f429f2ad740 1 -- 172.21.15.123:0/1099229296 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558cad802380 con 0x558cad77c990 2024-08-18T22:15:21.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.652+0000 7f427dffb640 1 -- 172.21.15.123:0/1099229296 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42800143b0 con 0x558cad77c990 2024-08-18T22:15:21.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.652+0000 7f427dffb640 1 -- 172.21.15.123:0/1099229296 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f428809a720 con 0x558cad77c990 2024-08-18T22:15:21.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.652+0000 7f429f2ad740 10 client.16851 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:15:21.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.652+0000 7f429f2ad740 10 client.16851 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:15:21.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.652+0000 7f429f2ad740 20 client.16851 populate_metadata read hostname 'smithi123' 2024-08-18T22:15:21.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.652+0000 7f429f2ad740 1 --2- 172.21.15.123:0/1099229296 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x558cad802940 0x558cad804d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:21.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.652+0000 7f429f2ad740 4 client.16851 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a2771347", "release": true, "await": true}] 2024-08-18T22:15:21.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.652+0000 7f429f2ad740 1 -- 172.21.15.123:0/1099229296 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a2771347", "release": true, "await": true}) -- 0x558cad6675a0 con 0x558cad802940 2024-08-18T22:15:21.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.652+0000 7f4295d9b640 1 --2- 172.21.15.123:0/1099229296 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x558cad802940 0x558cad804d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:21.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.653+0000 7f427dffb640 10 client.16851 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:21.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.653+0000 7f4295d9b640 1 --2- 172.21.15.123:0/1099229296 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x558cad802940 0x558cad804d60 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7e53c83d63e8883 server_cookie=db2cf843de0e00f7 in_seq=0 out_seq=0 2024-08-18T22:15:21.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:21 smithi183 ceph-mon[22097]: pgmap v567: 129 pgs: 129 active+clean; 213 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 78 KiB/s wr, 93 op/s 2024-08-18T22:15:21.665 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:21 smithi130 ceph-mon[21698]: pgmap v567: 129 pgs: 129 active+clean; 213 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 78 KiB/s wr, 93 op/s 2024-08-18T22:15:21.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.866+0000 7f427dffb640 1 -- 172.21.15.123:0/1099229296 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558cad6675a0 con 0x558cad802940 2024-08-18T22:15:21.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.866+0000 7f427dffb640 10 client.16851 handle_command_reply: tid=0 2024-08-18T22:15:21.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.866+0000 7f429f2ad740 1 client.16851 shutdown 2024-08-18T22:15:21.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.866+0000 7f429f2ad740 1 -- 172.21.15.123:0/1099229296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77c990 msgr2=0x558cad79d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:21.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.866+0000 7f429f2ad740 1 --2- 172.21.15.123:0/1099229296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77c990 0x558cad79d560 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f42880d2480 tx=0x7f42880cc5f0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.866+0000 7f429f2ad740 1 -- 172.21.15.123:0/1099229296 shutdown_connections 2024-08-18T22:15:21.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.866+0000 7f429f2ad740 1 --2- 172.21.15.123:0/1099229296 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x558cad802940 0x558cad804d60 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.866+0000 7f429f2ad740 1 --2- 172.21.15.123:0/1099229296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558cad787b70 0x558cad79adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.866+0000 7f429f2ad740 1 --2- 172.21.15.123:0/1099229296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cad77d2b0 0x558cad79a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.866+0000 7f429f2ad740 1 --2- 172.21.15.123:0/1099229296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558cad77c990 0x558cad79d560 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.866+0000 7f429f2ad740 1 -- 172.21.15.123:0/1099229296 >> 172.21.15.123:0/1099229296 conn(0x558cad778f20 msgr2=0x558cad7862d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:21.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.866+0000 7f427dffb640 0 client.16851 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:21.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.866+0000 7f429f2ad740 1 -- 172.21.15.123:0/1099229296 shutdown_connections 2024-08-18T22:15:21.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.866+0000 7f429f2ad740 1 -- 172.21.15.123:0/1099229296 wait complete. 2024-08-18T22:15:21.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.866+0000 7f429f2ad740 20 client.16851 trim_cache size 0 max 16384 2024-08-18T22:15:21.869 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:15:21.869 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 32, 2024-08-18T22:15:21.869 INFO:teuthology.orchestra.run.smithi123.stdout: "leader": 24466, 2024-08-18T22:15:21.869 INFO:teuthology.orchestra.run.smithi123.stdout: "set_version": 24, 2024-08-18T22:15:21.869 INFO:teuthology.orchestra.run.smithi123.stdout: "sets": { 2024-08-18T22:15:21.869 INFO:teuthology.orchestra.run.smithi123.stdout: "a2771347": { 2024-08-18T22:15:21.869 INFO:teuthology.orchestra.run.smithi123.stdout: "version": 24, 2024-08-18T22:15:21.869 INFO:teuthology.orchestra.run.smithi123.stdout: "age_ref": 0.0, 2024-08-18T22:15:21.869 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:15:21.869 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RELEASED", 2024-08-18T22:15:21.870 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:15:21.870 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:15:21.870 INFO:teuthology.orchestra.run.smithi123.stdout: "timeout": 90.0, 2024-08-18T22:15:21.870 INFO:teuthology.orchestra.run.smithi123.stdout: "expiration": 139.2, 2024-08-18T22:15:21.870 INFO:teuthology.orchestra.run.smithi123.stdout: "members": { 2024-08-18T22:15:21.870 INFO:teuthology.orchestra.run.smithi123.stdout: "file:/": { 2024-08-18T22:15:21.870 INFO:teuthology.orchestra.run.smithi123.stdout: "excluded": false, 2024-08-18T22:15:21.870 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:15:21.870 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RELEASED", 2024-08-18T22:15:21.870 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:15:21.870 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:15:21.870 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:15:21.871 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:15:21.871 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:15:21.871 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:15:21.871 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:15:21.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.867+0000 7f429ceaf640 1 -- 172.21.15.123:0/3002552722 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f42840a2b80 msgr2=0x7f42840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:21.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.867+0000 7f429ceaf640 1 --2- 172.21.15.123:0/3002552722 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f42840a2b80 0x7f42840a5040 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4290004ab0 tx=0x7f429002a8e0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.867+0000 7f429ceaf640 1 -- 172.21.15.123:0/3002552722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42981018b0 msgr2=0x7f429819a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:21.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.867+0000 7f429ceaf640 1 --2- 172.21.15.123:0/3002552722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42981018b0 0x7f429819a3d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f428800d770 tx=0x7f428800dc30 comp rx=0 tx=0).stop 2024-08-18T22:15:21.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.867+0000 7f429ceaf640 1 -- 172.21.15.123:0/3002552722 shutdown_connections 2024-08-18T22:15:21.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.867+0000 7f429ceaf640 1 --2- 172.21.15.123:0/3002552722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42981078b0 0x7f429819eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.867+0000 7f429ceaf640 1 --2- 172.21.15.123:0/3002552722 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f42840a2b80 0x7f42840a5040 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.867+0000 7f429ceaf640 1 --2- 172.21.15.123:0/3002552722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4298102250 0x7f429819a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.867+0000 7f429ceaf640 1 --2- 172.21.15.123:0/3002552722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42981018b0 0x7f429819a3d0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:21.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.867+0000 7f429ceaf640 1 -- 172.21.15.123:0/3002552722 >> 172.21.15.123:0/3002552722 conn(0x7f42980fd5f0 msgr2=0x7f42980fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:21.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.867+0000 7f429ceaf640 1 -- 172.21.15.123:0/3002552722 shutdown_connections 2024-08-18T22:15:21.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:15:21.867+0000 7f429ceaf640 1 -- 172.21.15.123:0/3002552722 wait complete. 2024-08-18T22:15:22.510 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a2771347', total seconds elapsed: 22.5 2024-08-18T22:15:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.873+0000 7fbf1f198640 1 -- 172.21.15.123:0/3666452770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf181075b0 msgr2=0x7fbf181099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.873+0000 7fbf1f198640 1 --2- 172.21.15.123:0/3666452770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf181075b0 0x7fbf181099c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009ca0 tx=0x7fbf1002a8c0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.873+0000 7fbf1f198640 1 -- 172.21.15.123:0/3666452770 shutdown_connections 2024-08-18T22:15:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.873+0000 7fbf1f198640 1 --2- 172.21.15.123:0/3666452770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf181075b0 0x7fbf181099c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.873+0000 7fbf1f198640 1 --2- 172.21.15.123:0/3666452770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf18104c80 0x7fbf18107070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.873+0000 7fbf1f198640 1 --2- 172.21.15.123:0/3666452770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf18102350 0x7fbf18104740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.873+0000 7fbf1f198640 1 -- 172.21.15.123:0/3666452770 >> 172.21.15.123:0/3666452770 conn(0x7fbf180fbf10 msgr2=0x7fbf180fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.873+0000 7fbf1f198640 1 -- 172.21.15.123:0/3666452770 shutdown_connections 2024-08-18T22:15:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.873+0000 7fbf1f198640 1 -- 172.21.15.123:0/3666452770 wait complete. 2024-08-18T22:15:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.874+0000 7fbf1f198640 1 Processor -- start 2024-08-18T22:15:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.874+0000 7fbf1f198640 1 -- start start 2024-08-18T22:15:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.874+0000 7fbf1f198640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf18102350 0x7fbf18101cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.874+0000 7fbf1f198640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf18104c80 0x7fbf18100300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.874+0000 7fbf1f198640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf181075b0 0x7fbf18100840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.874+0000 7fbf1f198640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1810d530 con 0x7fbf18102350 2024-08-18T22:15:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.874+0000 7fbf1f198640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1810d3b0 con 0x7fbf18104c80 2024-08-18T22:15:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.874+0000 7fbf1f198640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1810d6b0 con 0x7fbf181075b0 2024-08-18T22:15:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.874+0000 7fbf1cf34640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf18102350 0x7fbf18101cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.874+0000 7fbf1cf34640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf18102350 0x7fbf18101cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51864/0 (socket says 172.21.15.123:51864) 2024-08-18T22:15:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.874+0000 7fbf1cf34640 1 -- 172.21.15.123:0/1668151907 learned_addr learned my addr 172.21.15.123:0/1668151907 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.874+0000 7fbf0ffff640 1 --2- 172.21.15.123:0/1668151907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf18104c80 0x7fbf18100300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.874+0000 7fbf1d735640 1 --2- 172.21.15.123:0/1668151907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf181075b0 0x7fbf18100840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.875+0000 7fbf1cf34640 1 -- 172.21.15.123:0/1668151907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf181075b0 msgr2=0x7fbf18100840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.875+0000 7fbf1cf34640 1 --2- 172.21.15.123:0/1668151907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf181075b0 0x7fbf18100840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.875+0000 7fbf1cf34640 1 -- 172.21.15.123:0/1668151907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf18104c80 msgr2=0x7fbf18100300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.875+0000 7fbf1cf34640 1 --2- 172.21.15.123:0/1668151907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf18104c80 0x7fbf18100300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.875+0000 7fbf1cf34640 1 -- 172.21.15.123:0/1668151907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf181010d0 con 0x7fbf18102350 2024-08-18T22:15:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.875+0000 7fbf1cf34640 1 --2- 172.21.15.123:0/1668151907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf18102350 0x7fbf18101cc0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400ea60 tx=0x7fbf1400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.875+0000 7fbf0dffb640 1 -- 172.21.15.123:0/1668151907 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1400cde0 con 0x7fbf18102350 2024-08-18T22:15:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.875+0000 7fbf1f198640 1 -- 172.21.15.123:0/1668151907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf181a1c70 con 0x7fbf18102350 2024-08-18T22:15:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.875+0000 7fbf0dffb640 1 -- 172.21.15.123:0/1668151907 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf140035f0 con 0x7fbf18102350 2024-08-18T22:15:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.875+0000 7fbf0dffb640 1 -- 172.21.15.123:0/1668151907 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14018690 con 0x7fbf18102350 2024-08-18T22:15:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.875+0000 7fbf1f198640 1 -- 172.21.15.123:0/1668151907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf181a21c0 con 0x7fbf18102350 2024-08-18T22:15:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.878+0000 7fbf0dffb640 1 -- 172.21.15.123:0/1668151907 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fbf14003a80 con 0x7fbf18102350 2024-08-18T22:15:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.878+0000 7fbf22026740 1 Processor -- start 2024-08-18T22:15:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.878+0000 7fbf22026740 1 -- start start 2024-08-18T22:15:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf22026740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 0x5561e4fcea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf22026740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fcefc0 0x5561e4fd3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf22026740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 0x5561e4fd6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf22026740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5561e4f319d0 con 0x5561e4fcefc0 2024-08-18T22:15:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf22026740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5561e4ed9820 con 0x5561e4fce680 2024-08-18T22:15:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf22026740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5561e4f2d990 con 0x5561e4fd4050 2024-08-18T22:15:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf1cf34640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fcefc0 0x5561e4fd3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf0ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 0x5561e4fd6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf0ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 0x5561e4fd6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:37366/0 (socket says 172.21.15.123:37366) 2024-08-18T22:15:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf1cf34640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fcefc0 0x5561e4fd3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51870/0 (socket says 172.21.15.123:51870) 2024-08-18T22:15:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf0ffff640 1 -- 172.21.15.123:0/3986751285 learned_addr learned my addr 172.21.15.123:0/3986751285 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf1d735640 1 --2- 172.21.15.123:0/3986751285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 0x5561e4fcea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf0dffb640 1 --2- 172.21.15.123:0/1668151907 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbf000a2cb0 0x7fbf000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf0ffff640 1 -- 172.21.15.123:0/3986751285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 msgr2=0x5561e4fcea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf0ffff640 1 --2- 172.21.15.123:0/3986751285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 0x5561e4fcea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf0ffff640 1 -- 172.21.15.123:0/3986751285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fcefc0 msgr2=0x5561e4fd3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf0ffff640 1 --2- 172.21.15.123:0/3986751285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fcefc0 0x5561e4fd3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf0ffff640 1 -- 172.21.15.123:0/3986751285 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561e4c45210 con 0x5561e4fd4050 2024-08-18T22:15:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf1d735640 1 --2- 172.21.15.123:0/1668151907 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbf000a2cb0 0x7fbf000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf1cf34640 1 --2- 172.21.15.123:0/3986751285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fcefc0 0x5561e4fd3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:15:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf0dffb640 1 -- 172.21.15.123:0/1668151907 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fbf140cf720 con 0x7fbf18102350 2024-08-18T22:15:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.879+0000 7fbf0ffff640 1 --2- 172.21.15.123:0/3986751285 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 0x5561e4fd6510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbf08009c60 tx=0x7fbf08011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94c0a73595431a17 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.880+0000 7fbefeffd640 1 -- 172.21.15.123:0/3986751285 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08004230 con 0x5561e4fd4050 2024-08-18T22:15:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.880+0000 7fbefeffd640 1 -- 172.21.15.123:0/3986751285 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf080043d0 con 0x5561e4fd4050 2024-08-18T22:15:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.880+0000 7fbefeffd640 1 -- 172.21.15.123:0/3986751285 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf080197c0 con 0x5561e4fd4050 2024-08-18T22:15:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.880+0000 7fbf22026740 1 -- 172.21.15.123:0/3986751285 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 msgr2=0x5561e4fd6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.880+0000 7fbf1d735640 1 --2- 172.21.15.123:0/1668151907 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbf000a2cb0 0x7fbf000a5170 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbf10006010 tx=0x7fbf100095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.880+0000 7fbf22026740 1 --2- 172.21.15.123:0/3986751285 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 0x5561e4fd6510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbf08009c60 tx=0x7fbf08011810 comp rx=0 tx=0).stop 2024-08-18T22:15:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.880+0000 7fbf22026740 1 -- 172.21.15.123:0/3986751285 shutdown_connections 2024-08-18T22:15:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.880+0000 7fbf22026740 1 --2- 172.21.15.123:0/3986751285 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 0x5561e4fd6510 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.880+0000 7fbf22026740 1 --2- 172.21.15.123:0/3986751285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fcefc0 0x5561e4fd3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.880+0000 7fbf22026740 1 --2- 172.21.15.123:0/3986751285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 0x5561e4fcea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.880+0000 7fbf22026740 1 -- 172.21.15.123:0/3986751285 >> 172.21.15.123:0/3986751285 conn(0x5561e4fc9cf0 msgr2=0x5561e4fca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.880+0000 7fbf22026740 1 -- 172.21.15.123:0/3986751285 shutdown_connections 2024-08-18T22:15:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.880+0000 7fbf22026740 1 -- 172.21.15.123:0/3986751285 wait complete. 2024-08-18T22:15:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.881+0000 7fbf22026740 1 -- start start 2024-08-18T22:15:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.881+0000 7fbf22026740 1 Processor -- start 2024-08-18T22:15:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.881+0000 7fbf22026740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 0x5561e4fd8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.881+0000 7fbf22026740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fcefc0 0x5561e4fd8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.881+0000 7fbf22026740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 0x5561e4fdfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.881+0000 7fbf22026740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5561e4fd7020 con 0x5561e4fcefc0 2024-08-18T22:15:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.881+0000 7fbf22026740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5561e4eed520 con 0x5561e4fce680 2024-08-18T22:15:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.881+0000 7fbf22026740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5561e4fd71a0 con 0x5561e4fd4050 2024-08-18T22:15:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.881+0000 7fbf22026740 10 client.0 _ll_register_callbacks cb 0x5561e4c44a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:15:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.881+0000 7fbf0ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fcefc0 0x5561e4fd8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.881+0000 7fbf1d735640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 0x5561e4fdfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.881+0000 7fbf1cf34640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 0x5561e4fd8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.881+0000 7fbf0ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fcefc0 0x5561e4fd8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51880/0 (socket says 172.21.15.123:51880) 2024-08-18T22:15:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.881+0000 7fbf0ffff640 1 -- 172.21.15.123:0/4133155443 learned_addr learned my addr 172.21.15.123:0/4133155443 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.882+0000 7fbf1cf34640 1 -- 172.21.15.123:0/4133155443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 msgr2=0x5561e4fdfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.882+0000 7fbf1cf34640 1 --2- 172.21.15.123:0/4133155443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 0x5561e4fdfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.882+0000 7fbf1cf34640 1 -- 172.21.15.123:0/4133155443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fcefc0 msgr2=0x5561e4fd8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.882+0000 7fbf1cf34640 1 --2- 172.21.15.123:0/4133155443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fcefc0 0x5561e4fd8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.882+0000 7fbf1cf34640 1 -- 172.21.15.123:0/4133155443 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561e4d11620 con 0x5561e4fce680 2024-08-18T22:15:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.882+0000 7fbf0ffff640 1 --2- 172.21.15.123:0/4133155443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fcefc0 0x5561e4fd8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:15:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.882+0000 7fbf1cf34640 1 --2- 172.21.15.123:0/4133155443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 0x5561e4fd8770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbf140ccee0 tx=0x7fbf14009490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b27fb52af2b3109 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.882+0000 7fbef7fff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:15:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.882+0000 7fbef7fff640 1 -- 172.21.15.123:0/4133155443 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1409b730 con 0x5561e4fce680 2024-08-18T22:15:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.882+0000 7fbf22026740 1 -- 172.21.15.123:0/4133155443 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf080043d0 con 0x5561e4fce680 2024-08-18T22:15:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.882+0000 7fbef7fff640 1 -- 172.21.15.123:0/4133155443 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fbf140cf430 con 0x5561e4fce680 2024-08-18T22:15:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.882+0000 7fbef7fff640 1 -- 172.21.15.123:0/4133155443 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbf140b2070 con 0x5561e4fce680 2024-08-18T22:15:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.882+0000 7fbf22026740 10 client.26129 fetch_fsmap learned FSMap version 32 2024-08-18T22:15:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.882+0000 7fbf22026740 1 -- 172.21.15.123:0/4133155443 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5561e4fe2bb0 con 0x5561e4fce680 2024-08-18T22:15:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.882+0000 7fbef7fff640 1 -- 172.21.15.123:0/4133155443 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf080043d0 con 0x5561e4fce680 2024-08-18T22:15:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.883+0000 7fbef7fff640 1 -- 172.21.15.123:0/4133155443 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fbf14098260 con 0x5561e4fce680 2024-08-18T22:15:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.883+0000 7fbf22026740 10 client.26129 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:15:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.883+0000 7fbf22026740 10 client.26129 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:15:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.883+0000 7fbf22026740 20 client.26129 populate_metadata read hostname 'smithi123' 2024-08-18T22:15:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.883+0000 7fbf22026740 1 --2- 172.21.15.123:0/4133155443 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5561e4fe4280 0x5561e4fe66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.883+0000 7fbf22026740 4 client.26129 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:15:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.883+0000 7fbf22026740 1 -- 172.21.15.123:0/4133155443 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561e4f3f100 con 0x5561e4fe4280 2024-08-18T22:15:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.883+0000 7fbf0ffff640 1 --2- 172.21.15.123:0/4133155443 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5561e4fe4280 0x5561e4fe66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.883+0000 7fbef7fff640 10 client.26129 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.883+0000 7fbf0ffff640 1 --2- 172.21.15.123:0/4133155443 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5561e4fe4280 0x5561e4fe66b0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dff882f2e8e6f20 server_cookie=11104968c4464682 in_seq=0 out_seq=0 2024-08-18T22:15:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.884+0000 7fbef7fff640 1 -- 172.21.15.123:0/4133155443 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5561e4f3f100 con 0x5561e4fe4280 2024-08-18T22:15:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.884+0000 7fbef7fff640 10 client.26129 handle_command_reply: tid=0 2024-08-18T22:15:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.884+0000 7fbf22026740 1 client.26129 shutdown 2024-08-18T22:15:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.884+0000 7fbf22026740 1 -- 172.21.15.123:0/4133155443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 msgr2=0x5561e4fd8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.884+0000 7fbf22026740 1 --2- 172.21.15.123:0/4133155443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 0x5561e4fd8770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbf140ccee0 tx=0x7fbf14009490 comp rx=0 tx=0).stop 2024-08-18T22:15:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.884+0000 7fbf22026740 1 -- 172.21.15.123:0/4133155443 shutdown_connections 2024-08-18T22:15:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.884+0000 7fbf22026740 1 --2- 172.21.15.123:0/4133155443 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5561e4fe4280 0x5561e4fe66b0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.884+0000 7fbf22026740 1 --2- 172.21.15.123:0/4133155443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 0x5561e4fdfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.884+0000 7fbf22026740 1 --2- 172.21.15.123:0/4133155443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fcefc0 0x5561e4fd8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.884+0000 7fbef7fff640 0 client.26129 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.884+0000 7fbf22026740 1 --2- 172.21.15.123:0/4133155443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 0x5561e4fd8770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.884+0000 7fbf22026740 1 -- 172.21.15.123:0/4133155443 >> 172.21.15.123:0/4133155443 conn(0x5561e4fc9cf0 msgr2=0x5561e4fcb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.884+0000 7fbf22026740 1 -- 172.21.15.123:0/4133155443 shutdown_connections 2024-08-18T22:15:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.884+0000 7fbf22026740 1 -- 172.21.15.123:0/4133155443 wait complete. 2024-08-18T22:15:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.884+0000 7fbf22026740 20 client.26129 trim_cache size 0 max 16384 2024-08-18T22:15:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.899+0000 7fbf22026740 1 Processor -- start 2024-08-18T22:15:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.899+0000 7fbf22026740 1 -- start start 2024-08-18T22:15:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.899+0000 7fbf22026740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fce680 0x5561e4fd8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.899+0000 7fbf22026740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fcefc0 0x5561e4fdfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.899+0000 7fbf22026740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 0x5561e4fc8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.899+0000 7fbf22026740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181aefe0 con 0x5561e4fce680 2024-08-18T22:15:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.899+0000 7fbf22026740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181ac7f0 con 0x5561e4fcefc0 2024-08-18T22:15:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.899+0000 7fbf22026740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181aa640 con 0x5561e4fd4050 2024-08-18T22:15:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.899+0000 7fbf1cf34640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fce680 0x5561e4fd8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.899+0000 7fbf1cf34640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fce680 0x5561e4fd8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51896/0 (socket says 172.21.15.123:51896) 2024-08-18T22:15:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.899+0000 7fbf1cf34640 1 -- 172.21.15.123:0/1982888325 learned_addr learned my addr 172.21.15.123:0/1982888325 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.899+0000 7fbf1d735640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 0x5561e4fc8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.900+0000 7fbf0ffff640 1 --2- 172.21.15.123:0/1982888325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fcefc0 0x5561e4fdfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.900+0000 7fbf1cf34640 1 -- 172.21.15.123:0/1982888325 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 msgr2=0x5561e4fc8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.900+0000 7fbf1cf34640 1 --2- 172.21.15.123:0/1982888325 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 0x5561e4fc8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.900+0000 7fbf1cf34640 1 -- 172.21.15.123:0/1982888325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fcefc0 msgr2=0x5561e4fdfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.900+0000 7fbf1cf34640 1 --2- 172.21.15.123:0/1982888325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fcefc0 0x5561e4fdfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.900+0000 7fbf1cf34640 1 -- 172.21.15.123:0/1982888325 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561e4fcfc50 con 0x5561e4fce680 2024-08-18T22:15:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.900+0000 7fbf0ffff640 1 --2- 172.21.15.123:0/1982888325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fcefc0 0x5561e4fdfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:15:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.900+0000 7fbf1cf34640 1 --2- 172.21.15.123:0/1982888325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fce680 0x5561e4fd8d40 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400d010 tx=0x7fbf1400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad563cdd3c46272 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.900+0000 7fbefe7fc640 1 -- 172.21.15.123:0/1982888325 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1407e020 con 0x5561e4fce680 2024-08-18T22:15:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.900+0000 7fbefe7fc640 1 -- 172.21.15.123:0/1982888325 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf14086070 con 0x5561e4fce680 2024-08-18T22:15:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.900+0000 7fbefe7fc640 1 -- 172.21.15.123:0/1982888325 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1409b550 con 0x5561e4fce680 2024-08-18T22:15:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 -- 172.21.15.123:0/1982888325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fce680 msgr2=0x5561e4fd8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 --2- 172.21.15.123:0/1982888325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fce680 0x5561e4fd8d40 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400d010 tx=0x7fbf1400ef90 comp rx=0 tx=0).stop 2024-08-18T22:15:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 -- 172.21.15.123:0/1982888325 shutdown_connections 2024-08-18T22:15:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 --2- 172.21.15.123:0/1982888325 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fd4050 0x5561e4fc8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 --2- 172.21.15.123:0/1982888325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fcefc0 0x5561e4fdfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 --2- 172.21.15.123:0/1982888325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fce680 0x5561e4fd8d40 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 -- 172.21.15.123:0/1982888325 >> 172.21.15.123:0/1982888325 conn(0x5561e4fc9cf0 msgr2=0x5561e4fc8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 -- 172.21.15.123:0/1982888325 shutdown_connections 2024-08-18T22:15:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 -- 172.21.15.123:0/1982888325 wait complete. 2024-08-18T22:15:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 -- start start 2024-08-18T22:15:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 Processor -- start 2024-08-18T22:15:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 0x5561e4fdd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fcefc0 0x5561e4fdd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fd4050 0x5561e4fde680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181aacb0 con 0x5561e4fd4050 2024-08-18T22:15:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.901+0000 7fbf22026740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181ac120 con 0x5561e4fce680 2024-08-18T22:15:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf22026740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181ab380 con 0x5561e4fcefc0 2024-08-18T22:15:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf22026740 10 client.0 _ll_register_callbacks cb 0x7fbf1400e9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:15:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf1d735640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fd4050 0x5561e4fde680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf1d735640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fd4050 0x5561e4fde680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51902/0 (socket says 172.21.15.123:51902) 2024-08-18T22:15:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf1d735640 1 -- 172.21.15.123:0/236051939 learned_addr learned my addr 172.21.15.123:0/236051939 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf1cf34640 1 --2- 172.21.15.123:0/236051939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 0x5561e4fdd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf0ffff640 1 --2- 172.21.15.123:0/236051939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fcefc0 0x5561e4fdd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf1cf34640 1 -- 172.21.15.123:0/236051939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fcefc0 msgr2=0x5561e4fdd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf1cf34640 1 --2- 172.21.15.123:0/236051939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fcefc0 0x5561e4fdd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf1cf34640 1 -- 172.21.15.123:0/236051939 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fd4050 msgr2=0x5561e4fde680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf1cf34640 1 --2- 172.21.15.123:0/236051939 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fd4050 0x5561e4fde680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf1cf34640 1 -- 172.21.15.123:0/236051939 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561e4fdec90 con 0x5561e4fce680 2024-08-18T22:15:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf1d735640 1 --2- 172.21.15.123:0/236051939 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fd4050 0x5561e4fde680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:15:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf0ffff640 1 --2- 172.21.15.123:0/236051939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fcefc0 0x5561e4fdd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:15:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf1cf34640 1 --2- 172.21.15.123:0/236051939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 0x5561e4fdd180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf140d51b0 tx=0x7fbf140d5550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc3a4200d8a0f944 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbef7fff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-18T22:15:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbef7fff640 1 -- 172.21.15.123:0/236051939 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1407e070 con 0x5561e4fce680 2024-08-18T22:15:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbef7fff640 1 -- 172.21.15.123:0/236051939 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fbf1409b0b0 con 0x5561e4fce680 2024-08-18T22:15:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.902+0000 7fbf22026740 1 -- 172.21.15.123:0/236051939 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf14086070 con 0x5561e4fce680 2024-08-18T22:15:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.903+0000 7fbef7fff640 1 -- 172.21.15.123:0/236051939 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbf140a9050 con 0x5561e4fce680 2024-08-18T22:15:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.903+0000 7fbf22026740 10 client.26135 fetch_fsmap learned FSMap version 32 2024-08-18T22:15:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.903+0000 7fbf22026740 1 -- 172.21.15.123:0/236051939 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5561e4fdffa0 con 0x5561e4fce680 2024-08-18T22:15:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.903+0000 7fbef7fff640 1 -- 172.21.15.123:0/236051939 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf14086070 con 0x5561e4fce680 2024-08-18T22:15:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.903+0000 7fbef7fff640 1 -- 172.21.15.123:0/236051939 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fbf14097940 con 0x5561e4fce680 2024-08-18T22:15:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.903+0000 7fbf22026740 10 client.26135 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:15:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.903+0000 7fbf22026740 10 client.26135 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:15:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.903+0000 7fbf22026740 20 client.26135 populate_metadata read hostname 'smithi123' 2024-08-18T22:15:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.903+0000 7fbf22026740 1 --2- 172.21.15.123:0/236051939 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5561e504f420 0x5561e5051840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.903+0000 7fbf22026740 4 client.26135 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:15:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.903+0000 7fbf22026740 1 -- 172.21.15.123:0/236051939 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5561e4f39450 con 0x5561e504f420 2024-08-18T22:15:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.903+0000 7fbf0ffff640 1 --2- 172.21.15.123:0/236051939 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5561e504f420 0x5561e5051840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.903+0000 7fbf0ffff640 1 --2- 172.21.15.123:0/236051939 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5561e504f420 0x5561e5051840 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87cbf41c1ee13aee server_cookie=eb0879bec6c36fc9 in_seq=0 out_seq=0 2024-08-18T22:15:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:22.903+0000 7fbef7fff640 10 client.26135 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.106+0000 7fbef7fff640 1 -- 172.21.15.123:0/236051939 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5561e4f39450 con 0x5561e504f420 2024-08-18T22:15:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.106+0000 7fbef7fff640 10 client.26135 handle_command_reply: tid=0 2024-08-18T22:15:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.106+0000 7fbf22026740 1 client.26135 shutdown 2024-08-18T22:15:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.106+0000 7fbf22026740 1 -- 172.21.15.123:0/236051939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 msgr2=0x5561e4fdd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.106+0000 7fbf22026740 1 --2- 172.21.15.123:0/236051939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 0x5561e4fdd180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf140d51b0 tx=0x7fbf140d5550 comp rx=0 tx=0).stop 2024-08-18T22:15:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.106+0000 7fbf22026740 1 -- 172.21.15.123:0/236051939 shutdown_connections 2024-08-18T22:15:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.106+0000 7fbf22026740 1 --2- 172.21.15.123:0/236051939 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5561e504f420 0x5561e5051840 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.106+0000 7fbf22026740 1 --2- 172.21.15.123:0/236051939 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561e4fd4050 0x5561e4fde680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.106+0000 7fbf22026740 1 --2- 172.21.15.123:0/236051939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5561e4fcefc0 0x5561e4fdd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.106+0000 7fbef7fff640 0 client.26135 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.106+0000 7fbf22026740 1 --2- 172.21.15.123:0/236051939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561e4fce680 0x5561e4fdd180 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.106+0000 7fbf22026740 1 -- 172.21.15.123:0/236051939 >> 172.21.15.123:0/236051939 conn(0x5561e4fc9cf0 msgr2=0x5561e4fc8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.106+0000 7fbf22026740 1 -- 172.21.15.123:0/236051939 shutdown_connections 2024-08-18T22:15:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.106+0000 7fbf22026740 1 -- 172.21.15.123:0/236051939 wait complete. 2024-08-18T22:15:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.107+0000 7fbf22026740 20 client.26135 trim_cache size 0 max 16384 2024-08-18T22:15:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:15:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:15:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:15:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:15:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.107+0000 7fbf1f198640 1 -- 172.21.15.123:0/1668151907 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbf000a2cb0 msgr2=0x7fbf000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.107+0000 7fbf1f198640 1 --2- 172.21.15.123:0/1668151907 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbf000a2cb0 0x7fbf000a5170 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbf10006010 tx=0x7fbf100095c0 comp rx=0 tx=0).stop 2024-08-18T22:15:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.107+0000 7fbf1f198640 1 -- 172.21.15.123:0/1668151907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf18102350 msgr2=0x7fbf18101cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.107+0000 7fbf1f198640 1 --2- 172.21.15.123:0/1668151907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf18102350 0x7fbf18101cc0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400ea60 tx=0x7fbf1400ef20 comp rx=0 tx=0).stop 2024-08-18T22:15:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.107+0000 7fbf1f198640 1 -- 172.21.15.123:0/1668151907 shutdown_connections 2024-08-18T22:15:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.107+0000 7fbf1f198640 1 --2- 172.21.15.123:0/1668151907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf181075b0 0x7fbf18100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.107+0000 7fbf1f198640 1 --2- 172.21.15.123:0/1668151907 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbf000a2cb0 0x7fbf000a5170 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.107+0000 7fbf1f198640 1 --2- 172.21.15.123:0/1668151907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf18104c80 0x7fbf18100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.107+0000 7fbf1f198640 1 --2- 172.21.15.123:0/1668151907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf18102350 0x7fbf18101cc0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.107+0000 7fbf1f198640 1 -- 172.21.15.123:0/1668151907 >> 172.21.15.123:0/1668151907 conn(0x7fbf180fbf10 msgr2=0x7fbf18102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.107+0000 7fbf1f198640 1 -- 172.21.15.123:0/1668151907 shutdown_connections 2024-08-18T22:15:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:23.107+0000 7fbf1f198640 1 -- 172.21.15.123:0/1668151907 wait complete. 2024-08-18T22:15:23.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:23 smithi183 ceph-mon[22097]: pgmap v568: 129 pgs: 129 active+clean; 214 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 53 op/s 2024-08-18T22:15:23.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:23 smithi123 ceph-mon[18462]: pgmap v568: 129 pgs: 129 active+clean; 214 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 53 op/s 2024-08-18T22:15:23.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:23 smithi130 ceph-mon[21698]: pgmap v568: 129 pgs: 129 active+clean; 214 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 53 op/s 2024-08-18T22:15:25.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:25 smithi183 ceph-mon[22097]: pgmap v569: 129 pgs: 129 active+clean; 214 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 65 op/s 2024-08-18T22:15:25.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:25 smithi123 ceph-mon[18462]: pgmap v569: 129 pgs: 129 active+clean; 214 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 65 op/s 2024-08-18T22:15:25.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:25 smithi130 ceph-mon[21698]: pgmap v569: 129 pgs: 129 active+clean; 214 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 65 op/s 2024-08-18T22:15:27.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:27 smithi123 ceph-mon[18462]: pgmap v570: 129 pgs: 129 active+clean; 219 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 460 KiB/s wr, 71 op/s 2024-08-18T22:15:27.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:27 smithi130 ceph-mon[21698]: pgmap v570: 129 pgs: 129 active+clean; 219 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 460 KiB/s wr, 71 op/s 2024-08-18T22:15:27.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:27 smithi183 ceph-mon[22097]: pgmap v570: 129 pgs: 129 active+clean; 219 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 460 KiB/s wr, 71 op/s 2024-08-18T22:15:29.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:29 smithi123 ceph-mon[18462]: pgmap v571: 129 pgs: 129 active+clean; 219 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 460 KiB/s wr, 119 op/s 2024-08-18T22:15:29.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:29 smithi130 ceph-mon[21698]: pgmap v571: 129 pgs: 129 active+clean; 219 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 460 KiB/s wr, 119 op/s 2024-08-18T22:15:29.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:29 smithi183 ceph-mon[22097]: pgmap v571: 129 pgs: 129 active+clean; 219 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 460 KiB/s wr, 119 op/s 2024-08-18T22:15:31.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:31 smithi123 ceph-mon[18462]: pgmap v572: 129 pgs: 129 active+clean; 222 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 770 KiB/s wr, 236 op/s 2024-08-18T22:15:31.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:31 smithi130 ceph-mon[21698]: pgmap v572: 129 pgs: 129 active+clean; 222 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 770 KiB/s wr, 236 op/s 2024-08-18T22:15:31.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:31 smithi183 ceph-mon[22097]: pgmap v572: 129 pgs: 129 active+clean; 222 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 770 KiB/s wr, 236 op/s 2024-08-18T22:15:33.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:33 smithi123 ceph-mon[18462]: pgmap v573: 129 pgs: 129 active+clean; 231 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 339 op/s 2024-08-18T22:15:33.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:33 smithi130 ceph-mon[21698]: pgmap v573: 129 pgs: 129 active+clean; 231 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 339 op/s 2024-08-18T22:15:33.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:33 smithi183 ceph-mon[22097]: pgmap v573: 129 pgs: 129 active+clean; 231 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 339 op/s 2024-08-18T22:15:35.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:35 smithi123 ceph-mon[18462]: pgmap v574: 129 pgs: 129 active+clean; 235 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 456 op/s 2024-08-18T22:15:35.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:35 smithi130 ceph-mon[21698]: pgmap v574: 129 pgs: 129 active+clean; 235 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 456 op/s 2024-08-18T22:15:35.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:35 smithi183 ceph-mon[22097]: pgmap v574: 129 pgs: 129 active+clean; 235 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 456 op/s 2024-08-18T22:15:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.200+0000 7fbce0988640 1 -- 172.21.15.123:0/1261071038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcdc0ffb40 msgr2=0x7fbcdc0fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.200+0000 7fbce0988640 1 --2- 172.21.15.123:0/1261071038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcdc0ffb40 0x7fbcdc0fff40 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fbccc009900 tx=0x7fbccc02a410 comp rx=0 tx=0).stop 2024-08-18T22:15:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.200+0000 7fbce0988640 1 -- 172.21.15.123:0/1261071038 shutdown_connections 2024-08-18T22:15:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.200+0000 7fbce0988640 1 --2- 172.21.15.123:0/1261071038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbcdc1034d0 0x7fbcdc109d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.200+0000 7fbce0988640 1 --2- 172.21.15.123:0/1261071038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcdc102b10 0x7fbcdc102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.200+0000 7fbce0988640 1 --2- 172.21.15.123:0/1261071038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcdc0ffb40 0x7fbcdc0fff40 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.200+0000 7fbce0988640 1 -- 172.21.15.123:0/1261071038 >> 172.21.15.123:0/1261071038 conn(0x7fbcdc0fb660 msgr2=0x7fbcdc0fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.200+0000 7fbce0988640 1 -- 172.21.15.123:0/1261071038 shutdown_connections 2024-08-18T22:15:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.200+0000 7fbce0988640 1 -- 172.21.15.123:0/1261071038 wait complete. 2024-08-18T22:15:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.200+0000 7fbce0988640 1 Processor -- start 2024-08-18T22:15:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbce0988640 1 -- start start 2024-08-18T22:15:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbce0988640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbcdc0ffb40 0x7fbcdc197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbce0988640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcdc102b10 0x7fbcdc198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbce0988640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcdc1034d0 0x7fbcdc19f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbce0988640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc10d510 con 0x7fbcdc1034d0 2024-08-18T22:15:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbce0988640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc10d390 con 0x7fbcdc102b10 2024-08-18T22:15:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbce0988640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc10d690 con 0x7fbcdc0ffb40 2024-08-18T22:15:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbcdad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcdc1034d0 0x7fbcdc19f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbcd3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcdc102b10 0x7fbcdc198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbcdad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcdc1034d0 0x7fbcdc19f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54478/0 (socket says 172.21.15.123:54478) 2024-08-18T22:15:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbcdad9d640 1 -- 172.21.15.123:0/3007208290 learned_addr learned my addr 172.21.15.123:0/3007208290 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbcda59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbcdc0ffb40 0x7fbcdc197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbcdad9d640 1 -- 172.21.15.123:0/3007208290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbcdc0ffb40 msgr2=0x7fbcdc197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbcdad9d640 1 --2- 172.21.15.123:0/3007208290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbcdc0ffb40 0x7fbcdc197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbcdad9d640 1 -- 172.21.15.123:0/3007208290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcdc102b10 msgr2=0x7fbcdc198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbcdad9d640 1 --2- 172.21.15.123:0/3007208290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcdc102b10 0x7fbcdc198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbcdad9d640 1 -- 172.21.15.123:0/3007208290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcdc19f720 con 0x7fbcdc1034d0 2024-08-18T22:15:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/3007208290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcdc102b10 0x7fbcdc198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:15:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbcdad9d640 1 --2- 172.21.15.123:0/3007208290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcdc1034d0 0x7fbcdc19f0b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400eb10 tx=0x7fbcd400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.201+0000 7fbcd37fe640 1 -- 172.21.15.123:0/3007208290 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4004b20 con 0x7fbcdc1034d0 2024-08-18T22:15:36.208 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.202+0000 7fbcd37fe640 1 -- 172.21.15.123:0/3007208290 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcd4004cc0 con 0x7fbcdc1034d0 2024-08-18T22:15:36.208 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.202+0000 7fbce0988640 1 -- 172.21.15.123:0/3007208290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcdc19fa10 con 0x7fbcdc1034d0 2024-08-18T22:15:36.208 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.202+0000 7fbcd37fe640 1 -- 172.21.15.123:0/3007208290 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4010760 con 0x7fbcdc1034d0 2024-08-18T22:15:36.208 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.202+0000 7fbce0988640 1 -- 172.21.15.123:0/3007208290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcdc19ff60 con 0x7fbcdc1034d0 2024-08-18T22:15:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.204+0000 7fbcd37fe640 1 -- 172.21.15.123:0/3007208290 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fbcd4005020 con 0x7fbcdc1034d0 2024-08-18T22:15:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.204+0000 7fbce3820740 1 Processor -- start 2024-08-18T22:15:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.204+0000 7fbce3820740 1 -- start start 2024-08-18T22:15:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbce3820740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077abba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbce3820740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abbfc0 0x565077ac0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbce3820740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 0x565077ac3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbce3820740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x565077a1e9d0 con 0x565077abb680 2024-08-18T22:15:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbce3820740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5650779c6820 con 0x565077abbfc0 2024-08-18T22:15:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbce3820740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x565077a1a990 con 0x565077ac1050 2024-08-18T22:15:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcd3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077abba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcda59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abbfc0 0x565077ac0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcd3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077abba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54492/0 (socket says 172.21.15.123:54492) 2024-08-18T22:15:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcda59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abbfc0 0x565077ac0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:57628/0 (socket says 172.21.15.123:57628) 2024-08-18T22:15:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcd3fff640 1 -- 172.21.15.123:0/409741549 learned_addr learned my addr 172.21.15.123:0/409741549 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/409741549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 0x565077ac3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcd37fe640 1 --2- 172.21.15.123:0/3007208290 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbcc80a2c30 0x7fbcc80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcd3fff640 1 -- 172.21.15.123:0/409741549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 msgr2=0x565077ac3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/409741549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 0x565077ac3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcd3fff640 1 -- 172.21.15.123:0/409741549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abbfc0 msgr2=0x565077ac0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/409741549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abbfc0 0x565077ac0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcd3fff640 1 -- 172.21.15.123:0/409741549 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565077732210 con 0x565077abb680 2024-08-18T22:15:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcdad9d640 1 --2- 172.21.15.123:0/3007208290 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbcc80a2c30 0x7fbcc80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcd37fe640 1 -- 172.21.15.123:0/3007208290 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fbcd40cfad0 con 0x7fbcdc1034d0 2024-08-18T22:15:36.220 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/409741549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077abba80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4011bf0 tx=0x7fbcc4009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78fb7355a4b61d34 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:36.220 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.205+0000 7fbcd0ff9640 1 -- 172.21.15.123:0/409741549 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc400fc50 con 0x565077abb680 2024-08-18T22:15:36.220 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.206+0000 7fbcd0ff9640 1 -- 172.21.15.123:0/409741549 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcc400fdf0 con 0x565077abb680 2024-08-18T22:15:36.220 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.206+0000 7fbcd0ff9640 1 -- 172.21.15.123:0/409741549 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc400e680 con 0x565077abb680 2024-08-18T22:15:36.220 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.206+0000 7fbce3820740 1 -- 172.21.15.123:0/409741549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 msgr2=0x565077abba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.206+0000 7fbce3820740 1 --2- 172.21.15.123:0/409741549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077abba80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4011bf0 tx=0x7fbcc4009b70 comp rx=0 tx=0).stop 2024-08-18T22:15:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.206+0000 7fbcdad9d640 1 --2- 172.21.15.123:0/3007208290 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbcc80a2c30 0x7fbcc80a50f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4021000 tx=0x7fbcd40c6ad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.206+0000 7fbce3820740 1 -- 172.21.15.123:0/409741549 shutdown_connections 2024-08-18T22:15:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.206+0000 7fbce3820740 1 --2- 172.21.15.123:0/409741549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 0x565077ac3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.206+0000 7fbce3820740 1 --2- 172.21.15.123:0/409741549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abbfc0 0x565077ac0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.206+0000 7fbce3820740 1 --2- 172.21.15.123:0/409741549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077abba80 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.206+0000 7fbce3820740 1 -- 172.21.15.123:0/409741549 >> 172.21.15.123:0/409741549 conn(0x565077ab6cf0 msgr2=0x565077ab70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.206+0000 7fbce3820740 1 -- 172.21.15.123:0/409741549 shutdown_connections 2024-08-18T22:15:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbce3820740 1 -- 172.21.15.123:0/409741549 wait complete. 2024-08-18T22:15:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbce3820740 1 -- start start 2024-08-18T22:15:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbce3820740 1 Processor -- start 2024-08-18T22:15:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbce3820740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077ac5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbce3820740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077abbfc0 0x565077ac5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbce3820740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077ac1050 0x565077acccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbce3820740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x565077ac3fc0 con 0x565077abb680 2024-08-18T22:15:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbce3820740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5650779da520 con 0x565077ac1050 2024-08-18T22:15:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbce3820740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x565077ac4140 con 0x565077abbfc0 2024-08-18T22:15:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbce3820740 10 client.0 _ll_register_callbacks cb 0x565077731a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:15:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbcd3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077ac5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbcd3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077ac5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54504/0 (socket says 172.21.15.123:54504) 2024-08-18T22:15:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbcd3fff640 1 -- 172.21.15.123:0/1034760015 learned_addr learned my addr 172.21.15.123:0/1034760015 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbcda59c640 1 --2- 172.21.15.123:0/1034760015 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077abbfc0 0x565077ac5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/1034760015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077ac1050 0x565077acccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbcd3fff640 1 -- 172.21.15.123:0/1034760015 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077abbfc0 msgr2=0x565077ac5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/1034760015 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077abbfc0 0x565077ac5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbcd3fff640 1 -- 172.21.15.123:0/1034760015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077ac1050 msgr2=0x565077acccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.207+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/1034760015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077ac1050 0x565077acccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbcd3fff640 1 -- 172.21.15.123:0/1034760015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650777fe620 con 0x565077abb680 2024-08-18T22:15:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/1034760015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077ac5770 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4011540 tx=0x7fbcc4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213bf5f14a30100d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbcc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:15:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbcc1ffb640 1 -- 172.21.15.123:0/1034760015 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4026050 con 0x565077abb680 2024-08-18T22:15:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbcc1ffb640 1 -- 172.21.15.123:0/1034760015 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fbcc40055f0 con 0x565077abb680 2024-08-18T22:15:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbce3820740 1 -- 172.21.15.123:0/1034760015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcc400fdf0 con 0x565077abb680 2024-08-18T22:15:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbcc1ffb640 1 -- 172.21.15.123:0/1034760015 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbcc4004020 con 0x565077abb680 2024-08-18T22:15:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbce3820740 10 client.16881 fetch_fsmap learned FSMap version 32 2024-08-18T22:15:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbce3820740 1 -- 172.21.15.123:0/1034760015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x565077acfae0 con 0x565077abb680 2024-08-18T22:15:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbcc1ffb640 1 -- 172.21.15.123:0/1034760015 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcc400fdf0 con 0x565077abb680 2024-08-18T22:15:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbcc1ffb640 1 -- 172.21.15.123:0/1034760015 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fbcc401d020 con 0x565077abb680 2024-08-18T22:15:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbce3820740 10 client.16881 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:15:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbce3820740 10 client.16881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:15:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbce3820740 20 client.16881 populate_metadata read hostname 'smithi123' 2024-08-18T22:15:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbce3820740 1 --2- 172.21.15.123:0/1034760015 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x565077ad0f90 0x565077ad33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbce3820740 4 client.16881 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:15:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.208+0000 7fbce3820740 1 -- 172.21.15.123:0/1034760015 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565077a2c100 con 0x565077ad0f90 2024-08-18T22:15:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.209+0000 7fbcda59c640 1 --2- 172.21.15.123:0/1034760015 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x565077ad0f90 0x565077ad33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.209+0000 7fbcc1ffb640 10 client.16881 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.209+0000 7fbcda59c640 1 --2- 172.21.15.123:0/1034760015 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x565077ad0f90 0x565077ad33d0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f8af557f9b8be82 server_cookie=68b285f51e28cb75 in_seq=0 out_seq=0 2024-08-18T22:15:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.210+0000 7fbcc1ffb640 1 -- 172.21.15.123:0/1034760015 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565077a2c100 con 0x565077ad0f90 2024-08-18T22:15:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.210+0000 7fbcc1ffb640 10 client.16881 handle_command_reply: tid=0 2024-08-18T22:15:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.210+0000 7fbce3820740 1 client.16881 shutdown 2024-08-18T22:15:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.210+0000 7fbce3820740 1 -- 172.21.15.123:0/1034760015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 msgr2=0x565077ac5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.210+0000 7fbce3820740 1 --2- 172.21.15.123:0/1034760015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077ac5770 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4011540 tx=0x7fbcc4005f90 comp rx=0 tx=0).stop 2024-08-18T22:15:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.210+0000 7fbce3820740 1 -- 172.21.15.123:0/1034760015 shutdown_connections 2024-08-18T22:15:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.210+0000 7fbce3820740 1 --2- 172.21.15.123:0/1034760015 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x565077ad0f90 0x565077ad33d0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.210+0000 7fbce3820740 1 --2- 172.21.15.123:0/1034760015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077ac1050 0x565077acccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.210+0000 7fbcc1ffb640 0 client.16881 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.210+0000 7fbce3820740 1 --2- 172.21.15.123:0/1034760015 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077abbfc0 0x565077ac5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.210+0000 7fbce3820740 1 --2- 172.21.15.123:0/1034760015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077ac5770 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.210+0000 7fbce3820740 1 -- 172.21.15.123:0/1034760015 >> 172.21.15.123:0/1034760015 conn(0x565077ab6cf0 msgr2=0x565077ab8500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.210+0000 7fbce3820740 1 -- 172.21.15.123:0/1034760015 shutdown_connections 2024-08-18T22:15:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.210+0000 7fbce3820740 1 -- 172.21.15.123:0/1034760015 wait complete. 2024-08-18T22:15:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.210+0000 7fbce3820740 20 client.16881 trim_cache size 0 max 16384 2024-08-18T22:15:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.224+0000 7fbce3820740 1 Processor -- start 2024-08-18T22:15:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.224+0000 7fbce3820740 1 -- start start 2024-08-18T22:15:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.224+0000 7fbce3820740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abb680 0x565077ac5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.224+0000 7fbce3820740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abbfc0 0x565077acccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.224+0000 7fbce3820740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 0x565077ac4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.224+0000 7fbce3820740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1ace20 con 0x565077abbfc0 2024-08-18T22:15:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.224+0000 7fbce3820740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1aa630 con 0x565077abb680 2024-08-18T22:15:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.224+0000 7fbce3820740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1a8480 con 0x565077ac1050 2024-08-18T22:15:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.224+0000 7fbcda59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abbfc0 0x565077acccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.225+0000 7fbcda59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abbfc0 0x565077acccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54510/0 (socket says 172.21.15.123:54510) 2024-08-18T22:15:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.225+0000 7fbcda59c640 1 -- 172.21.15.123:0/1611870751 learned_addr learned my addr 172.21.15.123:0/1611870751 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.225+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/1611870751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abb680 0x565077ac5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.225+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/1611870751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 0x565077ac4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.225+0000 7fbcda59c640 1 -- 172.21.15.123:0/1611870751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 msgr2=0x565077ac4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.225+0000 7fbcda59c640 1 --2- 172.21.15.123:0/1611870751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 0x565077ac4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.225+0000 7fbcda59c640 1 -- 172.21.15.123:0/1611870751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abb680 msgr2=0x565077ac5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.225+0000 7fbcda59c640 1 --2- 172.21.15.123:0/1611870751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abb680 0x565077ac5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.225+0000 7fbcda59c640 1 -- 172.21.15.123:0/1611870751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565077ac0420 con 0x565077abbfc0 2024-08-18T22:15:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.225+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/1611870751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 0x565077ac4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:15:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.225+0000 7fbcda59c640 1 --2- 172.21.15.123:0/1611870751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abbfc0 0x565077acccb0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0314e0 tx=0x7fbccc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8af9ddd40ba1bc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.225+0000 7fbcc3fff640 1 -- 172.21.15.123:0/1611870751 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc035040 con 0x565077abbfc0 2024-08-18T22:15:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.225+0000 7fbcc3fff640 1 -- 172.21.15.123:0/1611870751 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbccc04b070 con 0x565077abbfc0 2024-08-18T22:15:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.225+0000 7fbcc3fff640 1 -- 172.21.15.123:0/1611870751 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc004780 con 0x565077abbfc0 2024-08-18T22:15:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.226+0000 7fbce3820740 1 -- 172.21.15.123:0/1611870751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abbfc0 msgr2=0x565077acccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.226+0000 7fbce3820740 1 --2- 172.21.15.123:0/1611870751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abbfc0 0x565077acccb0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0314e0 tx=0x7fbccc005fd0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.226+0000 7fbce3820740 1 -- 172.21.15.123:0/1611870751 shutdown_connections 2024-08-18T22:15:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.226+0000 7fbce3820740 1 --2- 172.21.15.123:0/1611870751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 0x565077ac4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.226+0000 7fbce3820740 1 --2- 172.21.15.123:0/1611870751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abbfc0 0x565077acccb0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.226+0000 7fbce3820740 1 --2- 172.21.15.123:0/1611870751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abb680 0x565077ac5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.226+0000 7fbce3820740 1 -- 172.21.15.123:0/1611870751 >> 172.21.15.123:0/1611870751 conn(0x565077ab6cf0 msgr2=0x565077ac5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.226+0000 7fbce3820740 1 -- 172.21.15.123:0/1611870751 shutdown_connections 2024-08-18T22:15:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.226+0000 7fbce3820740 1 -- 172.21.15.123:0/1611870751 wait complete. 2024-08-18T22:15:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.226+0000 7fbce3820740 1 -- start start 2024-08-18T22:15:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.226+0000 7fbce3820740 1 Processor -- start 2024-08-18T22:15:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.226+0000 7fbce3820740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077aca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbce3820740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abbfc0 0x565077aca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbce3820740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 0x565077acb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbce3820740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1a8af0 con 0x565077abb680 2024-08-18T22:15:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbce3820740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1a9f60 con 0x565077abbfc0 2024-08-18T22:15:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbce3820740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1a91c0 con 0x565077ac1050 2024-08-18T22:15:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbce3820740 10 client.0 _ll_register_callbacks cb 0x7fbcd40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:15:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbcd3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077aca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbcd3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077aca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54516/0 (socket says 172.21.15.123:54516) 2024-08-18T22:15:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbcd3fff640 1 -- 172.21.15.123:0/1791960499 learned_addr learned my addr 172.21.15.123:0/1791960499 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbcda59c640 1 --2- 172.21.15.123:0/1791960499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abbfc0 0x565077aca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/1791960499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 0x565077acb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbcd3fff640 1 -- 172.21.15.123:0/1791960499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 msgr2=0x565077acb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/1791960499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 0x565077acb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbcd3fff640 1 -- 172.21.15.123:0/1791960499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abbfc0 msgr2=0x565077aca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/1791960499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abbfc0 0x565077aca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbcd3fff640 1 -- 172.21.15.123:0/1791960499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565077acbc10 con 0x565077abb680 2024-08-18T22:15:36.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbcd3fff640 1 --2- 172.21.15.123:0/1791960499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077aca0b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4005470 tx=0x7fbcc40059b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972c89befd5ef4d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:36.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbcc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:15:36.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbcc1ffb640 1 -- 172.21.15.123:0/1791960499 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4026040 con 0x565077abb680 2024-08-18T22:15:36.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbcc1ffb640 1 -- 172.21.15.123:0/1791960499 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fbcc4011030 con 0x565077abb680 2024-08-18T22:15:36.246 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbce3820740 1 -- 172.21.15.123:0/1791960499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbccc04b070 con 0x565077abb680 2024-08-18T22:15:36.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbcc1ffb640 1 -- 172.21.15.123:0/1791960499 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbcc4043050 con 0x565077abb680 2024-08-18T22:15:36.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbce3820740 10 client.16887 fetch_fsmap learned FSMap version 32 2024-08-18T22:15:36.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.227+0000 7fbce3820740 1 -- 172.21.15.123:0/1791960499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x565077accf20 con 0x565077abb680 2024-08-18T22:15:36.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.228+0000 7fbcc1ffb640 1 -- 172.21.15.123:0/1791960499 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbccc04b070 con 0x565077abb680 2024-08-18T22:15:36.247 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.228+0000 7fbcc1ffb640 1 -- 172.21.15.123:0/1791960499 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fbcc401d040 con 0x565077abb680 2024-08-18T22:15:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.228+0000 7fbce3820740 10 client.16887 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:15:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.228+0000 7fbce3820740 10 client.16887 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:15:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.228+0000 7fbce3820740 20 client.16887 populate_metadata read hostname 'smithi123' 2024-08-18T22:15:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.228+0000 7fbce3820740 1 --2- 172.21.15.123:0/1791960499 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x565077ad0f90 0x565077b3e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.228+0000 7fbce3820740 4 client.16887 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:15:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.228+0000 7fbce3820740 1 -- 172.21.15.123:0/1791960499 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x565077a26450 con 0x565077ad0f90 2024-08-18T22:15:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.228+0000 7fbcda59c640 1 --2- 172.21.15.123:0/1791960499 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x565077ad0f90 0x565077b3e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.228+0000 7fbcc1ffb640 10 client.16887 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.228+0000 7fbcda59c640 1 --2- 172.21.15.123:0/1791960499 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x565077ad0f90 0x565077b3e2d0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59ba1e482d4d3d18 server_cookie=145e79e1bbae37e0 in_seq=0 out_seq=0 2024-08-18T22:15:36.554 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.553+0000 7fbcc1ffb640 1 -- 172.21.15.123:0/1791960499 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x565077a26450 con 0x565077ad0f90 2024-08-18T22:15:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.553+0000 7fbcc1ffb640 10 client.16887 handle_command_reply: tid=0 2024-08-18T22:15:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.553+0000 7fbce3820740 1 client.16887 shutdown 2024-08-18T22:15:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.553+0000 7fbce3820740 1 -- 172.21.15.123:0/1791960499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 msgr2=0x565077aca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.553+0000 7fbce3820740 1 --2- 172.21.15.123:0/1791960499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077aca0b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4005470 tx=0x7fbcc40059b0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.553+0000 7fbce3820740 1 -- 172.21.15.123:0/1791960499 shutdown_connections 2024-08-18T22:15:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.553+0000 7fbce3820740 1 --2- 172.21.15.123:0/1791960499 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x565077ad0f90 0x565077b3e2d0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.553+0000 7fbce3820740 1 --2- 172.21.15.123:0/1791960499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565077ac1050 0x565077acb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.553+0000 7fbce3820740 1 --2- 172.21.15.123:0/1791960499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565077abbfc0 0x565077aca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.553+0000 7fbcc1ffb640 0 client.16887 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.553+0000 7fbce3820740 1 --2- 172.21.15.123:0/1791960499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565077abb680 0x565077aca0b0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.553+0000 7fbce3820740 1 -- 172.21.15.123:0/1791960499 >> 172.21.15.123:0/1791960499 conn(0x565077ab6cf0 msgr2=0x565077ab7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.553+0000 7fbce3820740 1 -- 172.21.15.123:0/1791960499 shutdown_connections 2024-08-18T22:15:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.553+0000 7fbce3820740 1 -- 172.21.15.123:0/1791960499 wait complete. 2024-08-18T22:15:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.553+0000 7fbce3820740 20 client.16887 trim_cache size 0 max 16384 2024-08-18T22:15:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:15:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:15:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:15:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:15:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.554+0000 7fbce0988640 1 -- 172.21.15.123:0/3007208290 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbcc80a2c30 msgr2=0x7fbcc80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.554+0000 7fbce0988640 1 --2- 172.21.15.123:0/3007208290 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbcc80a2c30 0x7fbcc80a50f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4021000 tx=0x7fbcd40c6ad0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.554+0000 7fbce0988640 1 -- 172.21.15.123:0/3007208290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcdc1034d0 msgr2=0x7fbcdc19f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.554+0000 7fbce0988640 1 --2- 172.21.15.123:0/3007208290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcdc1034d0 0x7fbcdc19f0b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400eb10 tx=0x7fbcd400c2d0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.554+0000 7fbce0988640 1 -- 172.21.15.123:0/3007208290 shutdown_connections 2024-08-18T22:15:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.554+0000 7fbce0988640 1 --2- 172.21.15.123:0/3007208290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcdc1034d0 0x7fbcdc19f0b0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.554+0000 7fbce0988640 1 --2- 172.21.15.123:0/3007208290 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fbcc80a2c30 0x7fbcc80a50f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.554+0000 7fbce0988640 1 --2- 172.21.15.123:0/3007208290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcdc102b10 0x7fbcdc198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.554+0000 7fbce0988640 1 --2- 172.21.15.123:0/3007208290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbcdc0ffb40 0x7fbcdc197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.555+0000 7fbce0988640 1 -- 172.21.15.123:0/3007208290 >> 172.21.15.123:0/3007208290 conn(0x7fbcdc0fb660 msgr2=0x7fbcdc105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.555+0000 7fbce0988640 1 -- 172.21.15.123:0/3007208290 shutdown_connections 2024-08-18T22:15:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:36.555+0000 7fbce0988640 1 -- 172.21.15.123:0/3007208290 wait complete. 2024-08-18T22:15:37.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:37 smithi123 ceph-mon[18462]: pgmap v575: 129 pgs: 129 active+clean; 240 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 468 op/s 2024-08-18T22:15:37.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:37 smithi130 ceph-mon[21698]: pgmap v575: 129 pgs: 129 active+clean; 240 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 468 op/s 2024-08-18T22:15:37.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:37 smithi183 ceph-mon[22097]: pgmap v575: 129 pgs: 129 active+clean; 240 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 468 op/s 2024-08-18T22:15:39.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:39 smithi123 ceph-mon[18462]: pgmap v576: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 537 op/s 2024-08-18T22:15:39.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:39 smithi130 ceph-mon[21698]: pgmap v576: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 537 op/s 2024-08-18T22:15:39.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:39 smithi183 ceph-mon[22097]: pgmap v576: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 537 op/s 2024-08-18T22:15:41.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:41 smithi123 ceph-mon[18462]: pgmap v577: 129 pgs: 129 active+clean; 246 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 600 op/s 2024-08-18T22:15:41.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:41 smithi130 ceph-mon[21698]: pgmap v577: 129 pgs: 129 active+clean; 246 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 600 op/s 2024-08-18T22:15:41.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:41 smithi183 ceph-mon[22097]: pgmap v577: 129 pgs: 129 active+clean; 246 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 600 op/s 2024-08-18T22:15:42.115 INFO:tasks.workunit.client.0.smithi123.stdout:cleaned up hierarchy 2024-08-18T22:15:42.511 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-18T22:15:42.511 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-18T22:15:42.598 INFO:tasks.workunit:Running workunit fs/misc/filelock_deadlock.py... 2024-08-18T22:15:42.599 DEBUG:teuthology.orchestra.run.smithi123:workunit test fs/misc/filelock_deadlock.py> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/filelock_deadlock.py 2024-08-18T22:15:43.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:43 smithi123 ceph-mon[18462]: pgmap v578: 129 pgs: 129 active+clean; 242 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 557 op/s 2024-08-18T22:15:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:43 smithi130 ceph-mon[21698]: pgmap v578: 129 pgs: 129 active+clean; 242 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 557 op/s 2024-08-18T22:15:43.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:43 smithi183 ceph-mon[22097]: pgmap v578: 129 pgs: 129 active+clean; 242 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 557 op/s 2024-08-18T22:15:45.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:45 smithi123 ceph-mon[18462]: pgmap v579: 129 pgs: 129 active+clean; 248 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 591 op/s 2024-08-18T22:15:45.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:45 smithi130 ceph-mon[21698]: pgmap v579: 129 pgs: 129 active+clean; 248 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 591 op/s 2024-08-18T22:15:45.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:45 smithi183 ceph-mon[22097]: pgmap v579: 129 pgs: 129 active+clean; 248 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 591 op/s 2024-08-18T22:15:47.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:47 smithi123 ceph-mon[18462]: pgmap v580: 129 pgs: 129 active+clean; 249 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 515 op/s 2024-08-18T22:15:47.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:47 smithi130 ceph-mon[21698]: pgmap v580: 129 pgs: 129 active+clean; 249 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 515 op/s 2024-08-18T22:15:47.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:47 smithi183 ceph-mon[22097]: pgmap v580: 129 pgs: 129 active+clean; 249 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 515 op/s 2024-08-18T22:15:49.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.655+0000 7f5a77125640 1 -- 172.21.15.123:0/350531011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a70104c40 msgr2=0x7f5a70107030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:49.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.655+0000 7f5a77125640 1 --2- 172.21.15.123:0/350531011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a70104c40 0x7f5a70107030 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009900 tx=0x7f5a6002a410 comp rx=0 tx=0).stop 2024-08-18T22:15:49.660 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.655+0000 7f5a77125640 1 -- 172.21.15.123:0/350531011 shutdown_connections 2024-08-18T22:15:49.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.655+0000 7f5a77125640 1 --2- 172.21.15.123:0/350531011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a70107570 0x7f5a701099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.655+0000 7f5a77125640 1 --2- 172.21.15.123:0/350531011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a70104c40 0x7f5a70107030 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.655+0000 7f5a77125640 1 --2- 172.21.15.123:0/350531011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a70102310 0x7f5a70104700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.655+0000 7f5a77125640 1 -- 172.21.15.123:0/350531011 >> 172.21.15.123:0/350531011 conn(0x7f5a700fbf10 msgr2=0x7f5a700fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:49.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.656+0000 7f5a77125640 1 -- 172.21.15.123:0/350531011 shutdown_connections 2024-08-18T22:15:49.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.656+0000 7f5a77125640 1 -- 172.21.15.123:0/350531011 wait complete. 2024-08-18T22:15:49.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.656+0000 7f5a77125640 1 Processor -- start 2024-08-18T22:15:49.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.656+0000 7f5a77125640 1 -- start start 2024-08-18T22:15:49.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.656+0000 7f5a77125640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a70102310 0x7f5a70197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.656+0000 7f5a77125640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a70104c40 0x7f5a70198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.656+0000 7f5a77125640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a70107570 0x7f5a7019f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.661 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.656+0000 7f5a77125640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7010d540 con 0x7f5a70107570 2024-08-18T22:15:49.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.656+0000 7f5a77125640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7010d3c0 con 0x7f5a70102310 2024-08-18T22:15:49.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.656+0000 7f5a77125640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7010d6c0 con 0x7f5a70104c40 2024-08-18T22:15:49.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a756c2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a70107570 0x7f5a7019f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:49.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a756c2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a70107570 0x7f5a7019f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58180/0 (socket says 172.21.15.123:58180) 2024-08-18T22:15:49.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a756c2640 1 -- 172.21.15.123:0/513656129 learned_addr learned my addr 172.21.15.123:0/513656129 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:49.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a67fff640 1 --2- 172.21.15.123:0/513656129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a70104c40 0x7f5a70198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:49.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a74ec1640 1 --2- 172.21.15.123:0/513656129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a70102310 0x7f5a70197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:49.662 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a756c2640 1 -- 172.21.15.123:0/513656129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a70104c40 msgr2=0x7f5a70198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:49.663 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a756c2640 1 --2- 172.21.15.123:0/513656129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a70104c40 0x7f5a70198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.663 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a756c2640 1 -- 172.21.15.123:0/513656129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a70102310 msgr2=0x7f5a70197bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:49.663 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a756c2640 1 --2- 172.21.15.123:0/513656129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a70102310 0x7f5a70197bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.663 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a756c2640 1 -- 172.21.15.123:0/513656129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7019f7e0 con 0x7f5a70107570 2024-08-18T22:15:49.663 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a756c2640 1 --2- 172.21.15.123:0/513656129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a70107570 0x7f5a7019f170 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800e9d0 tx=0x7f5a6800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:49.663 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a65ffb640 1 -- 172.21.15.123:0/513656129 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6800cd80 con 0x7f5a70107570 2024-08-18T22:15:49.663 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a65ffb640 1 -- 172.21.15.123:0/513656129 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a68005020 con 0x7f5a70107570 2024-08-18T22:15:49.663 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a77125640 1 -- 172.21.15.123:0/513656129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7019fad0 con 0x7f5a70107570 2024-08-18T22:15:49.663 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a65ffb640 1 -- 172.21.15.123:0/513656129 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a680116d0 con 0x7f5a70107570 2024-08-18T22:15:49.663 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.657+0000 7f5a77125640 1 -- 172.21.15.123:0/513656129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7019ffa0 con 0x7f5a70107570 2024-08-18T22:15:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.660+0000 7f5a65ffb640 1 -- 172.21.15.123:0/513656129 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f5a680051d0 con 0x7f5a70107570 2024-08-18T22:15:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.660+0000 7f5a79fc3740 1 Processor -- start 2024-08-18T22:15:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.660+0000 7f5a79fc3740 1 -- start start 2024-08-18T22:15:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.660+0000 7f5a79fc3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7bb680 0x55fc2e7bba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.660+0000 7f5a79fc3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.671 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.660+0000 7f5a79fc3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7c1050 0x55fc2e7c3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.671 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.660+0000 7f5a79fc3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55fc2e71e9d0 con 0x55fc2e7c1050 2024-08-18T22:15:49.671 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.660+0000 7f5a79fc3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fc2e6c6820 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.671 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.660+0000 7f5a79fc3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fc2e71a990 con 0x55fc2e7bb680 2024-08-18T22:15:49.671 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a65ffb640 1 --2- 172.21.15.123:0/513656129 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a580a2c30 0x7f5a580a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.671 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a67fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7c1050 0x55fc2e7c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:49.671 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a67fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7c1050 0x55fc2e7c3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58182/0 (socket says 172.21.15.123:58182) 2024-08-18T22:15:49.671 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a67fff640 1 -- 172.21.15.123:0/107987878 learned_addr learned my addr 172.21.15.123:0/107987878 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:49.671 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a67fff640 1 --2- 172.21.15.123:0/107987878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7bb680 0x55fc2e7bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:49.671 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a756c2640 1 --2- 172.21.15.123:0/513656129 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a580a2c30 0x7f5a580a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:49.671 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a74ec1640 1 --2- 172.21.15.123:0/107987878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:49.671 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a65ffb640 1 -- 172.21.15.123:0/513656129 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f5a680cfa70 con 0x7f5a70107570 2024-08-18T22:15:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a67fff640 1 -- 172.21.15.123:0/107987878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7bb680 msgr2=0x55fc2e7bba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a67fff640 1 --2- 172.21.15.123:0/107987878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7bb680 0x55fc2e7bba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a67fff640 1 -- 172.21.15.123:0/107987878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7bbfc0 msgr2=0x55fc2e7c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a67fff640 1 --2- 172.21.15.123:0/107987878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7c0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a67fff640 1 -- 172.21.15.123:0/107987878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc2e432210 con 0x55fc2e7c1050 2024-08-18T22:15:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a67fff640 1 --2- 172.21.15.123:0/107987878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7c1050 0x55fc2e7c3510 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5a60005940 tx=0x7f5a60000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657bfea8492944e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a756c2640 1 --2- 172.21.15.123:0/513656129 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a580a2c30 0x7f5a580a50f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800c640 tx=0x7f5a680bc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a56ffd640 1 -- 172.21.15.123:0/107987878 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60035040 con 0x55fc2e7c1050 2024-08-18T22:15:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a56ffd640 1 -- 172.21.15.123:0/107987878 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a600035f0 con 0x55fc2e7c1050 2024-08-18T22:15:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.661+0000 7f5a56ffd640 1 -- 172.21.15.123:0/107987878 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6003d6e0 con 0x55fc2e7c1050 2024-08-18T22:15:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.662+0000 7f5a79fc3740 1 -- 172.21.15.123:0/107987878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7c1050 msgr2=0x55fc2e7c3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.662+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/107987878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7c1050 0x55fc2e7c3510 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5a60005940 tx=0x7f5a60000bc0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.662+0000 7f5a79fc3740 1 -- 172.21.15.123:0/107987878 shutdown_connections 2024-08-18T22:15:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.662+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/107987878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7c1050 0x55fc2e7c3510 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.662+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/107987878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7c0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.662+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/107987878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7bb680 0x55fc2e7bba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.662+0000 7f5a79fc3740 1 -- 172.21.15.123:0/107987878 >> 172.21.15.123:0/107987878 conn(0x55fc2e7b6cf0 msgr2=0x55fc2e7b70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.662+0000 7f5a79fc3740 1 -- 172.21.15.123:0/107987878 shutdown_connections 2024-08-18T22:15:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.662+0000 7f5a79fc3740 1 -- 172.21.15.123:0/107987878 wait complete. 2024-08-18T22:15:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.662+0000 7f5a79fc3740 1 -- start start 2024-08-18T22:15:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a79fc3740 1 Processor -- start 2024-08-18T22:15:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a79fc3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7bb680 0x55fc2e7c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a79fc3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a79fc3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7c1050 0x55fc2e7ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a79fc3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55fc2e7c3fc0 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.674 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a79fc3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fc2e6da520 con 0x55fc2e7bb680 2024-08-18T22:15:49.674 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a79fc3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fc2e7c4140 con 0x55fc2e7c1050 2024-08-18T22:15:49.674 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a79fc3740 10 client.0 _ll_register_callbacks cb 0x55fc2e431a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:15:49.674 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a74ec1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:49.674 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a74ec1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58188/0 (socket says 172.21.15.123:58188) 2024-08-18T22:15:49.674 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a74ec1640 1 -- 172.21.15.123:0/3947369792 learned_addr learned my addr 172.21.15.123:0/3947369792 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:49.674 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a67fff640 1 --2- 172.21.15.123:0/3947369792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7c1050 0x55fc2e7ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:49.674 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a74ec1640 1 -- 172.21.15.123:0/3947369792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7c1050 msgr2=0x55fc2e7ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:49.674 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a74ec1640 1 --2- 172.21.15.123:0/3947369792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7c1050 0x55fc2e7ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.674 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a74ec1640 1 -- 172.21.15.123:0/3947369792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7bb680 msgr2=0x55fc2e7c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:49.674 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a74ec1640 1 --2- 172.21.15.123:0/3947369792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7bb680 0x55fc2e7c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.674 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a74ec1640 1 -- 172.21.15.123:0/3947369792 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc2e4fe620 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.675 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a74ec1640 1 --2- 172.21.15.123:0/3947369792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7c5d10 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c012700 tx=0x7f5a6c012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ec4207a81542c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:49.675 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.663+0000 7f5a4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:15:49.675 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.664+0000 7f5a4ffff640 1 -- 172.21.15.123:0/3947369792 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c004260 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.675 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.664+0000 7f5a4ffff640 1 -- 172.21.15.123:0/3947369792 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f5a6c004400 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.675 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.664+0000 7f5a79fc3740 1 -- 172.21.15.123:0/3947369792 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a600035f0 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.675 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.664+0000 7f5a4ffff640 1 -- 172.21.15.123:0/3947369792 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5a6c0119a0 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.675 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.664+0000 7f5a79fc3740 10 client.16899 fetch_fsmap learned FSMap version 32 2024-08-18T22:15:49.675 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.664+0000 7f5a79fc3740 1 -- 172.21.15.123:0/3947369792 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fc2e7cfc10 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.675 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.664+0000 7f5a4ffff640 1 -- 172.21.15.123:0/3947369792 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a600035f0 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.675 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.664+0000 7f5a4ffff640 1 -- 172.21.15.123:0/3947369792 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f5a6c00f440 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.675 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.664+0000 7f5a79fc3740 10 client.16899 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:15:49.675 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.664+0000 7f5a79fc3740 10 client.16899 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:15:49.675 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.664+0000 7f5a79fc3740 20 client.16899 populate_metadata read hostname 'smithi123' 2024-08-18T22:15:49.675 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.664+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/3947369792 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fc2e7d1310 0x55fc2e7d3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.676 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.664+0000 7f5a79fc3740 4 client.16899 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:15:49.676 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.664+0000 7f5a79fc3740 1 -- 172.21.15.123:0/3947369792 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc2e72c100 con 0x55fc2e7d1310 2024-08-18T22:15:49.676 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.664+0000 7f5a67fff640 1 --2- 172.21.15.123:0/3947369792 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fc2e7d1310 0x55fc2e7d3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:49.676 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.665+0000 7f5a67fff640 1 --2- 172.21.15.123:0/3947369792 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fc2e7d1310 0x55fc2e7d3790 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ab6fe527d0b710e server_cookie=9e4714f7204923f1 in_seq=0 out_seq=0 2024-08-18T22:15:49.676 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.665+0000 7f5a4ffff640 10 client.16899 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:49.676 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.665+0000 7f5a4ffff640 1 -- 172.21.15.123:0/3947369792 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc2e72c100 con 0x55fc2e7d1310 2024-08-18T22:15:49.676 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.665+0000 7f5a4ffff640 10 client.16899 handle_command_reply: tid=0 2024-08-18T22:15:49.676 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.666+0000 7f5a79fc3740 1 client.16899 shutdown 2024-08-18T22:15:49.676 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.666+0000 7f5a79fc3740 1 -- 172.21.15.123:0/3947369792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bbfc0 msgr2=0x55fc2e7c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:49.676 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.666+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/3947369792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7c5d10 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c012700 tx=0x7f5a6c012bc0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.676 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.666+0000 7f5a79fc3740 1 -- 172.21.15.123:0/3947369792 shutdown_connections 2024-08-18T22:15:49.676 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.666+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/3947369792 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fc2e7d1310 0x55fc2e7d3790 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.676 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.666+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/3947369792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7c1050 0x55fc2e7ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.676 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.666+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/3947369792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7c5d10 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.677 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.666+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/3947369792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7bb680 0x55fc2e7c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.677 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.666+0000 7f5a4ffff640 0 client.16899 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:49.677 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.666+0000 7f5a79fc3740 1 -- 172.21.15.123:0/3947369792 >> 172.21.15.123:0/3947369792 conn(0x55fc2e7b6cf0 msgr2=0x55fc2e7b8500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:49.677 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.666+0000 7f5a79fc3740 1 -- 172.21.15.123:0/3947369792 shutdown_connections 2024-08-18T22:15:49.677 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.666+0000 7f5a79fc3740 1 -- 172.21.15.123:0/3947369792 wait complete. 2024-08-18T22:15:49.677 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.666+0000 7f5a79fc3740 20 client.16899 trim_cache size 0 max 16384 2024-08-18T22:15:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.680+0000 7f5a79fc3740 1 Processor -- start 2024-08-18T22:15:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.680+0000 7f5a79fc3740 1 -- start start 2024-08-18T22:15:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a79fc3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7bb680 0x55fc2e7b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a79fc3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a79fc3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7c1050 0x55fc2e7b8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a79fc3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701acdc0 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a79fc3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701aa5d0 con 0x55fc2e7bb680 2024-08-18T22:15:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a79fc3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701a8420 con 0x55fc2e7c1050 2024-08-18T22:15:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a74ec1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a74ec1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58194/0 (socket says 172.21.15.123:58194) 2024-08-18T22:15:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a74ec1640 1 -- 172.21.15.123:0/3140176691 learned_addr learned my addr 172.21.15.123:0/3140176691 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a67fff640 1 --2- 172.21.15.123:0/3140176691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7c1050 0x55fc2e7b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a74ec1640 1 -- 172.21.15.123:0/3140176691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7c1050 msgr2=0x55fc2e7b8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a74ec1640 1 --2- 172.21.15.123:0/3140176691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7c1050 0x55fc2e7b8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a74ec1640 1 -- 172.21.15.123:0/3140176691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7bb680 msgr2=0x55fc2e7b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a74ec1640 1 --2- 172.21.15.123:0/3140176691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7bb680 0x55fc2e7b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a74ec1640 1 -- 172.21.15.123:0/3140176691 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc2e7d3e10 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a67fff640 1 --2- 172.21.15.123:0/3140176691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7c1050 0x55fc2e7b8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:15:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a74ec1640 1 --2- 172.21.15.123:0/3140176691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7ccd10 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00f8e0 tx=0x7f5a6c00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616a2e867e81f28c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a567fc640 1 -- 172.21.15.123:0/3140176691 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c02d020 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a567fc640 1 -- 172.21.15.123:0/3140176691 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a6c00fe50 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.681+0000 7f5a567fc640 1 -- 172.21.15.123:0/3140176691 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c003850 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.682+0000 7f5a79fc3740 1 -- 172.21.15.123:0/3140176691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bbfc0 msgr2=0x55fc2e7ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.682+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/3140176691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7ccd10 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00f8e0 tx=0x7f5a6c00fce0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.682+0000 7f5a79fc3740 1 -- 172.21.15.123:0/3140176691 shutdown_connections 2024-08-18T22:15:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.682+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/3140176691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7c1050 0x55fc2e7b8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.682+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/3140176691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7ccd10 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.682+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/3140176691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7bb680 0x55fc2e7b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.682+0000 7f5a79fc3740 1 -- 172.21.15.123:0/3140176691 >> 172.21.15.123:0/3140176691 conn(0x55fc2e7b6cf0 msgr2=0x55fc2e7b5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.682+0000 7f5a79fc3740 1 -- 172.21.15.123:0/3140176691 shutdown_connections 2024-08-18T22:15:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.682+0000 7f5a79fc3740 1 -- 172.21.15.123:0/3140176691 wait complete. 2024-08-18T22:15:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.682+0000 7f5a79fc3740 1 -- start start 2024-08-18T22:15:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.682+0000 7f5a79fc3740 1 Processor -- start 2024-08-18T22:15:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a79fc3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bb680 0x55fc2e7cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a79fc3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a79fc3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7c1050 0x55fc2e7cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a79fc3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701a8a90 con 0x55fc2e7bb680 2024-08-18T22:15:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a79fc3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701a9f00 con 0x55fc2e7c1050 2024-08-18T22:15:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a79fc3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701a9160 con 0x55fc2e7bbfc0 2024-08-18T22:15:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a79fc3740 10 client.0 _ll_register_callbacks cb 0x7f5a6c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:15:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a67fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bb680 0x55fc2e7cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a67fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bb680 0x55fc2e7cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58202/0 (socket says 172.21.15.123:58202) 2024-08-18T22:15:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a67fff640 1 -- 172.21.15.123:0/2234950137 learned_addr learned my addr 172.21.15.123:0/2234950137 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:15:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a67fff640 1 --2- 172.21.15.123:0/2234950137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7c1050 0x55fc2e7cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a67fff640 1 -- 172.21.15.123:0/2234950137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7bbfc0 msgr2=0x55fc2e7cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a67fff640 1 --2- 172.21.15.123:0/2234950137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a67fff640 1 -- 172.21.15.123:0/2234950137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7c1050 msgr2=0x55fc2e7cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:15:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a67fff640 1 --2- 172.21.15.123:0/2234950137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7c1050 0x55fc2e7cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a67fff640 1 -- 172.21.15.123:0/2234950137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc2e7cc810 con 0x55fc2e7bb680 2024-08-18T22:15:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a67fff640 1 --2- 172.21.15.123:0/2234950137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bb680 0x55fc2e7cacb0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f5a60000c00 tx=0x7f5a60031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fc3bedeb94ca23 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:15:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:15:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a4ffff640 1 -- 172.21.15.123:0/2234950137 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60035040 con 0x55fc2e7bb680 2024-08-18T22:15:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a4ffff640 1 -- 172.21.15.123:0/2234950137 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f5a60004260 con 0x55fc2e7bb680 2024-08-18T22:15:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.683+0000 7f5a79fc3740 1 -- 172.21.15.123:0/2234950137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a6c00fe50 con 0x55fc2e7bb680 2024-08-18T22:15:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.684+0000 7f5a4ffff640 1 -- 172.21.15.123:0/2234950137 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5a60064050 con 0x55fc2e7bb680 2024-08-18T22:15:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.684+0000 7f5a79fc3740 10 client.16905 fetch_fsmap learned FSMap version 32 2024-08-18T22:15:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.684+0000 7f5a79fc3740 1 -- 172.21.15.123:0/2234950137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fc2e83c820 con 0x55fc2e7bb680 2024-08-18T22:15:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.684+0000 7f5a4ffff640 1 -- 172.21.15.123:0/2234950137 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a6c00fe50 con 0x55fc2e7bb680 2024-08-18T22:15:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.684+0000 7f5a4ffff640 1 -- 172.21.15.123:0/2234950137 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f5a6003a040 con 0x55fc2e7bb680 2024-08-18T22:15:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.684+0000 7f5a79fc3740 10 client.16905 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:15:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.684+0000 7f5a79fc3740 10 client.16905 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:15:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.684+0000 7f5a79fc3740 20 client.16905 populate_metadata read hostname 'smithi123' 2024-08-18T22:15:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.684+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/2234950137 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fc2e83ce30 0x55fc2e83f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:15:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.684+0000 7f5a79fc3740 4 client.16905 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:15:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.684+0000 7f5a79fc3740 1 -- 172.21.15.123:0/2234950137 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fc2e726450 con 0x55fc2e83ce30 2024-08-18T22:15:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.684+0000 7f5a74ec1640 1 --2- 172.21.15.123:0/2234950137 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fc2e83ce30 0x55fc2e83f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:15:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.685+0000 7f5a74ec1640 1 --2- 172.21.15.123:0/2234950137 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fc2e83ce30 0x55fc2e83f250 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17cfea61c70a4068 server_cookie=c35edbd583ed251b in_seq=0 out_seq=0 2024-08-18T22:15:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.685+0000 7f5a4ffff640 10 client.16905 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.717+0000 7f5a4ffff640 1 -- 172.21.15.123:0/2234950137 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fc2e726450 con 0x55fc2e83ce30 2024-08-18T22:15:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.717+0000 7f5a4ffff640 10 client.16905 handle_command_reply: tid=0 2024-08-18T22:15:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.717+0000 7f5a79fc3740 1 client.16905 shutdown 2024-08-18T22:15:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.717+0000 7f5a79fc3740 1 -- 172.21.15.123:0/2234950137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bb680 msgr2=0x55fc2e7cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.717+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/2234950137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bb680 0x55fc2e7cacb0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f5a60000c00 tx=0x7f5a60031400 comp rx=0 tx=0).stop 2024-08-18T22:15:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.717+0000 7f5a79fc3740 1 -- 172.21.15.123:0/2234950137 shutdown_connections 2024-08-18T22:15:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.717+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/2234950137 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55fc2e83ce30 0x55fc2e83f250 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.717+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/2234950137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc2e7c1050 0x55fc2e7cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.717+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/2234950137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fc2e7bbfc0 0x55fc2e7cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.717+0000 7f5a4ffff640 0 client.16905 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:15:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.717+0000 7f5a79fc3740 1 --2- 172.21.15.123:0/2234950137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc2e7bb680 0x55fc2e7cacb0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.717+0000 7f5a79fc3740 1 -- 172.21.15.123:0/2234950137 >> 172.21.15.123:0/2234950137 conn(0x55fc2e7b6cf0 msgr2=0x55fc2e7b5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.717+0000 7f5a79fc3740 1 -- 172.21.15.123:0/2234950137 shutdown_connections 2024-08-18T22:15:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.717+0000 7f5a79fc3740 1 -- 172.21.15.123:0/2234950137 wait complete. 2024-08-18T22:15:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.717+0000 7f5a79fc3740 20 client.16905 trim_cache size 0 max 16384 2024-08-18T22:15:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:15:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:15:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:15:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:15:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.718+0000 7f5a77125640 1 -- 172.21.15.123:0/513656129 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a580a2c30 msgr2=0x7f5a580a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.718+0000 7f5a77125640 1 --2- 172.21.15.123:0/513656129 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a580a2c30 0x7f5a580a50f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800c640 tx=0x7f5a680bc040 comp rx=0 tx=0).stop 2024-08-18T22:15:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.718+0000 7f5a77125640 1 -- 172.21.15.123:0/513656129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a70107570 msgr2=0x7f5a7019f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:15:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.718+0000 7f5a77125640 1 --2- 172.21.15.123:0/513656129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a70107570 0x7f5a7019f170 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800e9d0 tx=0x7f5a6800ee90 comp rx=0 tx=0).stop 2024-08-18T22:15:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.718+0000 7f5a77125640 1 -- 172.21.15.123:0/513656129 shutdown_connections 2024-08-18T22:15:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.718+0000 7f5a77125640 1 --2- 172.21.15.123:0/513656129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a70107570 0x7f5a7019f170 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.718+0000 7f5a77125640 1 --2- 172.21.15.123:0/513656129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a70104c40 0x7f5a70198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.718+0000 7f5a77125640 1 --2- 172.21.15.123:0/513656129 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5a580a2c30 0x7f5a580a50f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.718+0000 7f5a77125640 1 --2- 172.21.15.123:0/513656129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a70102310 0x7f5a70197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:15:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.718+0000 7f5a77125640 1 -- 172.21.15.123:0/513656129 >> 172.21.15.123:0/513656129 conn(0x7f5a700fbf10 msgr2=0x7f5a70102d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:15:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.718+0000 7f5a77125640 1 -- 172.21.15.123:0/513656129 shutdown_connections 2024-08-18T22:15:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:15:49.718+0000 7f5a77125640 1 -- 172.21.15.123:0/513656129 wait complete. 2024-08-18T22:15:49.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:49 smithi123 ceph-mon[18462]: pgmap v581: 129 pgs: 129 active+clean; 249 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 481 op/s 2024-08-18T22:15:49.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:49 smithi130 ceph-mon[21698]: pgmap v581: 129 pgs: 129 active+clean; 249 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 481 op/s 2024-08-18T22:15:49.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:49 smithi183 ceph-mon[22097]: pgmap v581: 129 pgs: 129 active+clean; 249 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 481 op/s 2024-08-18T22:15:51.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:51 smithi123 ceph-mon[18462]: pgmap v582: 129 pgs: 129 active+clean; 249 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 659 KiB/s wr, 391 op/s 2024-08-18T22:15:51.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:51 smithi130 ceph-mon[21698]: pgmap v582: 129 pgs: 129 active+clean; 249 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 659 KiB/s wr, 391 op/s 2024-08-18T22:15:51.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:51 smithi183 ceph-mon[22097]: pgmap v582: 129 pgs: 129 active+clean; 249 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 659 KiB/s wr, 391 op/s 2024-08-18T22:15:52.991 INFO:tasks.workunit.client.0.smithi123.stdout:ok 2024-08-18T22:15:52.996 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-18T22:15:52.997 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-18T22:15:53.043 INFO:tasks.workunit:Running workunit fs/misc/filelock_interrupt.py... 2024-08-18T22:15:53.044 DEBUG:teuthology.orchestra.run.smithi123:workunit test fs/misc/filelock_interrupt.py> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/filelock_interrupt.py 2024-08-18T22:15:53.710 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:53 smithi183 ceph-mon[22097]: pgmap v583: 129 pgs: 129 active+clean; 249 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 612 KiB/s wr, 284 op/s 2024-08-18T22:15:53.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:53 smithi123 ceph-mon[18462]: pgmap v583: 129 pgs: 129 active+clean; 249 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 612 KiB/s wr, 284 op/s 2024-08-18T22:15:53.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:53 smithi130 ceph-mon[21698]: pgmap v583: 129 pgs: 129 active+clean; 249 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 612 KiB/s wr, 284 op/s 2024-08-18T22:15:54.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:15:54.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:15:54.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:15:54.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:15:54.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:15:54.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:15:54.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:15:54.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:15:54.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:15:54.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:15:54.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:15:54.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:15:55.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:55 smithi123 ceph-mon[18462]: pgmap v584: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 582 KiB/s wr, 219 op/s 2024-08-18T22:15:55.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:55 smithi130 ceph-mon[21698]: pgmap v584: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 582 KiB/s wr, 219 op/s 2024-08-18T22:15:55.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:55 smithi183 ceph-mon[22097]: pgmap v584: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 582 KiB/s wr, 219 op/s 2024-08-18T22:15:57.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:57 smithi123 ceph-mon[18462]: pgmap v585: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 68 KiB/s wr, 83 op/s 2024-08-18T22:15:57.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:57 smithi130 ceph-mon[21698]: pgmap v585: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 68 KiB/s wr, 83 op/s 2024-08-18T22:15:57.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:57 smithi183 ceph-mon[22097]: pgmap v585: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 68 KiB/s wr, 83 op/s 2024-08-18T22:15:59.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:15:59 smithi123 ceph-mon[18462]: pgmap v586: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 41 op/s 2024-08-18T22:15:59.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:15:59 smithi130 ceph-mon[21698]: pgmap v586: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 41 op/s 2024-08-18T22:15:59.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:15:59 smithi183 ceph-mon[22097]: pgmap v586: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 41 op/s 2024-08-18T22:16:01.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:01 smithi123 ceph-mon[18462]: pgmap v587: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 28 op/s 2024-08-18T22:16:01.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:01 smithi130 ceph-mon[21698]: pgmap v587: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 28 op/s 2024-08-18T22:16:01.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:01 smithi183 ceph-mon[22097]: pgmap v587: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 28 op/s 2024-08-18T22:16:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.813+0000 7f2fcd2fe640 1 -- 172.21.15.123:0/4142553975 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc81034f0 msgr2=0x7f2fc8109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.813+0000 7f2fcd2fe640 1 --2- 172.21.15.123:0/4142553975 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc81034f0 0x7f2fc8109d80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009ca0 tx=0x7f2fc002a8c0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.813+0000 7f2fcd2fe640 1 -- 172.21.15.123:0/4142553975 shutdown_connections 2024-08-18T22:16:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.813+0000 7f2fcd2fe640 1 --2- 172.21.15.123:0/4142553975 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc81034f0 0x7f2fc8109d80 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.813+0000 7f2fcd2fe640 1 --2- 172.21.15.123:0/4142553975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc8102b30 0x7f2fc8102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.813+0000 7f2fcd2fe640 1 --2- 172.21.15.123:0/4142553975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fc80ffb60 0x7f2fc80fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.813+0000 7f2fcd2fe640 1 -- 172.21.15.123:0/4142553975 >> 172.21.15.123:0/4142553975 conn(0x7f2fc80fb6a0 msgr2=0x7f2fc80fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.813+0000 7f2fcd2fe640 1 -- 172.21.15.123:0/4142553975 shutdown_connections 2024-08-18T22:16:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.813+0000 7f2fcd2fe640 1 -- 172.21.15.123:0/4142553975 wait complete. 2024-08-18T22:16:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.814+0000 7f2fcd2fe640 1 Processor -- start 2024-08-18T22:16:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.814+0000 7f2fcd2fe640 1 -- start start 2024-08-18T22:16:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.814+0000 7f2fcd2fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fc80ffb60 0x7f2fc8197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.814+0000 7f2fcd2fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc8102b30 0x7f2fc8198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.814+0000 7f2fcd2fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc81034f0 0x7f2fc819f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.814+0000 7f2fcd2fe640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc810d580 con 0x7f2fc8102b30 2024-08-18T22:16:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.814+0000 7f2fcd2fe640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc810d400 con 0x7f2fc81034f0 2024-08-18T22:16:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.814+0000 7f2fcd2fe640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc810d700 con 0x7f2fc80ffb60 2024-08-18T22:16:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.814+0000 7f2fc67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc8102b30 0x7f2fc8198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.814+0000 7f2fc67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc8102b30 0x7f2fc8198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34922/0 (socket says 172.21.15.123:34922) 2024-08-18T22:16:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.814+0000 7f2fc67fc640 1 -- 172.21.15.123:0/3700918901 learned_addr learned my addr 172.21.15.123:0/3700918901 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.814+0000 7f2fc6ffd640 1 --2- 172.21.15.123:0/3700918901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fc80ffb60 0x7f2fc8197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.815+0000 7f2fc77fe640 1 --2- 172.21.15.123:0/3700918901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc81034f0 0x7f2fc819f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.815+0000 7f2fc67fc640 1 -- 172.21.15.123:0/3700918901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fc80ffb60 msgr2=0x7f2fc8197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.815+0000 7f2fc67fc640 1 --2- 172.21.15.123:0/3700918901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fc80ffb60 0x7f2fc8197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.815+0000 7f2fc67fc640 1 -- 172.21.15.123:0/3700918901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc81034f0 msgr2=0x7f2fc819f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.815+0000 7f2fc67fc640 1 --2- 172.21.15.123:0/3700918901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc81034f0 0x7f2fc819f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.815+0000 7f2fc67fc640 1 -- 172.21.15.123:0/3700918901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc819f730 con 0x7f2fc8102b30 2024-08-18T22:16:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.815+0000 7f2fc77fe640 1 --2- 172.21.15.123:0/3700918901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc81034f0 0x7f2fc819f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:16:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.815+0000 7f2fc67fc640 1 --2- 172.21.15.123:0/3700918901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc8102b30 0x7f2fc8198050 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00c890 tx=0x7f2fbc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.815+0000 7f2faffff640 1 -- 172.21.15.123:0/3700918901 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc004220 con 0x7f2fc8102b30 2024-08-18T22:16:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.815+0000 7f2faffff640 1 -- 172.21.15.123:0/3700918901 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fbc0043c0 con 0x7f2fc8102b30 2024-08-18T22:16:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.815+0000 7f2fcd2fe640 1 -- 172.21.15.123:0/3700918901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc819fa20 con 0x7f2fc8102b30 2024-08-18T22:16:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.815+0000 7f2faffff640 1 -- 172.21.15.123:0/3700918901 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0049e0 con 0x7f2fc8102b30 2024-08-18T22:16:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.815+0000 7f2fcd2fe640 1 -- 172.21.15.123:0/3700918901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc819ff70 con 0x7f2fc8102b30 2024-08-18T22:16:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.817+0000 7f2faffff640 1 -- 172.21.15.123:0/3700918901 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f2fbc0079b0 con 0x7f2fc8102b30 2024-08-18T22:16:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.818+0000 7f2fd00c1740 1 Processor -- start 2024-08-18T22:16:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.818+0000 7f2fd00c1740 1 -- start start 2024-08-18T22:16:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.818+0000 7f2fd00c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448680 0x564634448a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.818+0000 7f2fd00c1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 0x56463444da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.818+0000 7f2fd00c1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634450510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.818+0000 7f2fd00c1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5646343ab9d0 con 0x56463444e050 2024-08-18T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.818+0000 7f2fd00c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564634353820 con 0x564634448680 2024-08-18T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.818+0000 7f2fd00c1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5646343a7990 con 0x564634448fc0 2024-08-18T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.818+0000 7f2fc67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634450510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.818+0000 7f2fc67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634450510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34924/0 (socket says 172.21.15.123:34924) 2024-08-18T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.818+0000 7f2fc67fc640 1 -- 172.21.15.123:0/550525963 learned_addr learned my addr 172.21.15.123:0/550525963 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.818+0000 7f2fc6ffd640 1 --2- 172.21.15.123:0/550525963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 0x56463444da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.818+0000 7f2faffff640 1 --2- 172.21.15.123:0/3700918901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2fb00a2c30 0x7f2fb00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.819+0000 7f2fc77fe640 1 --2- 172.21.15.123:0/550525963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448680 0x564634448a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.819+0000 7f2fc77fe640 1 --2- 172.21.15.123:0/3700918901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2fb00a2c30 0x7f2fb00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.819+0000 7f2fc6ffd640 1 -- 172.21.15.123:0/550525963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448680 msgr2=0x564634448a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.819+0000 7f2fc6ffd640 1 --2- 172.21.15.123:0/550525963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448680 0x564634448a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.819+0000 7f2fc6ffd640 1 -- 172.21.15.123:0/550525963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 msgr2=0x564634450510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.819+0000 7f2fc6ffd640 1 --2- 172.21.15.123:0/550525963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634450510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.819+0000 7f2fc6ffd640 1 -- 172.21.15.123:0/550525963 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646340bf210 con 0x564634448fc0 2024-08-18T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.819+0000 7f2fc67fc640 1 --2- 172.21.15.123:0/550525963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634450510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:16:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.819+0000 7f2faffff640 1 -- 172.21.15.123:0/3700918901 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f2fbc0cf430 con 0x7f2fc8102b30 2024-08-18T22:16:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.819+0000 7f2fc6ffd640 1 --2- 172.21.15.123:0/550525963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 0x56463444da80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8069e50 tx=0x7f2fb800f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=770b559b361713ce server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.819+0000 7f2fc77fe640 1 --2- 172.21.15.123:0/3700918901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2fb00a2c30 0x7f2fb00a50f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2fc002ade0 tx=0x7f2fc00095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.819+0000 7f2fad7fa640 1 -- 172.21.15.123:0/550525963 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8004020 con 0x564634448fc0 2024-08-18T22:16:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.819+0000 7f2fad7fa640 1 -- 172.21.15.123:0/550525963 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fb80041c0 con 0x564634448fc0 2024-08-18T22:16:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.819+0000 7f2fad7fa640 1 -- 172.21.15.123:0/550525963 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8018790 con 0x564634448fc0 2024-08-18T22:16:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.820+0000 7f2fd00c1740 1 -- 172.21.15.123:0/550525963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 msgr2=0x56463444da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.820+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/550525963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 0x56463444da80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8069e50 tx=0x7f2fb800f3c0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.820+0000 7f2fd00c1740 1 -- 172.21.15.123:0/550525963 shutdown_connections 2024-08-18T22:16:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.820+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/550525963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634450510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.820+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/550525963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 0x56463444da80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.820+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/550525963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448680 0x564634448a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.820+0000 7f2fd00c1740 1 -- 172.21.15.123:0/550525963 >> 172.21.15.123:0/550525963 conn(0x564634443cf0 msgr2=0x5646344440f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.820+0000 7f2fd00c1740 1 -- 172.21.15.123:0/550525963 shutdown_connections 2024-08-18T22:16:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.820+0000 7f2fd00c1740 1 -- 172.21.15.123:0/550525963 wait complete. 2024-08-18T22:16:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.820+0000 7f2fd00c1740 1 -- start start 2024-08-18T22:16:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.820+0000 7f2fd00c1740 1 Processor -- start 2024-08-18T22:16:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fd00c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448680 0x564634452780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fd00c1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 0x564634452cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fd00c1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634459d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fd00c1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x564634451020 con 0x56463444e050 2024-08-18T22:16:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fd00c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564634367520 con 0x564634448680 2024-08-18T22:16:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fd00c1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5646344511a0 con 0x564634448fc0 2024-08-18T22:16:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fd00c1740 10 client.0 _ll_register_callbacks cb 0x5646340bea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:16:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fc77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634459d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fc77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634459d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34926/0 (socket says 172.21.15.123:34926) 2024-08-18T22:16:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fc77fe640 1 -- 172.21.15.123:0/1919293374 learned_addr learned my addr 172.21.15.123:0/1919293374 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fc67fc640 1 --2- 172.21.15.123:0/1919293374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 0x564634452cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fc6ffd640 1 --2- 172.21.15.123:0/1919293374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448680 0x564634452780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fc77fe640 1 -- 172.21.15.123:0/1919293374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 msgr2=0x564634452cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fc77fe640 1 --2- 172.21.15.123:0/1919293374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 0x564634452cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fc77fe640 1 -- 172.21.15.123:0/1919293374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448680 msgr2=0x564634452780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fc77fe640 1 --2- 172.21.15.123:0/1919293374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448680 0x564634452780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fc77fe640 1 -- 172.21.15.123:0/1919293374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56463418b620 con 0x56463444e050 2024-08-18T22:16:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fc77fe640 1 --2- 172.21.15.123:0/1919293374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634459d00 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0031700 tx=0x7f2fc002f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1706c76d2002c5c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2faaff5640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:16:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2faaff5640 1 -- 172.21.15.123:0/1919293374 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0032e70 con 0x56463444e050 2024-08-18T22:16:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2faaff5640 1 -- 172.21.15.123:0/1919293374 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f2fc0004250 con 0x56463444e050 2024-08-18T22:16:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.821+0000 7f2fd00c1740 1 -- 172.21.15.123:0/1919293374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fb80041c0 con 0x56463444e050 2024-08-18T22:16:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.822+0000 7f2faaff5640 1 -- 172.21.15.123:0/1919293374 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2fc0004450 con 0x56463444e050 2024-08-18T22:16:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.822+0000 7f2fd00c1740 10 client.16917 fetch_fsmap learned FSMap version 32 2024-08-18T22:16:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.822+0000 7f2fd00c1740 1 -- 172.21.15.123:0/1919293374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56463445cb60 con 0x56463444e050 2024-08-18T22:16:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.822+0000 7f2faaff5640 1 -- 172.21.15.123:0/1919293374 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fb80041c0 con 0x56463444e050 2024-08-18T22:16:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.822+0000 7f2faaff5640 1 -- 172.21.15.123:0/1919293374 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f2fc00305c0 con 0x56463444e050 2024-08-18T22:16:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.822+0000 7f2fd00c1740 10 client.16917 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:16:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.822+0000 7f2fd00c1740 10 client.16917 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:16:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.822+0000 7f2fd00c1740 20 client.16917 populate_metadata read hostname 'smithi123' 2024-08-18T22:16:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.822+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/1919293374 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56463445e2a0 0x5646344606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.822+0000 7f2fd00c1740 4 client.16917 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:16:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.822+0000 7f2fd00c1740 1 -- 172.21.15.123:0/1919293374 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646343b9100 con 0x56463445e2a0 2024-08-18T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.822+0000 7f2fc6ffd640 1 --2- 172.21.15.123:0/1919293374 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56463445e2a0 0x5646344606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.823+0000 7f2faaff5640 10 client.16917 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.823+0000 7f2fc6ffd640 1 --2- 172.21.15.123:0/1919293374 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56463445e2a0 0x5646344606d0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb884a25935a009a server_cookie=c3d9da9917d9db4 in_seq=0 out_seq=0 2024-08-18T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.823+0000 7f2faaff5640 1 -- 172.21.15.123:0/1919293374 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5646343b9100 con 0x56463445e2a0 2024-08-18T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.823+0000 7f2faaff5640 10 client.16917 handle_command_reply: tid=0 2024-08-18T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.823+0000 7f2fd00c1740 1 client.16917 shutdown 2024-08-18T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.824+0000 7f2fd00c1740 1 -- 172.21.15.123:0/1919293374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 msgr2=0x564634459d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.824+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/1919293374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634459d00 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0031700 tx=0x7f2fc002f310 comp rx=0 tx=0).stop 2024-08-18T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.824+0000 7f2fd00c1740 1 -- 172.21.15.123:0/1919293374 shutdown_connections 2024-08-18T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.824+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/1919293374 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x56463445e2a0 0x5646344606d0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.824+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/1919293374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634459d00 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.824+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/1919293374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 0x564634452cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.824+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/1919293374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448680 0x564634452780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.824+0000 7f2faaff5640 0 client.16917 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:16:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.824+0000 7f2fd00c1740 1 -- 172.21.15.123:0/1919293374 >> 172.21.15.123:0/1919293374 conn(0x564634443cf0 msgr2=0x564634445500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.824+0000 7f2fd00c1740 1 -- 172.21.15.123:0/1919293374 shutdown_connections 2024-08-18T22:16:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.824+0000 7f2fd00c1740 1 -- 172.21.15.123:0/1919293374 wait complete. 2024-08-18T22:16:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.824+0000 7f2fd00c1740 20 client.16917 trim_cache size 0 max 16384 2024-08-18T22:16:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.838+0000 7f2fd00c1740 1 Processor -- start 2024-08-18T22:16:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.838+0000 7f2fd00c1740 1 -- start start 2024-08-18T22:16:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.838+0000 7f2fd00c1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448680 0x564634442d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.838+0000 7f2fd00c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448fc0 0x564634459cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.838+0000 7f2fd00c1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634464fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.838+0000 7f2fd00c1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc81acdf0 con 0x56463444e050 2024-08-18T22:16:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.838+0000 7f2fd00c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc81aa600 con 0x564634448fc0 2024-08-18T22:16:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.838+0000 7f2fd00c1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc81a8450 con 0x564634448680 2024-08-18T22:16:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.838+0000 7f2fc77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634464fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.838+0000 7f2fc77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634464fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34932/0 (socket says 172.21.15.123:34932) 2024-08-18T22:16:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.838+0000 7f2fc77fe640 1 -- 172.21.15.123:0/1486078418 learned_addr learned my addr 172.21.15.123:0/1486078418 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.838+0000 7f2fc67fc640 1 --2- 172.21.15.123:0/1486078418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448fc0 0x564634459cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.838+0000 7f2fc6ffd640 1 --2- 172.21.15.123:0/1486078418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448680 0x564634442d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2fc77fe640 1 -- 172.21.15.123:0/1486078418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448680 msgr2=0x564634442d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2fc77fe640 1 --2- 172.21.15.123:0/1486078418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448680 0x564634442d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2fc77fe640 1 -- 172.21.15.123:0/1486078418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448fc0 msgr2=0x564634459cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2fc77fe640 1 --2- 172.21.15.123:0/1486078418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448fc0 0x564634459cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2fc77fe640 1 -- 172.21.15.123:0/1486078418 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564634451240 con 0x56463444e050 2024-08-18T22:16:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2fc6ffd640 1 --2- 172.21.15.123:0/1486078418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448680 0x564634442d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:16:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2fc67fc640 1 --2- 172.21.15.123:0/1486078418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448fc0 0x564634459cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:16:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2fc77fe640 1 --2- 172.21.15.123:0/1486078418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634464fd0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2fc002f540 tx=0x7f2fc00093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebac3d59434960a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2facff9640 1 -- 172.21.15.123:0/1486078418 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0003c80 con 0x56463444e050 2024-08-18T22:16:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2facff9640 1 -- 172.21.15.123:0/1486078418 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fc004e070 con 0x56463444e050 2024-08-18T22:16:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2facff9640 1 -- 172.21.15.123:0/1486078418 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc002fe60 con 0x56463444e050 2024-08-18T22:16:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2fd00c1740 1 -- 172.21.15.123:0/1486078418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 msgr2=0x564634464fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/1486078418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634464fd0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2fc002f540 tx=0x7f2fc00093e0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2fd00c1740 1 -- 172.21.15.123:0/1486078418 shutdown_connections 2024-08-18T22:16:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/1486078418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634464fd0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/1486078418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448fc0 0x564634459cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/1486078418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448680 0x564634442d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.839+0000 7f2fd00c1740 1 -- 172.21.15.123:0/1486078418 >> 172.21.15.123:0/1486078418 conn(0x564634443cf0 msgr2=0x564634442680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fd00c1740 1 -- 172.21.15.123:0/1486078418 shutdown_connections 2024-08-18T22:16:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fd00c1740 1 -- 172.21.15.123:0/1486078418 wait complete. 2024-08-18T22:16:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fd00c1740 1 -- start start 2024-08-18T22:16:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fd00c1740 1 Processor -- start 2024-08-18T22:16:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fd00c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448680 0x564634457af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fd00c1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 0x564634458030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fd00c1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634459040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fd00c1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc81a8ac0 con 0x56463444e050 2024-08-18T22:16:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fd00c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc81a9f30 con 0x564634448680 2024-08-18T22:16:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fd00c1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc81a9190 con 0x564634448fc0 2024-08-18T22:16:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fd00c1740 10 client.0 _ll_register_callbacks cb 0x7f2fc0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:16:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fc77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634459040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fc77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634459040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34946/0 (socket says 172.21.15.123:34946) 2024-08-18T22:16:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fc77fe640 1 -- 172.21.15.123:0/2805350947 learned_addr learned my addr 172.21.15.123:0/2805350947 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fc67fc640 1 --2- 172.21.15.123:0/2805350947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 0x564634458030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.840+0000 7f2fc6ffd640 1 --2- 172.21.15.123:0/2805350947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448680 0x564634457af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2fc77fe640 1 -- 172.21.15.123:0/2805350947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 msgr2=0x564634458030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2fc77fe640 1 --2- 172.21.15.123:0/2805350947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 0x564634458030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2fc77fe640 1 -- 172.21.15.123:0/2805350947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448680 msgr2=0x564634457af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2fc77fe640 1 --2- 172.21.15.123:0/2805350947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448680 0x564634457af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2fc77fe640 1 -- 172.21.15.123:0/2805350947 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564634459650 con 0x56463444e050 2024-08-18T22:16:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2fc77fe640 1 --2- 172.21.15.123:0/2805350947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634459040 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0004660 tx=0x7f2fc0004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfdb998ed52562f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2faaff5640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:16:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2faaff5640 1 -- 172.21.15.123:0/2805350947 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0030e60 con 0x56463444e050 2024-08-18T22:16:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2faaff5640 1 -- 172.21.15.123:0/2805350947 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f2fc0004b40 con 0x56463444e050 2024-08-18T22:16:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2fd00c1740 1 -- 172.21.15.123:0/2805350947 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fc004e070 con 0x56463444e050 2024-08-18T22:16:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2faaff5640 1 -- 172.21.15.123:0/2805350947 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2fc0072050 con 0x56463444e050 2024-08-18T22:16:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2fd00c1740 10 client.16923 fetch_fsmap learned FSMap version 32 2024-08-18T22:16:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2fd00c1740 1 -- 172.21.15.123:0/2805350947 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5646344c9720 con 0x56463444e050 2024-08-18T22:16:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2faaff5640 1 -- 172.21.15.123:0/2805350947 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fc004e070 con 0x56463444e050 2024-08-18T22:16:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2faaff5640 1 -- 172.21.15.123:0/2805350947 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f2fc0053630 con 0x56463444e050 2024-08-18T22:16:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2fd00c1740 10 client.16923 fetch_fsmap finished waiting for FSMap version 32 2024-08-18T22:16:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2fd00c1740 10 client.16923 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:16:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2fd00c1740 20 client.16923 populate_metadata read hostname 'smithi123' 2024-08-18T22:16:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/2805350947 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5646344ca080 0x5646344cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2fd00c1740 4 client.16923 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:16:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.841+0000 7f2fd00c1740 1 -- 172.21.15.123:0/2805350947 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5646343b3450 con 0x5646344ca080 2024-08-18T22:16:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.842+0000 7f2fc6ffd640 1 --2- 172.21.15.123:0/2805350947 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5646344ca080 0x5646344cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.842+0000 7f2faaff5640 10 client.16923 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:16:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.842+0000 7f2fc6ffd640 1 --2- 172.21.15.123:0/2805350947 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5646344ca080 0x5646344cc470 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c1e7b3239dad298 server_cookie=c3eea3f240e3936b in_seq=0 out_seq=0 2024-08-18T22:16:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.857+0000 7f2faaff5640 1 -- 172.21.15.123:0/2805350947 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5646343b3450 con 0x5646344ca080 2024-08-18T22:16:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.857+0000 7f2faaff5640 10 client.16923 handle_command_reply: tid=0 2024-08-18T22:16:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.857+0000 7f2fd00c1740 1 client.16923 shutdown 2024-08-18T22:16:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.857+0000 7f2fd00c1740 1 -- 172.21.15.123:0/2805350947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 msgr2=0x564634459040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.857+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/2805350947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634459040 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0004660 tx=0x7f2fc0004690 comp rx=0 tx=0).stop 2024-08-18T22:16:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.857+0000 7f2fd00c1740 1 -- 172.21.15.123:0/2805350947 shutdown_connections 2024-08-18T22:16:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.857+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/2805350947 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x5646344ca080 0x5646344cc470 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.857+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/2805350947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56463444e050 0x564634459040 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.857+0000 7f2faaff5640 0 client.16923 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:16:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.857+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/2805350947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564634448fc0 0x564634458030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.857+0000 7f2fd00c1740 1 --2- 172.21.15.123:0/2805350947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564634448680 0x564634457af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.857+0000 7f2fd00c1740 1 -- 172.21.15.123:0/2805350947 >> 172.21.15.123:0/2805350947 conn(0x564634443cf0 msgr2=0x564634444ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.857+0000 7f2fd00c1740 1 -- 172.21.15.123:0/2805350947 shutdown_connections 2024-08-18T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.857+0000 7f2fd00c1740 1 -- 172.21.15.123:0/2805350947 wait complete. 2024-08-18T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.857+0000 7f2fd00c1740 20 client.16923 trim_cache size 0 max 16384 2024-08-18T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:{ 2024-08-18T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "message": "", 2024-08-18T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout: "return_code": 0 2024-08-18T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stdout:} 2024-08-18T22:16:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.858+0000 7f2fcd2fe640 1 -- 172.21.15.123:0/3700918901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2fb00a2c30 msgr2=0x7f2fb00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.858+0000 7f2fcd2fe640 1 --2- 172.21.15.123:0/3700918901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2fb00a2c30 0x7f2fb00a50f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2fc002ade0 tx=0x7f2fc00095c0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.858+0000 7f2fcd2fe640 1 -- 172.21.15.123:0/3700918901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc8102b30 msgr2=0x7f2fc8198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.858+0000 7f2fcd2fe640 1 --2- 172.21.15.123:0/3700918901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc8102b30 0x7f2fc8198050 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00c890 tx=0x7f2fbc00cd50 comp rx=0 tx=0).stop 2024-08-18T22:16:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.858+0000 7f2fcd2fe640 1 -- 172.21.15.123:0/3700918901 shutdown_connections 2024-08-18T22:16:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.858+0000 7f2fcd2fe640 1 --2- 172.21.15.123:0/3700918901 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2fb00a2c30 0x7f2fb00a50f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.858+0000 7f2fcd2fe640 1 --2- 172.21.15.123:0/3700918901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc81034f0 0x7f2fc819f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.858+0000 7f2fcd2fe640 1 --2- 172.21.15.123:0/3700918901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc8102b30 0x7f2fc8198050 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.858+0000 7f2fcd2fe640 1 --2- 172.21.15.123:0/3700918901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fc80ffb60 0x7f2fc8197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.858+0000 7f2fcd2fe640 1 -- 172.21.15.123:0/3700918901 >> 172.21.15.123:0/3700918901 conn(0x7f2fc80fb6a0 msgr2=0x7f2fc8105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.858+0000 7f2fcd2fe640 1 -- 172.21.15.123:0/3700918901 shutdown_connections 2024-08-18T22:16:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:02.858+0000 7f2fcd2fe640 1 -- 172.21.15.123:0/3700918901 wait complete. 2024-08-18T22:16:03.454 INFO:tasks.workunit.client.0.smithi123.stdout:ok 2024-08-18T22:16:03.458 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-18T22:16:03.458 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-18T22:16:03.497 INFO:tasks.workunit:Running workunit fs/misc/i_complete_vs_rename.sh... 2024-08-18T22:16:03.497 DEBUG:teuthology.orchestra.run.smithi123:workunit test fs/misc/i_complete_vs_rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/i_complete_vs_rename.sh 2024-08-18T22:16:03.575 INFO:tasks.workunit.client.0.smithi123.stdout:a 2024-08-18T22:16:03.575 INFO:tasks.workunit.client.0.smithi123.stdout:b 2024-08-18T22:16:03.575 INFO:tasks.workunit.client.0.smithi123.stdout:c 2024-08-18T22:16:03.575 INFO:tasks.workunit.client.0.smithi123.stdout:d 2024-08-18T22:16:03.588 INFO:tasks.workunit.client.0.smithi123.stderr:stat: cannot statx 'e': No such file or directory 2024-08-18T22:16:03.591 INFO:tasks.workunit.client.0.smithi123.stdout:attempting rename over existing file... 2024-08-18T22:16:03.612 INFO:tasks.workunit.client.0.smithi123.stdout:f 2024-08-18T22:16:03.613 INFO:tasks.workunit.client.0.smithi123.stdout:rename over existing file is okay 2024-08-18T22:16:03.613 INFO:tasks.workunit.client.0.smithi123.stdout:attempting rename over negative dentry... 2024-08-18T22:16:03.621 INFO:tasks.workunit.client.0.smithi123.stdout:e 2024-08-18T22:16:03.621 INFO:tasks.workunit.client.0.smithi123.stdout:rename over negative dentry is ok 2024-08-18T22:16:03.621 INFO:tasks.workunit.client.0.smithi123.stdout:OK 2024-08-18T22:16:03.621 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-18T22:16:03.622 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-18T22:16:03.715 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:03 smithi123 ceph-mon[18462]: pgmap v588: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 26 op/s 2024-08-18T22:16:03.716 INFO:tasks.workunit:Running workunit fs/misc/layout_vxattrs.sh... 2024-08-18T22:16:03.716 DEBUG:teuthology.orchestra.run.smithi123:workunit test fs/misc/layout_vxattrs.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/layout_vxattrs.sh 2024-08-18T22:16:03.753 INFO:tasks.workunit.client.0.smithi123.stderr:+ datapool= 2024-08-18T22:16:03.753 INFO:tasks.workunit.client.0.smithi123.stderr:+ dir=. 2024-08-18T22:16:03.753 INFO:tasks.workunit.client.0.smithi123.stdout:. 2024-08-18T22:16:03.754 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2024-08-18T22:16:03.754 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo . 2024-08-18T22:16:03.754 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfattr -n ceph.dir.layout.pool . --only-values 2024-08-18T22:16:03.754 INFO:tasks.workunit.client.0.smithi123.stderr:.: ceph.dir.layout.pool: No such attribute 2024-08-18T22:16:03.754 INFO:tasks.workunit.client.0.smithi123.stderr:+ datapool= 2024-08-18T22:16:03.754 INFO:tasks.workunit.client.0.smithi123.stderr:+ dir=./.. 2024-08-18T22:16:03.755 INFO:tasks.workunit.client.0.smithi123.stdout:./.. 2024-08-18T22:16:03.755 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2024-08-18T22:16:03.755 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo ./.. 2024-08-18T22:16:03.755 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfattr -n ceph.dir.layout.pool ./.. --only-values 2024-08-18T22:16:03.756 INFO:tasks.workunit.client.0.smithi123.stderr:./..: ceph.dir.layout.pool: No such attribute 2024-08-18T22:16:03.756 INFO:tasks.workunit.client.0.smithi123.stderr:+ datapool= 2024-08-18T22:16:03.756 INFO:tasks.workunit.client.0.smithi123.stderr:+ dir=./../.. 2024-08-18T22:16:03.756 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2024-08-18T22:16:03.756 INFO:tasks.workunit.client.0.smithi123.stdout:./../.. 2024-08-18T22:16:03.757 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo ./../.. 2024-08-18T22:16:03.757 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfattr -n ceph.dir.layout.pool ./../.. --only-values 2024-08-18T22:16:03.757 INFO:tasks.workunit.client.0.smithi123.stderr:+ datapool=cephfs_data_ec 2024-08-18T22:16:03.757 INFO:tasks.workunit.client.0.smithi123.stderr:+ break 2024-08-18T22:16:03.757 INFO:tasks.workunit.client.0.smithi123.stderr:+ rm -f file file2 2024-08-18T22:16:03.757 INFO:tasks.workunit.client.0.smithi123.stderr:+ touch file file2 2024-08-18T22:16:03.759 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout file 2024-08-18T22:16:03.760 INFO:tasks.workunit.client.0.smithi123.stdout:# file: file 2024-08-18T22:16:03.760 INFO:tasks.workunit.client.0.smithi123.stdout:ceph.file.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-08-18T22:16:03.761 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-08-18T22:16:03.761 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout file 2024-08-18T22:16:03.761 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q object_size= 2024-08-18T22:16:03.762 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout file 2024-08-18T22:16:03.762 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q stripe_count= 2024-08-18T22:16:03.764 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout file 2024-08-18T22:16:03.764 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q stripe_unit= 2024-08-18T22:16:03.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:03 smithi130 ceph-mon[21698]: pgmap v588: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 26 op/s 2024-08-18T22:16:03.765 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout file 2024-08-18T22:16:03.765 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q pool= 2024-08-18T22:16:03.766 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.pool file 2024-08-18T22:16:03.767 INFO:tasks.workunit.client.0.smithi123.stdout:# file: file 2024-08-18T22:16:03.768 INFO:tasks.workunit.client.0.smithi123.stdout:ceph.file.layout.pool="cephfs_data_ec" 2024-08-18T22:16:03.768 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-08-18T22:16:03.768 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.pool_namespace file 2024-08-18T22:16:03.769 INFO:tasks.workunit.client.0.smithi123.stdout:# file: file 2024-08-18T22:16:03.769 INFO:tasks.workunit.client.0.smithi123.stdout:ceph.file.layout.pool_namespace="" 2024-08-18T22:16:03.769 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-08-18T22:16:03.769 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.stripe_unit file 2024-08-18T22:16:03.771 INFO:tasks.workunit.client.0.smithi123.stdout:# file: file 2024-08-18T22:16:03.771 INFO:tasks.workunit.client.0.smithi123.stdout:ceph.file.layout.stripe_unit="4194304" 2024-08-18T22:16:03.771 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-08-18T22:16:03.771 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.stripe_count file 2024-08-18T22:16:03.772 INFO:tasks.workunit.client.0.smithi123.stdout:# file: file 2024-08-18T22:16:03.772 INFO:tasks.workunit.client.0.smithi123.stdout:ceph.file.layout.stripe_count="1" 2024-08-18T22:16:03.772 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-08-18T22:16:03.772 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.object_size file 2024-08-18T22:16:03.773 INFO:tasks.workunit.client.0.smithi123.stdout:# file: file 2024-08-18T22:16:03.773 INFO:tasks.workunit.client.0.smithi123.stdout:ceph.file.layout.object_size="4194304" 2024-08-18T22:16:03.773 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-08-18T22:16:03.774 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.bogus file 2024-08-18T22:16:03.774 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 'No such attribute' 2024-08-18T22:16:03.775 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.dir.layout file 2024-08-18T22:16:03.775 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 'No such attribute' 2024-08-18T22:16:03.776 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n ceph.file.layout.stripe_unit -v 1048576 file2 2024-08-18T22:16:03.782 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n ceph.file.layout.stripe_count -v 8 file2 2024-08-18T22:16:03.785 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n ceph.file.layout.object_size -v 10485760 file2 2024-08-18T22:16:03.790 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n ceph.file.layout.pool -v cephfs_data_ec file2 2024-08-18T22:16:03.795 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.pool file2 2024-08-18T22:16:03.796 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q cephfs_data_ec 2024-08-18T22:16:03.797 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n ceph.file.layout.pool_namespace -v foons file2 2024-08-18T22:16:03.800 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2024-08-18T22:16:03.800 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q foons 2024-08-18T22:16:03.801 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -x ceph.file.layout.pool_namespace file2 2024-08-18T22:16:03.805 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2024-08-18T22:16:03.805 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q -v foons 2024-08-18T22:16:03.806 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2024-08-18T22:16:03.806 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 1048576 2024-08-18T22:16:03.808 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-08-18T22:16:03.808 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 8 2024-08-18T22:16:03.809 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.object_size file2 2024-08-18T22:16:03.809 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 10485760 2024-08-18T22:16:03.879 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n ceph.file.layout -v 'stripe_unit=4194304 stripe_count=16 object_size=41943040 pool=cephfs_data_ec pool_namespace=foons' file2 2024-08-18T22:16:03.879 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2024-08-18T22:16:03.879 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 4194304 2024-08-18T22:16:03.879 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-08-18T22:16:03.879 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 16 2024-08-18T22:16:03.879 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.object_size file2 2024-08-18T22:16:03.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 41943040 2024-08-18T22:16:03.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.pool file2 2024-08-18T22:16:03.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q cephfs_data_ec 2024-08-18T22:16:03.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2024-08-18T22:16:03.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q foons 2024-08-18T22:16:03.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n ceph.file.layout -v stripe_unit=1048576 file2 2024-08-18T22:16:03.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2024-08-18T22:16:03.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 1048576 2024-08-18T22:16:03.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-08-18T22:16:03.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 16 2024-08-18T22:16:03.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.object_size file2 2024-08-18T22:16:03.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 41943040 2024-08-18T22:16:03.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.pool file2 2024-08-18T22:16:03.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q cephfs_data_ec 2024-08-18T22:16:03.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2024-08-18T22:16:03.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q foons 2024-08-18T22:16:03.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n ceph.file.layout -v 'stripe_unit=2097152 stripe_count=4 object_size=2097152 pool=cephfs_data_ec pool_namespace=barns' file2 2024-08-18T22:16:03.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2024-08-18T22:16:03.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 2097152 2024-08-18T22:16:03.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-08-18T22:16:03.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 4 2024-08-18T22:16:03.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.object_size file2 2024-08-18T22:16:03.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 2097152 2024-08-18T22:16:03.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.pool file2 2024-08-18T22:16:03.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q cephfs_data_ec 2024-08-18T22:16:03.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2024-08-18T22:16:03.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q barns 2024-08-18T22:16:03.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ rm -f dir/file 2024-08-18T22:16:03.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir dir 2024-08-18T22:16:03.882 INFO:tasks.workunit.client.0.smithi123.stderr:rmdir: failed to remove 'dir': No such file or directory 2024-08-18T22:16:03.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2024-08-18T22:16:03.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir -p dir 2024-08-18T22:16:03.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -d -m - dir 2024-08-18T22:16:03.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q ceph.dir.layout 2024-08-18T22:16:03.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2024-08-18T22:16:03.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -d -m - dir 2024-08-18T22:16:03.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q ceph.file.layout 2024-08-18T22:16:03.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2024-08-18T22:16:03.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-18T22:16:03.882 INFO:tasks.workunit.client.0.smithi123.stderr:dir: ceph.dir.layout: No such attribute 2024-08-18T22:16:03.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2024-08-18T22:16:03.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n ceph.dir.layout.stripe_unit -v 1048576 dir 2024-08-18T22:16:03.883 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n ceph.dir.layout.stripe_count -v 8 dir 2024-08-18T22:16:03.883 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n ceph.dir.layout.object_size -v 10485760 dir 2024-08-18T22:16:03.883 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n ceph.dir.layout.pool -v cephfs_data_ec dir 2024-08-18T22:16:03.883 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n ceph.dir.layout.pool_namespace -v dirns dir 2024-08-18T22:16:03.883 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-18T22:16:03.883 INFO:tasks.workunit.client.0.smithi123.stdout:# file: dir 2024-08-18T22:16:03.883 INFO:tasks.workunit.client.0.smithi123.stdout:ceph.dir.layout="stripe_unit=1048576 stripe_count=8 object_size=10485760 pool=cephfs_data_ec pool_namespace=dirns" 2024-08-18T22:16:03.884 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-08-18T22:16:03.886 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-18T22:16:03.886 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q object_size=10485760 2024-08-18T22:16:03.886 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-18T22:16:03.886 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q stripe_count=8 2024-08-18T22:16:03.886 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-18T22:16:03.886 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q stripe_unit=1048576 2024-08-18T22:16:03.886 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-18T22:16:03.886 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q pool=cephfs_data_ec 2024-08-18T22:16:03.886 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-18T22:16:03.886 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q pool_namespace=dirns 2024-08-18T22:16:03.886 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.dir.layout.pool dir 2024-08-18T22:16:03.887 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q cephfs_data_ec 2024-08-18T22:16:03.887 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.dir.layout.stripe_unit dir 2024-08-18T22:16:03.887 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 1048576 2024-08-18T22:16:03.887 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.dir.layout.stripe_count dir 2024-08-18T22:16:03.887 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 8 2024-08-18T22:16:03.887 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.dir.layout.object_size dir 2024-08-18T22:16:03.887 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 10485760 2024-08-18T22:16:03.887 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.dir.layout.pool_namespace dir 2024-08-18T22:16:03.887 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q dirns 2024-08-18T22:16:03.887 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n ceph.file.layout -v stripe_count=16 file2 2024-08-18T22:16:03.888 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-08-18T22:16:03.888 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 16 2024-08-18T22:16:03.890 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n ceph.file.layout -v 'object_size=10485760 stripe_count=8 stripe_unit=1048576 pool=cephfs_data_ec pool_namespace=dirns' file2 2024-08-18T22:16:03.893 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-08-18T22:16:03.893 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 8 2024-08-18T22:16:03.894 INFO:tasks.workunit.client.0.smithi123.stderr:+ touch dir/file 2024-08-18T22:16:03.896 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.pool dir/file 2024-08-18T22:16:03.897 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q cephfs_data_ec 2024-08-18T22:16:03.898 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.stripe_unit dir/file 2024-08-18T22:16:03.898 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 1048576 2024-08-18T22:16:03.899 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.stripe_count dir/file 2024-08-18T22:16:03.899 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 8 2024-08-18T22:16:03.901 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.object_size dir/file 2024-08-18T22:16:03.901 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 10485760 2024-08-18T22:16:03.903 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.file.layout.pool_namespace dir/file 2024-08-18T22:16:03.903 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q dirns 2024-08-18T22:16:03.904 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -x ceph.dir.layout.pool_namespace dir 2024-08-18T22:16:03.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:03 smithi183 ceph-mon[22097]: pgmap v588: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 26 op/s 2024-08-18T22:16:03.910 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-18T22:16:03.910 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q -v pool_namespace=dirns 2024-08-18T22:16:03.911 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -x ceph.dir.layout dir 2024-08-18T22:16:03.914 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-18T22:16:03.914 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q 'No such attribute' 2024-08-18T22:16:03.915 INFO:tasks.workunit.client.0.smithi123.stdout:OK 2024-08-18T22:16:03.916 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo OK 2024-08-18T22:16:03.916 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-18T22:16:03.917 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-18T22:16:04.002 INFO:tasks.workunit:Running workunit fs/misc/mkpool_layout_vxattrs.sh... 2024-08-18T22:16:04.002 DEBUG:teuthology.orchestra.run.smithi123:workunit test fs/misc/mkpool_layout_vxattrs.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/mkpool_layout_vxattrs.sh 2024-08-18T22:16:05.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:05 smithi123 ceph-mon[18462]: pgmap v589: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.2 KiB/s wr, 19 op/s 2024-08-18T22:16:05.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:05 smithi130 ceph-mon[21698]: pgmap v589: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.2 KiB/s wr, 19 op/s 2024-08-18T22:16:05.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:05 smithi183 ceph-mon[22097]: pgmap v589: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.2 KiB/s wr, 19 op/s 2024-08-18T22:16:07.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:07 smithi123 ceph-mon[18462]: pgmap v590: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-08-18T22:16:07.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:07 smithi130 ceph-mon[21698]: pgmap v590: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-08-18T22:16:07.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:07 smithi183 ceph-mon[22097]: pgmap v590: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-08-18T22:16:08.510 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.507+0000 7facb06b5640 1 -- 172.21.15.123:0/1689817272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca8102320 msgr2=0x7faca8108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:08.510 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.507+0000 7facb06b5640 1 --2- 172.21.15.123:0/1689817272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca8102320 0x7faca8108bb0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7faca0009ca0 tx=0x7faca002a8c0 comp rx=0 tx=0).stop 2024-08-18T22:16:08.510 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.507+0000 7facb06b5640 1 -- 172.21.15.123:0/1689817272 shutdown_connections 2024-08-18T22:16:08.510 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.507+0000 7facb06b5640 1 --2- 172.21.15.123:0/1689817272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca8102320 0x7faca8108bb0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:08.511 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.507+0000 7facb06b5640 1 --2- 172.21.15.123:0/1689817272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faca8101960 0x7faca8101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:08.511 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.507+0000 7facb06b5640 1 --2- 172.21.15.123:0/1689817272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faca8100770 0x7faca8100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:08.511 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.507+0000 7facb06b5640 1 -- 172.21.15.123:0/1689817272 >> 172.21.15.123:0/1689817272 conn(0x7faca80fbf10 msgr2=0x7faca80fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:08.511 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.507+0000 7facb06b5640 1 -- 172.21.15.123:0/1689817272 shutdown_connections 2024-08-18T22:16:08.511 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.507+0000 7facb06b5640 1 -- 172.21.15.123:0/1689817272 wait complete. 2024-08-18T22:16:08.511 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.507+0000 7facb06b5640 1 Processor -- start 2024-08-18T22:16:08.511 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.507+0000 7facb06b5640 1 -- start start 2024-08-18T22:16:08.511 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facb06b5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faca8100770 0x7faca81048a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:08.511 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facb06b5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca8101960 0x7faca8102ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:08.511 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facb06b5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faca8102320 0x7faca8103420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:08.511 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facb06b5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faca810c3d0 con 0x7faca8101960 2024-08-18T22:16:08.511 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facb06b5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faca810c250 con 0x7faca8102320 2024-08-18T22:16:08.511 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facb06b5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faca810c550 con 0x7faca8100770 2024-08-18T22:16:08.512 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facadc50640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca8101960 0x7faca8102ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:08.512 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facadc50640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca8101960 0x7faca8102ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34962/0 (socket says 172.21.15.123:34962) 2024-08-18T22:16:08.512 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facadc50640 1 -- 172.21.15.123:0/3021801037 learned_addr learned my addr 172.21.15.123:0/3021801037 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:08.512 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facae451640 1 --2- 172.21.15.123:0/3021801037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faca8100770 0x7faca81048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:08.512 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facaec52640 1 --2- 172.21.15.123:0/3021801037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faca8102320 0x7faca8103420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:08.512 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facadc50640 1 -- 172.21.15.123:0/3021801037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faca8100770 msgr2=0x7faca81048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:08.512 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facadc50640 1 --2- 172.21.15.123:0/3021801037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faca8100770 0x7faca81048a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:08.512 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facadc50640 1 -- 172.21.15.123:0/3021801037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faca8102320 msgr2=0x7faca8103420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:08.512 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facadc50640 1 --2- 172.21.15.123:0/3021801037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faca8102320 0x7faca8103420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:08.512 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facadc50640 1 -- 172.21.15.123:0/3021801037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca8103cb0 con 0x7faca8101960 2024-08-18T22:16:08.512 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facaec52640 1 --2- 172.21.15.123:0/3021801037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faca8102320 0x7faca8103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:16:08.512 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facadc50640 1 --2- 172.21.15.123:0/3021801037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca8101960 0x7faca8102ee0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fac9800c890 tx=0x7fac9800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:08.512 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7fac9f7fe640 1 -- 172.21.15.123:0/3021801037 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac98004220 con 0x7faca8101960 2024-08-18T22:16:08.512 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7fac9f7fe640 1 -- 172.21.15.123:0/3021801037 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac980043c0 con 0x7faca8101960 2024-08-18T22:16:08.513 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7facb06b5640 1 -- 172.21.15.123:0/3021801037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca81a1c70 con 0x7faca8101960 2024-08-18T22:16:08.513 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.508+0000 7fac9f7fe640 1 -- 172.21.15.123:0/3021801037 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac980049e0 con 0x7faca8101960 2024-08-18T22:16:08.513 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.509+0000 7facb06b5640 1 -- 172.21.15.123:0/3021801037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca81a21c0 con 0x7faca8101960 2024-08-18T22:16:08.513 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.511+0000 7fac9f7fe640 1 -- 172.21.15.123:0/3021801037 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fac980079b0 con 0x7faca8101960 2024-08-18T22:16:08.513 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.511+0000 7fac9f7fe640 1 --2- 172.21.15.123:0/3021801037 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac940a2b90 0x7fac940a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:08.514 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.511+0000 7facae451640 1 --2- 172.21.15.123:0/3021801037 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac940a2b90 0x7fac940a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:08.514 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.511+0000 7fac9f7fe640 1 -- 172.21.15.123:0/3021801037 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fac980cf4c0 con 0x7faca8101960 2024-08-18T22:16:08.522 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.509+0000 7facb06b5640 1 -- 172.21.15.123:0/3021801037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca81a23f0 con 0x7faca8101960 2024-08-18T22:16:08.523 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.522+0000 7facae451640 1 --2- 172.21.15.123:0/3021801037 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac940a2b90 0x7fac940a5050 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faca81017c0 tx=0x7faca400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:08.528 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.527+0000 7fac9f7fe640 1 -- 172.21.15.123:0/3021801037 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fac98014030 con 0x7faca8101960 2024-08-18T22:16:08.695 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:08.694+0000 7facb06b5640 1 -- 172.21.15.123:0/3021801037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "foo.185348", "pg_num": 8} v 0) -- 0x7faca81a2780 con 0x7faca8101960 2024-08-18T22:16:09.473 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.472+0000 7fac9f7fe640 1 -- 172.21.15.123:0/3021801037 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "foo.185348", "pg_num": 8}]=0 pool 'foo.185348' created v93) ==== 123+0+0 (secure 0 0 0) 0x7fac9809c090 con 0x7faca8101960 2024-08-18T22:16:09.578 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.577+0000 7facb06b5640 1 -- 172.21.15.123:0/3021801037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "foo.185348", "pg_num": 8} v 0) -- 0x7faca8062570 con 0x7faca8101960 2024-08-18T22:16:09.579 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.577+0000 7fac9f7fe640 1 -- 172.21.15.123:0/3021801037 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "foo.185348", "pg_num": 8}]=0 pool 'foo.185348' already exists v93) ==== 130+0+0 (secure 0 0 0) 0x7fac9809b990 con 0x7faca8101960 2024-08-18T22:16:09.579 INFO:tasks.workunit.client.0.smithi123.stderr:pool 'foo.185348' already exists 2024-08-18T22:16:09.580 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.579+0000 7facb06b5640 1 -- 172.21.15.123:0/3021801037 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac940a2b90 msgr2=0x7fac940a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:09.580 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.579+0000 7facb06b5640 1 --2- 172.21.15.123:0/3021801037 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac940a2b90 0x7fac940a5050 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faca81017c0 tx=0x7faca400a2d0 comp rx=0 tx=0).stop 2024-08-18T22:16:09.581 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.579+0000 7facb06b5640 1 -- 172.21.15.123:0/3021801037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca8101960 msgr2=0x7faca8102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:09.581 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.579+0000 7facb06b5640 1 --2- 172.21.15.123:0/3021801037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca8101960 0x7faca8102ee0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fac9800c890 tx=0x7fac9800cd50 comp rx=0 tx=0).stop 2024-08-18T22:16:09.581 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.579+0000 7facb06b5640 1 -- 172.21.15.123:0/3021801037 shutdown_connections 2024-08-18T22:16:09.581 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.579+0000 7facb06b5640 1 --2- 172.21.15.123:0/3021801037 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fac940a2b90 0x7fac940a5050 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:09.581 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.579+0000 7facb06b5640 1 --2- 172.21.15.123:0/3021801037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faca8102320 0x7faca8103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:09.581 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.579+0000 7facb06b5640 1 --2- 172.21.15.123:0/3021801037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca8101960 0x7faca8102ee0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:09.581 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.579+0000 7facb06b5640 1 --2- 172.21.15.123:0/3021801037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faca8100770 0x7faca81048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:09.581 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.579+0000 7facb06b5640 1 -- 172.21.15.123:0/3021801037 >> 172.21.15.123:0/3021801037 conn(0x7faca80fbf10 msgr2=0x7faca8069280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:09.581 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.579+0000 7facb06b5640 1 -- 172.21.15.123:0/3021801037 shutdown_connections 2024-08-18T22:16:09.581 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.579+0000 7facb06b5640 1 -- 172.21.15.123:0/3021801037 wait complete. 2024-08-18T22:16:09.673 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.668+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/3864654431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e94101960 msgr2=0x7f4e94101de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:09.673 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.668+0000 7f4e9c7bf640 1 --2- 172.21.15.123:0/3864654431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e94101960 0x7f4e94101de0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009900 tx=0x7f4e8402a410 comp rx=0 tx=0).stop 2024-08-18T22:16:09.673 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/3864654431 shutdown_connections 2024-08-18T22:16:09.673 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9c7bf640 1 --2- 172.21.15.123:0/3864654431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e94102320 0x7f4e94108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:09.673 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9c7bf640 1 --2- 172.21.15.123:0/3864654431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e94101960 0x7f4e94101de0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:09.673 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9c7bf640 1 --2- 172.21.15.123:0/3864654431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94100770 0x7f4e94100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:09.673 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/3864654431 >> 172.21.15.123:0/3864654431 conn(0x7f4e940fbf10 msgr2=0x7f4e940fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:09.674 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/3864654431 shutdown_connections 2024-08-18T22:16:09.674 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/3864654431 wait complete. 2024-08-18T22:16:09.674 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9c7bf640 1 Processor -- start 2024-08-18T22:16:09.674 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9c7bf640 1 -- start start 2024-08-18T22:16:09.674 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9c7bf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94100770 0x7f4e94069df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:09.674 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9c7bf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e94101960 0x7f4e9419ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:09.674 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9c7bf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e94102320 0x7f4e9419f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:09.674 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9c7bf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9410c4f0 con 0x7f4e94102320 2024-08-18T22:16:09.674 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9c7bf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9410c370 con 0x7f4e94101960 2024-08-18T22:16:09.674 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9c7bf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9410c670 con 0x7f4e94100770 2024-08-18T22:16:09.674 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9ad5c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e94102320 0x7f4e9419f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:09.675 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.669+0000 7f4e9ad5c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e94102320 0x7f4e9419f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34974/0 (socket says 172.21.15.123:34974) 2024-08-18T22:16:09.675 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.670+0000 7f4e9ad5c640 1 -- 172.21.15.123:0/2569591466 learned_addr learned my addr 172.21.15.123:0/2569591466 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:09.675 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.670+0000 7f4e9a55b640 1 --2- 172.21.15.123:0/2569591466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94100770 0x7f4e94069df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:09.675 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.670+0000 7f4e9ad5c640 1 -- 172.21.15.123:0/2569591466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94100770 msgr2=0x7f4e94069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:09.675 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.670+0000 7f4e9ad5c640 1 --2- 172.21.15.123:0/2569591466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94100770 0x7f4e94069df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:09.675 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.670+0000 7f4e9ad5c640 1 -- 172.21.15.123:0/2569591466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e94101960 msgr2=0x7f4e9419ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:09.675 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.670+0000 7f4e9ad5c640 1 --2- 172.21.15.123:0/2569591466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e94101960 0x7f4e9419ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:09.675 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.670+0000 7f4e9ad5c640 1 -- 172.21.15.123:0/2569591466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9419f9b0 con 0x7f4e94102320 2024-08-18T22:16:09.675 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.670+0000 7f4e9ad5c640 1 --2- 172.21.15.123:0/2569591466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e94102320 0x7f4e9419f0a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00b970 tx=0x7f4e8c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:09.675 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.670+0000 7f4e8b7fe640 1 -- 172.21.15.123:0/2569591466 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c019070 con 0x7f4e94102320 2024-08-18T22:16:09.675 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.670+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/2569591466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e9419fc40 con 0x7f4e94102320 2024-08-18T22:16:09.675 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.670+0000 7f4e8b7fe640 1 -- 172.21.15.123:0/2569591466 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e8c00cb40 con 0x7f4e94102320 2024-08-18T22:16:09.675 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.670+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/2569591466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e941a0210 con 0x7f4e94102320 2024-08-18T22:16:09.676 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.670+0000 7f4e8b7fe640 1 -- 172.21.15.123:0/2569591466 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c007670 con 0x7f4e94102320 2024-08-18T22:16:09.676 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.671+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/2569591466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e94107c50 con 0x7f4e94102320 2024-08-18T22:16:09.676 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.673+0000 7f4e8b7fe640 1 -- 172.21.15.123:0/2569591466 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f4e8c01c070 con 0x7f4e94102320 2024-08-18T22:16:09.676 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.674+0000 7f4e8b7fe640 1 --2- 172.21.15.123:0/2569591466 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4e800a2b90 0x7f4e800a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:09.677 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.674+0000 7f4e9a55b640 1 --2- 172.21.15.123:0/2569591466 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4e800a2b90 0x7f4e800a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:09.677 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.674+0000 7f4e8b7fe640 1 -- 172.21.15.123:0/2569591466 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9499+0+0 (secure 0 0 0) 0x7f4e8c0cefe0 con 0x7f4e94102320 2024-08-18T22:16:09.677 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.674+0000 7f4e9a55b640 1 --2- 172.21.15.123:0/2569591466 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4e800a2b90 0x7f4e800a5050 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4e941017c0 tx=0x7f4e90008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:09.678 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.677+0000 7f4e8b7fe640 1 -- 172.21.15.123:0/2569591466 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4e8c09ba50 con 0x7f4e94102320 2024-08-18T22:16:09.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:09 smithi123 ceph-mon[18462]: pgmap v591: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 14 op/s 2024-08-18T22:16:09.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:09 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3021801037' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo.185348", "pg_num": 8}]: dispatch 2024-08-18T22:16:09.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:09 smithi130 ceph-mon[21698]: pgmap v591: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 14 op/s 2024-08-18T22:16:09.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:09 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3021801037' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo.185348", "pg_num": 8}]: dispatch 2024-08-18T22:16:09.881 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:09.880+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/2569591466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.185348"} v 0) -- 0x7f4e9402d7a0 con 0x7f4e94102320 2024-08-18T22:16:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:09 smithi183 ceph-mon[22097]: pgmap v591: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 14 op/s 2024-08-18T22:16:09.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:09 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3021801037' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo.185348", "pg_num": 8}]: dispatch 2024-08-18T22:16:10.481 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.480+0000 7f4e8b7fe640 1 -- 172.21.15.123:0/2569591466 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]=0 added data pool 5 to fsmap v33) ==== 133+0+0 (secure 0 0 0) 0x7f4e8c09b350 con 0x7f4e94102320 2024-08-18T22:16:10.617 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.616+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/2569591466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.185348"} v 0) -- 0x7f4e9402cc20 con 0x7f4e94102320 2024-08-18T22:16:10.618 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.617+0000 7f4e8b7fe640 1 -- 172.21.15.123:0/2569591466 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]=-22 RADOS pool 'foo.185348' is already used by filesystem 'cephfs' as a 'data' pool for application 'cephfs' v33) ==== 211+0+0 (secure 0 0 0) 0x7f4e8c09f700 con 0x7f4e94102320 2024-08-18T22:16:10.618 INFO:tasks.workunit.client.0.smithi123.stderr:Second attempt of previously successful command failed with EINVAL: RADOS pool 'foo.185348' is already used by filesystem 'cephfs' as a 'data' pool for application 'cephfs' 2024-08-18T22:16:10.618 INFO:tasks.workunit.client.0.smithi123.stderr:RADOS pool 'foo.185348' is already used by filesystem 'cephfs' as a 'data' pool for application 'cephfs' 2024-08-18T22:16:10.620 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.619+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/2569591466 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4e800a2b90 msgr2=0x7f4e800a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:10.620 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.619+0000 7f4e9c7bf640 1 --2- 172.21.15.123:0/2569591466 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4e800a2b90 0x7f4e800a5050 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4e941017c0 tx=0x7f4e90008040 comp rx=0 tx=0).stop 2024-08-18T22:16:10.620 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.619+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/2569591466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e94102320 msgr2=0x7f4e9419f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:10.620 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.619+0000 7f4e9c7bf640 1 --2- 172.21.15.123:0/2569591466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e94102320 0x7f4e9419f0a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00b970 tx=0x7f4e8c00be30 comp rx=0 tx=0).stop 2024-08-18T22:16:10.620 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.619+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/2569591466 shutdown_connections 2024-08-18T22:16:10.620 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.619+0000 7f4e9c7bf640 1 --2- 172.21.15.123:0/2569591466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e94102320 0x7f4e9419f0a0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:10.621 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.619+0000 7f4e9c7bf640 1 --2- 172.21.15.123:0/2569591466 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4e800a2b90 0x7f4e800a5050 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:10.621 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.619+0000 7f4e9c7bf640 1 --2- 172.21.15.123:0/2569591466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e94101960 0x7f4e9419ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:10.621 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.619+0000 7f4e9c7bf640 1 --2- 172.21.15.123:0/2569591466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94100770 0x7f4e94069df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:10.621 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.619+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/2569591466 >> 172.21.15.123:0/2569591466 conn(0x7f4e940fbf10 msgr2=0x7f4e94104e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:10.621 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.619+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/2569591466 shutdown_connections 2024-08-18T22:16:10.621 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.619+0000 7f4e9c7bf640 1 -- 172.21.15.123:0/2569591466 wait complete. 2024-08-18T22:16:10.725 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.722+0000 7fb521744640 1 -- 172.21.15.123:0/4134762121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb51c101890 msgr2=0x7fb51c101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:10.726 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.722+0000 7fb521744640 1 --2- 172.21.15.123:0/4134762121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb51c101890 0x7fb51c101c90 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb50c009900 tx=0x7fb50c02a410 comp rx=0 tx=0).stop 2024-08-18T22:16:10.726 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.722+0000 7fb521744640 1 -- 172.21.15.123:0/4134762121 shutdown_connections 2024-08-18T22:16:10.726 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.722+0000 7fb521744640 1 --2- 172.21.15.123:0/4134762121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51c103440 0x7fb51c109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:10.726 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.722+0000 7fb521744640 1 --2- 172.21.15.123:0/4134762121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb51c102a80 0x7fb51c102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:10.726 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.722+0000 7fb521744640 1 --2- 172.21.15.123:0/4134762121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb51c101890 0x7fb51c101c90 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:10.726 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.722+0000 7fb521744640 1 -- 172.21.15.123:0/4134762121 >> 172.21.15.123:0/4134762121 conn(0x7fb51c0fcfd0 msgr2=0x7fb51c0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:10.726 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.722+0000 7fb521744640 1 -- 172.21.15.123:0/4134762121 shutdown_connections 2024-08-18T22:16:10.726 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.722+0000 7fb521744640 1 -- 172.21.15.123:0/4134762121 wait complete. 2024-08-18T22:16:10.726 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb521744640 1 Processor -- start 2024-08-18T22:16:10.726 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb521744640 1 -- start start 2024-08-18T22:16:10.726 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb521744640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51c101890 0x7fb51c197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:10.727 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb521744640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb51c102a80 0x7fb51c1980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:10.727 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb521744640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb51c103440 0x7fb51c19f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:10.727 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb521744640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c10d4f0 con 0x7fb51c102a80 2024-08-18T22:16:10.727 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb521744640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c10d370 con 0x7fb51c101890 2024-08-18T22:16:10.727 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb521744640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c10d670 con 0x7fb51c103440 2024-08-18T22:16:10.727 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb513fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb51c102a80 0x7fb51c1980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:10.727 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb513fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb51c102a80 0x7fb51c1980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34984/0 (socket says 172.21.15.123:34984) 2024-08-18T22:16:10.727 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb513fff640 1 -- 172.21.15.123:0/700864407 learned_addr learned my addr 172.21.15.123:0/700864407 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:10.727 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb51b7fe640 1 --2- 172.21.15.123:0/700864407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb51c103440 0x7fb51c19f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:10.727 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb513fff640 1 -- 172.21.15.123:0/700864407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb51c103440 msgr2=0x7fb51c19f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:10.727 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb513fff640 1 --2- 172.21.15.123:0/700864407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb51c103440 0x7fb51c19f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:10.727 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb51affd640 1 --2- 172.21.15.123:0/700864407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51c101890 0x7fb51c197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:10.727 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb513fff640 1 -- 172.21.15.123:0/700864407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51c101890 msgr2=0x7fb51c197b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:10.727 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb513fff640 1 --2- 172.21.15.123:0/700864407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51c101890 0x7fb51c197b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:10.728 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb513fff640 1 -- 172.21.15.123:0/700864407 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c19f790 con 0x7fb51c102a80 2024-08-18T22:16:10.728 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.723+0000 7fb51affd640 1 --2- 172.21.15.123:0/700864407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51c101890 0x7fb51c197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:16:10.728 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.724+0000 7fb513fff640 1 --2- 172.21.15.123:0/700864407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb51c102a80 0x7fb51c1980b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb50400c920 tx=0x7fb50400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:10.728 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.724+0000 7fb518ff9640 1 -- 172.21.15.123:0/700864407 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504007c70 con 0x7fb51c102a80 2024-08-18T22:16:10.728 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.724+0000 7fb518ff9640 1 -- 172.21.15.123:0/700864407 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb504007e10 con 0x7fb51c102a80 2024-08-18T22:16:10.728 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.724+0000 7fb521744640 1 -- 172.21.15.123:0/700864407 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51c19fa80 con 0x7fb51c102a80 2024-08-18T22:16:10.728 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.724+0000 7fb518ff9640 1 -- 172.21.15.123:0/700864407 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504018890 con 0x7fb51c102a80 2024-08-18T22:16:10.728 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.724+0000 7fb521744640 1 -- 172.21.15.123:0/700864407 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb51c19ffd0 con 0x7fb51c102a80 2024-08-18T22:16:10.729 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.725+0000 7fb521744640 1 -- 172.21.15.123:0/700864407 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb51c108c80 con 0x7fb51c102a80 2024-08-18T22:16:10.729 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.726+0000 7fb518ff9640 1 -- 172.21.15.123:0/700864407 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fb504018a70 con 0x7fb51c102a80 2024-08-18T22:16:10.729 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.727+0000 7fb518ff9640 1 --2- 172.21.15.123:0/700864407 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb5080a2b90 0x7fb5080a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:10.729 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.727+0000 7fb51affd640 1 --2- 172.21.15.123:0/700864407 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb5080a2b90 0x7fb5080a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:10.729 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.727+0000 7fb518ff9640 1 -- 172.21.15.123:0/700864407 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9531+0+0 (secure 0 0 0) 0x7fb5040cf750 con 0x7fb51c102a80 2024-08-18T22:16:10.730 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.727+0000 7fb51affd640 1 --2- 172.21.15.123:0/700864407 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb5080a2b90 0x7fb5080a5050 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb50c000c00 tx=0x7fb50c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:10.732 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.731+0000 7fb518ff9640 1 -- 172.21.15.123:0/700864407 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb504014030 con 0x7fb51c102a80 2024-08-18T22:16:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:10 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3021801037' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo.185348", "pg_num": 8}]': finished 2024-08-18T22:16:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:10 smithi123 ceph-mon[18462]: osdmap e93: 12 total, 12 up, 12 in 2024-08-18T22:16:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:10 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3021801037' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo.185348", "pg_num": 8}]: dispatch 2024-08-18T22:16:10.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:10 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2569591466' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]: dispatch 2024-08-18T22:16:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:10 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3021801037' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo.185348", "pg_num": 8}]': finished 2024-08-18T22:16:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:10 smithi130 ceph-mon[21698]: osdmap e93: 12 total, 12 up, 12 in 2024-08-18T22:16:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:10 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3021801037' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo.185348", "pg_num": 8}]: dispatch 2024-08-18T22:16:10.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:10 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2569591466' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]: dispatch 2024-08-18T22:16:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:10 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3021801037' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo.185348", "pg_num": 8}]': finished 2024-08-18T22:16:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:10 smithi183 ceph-mon[22097]: osdmap e93: 12 total, 12 up, 12 in 2024-08-18T22:16:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:10 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3021801037' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo.185348", "pg_num": 8}]: dispatch 2024-08-18T22:16:10.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:10 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2569591466' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]: dispatch 2024-08-18T22:16:10.935 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:10.934+0000 7fb521744640 1 -- 172.21.15.123:0/700864407 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"} v 0) -- 0x7fb51c062b20 con 0x7fb51c102a80 2024-08-18T22:16:11.491 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:11.490+0000 7fb518ff9640 1 -- 172.21.15.123:0/700864407 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]=0 removed data pool 5 from fsmap v34) ==== 136+0+0 (secure 0 0 0) 0x7fb50400de20 con 0x7fb51c102a80 2024-08-18T22:16:11.632 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:11.631+0000 7fb521744640 1 -- 172.21.15.123:0/700864407 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"} v 0) -- 0x7fb51c02d8d0 con 0x7fb51c102a80 2024-08-18T22:16:11.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:11 smithi123 ceph-mon[18462]: pgmap v593: 137 pgs: 8 unknown, 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 15 op/s 2024-08-18T22:16:11.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:11 smithi123 ceph-mon[18462]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-18T22:16:11.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:11 smithi123 ceph-mon[18462]: osdmap e94: 12 total, 12 up, 12 in 2024-08-18T22:16:11.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:11 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2569591466' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]': finished 2024-08-18T22:16:11.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:11 smithi123 ceph-mon[18462]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:16:11.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:11 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2569591466' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]: dispatch 2024-08-18T22:16:11.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:11 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/700864407' entity='client.admin' cmd=[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]: dispatch 2024-08-18T22:16:11.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:11 smithi130 ceph-mon[21698]: pgmap v593: 137 pgs: 8 unknown, 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 15 op/s 2024-08-18T22:16:11.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:11 smithi130 ceph-mon[21698]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-18T22:16:11.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:11 smithi130 ceph-mon[21698]: osdmap e94: 12 total, 12 up, 12 in 2024-08-18T22:16:11.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:11 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2569591466' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]': finished 2024-08-18T22:16:11.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:11 smithi130 ceph-mon[21698]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:16:11.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:11 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2569591466' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]: dispatch 2024-08-18T22:16:11.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:11 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/700864407' entity='client.admin' cmd=[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]: dispatch 2024-08-18T22:16:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:11 smithi183 ceph-mon[22097]: pgmap v593: 137 pgs: 8 unknown, 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 15 op/s 2024-08-18T22:16:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:11 smithi183 ceph-mon[22097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-18T22:16:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:11 smithi183 ceph-mon[22097]: osdmap e94: 12 total, 12 up, 12 in 2024-08-18T22:16:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:11 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2569591466' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]': finished 2024-08-18T22:16:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:11 smithi183 ceph-mon[22097]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:16:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:11 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2569591466' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]: dispatch 2024-08-18T22:16:11.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:11 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/700864407' entity='client.admin' cmd=[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]: dispatch 2024-08-18T22:16:12.493 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.492+0000 7fb518ff9640 1 -- 172.21.15.123:0/700864407 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]=0 v35) ==== 106+0+0 (secure 0 0 0) 0x7fb50409c1a0 con 0x7fb51c102a80 2024-08-18T22:16:12.497 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.495+0000 7fb521744640 1 -- 172.21.15.123:0/700864407 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb5080a2b90 msgr2=0x7fb5080a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:12.497 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.495+0000 7fb521744640 1 --2- 172.21.15.123:0/700864407 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb5080a2b90 0x7fb5080a5050 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb50c000c00 tx=0x7fb50c031400 comp rx=0 tx=0).stop 2024-08-18T22:16:12.497 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.495+0000 7fb521744640 1 -- 172.21.15.123:0/700864407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb51c102a80 msgr2=0x7fb51c1980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:12.497 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.495+0000 7fb521744640 1 --2- 172.21.15.123:0/700864407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb51c102a80 0x7fb51c1980b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb50400c920 tx=0x7fb50400cde0 comp rx=0 tx=0).stop 2024-08-18T22:16:12.497 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.495+0000 7fb521744640 1 -- 172.21.15.123:0/700864407 shutdown_connections 2024-08-18T22:16:12.497 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.495+0000 7fb521744640 1 --2- 172.21.15.123:0/700864407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb51c103440 0x7fb51c19f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:12.497 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.495+0000 7fb521744640 1 --2- 172.21.15.123:0/700864407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb51c102a80 0x7fb51c1980b0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:12.497 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.495+0000 7fb521744640 1 --2- 172.21.15.123:0/700864407 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb5080a2b90 0x7fb5080a5050 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:12.497 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.495+0000 7fb521744640 1 --2- 172.21.15.123:0/700864407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51c101890 0x7fb51c197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:12.497 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.495+0000 7fb521744640 1 -- 172.21.15.123:0/700864407 >> 172.21.15.123:0/700864407 conn(0x7fb51c0fcfd0 msgr2=0x7fb51c105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:12.497 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.496+0000 7fb521744640 1 -- 172.21.15.123:0/700864407 shutdown_connections 2024-08-18T22:16:12.498 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.496+0000 7fb521744640 1 -- 172.21.15.123:0/700864407 wait complete. 2024-08-18T22:16:12.597 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.594+0000 7f455d1cf640 1 -- 172.21.15.123:0/3201288567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4558100790 msgr2=0x7f4558100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:12.598 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.594+0000 7f455d1cf640 1 --2- 172.21.15.123:0/3201288567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4558100790 0x7f4558100b90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4548009900 tx=0x7f454802a410 comp rx=0 tx=0).stop 2024-08-18T22:16:12.598 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.594+0000 7f455d1cf640 1 -- 172.21.15.123:0/3201288567 shutdown_connections 2024-08-18T22:16:12.598 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.594+0000 7f455d1cf640 1 --2- 172.21.15.123:0/3201288567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4558102340 0x7f4558108bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:12.598 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.594+0000 7f455d1cf640 1 --2- 172.21.15.123:0/3201288567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4558101980 0x7f4558101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:12.598 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.594+0000 7f455d1cf640 1 --2- 172.21.15.123:0/3201288567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4558100790 0x7f4558100b90 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:12.598 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.594+0000 7f455d1cf640 1 -- 172.21.15.123:0/3201288567 >> 172.21.15.123:0/3201288567 conn(0x7f45580fbef0 msgr2=0x7f45580fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:12.598 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.594+0000 7f455d1cf640 1 -- 172.21.15.123:0/3201288567 shutdown_connections 2024-08-18T22:16:12.598 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.594+0000 7f455d1cf640 1 -- 172.21.15.123:0/3201288567 wait complete. 2024-08-18T22:16:12.598 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.594+0000 7f455d1cf640 1 Processor -- start 2024-08-18T22:16:12.599 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455d1cf640 1 -- start start 2024-08-18T22:16:12.599 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455d1cf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4558100790 0x7f455806ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:12.599 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455d1cf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4558101980 0x7f455819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:12.599 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455d1cf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4558102340 0x7f455819efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:12.599 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455d1cf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f455810c410 con 0x7f4558102340 2024-08-18T22:16:12.599 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455d1cf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f455810c290 con 0x7f4558101980 2024-08-18T22:16:12.599 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455d1cf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f455810c590 con 0x7f4558100790 2024-08-18T22:16:12.599 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4558102340 0x7f455819efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:12.599 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4558102340 0x7f455819efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35000/0 (socket says 172.21.15.123:35000) 2024-08-18T22:16:12.599 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455759e640 1 -- 172.21.15.123:0/2185335323 learned_addr learned my addr 172.21.15.123:0/2185335323 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:12.599 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455659c640 1 --2- 172.21.15.123:0/2185335323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4558101980 0x7f455819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:12.600 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f4556d9d640 1 --2- 172.21.15.123:0/2185335323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4558100790 0x7f455806ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:12.600 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455759e640 1 -- 172.21.15.123:0/2185335323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4558100790 msgr2=0x7f455806ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:12.600 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455759e640 1 --2- 172.21.15.123:0/2185335323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4558100790 0x7f455806ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:12.600 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455759e640 1 -- 172.21.15.123:0/2185335323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4558101980 msgr2=0x7f455819c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:12.600 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455759e640 1 --2- 172.21.15.123:0/2185335323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4558101980 0x7f455819c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:12.600 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455759e640 1 -- 172.21.15.123:0/2185335323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455819f8e0 con 0x7f4558102340 2024-08-18T22:16:12.600 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f4556d9d640 1 --2- 172.21.15.123:0/2185335323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4558100790 0x7f455806ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:16:12.600 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.595+0000 7f455759e640 1 --2- 172.21.15.123:0/2185335323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4558102340 0x7f455819efd0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f455000cad0 tx=0x7f455000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:12.600 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.596+0000 7f453ffff640 1 -- 172.21.15.123:0/2185335323 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455000ae20 con 0x7f4558102340 2024-08-18T22:16:12.600 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.596+0000 7f453ffff640 1 -- 172.21.15.123:0/2185335323 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4550005020 con 0x7f4558102340 2024-08-18T22:16:12.600 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.596+0000 7f453ffff640 1 -- 172.21.15.123:0/2185335323 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455000f6f0 con 0x7f4558102340 2024-08-18T22:16:12.600 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.596+0000 7f455d1cf640 1 -- 172.21.15.123:0/2185335323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455819fb70 con 0x7f4558102340 2024-08-18T22:16:12.600 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.596+0000 7f455d1cf640 1 -- 172.21.15.123:0/2185335323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45581a00c0 con 0x7f4558102340 2024-08-18T22:16:12.601 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.597+0000 7f455d1cf640 1 -- 172.21.15.123:0/2185335323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4558107c90 con 0x7f4558102340 2024-08-18T22:16:12.601 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.598+0000 7f453ffff640 1 -- 172.21.15.123:0/2185335323 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f45500051d0 con 0x7f4558102340 2024-08-18T22:16:12.601 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.599+0000 7f453ffff640 1 --2- 172.21.15.123:0/2185335323 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f45400a2b90 0x7f45400a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:12.601 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.599+0000 7f4556d9d640 1 --2- 172.21.15.123:0/2185335323 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f45400a2b90 0x7f45400a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:12.602 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.599+0000 7f453ffff640 1 -- 172.21.15.123:0/2185335323 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9531+0+0 (secure 0 0 0) 0x7f45500cf8b0 con 0x7f4558102340 2024-08-18T22:16:12.602 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.599+0000 7f4556d9d640 1 --2- 172.21.15.123:0/2185335323 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f45400a2b90 0x7f45400a5050 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4548000c00 tx=0x7f45480315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:12.603 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.603+0000 7f453ffff640 1 -- 172.21.15.123:0/2185335323 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4550014030 con 0x7f4558102340 2024-08-18T22:16:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:12 smithi123 ceph-mon[18462]: osdmap e95: 12 total, 12 up, 12 in 2024-08-18T22:16:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:12 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/700864407' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]': finished 2024-08-18T22:16:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:12 smithi123 ceph-mon[18462]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:16:12.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:12 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/700864407' entity='client.admin' cmd=[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]: dispatch 2024-08-18T22:16:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:12 smithi130 ceph-mon[21698]: osdmap e95: 12 total, 12 up, 12 in 2024-08-18T22:16:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:12 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/700864407' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]': finished 2024-08-18T22:16:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:12 smithi130 ceph-mon[21698]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:16:12.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:12 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/700864407' entity='client.admin' cmd=[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]: dispatch 2024-08-18T22:16:12.771 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:12.770+0000 7f455d1cf640 1 -- 172.21.15.123:0/2185335323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "foo.185348", "pool2": "foo.185348", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4558062bc0 con 0x7f4558102340 2024-08-18T22:16:12.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:12 smithi183 ceph-mon[22097]: osdmap e95: 12 total, 12 up, 12 in 2024-08-18T22:16:12.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:12 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/700864407' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]': finished 2024-08-18T22:16:12.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:12 smithi183 ceph-mon[22097]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:16:12.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:12 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/700864407' entity='client.admin' cmd=[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]: dispatch 2024-08-18T22:16:13.500 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:13.499+0000 7f453ffff640 1 -- 172.21.15.123:0/2185335323 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "foo.185348", "pool2": "foo.185348", "yes_i_really_really_mean_it": true}]=0 pool 'foo.185348' removed v96) ==== 166+0+0 (secure 0 0 0) 0x7f455009c300 con 0x7f4558102340 2024-08-18T22:16:13.607 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:13.605+0000 7f455d1cf640 1 -- 172.21.15.123:0/2185335323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "foo.185348", "pool2": "foo.185348", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4558062e10 con 0x7f4558102340 2024-08-18T22:16:13.607 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:13.606+0000 7f453ffff640 1 -- 172.21.15.123:0/2185335323 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "foo.185348", "pool2": "foo.185348", "yes_i_really_really_mean_it": true}]=0 pool 'foo.185348' does not exist v96) ==== 173+0+0 (secure 0 0 0) 0x7f455009bc00 con 0x7f4558102340 2024-08-18T22:16:13.607 INFO:tasks.workunit.client.0.smithi123.stderr:pool 'foo.185348' does not exist 2024-08-18T22:16:13.609 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:13.608+0000 7f455d1cf640 1 -- 172.21.15.123:0/2185335323 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f45400a2b90 msgr2=0x7f45400a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:13.609 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:13.608+0000 7f455d1cf640 1 --2- 172.21.15.123:0/2185335323 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f45400a2b90 0x7f45400a5050 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4548000c00 tx=0x7f45480315b0 comp rx=0 tx=0).stop 2024-08-18T22:16:13.609 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:13.608+0000 7f455d1cf640 1 -- 172.21.15.123:0/2185335323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4558102340 msgr2=0x7f455819efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:13.609 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:13.608+0000 7f455d1cf640 1 --2- 172.21.15.123:0/2185335323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4558102340 0x7f455819efd0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f455000cad0 tx=0x7f455000cf90 comp rx=0 tx=0).stop 2024-08-18T22:16:13.609 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:13.608+0000 7f455d1cf640 1 -- 172.21.15.123:0/2185335323 shutdown_connections 2024-08-18T22:16:13.609 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:13.608+0000 7f455d1cf640 1 --2- 172.21.15.123:0/2185335323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4558102340 0x7f455819efd0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:13.609 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:13.608+0000 7f455d1cf640 1 --2- 172.21.15.123:0/2185335323 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f45400a2b90 0x7f45400a5050 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:13.609 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:13.608+0000 7f455d1cf640 1 --2- 172.21.15.123:0/2185335323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4558101980 0x7f455819c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:13.609 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:13.608+0000 7f455d1cf640 1 --2- 172.21.15.123:0/2185335323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4558100790 0x7f455806ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:13.610 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:13.608+0000 7f455d1cf640 1 -- 172.21.15.123:0/2185335323 >> 172.21.15.123:0/2185335323 conn(0x7f45580fbef0 msgr2=0x7f4558104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:13.610 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:13.608+0000 7f455d1cf640 1 -- 172.21.15.123:0/2185335323 shutdown_connections 2024-08-18T22:16:13.610 INFO:tasks.workunit.client.0.smithi123.stderr:2024-08-18T22:16:13.608+0000 7f455d1cf640 1 -- 172.21.15.123:0/2185335323 wait complete. 2024-08-18T22:16:13.619 INFO:tasks.workunit.client.0.smithi123.stdout:OK 2024-08-18T22:16:13.620 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-18T22:16:13.620 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-18T22:16:13.651 INFO:tasks.workunit:Running workunit fs/misc/multiple_rsync.sh... 2024-08-18T22:16:13.651 DEBUG:teuthology.orchestra.run.smithi123:workunit test fs/misc/multiple_rsync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh 2024-08-18T22:16:13.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:13 smithi123 ceph-mon[18462]: pgmap v596: 137 pgs: 1 creating+peering, 5 unknown, 131 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 5.0 KiB/s wr, 11 op/s 2024-08-18T22:16:13.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:13 smithi123 ceph-mon[18462]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-18T22:16:13.760 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:13 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/700864407' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]': finished 2024-08-18T22:16:13.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:13 smithi123 ceph-mon[18462]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:16:13.761 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:13 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2185335323' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "foo.185348", "pool2": "foo.185348", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-18T22:16:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:13 smithi130 ceph-mon[21698]: pgmap v596: 137 pgs: 1 creating+peering, 5 unknown, 131 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 5.0 KiB/s wr, 11 op/s 2024-08-18T22:16:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:13 smithi130 ceph-mon[21698]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-18T22:16:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:13 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/700864407' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]': finished 2024-08-18T22:16:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:13 smithi130 ceph-mon[21698]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:16:13.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:13 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2185335323' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "foo.185348", "pool2": "foo.185348", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-18T22:16:13.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:13 smithi183 ceph-mon[22097]: pgmap v596: 137 pgs: 1 creating+peering, 5 unknown, 131 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 5.0 KiB/s wr, 11 op/s 2024-08-18T22:16:13.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:13 smithi183 ceph-mon[22097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-18T22:16:13.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:13 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/700864407' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.185348"}]': finished 2024-08-18T22:16:13.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:13 smithi183 ceph-mon[22097]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:16:13.910 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:13 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2185335323' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "foo.185348", "pool2": "foo.185348", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-18T22:16:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:14 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2185335323' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "foo.185348", "pool2": "foo.185348", "yes_i_really_really_mean_it": true}]': finished 2024-08-18T22:16:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:14 smithi130 ceph-mon[21698]: osdmap e96: 12 total, 12 up, 12 in 2024-08-18T22:16:14.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:14 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2185335323' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "foo.185348", "pool2": "foo.185348", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-18T22:16:14.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:14 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2185335323' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "foo.185348", "pool2": "foo.185348", "yes_i_really_really_mean_it": true}]': finished 2024-08-18T22:16:14.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:14 smithi183 ceph-mon[22097]: osdmap e96: 12 total, 12 up, 12 in 2024-08-18T22:16:14.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:14 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2185335323' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "foo.185348", "pool2": "foo.185348", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-18T22:16:15.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:14 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2185335323' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "foo.185348", "pool2": "foo.185348", "yes_i_really_really_mean_it": true}]': finished 2024-08-18T22:16:15.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:14 smithi123 ceph-mon[18462]: osdmap e96: 12 total, 12 up, 12 in 2024-08-18T22:16:15.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:14 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2185335323' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "foo.185348", "pool2": "foo.185348", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-18T22:16:15.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:15 smithi183 ceph-mon[22097]: pgmap v598: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.6 KiB/s wr, 8 op/s 2024-08-18T22:16:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.952+0000 7f9f2490c640 1 -- 172.21.15.123:0/1826094424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20100790 msgr2=0x7f9f20100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.952+0000 7f9f2490c640 1 --2- 172.21.15.123:0/1826094424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20100790 0x7f9f20100b90 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009900 tx=0x7f9f1002a410 comp rx=0 tx=0).stop 2024-08-18T22:16:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.952+0000 7f9f2490c640 1 -- 172.21.15.123:0/1826094424 shutdown_connections 2024-08-18T22:16:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.952+0000 7f9f2490c640 1 --2- 172.21.15.123:0/1826094424 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f20102340 0x7f9f20108bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.952+0000 7f9f2490c640 1 --2- 172.21.15.123:0/1826094424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f20101980 0x7f9f20101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.952+0000 7f9f2490c640 1 --2- 172.21.15.123:0/1826094424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20100790 0x7f9f20100b90 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.952+0000 7f9f2490c640 1 -- 172.21.15.123:0/1826094424 >> 172.21.15.123:0/1826094424 conn(0x7f9f200fbf10 msgr2=0x7f9f200fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.952+0000 7f9f2490c640 1 -- 172.21.15.123:0/1826094424 shutdown_connections 2024-08-18T22:16:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.952+0000 7f9f2490c640 1 -- 172.21.15.123:0/1826094424 wait complete. 2024-08-18T22:16:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.953+0000 7f9f2490c640 1 Processor -- start 2024-08-18T22:16:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.953+0000 7f9f2490c640 1 -- start start 2024-08-18T22:16:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.953+0000 7f9f2490c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f20100790 0x7f9f20197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.953+0000 7f9f2490c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f20101980 0x7f9f20198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.953+0000 7f9f2490c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20102340 0x7f9f2019f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.953+0000 7f9f2490c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2010c3f0 con 0x7f9f20102340 2024-08-18T22:16:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.953+0000 7f9f2490c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2010c270 con 0x7f9f20100790 2024-08-18T22:16:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.953+0000 7f9f2490c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2010c570 con 0x7f9f20101980 2024-08-18T22:16:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.953+0000 7f9f1ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20102340 0x7f9f2019f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.953+0000 7f9f1ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20102340 0x7f9f2019f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49142/0 (socket says 172.21.15.123:49142) 2024-08-18T22:16:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.953+0000 7f9f1ed9d640 1 -- 172.21.15.123:0/1380453728 learned_addr learned my addr 172.21.15.123:0/1380453728 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.954+0000 7f9f1e59c640 1 --2- 172.21.15.123:0/1380453728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f20100790 0x7f9f20197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.954+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/1380453728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f20101980 0x7f9f20198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.954+0000 7f9f1ed9d640 1 -- 172.21.15.123:0/1380453728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f20101980 msgr2=0x7f9f20198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.954+0000 7f9f1ed9d640 1 --2- 172.21.15.123:0/1380453728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f20101980 0x7f9f20198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.954+0000 7f9f1ed9d640 1 -- 172.21.15.123:0/1380453728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f20100790 msgr2=0x7f9f20197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.954+0000 7f9f1ed9d640 1 --2- 172.21.15.123:0/1380453728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f20100790 0x7f9f20197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.954+0000 7f9f1ed9d640 1 -- 172.21.15.123:0/1380453728 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2019f730 con 0x7f9f20102340 2024-08-18T22:16:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.954+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/1380453728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f20101980 0x7f9f20198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:16:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.954+0000 7f9f1ed9d640 1 --2- 172.21.15.123:0/1380453728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f20102340 0x7f9f2019f0c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800eaa0 tx=0x7f9f1800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.954+0000 7f9f177fe640 1 -- 172.21.15.123:0/1380453728 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1800cdb0 con 0x7f9f20102340 2024-08-18T22:16:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.954+0000 7f9f177fe640 1 -- 172.21.15.123:0/1380453728 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f18005020 con 0x7f9f20102340 2024-08-18T22:16:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.954+0000 7f9f2490c640 1 -- 172.21.15.123:0/1380453728 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2019fa20 con 0x7f9f20102340 2024-08-18T22:16:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.954+0000 7f9f177fe640 1 -- 172.21.15.123:0/1380453728 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f180116b0 con 0x7f9f20102340 2024-08-18T22:16:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.954+0000 7f9f2490c640 1 -- 172.21.15.123:0/1380453728 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2019ff70 con 0x7f9f20102340 2024-08-18T22:16:15.965 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.956+0000 7f9f177fe640 1 -- 172.21.15.123:0/1380453728 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f9f18005560 con 0x7f9f20102340 2024-08-18T22:16:15.965 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f276d0740 1 Processor -- start 2024-08-18T22:16:15.965 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f276d0740 1 -- start start 2024-08-18T22:16:15.965 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f276d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d44a90 0x562764d44e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.965 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f276d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d453d0 0x562764d49e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f276d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 0x562764d4c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f276d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562764ca39d0 con 0x562764d453d0 2024-08-18T22:16:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f276d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562764c4b820 con 0x562764d44a90 2024-08-18T22:16:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f276d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562764c9f990 con 0x562764d4a460 2024-08-18T22:16:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f1e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d453d0 0x562764d49e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f1e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d453d0 0x562764d49e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49144/0 (socket says 172.21.15.123:49144) 2024-08-18T22:16:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f1e59c640 1 -- 172.21.15.123:0/1412612866 learned_addr learned my addr 172.21.15.123:0/1412612866 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/1412612866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 0x562764d4c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/1412612866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d44a90 0x562764d44e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f177fe640 1 --2- 172.21.15.123:0/1380453728 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9f0c0a2cb0 0x7f9f0c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f1e59c640 1 -- 172.21.15.123:0/1412612866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 msgr2=0x562764d4c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.957+0000 7f9f1e59c640 1 --2- 172.21.15.123:0/1412612866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 0x562764d4c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.958+0000 7f9f1e59c640 1 -- 172.21.15.123:0/1412612866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d44a90 msgr2=0x562764d44e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.958+0000 7f9f1e59c640 1 --2- 172.21.15.123:0/1412612866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d44a90 0x562764d44e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.958+0000 7f9f1e59c640 1 -- 172.21.15.123:0/1412612866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627649b7210 con 0x562764d453d0 2024-08-18T22:16:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.958+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/1412612866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 0x562764d4c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:16:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.958+0000 7f9f1ed9d640 1 --2- 172.21.15.123:0/1380453728 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9f0c0a2cb0 0x7f9f0c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.958+0000 7f9f1e59c640 1 --2- 172.21.15.123:0/1412612866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d453d0 0x562764d49e90 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9f10006010 tx=0x7f9f10005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66f7d7fa97643dc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.958+0000 7f9f177fe640 1 -- 172.21.15.123:0/1380453728 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f9f180cf6a0 con 0x7f9f20102340 2024-08-18T22:16:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.958+0000 7f9f14ff9640 1 -- 172.21.15.123:0/1412612866 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1003f070 con 0x562764d453d0 2024-08-18T22:16:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.958+0000 7f9f14ff9640 1 -- 172.21.15.123:0/1412612866 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f10004030 con 0x562764d453d0 2024-08-18T22:16:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.958+0000 7f9f14ff9640 1 -- 172.21.15.123:0/1412612866 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10035070 con 0x562764d453d0 2024-08-18T22:16:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 -- 172.21.15.123:0/1412612866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d453d0 msgr2=0x562764d49e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f1ed9d640 1 --2- 172.21.15.123:0/1380453728 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f9f0c0a2cb0 0x7f9f0c0a5170 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9f180cd180 tx=0x7f9f1806ec30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 --2- 172.21.15.123:0/1412612866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d453d0 0x562764d49e90 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9f10006010 tx=0x7f9f10005e80 comp rx=0 tx=0).stop 2024-08-18T22:16:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 -- 172.21.15.123:0/1412612866 shutdown_connections 2024-08-18T22:16:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 --2- 172.21.15.123:0/1412612866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 0x562764d4c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 --2- 172.21.15.123:0/1412612866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d453d0 0x562764d49e90 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 --2- 172.21.15.123:0/1412612866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d44a90 0x562764d44e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 -- 172.21.15.123:0/1412612866 >> 172.21.15.123:0/1412612866 conn(0x562764d3bcf0 msgr2=0x562764d3c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 -- 172.21.15.123:0/1412612866 shutdown_connections 2024-08-18T22:16:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 -- 172.21.15.123:0/1412612866 wait complete. 2024-08-18T22:16:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 -- start start 2024-08-18T22:16:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 Processor -- start 2024-08-18T22:16:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d44a90 0x562764d4ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d453d0 0x562764d4f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 0x562764d56130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562764d4d3d0 con 0x562764d44a90 2024-08-18T22:16:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.959+0000 7f9f276d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562764c5f520 con 0x562764d453d0 2024-08-18T22:16:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f276d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562764d4d550 con 0x562764d4a460 2024-08-18T22:16:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f276d0740 10 client.0 _ll_register_callbacks cb 0x5627649b6a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:16:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f1dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d44a90 0x562764d4ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f1dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d44a90 0x562764d4ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49158/0 (socket says 172.21.15.123:49158) 2024-08-18T22:16:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f1dd9b640 1 -- 172.21.15.123:0/943004648 learned_addr learned my addr 172.21.15.123:0/943004648 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f1e59c640 1 --2- 172.21.15.123:0/943004648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d453d0 0x562764d4f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f1dd9b640 1 -- 172.21.15.123:0/943004648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 msgr2=0x562764d56130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/943004648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 0x562764d56130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f1dd9b640 1 -- 172.21.15.123:0/943004648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d453d0 msgr2=0x562764d4f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/943004648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d453d0 0x562764d4f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f1dd9b640 1 -- 172.21.15.123:0/943004648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562764a83620 con 0x562764d44a90 2024-08-18T22:16:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/943004648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d44a90 0x562764d4ebb0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9f080128a0 tx=0x7f9f08012d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae41d6f41035da0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:16:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f05ffb640 1 -- 172.21.15.123:0/943004648 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08011dd0 con 0x562764d44a90 2024-08-18T22:16:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f05ffb640 1 -- 172.21.15.123:0/943004648 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f9f08004030 con 0x562764d44a90 2024-08-18T22:16:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f276d0740 1 -- 172.21.15.123:0/943004648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f10004030 con 0x562764d44a90 2024-08-18T22:16:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f05ffb640 1 -- 172.21.15.123:0/943004648 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9f08004230 con 0x562764d44a90 2024-08-18T22:16:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f276d0740 10 client.16959 fetch_fsmap learned FSMap version 35 2024-08-18T22:16:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.960+0000 7f9f276d0740 1 -- 172.21.15.123:0/943004648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562764d58ff0 con 0x562764d44a90 2024-08-18T22:16:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.961+0000 7f9f05ffb640 1 -- 172.21.15.123:0/943004648 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f10004030 con 0x562764d44a90 2024-08-18T22:16:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.961+0000 7f9f05ffb640 1 -- 172.21.15.123:0/943004648 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f9f08019070 con 0x562764d44a90 2024-08-18T22:16:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.961+0000 7f9f276d0740 10 client.16959 fetch_fsmap finished waiting for FSMap version 35 2024-08-18T22:16:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.961+0000 7f9f276d0740 10 client.16959 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:16:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.961+0000 7f9f276d0740 20 client.16959 populate_metadata read hostname 'smithi123' 2024-08-18T22:16:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.961+0000 7f9f276d0740 1 --2- 172.21.15.123:0/943004648 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x562764d5a7f0 0x562764d5cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.961+0000 7f9f276d0740 4 client.16959 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:16:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.961+0000 7f9f276d0740 1 -- 172.21.15.123:0/943004648 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562764cb1100 con 0x562764d5a7f0 2024-08-18T22:16:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.961+0000 7f9f1e59c640 1 --2- 172.21.15.123:0/943004648 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x562764d5a7f0 0x562764d5cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.962+0000 7f9f05ffb640 10 client.16959 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:16:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.962+0000 7f9f1e59c640 1 --2- 172.21.15.123:0/943004648 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x562764d5a7f0 0x562764d5cc20 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45080a7191ac66b7 server_cookie=95101317d06d3162 in_seq=0 out_seq=0 2024-08-18T22:16:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.962+0000 7f9f05ffb640 1 -- 172.21.15.123:0/943004648 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562764cb1100 con 0x562764d5a7f0 2024-08-18T22:16:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.962+0000 7f9f05ffb640 10 client.16959 handle_command_reply: tid=0 2024-08-18T22:16:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.962+0000 7f9f276d0740 1 client.16959 shutdown 2024-08-18T22:16:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.962+0000 7f9f276d0740 1 -- 172.21.15.123:0/943004648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d44a90 msgr2=0x562764d4ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.962+0000 7f9f276d0740 1 --2- 172.21.15.123:0/943004648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d44a90 0x562764d4ebb0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9f080128a0 tx=0x7f9f08012d60 comp rx=0 tx=0).stop 2024-08-18T22:16:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.963+0000 7f9f276d0740 1 -- 172.21.15.123:0/943004648 shutdown_connections 2024-08-18T22:16:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.963+0000 7f9f276d0740 1 --2- 172.21.15.123:0/943004648 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x562764d5a7f0 0x562764d5cc20 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.963+0000 7f9f276d0740 1 --2- 172.21.15.123:0/943004648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 0x562764d56130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.963+0000 7f9f276d0740 1 --2- 172.21.15.123:0/943004648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d453d0 0x562764d4f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.963+0000 7f9f276d0740 1 --2- 172.21.15.123:0/943004648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d44a90 0x562764d4ebb0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.963+0000 7f9f05ffb640 0 client.16959 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:16:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.963+0000 7f9f276d0740 1 -- 172.21.15.123:0/943004648 >> 172.21.15.123:0/943004648 conn(0x562764d3bcf0 msgr2=0x562764d3d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.963+0000 7f9f276d0740 1 -- 172.21.15.123:0/943004648 shutdown_connections 2024-08-18T22:16:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.963+0000 7f9f276d0740 1 -- 172.21.15.123:0/943004648 wait complete. 2024-08-18T22:16:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.963+0000 7f9f276d0740 20 client.16959 trim_cache size 0 max 16384 2024-08-18T22:16:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.977+0000 7f9f276d0740 1 Processor -- start 2024-08-18T22:16:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.977+0000 7f9f276d0740 1 -- start start 2024-08-18T22:16:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.977+0000 7f9f276d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d44a90 0x562764d4d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.977+0000 7f9f276d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d453d0 0x562764d560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.977+0000 7f9f276d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 0x562764d4eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.977+0000 7f9f276d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9f201aabf0 con 0x562764d44a90 2024-08-18T22:16:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.977+0000 7f9f276d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9f201a8400 con 0x562764d453d0 2024-08-18T22:16:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.977+0000 7f9f276d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9f201a6250 con 0x562764d4a460 2024-08-18T22:16:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.977+0000 7f9f1dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d44a90 0x562764d4d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.977+0000 7f9f1dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d44a90 0x562764d4d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49172/0 (socket says 172.21.15.123:49172) 2024-08-18T22:16:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.977+0000 7f9f1dd9b640 1 -- 172.21.15.123:0/2850571255 learned_addr learned my addr 172.21.15.123:0/2850571255 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.978+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/2850571255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 0x562764d4eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.978+0000 7f9f1e59c640 1 --2- 172.21.15.123:0/2850571255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d453d0 0x562764d560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.978+0000 7f9f1dd9b640 1 -- 172.21.15.123:0/2850571255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 msgr2=0x562764d4eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.978+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/2850571255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 0x562764d4eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.978+0000 7f9f1dd9b640 1 -- 172.21.15.123:0/2850571255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d453d0 msgr2=0x562764d560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.978+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/2850571255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d453d0 0x562764d560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.978+0000 7f9f1dd9b640 1 -- 172.21.15.123:0/2850571255 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562764d458b0 con 0x562764d44a90 2024-08-18T22:16:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.978+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/2850571255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d44a90 0x562764d4d950 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9f08005eb0 tx=0x7f9f080093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feec45c798055b70 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.978+0000 7f9f07fff640 1 -- 172.21.15.123:0/2850571255 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08032070 con 0x562764d44a90 2024-08-18T22:16:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.978+0000 7f9f07fff640 1 -- 172.21.15.123:0/2850571255 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f08011dd0 con 0x562764d44a90 2024-08-18T22:16:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.978+0000 7f9f07fff640 1 -- 172.21.15.123:0/2850571255 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0802a990 con 0x562764d44a90 2024-08-18T22:16:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 -- 172.21.15.123:0/2850571255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d44a90 msgr2=0x562764d4d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 --2- 172.21.15.123:0/2850571255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d44a90 0x562764d4d950 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9f08005eb0 tx=0x7f9f080093b0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 -- 172.21.15.123:0/2850571255 shutdown_connections 2024-08-18T22:16:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 --2- 172.21.15.123:0/2850571255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 0x562764d4eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 --2- 172.21.15.123:0/2850571255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d453d0 0x562764d560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 --2- 172.21.15.123:0/2850571255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d44a90 0x562764d4d950 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 -- 172.21.15.123:0/2850571255 >> 172.21.15.123:0/2850571255 conn(0x562764d3bcf0 msgr2=0x562764d4e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 -- 172.21.15.123:0/2850571255 shutdown_connections 2024-08-18T22:16:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 -- 172.21.15.123:0/2850571255 wait complete. 2024-08-18T22:16:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 -- start start 2024-08-18T22:16:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 Processor -- start 2024-08-18T22:16:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d44a90 0x562764d534a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d453d0 0x562764d539e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 0x562764d549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9f201a68c0 con 0x562764d453d0 2024-08-18T22:16:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9f201a7d30 con 0x562764d44a90 2024-08-18T22:16:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9f201a6f90 con 0x562764d4a460 2024-08-18T22:16:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f276d0740 10 client.0 _ll_register_callbacks cb 0x7f9f08005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:16:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f1e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d453d0 0x562764d539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f1e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d453d0 0x562764d539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49180/0 (socket says 172.21.15.123:49180) 2024-08-18T22:16:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f1e59c640 1 -- 172.21.15.123:0/2663084570 learned_addr learned my addr 172.21.15.123:0/2663084570 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.979+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/2663084570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 0x562764d549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.980+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/2663084570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d44a90 0x562764d534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.980+0000 7f9f1e59c640 1 -- 172.21.15.123:0/2663084570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 msgr2=0x562764d549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.980+0000 7f9f1e59c640 1 --2- 172.21.15.123:0/2663084570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562764d4a460 0x562764d549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.980+0000 7f9f1e59c640 1 -- 172.21.15.123:0/2663084570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d44a90 msgr2=0x562764d534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.980+0000 7f9f1e59c640 1 --2- 172.21.15.123:0/2663084570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562764d44a90 0x562764d534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.980+0000 7f9f1e59c640 1 -- 172.21.15.123:0/2663084570 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562764d54fb0 con 0x562764d453d0 2024-08-18T22:16:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.980+0000 7f9f1e59c640 1 --2- 172.21.15.123:0/2663084570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562764d453d0 0x562764d539e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9f1002a930 tx=0x7f9f1002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b700f9dde6279d14 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.980+0000 7f9f05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:16:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.980+0000 7f9f05ffb640 1 -- 172.21.15.123:0/2663084570 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10035050 con 0x562764d453d0 2024-08-18T22:16:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.980+0000 7f9f05ffb640 1 -- 172.21.15.123:0/2663084570 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f9f100318b0 con 0x562764d453d0 2024-08-18T22:16:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.980+0000 7f9f276d0740 1 -- 172.21.15.123:0/2663084570 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f08011dd0 con 0x562764d453d0 2024-08-18T22:16:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.980+0000 7f9f05ffb640 1 -- 172.21.15.123:0/2663084570 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9f1005b050 con 0x562764d453d0 2024-08-18T22:16:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.980+0000 7f9f276d0740 10 client.16965 fetch_fsmap learned FSMap version 35 2024-08-18T22:16:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.980+0000 7f9f276d0740 1 -- 172.21.15.123:0/2663084570 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562764d56320 con 0x562764d453d0 2024-08-18T22:16:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.980+0000 7f9f05ffb640 1 -- 172.21.15.123:0/2663084570 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f08011dd0 con 0x562764d453d0 2024-08-18T22:16:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.981+0000 7f9f05ffb640 1 -- 172.21.15.123:0/2663084570 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f9f10003bd0 con 0x562764d453d0 2024-08-18T22:16:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.981+0000 7f9f276d0740 10 client.16965 fetch_fsmap finished waiting for FSMap version 35 2024-08-18T22:16:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.981+0000 7f9f276d0740 10 client.16965 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-18T22:16:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.981+0000 7f9f276d0740 20 client.16965 populate_metadata read hostname 'smithi123' 2024-08-18T22:16:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.981+0000 7f9f276d0740 1 --2- 172.21.15.123:0/2663084570 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x562764dc5890 0x562764dc7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.981+0000 7f9f276d0740 4 client.16965 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:16:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.981+0000 7f9f276d0740 1 -- 172.21.15.123:0/2663084570 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562764cab450 con 0x562764dc5890 2024-08-18T22:16:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.981+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/2663084570 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x562764dc5890 0x562764dc7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.981+0000 7f9f1dd9b640 1 --2- 172.21.15.123:0/2663084570 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x562764dc5890 0x562764dc7c80 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70a9dd99fd819853 server_cookie=fc138d105eda0cf9 in_seq=0 out_seq=0 2024-08-18T22:16:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi123.front.sepia.ceph.com.smithi123.stderr:2024-08-18T22:16:15.981+0000 7f9f05ffb640 10 client.16965 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:16:15.995 INFO:tasks.workunit.client.0.smithi123.stderr:+ export PAYLOAD=/tmp/multiple_rsync_payload.185527 2024-08-18T22:16:15.995 INFO:tasks.workunit.client.0.smithi123.stderr:+ PAYLOAD=/tmp/multiple_rsync_payload.185527 2024-08-18T22:16:15.996 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo cp -r /usr/lib/ /tmp/multiple_rsync_payload.185527 2024-08-18T22:16:16.003 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:15 smithi123 ceph-mon[18462]: pgmap v598: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.6 KiB/s wr, 8 op/s 2024-08-18T22:16:16.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:15 smithi130 ceph-mon[21698]: pgmap v598: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.6 KiB/s wr, 8 op/s 2024-08-18T22:16:16.409 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:16:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: 2024-08-18T22:16:15.994+0000 7fcbd607e640 -1 log_channel(cluster) log [ERR] : failed to store backtrace on ino 0x10000007735 object, pool 2, errno -2 2024-08-18T22:16:16.409 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:16:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: 2024-08-18T22:16:15.994+0000 7fcbd607e640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-08-18T22:16:16.409 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:16:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: 2024-08-18T22:16:15.996+0000 7fcbd607e640 -1 log_channel(cluster) log [ERR] : failed to store backtrace on ino 0x10000007744 object, pool 2, errno -2 2024-08-18T22:16:16.410 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:16:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: 2024-08-18T22:16:15.996+0000 7fcbd607e640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-08-18T22:16:16.410 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:16:16 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: 2024-08-18T22:16:15.999+0000 7fcbd607e640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-08-18T22:16:17.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:17 smithi183 ceph-mon[22097]: failed to store backtrace on ino 0x10000007735 object, pool 2, errno -2 2024-08-18T22:16:17.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:17 smithi183 ceph-mon[22097]: force file system read-only 2024-08-18T22:16:17.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:17 smithi183 ceph-mon[22097]: failed to store backtrace on ino 0x10000007744 object, pool 2, errno -2 2024-08-18T22:16:17.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:17 smithi183 ceph-mon[22097]: pgmap v599: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.8 KiB/s wr, 10 op/s 2024-08-18T22:16:18.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:17 smithi123 ceph-mon[18462]: failed to store backtrace on ino 0x10000007735 object, pool 2, errno -2 2024-08-18T22:16:18.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:17 smithi123 ceph-mon[18462]: force file system read-only 2024-08-18T22:16:18.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:17 smithi123 ceph-mon[18462]: failed to store backtrace on ino 0x10000007744 object, pool 2, errno -2 2024-08-18T22:16:18.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:17 smithi123 ceph-mon[18462]: pgmap v599: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.8 KiB/s wr, 10 op/s 2024-08-18T22:16:18.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:17 smithi130 ceph-mon[21698]: failed to store backtrace on ino 0x10000007735 object, pool 2, errno -2 2024-08-18T22:16:18.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:17 smithi130 ceph-mon[21698]: force file system read-only 2024-08-18T22:16:18.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:17 smithi130 ceph-mon[21698]: failed to store backtrace on ino 0x10000007744 object, pool 2, errno -2 2024-08-18T22:16:18.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:17 smithi130 ceph-mon[21698]: pgmap v599: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.8 KiB/s wr, 10 op/s 2024-08-18T22:16:19.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:19 smithi183 ceph-mon[22097]: pgmap v600: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.8 KiB/s wr, 11 op/s 2024-08-18T22:16:20.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:19 smithi123 ceph-mon[18462]: pgmap v600: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.8 KiB/s wr, 11 op/s 2024-08-18T22:16:20.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:19 smithi130 ceph-mon[21698]: pgmap v600: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.8 KiB/s wr, 11 op/s 2024-08-18T22:16:20.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:20 smithi183 ceph-mon[22097]: Health check failed: 1 MDSs are read only (MDS_READ_ONLY) 2024-08-18T22:16:20.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:20 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] up:active 2024-08-18T22:16:20.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:20 smithi183 ceph-mon[22097]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:16:21.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:20 smithi123 ceph-mon[18462]: Health check failed: 1 MDSs are read only (MDS_READ_ONLY) 2024-08-18T22:16:21.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:20 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] up:active 2024-08-18T22:16:21.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:20 smithi123 ceph-mon[18462]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:16:21.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:20 smithi130 ceph-mon[21698]: Health check failed: 1 MDSs are read only (MDS_READ_ONLY) 2024-08-18T22:16:21.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:20 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] up:active 2024-08-18T22:16:21.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:20 smithi130 ceph-mon[21698]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-18T22:16:21.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:21 smithi183 ceph-mon[22097]: pgmap v601: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.8 KiB/s wr, 12 op/s 2024-08-18T22:16:21.915 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:21 smithi130 ceph-mon[21698]: pgmap v601: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.8 KiB/s wr, 12 op/s 2024-08-18T22:16:22.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:21 smithi123 ceph-mon[18462]: pgmap v601: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.8 KiB/s wr, 12 op/s 2024-08-18T22:16:23.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:23 smithi183 ceph-mon[22097]: pgmap v602: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-08-18T22:16:24.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:23 smithi123 ceph-mon[18462]: pgmap v602: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-08-18T22:16:24.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:23 smithi130 ceph-mon[21698]: pgmap v602: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-08-18T22:16:25.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:25 smithi183 ceph-mon[22097]: pgmap v603: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.6 KiB/s wr, 12 op/s 2024-08-18T22:16:26.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:25 smithi123 ceph-mon[18462]: pgmap v603: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.6 KiB/s wr, 12 op/s 2024-08-18T22:16:26.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:25 smithi130 ceph-mon[21698]: pgmap v603: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.6 KiB/s wr, 12 op/s 2024-08-18T22:16:27.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:27 smithi183 ceph-mon[22097]: pgmap v604: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2024-08-18T22:16:28.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:27 smithi123 ceph-mon[18462]: pgmap v604: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2024-08-18T22:16:28.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:27 smithi130 ceph-mon[21698]: pgmap v604: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2024-08-18T22:16:28.909 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:28 smithi183 ceph-mon[22097]: pgmap v605: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-08-18T22:16:29.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:28 smithi123 ceph-mon[18462]: pgmap v605: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-08-18T22:16:29.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:28 smithi130 ceph-mon[21698]: pgmap v605: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-08-18T22:16:31.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:31 smithi183 ceph-mon[22097]: pgmap v606: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 9 op/s 2024-08-18T22:16:31.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:31 smithi123 ceph-mon[18462]: pgmap v606: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 9 op/s 2024-08-18T22:16:31.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:31 smithi130 ceph-mon[21698]: pgmap v606: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 9 op/s 2024-08-18T22:16:33.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:33 smithi183 ceph-mon[22097]: pgmap v607: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-08-18T22:16:33.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:33 smithi123 ceph-mon[18462]: pgmap v607: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-08-18T22:16:33.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:33 smithi130 ceph-mon[21698]: pgmap v607: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-08-18T22:16:33.825 INFO:tasks.quiescer.fs.[cephfs]:Total duration (47.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-18T22:16:33.826 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.75 2024-08-18T22:16:33.826 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:16:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:16:34.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.618+0000 7fe587b67640 1 -- 172.21.15.123:0/4157169637 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5801007c0 msgr2=0x7fe580100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:34.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.618+0000 7fe587b67640 1 --2- 172.21.15.123:0/4157169637 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5801007c0 0x7fe580100c20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe570009930 tx=0x7fe57002a420 comp rx=0 tx=0).stop 2024-08-18T22:16:34.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.618+0000 7fe587b67640 1 -- 172.21.15.123:0/4157169637 shutdown_connections 2024-08-18T22:16:34.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.618+0000 7fe587b67640 1 --2- 172.21.15.123:0/4157169637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe580101160 0x7fe58010d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:34.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.618+0000 7fe587b67640 1 --2- 172.21.15.123:0/4157169637 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5801007c0 0x7fe580100c20 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:34.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.618+0000 7fe587b67640 1 --2- 172.21.15.123:0/4157169637 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5801067c0 0x7fe580106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.618+0000 7fe587b67640 1 -- 172.21.15.123:0/4157169637 >> 172.21.15.123:0/4157169637 conn(0x7fe5800fc500 msgr2=0x7fe5800fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.618+0000 7fe587b67640 1 -- 172.21.15.123:0/4157169637 shutdown_connections 2024-08-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.618+0000 7fe587b67640 1 -- 172.21.15.123:0/4157169637 wait complete. 2024-08-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.619+0000 7fe587b67640 1 Processor -- start 2024-08-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.619+0000 7fe587b67640 1 -- start start 2024-08-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.619+0000 7fe587b67640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5801007c0 0x7fe5801970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.619+0000 7fe587b67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe580101160 0x7fe580197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.619+0000 7fe587b67640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5801067c0 0x7fe58019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.619+0000 7fe587b67640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe580110bc0 con 0x7fe5801067c0 2024-08-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.619+0000 7fe587b67640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe580110a40 con 0x7fe5801007c0 2024-08-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.619+0000 7fe587b67640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe580110d40 con 0x7fe580101160 2024-08-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.619+0000 7fe586104640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5801067c0 0x7fe58019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:34.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.619+0000 7fe586104640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5801067c0 0x7fe58019b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51464/0 (socket says 172.21.15.123:51464) 2024-08-18T22:16:34.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.619+0000 7fe586104640 1 -- 172.21.15.123:0/1970381669 learned_addr learned my addr 172.21.15.123:0/1970381669 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:34.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.619+0000 7fe585903640 1 --2- 172.21.15.123:0/1970381669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5801007c0 0x7fe5801970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:34.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.620+0000 7fe585102640 1 --2- 172.21.15.123:0/1970381669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe580101160 0x7fe580197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:34.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.620+0000 7fe586104640 1 -- 172.21.15.123:0/1970381669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe580101160 msgr2=0x7fe580197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:34.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.620+0000 7fe586104640 1 --2- 172.21.15.123:0/1970381669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe580101160 0x7fe580197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:34.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.620+0000 7fe586104640 1 -- 172.21.15.123:0/1970381669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5801007c0 msgr2=0x7fe5801970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:34.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.620+0000 7fe586104640 1 --2- 172.21.15.123:0/1970381669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5801007c0 0x7fe5801970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:34.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.620+0000 7fe586104640 1 -- 172.21.15.123:0/1970381669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58019c090 con 0x7fe5801067c0 2024-08-18T22:16:34.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.620+0000 7fe586104640 1 --2- 172.21.15.123:0/1970381669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5801067c0 0x7fe58019b9b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe57800eaf0 tx=0x7fe578009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:34.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.620+0000 7fe576ffd640 1 -- 172.21.15.123:0/1970381669 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578013b50 con 0x7fe5801067c0 2024-08-18T22:16:34.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.620+0000 7fe576ffd640 1 -- 172.21.15.123:0/1970381669 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe578013cf0 con 0x7fe5801067c0 2024-08-18T22:16:34.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.620+0000 7fe576ffd640 1 -- 172.21.15.123:0/1970381669 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57800c420 con 0x7fe5801067c0 2024-08-18T22:16:34.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.620+0000 7fe587b67640 1 -- 172.21.15.123:0/1970381669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe58019c380 con 0x7fe5801067c0 2024-08-18T22:16:34.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.620+0000 7fe587b67640 1 -- 172.21.15.123:0/1970381669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe58006a4c0 con 0x7fe5801067c0 2024-08-18T22:16:34.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.622+0000 7fe587b67640 1 -- 172.21.15.123:0/1970381669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe580101f00 con 0x7fe5801067c0 2024-08-18T22:16:34.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.622+0000 7fe576ffd640 1 -- 172.21.15.123:0/1970381669 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fe578004a40 con 0x7fe5801067c0 2024-08-18T22:16:34.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.623+0000 7fe576ffd640 1 --2- 172.21.15.123:0/1970381669 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe56c0a2b80 0x7fe56c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:34.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.623+0000 7fe585903640 1 --2- 172.21.15.123:0/1970381669 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe56c0a2b80 0x7fe56c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:34.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.624+0000 7fe576ffd640 1 -- 172.21.15.123:0/1970381669 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7fe5780d2fb0 con 0x7fe5801067c0 2024-08-18T22:16:34.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.624+0000 7fe585903640 1 --2- 172.21.15.123:0/1970381669 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe56c0a2b80 0x7fe56c0a5040 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009b50 tx=0x7fe57c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:34.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.628+0000 7fe576ffd640 1 -- 172.21.15.123:0/1970381669 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe57809fb80 con 0x7fe5801067c0 2024-08-18T22:16:34.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.847+0000 7fe587b67640 1 -- 172.21.15.123:0/1970381669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe58006af40 con 0x7fe5801067c0 2024-08-18T22:16:34.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.847+0000 7fe576ffd640 1 -- 172.21.15.123:0/1970381669 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11930 (secure 0 0 0) 0x7fe57809f480 con 0x7fe5801067c0 2024-08-18T22:16:34.938 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:16:34.939 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":36,"btime":"2024-08-18T22:16:19:519031+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:16:18.935695+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":125,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":171,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:16:34.939 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 36 2024-08-18T22:16:34.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.849+0000 7fe587b67640 1 -- 172.21.15.123:0/1970381669 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe56c0a2b80 msgr2=0x7fe56c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:34.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.849+0000 7fe587b67640 1 --2- 172.21.15.123:0/1970381669 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe56c0a2b80 0x7fe56c0a5040 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009b50 tx=0x7fe57c005f90 comp rx=0 tx=0).stop 2024-08-18T22:16:34.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.849+0000 7fe587b67640 1 -- 172.21.15.123:0/1970381669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5801067c0 msgr2=0x7fe58019b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:34.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.849+0000 7fe587b67640 1 --2- 172.21.15.123:0/1970381669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5801067c0 0x7fe58019b9b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe57800eaf0 tx=0x7fe578009eb0 comp rx=0 tx=0).stop 2024-08-18T22:16:34.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.850+0000 7fe587b67640 1 -- 172.21.15.123:0/1970381669 shutdown_connections 2024-08-18T22:16:34.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.850+0000 7fe587b67640 1 --2- 172.21.15.123:0/1970381669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5801067c0 0x7fe58019b9b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:34.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.850+0000 7fe587b67640 1 --2- 172.21.15.123:0/1970381669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe580101160 0x7fe580197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:34.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.850+0000 7fe587b67640 1 --2- 172.21.15.123:0/1970381669 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fe56c0a2b80 0x7fe56c0a5040 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:34.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.850+0000 7fe587b67640 1 --2- 172.21.15.123:0/1970381669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5801007c0 0x7fe5801970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:34.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.850+0000 7fe587b67640 1 -- 172.21.15.123:0/1970381669 >> 172.21.15.123:0/1970381669 conn(0x7fe5800fc500 msgr2=0x7fe5800fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:34.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.850+0000 7fe587b67640 1 -- 172.21.15.123:0/1970381669 shutdown_connections 2024-08-18T22:16:34.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:34.850+0000 7fe587b67640 1 -- 172.21.15.123:0/1970381669 wait complete. 2024-08-18T22:16:35.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:35 smithi183 ceph-mon[22097]: pgmap v608: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-18T22:16:35.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:35 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1970381669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:16:35.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:35 smithi123 ceph-mon[18462]: pgmap v608: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-18T22:16:35.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:35 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1970381669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:16:35.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:35 smithi130 ceph-mon[21698]: pgmap v608: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-18T22:16:35.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:35 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1970381669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:16:35.676 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db / --timeout 90 --expiration 143.75 --await-for 45.0' 2024-08-18T22:16:35.677 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24466 quiesce db / --timeout 90 --expiration 143.75 --await-for 45.0 2024-08-18T22:16:35.942 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:16:36.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.440+0000 7f24c2c06640 1 -- 172.21.15.123:0/1755350521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24bc102ac0 msgr2=0x7f24bc102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:36.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.440+0000 7f24c2c06640 1 --2- 172.21.15.123:0/1755350521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24bc102ac0 0x7f24bc102ea0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009930 tx=0x7f24b802a420 comp rx=0 tx=0).stop 2024-08-18T22:16:36.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.440+0000 7f24c2c06640 1 -- 172.21.15.123:0/1755350521 shutdown_connections 2024-08-18T22:16:36.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.440+0000 7f24c2c06640 1 --2- 172.21.15.123:0/1755350521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24bc107fc0 0x7f24bc10e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.440+0000 7f24c2c06640 1 --2- 172.21.15.123:0/1755350521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24bc103470 0x7f24bc1078b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.440+0000 7f24c2c06640 1 --2- 172.21.15.123:0/1755350521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24bc102ac0 0x7f24bc102ea0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.440+0000 7f24c2c06640 1 -- 172.21.15.123:0/1755350521 >> 172.21.15.123:0/1755350521 conn(0x7f24bc0fc500 msgr2=0x7f24bc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:36.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.440+0000 7f24c2c06640 1 -- 172.21.15.123:0/1755350521 shutdown_connections 2024-08-18T22:16:36.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.440+0000 7f24c2c06640 1 -- 172.21.15.123:0/1755350521 wait complete. 2024-08-18T22:16:36.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.440+0000 7f24c2c06640 1 Processor -- start 2024-08-18T22:16:36.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.440+0000 7f24c2c06640 1 -- start start 2024-08-18T22:16:36.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.440+0000 7f24c2c06640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24bc102ac0 0x7f24bc1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c2c06640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24bc103470 0x7f24bc198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c2c06640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24bc107fc0 0x7f24bc19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c2c06640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc111dc0 con 0x7f24bc102ac0 2024-08-18T22:16:36.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c2c06640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc111c40 con 0x7f24bc103470 2024-08-18T22:16:36.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c2c06640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc111f40 con 0x7f24bc107fc0 2024-08-18T22:16:36.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c09a2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24bc102ac0 0x7f24bc1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c09a2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24bc102ac0 0x7f24bc1982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51480/0 (socket says 172.21.15.123:51480) 2024-08-18T22:16:36.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c09a2640 1 -- 172.21.15.123:0/1018366379 learned_addr learned my addr 172.21.15.123:0/1018366379 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:36.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24b3fff640 1 --2- 172.21.15.123:0/1018366379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24bc103470 0x7f24bc198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c11a3640 1 --2- 172.21.15.123:0/1018366379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24bc107fc0 0x7f24bc19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c09a2640 1 -- 172.21.15.123:0/1018366379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24bc107fc0 msgr2=0x7f24bc19cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:36.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c09a2640 1 --2- 172.21.15.123:0/1018366379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24bc107fc0 0x7f24bc19cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c09a2640 1 -- 172.21.15.123:0/1018366379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24bc103470 msgr2=0x7f24bc198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:36.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c09a2640 1 --2- 172.21.15.123:0/1018366379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24bc103470 0x7f24bc198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c09a2640 1 -- 172.21.15.123:0/1018366379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc19d280 con 0x7f24bc102ac0 2024-08-18T22:16:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c11a3640 1 --2- 172.21.15.123:0/1018366379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24bc107fc0 0x7f24bc19cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:16:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c09a2640 1 --2- 172.21.15.123:0/1018366379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24bc102ac0 0x7f24bc1982d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009230 tx=0x7f24b8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24b1ffb640 1 -- 172.21.15.123:0/1018366379 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b803f030 con 0x7f24bc102ac0 2024-08-18T22:16:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24b1ffb640 1 -- 172.21.15.123:0/1018366379 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24b8003ad0 con 0x7f24bc102ac0 2024-08-18T22:16:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24c2c06640 1 -- 172.21.15.123:0/1018366379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24bc19d510 con 0x7f24bc102ac0 2024-08-18T22:16:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.441+0000 7f24b1ffb640 1 -- 172.21.15.123:0/1018366379 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b8035070 con 0x7f24bc102ac0 2024-08-18T22:16:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.442+0000 7f24c2c06640 1 -- 172.21.15.123:0/1018366379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24bc1a4e50 con 0x7f24bc102ac0 2024-08-18T22:16:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.444+0000 7f24b1ffb640 1 -- 172.21.15.123:0/1018366379 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f24b8042030 con 0x7f24bc102ac0 2024-08-18T22:16:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.444+0000 7f24c5004740 1 Processor -- start 2024-08-18T22:16:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.444+0000 7f24c5004740 1 -- start start 2024-08-18T22:16:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.444+0000 7f24c5004740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5303072c0 0x55a5303076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.444+0000 7f24c5004740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a530307be0 0x55a530311f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.444+0000 7f24b1ffb640 1 --2- 172.21.15.123:0/1018366379 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f24a40a2b80 0x7f24a40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.444+0000 7f24c5004740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a530314890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.444+0000 7f24c5004740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55a53026c810 con 0x55a5303124a0 2024-08-18T22:16:36.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.444+0000 7f24c5004740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a530213c70 con 0x55a5303072c0 2024-08-18T22:16:36.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.444+0000 7f24c5004740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a5302687d0 con 0x55a530307be0 2024-08-18T22:16:36.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.444+0000 7f24c11a3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a530314890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24c11a3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a530314890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51488/0 (socket says 172.21.15.123:51488) 2024-08-18T22:16:36.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24c11a3640 1 -- 172.21.15.123:0/1950905905 learned_addr learned my addr 172.21.15.123:0/1950905905 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:36.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24b3fff640 1 --2- 172.21.15.123:0/1018366379 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f24a40a2b80 0x7f24a40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24b1ffb640 1 -- 172.21.15.123:0/1018366379 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f24b80ef8d0 con 0x7f24bc102ac0 2024-08-18T22:16:36.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24c09a2640 1 --2- 172.21.15.123:0/1950905905 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a530307be0 0x55a530311f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24c11a3640 1 --2- 172.21.15.123:0/1950905905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5303072c0 0x55a5303076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24c11a3640 1 -- 172.21.15.123:0/1950905905 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a530307be0 msgr2=0x55a530311f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:36.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24c11a3640 1 --2- 172.21.15.123:0/1950905905 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a530307be0 0x55a530311f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24c11a3640 1 -- 172.21.15.123:0/1950905905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5303072c0 msgr2=0x55a5303076a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:36.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24c11a3640 1 --2- 172.21.15.123:0/1950905905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5303072c0 0x55a5303076a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24c11a3640 1 -- 172.21.15.123:0/1950905905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a52ffdeba0 con 0x55a5303124a0 2024-08-18T22:16:36.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24c11a3640 1 --2- 172.21.15.123:0/1950905905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a530314890 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f24b40134b0 tx=0x7f24b4009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84463583a9b015bc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:36.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24b3fff640 1 --2- 172.21.15.123:0/1018366379 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f24a40a2b80 0x7f24a40a5040 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0febb0 tx=0x7f24ac00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:36.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24a2ffd640 1 -- 172.21.15.123:0/1950905905 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b4004d20 con 0x55a5303124a0 2024-08-18T22:16:36.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24a2ffd640 1 -- 172.21.15.123:0/1950905905 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24b4017070 con 0x55a5303124a0 2024-08-18T22:16:36.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.445+0000 7f24a2ffd640 1 -- 172.21.15.123:0/1950905905 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b4011820 con 0x55a5303124a0 2024-08-18T22:16:36.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.446+0000 7f24c5004740 1 -- 172.21.15.123:0/1950905905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 msgr2=0x55a530314890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:36.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.446+0000 7f24c5004740 1 --2- 172.21.15.123:0/1950905905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a530314890 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f24b40134b0 tx=0x7f24b4009810 comp rx=0 tx=0).stop 2024-08-18T22:16:36.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.446+0000 7f24c5004740 1 -- 172.21.15.123:0/1950905905 shutdown_connections 2024-08-18T22:16:36.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.446+0000 7f24c5004740 1 --2- 172.21.15.123:0/1950905905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a530314890 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.446+0000 7f24c5004740 1 --2- 172.21.15.123:0/1950905905 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a530307be0 0x55a530311f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.446+0000 7f24c5004740 1 --2- 172.21.15.123:0/1950905905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5303072c0 0x55a5303076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.446+0000 7f24c5004740 1 -- 172.21.15.123:0/1950905905 >> 172.21.15.123:0/1950905905 conn(0x55a530303850 msgr2=0x55a530303c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.446+0000 7f24c5004740 1 -- 172.21.15.123:0/1950905905 shutdown_connections 2024-08-18T22:16:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.446+0000 7f24c5004740 1 -- 172.21.15.123:0/1950905905 wait complete. 2024-08-18T22:16:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.446+0000 7f24c5004740 1 -- start start 2024-08-18T22:16:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.446+0000 7f24c5004740 1 Processor -- start 2024-08-18T22:16:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c5004740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5303072c0 0x55a53030f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c5004740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a530307be0 0x55a53030fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c5004740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a530310050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c5004740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55a530314fb0 con 0x55a5303124a0 2024-08-18T22:16:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c5004740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a5302279a0 con 0x55a530307be0 2024-08-18T22:16:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c5004740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a530315130 con 0x55a5303072c0 2024-08-18T22:16:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c11a3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a530310050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c5004740 10 client.0 _ll_register_callbacks cb 0x55a530215c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:16:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c11a3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a530310050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51502/0 (socket says 172.21.15.123:51502) 2024-08-18T22:16:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c11a3640 1 -- 172.21.15.123:0/620691572 learned_addr learned my addr 172.21.15.123:0/620691572 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:36.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24b3fff640 1 --2- 172.21.15.123:0/620691572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a530307be0 0x55a53030fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c09a2640 1 --2- 172.21.15.123:0/620691572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5303072c0 0x55a53030f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c11a3640 1 -- 172.21.15.123:0/620691572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5303072c0 msgr2=0x55a53030f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:36.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c11a3640 1 --2- 172.21.15.123:0/620691572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5303072c0 0x55a53030f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c11a3640 1 -- 172.21.15.123:0/620691572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a530307be0 msgr2=0x55a53030fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:36.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c11a3640 1 --2- 172.21.15.123:0/620691572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a530307be0 0x55a53030fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24c11a3640 1 -- 172.21.15.123:0/620691572 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a530233220 con 0x55a5303124a0 2024-08-18T22:16:36.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.447+0000 7f24b3fff640 1 --2- 172.21.15.123:0/620691572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a530307be0 0x55a53030fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:16:36.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f24c11a3640 1 --2- 172.21.15.123:0/620691572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a530310050 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f24b4006010 tx=0x7f24b40095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19b6d7ddffaf7a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:36.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f249bfff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:16:36.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f249bfff640 1 -- 172.21.15.123:0/620691572 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b4029060 con 0x55a5303124a0 2024-08-18T22:16:36.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f24c5004740 1 -- 172.21.15.123:0/620691572 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24b4017070 con 0x55a5303124a0 2024-08-18T22:16:36.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f249bfff640 1 -- 172.21.15.123:0/620691572 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f24b4004d10 con 0x55a5303124a0 2024-08-18T22:16:36.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f249bfff640 1 -- 172.21.15.123:0/620691572 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f24b4030050 con 0x55a5303124a0 2024-08-18T22:16:36.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f24c5004740 10 client.16983 fetch_fsmap learned FSMap version 36 2024-08-18T22:16:36.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f24c5004740 1 -- 172.21.15.123:0/620691572 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a530320e80 con 0x55a5303124a0 2024-08-18T22:16:36.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f249bfff640 1 -- 172.21.15.123:0/620691572 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24b4017070 con 0x55a5303124a0 2024-08-18T22:16:36.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f249bfff640 1 -- 172.21.15.123:0/620691572 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7f24b4011a30 con 0x55a5303124a0 2024-08-18T22:16:36.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f24c5004740 10 client.16983 fetch_fsmap finished waiting for FSMap version 36 2024-08-18T22:16:36.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f24c5004740 10 client.16983 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:16:36.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f24c5004740 20 client.16983 populate_metadata read hostname 'smithi123' 2024-08-18T22:16:36.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f24c5004740 1 --2- 172.21.15.123:0/620691572 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55a530322290 0x55a530324680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f24c5004740 4 client.16983 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:16:36.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.448+0000 7f24c5004740 1 -- 172.21.15.123:0/620691572 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a530279f40 con 0x55a530322290 2024-08-18T22:16:36.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.449+0000 7f24c09a2640 1 --2- 172.21.15.123:0/620691572 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55a530322290 0x55a530324680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.449+0000 7f249bfff640 10 client.16983 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:16:36.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.449+0000 7f24c09a2640 1 --2- 172.21.15.123:0/620691572 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55a530322290 0x55a530324680 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34a0c6657c00031f server_cookie=792f07f798adb897 in_seq=0 out_seq=0 2024-08-18T22:16:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.450+0000 7f249bfff640 1 -- 172.21.15.123:0/620691572 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a530279f40 con 0x55a530322290 2024-08-18T22:16:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.450+0000 7f249bfff640 10 client.16983 handle_command_reply: tid=0 2024-08-18T22:16:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.450+0000 7f24c5004740 1 client.16983 shutdown 2024-08-18T22:16:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.450+0000 7f24c5004740 1 -- 172.21.15.123:0/620691572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 msgr2=0x55a530310050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.450+0000 7f24c5004740 1 --2- 172.21.15.123:0/620691572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a530310050 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f24b4006010 tx=0x7f24b40095f0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.450+0000 7f24c5004740 1 -- 172.21.15.123:0/620691572 shutdown_connections 2024-08-18T22:16:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.450+0000 7f24c5004740 1 --2- 172.21.15.123:0/620691572 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55a530322290 0x55a530324680 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.450+0000 7f24c5004740 1 --2- 172.21.15.123:0/620691572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a530310050 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.450+0000 7f24c5004740 1 --2- 172.21.15.123:0/620691572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a530307be0 0x55a53030fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.450+0000 7f24c5004740 1 --2- 172.21.15.123:0/620691572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5303072c0 0x55a53030f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.450+0000 7f249bfff640 0 client.16983 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:16:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.450+0000 7f24c5004740 1 -- 172.21.15.123:0/620691572 >> 172.21.15.123:0/620691572 conn(0x55a530303850 msgr2=0x55a530302b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.450+0000 7f24c5004740 1 -- 172.21.15.123:0/620691572 shutdown_connections 2024-08-18T22:16:36.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.450+0000 7f24c5004740 1 -- 172.21.15.123:0/620691572 wait complete. 2024-08-18T22:16:36.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.450+0000 7f24c5004740 20 client.16983 trim_cache size 0 max 16384 2024-08-18T22:16:36.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c5004740 1 Processor -- start 2024-08-18T22:16:36.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c5004740 1 -- start start 2024-08-18T22:16:36.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c5004740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5303072c0 0x55a530302980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c5004740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a530307be0 0x55a53030dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c5004740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a53031a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c5004740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc1b1410 con 0x55a5303124a0 2024-08-18T22:16:36.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c5004740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc1aec20 con 0x55a530307be0 2024-08-18T22:16:36.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c5004740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc1aca70 con 0x55a5303072c0 2024-08-18T22:16:36.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c11a3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a53031a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c11a3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a53031a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51518/0 (socket says 172.21.15.123:51518) 2024-08-18T22:16:36.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c11a3640 1 -- 172.21.15.123:0/954242445 learned_addr learned my addr 172.21.15.123:0/954242445 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:36.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c09a2640 1 --2- 172.21.15.123:0/954242445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5303072c0 0x55a530302980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24b3fff640 1 --2- 172.21.15.123:0/954242445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a530307be0 0x55a53030dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c11a3640 1 -- 172.21.15.123:0/954242445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5303072c0 msgr2=0x55a530302980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:36.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c11a3640 1 --2- 172.21.15.123:0/954242445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5303072c0 0x55a530302980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c11a3640 1 -- 172.21.15.123:0/954242445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a530307be0 msgr2=0x55a53030dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:36.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c11a3640 1 --2- 172.21.15.123:0/954242445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a530307be0 0x55a53030dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24c11a3640 1 -- 172.21.15.123:0/954242445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a530312120 con 0x55a5303124a0 2024-08-18T22:16:36.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.467+0000 7f24b3fff640 1 --2- 172.21.15.123:0/954242445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a530307be0 0x55a53030dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:16:36.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.468+0000 7f24c11a3640 1 --2- 172.21.15.123:0/954242445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a53031a760 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f24b4013fc0 tx=0x7f24b4009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c6e50608b6203 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:36.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.468+0000 7f24a27fc640 1 -- 172.21.15.123:0/954242445 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b4009b50 con 0x55a5303124a0 2024-08-18T22:16:36.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.468+0000 7f24a27fc640 1 -- 172.21.15.123:0/954242445 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24b4017070 con 0x55a5303124a0 2024-08-18T22:16:36.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.468+0000 7f24a27fc640 1 -- 172.21.15.123:0/954242445 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b4011700 con 0x55a5303124a0 2024-08-18T22:16:36.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.468+0000 7f24c5004740 1 -- 172.21.15.123:0/954242445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 msgr2=0x55a53031a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:36.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.468+0000 7f24c5004740 1 --2- 172.21.15.123:0/954242445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a53031a760 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f24b4013fc0 tx=0x7f24b4009670 comp rx=0 tx=0).stop 2024-08-18T22:16:36.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.468+0000 7f24c5004740 1 -- 172.21.15.123:0/954242445 shutdown_connections 2024-08-18T22:16:36.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.468+0000 7f24c5004740 1 --2- 172.21.15.123:0/954242445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a5303124a0 0x55a53031a760 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.468+0000 7f24c5004740 1 --2- 172.21.15.123:0/954242445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a530307be0 0x55a53030dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.468+0000 7f24c5004740 1 --2- 172.21.15.123:0/954242445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5303072c0 0x55a530302980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.468+0000 7f24c5004740 1 -- 172.21.15.123:0/954242445 >> 172.21.15.123:0/954242445 conn(0x55a530303850 msgr2=0x55a530311650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:36.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.468+0000 7f24c5004740 1 -- 172.21.15.123:0/954242445 shutdown_connections 2024-08-18T22:16:36.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.468+0000 7f24c5004740 1 -- 172.21.15.123:0/954242445 wait complete. 2024-08-18T22:16:36.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.469+0000 7f24c5004740 1 -- start start 2024-08-18T22:16:36.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.469+0000 7f24c5004740 1 Processor -- start 2024-08-18T22:16:36.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.469+0000 7f24c5004740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5303072c0 0x55a53030d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.469+0000 7f24c5004740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a530307be0 0x55a53030b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.469+0000 7f24c5004740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5303124a0 0x55a53030bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.469+0000 7f24c5004740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc1ad0e0 con 0x55a530307be0 2024-08-18T22:16:36.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.469+0000 7f24c5004740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc1ae550 con 0x55a5303124a0 2024-08-18T22:16:36.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.469+0000 7f24c5004740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc1ad7b0 con 0x55a5303072c0 2024-08-18T22:16:36.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.469+0000 7f24c5004740 10 client.0 _ll_register_callbacks cb 0x7f24b8009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:16:36.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.469+0000 7f24b3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a530307be0 0x55a53030b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.469+0000 7f24b3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a530307be0 0x55a53030b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51526/0 (socket says 172.21.15.123:51526) 2024-08-18T22:16:36.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.469+0000 7f24b3fff640 1 -- 172.21.15.123:0/3425645806 learned_addr learned my addr 172.21.15.123:0/3425645806 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:36.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.469+0000 7f24c09a2640 1 --2- 172.21.15.123:0/3425645806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5303072c0 0x55a53030d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.469+0000 7f24c11a3640 1 --2- 172.21.15.123:0/3425645806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5303124a0 0x55a53030bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.470+0000 7f24b3fff640 1 -- 172.21.15.123:0/3425645806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5303072c0 msgr2=0x55a53030d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:36.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.470+0000 7f24b3fff640 1 --2- 172.21.15.123:0/3425645806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5303072c0 0x55a53030d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.470+0000 7f24b3fff640 1 -- 172.21.15.123:0/3425645806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5303124a0 msgr2=0x55a53030bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:36.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.470+0000 7f24b3fff640 1 --2- 172.21.15.123:0/3425645806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5303124a0 0x55a53030bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.470+0000 7f24b3fff640 1 -- 172.21.15.123:0/3425645806 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a53030c430 con 0x55a530307be0 2024-08-18T22:16:36.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.470+0000 7f24b3fff640 1 --2- 172.21.15.123:0/3425645806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a530307be0 0x55a53030b880 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f24bc069500 tx=0x7f24ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc981cff7ad282b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:36.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.470+0000 7f249bfff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:16:36.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.470+0000 7f249bfff640 1 -- 172.21.15.123:0/3425645806 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac02a060 con 0x55a530307be0 2024-08-18T22:16:36.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.470+0000 7f249bfff640 1 -- 172.21.15.123:0/3425645806 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f24ac01b620 con 0x55a530307be0 2024-08-18T22:16:36.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.470+0000 7f24c5004740 1 -- 172.21.15.123:0/3425645806 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24b4017070 con 0x55a530307be0 2024-08-18T22:16:36.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.470+0000 7f249bfff640 1 -- 172.21.15.123:0/3425645806 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f24ac016070 con 0x55a530307be0 2024-08-18T22:16:36.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.470+0000 7f24c5004740 10 client.16989 fetch_fsmap learned FSMap version 36 2024-08-18T22:16:36.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.470+0000 7f24c5004740 1 -- 172.21.15.123:0/3425645806 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a530391b40 con 0x55a530307be0 2024-08-18T22:16:36.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.470+0000 7f249bfff640 1 -- 172.21.15.123:0/3425645806 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24b4017070 con 0x55a530307be0 2024-08-18T22:16:36.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.470+0000 7f249bfff640 1 -- 172.21.15.123:0/3425645806 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7f24ac0047a0 con 0x55a530307be0 2024-08-18T22:16:36.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.471+0000 7f24c5004740 10 client.16989 fetch_fsmap finished waiting for FSMap version 36 2024-08-18T22:16:36.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.471+0000 7f24c5004740 10 client.16989 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:16:36.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.471+0000 7f24c5004740 20 client.16989 populate_metadata read hostname 'smithi123' 2024-08-18T22:16:36.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.471+0000 7f24c5004740 1 --2- 172.21.15.123:0/3425645806 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55a5303923f0 0x55a530394810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:36.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.471+0000 7f24c5004740 4 client.16989 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.75, "await_for": 45.0}] 2024-08-18T22:16:36.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.471+0000 7f24c5004740 1 -- 172.21.15.123:0/3425645806 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.75, "await_for": 45.0}) -- 0x55a530274290 con 0x55a5303923f0 2024-08-18T22:16:36.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.471+0000 7f24c09a2640 1 --2- 172.21.15.123:0/3425645806 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55a5303923f0 0x55a530394810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:36.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.471+0000 7f249bfff640 10 client.16989 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:16:36.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.471+0000 7f24c09a2640 1 --2- 172.21.15.123:0/3425645806 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55a5303923f0 0x55a530394810 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aae92539b573eb9f server_cookie=6180e5c524d7e634 in_seq=0 out_seq=0 2024-08-18T22:16:36.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.477+0000 7f249bfff640 1 -- 172.21.15.123:0/3425645806 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a530274290 con 0x55a5303923f0 2024-08-18T22:16:36.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.477+0000 7f249bfff640 10 client.16989 handle_command_reply: tid=0 2024-08-18T22:16:36.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.477+0000 7f24c5004740 1 client.16989 shutdown 2024-08-18T22:16:36.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.478+0000 7f24c5004740 1 -- 172.21.15.123:0/3425645806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a530307be0 msgr2=0x55a53030b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:36.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.478+0000 7f24c5004740 1 --2- 172.21.15.123:0/3425645806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a530307be0 0x55a53030b880 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f24bc069500 tx=0x7f24ac004730 comp rx=0 tx=0).stop 2024-08-18T22:16:36.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.478+0000 7f24c5004740 1 -- 172.21.15.123:0/3425645806 shutdown_connections 2024-08-18T22:16:36.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.478+0000 7f24c5004740 1 --2- 172.21.15.123:0/3425645806 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x55a5303923f0 0x55a530394810 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.478+0000 7f24c5004740 1 --2- 172.21.15.123:0/3425645806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5303124a0 0x55a53030bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.478+0000 7f24c5004740 1 --2- 172.21.15.123:0/3425645806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a530307be0 0x55a53030b880 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.478+0000 7f249bfff640 0 client.16989 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:16:36.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.478+0000 7f24c5004740 1 --2- 172.21.15.123:0/3425645806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5303072c0 0x55a53030d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.478+0000 7f24c5004740 1 -- 172.21.15.123:0/3425645806 >> 172.21.15.123:0/3425645806 conn(0x55a530303850 msgr2=0x55a530310e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:36.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.478+0000 7f24c5004740 1 -- 172.21.15.123:0/3425645806 shutdown_connections 2024-08-18T22:16:36.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.478+0000 7f24c5004740 1 -- 172.21.15.123:0/3425645806 wait complete. 2024-08-18T22:16:36.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.478+0000 7f24c5004740 20 client.16989 trim_cache size 0 max 16384 2024-08-18T22:16:36.493 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:16:36.493 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 36, 2024-08-18T22:16:36.493 INFO:teuthology.orchestra.run.smithi123.stdout: "leader": 24466, 2024-08-18T22:16:36.493 INFO:teuthology.orchestra.run.smithi123.stdout: "set_version": 26, 2024-08-18T22:16:36.493 INFO:teuthology.orchestra.run.smithi123.stdout: "sets": { 2024-08-18T22:16:36.493 INFO:teuthology.orchestra.run.smithi123.stdout: "e14923df": { 2024-08-18T22:16:36.493 INFO:teuthology.orchestra.run.smithi123.stdout: "version": 26, 2024-08-18T22:16:36.493 INFO:teuthology.orchestra.run.smithi123.stdout: "age_ref": 0.0, 2024-08-18T22:16:36.493 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:16:36.493 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "QUIESCED", 2024-08-18T22:16:36.493 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:16:36.494 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:36.494 INFO:teuthology.orchestra.run.smithi123.stdout: "timeout": 90.0, 2024-08-18T22:16:36.494 INFO:teuthology.orchestra.run.smithi123.stdout: "expiration": 143.8, 2024-08-18T22:16:36.494 INFO:teuthology.orchestra.run.smithi123.stdout: "members": { 2024-08-18T22:16:36.494 INFO:teuthology.orchestra.run.smithi123.stdout: "file:/": { 2024-08-18T22:16:36.494 INFO:teuthology.orchestra.run.smithi123.stdout: "excluded": false, 2024-08-18T22:16:36.494 INFO:teuthology.orchestra.run.smithi123.stdout: "state": { 2024-08-18T22:16:36.494 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "QUIESCED", 2024-08-18T22:16:36.494 INFO:teuthology.orchestra.run.smithi123.stdout: "age": 0.0 2024-08-18T22:16:36.494 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:36.494 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:36.495 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:36.495 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:36.495 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:36.495 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:16:36.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.478+0000 7f24c2c06640 1 -- 172.21.15.123:0/1018366379 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f24a40a2b80 msgr2=0x7f24a40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:36.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.478+0000 7f24c2c06640 1 --2- 172.21.15.123:0/1018366379 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f24a40a2b80 0x7f24a40a5040 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0febb0 tx=0x7f24ac00a250 comp rx=0 tx=0).stop 2024-08-18T22:16:36.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.479+0000 7f24c2c06640 1 -- 172.21.15.123:0/1018366379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24bc102ac0 msgr2=0x7f24bc1982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:36.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.479+0000 7f24c2c06640 1 --2- 172.21.15.123:0/1018366379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24bc102ac0 0x7f24bc1982d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009230 tx=0x7f24b8004270 comp rx=0 tx=0).stop 2024-08-18T22:16:36.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.479+0000 7f24c2c06640 1 -- 172.21.15.123:0/1018366379 shutdown_connections 2024-08-18T22:16:36.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.479+0000 7f24c2c06640 1 --2- 172.21.15.123:0/1018366379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24bc107fc0 0x7f24bc19cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.479+0000 7f24c2c06640 1 --2- 172.21.15.123:0/1018366379 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f24a40a2b80 0x7f24a40a5040 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.479+0000 7f24c2c06640 1 --2- 172.21.15.123:0/1018366379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24bc103470 0x7f24bc198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.479+0000 7f24c2c06640 1 --2- 172.21.15.123:0/1018366379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24bc102ac0 0x7f24bc1982d0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:36.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.479+0000 7f24c2c06640 1 -- 172.21.15.123:0/1018366379 >> 172.21.15.123:0/1018366379 conn(0x7f24bc0fc500 msgr2=0x7f24bc105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:36.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.479+0000 7f24c2c06640 1 -- 172.21.15.123:0/1018366379 shutdown_connections 2024-08-18T22:16:36.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:36.479+0000 7f24c2c06640 1 -- 172.21.15.123:0/1018366379 wait complete. 2024-08-18T22:16:37.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:37 smithi123 ceph-mon[18462]: pgmap v609: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-18T22:16:37.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:37 smithi183 ceph-mon[22097]: pgmap v609: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-18T22:16:37.422 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e14923df', quiesce took 3.6 seconds. Will release after: 20.15 2024-08-18T22:16:37.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:37 smithi130 ceph-mon[21698]: pgmap v609: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-18T22:16:39.203 INFO:tasks.workunit.client.0.smithi123.stderr:+ set -e 2024-08-18T22:16:39.203 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo rsync -av /tmp/multiple_rsync_payload.185527 payload.1 2024-08-18T22:16:39.234 INFO:tasks.workunit.client.0.smithi123.stdout:sending incremental file list 2024-08-18T22:16:39.235 INFO:tasks.workunit.client.0.smithi123.stderr:rsync: [Receiver] mkdir "/home/ubuntu/cephtest/mnt.0/client.0/tmp/payload.1" failed: Read-only file system (30) 2024-08-18T22:16:39.236 INFO:tasks.workunit.client.0.smithi123.stderr:rsync error: error in file IO (code 11) at main.c(783) [Receiver=3.2.3] 2024-08-18T22:16:39.241 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-08-18T22:16:39.336 INFO:tasks.workunit:Stopping ['fs/misc'] on client.0... 2024-08-18T22:16:39.337 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-18T22:16:39.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:39 smithi183 ceph-mon[22097]: pgmap v610: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:16:39.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:39 smithi123 ceph-mon[18462]: pgmap v610: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:16:39.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:39 smithi130 ceph-mon[21698]: pgmap v610: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:16:40.295 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi123 with status 11: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh' 2024-08-18T22:16:40.491 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2d9c45e9e6194bcfb522864712786d30 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi123 with status 11: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh' 2024-08-18T22:16:40.493 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-08-18T22:16:40.504 INFO:tasks.quiescer:joining Quiescers 2024-08-18T22:16:40.504 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-08-18T22:16:40.505 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:16:40.758 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:16:41.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.319+0000 7f3177afd640 1 -- 172.21.15.123:0/1369539111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3170101180 msgr2=0x7f3170105650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:41.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.319+0000 7f3177afd640 1 --2- 172.21.15.123:0/1369539111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3170101180 0x7f3170105650 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3160009900 tx=0x7f316002a470 comp rx=0 tx=0).stop 2024-08-18T22:16:41.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.319+0000 7f3177afd640 1 -- 172.21.15.123:0/1369539111 shutdown_connections 2024-08-18T22:16:41.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.319+0000 7f3177afd640 1 --2- 172.21.15.123:0/1369539111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3170105c70 0x7f3170106100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:41.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.319+0000 7f3177afd640 1 --2- 172.21.15.123:0/1369539111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3170101180 0x7f3170105650 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:41.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.319+0000 7f3177afd640 1 --2- 172.21.15.123:0/1369539111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3170100860 0x7f3170100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:41.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.319+0000 7f3177afd640 1 -- 172.21.15.123:0/1369539111 >> 172.21.15.123:0/1369539111 conn(0x7f31700fc4d0 msgr2=0x7f31700fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:41.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.319+0000 7f3177afd640 1 -- 172.21.15.123:0/1369539111 shutdown_connections 2024-08-18T22:16:41.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.319+0000 7f3177afd640 1 -- 172.21.15.123:0/1369539111 wait complete. 2024-08-18T22:16:41.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.320+0000 7f3177afd640 1 Processor -- start 2024-08-18T22:16:41.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.320+0000 7f3177afd640 1 -- start start 2024-08-18T22:16:41.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.320+0000 7f3177afd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3170100860 0x7f31701a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:41.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.320+0000 7f3177afd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3170101180 0x7f31701a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:41.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.320+0000 7f3177afd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3170105c70 0x7f317019e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:41.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.320+0000 7f3177afd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f31701182f0 con 0x7f3170105c70 2024-08-18T22:16:41.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.320+0000 7f3177afd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3170118170 con 0x7f3170100860 2024-08-18T22:16:41.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.320+0000 7f3177afd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3170118470 con 0x7f3170101180 2024-08-18T22:16:41.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f317609a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3170105c70 0x7f317019e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:41.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f317609a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3170105c70 0x7f317019e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51548/0 (socket says 172.21.15.123:51548) 2024-08-18T22:16:41.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f317609a640 1 -- 172.21.15.123:0/1438387029 learned_addr learned my addr 172.21.15.123:0/1438387029 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:41.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f3175098640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3170101180 0x7f31701a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:41.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f3175899640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3170100860 0x7f31701a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:41.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f317609a640 1 -- 172.21.15.123:0/1438387029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3170101180 msgr2=0x7f31701a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:41.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f317609a640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3170101180 0x7f31701a4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:41.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f317609a640 1 -- 172.21.15.123:0/1438387029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3170100860 msgr2=0x7f31701a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:41.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f317609a640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3170100860 0x7f31701a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:41.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f317609a640 1 -- 172.21.15.123:0/1438387029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317019ecd0 con 0x7f3170105c70 2024-08-18T22:16:41.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f3175098640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3170101180 0x7f31701a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:16:41.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f3175899640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3170100860 0x7f31701a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:16:41.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f317609a640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3170105c70 0x7f317019e5a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f316800cce0 tx=0x7f316800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:41.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f3166ffd640 1 -- 172.21.15.123:0/1438387029 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316800f450 con 0x7f3170105c70 2024-08-18T22:16:41.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f3166ffd640 1 -- 172.21.15.123:0/1438387029 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f316800fad0 con 0x7f3170105c70 2024-08-18T22:16:41.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f3166ffd640 1 -- 172.21.15.123:0/1438387029 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3168018c10 con 0x7f3170105c70 2024-08-18T22:16:41.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f3177afd640 1 -- 172.21.15.123:0/1438387029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317019efc0 con 0x7f3170105c70 2024-08-18T22:16:41.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.321+0000 7f3177afd640 1 -- 172.21.15.123:0/1438387029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31701ab2b0 con 0x7f3170105c70 2024-08-18T22:16:41.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.322+0000 7f3177afd640 1 -- 172.21.15.123:0/1438387029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3170105650 con 0x7f3170105c70 2024-08-18T22:16:41.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.323+0000 7f3166ffd640 1 -- 172.21.15.123:0/1438387029 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f316800f5f0 con 0x7f3170105c70 2024-08-18T22:16:41.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.324+0000 7f3166ffd640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f315c0a2b80 0x7f315c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:41.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.324+0000 7f3166ffd640 1 -- 172.21.15.123:0/1438387029 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f31680cfbd0 con 0x7f3170105c70 2024-08-18T22:16:41.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.324+0000 7f3175899640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f315c0a2b80 0x7f315c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:41.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.324+0000 7f3175899640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f315c0a2b80 0x7f315c0a5040 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f316c006fd0 tx=0x7f316c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:41.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.327+0000 7f3166ffd640 1 -- 172.21.15.123:0/1438387029 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3168014030 con 0x7f3170105c70 2024-08-18T22:16:41.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:41 smithi183 ceph-mon[22097]: pgmap v611: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-18T22:16:41.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:41 smithi123 ceph-mon[18462]: pgmap v611: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-18T22:16:41.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:41 smithi130 ceph-mon[21698]: pgmap v611: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-18T22:16:41.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.533+0000 7f3177afd640 1 -- 172.21.15.123:0/1438387029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f317019fad0 con 0x7f3170105c70 2024-08-18T22:16:41.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.534+0000 7f3166ffd640 1 -- 172.21.15.123:0/1438387029 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11930 (secure 0 0 0) 0x7f317019fad0 con 0x7f3170105c70 2024-08-18T22:16:41.535 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:16:41.535 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":36,"btime":"2024-08-18T22:16:19:519031+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:16:18.935695+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":125,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":171,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:16:41.536 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 36 2024-08-18T22:16:41.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.536+0000 7f3177afd640 1 -- 172.21.15.123:0/1438387029 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f315c0a2b80 msgr2=0x7f315c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:41.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.536+0000 7f3177afd640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f315c0a2b80 0x7f315c0a5040 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f316c006fd0 tx=0x7f316c008040 comp rx=0 tx=0).stop 2024-08-18T22:16:41.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.536+0000 7f3177afd640 1 -- 172.21.15.123:0/1438387029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3170105c70 msgr2=0x7f317019e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:41.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.536+0000 7f3177afd640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3170105c70 0x7f317019e5a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f316800cce0 tx=0x7f316800a620 comp rx=0 tx=0).stop 2024-08-18T22:16:41.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.536+0000 7f3177afd640 1 -- 172.21.15.123:0/1438387029 shutdown_connections 2024-08-18T22:16:41.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.536+0000 7f3177afd640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3170105c70 0x7f317019e5a0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:41.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.536+0000 7f3177afd640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3170101180 0x7f31701a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:41.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.536+0000 7f3177afd640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f315c0a2b80 0x7f315c0a5040 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:41.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.536+0000 7f3177afd640 1 --2- 172.21.15.123:0/1438387029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3170100860 0x7f31701a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:41.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.536+0000 7f3177afd640 1 -- 172.21.15.123:0/1438387029 >> 172.21.15.123:0/1438387029 conn(0x7f31700fc4d0 msgr2=0x7f31701035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:41.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.536+0000 7f3177afd640 1 -- 172.21.15.123:0/1438387029 shutdown_connections 2024-08-18T22:16:41.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:41.536+0000 7f3177afd640 1 -- 172.21.15.123:0/1438387029 wait complete. 2024-08-18T22:16:42.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:42 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1438387029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:16:42.322 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24466 quiesce db --cancel --all' 2024-08-18T22:16:42.322 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24466 quiesce db --cancel --all 2024-08-18T22:16:42.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:42 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1438387029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:16:42.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:42 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1438387029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:16:42.572 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:16:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.048+0000 7f15dbda3640 1 -- 172.21.15.123:0/4184604613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15d41007b0 msgr2=0x7f15d4100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.048+0000 7f15dbda3640 1 --2- 172.21.15.123:0/4184604613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15d41007b0 0x7f15d4100c10 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009cd0 tx=0x7f15d002a8e0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.049+0000 7f15dbda3640 1 -- 172.21.15.123:0/4184604613 shutdown_connections 2024-08-18T22:16:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.049+0000 7f15dbda3640 1 --2- 172.21.15.123:0/4184604613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15d4101150 0x7f15d410d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.049+0000 7f15dbda3640 1 --2- 172.21.15.123:0/4184604613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15d41007b0 0x7f15d4100c10 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.049+0000 7f15dbda3640 1 --2- 172.21.15.123:0/4184604613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15d41067b0 0x7f15d4106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.049+0000 7f15dbda3640 1 -- 172.21.15.123:0/4184604613 >> 172.21.15.123:0/4184604613 conn(0x7f15d40fc4d0 msgr2=0x7f15d40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.049+0000 7f15dbda3640 1 -- 172.21.15.123:0/4184604613 shutdown_connections 2024-08-18T22:16:43.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.049+0000 7f15dbda3640 1 -- 172.21.15.123:0/4184604613 wait complete. 2024-08-18T22:16:43.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.049+0000 7f15dbda3640 1 Processor -- start 2024-08-18T22:16:43.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.049+0000 7f15dbda3640 1 -- start start 2024-08-18T22:16:43.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15dbda3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15d41007b0 0x7f15d4199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15dbda3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15d4101150 0x7f15d4199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15dbda3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15d41067b0 0x7f15d41a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15dbda3640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4110b70 con 0x7f15d41067b0 2024-08-18T22:16:43.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15dbda3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41109f0 con 0x7f15d4101150 2024-08-18T22:16:43.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15dbda3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4110cf0 con 0x7f15d41007b0 2024-08-18T22:16:43.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15da340640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15d41067b0 0x7f15d41a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15da340640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15d41067b0 0x7f15d41a40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34882/0 (socket says 172.21.15.123:34882) 2024-08-18T22:16:43.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15da340640 1 -- 172.21.15.123:0/3383253270 learned_addr learned my addr 172.21.15.123:0/3383253270 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:43.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15d9b3f640 1 --2- 172.21.15.123:0/3383253270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15d41007b0 0x7f15d4199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15d933e640 1 --2- 172.21.15.123:0/3383253270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15d4101150 0x7f15d4199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15da340640 1 -- 172.21.15.123:0/3383253270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15d41007b0 msgr2=0x7f15d4199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:43.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15da340640 1 --2- 172.21.15.123:0/3383253270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15d41007b0 0x7f15d4199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15da340640 1 -- 172.21.15.123:0/3383253270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15d4101150 msgr2=0x7f15d4199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:43.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15da340640 1 --2- 172.21.15.123:0/3383253270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15d4101150 0x7f15d4199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15da340640 1 -- 172.21.15.123:0/3383253270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d41a45e0 con 0x7f15d41067b0 2024-08-18T22:16:43.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15da340640 1 --2- 172.21.15.123:0/3383253270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15d41067b0 0x7f15d41a40a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00c970 tx=0x7f15cc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:43.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15caffd640 1 -- 172.21.15.123:0/3383253270 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc007bb0 con 0x7f15d41067b0 2024-08-18T22:16:43.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15caffd640 1 -- 172.21.15.123:0/3383253270 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15cc007d50 con 0x7f15d41067b0 2024-08-18T22:16:43.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15dbda3640 1 -- 172.21.15.123:0/3383253270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d41a47b0 con 0x7f15d41067b0 2024-08-18T22:16:43.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15caffd640 1 -- 172.21.15.123:0/3383253270 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc00f450 con 0x7f15d41067b0 2024-08-18T22:16:43.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.050+0000 7f15dbda3640 1 -- 172.21.15.123:0/3383253270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d41a4cc0 con 0x7f15d41067b0 2024-08-18T22:16:43.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.053+0000 7f15caffd640 1 -- 172.21.15.123:0/3383253270 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f15cc004f60 con 0x7f15d41067b0 2024-08-18T22:16:43.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.053+0000 7f15de1a1740 1 Processor -- start 2024-08-18T22:16:43.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.053+0000 7f15de1a1740 1 -- start start 2024-08-18T22:16:43.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.053+0000 7f15de1a1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d312866a0 0x556d31286a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.053+0000 7f15de1a1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31286fc0 0x556d31291340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.053+0000 7f15de1a1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d31291880 0x556d31293c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.053+0000 7f15de1a1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556d311e78c0 con 0x556d31286fc0 2024-08-18T22:16:43.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.053+0000 7f15de1a1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556d311999e0 con 0x556d31291880 2024-08-18T22:16:43.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.053+0000 7f15de1a1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556d311f5540 con 0x556d312866a0 2024-08-18T22:16:43.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15d9b3f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31286fc0 0x556d31291340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15d9b3f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31286fc0 0x556d31291340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34894/0 (socket says 172.21.15.123:34894) 2024-08-18T22:16:43.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15d9b3f640 1 -- 172.21.15.123:0/841214070 learned_addr learned my addr 172.21.15.123:0/841214070 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:43.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15d933e640 1 --2- 172.21.15.123:0/841214070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d312866a0 0x556d31286a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15caffd640 1 --2- 172.21.15.123:0/3383253270 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f15c00a2c00 0x7f15c00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15d933e640 1 --2- 172.21.15.123:0/841214070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d31291880 0x556d31293c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15da340640 1 --2- 172.21.15.123:0/3383253270 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f15c00a2c00 0x7f15c00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15d9b3f640 1 -- 172.21.15.123:0/841214070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d312866a0 msgr2=0x556d31286a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:43.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15d9b3f640 1 --2- 172.21.15.123:0/841214070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d312866a0 0x556d31286a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15d9b3f640 1 -- 172.21.15.123:0/841214070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d31291880 msgr2=0x556d31293c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:43.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15d9b3f640 1 --2- 172.21.15.123:0/841214070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d31291880 0x556d31293c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15d9b3f640 1 -- 172.21.15.123:0/841214070 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d31183640 con 0x556d31286fc0 2024-08-18T22:16:43.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15caffd640 1 -- 172.21.15.123:0/3383253270 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f15cc0cf090 con 0x7f15d41067b0 2024-08-18T22:16:43.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15d933e640 1 --2- 172.21.15.123:0/841214070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d312866a0 0x556d31286a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:16:43.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15d9b3f640 1 --2- 172.21.15.123:0/841214070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31286fc0 0x556d31291340 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f15c400bc90 tx=0x7f15c40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539678322901b0ca server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:43.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15da340640 1 --2- 172.21.15.123:0/3383253270 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f15c00a2c00 0x7f15c00a50c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f15cc09b260 tx=0x7f15cc06a4e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:43.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15bffff640 1 -- 172.21.15.123:0/841214070 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c401c480 con 0x556d31286fc0 2024-08-18T22:16:43.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15bffff640 1 -- 172.21.15.123:0/841214070 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15c401cb00 con 0x556d31286fc0 2024-08-18T22:16:43.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.054+0000 7f15bffff640 1 -- 172.21.15.123:0/841214070 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4011b90 con 0x556d31286fc0 2024-08-18T22:16:43.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.055+0000 7f15de1a1740 1 -- 172.21.15.123:0/841214070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31286fc0 msgr2=0x556d31291340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:43.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.055+0000 7f15de1a1740 1 --2- 172.21.15.123:0/841214070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31286fc0 0x556d31291340 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f15c400bc90 tx=0x7f15c40107a0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.055+0000 7f15de1a1740 1 -- 172.21.15.123:0/841214070 shutdown_connections 2024-08-18T22:16:43.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.055+0000 7f15de1a1740 1 --2- 172.21.15.123:0/841214070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d31291880 0x556d31293c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.055+0000 7f15de1a1740 1 --2- 172.21.15.123:0/841214070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31286fc0 0x556d31291340 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.055+0000 7f15de1a1740 1 --2- 172.21.15.123:0/841214070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d312866a0 0x556d31286a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.055+0000 7f15de1a1740 1 -- 172.21.15.123:0/841214070 >> 172.21.15.123:0/841214070 conn(0x556d31282c30 msgr2=0x556d31283010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:43.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.055+0000 7f15de1a1740 1 -- 172.21.15.123:0/841214070 shutdown_connections 2024-08-18T22:16:43.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.055+0000 7f15de1a1740 1 -- 172.21.15.123:0/841214070 wait complete. 2024-08-18T22:16:43.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.056+0000 7f15de1a1740 1 -- start start 2024-08-18T22:16:43.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.056+0000 7f15de1a1740 1 Processor -- start 2024-08-18T22:16:43.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.056+0000 7f15de1a1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d312866a0 0x556d31291150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.056+0000 7f15de1a1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d31286fc0 0x556d3128e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.056+0000 7f15de1a1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31291880 0x556d3128e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.056+0000 7f15de1a1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556d311eac10 con 0x556d31291880 2024-08-18T22:16:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.056+0000 7f15de1a1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556d311a9f00 con 0x556d312866a0 2024-08-18T22:16:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.056+0000 7f15de1a1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556d311eff30 con 0x556d31286fc0 2024-08-18T22:16:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.056+0000 7f15de1a1740 10 client.0 _ll_register_callbacks cb 0x556d30efab20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:16:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.056+0000 7f15d933e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31291880 0x556d3128e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.056+0000 7f15d933e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31291880 0x556d3128e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34896/0 (socket says 172.21.15.123:34896) 2024-08-18T22:16:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.056+0000 7f15d933e640 1 -- 172.21.15.123:0/3905995144 learned_addr learned my addr 172.21.15.123:0/3905995144 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.056+0000 7f15d933e640 1 --2- 172.21.15.123:0/3905995144 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d312866a0 0x556d31291150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.056+0000 7f15d9b3f640 1 --2- 172.21.15.123:0/3905995144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d31286fc0 0x556d3128e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.057+0000 7f15d933e640 1 -- 172.21.15.123:0/3905995144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d31286fc0 msgr2=0x556d3128e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.057+0000 7f15d933e640 1 --2- 172.21.15.123:0/3905995144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d31286fc0 0x556d3128e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.057+0000 7f15d933e640 1 -- 172.21.15.123:0/3905995144 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d312866a0 msgr2=0x556d31291150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.057+0000 7f15d933e640 1 --2- 172.21.15.123:0/3905995144 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d312866a0 0x556d31291150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.057+0000 7f15d933e640 1 -- 172.21.15.123:0/3905995144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d30f5d620 con 0x556d31291880 2024-08-18T22:16:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.057+0000 7f15d933e640 1 --2- 172.21.15.123:0/3905995144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31291880 0x556d3128e940 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009cd0 tx=0x7f15d00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac91d9b684941075 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.057+0000 7f15bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:16:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.057+0000 7f15bd7fa640 1 -- 172.21.15.123:0/3905995144 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d0003b80 con 0x556d31291880 2024-08-18T22:16:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.057+0000 7f15de1a1740 1 -- 172.21.15.123:0/3905995144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15c401cb00 con 0x556d31291880 2024-08-18T22:16:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.057+0000 7f15bd7fa640 1 -- 172.21.15.123:0/3905995144 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f15d0003d20 con 0x556d31291880 2024-08-18T22:16:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.057+0000 7f15bd7fa640 1 -- 172.21.15.123:0/3905995144 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f15d0030910 con 0x556d31291880 2024-08-18T22:16:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.057+0000 7f15de1a1740 10 client.17007 fetch_fsmap learned FSMap version 36 2024-08-18T22:16:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.057+0000 7f15de1a1740 1 -- 172.21.15.123:0/3905995144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x556d3129fe70 con 0x556d31291880 2024-08-18T22:16:43.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.057+0000 7f15bd7fa640 1 -- 172.21.15.123:0/3905995144 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15c401cb00 con 0x556d31291880 2024-08-18T22:16:43.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.057+0000 7f15bd7fa640 1 -- 172.21.15.123:0/3905995144 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7f15d0030070 con 0x556d31291880 2024-08-18T22:16:43.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.058+0000 7f15de1a1740 10 client.17007 fetch_fsmap finished waiting for FSMap version 36 2024-08-18T22:16:43.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.058+0000 7f15de1a1740 10 client.17007 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:16:43.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.058+0000 7f15de1a1740 20 client.17007 populate_metadata read hostname 'smithi123' 2024-08-18T22:16:43.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.058+0000 7f15de1a1740 1 --2- 172.21.15.123:0/3905995144 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556d312a1280 0x556d312a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.058+0000 7f15de1a1740 4 client.17007 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:16:43.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.058+0000 7f15de1a1740 1 -- 172.21.15.123:0/3905995144 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d311f8e70 con 0x556d312a1280 2024-08-18T22:16:43.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.058+0000 7f15d9b3f640 1 --2- 172.21.15.123:0/3905995144 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556d312a1280 0x556d312a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.058+0000 7f15bd7fa640 10 client.17007 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:16:43.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.058+0000 7f15d9b3f640 1 --2- 172.21.15.123:0/3905995144 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556d312a1280 0x556d312a36c0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36f94d7976b91f8 server_cookie=5bede661cfaa2339 in_seq=0 out_seq=0 2024-08-18T22:16:43.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.059+0000 7f15bd7fa640 1 -- 172.21.15.123:0/3905995144 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556d311f8e70 con 0x556d312a1280 2024-08-18T22:16:43.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.059+0000 7f15bd7fa640 10 client.17007 handle_command_reply: tid=0 2024-08-18T22:16:43.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.059+0000 7f15de1a1740 1 client.17007 shutdown 2024-08-18T22:16:43.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.059+0000 7f15de1a1740 1 -- 172.21.15.123:0/3905995144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31291880 msgr2=0x556d3128e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:43.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.059+0000 7f15de1a1740 1 --2- 172.21.15.123:0/3905995144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31291880 0x556d3128e940 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009cd0 tx=0x7f15d00095c0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.059+0000 7f15de1a1740 1 -- 172.21.15.123:0/3905995144 shutdown_connections 2024-08-18T22:16:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.059+0000 7f15de1a1740 1 --2- 172.21.15.123:0/3905995144 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556d312a1280 0x556d312a36c0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.059+0000 7f15de1a1740 1 --2- 172.21.15.123:0/3905995144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31291880 0x556d3128e940 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.059+0000 7f15bd7fa640 0 client.17007 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:16:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.059+0000 7f15de1a1740 1 --2- 172.21.15.123:0/3905995144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d31286fc0 0x556d3128e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.059+0000 7f15de1a1740 1 --2- 172.21.15.123:0/3905995144 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d312866a0 0x556d31291150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.059+0000 7f15de1a1740 1 -- 172.21.15.123:0/3905995144 >> 172.21.15.123:0/3905995144 conn(0x556d31282c30 msgr2=0x556d31288910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.059+0000 7f15de1a1740 1 -- 172.21.15.123:0/3905995144 shutdown_connections 2024-08-18T22:16:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.059+0000 7f15de1a1740 1 -- 172.21.15.123:0/3905995144 wait complete. 2024-08-18T22:16:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.059+0000 7f15de1a1740 20 client.17007 trim_cache size 0 max 16384 2024-08-18T22:16:43.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.076+0000 7f15de1a1740 1 Processor -- start 2024-08-18T22:16:43.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.076+0000 7f15de1a1740 1 -- start start 2024-08-18T22:16:43.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.076+0000 7f15de1a1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d312866a0 0x556d3128ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.076+0000 7f15de1a1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d31286fc0 0x556d312a8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.076+0000 7f15de1a1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31291880 0x556d312a9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.076+0000 7f15de1a1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41aec50 con 0x556d31291880 2024-08-18T22:16:43.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.076+0000 7f15de1a1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41acaa0 con 0x556d312866a0 2024-08-18T22:16:43.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.076+0000 7f15de1a1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41ae580 con 0x556d31286fc0 2024-08-18T22:16:43.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.076+0000 7f15d933e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31291880 0x556d312a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.076+0000 7f15d933e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31291880 0x556d312a9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34912/0 (socket says 172.21.15.123:34912) 2024-08-18T22:16:43.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.076+0000 7f15d933e640 1 -- 172.21.15.123:0/2640358278 learned_addr learned my addr 172.21.15.123:0/2640358278 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:43.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.076+0000 7f15d9b3f640 1 --2- 172.21.15.123:0/2640358278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d31286fc0 0x556d312a8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.077+0000 7f15d933e640 1 --2- 172.21.15.123:0/2640358278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d312866a0 0x556d3128ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.077+0000 7f15d933e640 1 -- 172.21.15.123:0/2640358278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d31286fc0 msgr2=0x556d312a8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.077+0000 7f15d933e640 1 --2- 172.21.15.123:0/2640358278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d31286fc0 0x556d312a8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.077+0000 7f15d933e640 1 -- 172.21.15.123:0/2640358278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d312866a0 msgr2=0x556d3128ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.077+0000 7f15d933e640 1 --2- 172.21.15.123:0/2640358278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d312866a0 0x556d3128ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.077+0000 7f15d933e640 1 -- 172.21.15.123:0/2640358278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d31283dc0 con 0x556d31291880 2024-08-18T22:16:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.077+0000 7f15d933e640 1 --2- 172.21.15.123:0/2640358278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31291880 0x556d312a9510 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f15d002ae00 tx=0x7f15d002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f958de360d69af83 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.077+0000 7f15bf7fe640 1 -- 172.21.15.123:0/2640358278 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d004b3f0 con 0x556d31291880 2024-08-18T22:16:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.077+0000 7f15bf7fe640 1 -- 172.21.15.123:0/2640358278 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15d0041030 con 0x556d31291880 2024-08-18T22:16:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.077+0000 7f15bf7fe640 1 -- 172.21.15.123:0/2640358278 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d0030da0 con 0x556d31291880 2024-08-18T22:16:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 -- 172.21.15.123:0/2640358278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31291880 msgr2=0x556d312a9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 --2- 172.21.15.123:0/2640358278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31291880 0x556d312a9510 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f15d002ae00 tx=0x7f15d002a8e0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 -- 172.21.15.123:0/2640358278 shutdown_connections 2024-08-18T22:16:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 --2- 172.21.15.123:0/2640358278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31291880 0x556d312a9510 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 --2- 172.21.15.123:0/2640358278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d31286fc0 0x556d312a8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 --2- 172.21.15.123:0/2640358278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d312866a0 0x556d3128ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 -- 172.21.15.123:0/2640358278 >> 172.21.15.123:0/2640358278 conn(0x556d31282c30 msgr2=0x556d31290480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 -- 172.21.15.123:0/2640358278 shutdown_connections 2024-08-18T22:16:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 -- 172.21.15.123:0/2640358278 wait complete. 2024-08-18T22:16:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 -- start start 2024-08-18T22:16:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 Processor -- start 2024-08-18T22:16:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d312866a0 0x556d31297b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31286fc0 0x556d31298070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d31291880 0x556d31304f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41ad7e0 con 0x556d31286fc0 2024-08-18T22:16:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41ad110 con 0x556d312866a0 2024-08-18T22:16:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.078+0000 7f15de1a1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41adeb0 con 0x556d31291880 2024-08-18T22:16:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15de1a1740 10 client.0 _ll_register_callbacks cb 0x7f15d00305a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:16:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15d9b3f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31286fc0 0x556d31298070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15d9b3f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31286fc0 0x556d31298070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34924/0 (socket says 172.21.15.123:34924) 2024-08-18T22:16:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15d9b3f640 1 -- 172.21.15.123:0/1675120142 learned_addr learned my addr 172.21.15.123:0/1675120142 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15d933e640 1 --2- 172.21.15.123:0/1675120142 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d312866a0 0x556d31297b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15d933e640 1 --2- 172.21.15.123:0/1675120142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d31291880 0x556d31304f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15d9b3f640 1 -- 172.21.15.123:0/1675120142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d31291880 msgr2=0x556d31304f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15d9b3f640 1 --2- 172.21.15.123:0/1675120142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d31291880 0x556d31304f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15d9b3f640 1 -- 172.21.15.123:0/1675120142 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d312866a0 msgr2=0x556d31297b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:16:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15d9b3f640 1 --2- 172.21.15.123:0/1675120142 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d312866a0 0x556d31297b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15d9b3f640 1 -- 172.21.15.123:0/1675120142 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d313055c0 con 0x556d31286fc0 2024-08-18T22:16:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15d9b3f640 1 --2- 172.21.15.123:0/1675120142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31286fc0 0x556d31298070 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f15c401f010 tx=0x7f15c4005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de51ba0a15e2254 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-08-18T22:16:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15bd7fa640 1 -- 172.21.15.123:0/1675120142 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c402e030 con 0x556d31286fc0 2024-08-18T22:16:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15bd7fa640 1 -- 172.21.15.123:0/1675120142 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f15c4011880 con 0x556d31286fc0 2024-08-18T22:16:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15de1a1740 1 -- 172.21.15.123:0/1675120142 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15d0041030 con 0x556d31286fc0 2024-08-18T22:16:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15bd7fa640 1 -- 172.21.15.123:0/1675120142 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f15c403b050 con 0x556d31286fc0 2024-08-18T22:16:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15de1a1740 10 client.17013 fetch_fsmap learned FSMap version 36 2024-08-18T22:16:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.079+0000 7f15de1a1740 1 -- 172.21.15.123:0/1675120142 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x556d3130ca00 con 0x556d31286fc0 2024-08-18T22:16:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.080+0000 7f15bd7fa640 1 -- 172.21.15.123:0/1675120142 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15d0041030 con 0x556d31286fc0 2024-08-18T22:16:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.080+0000 7f15bd7fa640 1 -- 172.21.15.123:0/1675120142 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7f15c4005470 con 0x556d31286fc0 2024-08-18T22:16:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.080+0000 7f15de1a1740 10 client.17013 fetch_fsmap finished waiting for FSMap version 36 2024-08-18T22:16:43.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.080+0000 7f15de1a1740 10 client.17013 resolve_mds: validated gid 24466 aka daemon mds.i 2024-08-18T22:16:43.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.080+0000 7f15de1a1740 20 client.17013 populate_metadata read hostname 'smithi123' 2024-08-18T22:16:43.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.080+0000 7f15de1a1740 1 --2- 172.21.15.123:0/1675120142 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556d3130cf00 0x556d3130f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.080+0000 7f15de1a1740 4 client.17013 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-08-18T22:16:43.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.080+0000 7f15de1a1740 1 -- 172.21.15.123:0/1675120142 --> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x556d311f3380 con 0x556d3130cf00 2024-08-18T22:16:43.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.080+0000 7f15d933e640 1 --2- 172.21.15.123:0/1675120142 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556d3130cf00 0x556d3130f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15d933e640 1 --2- 172.21.15.123:0/1675120142 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556d3130cf00 0x556d3130f320 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a0a1e43146b6181 server_cookie=7a65d1cefbcd58a1 in_seq=0 out_seq=0 2024-08-18T22:16:43.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15bd7fa640 10 client.17013 ms_handle_connect on v2:172.21.15.183:6838/1902275683 2024-08-18T22:16:43.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15bd7fa640 1 -- 172.21.15.123:0/1675120142 <== mds.0 v2:172.21.15.183:6838/1902275683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x556d311f3380 con 0x556d3130cf00 2024-08-18T22:16:43.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15bd7fa640 10 client.17013 handle_command_reply: tid=0 2024-08-18T22:16:43.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15de1a1740 1 client.17013 shutdown 2024-08-18T22:16:43.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15de1a1740 1 -- 172.21.15.123:0/1675120142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31286fc0 msgr2=0x556d31298070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:43.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15de1a1740 1 --2- 172.21.15.123:0/1675120142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31286fc0 0x556d31298070 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f15c401f010 tx=0x7f15c4005bf0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15de1a1740 1 -- 172.21.15.123:0/1675120142 shutdown_connections 2024-08-18T22:16:43.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15de1a1740 1 --2- 172.21.15.123:0/1675120142 >> [v2:172.21.15.183:6838/1902275683,v1:172.21.15.183:6839/1902275683] conn(0x556d3130cf00 0x556d3130f320 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15de1a1740 1 --2- 172.21.15.123:0/1675120142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556d31291880 0x556d31304f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15de1a1740 1 --2- 172.21.15.123:0/1675120142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x556d31286fc0 0x556d31298070 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15bd7fa640 0 client.17013 ms_handle_reset on v2:172.21.15.183:6838/1902275683 2024-08-18T22:16:43.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15de1a1740 1 --2- 172.21.15.123:0/1675120142 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d312866a0 0x556d31297b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15de1a1740 1 -- 172.21.15.123:0/1675120142 >> 172.21.15.123:0/1675120142 conn(0x556d31282c30 msgr2=0x556d3128fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:43.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15de1a1740 1 -- 172.21.15.123:0/1675120142 shutdown_connections 2024-08-18T22:16:43.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15de1a1740 1 -- 172.21.15.123:0/1675120142 wait complete. 2024-08-18T22:16:43.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.081+0000 7f15de1a1740 20 client.17013 trim_cache size 0 max 16384 2024-08-18T22:16:43.099 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:16:43.099 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 36, 2024-08-18T22:16:43.099 INFO:teuthology.orchestra.run.smithi123.stdout: "leader": 24466, 2024-08-18T22:16:43.099 INFO:teuthology.orchestra.run.smithi123.stdout: "set_version": 27, 2024-08-18T22:16:43.099 INFO:teuthology.orchestra.run.smithi123.stdout: "sets": {} 2024-08-18T22:16:43.099 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:16:43.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.082+0000 7f15dbda3640 1 -- 172.21.15.123:0/3383253270 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f15c00a2c00 msgr2=0x7f15c00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:43.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.082+0000 7f15dbda3640 1 --2- 172.21.15.123:0/3383253270 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f15c00a2c00 0x7f15c00a50c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f15cc09b260 tx=0x7f15cc06a4e0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.082+0000 7f15dbda3640 1 -- 172.21.15.123:0/3383253270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15d41067b0 msgr2=0x7f15d41a40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:43.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.082+0000 7f15dbda3640 1 --2- 172.21.15.123:0/3383253270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15d41067b0 0x7f15d41a40a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00c970 tx=0x7f15cc00ce30 comp rx=0 tx=0).stop 2024-08-18T22:16:43.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.082+0000 7f15dbda3640 1 -- 172.21.15.123:0/3383253270 shutdown_connections 2024-08-18T22:16:43.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.082+0000 7f15dbda3640 1 --2- 172.21.15.123:0/3383253270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15d41067b0 0x7f15d41a40a0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.082+0000 7f15dbda3640 1 --2- 172.21.15.123:0/3383253270 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f15c00a2c00 0x7f15c00a50c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.082+0000 7f15dbda3640 1 --2- 172.21.15.123:0/3383253270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15d4101150 0x7f15d4199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.082+0000 7f15dbda3640 1 --2- 172.21.15.123:0/3383253270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15d41007b0 0x7f15d4199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.082+0000 7f15dbda3640 1 -- 172.21.15.123:0/3383253270 >> 172.21.15.123:0/3383253270 conn(0x7f15d40fc4d0 msgr2=0x7f15d40fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:43.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.082+0000 7f15dbda3640 1 -- 172.21.15.123:0/3383253270 shutdown_connections 2024-08-18T22:16:43.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.082+0000 7f15dbda3640 1 -- 172.21.15.123:0/3383253270 wait complete. 2024-08-18T22:16:43.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:43 smithi123 ceph-mon[18462]: pgmap v612: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:16:43.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:43 smithi183 ceph-mon[22097]: pgmap v612: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:16:43.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:43 smithi130 ceph-mon[21698]: pgmap v612: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:16:43.782 INFO:tasks.quiescer:done joining Quiescers 2024-08-18T22:16:43.783 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-08-18T22:16:43.792 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi123.front.sepia.ceph.com 2024-08-18T22:16:43.801 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-08-18T22:16:43.811 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-08-18T22:16:43.812 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-08-18T22:16:43.817 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-08-18T22:16:43.829 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:16:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.943+0000 7f69e14b7640 1 -- 172.21.15.123:0/1088273400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69dc100740 msgr2=0x7f69dc100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.943+0000 7f69e14b7640 1 --2- 172.21.15.123:0/1088273400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69dc100740 0x7f69dc100b40 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009ca0 tx=0x7f69cc02a8c0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.943+0000 7f69e14b7640 1 -- 172.21.15.123:0/1088273400 shutdown_connections 2024-08-18T22:16:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.943+0000 7f69e14b7640 1 --2- 172.21.15.123:0/1088273400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69dc1022f0 0x7f69dc108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.943+0000 7f69e14b7640 1 --2- 172.21.15.123:0/1088273400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69dc101930 0x7f69dc101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.943+0000 7f69e14b7640 1 --2- 172.21.15.123:0/1088273400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69dc100740 0x7f69dc100b40 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.943+0000 7f69e14b7640 1 -- 172.21.15.123:0/1088273400 >> 172.21.15.123:0/1088273400 conn(0x7f69dc0fbea0 msgr2=0x7f69dc0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:43.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.943+0000 7f69e14b7640 1 -- 172.21.15.123:0/1088273400 shutdown_connections 2024-08-18T22:16:43.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.943+0000 7f69e14b7640 1 -- 172.21.15.123:0/1088273400 wait complete. 2024-08-18T22:16:43.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.943+0000 7f69e14b7640 1 Processor -- start 2024-08-18T22:16:43.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.943+0000 7f69e14b7640 1 -- start start 2024-08-18T22:16:43.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69e14b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69dc100740 0x7f69dc196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69e14b7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69dc101930 0x7f69dc197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69e14b7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69dc1022f0 0x7f69dc19e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69e14b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f69dc10c440 con 0x7f69dc100740 2024-08-18T22:16:43.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69e14b7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69dc10c2c0 con 0x7f69dc101930 2024-08-18T22:16:43.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69e14b7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f69dc10c5c0 con 0x7f69dc1022f0 2024-08-18T22:16:43.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69daffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69dc100740 0x7f69dc196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69daffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69dc100740 0x7f69dc196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34936/0 (socket says 172.21.15.123:34936) 2024-08-18T22:16:43.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69daffd640 1 -- 172.21.15.123:0/3306000020 learned_addr learned my addr 172.21.15.123:0/3306000020 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:43.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69da7fc640 1 --2- 172.21.15.123:0/3306000020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69dc101930 0x7f69dc197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69db7fe640 1 --2- 172.21.15.123:0/3306000020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69dc1022f0 0x7f69dc19e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69daffd640 1 -- 172.21.15.123:0/3306000020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69dc1022f0 msgr2=0x7f69dc19e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:43.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69daffd640 1 --2- 172.21.15.123:0/3306000020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69dc1022f0 0x7f69dc19e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69daffd640 1 -- 172.21.15.123:0/3306000020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69dc101930 msgr2=0x7f69dc197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:43.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69daffd640 1 --2- 172.21.15.123:0/3306000020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69dc101930 0x7f69dc197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:43.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69daffd640 1 -- 172.21.15.123:0/3306000020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69dc19e740 con 0x7f69dc100740 2024-08-18T22:16:43.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69db7fe640 1 --2- 172.21.15.123:0/3306000020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69dc1022f0 0x7f69dc19e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:16:43.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69daffd640 1 --2- 172.21.15.123:0/3306000020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69dc100740 0x7f69dc196b20 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f69cc004af0 tx=0x7f69cc031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:43.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69c3fff640 1 -- 172.21.15.123:0/3306000020 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc02fb60 con 0x7f69dc100740 2024-08-18T22:16:43.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69c3fff640 1 -- 172.21.15.123:0/3306000020 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69cc02fd00 con 0x7f69dc100740 2024-08-18T22:16:43.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69e14b7640 1 -- 172.21.15.123:0/3306000020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69dc19e9d0 con 0x7f69dc100740 2024-08-18T22:16:43.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69c3fff640 1 -- 172.21.15.123:0/3306000020 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc046920 con 0x7f69dc100740 2024-08-18T22:16:43.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.944+0000 7f69e14b7640 1 -- 172.21.15.123:0/3306000020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69dc19efa0 con 0x7f69dc100740 2024-08-18T22:16:43.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.945+0000 7f69e14b7640 1 -- 172.21.15.123:0/3306000020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69dc107b80 con 0x7f69dc100740 2024-08-18T22:16:43.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.946+0000 7f69c3fff640 1 -- 172.21.15.123:0/3306000020 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f69cc030c30 con 0x7f69dc100740 2024-08-18T22:16:43.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.947+0000 7f69c3fff640 1 --2- 172.21.15.123:0/3306000020 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f69c40a2b90 0x7f69c40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:43.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.947+0000 7f69c3fff640 1 -- 172.21.15.123:0/3306000020 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f69cc0f0d90 con 0x7f69dc100740 2024-08-18T22:16:43.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.947+0000 7f69da7fc640 1 --2- 172.21.15.123:0/3306000020 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f69c40a2b90 0x7f69c40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:43.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.948+0000 7f69da7fc640 1 --2- 172.21.15.123:0/3306000020 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f69c40a2b90 0x7f69c40a5050 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f69d0005fd0 tx=0x7f69d0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:43.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:43.950+0000 7f69c3fff640 1 -- 172.21.15.123:0/3306000020 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f69cc081df0 con 0x7f69dc100740 2024-08-18T22:16:44.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.119+0000 7f69e14b7640 1 -- 172.21.15.123:0/3306000020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69dc02d830 con 0x7f69dc100740 2024-08-18T22:16:44.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.121+0000 7f69c3fff640 1 -- 172.21.15.123:0/3306000020 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+24810 (secure 0 0 0) 0x7f69cc0bd960 con 0x7f69dc100740 2024-08-18T22:16:44.122 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:16:44.122 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":96,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:16:13.498586+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:05:18.077632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:05:20.808463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:05:27.136662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:16:44.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.123+0000 7f69e14b7640 1 -- 172.21.15.123:0/3306000020 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f69c40a2b90 msgr2=0x7f69c40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.123+0000 7f69e14b7640 1 --2- 172.21.15.123:0/3306000020 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f69c40a2b90 0x7f69c40a5050 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f69d0005fd0 tx=0x7f69d0005850 comp rx=0 tx=0).stop 2024-08-18T22:16:44.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.123+0000 7f69e14b7640 1 -- 172.21.15.123:0/3306000020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69dc100740 msgr2=0x7f69dc196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.123+0000 7f69e14b7640 1 --2- 172.21.15.123:0/3306000020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69dc100740 0x7f69dc196b20 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f69cc004af0 tx=0x7f69cc031ee0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.123+0000 7f69e14b7640 1 -- 172.21.15.123:0/3306000020 shutdown_connections 2024-08-18T22:16:44.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.123+0000 7f69e14b7640 1 --2- 172.21.15.123:0/3306000020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69dc1022f0 0x7f69dc19e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.123+0000 7f69e14b7640 1 --2- 172.21.15.123:0/3306000020 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f69c40a2b90 0x7f69c40a5050 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.123+0000 7f69e14b7640 1 --2- 172.21.15.123:0/3306000020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69dc101930 0x7f69dc197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.123+0000 7f69e14b7640 1 --2- 172.21.15.123:0/3306000020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69dc100740 0x7f69dc196b20 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.123+0000 7f69e14b7640 1 -- 172.21.15.123:0/3306000020 >> 172.21.15.123:0/3306000020 conn(0x7f69dc0fbea0 msgr2=0x7f69dc104d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:44.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.123+0000 7f69e14b7640 1 -- 172.21.15.123:0/3306000020 shutdown_connections 2024-08-18T22:16:44.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.123+0000 7f69e14b7640 1 -- 172.21.15.123:0/3306000020 wait complete. 2024-08-18T22:16:44.136 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:01:09.550765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-18T22:05:18.077632+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-18T22:05:20.808463+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-18T22:05:27.136662+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-18T22:16:44.136 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T22:16:44.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.238+0000 7f263e362640 1 -- 172.21.15.123:0/2818435074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2638101370 msgr2=0x7f2638108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.238+0000 7f263e362640 1 --2- 172.21.15.123:0/2818435074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2638101370 0x7f2638108c10 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f2630009ca0 tx=0x7f263002a8c0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.238+0000 7f263e362640 1 -- 172.21.15.123:0/2818435074 shutdown_connections 2024-08-18T22:16:44.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.238+0000 7f263e362640 1 --2- 172.21.15.123:0/2818435074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2638101370 0x7f2638108c10 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.238+0000 7f263e362640 1 --2- 172.21.15.123:0/2818435074 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26381009b0 0x7f2638100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.238+0000 7f263e362640 1 --2- 172.21.15.123:0/2818435074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2638101d60 0x7f2638102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.238+0000 7f263e362640 1 -- 172.21.15.123:0/2818435074 >> 172.21.15.123:0/2818435074 conn(0x7f26380fb630 msgr2=0x7f26380fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:44.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.238+0000 7f263e362640 1 -- 172.21.15.123:0/2818435074 shutdown_connections 2024-08-18T22:16:44.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.238+0000 7f263e362640 1 -- 172.21.15.123:0/2818435074 wait complete. 2024-08-18T22:16:44.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.238+0000 7f263e362640 1 Processor -- start 2024-08-18T22:16:44.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.238+0000 7f263e362640 1 -- start start 2024-08-18T22:16:44.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f263e362640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26381009b0 0x7f2638197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:44.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f263e362640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2638101370 0x7f2638198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:44.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f263e362640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2638101d60 0x7f263819f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:44.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f263e362640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f263810d590 con 0x7f26381009b0 2024-08-18T22:16:44.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f263e362640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f263810d410 con 0x7f2638101d60 2024-08-18T22:16:44.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f263e362640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f263810d710 con 0x7f2638101370 2024-08-18T22:16:44.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f2637fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26381009b0 0x7f2638197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:44.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f2637fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26381009b0 0x7f2638197bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34950/0 (socket says 172.21.15.123:34950) 2024-08-18T22:16:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f2637fff640 1 -- 172.21.15.123:0/3525997179 learned_addr learned my addr 172.21.15.123:0/3525997179 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f26377fe640 1 --2- 172.21.15.123:0/3525997179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2638101370 0x7f2638198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f263c8ff640 1 --2- 172.21.15.123:0/3525997179 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2638101d60 0x7f263819f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f2637fff640 1 -- 172.21.15.123:0/3525997179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2638101370 msgr2=0x7f2638198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f2637fff640 1 --2- 172.21.15.123:0/3525997179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2638101370 0x7f2638198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f2637fff640 1 -- 172.21.15.123:0/3525997179 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2638101d60 msgr2=0x7f263819f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f2637fff640 1 --2- 172.21.15.123:0/3525997179 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2638101d60 0x7f263819f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f2637fff640 1 -- 172.21.15.123:0/3525997179 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263819f810 con 0x7f26381009b0 2024-08-18T22:16:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f2637fff640 1 --2- 172.21.15.123:0/3525997179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26381009b0 0x7f2638197bf0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f262800b450 tx=0x7f262800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f26357fa640 1 -- 172.21.15.123:0/3525997179 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2628015020 con 0x7f26381009b0 2024-08-18T22:16:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f263e362640 1 -- 172.21.15.123:0/3525997179 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263819fb00 con 0x7f26381009b0 2024-08-18T22:16:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f26357fa640 1 -- 172.21.15.123:0/3525997179 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2628011d70 con 0x7f26381009b0 2024-08-18T22:16:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.239+0000 7f26357fa640 1 -- 172.21.15.123:0/3525997179 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262800f340 con 0x7f26381009b0 2024-08-18T22:16:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.240+0000 7f263e362640 1 -- 172.21.15.123:0/3525997179 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26381a00a0 con 0x7f26381009b0 2024-08-18T22:16:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.240+0000 7f263e362640 1 -- 172.21.15.123:0/3525997179 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2638107c10 con 0x7f26381009b0 2024-08-18T22:16:44.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.241+0000 7f26357fa640 1 -- 172.21.15.123:0/3525997179 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f2628018020 con 0x7f26381009b0 2024-08-18T22:16:44.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.242+0000 7f26357fa640 1 --2- 172.21.15.123:0/3525997179 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f26200a2b90 0x7f26200a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:44.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.242+0000 7f26377fe640 1 --2- 172.21.15.123:0/3525997179 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f26200a2b90 0x7f26200a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:44.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.242+0000 7f26357fa640 1 -- 172.21.15.123:0/3525997179 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f26280cef30 con 0x7f26381009b0 2024-08-18T22:16:44.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.242+0000 7f26377fe640 1 --2- 172.21.15.123:0/3525997179 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f26200a2b90 0x7f26200a5050 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f262c005fd0 tx=0x7f262c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:44.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.246+0000 7f26357fa640 1 -- 172.21.15.123:0/3525997179 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f262801f020 con 0x7f26381009b0 2024-08-18T22:16:44.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.415+0000 7f263e362640 1 -- 172.21.15.123:0/3525997179 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2638062bc0 con 0x7f26381009b0 2024-08-18T22:16:44.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.415+0000 7f26357fa640 1 -- 172.21.15.123:0/3525997179 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) ==== 93+0+10 (secure 0 0 0) 0x7f262800d040 con 0x7f26381009b0 2024-08-18T22:16:44.417 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-08-18T22:16:44.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.417+0000 7f263e362640 1 -- 172.21.15.123:0/3525997179 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f26200a2b90 msgr2=0x7f26200a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.417+0000 7f263e362640 1 --2- 172.21.15.123:0/3525997179 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f26200a2b90 0x7f26200a5050 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f262c005fd0 tx=0x7f262c005850 comp rx=0 tx=0).stop 2024-08-18T22:16:44.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.417+0000 7f263e362640 1 -- 172.21.15.123:0/3525997179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26381009b0 msgr2=0x7f2638197bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.417+0000 7f263e362640 1 --2- 172.21.15.123:0/3525997179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26381009b0 0x7f2638197bf0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f262800b450 tx=0x7f262800b910 comp rx=0 tx=0).stop 2024-08-18T22:16:44.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.418+0000 7f263e362640 1 -- 172.21.15.123:0/3525997179 shutdown_connections 2024-08-18T22:16:44.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.418+0000 7f263e362640 1 --2- 172.21.15.123:0/3525997179 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f26200a2b90 0x7f26200a5050 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.418+0000 7f263e362640 1 --2- 172.21.15.123:0/3525997179 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2638101d60 0x7f263819f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.418+0000 7f263e362640 1 --2- 172.21.15.123:0/3525997179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2638101370 0x7f2638198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.418+0000 7f263e362640 1 --2- 172.21.15.123:0/3525997179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26381009b0 0x7f2638197bf0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.418+0000 7f263e362640 1 -- 172.21.15.123:0/3525997179 >> 172.21.15.123:0/3525997179 conn(0x7f26380fb630 msgr2=0x7f2638104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:44.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.418+0000 7f263e362640 1 -- 172.21.15.123:0/3525997179 shutdown_connections 2024-08-18T22:16:44.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.418+0000 7f263e362640 1 -- 172.21.15.123:0/3525997179 wait complete. 2024-08-18T22:16:44.429 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:44 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3306000020' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:16:44.430 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-18T22:16:44.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:44 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3306000020' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:16:44.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.531+0000 7f4dcc568640 1 -- 172.21.15.123:0/4068022315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc40ffe70 msgr2=0x7f4dc4100270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.531+0000 7f4dcc568640 1 --2- 172.21.15.123:0/4068022315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc40ffe70 0x7f4dc4100270 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f4db800aa10 tx=0x7f4db802b720 comp rx=0 tx=0).stop 2024-08-18T22:16:44.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.531+0000 7f4dcc568640 1 -- 172.21.15.123:0/4068022315 shutdown_connections 2024-08-18T22:16:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.531+0000 7f4dcc568640 1 --2- 172.21.15.123:0/4068022315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc4101a10 0x7f4dc4108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.531+0000 7f4dcc568640 1 --2- 172.21.15.123:0/4068022315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4dc4101050 0x7f4dc41014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.531+0000 7f4dcc568640 1 --2- 172.21.15.123:0/4068022315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc40ffe70 0x7f4dc4100270 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.531+0000 7f4dcc568640 1 -- 172.21.15.123:0/4068022315 >> 172.21.15.123:0/4068022315 conn(0x7f4dc40fb620 msgr2=0x7f4dc40fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.531+0000 7f4dcc568640 1 -- 172.21.15.123:0/4068022315 shutdown_connections 2024-08-18T22:16:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.531+0000 7f4dcc568640 1 -- 172.21.15.123:0/4068022315 wait complete. 2024-08-18T22:16:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.531+0000 7f4dcc568640 1 Processor -- start 2024-08-18T22:16:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcc568640 1 -- start start 2024-08-18T22:16:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcc568640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc40ffe70 0x7f4dc4197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcc568640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4dc4101050 0x7f4dc4198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcc568640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc4101a10 0x7f4dc419f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcc568640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc410b3c0 con 0x7f4dc4101a10 2024-08-18T22:16:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcc568640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc410b240 con 0x7f4dc40ffe70 2024-08-18T22:16:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcc568640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc410b540 con 0x7f4dc4101050 2024-08-18T22:16:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcab05640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc4101a10 0x7f4dc419f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:44.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcab05640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc4101a10 0x7f4dc419f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34980/0 (socket says 172.21.15.123:34980) 2024-08-18T22:16:44.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcab05640 1 -- 172.21.15.123:0/3769572503 learned_addr learned my addr 172.21.15.123:0/3769572503 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:44.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dca304640 1 --2- 172.21.15.123:0/3769572503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc40ffe70 0x7f4dc4197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:44.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcab05640 1 -- 172.21.15.123:0/3769572503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4dc4101050 msgr2=0x7f4dc4198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dc9b03640 1 --2- 172.21.15.123:0/3769572503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4dc4101050 0x7f4dc4198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:44.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcab05640 1 --2- 172.21.15.123:0/3769572503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4dc4101050 0x7f4dc4198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcab05640 1 -- 172.21.15.123:0/3769572503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc40ffe70 msgr2=0x7f4dc4197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcab05640 1 --2- 172.21.15.123:0/3769572503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc40ffe70 0x7f4dc4197d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcab05640 1 -- 172.21.15.123:0/3769572503 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc419f920 con 0x7f4dc4101a10 2024-08-18T22:16:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dc9b03640 1 --2- 172.21.15.123:0/3769572503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4dc4101050 0x7f4dc4198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:16:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcab05640 1 --2- 172.21.15.123:0/3769572503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc4101a10 0x7f4dc419f280 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00b970 tx=0x7f4dbc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4db77fe640 1 -- 172.21.15.123:0/3769572503 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc019070 con 0x7f4dc4101a10 2024-08-18T22:16:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4dcc568640 1 -- 172.21.15.123:0/3769572503 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc419fc10 con 0x7f4dc4101a10 2024-08-18T22:16:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4db77fe640 1 -- 172.21.15.123:0/3769572503 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dbc00cb40 con 0x7f4dc4101a10 2024-08-18T22:16:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.532+0000 7f4db77fe640 1 -- 172.21.15.123:0/3769572503 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc007650 con 0x7f4dc4101a10 2024-08-18T22:16:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.533+0000 7f4dcc568640 1 -- 172.21.15.123:0/3769572503 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc41a00e0 con 0x7f4dc4101a10 2024-08-18T22:16:44.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.534+0000 7f4dcc568640 1 -- 172.21.15.123:0/3769572503 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc4107380 con 0x7f4dc4101a10 2024-08-18T22:16:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.535+0000 7f4db77fe640 1 -- 172.21.15.123:0/3769572503 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f4dbc01c070 con 0x7f4dc4101a10 2024-08-18T22:16:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.535+0000 7f4db77fe640 1 --2- 172.21.15.123:0/3769572503 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4db00a2b90 0x7f4db00a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.536+0000 7f4dca304640 1 --2- 172.21.15.123:0/3769572503 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4db00a2b90 0x7f4db00a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.536+0000 7f4db77fe640 1 -- 172.21.15.123:0/3769572503 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f4dbc0cea40 con 0x7f4dc4101a10 2024-08-18T22:16:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.536+0000 7f4dca304640 1 --2- 172.21.15.123:0/3769572503 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4db00a2b90 0x7f4db00a5050 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4db8005ab0 tx=0x7f4db8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.540+0000 7f4db77fe640 1 -- 172.21.15.123:0/3769572503 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4dbc09afc0 con 0x7f4dc4101a10 2024-08-18T22:16:44.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:44 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3306000020' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:16:44.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.704+0000 7f4dcc568640 1 -- 172.21.15.123:0/3769572503 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4dc4062bc0 con 0x7f4dc4101a10 2024-08-18T22:16:44.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.705+0000 7f4db77fe640 1 -- 172.21.15.123:0/3769572503 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) ==== 104+0+11 (secure 0 0 0) 0x7f4dbc09f2c0 con 0x7f4dc4101a10 2024-08-18T22:16:44.706 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-08-18T22:16:44.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.707+0000 7f4dcc568640 1 -- 172.21.15.123:0/3769572503 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4db00a2b90 msgr2=0x7f4db00a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.707+0000 7f4dcc568640 1 --2- 172.21.15.123:0/3769572503 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4db00a2b90 0x7f4db00a5050 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4db8005ab0 tx=0x7f4db8000bc0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.707+0000 7f4dcc568640 1 -- 172.21.15.123:0/3769572503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc4101a10 msgr2=0x7f4dc419f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.707+0000 7f4dcc568640 1 --2- 172.21.15.123:0/3769572503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc4101a10 0x7f4dc419f280 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00b970 tx=0x7f4dbc00be30 comp rx=0 tx=0).stop 2024-08-18T22:16:44.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.707+0000 7f4dcc568640 1 -- 172.21.15.123:0/3769572503 shutdown_connections 2024-08-18T22:16:44.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.707+0000 7f4dcc568640 1 --2- 172.21.15.123:0/3769572503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc4101a10 0x7f4dc419f280 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.707+0000 7f4dcc568640 1 --2- 172.21.15.123:0/3769572503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4dc4101050 0x7f4dc4198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.707+0000 7f4dcc568640 1 --2- 172.21.15.123:0/3769572503 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f4db00a2b90 0x7f4db00a5050 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.707+0000 7f4dcc568640 1 --2- 172.21.15.123:0/3769572503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc40ffe70 0x7f4dc4197d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.707+0000 7f4dcc568640 1 -- 172.21.15.123:0/3769572503 >> 172.21.15.123:0/3769572503 conn(0x7f4dc40fb620 msgr2=0x7f4dc4104550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:44.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.707+0000 7f4dcc568640 1 -- 172.21.15.123:0/3769572503 shutdown_connections 2024-08-18T22:16:44.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.707+0000 7f4dcc568640 1 -- 172.21.15.123:0/3769572503 wait complete. 2024-08-18T22:16:44.719 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-18T22:16:44.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.820+0000 7f5cd57d8640 1 -- 172.21.15.123:0/3958051165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd0100740 msgr2=0x7f5cd0100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.820+0000 7f5cd57d8640 1 --2- 172.21.15.123:0/3958051165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd0100740 0x7f5cd0100b40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009900 tx=0x7f5cc002a410 comp rx=0 tx=0).stop 2024-08-18T22:16:44.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.820+0000 7f5cd57d8640 1 -- 172.21.15.123:0/3958051165 shutdown_connections 2024-08-18T22:16:44.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.820+0000 7f5cd57d8640 1 --2- 172.21.15.123:0/3958051165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cd01022f0 0x7f5cd0108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.820+0000 7f5cd57d8640 1 --2- 172.21.15.123:0/3958051165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cd0101930 0x7f5cd0101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.820+0000 7f5cd57d8640 1 --2- 172.21.15.123:0/3958051165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd0100740 0x7f5cd0100b40 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.820+0000 7f5cd57d8640 1 -- 172.21.15.123:0/3958051165 >> 172.21.15.123:0/3958051165 conn(0x7f5cd00fbee0 msgr2=0x7f5cd00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:44.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.820+0000 7f5cd57d8640 1 -- 172.21.15.123:0/3958051165 shutdown_connections 2024-08-18T22:16:44.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.820+0000 7f5cd57d8640 1 -- 172.21.15.123:0/3958051165 wait complete. 2024-08-18T22:16:44.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cd57d8640 1 Processor -- start 2024-08-18T22:16:44.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cd57d8640 1 -- start start 2024-08-18T22:16:44.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cd57d8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd0100740 0x7f5cd006ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:44.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cd57d8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cd0101930 0x7f5cd019c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:44.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cd57d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cd01022f0 0x7f5cd019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:44.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cd57d8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd010c420 con 0x7f5cd0100740 2024-08-18T22:16:44.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cd57d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd010c2a0 con 0x7f5cd01022f0 2024-08-18T22:16:44.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cd57d8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd010c5a0 con 0x7f5cd0101930 2024-08-18T22:16:44.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cceffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd0100740 0x7f5cd006ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:44.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cceffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd0100740 0x7f5cd006ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35004/0 (socket says 172.21.15.123:35004) 2024-08-18T22:16:44.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cceffd640 1 -- 172.21.15.123:0/3280143095 learned_addr learned my addr 172.21.15.123:0/3280143095 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:44.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cceffd640 1 -- 172.21.15.123:0/3280143095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cd0101930 msgr2=0x7f5cd019c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cceffd640 1 --2- 172.21.15.123:0/3280143095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cd0101930 0x7f5cd019c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cceffd640 1 -- 172.21.15.123:0/3280143095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cd01022f0 msgr2=0x7f5cd019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cceffd640 1 --2- 172.21.15.123:0/3280143095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cd01022f0 0x7f5cd019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cceffd640 1 -- 172.21.15.123:0/3280143095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd019f880 con 0x7f5cd0100740 2024-08-18T22:16:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cceffd640 1 --2- 172.21.15.123:0/3280143095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd0100740 0x7f5cd006ac40 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0031610 tx=0x7f5cc00043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cccff9640 1 -- 172.21.15.123:0/3280143095 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc003f030 con 0x7f5cd0100740 2024-08-18T22:16:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cccff9640 1 -- 172.21.15.123:0/3280143095 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cc0003ce0 con 0x7f5cd0100740 2024-08-18T22:16:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cccff9640 1 -- 172.21.15.123:0/3280143095 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0035070 con 0x7f5cd0100740 2024-08-18T22:16:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.821+0000 7f5cd57d8640 1 -- 172.21.15.123:0/3280143095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd019fab0 con 0x7f5cd0100740 2024-08-18T22:16:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.822+0000 7f5cd57d8640 1 -- 172.21.15.123:0/3280143095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd01a0070 con 0x7f5cd0100740 2024-08-18T22:16:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.822+0000 7f5cd57d8640 1 -- 172.21.15.123:0/3280143095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cd0107bd0 con 0x7f5cd0100740 2024-08-18T22:16:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.824+0000 7f5cccff9640 1 -- 172.21.15.123:0/3280143095 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f5cc0042030 con 0x7f5cd0100740 2024-08-18T22:16:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.824+0000 7f5cccff9640 1 --2- 172.21.15.123:0/3280143095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5cbc0a2c10 0x7f5cbc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.824+0000 7f5cc7fff640 1 --2- 172.21.15.123:0/3280143095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5cbc0a2c10 0x7f5cbc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.824+0000 7f5cccff9640 1 -- 172.21.15.123:0/3280143095 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f5cc00efcd0 con 0x7f5cd0100740 2024-08-18T22:16:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.825+0000 7f5cc7fff640 1 --2- 172.21.15.123:0/3280143095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5cbc0a2c10 0x7f5cbc0a50d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5cd006a9b0 tx=0x7f5cb8005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.827+0000 7f5cccff9640 1 -- 172.21.15.123:0/3280143095 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5cc00bc8a0 con 0x7f5cd0100740 2024-08-18T22:16:44.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.994+0000 7f5cd57d8640 1 -- 172.21.15.123:0/3280143095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5cd002d800 con 0x7f5cd0100740 2024-08-18T22:16:44.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.995+0000 7f5cccff9640 1 -- 172.21.15.123:0/3280143095 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) ==== 100+0+11 (secure 0 0 0) 0x7f5cc00bc1a0 con 0x7f5cd0100740 2024-08-18T22:16:44.996 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-08-18T22:16:44.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.997+0000 7f5cd57d8640 1 -- 172.21.15.123:0/3280143095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5cbc0a2c10 msgr2=0x7f5cbc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.997+0000 7f5cd57d8640 1 --2- 172.21.15.123:0/3280143095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5cbc0a2c10 0x7f5cbc0a50d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5cd006a9b0 tx=0x7f5cb8005bf0 comp rx=0 tx=0).stop 2024-08-18T22:16:44.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.997+0000 7f5cd57d8640 1 -- 172.21.15.123:0/3280143095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd0100740 msgr2=0x7f5cd006ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:44.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.997+0000 7f5cd57d8640 1 --2- 172.21.15.123:0/3280143095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd0100740 0x7f5cd006ac40 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0031610 tx=0x7f5cc00043b0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.997+0000 7f5cd57d8640 1 -- 172.21.15.123:0/3280143095 shutdown_connections 2024-08-18T22:16:45.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.997+0000 7f5cd57d8640 1 --2- 172.21.15.123:0/3280143095 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f5cbc0a2c10 0x7f5cbc0a50d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.997+0000 7f5cd57d8640 1 --2- 172.21.15.123:0/3280143095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cd01022f0 0x7f5cd019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.997+0000 7f5cd57d8640 1 --2- 172.21.15.123:0/3280143095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cd0101930 0x7f5cd019c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.997+0000 7f5cd57d8640 1 --2- 172.21.15.123:0/3280143095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cd0100740 0x7f5cd006ac40 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.997+0000 7f5cd57d8640 1 -- 172.21.15.123:0/3280143095 >> 172.21.15.123:0/3280143095 conn(0x7f5cd00fbee0 msgr2=0x7f5cd0104da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:45.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.997+0000 7f5cd57d8640 1 -- 172.21.15.123:0/3280143095 shutdown_connections 2024-08-18T22:16:45.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:44.997+0000 7f5cd57d8640 1 -- 172.21.15.123:0/3280143095 wait complete. 2024-08-18T22:16:45.009 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-18T22:16:45.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.111+0000 7f16ab896640 1 -- 172.21.15.123:0/2543621420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a4101910 msgr2=0x7f16a4101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:45.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.111+0000 7f16ab896640 1 --2- 172.21.15.123:0/2543621420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a4101910 0x7f16a4101d90 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f1698009900 tx=0x7f169802a410 comp rx=0 tx=0).stop 2024-08-18T22:16:45.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.111+0000 7f16ab896640 1 -- 172.21.15.123:0/2543621420 shutdown_connections 2024-08-18T22:16:45.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.111+0000 7f16ab896640 1 --2- 172.21.15.123:0/2543621420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16a41022d0 0x7f16a4108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.111+0000 7f16ab896640 1 --2- 172.21.15.123:0/2543621420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a4101910 0x7f16a4101d90 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.111+0000 7f16ab896640 1 --2- 172.21.15.123:0/2543621420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16a4100720 0x7f16a4100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.111+0000 7f16ab896640 1 -- 172.21.15.123:0/2543621420 >> 172.21.15.123:0/2543621420 conn(0x7f16a40fbea0 msgr2=0x7f16a40fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:45.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.111+0000 7f16ab896640 1 -- 172.21.15.123:0/2543621420 shutdown_connections 2024-08-18T22:16:45.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.111+0000 7f16ab896640 1 -- 172.21.15.123:0/2543621420 wait complete. 2024-08-18T22:16:45.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.111+0000 7f16ab896640 1 Processor -- start 2024-08-18T22:16:45.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16ab896640 1 -- start start 2024-08-18T22:16:45.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16ab896640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16a4100720 0x7f16a406ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:45.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16ab896640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a4101910 0x7f16a419c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:45.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16ab896640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16a41022d0 0x7f16a419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:45.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16ab896640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f16a410c3f0 con 0x7f16a4101910 2024-08-18T22:16:45.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16ab896640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f16a410c270 con 0x7f16a4100720 2024-08-18T22:16:45.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16ab896640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f16a410c570 con 0x7f16a41022d0 2024-08-18T22:16:45.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16a8e31640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a4101910 0x7f16a419c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:45.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16a8e31640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a4101910 0x7f16a419c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35012/0 (socket says 172.21.15.123:35012) 2024-08-18T22:16:45.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16a8e31640 1 -- 172.21.15.123:0/3390590316 learned_addr learned my addr 172.21.15.123:0/3390590316 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:45.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16a9632640 1 --2- 172.21.15.123:0/3390590316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16a4100720 0x7f16a406ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:45.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16a8e31640 1 -- 172.21.15.123:0/3390590316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16a41022d0 msgr2=0x7f16a419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:45.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16a8e31640 1 --2- 172.21.15.123:0/3390590316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16a41022d0 0x7f16a419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16a8e31640 1 -- 172.21.15.123:0/3390590316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16a4100720 msgr2=0x7f16a406ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:45.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16a8e31640 1 --2- 172.21.15.123:0/3390590316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16a4100720 0x7f16a406ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16a8e31640 1 -- 172.21.15.123:0/3390590316 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a419f7f0 con 0x7f16a4101910 2024-08-18T22:16:45.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16a8e31640 1 --2- 172.21.15.123:0/3390590316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a4101910 0x7f16a419c8c0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1698031440 tx=0x7f1698032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:45.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16a27fc640 1 -- 172.21.15.123:0/3390590316 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169803f030 con 0x7f16a4101910 2024-08-18T22:16:45.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16a27fc640 1 -- 172.21.15.123:0/3390590316 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1698003ce0 con 0x7f16a4101910 2024-08-18T22:16:45.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16a27fc640 1 -- 172.21.15.123:0/3390590316 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1698035070 con 0x7f16a4101910 2024-08-18T22:16:45.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.112+0000 7f16ab896640 1 -- 172.21.15.123:0/3390590316 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a419fa20 con 0x7f16a4101910 2024-08-18T22:16:45.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.113+0000 7f16ab896640 1 -- 172.21.15.123:0/3390590316 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a419fec0 con 0x7f16a4101910 2024-08-18T22:16:45.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.113+0000 7f16ab896640 1 -- 172.21.15.123:0/3390590316 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a4107ae0 con 0x7f16a4101910 2024-08-18T22:16:45.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.115+0000 7f16a27fc640 1 -- 172.21.15.123:0/3390590316 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f1698042030 con 0x7f16a4101910 2024-08-18T22:16:45.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.115+0000 7f16a27fc640 1 --2- 172.21.15.123:0/3390590316 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f168c0a2c10 0x7f168c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:45.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.115+0000 7f16a9632640 1 --2- 172.21.15.123:0/3390590316 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f168c0a2c10 0x7f168c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:45.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.115+0000 7f16a27fc640 1 -- 172.21.15.123:0/3390590316 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f16980efe80 con 0x7f16a4101910 2024-08-18T22:16:45.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.116+0000 7f16a9632640 1 --2- 172.21.15.123:0/3390590316 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f168c0a2c10 0x7f168c0a50d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f169c005fd0 tx=0x7f169c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:45.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.118+0000 7f16a27fc640 1 -- 172.21.15.123:0/3390590316 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f16980bca50 con 0x7f16a4101910 2024-08-18T22:16:45.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:45 smithi123 ceph-mon[18462]: pgmap v613: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-08-18T22:16:45.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:45 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3525997179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-18T22:16:45.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:45 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3769572503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-18T22:16:45.261 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:45 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3280143095' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-18T22:16:45.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.290+0000 7f16ab896640 1 -- 172.21.15.123:0/3390590316 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f16a402d830 con 0x7f16a4101910 2024-08-18T22:16:45.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.290+0000 7f16a27fc640 1 -- 172.21.15.123:0/3390590316 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v96) ==== 103+0+11 (secure 0 0 0) 0x7f16980bc350 con 0x7f16a4101910 2024-08-18T22:16:45.291 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-08-18T22:16:45.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.292+0000 7f16ab896640 1 -- 172.21.15.123:0/3390590316 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f168c0a2c10 msgr2=0x7f168c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:45.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.292+0000 7f16ab896640 1 --2- 172.21.15.123:0/3390590316 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f168c0a2c10 0x7f168c0a50d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f169c005fd0 tx=0x7f169c005850 comp rx=0 tx=0).stop 2024-08-18T22:16:45.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.292+0000 7f16ab896640 1 -- 172.21.15.123:0/3390590316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a4101910 msgr2=0x7f16a419c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:45.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.292+0000 7f16ab896640 1 --2- 172.21.15.123:0/3390590316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a4101910 0x7f16a419c8c0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1698031440 tx=0x7f1698032e20 comp rx=0 tx=0).stop 2024-08-18T22:16:45.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.292+0000 7f16ab896640 1 -- 172.21.15.123:0/3390590316 shutdown_connections 2024-08-18T22:16:45.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.292+0000 7f16ab896640 1 --2- 172.21.15.123:0/3390590316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16a41022d0 0x7f16a419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.292+0000 7f16ab896640 1 --2- 172.21.15.123:0/3390590316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a4101910 0x7f16a419c8c0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.292+0000 7f16ab896640 1 --2- 172.21.15.123:0/3390590316 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f168c0a2c10 0x7f168c0a50d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.292+0000 7f16ab896640 1 --2- 172.21.15.123:0/3390590316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16a4100720 0x7f16a406ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.292+0000 7f16ab896640 1 -- 172.21.15.123:0/3390590316 >> 172.21.15.123:0/3390590316 conn(0x7f16a40fbea0 msgr2=0x7f16a4104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:45.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.292+0000 7f16ab896640 1 -- 172.21.15.123:0/3390590316 shutdown_connections 2024-08-18T22:16:45.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.292+0000 7f16ab896640 1 -- 172.21.15.123:0/3390590316 wait complete. 2024-08-18T22:16:45.304 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-08-18T22:16:45.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.402+0000 7fad463f8640 1 -- 172.21.15.123:0/917387314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad401022f0 msgr2=0x7fad40108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:45.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.402+0000 7fad463f8640 1 --2- 172.21.15.123:0/917387314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad401022f0 0x7fad40108b80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fad38009ca0 tx=0x7fad3802a8c0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.402+0000 7fad463f8640 1 -- 172.21.15.123:0/917387314 shutdown_connections 2024-08-18T22:16:45.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.402+0000 7fad463f8640 1 --2- 172.21.15.123:0/917387314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad401022f0 0x7fad40108b80 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.402+0000 7fad463f8640 1 --2- 172.21.15.123:0/917387314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad40101930 0x7fad40101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.402+0000 7fad463f8640 1 --2- 172.21.15.123:0/917387314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad40100740 0x7fad40100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.402+0000 7fad463f8640 1 -- 172.21.15.123:0/917387314 >> 172.21.15.123:0/917387314 conn(0x7fad400fbea0 msgr2=0x7fad400fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:45.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.402+0000 7fad463f8640 1 -- 172.21.15.123:0/917387314 shutdown_connections 2024-08-18T22:16:45.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.402+0000 7fad463f8640 1 -- 172.21.15.123:0/917387314 wait complete. 2024-08-18T22:16:45.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad463f8640 1 Processor -- start 2024-08-18T22:16:45.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad463f8640 1 -- start start 2024-08-18T22:16:45.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad463f8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad40100740 0x7fad40069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:45.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad463f8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad40101930 0x7fad4019c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:45.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad463f8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad401022f0 0x7fad4019ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:45.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad463f8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fad4010c3c0 con 0x7fad40100740 2024-08-18T22:16:45.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad463f8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fad4010c240 con 0x7fad401022f0 2024-08-18T22:16:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad463f8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fad4010c540 con 0x7fad40101930 2024-08-18T22:16:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad3ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad40100740 0x7fad40069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad3ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad40100740 0x7fad40069c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35022/0 (socket says 172.21.15.123:35022) 2024-08-18T22:16:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad3ffff640 1 -- 172.21.15.123:0/942689894 learned_addr learned my addr 172.21.15.123:0/942689894 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:16:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad3f7fe640 1 --2- 172.21.15.123:0/942689894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad40101930 0x7fad4019c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad3ffff640 1 -- 172.21.15.123:0/942689894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad40101930 msgr2=0x7fad4019c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad3ffff640 1 --2- 172.21.15.123:0/942689894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad40101930 0x7fad4019c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad3ffff640 1 -- 172.21.15.123:0/942689894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad401022f0 msgr2=0x7fad4019ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:45.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad44995640 1 --2- 172.21.15.123:0/942689894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad401022f0 0x7fad4019ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:45.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad3ffff640 1 --2- 172.21.15.123:0/942689894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad401022f0 0x7fad4019ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:45.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad3ffff640 1 -- 172.21.15.123:0/942689894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4019f740 con 0x7fad40100740 2024-08-18T22:16:45.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.403+0000 7fad3f7fe640 1 --2- 172.21.15.123:0/942689894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad40101930 0x7fad4019c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:16:45.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.404+0000 7fad3ffff640 1 --2- 172.21.15.123:0/942689894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad40100740 0x7fad40069c20 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fad3000d950 tx=0x7fad3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:45.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.404+0000 7fad3d7fa640 1 -- 172.21.15.123:0/942689894 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30017070 con 0x7fad40100740 2024-08-18T22:16:45.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.404+0000 7fad3d7fa640 1 -- 172.21.15.123:0/942689894 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad30009c30 con 0x7fad40100740 2024-08-18T22:16:45.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.404+0000 7fad463f8640 1 -- 172.21.15.123:0/942689894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad4019f9d0 con 0x7fad40100740 2024-08-18T22:16:45.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.404+0000 7fad3d7fa640 1 -- 172.21.15.123:0/942689894 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3000f600 con 0x7fad40100740 2024-08-18T22:16:45.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.404+0000 7fad463f8640 1 -- 172.21.15.123:0/942689894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad4019fed0 con 0x7fad40100740 2024-08-18T22:16:45.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.405+0000 7fad463f8640 1 -- 172.21.15.123:0/942689894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad40107a60 con 0x7fad40100740 2024-08-18T22:16:45.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.406+0000 7fad3d7fa640 1 -- 172.21.15.123:0/942689894 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fad3001a070 con 0x7fad40100740 2024-08-18T22:16:45.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.407+0000 7fad3d7fa640 1 --2- 172.21.15.123:0/942689894 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fad280a2b90 0x7fad280a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:16:45.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.407+0000 7fad3f7fe640 1 --2- 172.21.15.123:0/942689894 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fad280a2b90 0x7fad280a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:16:45.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.407+0000 7fad3d7fa640 1 -- 172.21.15.123:0/942689894 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7fad300cef10 con 0x7fad40100740 2024-08-18T22:16:45.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.407+0000 7fad3f7fe640 1 --2- 172.21.15.123:0/942689894 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fad280a2b90 0x7fad280a5050 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fad40069990 tx=0x7fad34005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:16:45.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.411+0000 7fad3d7fa640 1 -- 172.21.15.123:0/942689894 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fad30009de0 con 0x7fad40100740 2024-08-18T22:16:45.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:45 smithi130 ceph-mon[21698]: pgmap v613: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-08-18T22:16:45.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:45 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3525997179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-18T22:16:45.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:45 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3769572503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-18T22:16:45.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:45 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3280143095' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-18T22:16:45.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.623+0000 7fad463f8640 1 -- 172.21.15.123:0/942689894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fad40062b50 con 0x7fad40100740 2024-08-18T22:16:45.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.630+0000 7fad3d7fa640 1 -- 172.21.15.123:0/942689894 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740373 (secure 0 0 0) 0x7fad3009bae0 con 0x7fad40100740 2024-08-18T22:16:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:16:45.642 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:16:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 18, 2024-08-18T22:16:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: "active_gid": 14150, 2024-08-18T22:16:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: "active_name": "x", 2024-08-18T22:16:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: "active_addrs": { 2024-08-18T22:16:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-08-18T22:16:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-08-18T22:16:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6800", 2024-08-18T22:16:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 22123895 2024-08-18T22:16:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-08-18T22:16:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6801", 2024-08-18T22:16:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 22123895 2024-08-18T22:16:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-08-18T22:16:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "active_addr": "172.21.15.123:6801/22123895", 2024-08-18T22:16:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "active_change": "2024-08-18T21:59:09.243407+0000", 2024-08-18T22:16:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "active_mgr_features": 4540701547738038271, 2024-08-18T22:16:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "available": true, 2024-08-18T22:16:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "standbys": [ 2024-08-18T22:16:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:45.646 INFO:teuthology.orchestra.run.smithi123.stdout: "gid": 24106, 2024-08-18T22:16:45.646 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "z", 2024-08-18T22:16:45.646 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr_features": 4540701547738038271, 2024-08-18T22:16:45.646 INFO:teuthology.orchestra.run.smithi123.stdout: "available_modules": [ 2024-08-18T22:16:45.646 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:45.647 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "alerts", 2024-08-18T22:16:45.647 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-08-18T22:16:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-08-18T22:16:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-08-18T22:16:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How frequently to reexamine health status", 2024-08-18T22:16:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_destination": { 2024-08-18T22:16:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_destination", 2024-08-18T22:16:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Email address to send alerts to", 2024-08-18T22:16:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_from_name": { 2024-08-18T22:16:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_from_name", 2024-08-18T22:16:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "Ceph", 2024-08-18T22:16:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Email From: name", 2024-08-18T22:16:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_host": { 2024-08-18T22:16:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_host", 2024-08-18T22:16:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP server", 2024-08-18T22:16:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_password": { 2024-08-18T22:16:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_password", 2024-08-18T22:16:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Password to authenticate with", 2024-08-18T22:16:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_port": { 2024-08-18T22:16:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_port", 2024-08-18T22:16:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "465", 2024-08-18T22:16:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP port", 2024-08-18T22:16:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_sender": { 2024-08-18T22:16:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_sender", 2024-08-18T22:16:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP envelope sender", 2024-08-18T22:16:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_ssl": { 2024-08-18T22:16:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_ssl", 2024-08-18T22:16:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-18T22:16:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_user": { 2024-08-18T22:16:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_user", 2024-08-18T22:16:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "User to authenticate as", 2024-08-18T22:16:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "balancer", 2024-08-18T22:16:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "active": { 2024-08-18T22:16:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "active", 2024-08-18T22:16:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "automatically balance PGs across cluster", 2024-08-18T22:16:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "begin_time": { 2024-08-18T22:16:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "begin_time", 2024-08-18T22:16:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0000", 2024-08-18T22:16:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "beginning time of day to automatically balance", 2024-08-18T22:16:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-18T22:16:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "begin_weekday": { 2024-08-18T22:16:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "begin_weekday", 2024-08-18T22:16:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-08-18T22:16:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-08-18T22:16:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0", 2024-08-18T22:16:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "6", 2024-08-18T22:16:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-18T22:16:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-18T22:16:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_max_iterations": { 2024-08-18T22:16:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_max_iterations", 2024-08-18T22:16:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-08-18T22:16:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "25", 2024-08-18T22:16:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-08-18T22:16:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "250", 2024-08-18T22:16:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-18T22:16:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_metrics": { 2024-08-18T22:16:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_metrics", 2024-08-18T22:16:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "pgs,objects,bytes", 2024-08-18T22:16:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-18T22:16:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-18T22:16:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_step": { 2024-08-18T22:16:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_step", 2024-08-18T22:16:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0.5", 2024-08-18T22:16:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0.001", 2024-08-18T22:16:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "0.999", 2024-08-18T22:16:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "aggressiveness of optimization", 2024-08-18T22:16:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-18T22:16:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "end_time": { 2024-08-18T22:16:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "end_time", 2024-08-18T22:16:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "2359", 2024-08-18T22:16:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "ending time of day to automatically balance", 2024-08-18T22:16:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-18T22:16:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: "end_weekday": { 2024-08-18T22:16:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "end_weekday", 2024-08-18T22:16:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-08-18T22:16:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-08-18T22:16:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0", 2024-08-18T22:16:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "6", 2024-08-18T22:16:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-18T22:16:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-18T22:16:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "min_score": { 2024-08-18T22:16:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "min_score", 2024-08-18T22:16:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-08-18T22:16:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-18T22:16:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": { 2024-08-18T22:16:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mode", 2024-08-18T22:16:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "upmap", 2024-08-18T22:16:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "crush-compat", 2024-08-18T22:16:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "none", 2024-08-18T22:16:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "read", 2024-08-18T22:16:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap", 2024-08-18T22:16:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap-read" 2024-08-18T22:16:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Balancer mode", 2024-08-18T22:16:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "pool_ids": { 2024-08-18T22:16:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pool_ids", 2024-08-18T22:16:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-18T22:16:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-08-18T22:16:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-08-18T22:16:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:45.709 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.709 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.709 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-08-18T22:16:45.709 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.709 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.709 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.709 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-18T22:16:45.709 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.710 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.710 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.710 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.710 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap_max_deviation": { 2024-08-18T22:16:45.710 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "upmap_max_deviation", 2024-08-18T22:16:45.710 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.710 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-08-18T22:16:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-08-18T22:16:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-18T22:16:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-18T22:16:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap_max_optimizations": { 2024-08-18T22:16:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "upmap_max_optimizations", 2024-08-18T22:16:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-08-18T22:16:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-18T22:16:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cephadm", 2024-08-18T22:16:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_down_multiplier": { 2024-08-18T22:16:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_down_multiplier", 2024-08-18T22:16:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3.0", 2024-08-18T22:16:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-18T22:16:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_refresh_rate": { 2024-08-18T22:16:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_refresh_rate", 2024-08-18T22:16:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "20", 2024-08-18T22:16:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-18T22:16:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.718 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_starting_port": { 2024-08-18T22:16:45.718 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_starting_port", 2024-08-18T22:16:45.718 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.718 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.718 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.718 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "4721", 2024-08-18T22:16:45.718 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-18T22:16:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_ptrace": { 2024-08-18T22:16:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_ptrace", 2024-08-18T22:16:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-18T22:16:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-18T22:16:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "autotune_interval": { 2024-08-18T22:16:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "autotune_interval", 2024-08-18T22:16:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-08-18T22:16:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-18T22:16:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.723 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.723 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.723 INFO:teuthology.orchestra.run.smithi123.stdout: "autotune_memory_target_ratio": { 2024-08-18T22:16:45.723 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "autotune_memory_target_ratio", 2024-08-18T22:16:45.723 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:45.723 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.723 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0.7", 2024-08-18T22:16:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-18T22:16:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm_log_destination": { 2024-08-18T22:16:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cephadm_log_destination", 2024-08-18T22:16:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "file", 2024-08-18T22:16:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "file,syslog", 2024-08-18T22:16:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "syslog" 2024-08-18T22:16:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-18T22:16:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "cgroups_split": { 2024-08-18T22:16:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cgroups_split", 2024-08-18T22:16:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-18T22:16:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "config_checks_enabled": { 2024-08-18T22:16:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_checks_enabled", 2024-08-18T22:16:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-18T22:16:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "config_dashboard": { 2024-08-18T22:16:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_dashboard", 2024-08-18T22:16:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-18T22:16:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_alertmanager": { 2024-08-18T22:16:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_alertmanager", 2024-08-18T22:16:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-08-18T22:16:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-08-18T22:16:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_base": { 2024-08-18T22:16:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_base", 2024-08-18T22:16:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-18T22:16:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Container image name, without the tag", 2024-08-18T22:16:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_elasticsearch": { 2024-08-18T22:16:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_elasticsearch", 2024-08-18T22:16:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-18T22:16:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "elasticsearch container image", 2024-08-18T22:16:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_grafana": { 2024-08-18T22:16:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_grafana", 2024-08-18T22:16:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-08-18T22:16:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-08-18T22:16:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_haproxy": { 2024-08-18T22:16:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_haproxy", 2024-08-18T22:16:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-18T22:16:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "HAproxy container image", 2024-08-18T22:16:45.741 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.741 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.741 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.741 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.741 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_agent": { 2024-08-18T22:16:45.741 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_agent", 2024-08-18T22:16:45.741 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.741 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-18T22:16:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger agent container image", 2024-08-18T22:16:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.743 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.743 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.743 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_collector": { 2024-08-18T22:16:45.743 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_collector", 2024-08-18T22:16:45.743 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.743 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.743 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.743 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-18T22:16:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger collector container image", 2024-08-18T22:16:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.745 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.745 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_query": { 2024-08-18T22:16:45.745 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_query", 2024-08-18T22:16:45.745 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.745 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.745 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.745 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-18T22:16:45.745 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.746 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.746 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.746 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger query container image", 2024-08-18T22:16:45.746 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.746 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.746 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.746 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.747 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_keepalived": { 2024-08-18T22:16:45.747 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_keepalived", 2024-08-18T22:16:45.747 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.747 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.747 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.747 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-18T22:16:45.747 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Keepalived container image", 2024-08-18T22:16:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_loki": { 2024-08-18T22:16:45.749 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_loki", 2024-08-18T22:16:45.749 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.749 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.749 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.749 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-18T22:16:45.749 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.749 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.749 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.750 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Loki container image", 2024-08-18T22:16:45.750 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.750 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.750 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.750 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.750 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_node_exporter": { 2024-08-18T22:16:45.750 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_node_exporter", 2024-08-18T22:16:45.751 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.751 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.751 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.751 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-08-18T22:16:45.751 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.751 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.751 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.751 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-08-18T22:16:45.752 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.752 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.752 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.752 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.752 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_nvmeof": { 2024-08-18T22:16:45.752 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_nvmeof", 2024-08-18T22:16:45.752 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.752 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-18T22:16:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Nvme-of container image", 2024-08-18T22:16:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_prometheus": { 2024-08-18T22:16:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_prometheus", 2024-08-18T22:16:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-08-18T22:16:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-08-18T22:16:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_promtail": { 2024-08-18T22:16:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_promtail", 2024-08-18T22:16:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-18T22:16:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Promtail container image", 2024-08-18T22:16:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_samba": { 2024-08-18T22:16:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_samba", 2024-08-18T22:16:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-18T22:16:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Samba/SMB container image", 2024-08-18T22:16:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_snmp_gateway": { 2024-08-18T22:16:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_snmp_gateway", 2024-08-18T22:16:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-18T22:16:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SNMP Gateway container image", 2024-08-18T22:16:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "container_init": { 2024-08-18T22:16:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_init", 2024-08-18T22:16:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Run podman/docker with `--init`", 2024-08-18T22:16:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "daemon_cache_timeout": { 2024-08-18T22:16:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "daemon_cache_timeout", 2024-08-18T22:16:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-08-18T22:16:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-18T22:16:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "default_cephadm_command_timeout": { 2024-08-18T22:16:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "default_cephadm_command_timeout", 2024-08-18T22:16:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.766 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.766 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.766 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "900", 2024-08-18T22:16:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-18T22:16:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: "default_registry": { 2024-08-18T22:16:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "default_registry", 2024-08-18T22:16:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io", 2024-08-18T22:16:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-18T22:16:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "device_cache_timeout": { 2024-08-18T22:16:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_cache_timeout", 2024-08-18T22:16:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1800", 2024-08-18T22:16:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache device inventory", 2024-08-18T22:16:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "device_enhanced_scan": { 2024-08-18T22:16:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_enhanced_scan", 2024-08-18T22:16:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-18T22:16:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "facts_cache_timeout": { 2024-08-18T22:16:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "facts_cache_timeout", 2024-08-18T22:16:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-08-18T22:16:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache host facts data", 2024-08-18T22:16:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.775 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.775 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.775 INFO:teuthology.orchestra.run.smithi123.stdout: "grafana_dashboards_path": { 2024-08-18T22:16:45.775 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "grafana_dashboards_path", 2024-08-18T22:16:45.775 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.775 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.775 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.775 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-18T22:16:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-18T22:16:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "host_check_interval": { 2024-08-18T22:16:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "host_check_interval", 2024-08-18T22:16:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-08-18T22:16:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to perform a host check", 2024-08-18T22:16:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: "hw_monitoring": { 2024-08-18T22:16:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "hw_monitoring", 2024-08-18T22:16:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-18T22:16:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "inventory_list_all": { 2024-08-18T22:16:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "inventory_list_all", 2024-08-18T22:16:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-18T22:16:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.783 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.783 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.783 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.783 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:45.783 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:45.783 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:45.783 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:45.783 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.785 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.785 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.785 INFO:teuthology.orchestra.run.smithi123.stdout: "log_refresh_metadata": { 2024-08-18T22:16:45.785 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_refresh_metadata", 2024-08-18T22:16:45.785 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.785 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.785 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.786 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.786 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.786 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.786 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.786 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-18T22:16:45.786 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-18T22:16:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-18T22:16:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-18T22:16:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-18T22:16:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-18T22:16:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-18T22:16:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "*", 2024-08-18T22:16:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-18T22:16:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: "max_count_per_host": { 2024-08-18T22:16:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_count_per_host", 2024-08-18T22:16:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "max number of daemons per service per host", 2024-08-18T22:16:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: "max_osd_draining_count": { 2024-08-18T22:16:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_osd_draining_count", 2024-08-18T22:16:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-18T22:16:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "migration_current": { 2024-08-18T22:16:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "migration_current", 2024-08-18T22:16:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "internal - do not modify", 2024-08-18T22:16:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": { 2024-08-18T22:16:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mode", 2024-08-18T22:16:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "root", 2024-08-18T22:16:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm-package", 2024-08-18T22:16:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "root" 2024-08-18T22:16:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "mode for remote execution of cephadm", 2024-08-18T22:16:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "oob_default_addr": { 2024-08-18T22:16:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "oob_default_addr", 2024-08-18T22:16:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "169.254.1.1", 2024-08-18T22:16:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-18T22:16:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "prometheus_alerts_path": { 2024-08-18T22:16:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prometheus_alerts_path", 2024-08-18T22:16:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-18T22:16:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-18T22:16:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_insecure": { 2024-08-18T22:16:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_insecure", 2024-08-18T22:16:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-18T22:16:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_password": { 2024-08-18T22:16:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_password", 2024-08-18T22:16:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-18T22:16:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_url": { 2024-08-18T22:16:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_url", 2024-08-18T22:16:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-18T22:16:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_username": { 2024-08-18T22:16:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_username", 2024-08-18T22:16:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-18T22:16:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: "secure_monitoring_stack": { 2024-08-18T22:16:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "secure_monitoring_stack", 2024-08-18T22:16:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-18T22:16:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "service_discovery_port": { 2024-08-18T22:16:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "service_discovery_port", 2024-08-18T22:16:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8765", 2024-08-18T22:16:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "cephadm service discovery port", 2024-08-18T22:16:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: "ssh_config_file": { 2024-08-18T22:16:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssh_config_file", 2024-08-18T22:16:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-18T22:16:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.822 INFO:teuthology.orchestra.run.smithi123.stdout: "use_agent": { 2024-08-18T22:16:45.822 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "use_agent", 2024-08-18T22:16:45.822 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.822 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.822 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.822 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.822 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.822 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-18T22:16:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "use_repo_digest": { 2024-08-18T22:16:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "use_repo_digest", 2024-08-18T22:16:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-18T22:16:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_failed_host_check": { 2024-08-18T22:16:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_failed_host_check", 2024-08-18T22:16:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if the host check fails", 2024-08-18T22:16:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_stray_daemons": { 2024-08-18T22:16:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_stray_daemons", 2024-08-18T22:16:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-18T22:16:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_stray_hosts": { 2024-08-18T22:16:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_stray_hosts", 2024-08-18T22:16:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-18T22:16:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crash", 2024-08-18T22:16:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.837 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.837 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.837 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.837 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.837 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: "retain_interval": { 2024-08-18T22:16:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "retain_interval", 2024-08-18T22:16:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "31536000", 2024-08-18T22:16:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-18T22:16:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_recent_interval": { 2024-08-18T22:16:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_recent_interval", 2024-08-18T22:16:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1209600", 2024-08-18T22:16:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-18T22:16:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "dashboard", 2024-08-18T22:16:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-18T22:16:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-18T22:16:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "ALERTMANAGER_API_HOST": { 2024-08-18T22:16:45.849 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-18T22:16:45.849 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.849 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.849 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.849 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.849 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.849 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-18T22:16:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-18T22:16:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.852 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.855 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.855 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.856 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.856 INFO:teuthology.orchestra.run.smithi123.stdout: "AUDIT_API_ENABLED": { 2024-08-18T22:16:45.857 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "AUDIT_API_ENABLED", 2024-08-18T22:16:45.858 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.859 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.860 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.860 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.860 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.861 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.862 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.863 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.864 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.864 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.865 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.867 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.867 INFO:teuthology.orchestra.run.smithi123.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-18T22:16:45.867 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-18T22:16:45.868 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.868 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.868 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.869 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.870 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.870 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.870 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.872 INFO:teuthology.orchestra.run.smithi123.stdout: "ENABLE_BROWSABLE_API": { 2024-08-18T22:16:45.872 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-18T22:16:45.872 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.872 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.873 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.873 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.873 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.875 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.875 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.875 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.876 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-18T22:16:45.876 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-18T22:16:45.876 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.876 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.877 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.877 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.877 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.877 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.878 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.878 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.878 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.878 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.879 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.879 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.879 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-18T22:16:45.880 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-18T22:16:45.880 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.880 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.881 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.881 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.881 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.882 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.882 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.882 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-18T22:16:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-18T22:16:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.885 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.885 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.885 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.885 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.885 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.886 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.886 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.886 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-18T22:16:45.886 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-18T22:16:45.887 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.887 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.887 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.887 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.888 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.888 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.888 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.888 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.889 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.889 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.889 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.890 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.890 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-18T22:16:45.890 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-18T22:16:45.890 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.891 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.891 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.891 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.891 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.892 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.892 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.892 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.892 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.893 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.893 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.893 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.894 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-18T22:16:45.894 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-18T22:16:45.894 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.894 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.895 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.895 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.895 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.896 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.896 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.896 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.896 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-18T22:16:45.898 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-18T22:16:45.898 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.898 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.898 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.899 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.899 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.899 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.899 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.900 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.900 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.900 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.901 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.901 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.901 INFO:teuthology.orchestra.run.smithi123.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-18T22:16:45.901 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-18T22:16:45.902 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.902 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.902 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_PASSWORD": { 2024-08-18T22:16:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-18T22:16:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.906 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.906 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-08-18T22:16:45.906 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.907 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.907 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.907 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.908 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.908 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.908 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-18T22:16:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-18T22:16:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.910 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.910 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.910 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.910 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_URL": { 2024-08-18T22:16:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_URL", 2024-08-18T22:16:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.914 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.914 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.914 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.914 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.914 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.914 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_USERNAME": { 2024-08-18T22:16:45.914 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-18T22:16:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-08-18T22:16:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.916 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.916 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.916 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.916 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.916 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-18T22:16:45.916 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-18T22:16:45.916 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.916 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.918 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.918 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-18T22:16:45.918 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-18T22:16:45.918 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.918 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.918 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.918 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-18T22:16:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-18T22:16:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.921 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.921 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.921 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.921 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.921 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.921 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.921 INFO:teuthology.orchestra.run.smithi123.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-18T22:16:45.921 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-18T22:16:45.922 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.922 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.922 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.922 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.922 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.922 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.922 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.922 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.923 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.923 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.923 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.923 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.923 INFO:teuthology.orchestra.run.smithi123.stdout: "PROMETHEUS_API_HOST": { 2024-08-18T22:16:45.923 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-18T22:16:45.923 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.923 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-18T22:16:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-18T22:16:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-18T22:16:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-18T22:16:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-18T22:16:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-18T22:16:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-18T22:16:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-18T22:16:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-18T22:16:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-18T22:16:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-18T22:16:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-18T22:16:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-18T22:16:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-18T22:16:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-18T22:16:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-18T22:16:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_ENABLED": { 2024-08-18T22:16:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-18T22:16:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-18T22:16:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-18T22:16:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-18T22:16:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-18T22:16:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-18T22:16:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-18T22:16:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-18T22:16:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8", 2024-08-18T22:16:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-18T22:16:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-18T22:16:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "45", 2024-08-18T22:16:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_ACCESS_KEY": { 2024-08-18T22:16:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-18T22:16:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-18T22:16:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-18T22:16:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-08-18T22:16:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_SECRET_KEY": { 2024-08-18T22:16:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-18T22:16:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_SSL_VERIFY": { 2024-08-18T22:16:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-18T22:16:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-18T22:16:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-18T22:16:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-08-18T22:16:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-18T22:16:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-18T22:16:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-18T22:16:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-18T22:16:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-08-18T22:16:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "cross_origin_url": { 2024-08-18T22:16:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cross_origin_url", 2024-08-18T22:16:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: "crt_file": { 2024-08-18T22:16:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crt_file", 2024-08-18T22:16:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: "debug": { 2024-08-18T22:16:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "debug", 2024-08-18T22:16:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable/disable debug options", 2024-08-18T22:16:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: "jwt_token_ttl": { 2024-08-18T22:16:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "jwt_token_ttl", 2024-08-18T22:16:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "28800", 2024-08-18T22:16:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "key_file": { 2024-08-18T22:16:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "key_file", 2024-08-18T22:16:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "motd": { 2024-08-18T22:16:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "motd", 2024-08-18T22:16:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "The message of the day", 2024-08-18T22:16:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "redirect_resolve_ip_addr": { 2024-08-18T22:16:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "redirect_resolve_ip_addr", 2024-08-18T22:16:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.980 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.980 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.980 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-08-18T22:16:45.980 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-08-18T22:16:45.980 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.980 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.980 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.980 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "::", 2024-08-18T22:16:45.981 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.981 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.981 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.981 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.981 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.981 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.981 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.981 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.981 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-08-18T22:16:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-08-18T22:16:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8080", 2024-08-18T22:16:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl": { 2024-08-18T22:16:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl", 2024-08-18T22:16:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl_server_port": { 2024-08-18T22:16:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl_server_port", 2024-08-18T22:16:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8443", 2024-08-18T22:16:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_behaviour": { 2024-08-18T22:16:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_behaviour", 2024-08-18T22:16:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "redirect", 2024-08-18T22:16:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "redirect" 2024-08-18T22:16:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_error_status_code": { 2024-08-18T22:16:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_error_status_code", 2024-08-18T22:16:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "500", 2024-08-18T22:16:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "400", 2024-08-18T22:16:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "599", 2024-08-18T22:16:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "url_prefix": { 2024-08-18T22:16:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "url_prefix", 2024-08-18T22:16:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "devicehealth", 2024-08-18T22:16:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "enable_monitoring": { 2024-08-18T22:16:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enable_monitoring", 2024-08-18T22:16:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "monitor device health metrics", 2024-08-18T22:16:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "mark_out_threshold": { 2024-08-18T22:16:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mark_out_threshold", 2024-08-18T22:16:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "2419200", 2024-08-18T22:16:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-18T22:16:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "pool_name": { 2024-08-18T22:16:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pool_name", 2024-08-18T22:16:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "device_health_metrics", 2024-08-18T22:16:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-18T22:16:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "retention_period": { 2024-08-18T22:16:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "retention_period", 2024-08-18T22:16:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15552000", 2024-08-18T22:16:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long to retain device health metrics", 2024-08-18T22:16:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "scrape_frequency": { 2024-08-18T22:16:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "scrape_frequency", 2024-08-18T22:16:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "86400", 2024-08-18T22:16:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-18T22:16:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "self_heal": { 2024-08-18T22:16:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "self_heal", 2024-08-18T22:16:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-18T22:16:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-08-18T22:16:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-08-18T22:16:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-08-18T22:16:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to wake up and check device health", 2024-08-18T22:16:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_threshold": { 2024-08-18T22:16:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_threshold", 2024-08-18T22:16:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "7257600", 2024-08-18T22:16:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-18T22:16:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "diskprediction_local", 2024-08-18T22:16:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "predict_interval": { 2024-08-18T22:16:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "predict_interval", 2024-08-18T22:16:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "86400", 2024-08-18T22:16:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "predictor_model": { 2024-08-18T22:16:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "predictor_model", 2024-08-18T22:16:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "prophetstor", 2024-08-18T22:16:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-08-18T22:16:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-08-18T22:16:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-08-18T22:16:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "influx", 2024-08-18T22:16:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": false, 2024-08-18T22:16:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "influxdb python module not found", 2024-08-18T22:16:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: "batch_size": { 2024-08-18T22:16:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "batch_size", 2024-08-18T22:16:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5000", 2024-08-18T22:16:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-18T22:16:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "database": { 2024-08-18T22:16:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "database", 2024-08-18T22:16:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "ceph", 2024-08-18T22:16:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-18T22:16:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.034 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.034 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.034 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.034 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": { 2024-08-18T22:16:46.034 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "hostname", 2024-08-18T22:16:46.034 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.034 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.034 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB server hostname", 2024-08-18T22:16:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.036 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.036 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-08-18T22:16:46.036 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-08-18T22:16:46.036 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.036 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.036 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.036 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "30", 2024-08-18T22:16:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "5", 2024-08-18T22:16:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-18T22:16:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "password": { 2024-08-18T22:16:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "password", 2024-08-18T22:16:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "password of InfluxDB server user", 2024-08-18T22:16:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "port": { 2024-08-18T22:16:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "port", 2024-08-18T22:16:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8086", 2024-08-18T22:16:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB server port", 2024-08-18T22:16:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl": { 2024-08-18T22:16:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl", 2024-08-18T22:16:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "false", 2024-08-18T22:16:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-18T22:16:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "threads": { 2024-08-18T22:16:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "threads", 2024-08-18T22:16:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-08-18T22:16:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-08-18T22:16:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "32", 2024-08-18T22:16:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-18T22:16:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "username": { 2024-08-18T22:16:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "username", 2024-08-18T22:16:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "username of InfluxDB server user", 2024-08-18T22:16:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.057 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: "verify_ssl": { 2024-08-18T22:16:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "verify_ssl", 2024-08-18T22:16:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "true", 2024-08-18T22:16:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-18T22:16:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "insights", 2024-08-18T22:16:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.069 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.069 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.069 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.069 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.069 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "iostat", 2024-08-18T22:16:46.069 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.069 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.069 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "k8sevents", 2024-08-18T22:16:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_event_retention_days": { 2024-08-18T22:16:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ceph_event_retention_days", 2024-08-18T22:16:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "7", 2024-08-18T22:16:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-18T22:16:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "config_check_secs": { 2024-08-18T22:16:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_check_secs", 2024-08-18T22:16:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "10", 2024-08-18T22:16:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-18T22:16:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "localpool", 2024-08-18T22:16:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "failure_domain": { 2024-08-18T22:16:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "failure_domain", 2024-08-18T22:16:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "host", 2024-08-18T22:16:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "failure domain for any created local pool", 2024-08-18T22:16:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-18T22:16:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "min_size": { 2024-08-18T22:16:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "min_size", 2024-08-18T22:16:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default min_size for any created local pool", 2024-08-18T22:16:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-18T22:16:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "num_rep": { 2024-08-18T22:16:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "num_rep", 2024-08-18T22:16:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3", 2024-08-18T22:16:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default replica count for any created local pool", 2024-08-18T22:16:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "pg_num": { 2024-08-18T22:16:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pg_num", 2024-08-18T22:16:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "128", 2024-08-18T22:16:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default pg_num for any created local pool", 2024-08-18T22:16:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: "prefix": { 2024-08-18T22:16:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prefix", 2024-08-18T22:16:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "name prefix for any created local pool", 2024-08-18T22:16:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "subtree": { 2024-08-18T22:16:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "subtree", 2024-08-18T22:16:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "rack", 2024-08-18T22:16:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-18T22:16:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-18T22:16:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mds_autoscaler", 2024-08-18T22:16:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mirroring", 2024-08-18T22:16:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "nfs", 2024-08-18T22:16:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "orchestrator", 2024-08-18T22:16:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: "fail_fs": { 2024-08-18T22:16:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "fail_fs", 2024-08-18T22:16:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-18T22:16:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "orchestrator": { 2024-08-18T22:16:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "orchestrator", 2024-08-18T22:16:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm", 2024-08-18T22:16:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "rook", 2024-08-18T22:16:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "test_orchestrator" 2024-08-18T22:16:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Orchestrator backend", 2024-08-18T22:16:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "osd_perf_query", 2024-08-18T22:16:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "osd_support", 2024-08-18T22:16:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pg_autoscaler", 2024-08-18T22:16:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-08-18T22:16:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-08-18T22:16:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-08-18T22:16:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "threshold": { 2024-08-18T22:16:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "threshold", 2024-08-18T22:16:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.184 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.184 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3.0", 2024-08-18T22:16:46.184 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1.0", 2024-08-18T22:16:46.184 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.184 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.184 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "scaling threshold", 2024-08-18T22:16:46.184 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-18T22:16:46.184 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.184 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.185 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.185 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.185 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.185 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.185 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "progress", 2024-08-18T22:16:46.185 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.185 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.185 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.186 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_pg_recovery_event": { 2024-08-18T22:16:46.186 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_pg_recovery_event", 2024-08-18T22:16:46.186 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.186 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.186 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.186 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.186 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.186 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-18T22:16:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "enabled": { 2024-08-18T22:16:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enabled", 2024-08-18T22:16:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "max_completed_events": { 2024-08-18T22:16:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_completed_events", 2024-08-18T22:16:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "50", 2024-08-18T22:16:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "number of past completed events to remember", 2024-08-18T22:16:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-08-18T22:16:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-08-18T22:16:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-08-18T22:16:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long the module is going to sleep", 2024-08-18T22:16:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prometheus", 2024-08-18T22:16:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "cache": { 2024-08-18T22:16:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cache", 2024-08-18T22:16:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "exclude_perf_counters": { 2024-08-18T22:16:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "exclude_perf_counters", 2024-08-18T22:16:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-18T22:16:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-18T22:16:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_stats_pools": { 2024-08-18T22:16:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_stats_pools", 2024-08-18T22:16:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-18T22:16:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-18T22:16:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "300", 2024-08-18T22:16:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: "scrape_interval": { 2024-08-18T22:16:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "scrape_interval", 2024-08-18T22:16:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15.0", 2024-08-18T22:16:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-08-18T22:16:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-08-18T22:16:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "::", 2024-08-18T22:16:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-18T22:16:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-08-18T22:16:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-08-18T22:16:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "9283", 2024-08-18T22:16:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-18T22:16:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "stale_cache_strategy": { 2024-08-18T22:16:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "stale_cache_strategy", 2024-08-18T22:16:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "log", 2024-08-18T22:16:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_behaviour": { 2024-08-18T22:16:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_behaviour", 2024-08-18T22:16:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "default", 2024-08-18T22:16:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "default", 2024-08-18T22:16:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "error" 2024-08-18T22:16:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_error_status_code": { 2024-08-18T22:16:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_error_status_code", 2024-08-18T22:16:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "500", 2024-08-18T22:16:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "400", 2024-08-18T22:16:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "599", 2024-08-18T22:16:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_support", 2024-08-18T22:16:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "max_concurrent_snap_create": { 2024-08-18T22:16:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_concurrent_snap_create", 2024-08-18T22:16:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "mirror_snapshot_schedule": { 2024-08-18T22:16:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mirror_snapshot_schedule", 2024-08-18T22:16:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "trash_purge_schedule": { 2024-08-18T22:16:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "trash_purge_schedule", 2024-08-18T22:16:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "restful", 2024-08-18T22:16:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "enable_auth": { 2024-08-18T22:16:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enable_auth", 2024-08-18T22:16:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "key_file": { 2024-08-18T22:16:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "key_file", 2024-08-18T22:16:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.246 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.246 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.246 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.246 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-08-18T22:16:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-08-18T22:16:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-08-18T22:16:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-08-18T22:16:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rgw", 2024-08-18T22:16:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rook", 2024-08-18T22:16:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.278 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.278 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.278 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.278 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.281 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.281 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.281 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.281 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: "storage_class": { 2024-08-18T22:16:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "storage_class", 2024-08-18T22:16:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "local", 2024-08-18T22:16:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-18T22:16:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "selftest", 2024-08-18T22:16:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.287 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.287 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.287 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.287 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.287 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.288 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.288 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.288 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.288 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "roption1": { 2024-08-18T22:16:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "roption1", 2024-08-18T22:16:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: "roption2": { 2024-08-18T22:16:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "roption2", 2024-08-18T22:16:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "xyz", 2024-08-18T22:16:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption1": { 2024-08-18T22:16:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption1", 2024-08-18T22:16:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption2": { 2024-08-18T22:16:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption2", 2024-08-18T22:16:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption3": { 2024-08-18T22:16:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption3", 2024-08-18T22:16:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption4": { 2024-08-18T22:16:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption4", 2024-08-18T22:16:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption5": { 2024-08-18T22:16:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption5", 2024-08-18T22:16:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption6": { 2024-08-18T22:16:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption6", 2024-08-18T22:16:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption7": { 2024-08-18T22:16:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption7", 2024-08-18T22:16:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-08-18T22:16:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "42", 2024-08-18T22:16:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "testkey": { 2024-08-18T22:16:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testkey", 2024-08-18T22:16:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "testlkey": { 2024-08-18T22:16:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testlkey", 2024-08-18T22:16:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "testnewline": { 2024-08-18T22:16:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testnewline", 2024-08-18T22:16:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snap_schedule", 2024-08-18T22:16:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_m_granularity": { 2024-08-18T22:16:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_m_granularity", 2024-08-18T22:16:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow minute scheduled snapshots", 2024-08-18T22:16:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: "dump_on_update": { 2024-08-18T22:16:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "dump_on_update", 2024-08-18T22:16:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "dump database to debug log on update", 2024-08-18T22:16:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "stats", 2024-08-18T22:16:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "status", 2024-08-18T22:16:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "telegraf", 2024-08-18T22:16:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "address": { 2024-08-18T22:16:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "address", 2024-08-18T22:16:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-18T22:16:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.355 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.355 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.355 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.355 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.355 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-08-18T22:16:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-08-18T22:16:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15", 2024-08-18T22:16:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.357 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.357 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.357 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.357 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.357 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.357 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.358 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.358 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.358 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.358 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.358 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.358 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "telemetry", 2024-08-18T22:16:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_basic": { 2024-08-18T22:16:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_basic", 2024-08-18T22:16:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-18T22:16:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_crash": { 2024-08-18T22:16:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_crash", 2024-08-18T22:16:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-18T22:16:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_device": { 2024-08-18T22:16:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_device", 2024-08-18T22:16:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-18T22:16:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_ident": { 2024-08-18T22:16:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_ident", 2024-08-18T22:16:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-18T22:16:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_perf": { 2024-08-18T22:16:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_perf", 2024-08-18T22:16:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-18T22:16:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "contact": { 2024-08-18T22:16:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "contact", 2024-08-18T22:16:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "description": { 2024-08-18T22:16:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "description", 2024-08-18T22:16:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "device_url": { 2024-08-18T22:16:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_url", 2024-08-18T22:16:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-18T22:16:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "enabled": { 2024-08-18T22:16:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enabled", 2024-08-18T22:16:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-08-18T22:16:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-08-18T22:16:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "24", 2024-08-18T22:16:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "8", 2024-08-18T22:16:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "last_opt_revision": { 2024-08-18T22:16:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "last_opt_revision", 2024-08-18T22:16:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1", 2024-08-18T22:16:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "leaderboard": { 2024-08-18T22:16:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "leaderboard", 2024-08-18T22:16:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.388 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.388 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.388 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.388 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.388 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.388 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.388 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.388 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.389 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.389 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.389 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.389 INFO:teuthology.orchestra.run.smithi123.stdout: "leaderboard_description": { 2024-08-18T22:16:46.389 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "leaderboard_description", 2024-08-18T22:16:46.389 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.389 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "organization": { 2024-08-18T22:16:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "organization", 2024-08-18T22:16:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "proxy": { 2024-08-18T22:16:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "proxy", 2024-08-18T22:16:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "url": { 2024-08-18T22:16:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "url", 2024-08-18T22:16:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-18T22:16:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "test_orchestrator", 2024-08-18T22:16:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "volumes", 2024-08-18T22:16:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: "max_concurrent_clones": { 2024-08-18T22:16:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_concurrent_clones", 2024-08-18T22:16:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "4", 2024-08-18T22:16:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-18T22:16:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "periodic_async_work": { 2024-08-18T22:16:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "periodic_async_work", 2024-08-18T22:16:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Periodically check for async work", 2024-08-18T22:16:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: "snapshot_clone_delay": { 2024-08-18T22:16:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snapshot_clone_delay", 2024-08-18T22:16:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-08-18T22:16:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-18T22:16:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "snapshot_clone_no_wait": { 2024-08-18T22:16:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snapshot_clone_no_wait", 2024-08-18T22:16:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-18T22:16:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix", 2024-08-18T22:16:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "discovery_interval": { 2024-08-18T22:16:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "discovery_interval", 2024-08-18T22:16:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-08-18T22:16:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "100", 2024-08-18T22:16:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "identifier": { 2024-08-18T22:16:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "identifier", 2024-08-18T22:16:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-08-18T22:16:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-08-18T22:16:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-08-18T22:16:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_host": { 2024-08-18T22:16:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_host", 2024-08-18T22:16:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_port": { 2024-08-18T22:16:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_port", 2024-08-18T22:16:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10051", 2024-08-18T22:16:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_sender": { 2024-08-18T22:16:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_sender", 2024-08-18T22:16:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-18T22:16:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-08-18T22:16:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "gid": 24113, 2024-08-18T22:16:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "y", 2024-08-18T22:16:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr_features": 4540701547738038271, 2024-08-18T22:16:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "available_modules": [ 2024-08-18T22:16:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "alerts", 2024-08-18T22:16:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-08-18T22:16:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-08-18T22:16:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-08-18T22:16:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How frequently to reexamine health status", 2024-08-18T22:16:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.465 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.465 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_destination": { 2024-08-18T22:16:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_destination", 2024-08-18T22:16:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Email address to send alerts to", 2024-08-18T22:16:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_from_name": { 2024-08-18T22:16:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_from_name", 2024-08-18T22:16:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "Ceph", 2024-08-18T22:16:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Email From: name", 2024-08-18T22:16:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_host": { 2024-08-18T22:16:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_host", 2024-08-18T22:16:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP server", 2024-08-18T22:16:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_password": { 2024-08-18T22:16:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_password", 2024-08-18T22:16:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Password to authenticate with", 2024-08-18T22:16:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_port": { 2024-08-18T22:16:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_port", 2024-08-18T22:16:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "465", 2024-08-18T22:16:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP port", 2024-08-18T22:16:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_sender": { 2024-08-18T22:16:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_sender", 2024-08-18T22:16:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP envelope sender", 2024-08-18T22:16:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_ssl": { 2024-08-18T22:16:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_ssl", 2024-08-18T22:16:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-18T22:16:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_user": { 2024-08-18T22:16:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_user", 2024-08-18T22:16:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "User to authenticate as", 2024-08-18T22:16:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "balancer", 2024-08-18T22:16:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "active": { 2024-08-18T22:16:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "active", 2024-08-18T22:16:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "automatically balance PGs across cluster", 2024-08-18T22:16:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "begin_time": { 2024-08-18T22:16:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "begin_time", 2024-08-18T22:16:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0000", 2024-08-18T22:16:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "beginning time of day to automatically balance", 2024-08-18T22:16:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-18T22:16:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "begin_weekday": { 2024-08-18T22:16:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "begin_weekday", 2024-08-18T22:16:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-08-18T22:16:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-08-18T22:16:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0", 2024-08-18T22:16:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "6", 2024-08-18T22:16:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-18T22:16:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-18T22:16:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_max_iterations": { 2024-08-18T22:16:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_max_iterations", 2024-08-18T22:16:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-08-18T22:16:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "25", 2024-08-18T22:16:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-08-18T22:16:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "250", 2024-08-18T22:16:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-18T22:16:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_metrics": { 2024-08-18T22:16:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_metrics", 2024-08-18T22:16:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "pgs,objects,bytes", 2024-08-18T22:16:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-18T22:16:46.491 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-18T22:16:46.491 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.491 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.491 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.491 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_step": { 2024-08-18T22:16:46.491 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_step", 2024-08-18T22:16:46.491 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:46.491 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.492 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.492 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0.5", 2024-08-18T22:16:46.492 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0.001", 2024-08-18T22:16:46.492 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "0.999", 2024-08-18T22:16:46.492 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.492 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "aggressiveness of optimization", 2024-08-18T22:16:46.492 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-18T22:16:46.492 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.493 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.493 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.493 INFO:teuthology.orchestra.run.smithi123.stdout: "end_time": { 2024-08-18T22:16:46.493 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "end_time", 2024-08-18T22:16:46.493 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.493 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.493 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.494 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "2359", 2024-08-18T22:16:46.494 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.494 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.494 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.494 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "ending time of day to automatically balance", 2024-08-18T22:16:46.494 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-18T22:16:46.494 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.495 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.495 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.495 INFO:teuthology.orchestra.run.smithi123.stdout: "end_weekday": { 2024-08-18T22:16:46.495 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "end_weekday", 2024-08-18T22:16:46.495 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-08-18T22:16:46.495 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.495 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.495 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-08-18T22:16:46.496 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0", 2024-08-18T22:16:46.496 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "6", 2024-08-18T22:16:46.496 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.496 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-18T22:16:46.496 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-18T22:16:46.496 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.496 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.497 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.497 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.497 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.497 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.497 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.497 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.497 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.497 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.498 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.498 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.498 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.498 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.498 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.498 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.498 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.499 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.499 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.499 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.499 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.499 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.499 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.499 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.500 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.500 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.500 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.500 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.500 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.500 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.500 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.500 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.501 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.501 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.501 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.501 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.501 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.501 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.502 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.502 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.502 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.502 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.502 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.502 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.502 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.503 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.503 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.503 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.503 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.503 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.503 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.504 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.504 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.504 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.504 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.504 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.504 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.504 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.505 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.505 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.505 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.505 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.505 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.505 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.505 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.506 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.506 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.506 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.506 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.506 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.506 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.506 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.507 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.507 INFO:teuthology.orchestra.run.smithi123.stdout: "min_score": { 2024-08-18T22:16:46.507 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "min_score", 2024-08-18T22:16:46.507 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:46.507 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.507 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.507 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-08-18T22:16:46.508 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.508 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.508 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.508 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-18T22:16:46.508 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.508 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.508 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.509 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.509 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": { 2024-08-18T22:16:46.509 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mode", 2024-08-18T22:16:46.509 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.509 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.509 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.509 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "upmap", 2024-08-18T22:16:46.509 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.510 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.510 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.510 INFO:teuthology.orchestra.run.smithi123.stdout: "crush-compat", 2024-08-18T22:16:46.510 INFO:teuthology.orchestra.run.smithi123.stdout: "none", 2024-08-18T22:16:46.510 INFO:teuthology.orchestra.run.smithi123.stdout: "read", 2024-08-18T22:16:46.510 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap", 2024-08-18T22:16:46.510 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap-read" 2024-08-18T22:16:46.510 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.511 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Balancer mode", 2024-08-18T22:16:46.511 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.511 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.511 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.511 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.511 INFO:teuthology.orchestra.run.smithi123.stdout: "pool_ids": { 2024-08-18T22:16:46.511 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pool_ids", 2024-08-18T22:16:46.512 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.512 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.512 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.512 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.512 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.512 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.512 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.513 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-18T22:16:46.513 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.513 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.513 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.513 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.513 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-08-18T22:16:46.513 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-08-18T22:16:46.513 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-08-18T22:16:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.514 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-18T22:16:46.515 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.515 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.515 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.515 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.515 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap_max_deviation": { 2024-08-18T22:16:46.515 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "upmap_max_deviation", 2024-08-18T22:16:46.515 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.515 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.516 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.516 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-08-18T22:16:46.516 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-08-18T22:16:46.516 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.516 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.516 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-18T22:16:46.516 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-18T22:16:46.517 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.517 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.517 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.517 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap_max_optimizations": { 2024-08-18T22:16:46.517 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "upmap_max_optimizations", 2024-08-18T22:16:46.517 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-08-18T22:16:46.517 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.518 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.518 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:46.518 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.518 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.518 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.518 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-18T22:16:46.518 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.519 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.519 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.519 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.519 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.519 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.519 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.519 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cephadm", 2024-08-18T22:16:46.519 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.520 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.520 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.520 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_down_multiplier": { 2024-08-18T22:16:46.520 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_down_multiplier", 2024-08-18T22:16:46.520 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:46.520 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.520 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.520 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3.0", 2024-08-18T22:16:46.521 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.521 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.521 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.521 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-18T22:16:46.521 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.521 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.521 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.521 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.522 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_refresh_rate": { 2024-08-18T22:16:46.522 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_refresh_rate", 2024-08-18T22:16:46.522 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.522 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.522 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.522 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "20", 2024-08-18T22:16:46.522 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.522 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.523 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.523 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-18T22:16:46.523 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.523 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.523 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.523 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.523 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_starting_port": { 2024-08-18T22:16:46.524 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_starting_port", 2024-08-18T22:16:46.524 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.524 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.524 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.524 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "4721", 2024-08-18T22:16:46.524 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.524 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.524 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.525 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-18T22:16:46.525 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.525 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.525 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.525 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.525 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_ptrace": { 2024-08-18T22:16:46.525 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_ptrace", 2024-08-18T22:16:46.525 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.525 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.526 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.526 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.526 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.526 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.526 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.526 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-18T22:16:46.526 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-18T22:16:46.527 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.527 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.527 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.527 INFO:teuthology.orchestra.run.smithi123.stdout: "autotune_interval": { 2024-08-18T22:16:46.527 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "autotune_interval", 2024-08-18T22:16:46.527 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.527 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.527 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.528 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-08-18T22:16:46.528 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.528 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.528 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.528 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-18T22:16:46.528 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.528 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.528 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.528 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.529 INFO:teuthology.orchestra.run.smithi123.stdout: "autotune_memory_target_ratio": { 2024-08-18T22:16:46.529 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "autotune_memory_target_ratio", 2024-08-18T22:16:46.529 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:46.529 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.529 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.529 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0.7", 2024-08-18T22:16:46.529 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.530 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.530 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.530 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-18T22:16:46.530 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.530 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.530 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.530 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.530 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm_log_destination": { 2024-08-18T22:16:46.530 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cephadm_log_destination", 2024-08-18T22:16:46.531 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.531 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.531 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.531 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.531 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.531 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.531 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.531 INFO:teuthology.orchestra.run.smithi123.stdout: "file", 2024-08-18T22:16:46.532 INFO:teuthology.orchestra.run.smithi123.stdout: "file,syslog", 2024-08-18T22:16:46.532 INFO:teuthology.orchestra.run.smithi123.stdout: "syslog" 2024-08-18T22:16:46.532 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.532 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-18T22:16:46.532 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.532 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.532 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.532 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.533 INFO:teuthology.orchestra.run.smithi123.stdout: "cgroups_split": { 2024-08-18T22:16:46.533 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cgroups_split", 2024-08-18T22:16:46.533 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.533 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.533 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.533 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.533 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.533 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.534 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.534 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-18T22:16:46.534 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.534 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.534 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.534 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.534 INFO:teuthology.orchestra.run.smithi123.stdout: "config_checks_enabled": { 2024-08-18T22:16:46.534 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_checks_enabled", 2024-08-18T22:16:46.535 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.535 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.535 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.535 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.535 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.535 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.535 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.535 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-18T22:16:46.536 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.536 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.536 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.536 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.536 INFO:teuthology.orchestra.run.smithi123.stdout: "config_dashboard": { 2024-08-18T22:16:46.536 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_dashboard", 2024-08-18T22:16:46.536 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.536 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.537 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.537 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.537 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.537 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.537 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.537 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-18T22:16:46.537 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.537 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.537 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.538 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.538 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_alertmanager": { 2024-08-18T22:16:46.538 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_alertmanager", 2024-08-18T22:16:46.538 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.538 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.538 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.538 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-08-18T22:16:46.538 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.539 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.539 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.539 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-08-18T22:16:46.539 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.539 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.539 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.539 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.539 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_base": { 2024-08-18T22:16:46.539 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_base", 2024-08-18T22:16:46.540 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.540 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.540 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.540 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-18T22:16:46.540 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.540 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.540 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.540 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Container image name, without the tag", 2024-08-18T22:16:46.541 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.541 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.541 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.541 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.541 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_elasticsearch": { 2024-08-18T22:16:46.541 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_elasticsearch", 2024-08-18T22:16:46.541 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.541 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.542 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.542 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-18T22:16:46.542 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.542 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.542 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.542 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "elasticsearch container image", 2024-08-18T22:16:46.542 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.542 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.543 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.543 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.543 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_grafana": { 2024-08-18T22:16:46.543 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_grafana", 2024-08-18T22:16:46.543 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.543 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.543 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.543 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-08-18T22:16:46.544 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.544 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.544 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.544 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-08-18T22:16:46.544 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.544 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.544 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.544 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.545 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_haproxy": { 2024-08-18T22:16:46.545 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_haproxy", 2024-08-18T22:16:46.545 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.545 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.545 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.545 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-18T22:16:46.545 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.545 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.545 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.546 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "HAproxy container image", 2024-08-18T22:16:46.546 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.546 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.546 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.546 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.546 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_agent": { 2024-08-18T22:16:46.546 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_agent", 2024-08-18T22:16:46.546 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.547 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.547 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.547 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-18T22:16:46.547 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.547 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.547 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.548 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger agent container image", 2024-08-18T22:16:46.548 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.548 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.548 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.548 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.548 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_collector": { 2024-08-18T22:16:46.548 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_collector", 2024-08-18T22:16:46.548 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.549 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.549 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.549 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-18T22:16:46.549 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.549 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.549 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.550 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger collector container image", 2024-08-18T22:16:46.550 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.550 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.550 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.550 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.550 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_query": { 2024-08-18T22:16:46.550 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_query", 2024-08-18T22:16:46.551 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.551 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.551 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.551 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-18T22:16:46.551 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.551 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.551 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.552 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger query container image", 2024-08-18T22:16:46.552 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.552 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.552 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.552 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.552 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_keepalived": { 2024-08-18T22:16:46.552 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_keepalived", 2024-08-18T22:16:46.553 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.553 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.553 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.553 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-18T22:16:46.553 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.553 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.553 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.554 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Keepalived container image", 2024-08-18T22:16:46.554 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.554 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.554 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.554 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.554 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_loki": { 2024-08-18T22:16:46.554 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_loki", 2024-08-18T22:16:46.554 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.555 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.555 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.555 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-18T22:16:46.555 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.555 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.555 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.555 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Loki container image", 2024-08-18T22:16:46.556 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.556 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.556 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.556 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.556 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_node_exporter": { 2024-08-18T22:16:46.556 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_node_exporter", 2024-08-18T22:16:46.556 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.557 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.557 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.557 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-08-18T22:16:46.557 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.557 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.557 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.557 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-08-18T22:16:46.558 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.558 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.558 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.558 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.558 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_nvmeof": { 2024-08-18T22:16:46.558 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_nvmeof", 2024-08-18T22:16:46.558 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.559 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.559 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.559 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-18T22:16:46.559 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.559 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.559 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.559 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Nvme-of container image", 2024-08-18T22:16:46.559 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.560 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.560 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.560 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.560 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_prometheus": { 2024-08-18T22:16:46.560 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_prometheus", 2024-08-18T22:16:46.560 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.560 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.560 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.560 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-08-18T22:16:46.561 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.561 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.561 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.561 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-08-18T22:16:46.561 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.561 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.561 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.561 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_promtail": { 2024-08-18T22:16:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_promtail", 2024-08-18T22:16:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-18T22:16:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Promtail container image", 2024-08-18T22:16:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_samba": { 2024-08-18T22:16:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_samba", 2024-08-18T22:16:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-18T22:16:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.565 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.565 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Samba/SMB container image", 2024-08-18T22:16:46.565 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.565 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.565 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.565 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.565 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_snmp_gateway": { 2024-08-18T22:16:46.566 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_snmp_gateway", 2024-08-18T22:16:46.566 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.566 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.566 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.566 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-18T22:16:46.566 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.566 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.567 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.567 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SNMP Gateway container image", 2024-08-18T22:16:46.567 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.567 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.567 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.567 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.567 INFO:teuthology.orchestra.run.smithi123.stdout: "container_init": { 2024-08-18T22:16:46.567 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_init", 2024-08-18T22:16:46.568 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.568 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.568 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.568 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.568 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.568 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.568 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.569 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Run podman/docker with `--init`", 2024-08-18T22:16:46.569 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.569 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.569 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.569 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.569 INFO:teuthology.orchestra.run.smithi123.stdout: "daemon_cache_timeout": { 2024-08-18T22:16:46.569 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "daemon_cache_timeout", 2024-08-18T22:16:46.570 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.570 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.570 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.570 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-08-18T22:16:46.570 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.570 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.570 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.571 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-18T22:16:46.571 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.571 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.571 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.571 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.571 INFO:teuthology.orchestra.run.smithi123.stdout: "default_cephadm_command_timeout": { 2024-08-18T22:16:46.571 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "default_cephadm_command_timeout", 2024-08-18T22:16:46.572 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.572 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.572 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.572 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "900", 2024-08-18T22:16:46.572 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.572 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.572 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.572 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-18T22:16:46.573 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.573 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.573 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.573 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.573 INFO:teuthology.orchestra.run.smithi123.stdout: "default_registry": { 2024-08-18T22:16:46.573 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "default_registry", 2024-08-18T22:16:46.573 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.573 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.574 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.574 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io", 2024-08-18T22:16:46.574 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.574 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.574 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.574 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-18T22:16:46.574 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.574 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.575 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.575 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.575 INFO:teuthology.orchestra.run.smithi123.stdout: "device_cache_timeout": { 2024-08-18T22:16:46.575 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_cache_timeout", 2024-08-18T22:16:46.575 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.575 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.575 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.576 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1800", 2024-08-18T22:16:46.576 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.576 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.576 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.576 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache device inventory", 2024-08-18T22:16:46.576 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.576 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.576 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.577 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.577 INFO:teuthology.orchestra.run.smithi123.stdout: "device_enhanced_scan": { 2024-08-18T22:16:46.577 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_enhanced_scan", 2024-08-18T22:16:46.577 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.577 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.577 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.577 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.577 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.578 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.578 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.578 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-18T22:16:46.578 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.578 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.578 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.578 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.578 INFO:teuthology.orchestra.run.smithi123.stdout: "facts_cache_timeout": { 2024-08-18T22:16:46.579 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "facts_cache_timeout", 2024-08-18T22:16:46.579 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.579 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.579 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.579 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-08-18T22:16:46.579 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.579 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.579 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.580 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache host facts data", 2024-08-18T22:16:46.580 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.580 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.580 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.580 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.580 INFO:teuthology.orchestra.run.smithi123.stdout: "grafana_dashboards_path": { 2024-08-18T22:16:46.580 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "grafana_dashboards_path", 2024-08-18T22:16:46.580 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.581 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.581 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.581 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-18T22:16:46.581 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.581 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.581 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.581 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-18T22:16:46.581 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.582 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.582 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.582 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.582 INFO:teuthology.orchestra.run.smithi123.stdout: "host_check_interval": { 2024-08-18T22:16:46.582 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "host_check_interval", 2024-08-18T22:16:46.582 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.582 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.583 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.583 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-08-18T22:16:46.583 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.583 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.583 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.583 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to perform a host check", 2024-08-18T22:16:46.583 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.583 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.584 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.584 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.584 INFO:teuthology.orchestra.run.smithi123.stdout: "hw_monitoring": { 2024-08-18T22:16:46.584 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "hw_monitoring", 2024-08-18T22:16:46.584 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.584 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.584 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.585 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.585 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.585 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.585 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.585 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-18T22:16:46.585 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.585 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.585 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.585 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.586 INFO:teuthology.orchestra.run.smithi123.stdout: "inventory_list_all": { 2024-08-18T22:16:46.586 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "inventory_list_all", 2024-08-18T22:16:46.586 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.586 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.586 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.586 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.586 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.587 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.587 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.587 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-18T22:16:46.587 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.587 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.587 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.587 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.588 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.588 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.588 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.588 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.588 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.588 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.588 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.588 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.589 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.589 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.589 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.589 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.589 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.589 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.589 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.589 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.590 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.590 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.590 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.590 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.590 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.590 INFO:teuthology.orchestra.run.smithi123.stdout: "log_refresh_metadata": { 2024-08-18T22:16:46.590 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_refresh_metadata", 2024-08-18T22:16:46.590 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.591 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.591 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.591 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.591 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.591 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.591 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.591 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-18T22:16:46.591 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.592 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.592 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.592 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.592 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.592 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.592 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.593 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.593 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.593 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.593 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.593 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.593 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.593 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-18T22:16:46.593 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.593 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.594 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.594 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.594 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.594 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.594 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.594 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.594 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.595 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.595 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.595 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.595 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.595 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.595 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.595 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.595 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.596 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.596 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.596 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.596 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.596 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.596 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.596 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.596 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.597 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.597 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.597 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.597 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.597 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.597 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.597 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.598 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.598 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.598 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.598 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.598 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.598 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.599 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.599 INFO:teuthology.orchestra.run.smithi123.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-18T22:16:46.599 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-18T22:16:46.599 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.599 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.599 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.599 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.599 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.600 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.600 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.600 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-18T22:16:46.600 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.600 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.600 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.600 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.601 INFO:teuthology.orchestra.run.smithi123.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-18T22:16:46.601 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-18T22:16:46.601 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.601 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.601 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.601 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "*", 2024-08-18T22:16:46.601 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.602 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.602 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.602 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-18T22:16:46.602 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.602 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.602 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.602 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.603 INFO:teuthology.orchestra.run.smithi123.stdout: "max_count_per_host": { 2024-08-18T22:16:46.603 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_count_per_host", 2024-08-18T22:16:46.603 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.603 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.603 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.603 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:46.603 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.603 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.604 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.604 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "max number of daemons per service per host", 2024-08-18T22:16:46.604 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.604 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.604 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.604 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.605 INFO:teuthology.orchestra.run.smithi123.stdout: "max_osd_draining_count": { 2024-08-18T22:16:46.605 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_osd_draining_count", 2024-08-18T22:16:46.605 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.605 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.605 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.605 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:46.605 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.606 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.606 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.606 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-18T22:16:46.606 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.606 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.606 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.606 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.607 INFO:teuthology.orchestra.run.smithi123.stdout: "migration_current": { 2024-08-18T22:16:46.607 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "migration_current", 2024-08-18T22:16:46.607 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.607 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.607 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.607 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.607 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.608 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.608 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.608 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "internal - do not modify", 2024-08-18T22:16:46.608 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.608 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.608 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.608 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.609 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": { 2024-08-18T22:16:46.609 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mode", 2024-08-18T22:16:46.609 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.609 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.609 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.609 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "root", 2024-08-18T22:16:46.609 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.609 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.610 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.610 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm-package", 2024-08-18T22:16:46.610 INFO:teuthology.orchestra.run.smithi123.stdout: "root" 2024-08-18T22:16:46.610 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.610 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "mode for remote execution of cephadm", 2024-08-18T22:16:46.610 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.610 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.611 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.611 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.611 INFO:teuthology.orchestra.run.smithi123.stdout: "oob_default_addr": { 2024-08-18T22:16:46.611 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "oob_default_addr", 2024-08-18T22:16:46.611 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.611 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.611 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.611 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "169.254.1.1", 2024-08-18T22:16:46.612 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.612 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.612 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.612 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-18T22:16:46.612 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.612 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.612 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.613 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.613 INFO:teuthology.orchestra.run.smithi123.stdout: "prometheus_alerts_path": { 2024-08-18T22:16:46.613 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prometheus_alerts_path", 2024-08-18T22:16:46.613 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.613 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.613 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.613 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-18T22:16:46.614 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.614 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.614 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.614 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-18T22:16:46.614 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.614 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.614 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.615 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.615 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_insecure": { 2024-08-18T22:16:46.615 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_insecure", 2024-08-18T22:16:46.615 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.615 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.615 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.615 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.616 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.616 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.616 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.616 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-18T22:16:46.616 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.616 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.616 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.617 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.617 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_password": { 2024-08-18T22:16:46.617 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_password", 2024-08-18T22:16:46.617 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.617 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.617 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.617 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.618 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.618 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.618 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.618 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-18T22:16:46.618 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.618 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.618 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.619 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.619 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_url": { 2024-08-18T22:16:46.619 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_url", 2024-08-18T22:16:46.619 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.619 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.619 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.619 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.619 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.620 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.620 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.620 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-18T22:16:46.620 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.620 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.620 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.620 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.620 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_username": { 2024-08-18T22:16:46.621 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_username", 2024-08-18T22:16:46.621 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.621 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.621 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.621 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.621 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.621 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.621 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.622 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-18T22:16:46.622 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.622 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.622 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.622 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.622 INFO:teuthology.orchestra.run.smithi123.stdout: "secure_monitoring_stack": { 2024-08-18T22:16:46.622 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "secure_monitoring_stack", 2024-08-18T22:16:46.622 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.623 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.623 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.623 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.623 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.623 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.623 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.623 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-18T22:16:46.623 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.624 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.624 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.624 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.624 INFO:teuthology.orchestra.run.smithi123.stdout: "service_discovery_port": { 2024-08-18T22:16:46.624 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "service_discovery_port", 2024-08-18T22:16:46.624 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.624 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.624 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.624 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8765", 2024-08-18T22:16:46.625 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.625 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.625 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.625 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "cephadm service discovery port", 2024-08-18T22:16:46.625 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.625 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.625 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.626 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.626 INFO:teuthology.orchestra.run.smithi123.stdout: "ssh_config_file": { 2024-08-18T22:16:46.626 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssh_config_file", 2024-08-18T22:16:46.626 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.626 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.626 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.626 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.626 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.627 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.627 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.627 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-18T22:16:46.627 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.627 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.627 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.627 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.627 INFO:teuthology.orchestra.run.smithi123.stdout: "use_agent": { 2024-08-18T22:16:46.628 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "use_agent", 2024-08-18T22:16:46.628 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.628 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.628 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.628 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.628 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.628 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.628 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.629 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-18T22:16:46.629 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.629 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.629 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.629 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.629 INFO:teuthology.orchestra.run.smithi123.stdout: "use_repo_digest": { 2024-08-18T22:16:46.629 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "use_repo_digest", 2024-08-18T22:16:46.630 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.630 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.630 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.630 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.630 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.630 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.630 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.630 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-18T22:16:46.631 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.631 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.631 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.631 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.631 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_failed_host_check": { 2024-08-18T22:16:46.631 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_failed_host_check", 2024-08-18T22:16:46.631 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.632 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.632 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.632 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.632 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.632 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.632 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.632 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if the host check fails", 2024-08-18T22:16:46.633 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.633 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.633 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.633 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.633 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_stray_daemons": { 2024-08-18T22:16:46.633 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_stray_daemons", 2024-08-18T22:16:46.633 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.634 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.634 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.634 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.634 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.634 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.634 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.634 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-18T22:16:46.635 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.635 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.635 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.635 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.635 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_stray_hosts": { 2024-08-18T22:16:46.635 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_stray_hosts", 2024-08-18T22:16:46.635 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.636 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.636 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.636 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.636 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.636 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.636 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.636 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-18T22:16:46.637 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.637 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.637 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.637 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.637 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.637 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.637 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.638 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crash", 2024-08-18T22:16:46.638 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.638 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.638 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.638 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.638 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.638 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.639 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.639 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.639 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.639 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.639 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.639 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.639 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.640 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.640 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.640 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.640 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.640 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.640 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.640 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.640 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.641 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.641 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.641 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.641 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.641 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.641 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.641 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.642 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.642 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.642 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.642 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.642 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.642 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.642 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.642 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.643 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.643 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.643 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.643 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.643 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.643 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.643 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.643 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.644 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.644 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.644 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.644 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.644 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.644 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.644 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.644 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.645 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.645 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.645 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.645 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.645 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.645 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.645 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.646 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.646 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.646 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.646 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.646 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.646 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.646 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.646 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.647 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.647 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.647 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.647 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.647 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.647 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.647 INFO:teuthology.orchestra.run.smithi123.stdout: "retain_interval": { 2024-08-18T22:16:46.647 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "retain_interval", 2024-08-18T22:16:46.648 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.648 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.648 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.648 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "31536000", 2024-08-18T22:16:46.648 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.648 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.649 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.649 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-18T22:16:46.649 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.649 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.649 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.649 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.649 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_recent_interval": { 2024-08-18T22:16:46.649 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_recent_interval", 2024-08-18T22:16:46.650 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.650 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.650 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.650 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1209600", 2024-08-18T22:16:46.650 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.650 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.650 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.650 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-18T22:16:46.651 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.651 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.651 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.651 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.651 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.651 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.651 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.651 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "dashboard", 2024-08-18T22:16:46.652 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.652 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.652 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.652 INFO:teuthology.orchestra.run.smithi123.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-18T22:16:46.652 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-18T22:16:46.652 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.652 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.652 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.653 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:46.653 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.653 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.653 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.653 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.653 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.653 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.653 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.654 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.654 INFO:teuthology.orchestra.run.smithi123.stdout: "ALERTMANAGER_API_HOST": { 2024-08-18T22:16:46.654 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-18T22:16:46.654 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.654 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.654 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.654 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.654 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.655 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.655 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.655 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.655 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.655 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.655 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.655 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.655 INFO:teuthology.orchestra.run.smithi123.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-18T22:16:46.656 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-18T22:16:46.656 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.656 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.656 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.656 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.656 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.656 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.657 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.657 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.657 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.657 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.657 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.657 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.657 INFO:teuthology.orchestra.run.smithi123.stdout: "AUDIT_API_ENABLED": { 2024-08-18T22:16:46.657 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "AUDIT_API_ENABLED", 2024-08-18T22:16:46.658 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.658 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.658 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.658 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.658 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.658 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.658 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.659 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.659 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.659 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.659 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.659 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.659 INFO:teuthology.orchestra.run.smithi123.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-18T22:16:46.659 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-18T22:16:46.659 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.660 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.660 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.660 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.660 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.660 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.660 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.660 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.660 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.661 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.661 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.661 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.661 INFO:teuthology.orchestra.run.smithi123.stdout: "ENABLE_BROWSABLE_API": { 2024-08-18T22:16:46.661 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-18T22:16:46.661 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.661 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.661 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.662 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.662 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.662 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.662 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.662 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.662 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.662 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.663 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.663 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.663 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-18T22:16:46.663 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-18T22:16:46.663 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.663 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.663 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.663 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.664 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.664 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.664 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.664 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.664 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.664 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.664 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.665 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.665 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-18T22:16:46.665 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-18T22:16:46.665 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.665 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.665 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.665 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.665 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.666 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.666 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.666 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.666 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.666 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.666 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.666 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.666 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-18T22:16:46.667 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-18T22:16:46.667 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.667 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.667 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.667 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.667 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.667 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.667 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.668 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.668 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.669 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.669 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.669 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.669 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-18T22:16:46.670 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-18T22:16:46.670 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.670 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.670 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.670 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.670 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.670 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.671 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.671 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.671 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.671 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.671 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.671 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.671 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-18T22:16:46.672 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-18T22:16:46.672 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.672 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.672 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.672 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.672 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.672 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.673 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.673 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.673 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.673 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.673 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.673 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.673 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-18T22:16:46.673 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-18T22:16:46.674 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.674 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.674 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.674 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.674 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.674 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.674 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.675 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.675 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.675 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.675 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.675 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.675 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-18T22:16:46.675 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-18T22:16:46.676 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.676 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.676 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.676 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.676 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.676 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.676 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.676 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.677 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.677 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.677 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.677 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.677 INFO:teuthology.orchestra.run.smithi123.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-18T22:16:46.677 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-18T22:16:46.677 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.678 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.678 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.678 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.678 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.678 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.678 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.678 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.679 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.679 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.679 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.679 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.679 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_PASSWORD": { 2024-08-18T22:16:46.679 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-18T22:16:46.679 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.680 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.680 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.680 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-08-18T22:16:46.680 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.680 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.680 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.680 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.681 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.681 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.681 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.681 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.681 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-18T22:16:46.681 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-18T22:16:46.681 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.681 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.681 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.682 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.682 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.682 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.682 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.682 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.682 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.682 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.682 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.683 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.683 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_URL": { 2024-08-18T22:16:46.683 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_URL", 2024-08-18T22:16:46.683 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.683 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.683 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.683 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.683 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.684 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.684 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.684 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.684 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.684 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.684 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.684 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.684 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_USERNAME": { 2024-08-18T22:16:46.685 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-18T22:16:46.685 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.685 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.685 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.685 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-08-18T22:16:46.685 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.685 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.685 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.686 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.686 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.686 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.686 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.686 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.686 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-18T22:16:46.686 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-18T22:16:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.688 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.688 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.688 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.688 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.688 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-18T22:16:46.688 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-18T22:16:46.688 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.688 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.688 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.689 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.689 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.689 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.689 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.689 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.689 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.689 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.690 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.690 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.690 INFO:teuthology.orchestra.run.smithi123.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-18T22:16:46.690 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-18T22:16:46.690 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.690 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.690 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.690 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.691 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.691 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.691 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.691 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.691 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.691 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.691 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.691 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.692 INFO:teuthology.orchestra.run.smithi123.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-18T22:16:46.692 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-18T22:16:46.692 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.692 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.692 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.692 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.692 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.693 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.693 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.693 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.693 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.693 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.693 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.693 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.694 INFO:teuthology.orchestra.run.smithi123.stdout: "PROMETHEUS_API_HOST": { 2024-08-18T22:16:46.694 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-18T22:16:46.694 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.694 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.694 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.694 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.695 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.695 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.695 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.695 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.695 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.695 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.695 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.695 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.696 INFO:teuthology.orchestra.run.smithi123.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-18T22:16:46.696 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-18T22:16:46.696 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.696 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.696 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.696 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.696 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.697 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.697 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.697 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.697 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.697 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.697 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.697 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.698 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-18T22:16:46.698 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-18T22:16:46.698 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.698 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.698 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.698 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.698 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.699 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.699 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.699 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.699 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.699 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.699 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.699 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.699 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-18T22:16:46.700 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-18T22:16:46.700 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.700 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.700 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.700 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.700 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.700 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.701 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.701 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.701 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.701 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.701 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.701 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.701 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-18T22:16:46.701 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-18T22:16:46.702 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.702 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.702 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.702 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.702 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.702 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.702 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.703 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.703 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.703 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.703 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.703 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.703 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-18T22:16:46.703 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-18T22:16:46.703 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.704 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.704 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.704 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.704 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.704 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.704 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.704 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.704 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.705 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.705 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.705 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.705 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-18T22:16:46.705 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-18T22:16:46.705 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.705 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.705 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.705 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.706 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.706 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.706 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.706 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.706 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.706 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.706 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.706 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.707 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-18T22:16:46.707 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-18T22:16:46.707 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.707 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.707 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.707 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.707 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.707 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.708 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.708 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.708 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.708 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.708 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.708 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.708 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-18T22:16:46.709 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-18T22:16:46.709 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.709 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.709 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.709 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.709 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.709 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.710 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.710 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.710 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.710 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.710 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.710 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.710 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_ENABLED": { 2024-08-18T22:16:46.711 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-18T22:16:46.711 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.711 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.711 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.711 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.711 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.711 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.711 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.712 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.712 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.712 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.712 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.712 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.712 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-18T22:16:46.712 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-18T22:16:46.713 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.713 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.713 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.713 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-18T22:16:46.713 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.713 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.713 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.714 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.714 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.714 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.714 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.714 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.714 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-18T22:16:46.715 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-18T22:16:46.715 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.715 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.715 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.715 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:46.715 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.715 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.715 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.716 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.716 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.716 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.716 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.716 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.716 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-18T22:16:46.716 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-18T22:16:46.717 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.717 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.717 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.717 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8", 2024-08-18T22:16:46.717 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.717 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.717 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.717 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.718 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.718 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.718 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.718 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.718 INFO:teuthology.orchestra.run.smithi123.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-18T22:16:46.718 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-18T22:16:46.718 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.718 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.719 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.719 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "45", 2024-08-18T22:16:46.719 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.719 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.719 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.719 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.719 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.719 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.720 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.720 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.720 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_ACCESS_KEY": { 2024-08-18T22:16:46.720 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-18T22:16:46.720 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.720 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.720 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.720 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.721 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.721 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.721 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.721 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.721 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.721 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.721 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.722 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.722 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-18T22:16:46.722 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-18T22:16:46.722 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.722 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.722 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.722 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-08-18T22:16:46.722 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.723 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.723 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.723 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.723 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.723 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.723 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.723 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.724 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_SECRET_KEY": { 2024-08-18T22:16:46.724 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-18T22:16:46.724 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.724 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.724 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.724 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.724 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.724 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.725 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.725 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.725 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.725 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.725 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.725 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.725 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_SSL_VERIFY": { 2024-08-18T22:16:46.725 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-18T22:16:46.726 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.726 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.726 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.726 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.726 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.726 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.726 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.726 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.727 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.727 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.727 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.727 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.727 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-18T22:16:46.727 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-18T22:16:46.727 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.727 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.728 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.728 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-08-18T22:16:46.728 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.728 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.728 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.728 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.728 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.729 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.729 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.729 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.729 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-18T22:16:46.729 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-18T22:16:46.729 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.729 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.729 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.730 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:46.730 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.730 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.730 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.730 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.730 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.730 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.731 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.731 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.731 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-18T22:16:46.731 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-18T22:16:46.731 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.731 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.731 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.731 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-08-18T22:16:46.732 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.732 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.732 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.732 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.732 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.732 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.732 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.732 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.733 INFO:teuthology.orchestra.run.smithi123.stdout: "cross_origin_url": { 2024-08-18T22:16:46.733 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cross_origin_url", 2024-08-18T22:16:46.733 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.733 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.733 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.733 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.733 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.733 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.734 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.734 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.734 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.734 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.734 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.734 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.734 INFO:teuthology.orchestra.run.smithi123.stdout: "crt_file": { 2024-08-18T22:16:46.735 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crt_file", 2024-08-18T22:16:46.735 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.735 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.735 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.735 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.735 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.735 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.735 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.736 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.736 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.736 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.736 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.736 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.736 INFO:teuthology.orchestra.run.smithi123.stdout: "debug": { 2024-08-18T22:16:46.736 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "debug", 2024-08-18T22:16:46.736 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.737 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.737 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.737 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.737 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.737 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.737 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.737 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable/disable debug options", 2024-08-18T22:16:46.738 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.738 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.738 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.738 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.738 INFO:teuthology.orchestra.run.smithi123.stdout: "jwt_token_ttl": { 2024-08-18T22:16:46.738 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "jwt_token_ttl", 2024-08-18T22:16:46.738 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.739 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.739 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.739 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "28800", 2024-08-18T22:16:46.739 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.739 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.739 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.739 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.740 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.740 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.740 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.740 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.740 INFO:teuthology.orchestra.run.smithi123.stdout: "key_file": { 2024-08-18T22:16:46.740 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "key_file", 2024-08-18T22:16:46.740 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.741 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.741 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.741 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.741 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.741 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.741 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.741 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.741 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.742 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.742 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.742 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.742 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.742 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.742 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.742 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.742 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.743 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.743 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.743 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.743 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.743 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.743 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.743 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.743 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.744 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.744 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.744 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.744 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.744 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.744 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.744 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.744 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.745 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.745 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.745 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.745 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.745 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.745 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.745 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.745 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.746 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.746 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.746 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.746 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.746 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.746 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.746 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.746 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.747 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.747 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.747 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.747 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.747 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.747 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.747 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.747 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.748 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.748 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.748 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.748 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.748 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.748 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.748 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.748 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.749 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.749 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.749 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.749 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.749 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.749 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.749 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.749 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.750 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.750 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.750 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.750 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.750 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.750 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.750 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.751 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.751 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.751 INFO:teuthology.orchestra.run.smithi123.stdout: "motd": { 2024-08-18T22:16:46.751 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "motd", 2024-08-18T22:16:46.751 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.751 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.751 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.751 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.752 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.752 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.752 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.752 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "The message of the day", 2024-08-18T22:16:46.752 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.752 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.752 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.753 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.753 INFO:teuthology.orchestra.run.smithi123.stdout: "redirect_resolve_ip_addr": { 2024-08-18T22:16:46.753 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "redirect_resolve_ip_addr", 2024-08-18T22:16:46.753 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.753 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.753 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.753 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.753 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.753 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.754 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.754 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.754 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.754 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.754 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.754 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.754 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-08-18T22:16:46.754 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-08-18T22:16:46.755 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.755 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.755 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.755 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "::", 2024-08-18T22:16:46.755 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.755 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.755 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.756 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.756 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.756 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.756 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.756 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.756 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-08-18T22:16:46.756 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-08-18T22:16:46.756 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.757 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.757 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.757 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8080", 2024-08-18T22:16:46.757 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.757 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.757 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.757 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.757 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.757 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.758 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.758 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.758 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl": { 2024-08-18T22:16:46.758 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl", 2024-08-18T22:16:46.758 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.758 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.758 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.759 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.759 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.759 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.759 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.759 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.759 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.759 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.759 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.759 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.760 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl_server_port": { 2024-08-18T22:16:46.760 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl_server_port", 2024-08-18T22:16:46.760 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.760 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.760 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.760 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8443", 2024-08-18T22:16:46.760 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.760 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.761 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.761 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.761 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.761 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.761 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.761 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.761 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_behaviour": { 2024-08-18T22:16:46.761 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_behaviour", 2024-08-18T22:16:46.762 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.762 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.762 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.762 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "redirect", 2024-08-18T22:16:46.762 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.762 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.762 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.763 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.763 INFO:teuthology.orchestra.run.smithi123.stdout: "redirect" 2024-08-18T22:16:46.763 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.763 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.763 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.763 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.763 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.763 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.764 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_error_status_code": { 2024-08-18T22:16:46.764 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_error_status_code", 2024-08-18T22:16:46.764 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.764 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.764 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.764 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "500", 2024-08-18T22:16:46.764 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "400", 2024-08-18T22:16:46.764 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "599", 2024-08-18T22:16:46.765 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.765 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.765 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.765 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.765 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.765 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.765 INFO:teuthology.orchestra.run.smithi123.stdout: "url_prefix": { 2024-08-18T22:16:46.765 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "url_prefix", 2024-08-18T22:16:46.766 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.766 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.766 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.766 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.766 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.766 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.766 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.767 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.767 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.767 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.767 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.767 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.767 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.767 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.767 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.768 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "devicehealth", 2024-08-18T22:16:46.768 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.768 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.768 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.768 INFO:teuthology.orchestra.run.smithi123.stdout: "enable_monitoring": { 2024-08-18T22:16:46.768 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enable_monitoring", 2024-08-18T22:16:46.768 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.768 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.769 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.769 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.769 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.769 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.769 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.769 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "monitor device health metrics", 2024-08-18T22:16:46.769 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.769 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.770 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.770 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.770 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.770 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.770 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.770 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.770 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.771 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.771 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.771 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.771 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.771 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.771 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.771 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.771 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.772 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.772 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.772 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.772 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.772 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.772 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.772 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.772 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.773 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.773 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.773 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.773 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.773 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.773 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.773 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.774 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.774 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.774 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.774 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.774 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.774 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.774 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.774 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.775 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.775 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.775 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.775 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.775 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.775 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.775 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.776 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.776 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.776 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.776 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.776 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.776 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.776 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.776 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "mark_out_threshold": { 2024-08-18T22:16:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mark_out_threshold", 2024-08-18T22:16:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "2419200", 2024-08-18T22:16:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-18T22:16:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "pool_name": { 2024-08-18T22:16:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pool_name", 2024-08-18T22:16:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "device_health_metrics", 2024-08-18T22:16:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-18T22:16:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "retention_period": { 2024-08-18T22:16:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "retention_period", 2024-08-18T22:16:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15552000", 2024-08-18T22:16:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long to retain device health metrics", 2024-08-18T22:16:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: "scrape_frequency": { 2024-08-18T22:16:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "scrape_frequency", 2024-08-18T22:16:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "86400", 2024-08-18T22:16:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-18T22:16:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "self_heal": { 2024-08-18T22:16:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "self_heal", 2024-08-18T22:16:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.787 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.787 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.787 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.787 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.787 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.787 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-18T22:16:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-08-18T22:16:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-08-18T22:16:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-08-18T22:16:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to wake up and check device health", 2024-08-18T22:16:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_threshold": { 2024-08-18T22:16:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_threshold", 2024-08-18T22:16:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "7257600", 2024-08-18T22:16:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-18T22:16:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.793 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.793 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "diskprediction_local", 2024-08-18T22:16:46.793 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.793 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.793 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.793 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.793 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.793 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.795 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.795 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.795 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.795 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.795 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.795 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.795 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.795 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.796 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.796 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.796 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.796 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.796 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.796 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.796 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.796 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.797 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.797 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.797 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.797 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.797 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.797 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.797 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.797 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.798 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.798 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.798 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.798 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.798 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.798 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.798 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.799 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.799 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.799 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.799 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.799 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.799 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.799 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.799 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.800 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.800 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.800 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.800 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.800 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.800 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.800 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.800 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.801 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.801 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.801 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.801 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.801 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.801 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.801 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.801 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.802 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.802 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.802 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.802 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.802 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.802 INFO:teuthology.orchestra.run.smithi123.stdout: "predict_interval": { 2024-08-18T22:16:46.802 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "predict_interval", 2024-08-18T22:16:46.803 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.803 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.803 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.803 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "86400", 2024-08-18T22:16:46.803 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.803 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.803 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.803 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.803 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.804 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.804 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.804 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.804 INFO:teuthology.orchestra.run.smithi123.stdout: "predictor_model": { 2024-08-18T22:16:46.804 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "predictor_model", 2024-08-18T22:16:46.804 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.804 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.805 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.805 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "prophetstor", 2024-08-18T22:16:46.805 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.805 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.805 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.805 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.805 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.805 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.806 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.806 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.806 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-08-18T22:16:46.806 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-08-18T22:16:46.806 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.806 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.806 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.807 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-08-18T22:16:46.807 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.807 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.807 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.807 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.807 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.807 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.807 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.808 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.808 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.808 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.808 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.808 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "influx", 2024-08-18T22:16:46.808 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": false, 2024-08-18T22:16:46.808 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "influxdb python module not found", 2024-08-18T22:16:46.808 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.809 INFO:teuthology.orchestra.run.smithi123.stdout: "batch_size": { 2024-08-18T22:16:46.809 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "batch_size", 2024-08-18T22:16:46.809 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.809 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.809 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.809 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5000", 2024-08-18T22:16:46.809 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.809 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.810 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.810 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-18T22:16:46.810 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.810 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.810 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.810 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.810 INFO:teuthology.orchestra.run.smithi123.stdout: "database": { 2024-08-18T22:16:46.811 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "database", 2024-08-18T22:16:46.811 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.811 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.811 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.811 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "ceph", 2024-08-18T22:16:46.811 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.811 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.812 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.812 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-18T22:16:46.812 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.812 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.812 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.812 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.813 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": { 2024-08-18T22:16:46.813 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "hostname", 2024-08-18T22:16:46.813 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.813 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.813 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.813 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.813 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.814 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.814 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.814 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB server hostname", 2024-08-18T22:16:46.814 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.814 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.814 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.815 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.815 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-08-18T22:16:46.815 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-08-18T22:16:46.815 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.815 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.815 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.815 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "30", 2024-08-18T22:16:46.816 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "5", 2024-08-18T22:16:46.816 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.816 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.816 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-18T22:16:46.816 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.816 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.816 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.817 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.817 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.817 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.817 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.817 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.817 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.817 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.818 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.818 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.818 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.818 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.818 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.818 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.818 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.819 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.819 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.819 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.819 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.819 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.819 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.819 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.819 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.820 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.820 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.820 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.820 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.820 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.820 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.820 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.820 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.821 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.821 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.821 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.821 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.821 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.821 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.821 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.821 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.822 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.822 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.822 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.822 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.822 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.822 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.822 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.823 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.823 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.823 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.823 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.823 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.823 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.823 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.823 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.823 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.824 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.824 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.824 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.824 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.824 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.824 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.824 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.824 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.825 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.825 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.825 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.825 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.825 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.825 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.825 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.825 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.826 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.826 INFO:teuthology.orchestra.run.smithi123.stdout: "password": { 2024-08-18T22:16:46.826 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "password", 2024-08-18T22:16:46.826 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.826 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.826 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.826 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.826 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.827 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.827 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.827 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "password of InfluxDB server user", 2024-08-18T22:16:46.827 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.827 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.827 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.827 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.827 INFO:teuthology.orchestra.run.smithi123.stdout: "port": { 2024-08-18T22:16:46.828 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "port", 2024-08-18T22:16:46.828 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.828 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.828 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.828 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8086", 2024-08-18T22:16:46.828 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.828 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.828 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.828 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB server port", 2024-08-18T22:16:46.829 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.829 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.829 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.829 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.829 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl": { 2024-08-18T22:16:46.829 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl", 2024-08-18T22:16:46.829 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.829 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.830 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.830 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "false", 2024-08-18T22:16:46.830 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.830 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.830 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.830 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-18T22:16:46.830 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.830 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.830 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.831 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.831 INFO:teuthology.orchestra.run.smithi123.stdout: "threads": { 2024-08-18T22:16:46.831 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "threads", 2024-08-18T22:16:46.831 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.831 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.831 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.831 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-08-18T22:16:46.831 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-08-18T22:16:46.832 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "32", 2024-08-18T22:16:46.832 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.832 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-18T22:16:46.832 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.832 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.832 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.832 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.832 INFO:teuthology.orchestra.run.smithi123.stdout: "username": { 2024-08-18T22:16:46.833 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "username", 2024-08-18T22:16:46.833 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.833 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.833 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.833 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.833 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.833 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.834 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.834 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "username of InfluxDB server user", 2024-08-18T22:16:46.834 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.834 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.834 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.834 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.834 INFO:teuthology.orchestra.run.smithi123.stdout: "verify_ssl": { 2024-08-18T22:16:46.834 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "verify_ssl", 2024-08-18T22:16:46.835 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.835 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.835 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.835 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "true", 2024-08-18T22:16:46.835 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.835 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.835 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.835 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-18T22:16:46.836 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.836 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.836 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.836 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.836 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.836 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.836 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.837 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "insights", 2024-08-18T22:16:46.837 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.837 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.837 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.837 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.837 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.837 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.837 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.838 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.838 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.838 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.838 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.838 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.838 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.838 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.839 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.839 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.839 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.839 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.839 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.839 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.839 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.839 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.840 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.840 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.840 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.840 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.840 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.840 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.840 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.840 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.841 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.841 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.841 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.841 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.841 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.841 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.841 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.841 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.841 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.842 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.842 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.842 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.842 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.842 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.842 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.842 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.842 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.843 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.843 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.843 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.843 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.843 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.843 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.843 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.843 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.844 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.844 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.844 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.844 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.844 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.844 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.844 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.844 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.845 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.845 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.845 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.845 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.845 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.845 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.845 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.846 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.846 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.846 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.846 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.846 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.846 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.846 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "iostat", 2024-08-18T22:16:46.846 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.847 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.847 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.847 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.847 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.847 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.847 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.847 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.847 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.848 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.848 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.848 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.848 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.848 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.848 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.848 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.848 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.849 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.849 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.849 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.849 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.849 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.849 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.849 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.849 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.850 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.850 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.850 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.850 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.850 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.850 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.850 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.851 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.851 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.851 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.851 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.851 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.851 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.851 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.851 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.852 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.852 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.852 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.852 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.852 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.852 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.852 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.853 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.853 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.853 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.853 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.853 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.853 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.853 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.854 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.854 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.854 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.854 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.854 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.854 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.854 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.854 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.855 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.855 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.855 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.855 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.855 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.855 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.855 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.855 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.856 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.856 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.856 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.856 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.856 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.856 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.856 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "k8sevents", 2024-08-18T22:16:46.856 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.856 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.857 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.857 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_event_retention_days": { 2024-08-18T22:16:46.857 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ceph_event_retention_days", 2024-08-18T22:16:46.857 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.857 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.857 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.857 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "7", 2024-08-18T22:16:46.858 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.858 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.858 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.858 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-18T22:16:46.858 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.858 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.858 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.858 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: "config_check_secs": { 2024-08-18T22:16:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_check_secs", 2024-08-18T22:16:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "10", 2024-08-18T22:16:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-18T22:16:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "localpool", 2024-08-18T22:16:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "failure_domain": { 2024-08-18T22:16:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "failure_domain", 2024-08-18T22:16:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "host", 2024-08-18T22:16:46.871 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.871 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.873 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "failure domain for any created local pool", 2024-08-18T22:16:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-18T22:16:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.881 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.881 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.881 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.881 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.881 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.881 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.881 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.881 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.881 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.882 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.882 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.882 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.882 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.882 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.882 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.883 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.883 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.883 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.883 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.883 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.883 INFO:teuthology.orchestra.run.smithi123.stdout: "min_size": { 2024-08-18T22:16:46.883 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "min_size", 2024-08-18T22:16:46.883 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.883 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.884 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.884 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.884 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.884 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.884 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.884 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default min_size for any created local pool", 2024-08-18T22:16:46.884 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-18T22:16:46.885 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.885 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.885 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.885 INFO:teuthology.orchestra.run.smithi123.stdout: "num_rep": { 2024-08-18T22:16:46.885 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "num_rep", 2024-08-18T22:16:46.885 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.885 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.885 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.886 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3", 2024-08-18T22:16:46.886 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.886 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.886 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.886 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default replica count for any created local pool", 2024-08-18T22:16:46.886 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.886 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.886 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.887 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.887 INFO:teuthology.orchestra.run.smithi123.stdout: "pg_num": { 2024-08-18T22:16:46.887 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pg_num", 2024-08-18T22:16:46.887 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.887 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.887 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.888 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "128", 2024-08-18T22:16:46.888 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.888 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.888 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.888 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default pg_num for any created local pool", 2024-08-18T22:16:46.888 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.888 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.889 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.889 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.889 INFO:teuthology.orchestra.run.smithi123.stdout: "prefix": { 2024-08-18T22:16:46.889 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prefix", 2024-08-18T22:16:46.889 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.889 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.889 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.889 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.890 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.890 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.890 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.890 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "name prefix for any created local pool", 2024-08-18T22:16:46.890 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.890 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.890 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.891 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.891 INFO:teuthology.orchestra.run.smithi123.stdout: "subtree": { 2024-08-18T22:16:46.891 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "subtree", 2024-08-18T22:16:46.891 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.891 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.891 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.891 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "rack", 2024-08-18T22:16:46.891 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.892 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.892 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.892 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-18T22:16:46.892 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-18T22:16:46.892 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.892 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.892 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.892 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.893 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.893 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.893 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mds_autoscaler", 2024-08-18T22:16:46.893 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.893 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.893 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.893 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.893 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.894 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.894 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.894 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.894 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.894 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.894 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.894 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.894 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.895 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.895 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.895 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.895 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.895 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.895 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.895 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.895 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.896 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.896 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.896 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.896 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.896 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.896 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.896 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.896 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.897 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.897 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.897 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.897 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.897 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.897 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.897 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.897 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.898 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.898 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.898 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.898 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.898 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.898 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.898 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.898 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.898 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.899 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.899 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.899 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.899 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.899 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.899 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.899 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.899 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.900 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.900 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.900 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.900 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.900 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.900 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.900 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.900 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.901 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.901 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.901 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.901 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.901 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.901 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.901 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.901 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.902 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.902 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.902 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.902 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.902 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.902 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.902 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mirroring", 2024-08-18T22:16:46.902 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.903 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.903 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.903 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.903 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.903 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.903 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.903 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.903 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.903 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.904 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.904 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.904 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.904 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.904 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.904 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.904 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.904 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.905 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.905 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.905 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.905 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.905 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.905 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.905 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.905 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.906 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.906 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.906 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.906 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.906 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.906 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.906 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.907 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.907 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.907 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.907 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.907 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.907 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.907 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.907 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.908 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.908 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.908 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.908 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.908 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.908 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.908 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.909 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.909 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.909 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.909 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.909 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.909 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.909 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.910 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.910 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.910 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.910 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.910 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.910 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.910 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.910 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.911 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.911 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.911 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.911 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.911 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.911 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.911 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.912 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.912 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.912 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.912 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.912 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.912 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.912 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "nfs", 2024-08-18T22:16:46.913 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.913 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.913 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.913 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.913 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.913 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.913 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.913 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.914 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.914 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.914 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.914 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.914 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.914 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.914 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.915 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.915 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.915 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.915 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.915 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.915 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.915 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.916 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.916 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.916 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.916 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.916 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.916 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.916 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.916 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.917 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.917 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.917 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.917 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.917 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.917 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.917 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.917 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.918 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.918 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.918 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.918 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.918 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.918 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.918 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.918 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.919 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.919 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.919 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.919 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.919 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.919 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.919 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.919 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.920 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.920 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.920 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.920 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.920 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.920 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.920 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.920 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.921 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.921 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.921 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.921 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.921 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.921 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.921 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.921 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.922 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.922 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.922 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.922 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.922 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.922 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.922 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "orchestrator", 2024-08-18T22:16:46.923 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.923 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.923 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.923 INFO:teuthology.orchestra.run.smithi123.stdout: "fail_fs": { 2024-08-18T22:16:46.923 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "fail_fs", 2024-08-18T22:16:46.923 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.923 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.923 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.924 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.924 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.924 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.924 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.924 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-18T22:16:46.924 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.924 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.924 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.925 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.925 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.925 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.925 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.925 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.925 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.925 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.925 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.926 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.926 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.926 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.926 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.926 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.926 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.926 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.926 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.926 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.927 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.927 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.927 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.927 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.927 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.927 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.927 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.927 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.928 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.928 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.928 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.928 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.928 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.928 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.928 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.928 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.929 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.929 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.929 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.929 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.929 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.929 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.929 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.929 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.930 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.930 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.930 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.930 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.930 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.930 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.930 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.930 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.931 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.931 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.931 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.931 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.931 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.931 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.931 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.931 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.931 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.932 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.932 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.932 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.932 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.932 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.932 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.932 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.932 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.932 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.933 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.933 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.933 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.933 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.933 INFO:teuthology.orchestra.run.smithi123.stdout: "orchestrator": { 2024-08-18T22:16:46.933 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "orchestrator", 2024-08-18T22:16:46.933 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.933 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.934 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.934 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.934 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.934 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.934 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.934 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm", 2024-08-18T22:16:46.934 INFO:teuthology.orchestra.run.smithi123.stdout: "rook", 2024-08-18T22:16:46.934 INFO:teuthology.orchestra.run.smithi123.stdout: "test_orchestrator" 2024-08-18T22:16:46.935 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.935 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Orchestrator backend", 2024-08-18T22:16:46.935 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.935 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.935 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.935 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.935 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.935 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.936 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.936 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "osd_perf_query", 2024-08-18T22:16:46.936 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.936 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.936 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.936 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.936 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.936 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.937 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.937 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.937 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.937 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.937 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.937 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.937 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.937 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.938 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.938 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.938 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.938 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.938 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.938 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.938 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.939 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.939 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.939 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.939 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.939 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.939 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.939 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.939 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.939 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.940 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.940 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.940 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.940 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.940 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.940 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.940 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.940 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.941 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.941 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.941 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.941 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.941 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.941 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.941 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.941 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.941 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.942 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.942 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.942 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.942 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.942 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.942 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.942 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.943 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.943 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.943 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.943 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.943 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.943 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.943 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.943 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.944 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.944 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.944 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.944 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.944 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.944 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.944 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.944 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.944 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.945 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.945 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.945 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.945 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.945 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.945 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "osd_support", 2024-08-18T22:16:46.945 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.945 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.946 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.946 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.946 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.946 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.946 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.946 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.946 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.946 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.947 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.947 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.947 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.947 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.947 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.947 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.947 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.947 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.947 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.948 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.948 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.948 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.948 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.948 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.948 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.948 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.948 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.949 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.949 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.949 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.949 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.949 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.949 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.949 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.949 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.950 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.950 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.950 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.950 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.950 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.950 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.950 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.950 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.951 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.951 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.951 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.951 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.951 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.951 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.951 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.951 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.952 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.952 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.952 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.952 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.952 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.952 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.952 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.952 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.953 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.953 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.953 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.953 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.953 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.953 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.953 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.953 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.954 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.954 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.954 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.954 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.954 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.954 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.954 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.954 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.955 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.955 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pg_autoscaler", 2024-08-18T22:16:46.955 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.955 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.955 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.955 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.955 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.956 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.956 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.956 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.956 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.956 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.956 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.956 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.956 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.957 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.957 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.957 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.957 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.957 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.957 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.957 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.957 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.958 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.958 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.958 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.958 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.958 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.958 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.958 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.958 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.959 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.959 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.959 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.959 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.959 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.959 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.959 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.959 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.960 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.960 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.960 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.960 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.960 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.960 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.960 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.960 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.960 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.961 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.961 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.961 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.961 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.961 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.961 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.961 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.961 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.962 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.962 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.962 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.962 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.962 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.962 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.962 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.962 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.963 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.963 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.963 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.963 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.963 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.963 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.963 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.963 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.964 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.964 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.964 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.964 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-08-18T22:16:46.964 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-08-18T22:16:46.964 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.964 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.964 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.965 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-08-18T22:16:46.965 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.965 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.965 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.965 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.965 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.965 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.965 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.965 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.966 INFO:teuthology.orchestra.run.smithi123.stdout: "threshold": { 2024-08-18T22:16:46.966 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "threshold", 2024-08-18T22:16:46.966 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:46.966 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.966 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.966 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3.0", 2024-08-18T22:16:46.966 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1.0", 2024-08-18T22:16:46.966 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.967 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.967 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "scaling threshold", 2024-08-18T22:16:46.967 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-18T22:16:46.967 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.967 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.967 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.967 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.967 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.968 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.968 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "progress", 2024-08-18T22:16:46.968 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.968 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.968 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.968 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_pg_recovery_event": { 2024-08-18T22:16:46.968 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_pg_recovery_event", 2024-08-18T22:16:46.968 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.968 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.969 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.969 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.969 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.969 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.969 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.969 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-18T22:16:46.969 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.969 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.970 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.970 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.970 INFO:teuthology.orchestra.run.smithi123.stdout: "enabled": { 2024-08-18T22:16:46.970 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enabled", 2024-08-18T22:16:46.970 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.970 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.970 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.970 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.971 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.971 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.971 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.971 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.971 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.971 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.971 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.971 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.971 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.972 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.972 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.972 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.972 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.972 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.972 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.972 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.972 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.972 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.973 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.973 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.973 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.973 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.973 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.973 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.973 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.973 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.974 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.974 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.974 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.974 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.974 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.974 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.974 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.974 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.975 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.975 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.975 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.975 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.975 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.975 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.975 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.975 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.976 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.976 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.976 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.976 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.976 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.976 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.976 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.976 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.976 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.977 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.977 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.977 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.977 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.977 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.977 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.977 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.977 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.978 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.978 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.978 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.978 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.978 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.978 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.978 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.978 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.979 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.979 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.979 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.979 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.979 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.979 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.979 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.979 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.979 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.980 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.980 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.980 INFO:teuthology.orchestra.run.smithi123.stdout: "max_completed_events": { 2024-08-18T22:16:46.980 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_completed_events", 2024-08-18T22:16:46.980 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.980 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.980 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.980 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "50", 2024-08-18T22:16:46.981 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.981 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.981 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.981 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "number of past completed events to remember", 2024-08-18T22:16:46.981 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.981 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.981 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.981 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.981 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-08-18T22:16:46.982 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-08-18T22:16:46.982 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:46.982 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.982 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.982 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-08-18T22:16:46.982 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.982 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.983 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.983 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long the module is going to sleep", 2024-08-18T22:16:46.983 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.983 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.983 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.983 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.983 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:46.983 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.984 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:46.984 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prometheus", 2024-08-18T22:16:46.984 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:46.984 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:46.984 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:46.984 INFO:teuthology.orchestra.run.smithi123.stdout: "cache": { 2024-08-18T22:16:46.984 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cache", 2024-08-18T22:16:46.984 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.985 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.985 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.985 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.985 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.985 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.985 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.985 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.985 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.986 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.986 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.986 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.986 INFO:teuthology.orchestra.run.smithi123.stdout: "exclude_perf_counters": { 2024-08-18T22:16:46.986 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "exclude_perf_counters", 2024-08-18T22:16:46.986 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.986 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.986 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.987 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:46.987 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.987 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.987 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.987 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-18T22:16:46.987 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-18T22:16:46.987 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.987 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.988 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.988 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:46.988 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:46.988 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.988 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.988 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.988 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.988 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.989 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.989 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.989 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.989 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.989 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.989 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.989 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.989 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.990 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.990 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.990 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.990 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.990 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.990 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.990 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:46.991 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:46.991 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.991 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.991 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.991 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.991 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.991 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.991 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.992 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.992 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.992 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.992 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.992 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.992 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:46.992 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:46.993 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.993 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.993 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.993 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:46.993 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.993 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.993 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:46.993 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:46.993 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:46.994 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:46.994 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:46.994 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:46.994 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:46.994 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:46.994 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.994 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.994 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.995 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.995 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.995 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:46.995 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:46.995 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:46.995 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.995 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:46.995 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:46.996 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.996 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.996 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.996 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.996 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.996 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.996 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.996 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.996 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_stats_pools": { 2024-08-18T22:16:46.997 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_stats_pools", 2024-08-18T22:16:46.997 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:46.997 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.997 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.997 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:46.997 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.997 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.997 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-18T22:16:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-18T22:16:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "300", 2024-08-18T22:16:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "scrape_interval": { 2024-08-18T22:16:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "scrape_interval", 2024-08-18T22:16:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15.0", 2024-08-18T22:16:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-08-18T22:16:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-08-18T22:16:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "::", 2024-08-18T22:16:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-18T22:16:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-08-18T22:16:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-08-18T22:16:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "9283", 2024-08-18T22:16:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-18T22:16:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: "stale_cache_strategy": { 2024-08-18T22:16:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "stale_cache_strategy", 2024-08-18T22:16:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "log", 2024-08-18T22:16:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_behaviour": { 2024-08-18T22:16:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_behaviour", 2024-08-18T22:16:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "default", 2024-08-18T22:16:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: "default", 2024-08-18T22:16:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: "error" 2024-08-18T22:16:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_error_status_code": { 2024-08-18T22:16:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_error_status_code", 2024-08-18T22:16:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "500", 2024-08-18T22:16:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "400", 2024-08-18T22:16:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "599", 2024-08-18T22:16:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.011 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.011 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_support", 2024-08-18T22:16:47.011 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.011 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.011 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.011 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.011 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.011 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.011 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.012 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.012 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.012 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.012 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.012 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.012 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.012 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.012 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.013 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.013 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.013 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.013 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.013 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.013 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.013 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.013 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.013 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.014 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.014 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.014 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.014 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.014 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.014 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.014 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.014 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.015 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.015 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.015 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.015 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.015 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.015 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.015 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.015 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.015 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.016 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.016 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.016 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.016 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.016 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.016 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.016 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.016 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.017 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.017 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.017 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.017 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.017 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.017 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.017 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.017 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.018 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.018 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.018 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.018 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.018 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.018 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.018 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.018 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.019 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.019 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.019 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.019 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.019 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.019 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.019 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.019 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.020 INFO:teuthology.orchestra.run.smithi123.stdout: "max_concurrent_snap_create": { 2024-08-18T22:16:47.020 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_concurrent_snap_create", 2024-08-18T22:16:47.020 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.020 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.020 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.020 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:47.020 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.020 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.021 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.021 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.021 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.021 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.021 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.021 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.021 INFO:teuthology.orchestra.run.smithi123.stdout: "mirror_snapshot_schedule": { 2024-08-18T22:16:47.021 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mirror_snapshot_schedule", 2024-08-18T22:16:47.022 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.022 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.022 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.022 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.022 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.022 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.022 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.022 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.023 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.023 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.023 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.023 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.023 INFO:teuthology.orchestra.run.smithi123.stdout: "trash_purge_schedule": { 2024-08-18T22:16:47.023 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "trash_purge_schedule", 2024-08-18T22:16:47.023 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.023 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.024 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.024 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.024 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.024 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.024 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.024 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.024 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.024 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.025 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.025 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.025 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.025 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.025 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.025 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "restful", 2024-08-18T22:16:47.025 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.026 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.026 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.026 INFO:teuthology.orchestra.run.smithi123.stdout: "enable_auth": { 2024-08-18T22:16:47.026 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enable_auth", 2024-08-18T22:16:47.026 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.026 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.026 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.026 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.026 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.027 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.027 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.027 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.027 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.027 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.027 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.027 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.027 INFO:teuthology.orchestra.run.smithi123.stdout: "key_file": { 2024-08-18T22:16:47.028 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "key_file", 2024-08-18T22:16:47.028 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.028 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.028 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.028 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.028 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.028 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.028 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.028 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.029 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.029 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.029 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.029 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.029 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.029 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.029 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.029 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.030 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.030 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.030 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.030 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.030 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.030 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.030 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.030 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.031 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.031 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.031 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.031 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.031 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.031 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.031 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.031 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.032 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.032 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.032 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.032 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.032 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.032 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.032 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.032 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.032 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.033 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.033 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.033 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.033 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.033 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.033 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.033 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.033 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.033 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.034 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.034 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.034 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.034 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.034 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.034 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.034 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.034 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.035 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.035 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.035 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.035 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.035 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.035 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.035 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.035 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.036 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.036 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.036 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.036 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.036 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.036 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.036 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.036 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.036 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.037 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.037 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.037 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.037 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.037 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.037 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.037 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.037 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-08-18T22:16:47.038 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-08-18T22:16:47.038 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.038 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.038 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.038 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.038 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.038 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.038 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.039 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.039 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.039 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.039 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.039 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.039 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-08-18T22:16:47.039 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-08-18T22:16:47.039 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.039 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.040 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.040 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.040 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.040 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.040 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.040 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.040 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.040 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.040 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.041 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.041 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.041 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.041 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.041 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rgw", 2024-08-18T22:16:47.041 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.041 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.041 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.042 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.042 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.042 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.042 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.042 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.042 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.042 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.042 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.043 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.043 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.043 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.043 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.043 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.043 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.043 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.043 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.044 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.044 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.044 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.044 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.044 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.044 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.044 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.044 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.045 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.045 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.045 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.045 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.045 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.045 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.045 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.045 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.045 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.046 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.046 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.046 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.046 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.046 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.046 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.046 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.046 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.047 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.047 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.047 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.047 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.047 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.047 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.047 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.047 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.048 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.048 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.048 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.048 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.048 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.048 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.048 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.048 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.049 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.049 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.049 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.049 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.049 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.049 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.049 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.049 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.049 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.050 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.050 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.050 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.050 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.050 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.050 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.050 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.050 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rook", 2024-08-18T22:16:47.051 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.051 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.051 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.051 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.051 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.051 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.051 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.051 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.052 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.052 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.052 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.052 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.052 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.052 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.052 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.052 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.053 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.053 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.053 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.053 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.053 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.053 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.053 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.053 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.054 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.054 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.054 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.054 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.054 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.054 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.054 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.055 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.055 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.055 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.055 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.055 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.055 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.055 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.055 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.056 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.056 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.056 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.056 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.056 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.056 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.056 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.056 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.056 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.057 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.057 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.057 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.057 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.057 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.057 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.057 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.058 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.058 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.058 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.058 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.058 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.058 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.058 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.059 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.059 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.059 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.059 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.059 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.059 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.059 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.059 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.060 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.060 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.060 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.060 INFO:teuthology.orchestra.run.smithi123.stdout: "storage_class": { 2024-08-18T22:16:47.060 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "storage_class", 2024-08-18T22:16:47.060 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.060 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.060 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.061 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "local", 2024-08-18T22:16:47.061 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.061 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.061 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.061 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-18T22:16:47.061 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.061 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.061 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.062 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.062 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.062 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.062 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.062 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "selftest", 2024-08-18T22:16:47.062 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.062 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.062 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.063 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.063 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.063 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.063 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.063 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.063 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.063 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.063 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.064 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.064 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.064 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.064 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.064 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.064 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.064 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.064 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.064 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.065 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.065 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.065 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.065 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.065 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.065 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.065 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.065 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.066 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.066 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.066 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.066 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.066 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.066 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.066 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.066 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.066 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.067 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.067 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.067 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.067 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.067 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.067 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.067 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.067 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.068 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.068 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.068 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.068 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.068 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.068 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.068 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.068 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.068 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.069 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.069 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.069 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.069 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.069 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.069 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.069 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.069 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.070 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.070 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.070 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.070 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.070 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.070 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.070 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.070 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.071 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.071 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.071 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.071 INFO:teuthology.orchestra.run.smithi123.stdout: "roption1": { 2024-08-18T22:16:47.071 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "roption1", 2024-08-18T22:16:47.071 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.071 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.071 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.072 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.072 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.072 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.072 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.072 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.072 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.072 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.072 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.072 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.073 INFO:teuthology.orchestra.run.smithi123.stdout: "roption2": { 2024-08-18T22:16:47.073 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "roption2", 2024-08-18T22:16:47.073 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.073 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.073 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.073 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "xyz", 2024-08-18T22:16:47.073 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.073 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.073 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.074 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.074 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.074 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.074 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.074 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.074 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption1": { 2024-08-18T22:16:47.074 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption1", 2024-08-18T22:16:47.074 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.075 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.075 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.075 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.075 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.075 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.075 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.075 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.075 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.076 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.076 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.076 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.076 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption2": { 2024-08-18T22:16:47.076 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption2", 2024-08-18T22:16:47.076 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.076 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.076 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.076 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.077 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.077 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.077 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.077 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.077 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.077 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.077 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.077 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.078 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption3": { 2024-08-18T22:16:47.078 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption3", 2024-08-18T22:16:47.078 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:47.078 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.078 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.078 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.078 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.078 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.079 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.079 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.079 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.079 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.079 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.079 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.079 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption4": { 2024-08-18T22:16:47.079 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption4", 2024-08-18T22:16:47.080 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.080 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.080 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.080 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.080 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.080 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.080 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.080 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.081 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.081 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.081 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.081 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.081 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption5": { 2024-08-18T22:16:47.081 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption5", 2024-08-18T22:16:47.081 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.081 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.082 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.082 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.082 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.082 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.082 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.082 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.082 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.082 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.083 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.083 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.083 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption6": { 2024-08-18T22:16:47.083 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption6", 2024-08-18T22:16:47.083 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.083 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.083 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.083 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.083 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.084 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.084 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.084 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.084 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.084 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.084 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.084 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.084 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption7": { 2024-08-18T22:16:47.085 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption7", 2024-08-18T22:16:47.085 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.085 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.085 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.085 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.085 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-08-18T22:16:47.085 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "42", 2024-08-18T22:16:47.085 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.086 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.086 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.086 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.086 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.086 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.086 INFO:teuthology.orchestra.run.smithi123.stdout: "testkey": { 2024-08-18T22:16:47.086 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testkey", 2024-08-18T22:16:47.086 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.086 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.087 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.087 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.087 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.087 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.087 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.087 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.087 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.088 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.088 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.088 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.088 INFO:teuthology.orchestra.run.smithi123.stdout: "testlkey": { 2024-08-18T22:16:47.088 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testlkey", 2024-08-18T22:16:47.088 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.088 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.088 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.089 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.089 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.089 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.089 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.089 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.089 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.089 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.089 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.090 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.090 INFO:teuthology.orchestra.run.smithi123.stdout: "testnewline": { 2024-08-18T22:16:47.090 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testnewline", 2024-08-18T22:16:47.090 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.090 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.090 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.090 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.090 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.091 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.091 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.091 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.091 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.091 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.091 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.091 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.091 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.091 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.092 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.092 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snap_schedule", 2024-08-18T22:16:47.092 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.092 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.092 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.092 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_m_granularity": { 2024-08-18T22:16:47.092 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_m_granularity", 2024-08-18T22:16:47.092 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.093 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.093 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.093 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.093 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.093 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.093 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.093 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow minute scheduled snapshots", 2024-08-18T22:16:47.093 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.094 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.094 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.094 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.094 INFO:teuthology.orchestra.run.smithi123.stdout: "dump_on_update": { 2024-08-18T22:16:47.094 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "dump_on_update", 2024-08-18T22:16:47.094 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.094 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.094 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.095 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.095 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.095 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.095 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.095 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "dump database to debug log on update", 2024-08-18T22:16:47.095 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.095 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.095 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.095 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.096 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.096 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.096 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.096 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.096 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.096 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.096 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.096 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.097 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.097 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.097 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.097 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.097 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.097 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.097 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.097 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.098 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.098 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.098 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.098 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.098 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.098 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.098 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.098 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.099 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.099 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.099 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.099 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.099 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.099 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.099 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.099 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.100 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.100 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.100 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.100 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.100 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.100 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.100 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.100 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.101 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.101 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.101 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.101 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.101 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.101 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.101 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.101 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.102 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.102 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.102 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.102 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.102 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.102 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.102 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.103 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.103 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.103 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.103 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.103 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.103 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.103 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.103 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.104 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.104 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.104 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.104 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.104 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.104 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.104 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.104 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.105 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.105 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.105 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "stats", 2024-08-18T22:16:47.105 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.105 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.105 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.105 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.105 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.106 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.106 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.106 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.106 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.106 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.106 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.106 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.106 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.107 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.107 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.107 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.107 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.107 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.107 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.107 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.107 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.108 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.108 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.108 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.108 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.108 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.108 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.108 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.108 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.108 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.109 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.109 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.109 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.109 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.109 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.109 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.109 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.109 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.110 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.110 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.110 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.110 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.110 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.110 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.110 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.110 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.111 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.111 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.111 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.111 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.111 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.111 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.111 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.111 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.112 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.112 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.112 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.112 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.112 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.112 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.112 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.112 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.113 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.113 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.113 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.113 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.113 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.113 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.113 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.113 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.113 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.114 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.114 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.114 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.114 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.114 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.114 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "status", 2024-08-18T22:16:47.114 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.115 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.115 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.115 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.115 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.115 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.115 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.115 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.115 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.115 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.116 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.116 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.116 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.116 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.116 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.116 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.116 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.116 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.117 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.117 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.117 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.117 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.117 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.117 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.117 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.117 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.117 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.118 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.118 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.118 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.118 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.118 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.118 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.118 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.118 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.119 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.119 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.119 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.119 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.119 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.119 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.119 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.119 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.120 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.120 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.120 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.120 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.120 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.120 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.120 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.120 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.121 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.121 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.121 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.121 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.121 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.121 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.121 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.121 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.121 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.122 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.122 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.122 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.122 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.122 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.122 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.122 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.122 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.123 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.123 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.123 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.123 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.123 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.123 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.123 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.123 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.124 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "telegraf", 2024-08-18T22:16:47.124 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.124 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.124 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.124 INFO:teuthology.orchestra.run.smithi123.stdout: "address": { 2024-08-18T22:16:47.124 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "address", 2024-08-18T22:16:47.124 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.124 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.124 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.125 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-18T22:16:47.125 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.125 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.125 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.125 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.125 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.125 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.125 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.126 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.126 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-08-18T22:16:47.126 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-08-18T22:16:47.126 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.126 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.126 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.126 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15", 2024-08-18T22:16:47.126 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.127 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.127 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.127 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.127 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.127 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.127 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.127 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.127 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.128 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.128 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.128 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.128 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.128 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.128 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.128 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.128 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.128 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.129 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.129 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.129 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.129 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.129 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.129 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.129 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.129 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.135 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.135 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.135 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.135 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.135 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.135 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.135 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.135 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "telemetry", 2024-08-18T22:16:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_basic": { 2024-08-18T22:16:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_basic", 2024-08-18T22:16:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-18T22:16:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_crash": { 2024-08-18T22:16:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_crash", 2024-08-18T22:16:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-18T22:16:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_device": { 2024-08-18T22:16:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_device", 2024-08-18T22:16:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-18T22:16:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.142 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.142 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.142 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_ident": { 2024-08-18T22:16:47.142 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_ident", 2024-08-18T22:16:47.142 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.142 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.142 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.142 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.142 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.143 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.143 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.143 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-18T22:16:47.143 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.143 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.143 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.143 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.143 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_perf": { 2024-08-18T22:16:47.144 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_perf", 2024-08-18T22:16:47.144 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.144 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.144 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.144 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.144 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.144 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.144 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.145 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-18T22:16:47.145 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.145 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.145 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.145 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.146 INFO:teuthology.orchestra.run.smithi123.stdout: "contact": { 2024-08-18T22:16:47.146 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "contact", 2024-08-18T22:16:47.146 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.146 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.146 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.147 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.147 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.147 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.147 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.147 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.147 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.147 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.148 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.148 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.148 INFO:teuthology.orchestra.run.smithi123.stdout: "description": { 2024-08-18T22:16:47.148 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "description", 2024-08-18T22:16:47.148 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.148 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.148 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.149 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.149 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.149 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.149 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.150 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.150 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.150 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.150 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.150 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.151 INFO:teuthology.orchestra.run.smithi123.stdout: "device_url": { 2024-08-18T22:16:47.151 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_url", 2024-08-18T22:16:47.151 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.151 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.152 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.152 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-18T22:16:47.152 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.152 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.153 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.153 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.153 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.153 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.153 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.153 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.153 INFO:teuthology.orchestra.run.smithi123.stdout: "enabled": { 2024-08-18T22:16:47.153 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enabled", 2024-08-18T22:16:47.154 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.154 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.154 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.154 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.154 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.154 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.154 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.154 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.155 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.155 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.155 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.155 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.155 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-08-18T22:16:47.155 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-08-18T22:16:47.155 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.155 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.156 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.156 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "24", 2024-08-18T22:16:47.156 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "8", 2024-08-18T22:16:47.156 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.156 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.156 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.156 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.156 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.157 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.157 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.157 INFO:teuthology.orchestra.run.smithi123.stdout: "last_opt_revision": { 2024-08-18T22:16:47.157 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "last_opt_revision", 2024-08-18T22:16:47.157 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.157 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.157 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.157 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1", 2024-08-18T22:16:47.158 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.158 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.158 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.158 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.158 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.158 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.158 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.158 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.159 INFO:teuthology.orchestra.run.smithi123.stdout: "leaderboard": { 2024-08-18T22:16:47.159 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "leaderboard", 2024-08-18T22:16:47.159 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.159 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.159 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.159 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.159 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.159 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.160 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.160 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.160 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.160 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.160 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.160 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.160 INFO:teuthology.orchestra.run.smithi123.stdout: "leaderboard_description": { 2024-08-18T22:16:47.160 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "leaderboard_description", 2024-08-18T22:16:47.160 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.161 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.161 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.161 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.161 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.161 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.161 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.161 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.161 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.162 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.162 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.162 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.162 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.162 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.162 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.162 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.162 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.163 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.164 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.164 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.164 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.164 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.164 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.164 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.164 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.164 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.165 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.165 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.165 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.165 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.165 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.165 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.165 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.165 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.166 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.166 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.166 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.166 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.166 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.166 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.166 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.166 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.167 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.167 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.167 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.167 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.167 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.167 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.167 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.167 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.168 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.168 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.168 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.168 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.168 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.168 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.168 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.168 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.169 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.169 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.169 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.169 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.169 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.169 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.169 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.169 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.169 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.170 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.170 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.170 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.170 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.170 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.170 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.170 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.170 INFO:teuthology.orchestra.run.smithi123.stdout: "organization": { 2024-08-18T22:16:47.171 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "organization", 2024-08-18T22:16:47.171 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.171 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.171 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.171 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.171 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.171 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.171 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.172 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.172 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.172 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.172 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.172 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.172 INFO:teuthology.orchestra.run.smithi123.stdout: "proxy": { 2024-08-18T22:16:47.172 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "proxy", 2024-08-18T22:16:47.172 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.172 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.173 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.173 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.173 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.173 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.173 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.173 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.173 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.173 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.174 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.174 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.174 INFO:teuthology.orchestra.run.smithi123.stdout: "url": { 2024-08-18T22:16:47.174 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "url", 2024-08-18T22:16:47.174 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.174 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.174 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.175 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-18T22:16:47.175 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.175 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.175 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.175 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.175 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.175 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.175 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.176 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.176 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.176 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.176 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.176 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "test_orchestrator", 2024-08-18T22:16:47.176 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.176 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.176 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.176 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.177 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.177 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.177 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.177 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.177 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.177 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.177 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.177 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.178 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.178 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.178 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.178 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.178 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.178 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.178 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.178 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.179 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.179 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.179 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.179 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.179 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.179 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.179 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.179 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.180 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.180 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.180 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.180 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.180 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.180 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.180 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.180 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.181 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.181 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.181 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.181 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.181 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.181 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.181 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.181 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.182 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.182 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.182 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.182 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.182 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.182 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.182 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.182 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.183 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.183 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.183 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.183 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.183 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.183 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.183 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.183 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.183 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.184 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.184 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.184 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.184 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.184 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.184 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.184 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.184 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.185 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.185 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.185 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.185 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.185 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.185 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.185 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.186 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "volumes", 2024-08-18T22:16:47.186 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.186 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.186 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.186 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.186 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.186 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.186 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.187 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.187 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.187 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.187 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.187 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.187 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.187 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.187 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.187 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.188 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.188 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.188 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.188 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.188 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.188 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.188 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.188 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.189 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.189 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.189 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.189 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.189 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.189 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.189 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.189 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.189 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.190 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.190 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.190 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.190 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.190 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.190 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.190 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.190 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.191 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.191 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.191 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.191 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.191 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.191 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.191 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.191 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.192 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.192 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.192 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.192 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.192 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.192 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.192 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.192 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.192 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.193 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.193 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.193 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.193 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.193 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.193 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.193 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.193 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.193 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.194 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.194 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.194 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.194 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.194 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.194 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.194 INFO:teuthology.orchestra.run.smithi123.stdout: "max_concurrent_clones": { 2024-08-18T22:16:47.194 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_concurrent_clones", 2024-08-18T22:16:47.195 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.195 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.195 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.195 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "4", 2024-08-18T22:16:47.195 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.195 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.195 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.195 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-18T22:16:47.195 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.196 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.196 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.196 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.196 INFO:teuthology.orchestra.run.smithi123.stdout: "periodic_async_work": { 2024-08-18T22:16:47.196 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "periodic_async_work", 2024-08-18T22:16:47.196 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.196 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.196 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.197 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.197 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.197 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.197 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.197 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Periodically check for async work", 2024-08-18T22:16:47.197 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.197 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.197 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.198 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.198 INFO:teuthology.orchestra.run.smithi123.stdout: "snapshot_clone_delay": { 2024-08-18T22:16:47.198 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snapshot_clone_delay", 2024-08-18T22:16:47.198 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.198 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.198 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.198 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-08-18T22:16:47.198 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.199 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.199 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.199 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-18T22:16:47.199 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.199 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.199 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.199 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.199 INFO:teuthology.orchestra.run.smithi123.stdout: "snapshot_clone_no_wait": { 2024-08-18T22:16:47.200 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snapshot_clone_no_wait", 2024-08-18T22:16:47.200 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.200 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.200 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.200 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.200 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.200 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.200 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.201 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-18T22:16:47.201 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.201 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.201 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.201 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.201 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.201 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.201 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.201 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix", 2024-08-18T22:16:47.202 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.202 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.202 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.202 INFO:teuthology.orchestra.run.smithi123.stdout: "discovery_interval": { 2024-08-18T22:16:47.202 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "discovery_interval", 2024-08-18T22:16:47.202 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-08-18T22:16:47.202 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.202 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.203 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "100", 2024-08-18T22:16:47.203 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.203 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.203 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.203 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.203 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.203 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.203 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.204 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.204 INFO:teuthology.orchestra.run.smithi123.stdout: "identifier": { 2024-08-18T22:16:47.204 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "identifier", 2024-08-18T22:16:47.204 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.204 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.204 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.204 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.204 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.204 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.205 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.205 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.205 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.205 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.205 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.205 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.205 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-08-18T22:16:47.205 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-08-18T22:16:47.206 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.206 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.206 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.206 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-08-18T22:16:47.206 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.206 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.206 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.206 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.207 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.207 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.207 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.207 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.207 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.207 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.207 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.207 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.207 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.208 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.208 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.208 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.208 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.208 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.208 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.208 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.208 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.209 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.209 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.209 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.209 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.209 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.209 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.209 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.209 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.209 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.210 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.210 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.210 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.210 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.210 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.210 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.210 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.210 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.211 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.211 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.211 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.211 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.211 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.211 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.211 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.211 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.211 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.212 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.212 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.212 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.212 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.212 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.212 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.212 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.212 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.213 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.213 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.213 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.213 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.213 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.213 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.213 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.213 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.213 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.214 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.214 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.214 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.214 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.214 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.214 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.214 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.214 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.215 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.215 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.215 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.215 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.215 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.215 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.215 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_host": { 2024-08-18T22:16:47.215 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_host", 2024-08-18T22:16:47.216 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.216 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.216 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.216 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.216 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.216 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.216 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.216 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.216 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.217 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.217 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.217 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.217 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_port": { 2024-08-18T22:16:47.217 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_port", 2024-08-18T22:16:47.217 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.217 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.217 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.218 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10051", 2024-08-18T22:16:47.218 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.218 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.218 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.218 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.218 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.218 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.218 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.219 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.219 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_sender": { 2024-08-18T22:16:47.219 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_sender", 2024-08-18T22:16:47.219 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.219 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.219 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.219 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-18T22:16:47.219 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.219 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.220 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.220 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.220 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.220 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.220 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.220 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.220 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.220 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.220 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-08-18T22:16:47.221 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.221 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.221 INFO:teuthology.orchestra.run.smithi123.stdout: "modules": [ 2024-08-18T22:16:47.221 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm", 2024-08-18T22:16:47.221 INFO:teuthology.orchestra.run.smithi123.stdout: "dashboard", 2024-08-18T22:16:47.221 INFO:teuthology.orchestra.run.smithi123.stdout: "iostat", 2024-08-18T22:16:47.221 INFO:teuthology.orchestra.run.smithi123.stdout: "nfs", 2024-08-18T22:16:47.221 INFO:teuthology.orchestra.run.smithi123.stdout: "restful" 2024-08-18T22:16:47.222 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.222 INFO:teuthology.orchestra.run.smithi123.stdout: "available_modules": [ 2024-08-18T22:16:47.222 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.222 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "alerts", 2024-08-18T22:16:47.222 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.222 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.222 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.222 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-08-18T22:16:47.223 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-08-18T22:16:47.223 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.223 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.223 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.223 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-08-18T22:16:47.223 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.223 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.223 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.224 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How frequently to reexamine health status", 2024-08-18T22:16:47.224 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.224 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.224 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.224 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.224 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.224 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.224 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.225 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.225 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.225 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.225 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.225 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.225 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.225 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.225 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.225 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.226 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.226 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.226 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.226 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.226 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.226 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.226 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.226 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.227 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.227 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.227 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.227 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.227 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.227 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.227 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.227 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.228 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.228 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.228 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.228 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.228 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.228 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.228 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.228 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.229 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.229 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.229 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.229 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.229 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.229 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.229 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.229 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.229 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.230 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.230 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.230 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.230 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.230 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.230 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.230 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.230 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.231 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.231 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.231 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.231 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.231 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.231 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.231 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.231 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.232 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.232 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.232 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.232 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.232 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.232 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.232 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.232 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.233 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.233 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_destination": { 2024-08-18T22:16:47.233 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_destination", 2024-08-18T22:16:47.233 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.233 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.233 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.233 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.233 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.233 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.234 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.234 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Email address to send alerts to", 2024-08-18T22:16:47.234 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.234 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.234 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.234 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.234 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_from_name": { 2024-08-18T22:16:47.234 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_from_name", 2024-08-18T22:16:47.235 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.235 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.235 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.235 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "Ceph", 2024-08-18T22:16:47.235 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.235 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.235 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.235 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Email From: name", 2024-08-18T22:16:47.236 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.236 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.236 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.236 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.236 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_host": { 2024-08-18T22:16:47.236 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_host", 2024-08-18T22:16:47.236 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.236 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.237 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.237 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.237 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.237 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.237 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.237 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP server", 2024-08-18T22:16:47.237 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.237 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.237 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.238 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.238 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_password": { 2024-08-18T22:16:47.238 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_password", 2024-08-18T22:16:47.238 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.238 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.238 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.238 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.238 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.239 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.239 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.239 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Password to authenticate with", 2024-08-18T22:16:47.239 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.239 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.239 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.239 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.239 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_port": { 2024-08-18T22:16:47.240 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_port", 2024-08-18T22:16:47.240 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.240 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.240 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.240 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "465", 2024-08-18T22:16:47.240 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.240 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.240 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.241 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP port", 2024-08-18T22:16:47.241 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.241 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.241 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.241 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.241 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_sender": { 2024-08-18T22:16:47.241 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_sender", 2024-08-18T22:16:47.241 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.241 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.242 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.242 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.242 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.242 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.242 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.242 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP envelope sender", 2024-08-18T22:16:47.242 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.242 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.243 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.243 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.243 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_ssl": { 2024-08-18T22:16:47.243 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_ssl", 2024-08-18T22:16:47.243 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.243 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.243 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.243 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.244 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.244 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.244 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.244 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-18T22:16:47.244 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.244 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.244 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.244 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.245 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_user": { 2024-08-18T22:16:47.245 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_user", 2024-08-18T22:16:47.245 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.245 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.245 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.245 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.245 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.245 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.246 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.246 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "User to authenticate as", 2024-08-18T22:16:47.246 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.246 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.246 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.246 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.246 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.246 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.247 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.247 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "balancer", 2024-08-18T22:16:47.247 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.247 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.247 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.247 INFO:teuthology.orchestra.run.smithi123.stdout: "active": { 2024-08-18T22:16:47.247 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "active", 2024-08-18T22:16:47.247 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.248 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.248 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.248 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.248 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.248 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.248 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.248 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "automatically balance PGs across cluster", 2024-08-18T22:16:47.248 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.248 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.249 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.249 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.249 INFO:teuthology.orchestra.run.smithi123.stdout: "begin_time": { 2024-08-18T22:16:47.249 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "begin_time", 2024-08-18T22:16:47.249 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.249 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.249 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.249 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0000", 2024-08-18T22:16:47.250 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.250 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.250 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.250 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "beginning time of day to automatically balance", 2024-08-18T22:16:47.250 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-18T22:16:47.250 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.250 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.250 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.251 INFO:teuthology.orchestra.run.smithi123.stdout: "begin_weekday": { 2024-08-18T22:16:47.251 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "begin_weekday", 2024-08-18T22:16:47.251 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-08-18T22:16:47.251 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.251 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.251 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-08-18T22:16:47.251 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0", 2024-08-18T22:16:47.251 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "6", 2024-08-18T22:16:47.252 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.252 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-18T22:16:47.252 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-18T22:16:47.252 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.252 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.252 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.252 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_max_iterations": { 2024-08-18T22:16:47.252 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_max_iterations", 2024-08-18T22:16:47.252 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-08-18T22:16:47.253 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.253 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.253 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "25", 2024-08-18T22:16:47.253 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-08-18T22:16:47.253 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "250", 2024-08-18T22:16:47.253 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.253 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-18T22:16:47.253 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.254 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.254 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.254 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.254 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_metrics": { 2024-08-18T22:16:47.254 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_metrics", 2024-08-18T22:16:47.254 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.254 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.254 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.255 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "pgs,objects,bytes", 2024-08-18T22:16:47.255 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.255 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.255 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.255 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-18T22:16:47.255 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-18T22:16:47.255 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.255 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.256 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.256 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_step": { 2024-08-18T22:16:47.256 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_step", 2024-08-18T22:16:47.256 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:47.256 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.256 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.256 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0.5", 2024-08-18T22:16:47.256 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0.001", 2024-08-18T22:16:47.256 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "0.999", 2024-08-18T22:16:47.257 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.257 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "aggressiveness of optimization", 2024-08-18T22:16:47.257 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-18T22:16:47.257 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.257 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.257 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.257 INFO:teuthology.orchestra.run.smithi123.stdout: "end_time": { 2024-08-18T22:16:47.257 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "end_time", 2024-08-18T22:16:47.258 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.258 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.258 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.258 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "2359", 2024-08-18T22:16:47.258 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.258 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.258 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.259 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "ending time of day to automatically balance", 2024-08-18T22:16:47.259 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-18T22:16:47.259 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.259 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.259 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.259 INFO:teuthology.orchestra.run.smithi123.stdout: "end_weekday": { 2024-08-18T22:16:47.259 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "end_weekday", 2024-08-18T22:16:47.259 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-08-18T22:16:47.260 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.260 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.260 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-08-18T22:16:47.260 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0", 2024-08-18T22:16:47.260 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "6", 2024-08-18T22:16:47.260 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.260 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-18T22:16:47.260 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-18T22:16:47.261 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.261 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.261 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.261 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.261 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.261 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.261 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.261 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.262 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.262 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.262 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.262 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.262 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.262 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.262 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.262 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.263 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.263 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.263 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.263 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.263 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.263 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.263 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.263 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.264 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.264 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.264 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.264 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.264 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.264 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.264 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.264 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.265 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.265 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.265 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.265 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.265 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.265 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.265 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.265 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.266 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.266 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.266 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.266 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.266 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.266 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.266 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.266 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.267 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.267 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.267 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.267 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.267 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.267 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.267 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.267 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.268 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.268 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.268 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.268 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.268 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.268 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.268 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.268 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.269 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.269 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.269 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.269 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.269 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.269 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.269 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.269 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.270 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.270 INFO:teuthology.orchestra.run.smithi123.stdout: "min_score": { 2024-08-18T22:16:47.270 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "min_score", 2024-08-18T22:16:47.270 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:47.270 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.270 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.270 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-08-18T22:16:47.270 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.271 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.271 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.271 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-18T22:16:47.271 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.271 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.271 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.271 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.271 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": { 2024-08-18T22:16:47.272 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mode", 2024-08-18T22:16:47.272 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.272 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.272 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.272 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "upmap", 2024-08-18T22:16:47.272 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.272 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.272 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.272 INFO:teuthology.orchestra.run.smithi123.stdout: "crush-compat", 2024-08-18T22:16:47.273 INFO:teuthology.orchestra.run.smithi123.stdout: "none", 2024-08-18T22:16:47.273 INFO:teuthology.orchestra.run.smithi123.stdout: "read", 2024-08-18T22:16:47.273 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap", 2024-08-18T22:16:47.273 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap-read" 2024-08-18T22:16:47.273 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.273 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Balancer mode", 2024-08-18T22:16:47.273 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.273 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.274 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.274 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.274 INFO:teuthology.orchestra.run.smithi123.stdout: "pool_ids": { 2024-08-18T22:16:47.274 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pool_ids", 2024-08-18T22:16:47.274 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.274 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.274 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.274 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.275 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.275 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.275 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.275 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-18T22:16:47.275 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.275 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.275 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.275 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.275 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-08-18T22:16:47.276 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-08-18T22:16:47.276 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.276 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.276 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.276 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-08-18T22:16:47.276 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.276 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.276 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.277 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-18T22:16:47.277 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.277 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.277 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.277 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.277 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap_max_deviation": { 2024-08-18T22:16:47.277 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "upmap_max_deviation", 2024-08-18T22:16:47.277 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.278 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.278 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.278 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-08-18T22:16:47.278 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-08-18T22:16:47.278 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.278 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.278 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-18T22:16:47.278 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-18T22:16:47.279 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.279 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.279 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.279 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap_max_optimizations": { 2024-08-18T22:16:47.279 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "upmap_max_optimizations", 2024-08-18T22:16:47.279 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-08-18T22:16:47.279 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.279 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.279 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:47.280 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.280 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.280 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.280 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-18T22:16:47.280 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.280 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.280 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.280 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.281 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.281 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.281 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.281 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cephadm", 2024-08-18T22:16:47.281 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.281 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.281 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.281 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_down_multiplier": { 2024-08-18T22:16:47.281 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_down_multiplier", 2024-08-18T22:16:47.282 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:47.282 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.282 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.282 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3.0", 2024-08-18T22:16:47.282 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.282 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.282 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.283 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-18T22:16:47.283 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.283 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.283 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.283 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.283 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_refresh_rate": { 2024-08-18T22:16:47.283 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_refresh_rate", 2024-08-18T22:16:47.283 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.284 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.284 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.284 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "20", 2024-08-18T22:16:47.284 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.284 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.284 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.284 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-18T22:16:47.284 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.284 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.285 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.285 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.285 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_starting_port": { 2024-08-18T22:16:47.285 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_starting_port", 2024-08-18T22:16:47.285 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.285 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.285 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.285 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "4721", 2024-08-18T22:16:47.286 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.286 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.286 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.286 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-18T22:16:47.286 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.286 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.286 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.286 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.286 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_ptrace": { 2024-08-18T22:16:47.287 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_ptrace", 2024-08-18T22:16:47.287 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.287 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.287 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.287 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.287 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.287 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.288 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.288 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-18T22:16:47.288 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-18T22:16:47.288 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.288 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.288 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.288 INFO:teuthology.orchestra.run.smithi123.stdout: "autotune_interval": { 2024-08-18T22:16:47.288 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "autotune_interval", 2024-08-18T22:16:47.289 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.289 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.289 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.289 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-08-18T22:16:47.289 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.289 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.289 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.289 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-18T22:16:47.290 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.290 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.290 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.290 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.290 INFO:teuthology.orchestra.run.smithi123.stdout: "autotune_memory_target_ratio": { 2024-08-18T22:16:47.290 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "autotune_memory_target_ratio", 2024-08-18T22:16:47.290 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:47.290 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.291 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.291 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0.7", 2024-08-18T22:16:47.291 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.291 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.291 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.291 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-18T22:16:47.291 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.291 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.292 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.292 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.292 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm_log_destination": { 2024-08-18T22:16:47.292 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cephadm_log_destination", 2024-08-18T22:16:47.292 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.292 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.292 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.292 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.293 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.293 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.293 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.293 INFO:teuthology.orchestra.run.smithi123.stdout: "file", 2024-08-18T22:16:47.293 INFO:teuthology.orchestra.run.smithi123.stdout: "file,syslog", 2024-08-18T22:16:47.293 INFO:teuthology.orchestra.run.smithi123.stdout: "syslog" 2024-08-18T22:16:47.293 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.293 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-18T22:16:47.293 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.294 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.294 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.294 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.294 INFO:teuthology.orchestra.run.smithi123.stdout: "cgroups_split": { 2024-08-18T22:16:47.294 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cgroups_split", 2024-08-18T22:16:47.294 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.294 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.295 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.295 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.297 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.298 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.298 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.298 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-18T22:16:47.298 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.298 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.298 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.298 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.298 INFO:teuthology.orchestra.run.smithi123.stdout: "config_checks_enabled": { 2024-08-18T22:16:47.299 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_checks_enabled", 2024-08-18T22:16:47.299 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.299 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.299 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.299 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.299 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.299 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.299 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.300 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-18T22:16:47.300 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.300 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.300 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.300 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.300 INFO:teuthology.orchestra.run.smithi123.stdout: "config_dashboard": { 2024-08-18T22:16:47.300 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_dashboard", 2024-08-18T22:16:47.300 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.301 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.301 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.301 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.301 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.301 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.301 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.301 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-18T22:16:47.301 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.302 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.302 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.302 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.302 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_alertmanager": { 2024-08-18T22:16:47.302 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_alertmanager", 2024-08-18T22:16:47.302 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.302 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.302 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.302 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-08-18T22:16:47.303 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.303 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.303 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.303 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-08-18T22:16:47.303 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.303 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.303 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.303 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.304 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_base": { 2024-08-18T22:16:47.304 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_base", 2024-08-18T22:16:47.304 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.304 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.304 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.304 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-18T22:16:47.304 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.304 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.305 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.305 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Container image name, without the tag", 2024-08-18T22:16:47.305 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.305 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.305 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.305 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.305 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_elasticsearch": { 2024-08-18T22:16:47.305 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_elasticsearch", 2024-08-18T22:16:47.306 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.306 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.306 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.306 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-18T22:16:47.306 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.306 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.306 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.306 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "elasticsearch container image", 2024-08-18T22:16:47.307 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.307 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.307 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.307 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.307 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_grafana": { 2024-08-18T22:16:47.307 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_grafana", 2024-08-18T22:16:47.307 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.307 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.308 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.308 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-08-18T22:16:47.308 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.308 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.308 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.308 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-08-18T22:16:47.308 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.308 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.308 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.309 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.309 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_haproxy": { 2024-08-18T22:16:47.309 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_haproxy", 2024-08-18T22:16:47.309 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.309 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.309 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.309 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-18T22:16:47.310 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.310 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.310 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.310 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "HAproxy container image", 2024-08-18T22:16:47.310 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.310 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.310 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.310 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.311 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_agent": { 2024-08-18T22:16:47.311 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_agent", 2024-08-18T22:16:47.311 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.311 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.311 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.311 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-18T22:16:47.311 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.311 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.311 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.312 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger agent container image", 2024-08-18T22:16:47.312 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.312 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.312 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.312 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.312 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_collector": { 2024-08-18T22:16:47.312 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_collector", 2024-08-18T22:16:47.312 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.313 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.313 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.313 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-18T22:16:47.313 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.313 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.313 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.313 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger collector container image", 2024-08-18T22:16:47.313 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.314 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.314 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.314 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.314 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_query": { 2024-08-18T22:16:47.314 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_query", 2024-08-18T22:16:47.314 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.314 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.314 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.314 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-18T22:16:47.315 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.315 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.315 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.315 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger query container image", 2024-08-18T22:16:47.315 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.315 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.315 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.315 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.316 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_keepalived": { 2024-08-18T22:16:47.316 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_keepalived", 2024-08-18T22:16:47.316 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.316 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.316 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.316 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-18T22:16:47.316 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.316 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.316 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.317 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Keepalived container image", 2024-08-18T22:16:47.317 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.317 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.317 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.317 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.317 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_loki": { 2024-08-18T22:16:47.317 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_loki", 2024-08-18T22:16:47.317 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.318 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.318 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.318 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-18T22:16:47.318 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.318 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.318 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.318 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Loki container image", 2024-08-18T22:16:47.318 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.319 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.319 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.319 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.319 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_node_exporter": { 2024-08-18T22:16:47.319 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_node_exporter", 2024-08-18T22:16:47.319 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.319 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.319 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.320 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-08-18T22:16:47.320 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.320 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.320 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.320 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-08-18T22:16:47.320 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.320 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.320 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.321 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.321 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_nvmeof": { 2024-08-18T22:16:47.321 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_nvmeof", 2024-08-18T22:16:47.321 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.321 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.321 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.321 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-18T22:16:47.321 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.321 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.322 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.322 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Nvme-of container image", 2024-08-18T22:16:47.322 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.322 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.322 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.322 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.322 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_prometheus": { 2024-08-18T22:16:47.322 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_prometheus", 2024-08-18T22:16:47.323 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.323 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.323 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.323 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-08-18T22:16:47.323 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.323 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.323 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.323 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-08-18T22:16:47.324 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.324 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.324 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.324 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.324 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_promtail": { 2024-08-18T22:16:47.324 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_promtail", 2024-08-18T22:16:47.324 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.324 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.324 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.325 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-18T22:16:47.325 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.325 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.325 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.325 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Promtail container image", 2024-08-18T22:16:47.325 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.325 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.325 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.326 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.326 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_samba": { 2024-08-18T22:16:47.326 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_samba", 2024-08-18T22:16:47.326 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.326 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.326 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.326 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-18T22:16:47.326 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.326 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.327 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.327 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Samba/SMB container image", 2024-08-18T22:16:47.327 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.327 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.327 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.327 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.327 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_snmp_gateway": { 2024-08-18T22:16:47.327 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_snmp_gateway", 2024-08-18T22:16:47.328 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.328 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.328 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.328 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-18T22:16:47.328 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.328 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.328 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.328 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SNMP Gateway container image", 2024-08-18T22:16:47.328 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.329 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.329 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.329 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.329 INFO:teuthology.orchestra.run.smithi123.stdout: "container_init": { 2024-08-18T22:16:47.329 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_init", 2024-08-18T22:16:47.329 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.329 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.329 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.330 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.330 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.330 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.330 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.330 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Run podman/docker with `--init`", 2024-08-18T22:16:47.330 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.330 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.330 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.331 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.331 INFO:teuthology.orchestra.run.smithi123.stdout: "daemon_cache_timeout": { 2024-08-18T22:16:47.331 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "daemon_cache_timeout", 2024-08-18T22:16:47.331 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.331 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.331 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.331 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-08-18T22:16:47.331 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.332 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.332 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.332 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-18T22:16:47.332 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.332 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.332 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.332 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.332 INFO:teuthology.orchestra.run.smithi123.stdout: "default_cephadm_command_timeout": { 2024-08-18T22:16:47.332 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "default_cephadm_command_timeout", 2024-08-18T22:16:47.333 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.333 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.333 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.333 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "900", 2024-08-18T22:16:47.333 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.333 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.333 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.333 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-18T22:16:47.334 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.334 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.334 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.334 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.334 INFO:teuthology.orchestra.run.smithi123.stdout: "default_registry": { 2024-08-18T22:16:47.334 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "default_registry", 2024-08-18T22:16:47.334 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.334 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.335 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.335 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io", 2024-08-18T22:16:47.335 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.335 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.335 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.335 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-18T22:16:47.335 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.336 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.336 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.336 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.336 INFO:teuthology.orchestra.run.smithi123.stdout: "device_cache_timeout": { 2024-08-18T22:16:47.336 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_cache_timeout", 2024-08-18T22:16:47.336 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.336 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.337 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.337 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1800", 2024-08-18T22:16:47.337 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.337 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.337 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.337 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache device inventory", 2024-08-18T22:16:47.337 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.337 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.338 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.338 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.338 INFO:teuthology.orchestra.run.smithi123.stdout: "device_enhanced_scan": { 2024-08-18T22:16:47.338 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_enhanced_scan", 2024-08-18T22:16:47.338 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.338 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.338 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.338 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.339 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.339 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.339 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.339 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-18T22:16:47.339 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.339 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.339 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.339 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.340 INFO:teuthology.orchestra.run.smithi123.stdout: "facts_cache_timeout": { 2024-08-18T22:16:47.340 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "facts_cache_timeout", 2024-08-18T22:16:47.340 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.340 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.340 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.340 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-08-18T22:16:47.340 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.340 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.340 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.341 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache host facts data", 2024-08-18T22:16:47.341 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.341 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.341 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.341 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.341 INFO:teuthology.orchestra.run.smithi123.stdout: "grafana_dashboards_path": { 2024-08-18T22:16:47.341 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "grafana_dashboards_path", 2024-08-18T22:16:47.341 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.342 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.342 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.342 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-18T22:16:47.342 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.342 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.342 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.342 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-18T22:16:47.342 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.342 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.343 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.343 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.343 INFO:teuthology.orchestra.run.smithi123.stdout: "host_check_interval": { 2024-08-18T22:16:47.343 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "host_check_interval", 2024-08-18T22:16:47.343 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.343 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.343 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.343 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-08-18T22:16:47.344 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.344 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.344 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.344 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to perform a host check", 2024-08-18T22:16:47.344 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.344 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.344 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.344 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.344 INFO:teuthology.orchestra.run.smithi123.stdout: "hw_monitoring": { 2024-08-18T22:16:47.345 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "hw_monitoring", 2024-08-18T22:16:47.345 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.345 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.345 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.345 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.345 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.345 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.345 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.346 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-18T22:16:47.346 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.346 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.346 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.346 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.346 INFO:teuthology.orchestra.run.smithi123.stdout: "inventory_list_all": { 2024-08-18T22:16:47.346 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "inventory_list_all", 2024-08-18T22:16:47.346 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.347 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.347 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.347 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.347 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.347 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.347 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.347 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-18T22:16:47.347 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.347 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.348 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.348 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.348 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.348 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.348 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.348 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.348 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.348 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.348 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.349 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.349 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.349 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.349 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.349 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.349 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.349 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.349 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.350 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.350 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.350 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.350 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.350 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.350 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.350 INFO:teuthology.orchestra.run.smithi123.stdout: "log_refresh_metadata": { 2024-08-18T22:16:47.350 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_refresh_metadata", 2024-08-18T22:16:47.350 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.351 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.351 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.351 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.351 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.351 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.351 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.351 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-18T22:16:47.351 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.352 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.352 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.352 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.352 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.352 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.352 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.352 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.352 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.352 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.353 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.353 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.353 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.353 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-18T22:16:47.353 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.353 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.353 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.353 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.354 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.354 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.354 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.354 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.354 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.354 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.354 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.354 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.355 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.355 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.355 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.355 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.355 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.355 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.355 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.355 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.355 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.356 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.356 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.356 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.356 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.356 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.356 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.356 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.356 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.357 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.357 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.357 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.357 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.357 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.357 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.357 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.357 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.357 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.358 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.358 INFO:teuthology.orchestra.run.smithi123.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-18T22:16:47.358 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-18T22:16:47.358 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.358 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.358 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.358 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.358 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.359 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.359 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.359 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-18T22:16:47.359 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.359 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.359 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.359 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.359 INFO:teuthology.orchestra.run.smithi123.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-18T22:16:47.360 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-18T22:16:47.360 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.360 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.360 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.360 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "*", 2024-08-18T22:16:47.360 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.360 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.360 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.360 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-18T22:16:47.361 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.361 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.361 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.361 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.361 INFO:teuthology.orchestra.run.smithi123.stdout: "max_count_per_host": { 2024-08-18T22:16:47.361 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_count_per_host", 2024-08-18T22:16:47.361 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.361 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.361 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.362 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:47.362 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.362 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.362 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.362 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "max number of daemons per service per host", 2024-08-18T22:16:47.362 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.362 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.362 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.363 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.363 INFO:teuthology.orchestra.run.smithi123.stdout: "max_osd_draining_count": { 2024-08-18T22:16:47.363 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_osd_draining_count", 2024-08-18T22:16:47.363 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.363 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.363 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.363 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:47.363 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.364 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.364 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.364 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-18T22:16:47.364 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.364 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.364 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.364 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.364 INFO:teuthology.orchestra.run.smithi123.stdout: "migration_current": { 2024-08-18T22:16:47.364 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "migration_current", 2024-08-18T22:16:47.365 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.365 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.365 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.365 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.365 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.365 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.365 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.365 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "internal - do not modify", 2024-08-18T22:16:47.366 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.366 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.366 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.366 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.366 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": { 2024-08-18T22:16:47.366 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mode", 2024-08-18T22:16:47.366 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.366 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.367 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.367 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "root", 2024-08-18T22:16:47.367 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.367 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.367 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.367 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm-package", 2024-08-18T22:16:47.367 INFO:teuthology.orchestra.run.smithi123.stdout: "root" 2024-08-18T22:16:47.367 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.368 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "mode for remote execution of cephadm", 2024-08-18T22:16:47.368 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.368 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.368 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.368 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.368 INFO:teuthology.orchestra.run.smithi123.stdout: "oob_default_addr": { 2024-08-18T22:16:47.368 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "oob_default_addr", 2024-08-18T22:16:47.368 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.368 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.369 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.369 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "169.254.1.1", 2024-08-18T22:16:47.369 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.369 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.369 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.369 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-18T22:16:47.369 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.369 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.370 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.370 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.370 INFO:teuthology.orchestra.run.smithi123.stdout: "prometheus_alerts_path": { 2024-08-18T22:16:47.370 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prometheus_alerts_path", 2024-08-18T22:16:47.370 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.370 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.370 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.370 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-18T22:16:47.371 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.371 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.371 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.371 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-18T22:16:47.371 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.371 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.371 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.371 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.371 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_insecure": { 2024-08-18T22:16:47.372 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_insecure", 2024-08-18T22:16:47.372 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.372 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.372 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.372 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.372 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.372 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.372 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.373 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-18T22:16:47.373 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.373 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.373 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.373 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.373 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_password": { 2024-08-18T22:16:47.373 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_password", 2024-08-18T22:16:47.373 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.374 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.374 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.374 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.374 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.374 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.374 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.374 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-18T22:16:47.374 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.375 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.375 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.375 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.375 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_url": { 2024-08-18T22:16:47.375 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_url", 2024-08-18T22:16:47.375 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.375 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.375 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.375 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.376 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.376 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.376 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.376 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-18T22:16:47.376 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.376 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.376 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.376 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.377 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_username": { 2024-08-18T22:16:47.377 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_username", 2024-08-18T22:16:47.377 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.377 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.377 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.377 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.377 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.377 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.378 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.378 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-18T22:16:47.378 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.378 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.378 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.378 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.378 INFO:teuthology.orchestra.run.smithi123.stdout: "secure_monitoring_stack": { 2024-08-18T22:16:47.378 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "secure_monitoring_stack", 2024-08-18T22:16:47.378 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.379 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.379 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.379 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.379 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.379 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.379 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.379 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-18T22:16:47.379 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.380 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.380 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.380 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.380 INFO:teuthology.orchestra.run.smithi123.stdout: "service_discovery_port": { 2024-08-18T22:16:47.380 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "service_discovery_port", 2024-08-18T22:16:47.380 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.380 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.380 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.381 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8765", 2024-08-18T22:16:47.381 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.381 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.381 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.381 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "cephadm service discovery port", 2024-08-18T22:16:47.381 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.381 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.381 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.382 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.382 INFO:teuthology.orchestra.run.smithi123.stdout: "ssh_config_file": { 2024-08-18T22:16:47.382 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssh_config_file", 2024-08-18T22:16:47.382 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.382 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.382 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.382 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.382 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.383 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.383 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.383 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-18T22:16:47.383 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.383 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.383 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.383 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.383 INFO:teuthology.orchestra.run.smithi123.stdout: "use_agent": { 2024-08-18T22:16:47.383 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "use_agent", 2024-08-18T22:16:47.384 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.384 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.384 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.384 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.384 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.384 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.384 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.384 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-18T22:16:47.385 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.385 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.385 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.385 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.385 INFO:teuthology.orchestra.run.smithi123.stdout: "use_repo_digest": { 2024-08-18T22:16:47.385 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "use_repo_digest", 2024-08-18T22:16:47.385 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.385 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.385 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.386 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.386 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.386 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.386 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.386 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-18T22:16:47.386 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.386 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.386 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.387 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.387 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_failed_host_check": { 2024-08-18T22:16:47.387 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_failed_host_check", 2024-08-18T22:16:47.387 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.387 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.387 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.387 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.387 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.388 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.388 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.388 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if the host check fails", 2024-08-18T22:16:47.388 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.388 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.388 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.388 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.388 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_stray_daemons": { 2024-08-18T22:16:47.388 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_stray_daemons", 2024-08-18T22:16:47.389 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.389 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.389 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.389 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.389 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.389 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.389 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.389 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-18T22:16:47.390 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.390 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.390 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.390 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.390 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_stray_hosts": { 2024-08-18T22:16:47.390 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_stray_hosts", 2024-08-18T22:16:47.390 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.390 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.391 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.391 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.391 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.391 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.391 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.391 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-18T22:16:47.391 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.391 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.392 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.392 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.392 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.392 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.392 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.392 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crash", 2024-08-18T22:16:47.392 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.392 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.393 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.393 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.393 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.393 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.393 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.393 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.393 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.393 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.393 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.394 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.394 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.394 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.394 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.394 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.394 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.394 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.395 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.395 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.395 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.395 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.395 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.395 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.395 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.395 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.395 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.396 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.396 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.396 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.396 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.396 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.396 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.396 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.396 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.397 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.397 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.397 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.397 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.397 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.397 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.397 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.397 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.397 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.398 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.398 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.398 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.398 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.398 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.398 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.398 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.398 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.399 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.399 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.399 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.399 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.399 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.399 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.399 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.399 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.400 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.400 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.400 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.400 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.400 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.400 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.400 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.400 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.401 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.401 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.401 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.401 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.401 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.401 INFO:teuthology.orchestra.run.smithi123.stdout: "retain_interval": { 2024-08-18T22:16:47.401 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "retain_interval", 2024-08-18T22:16:47.401 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.401 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.402 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.402 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "31536000", 2024-08-18T22:16:47.402 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.402 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.402 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.402 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-18T22:16:47.402 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.403 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.403 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.403 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.403 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_recent_interval": { 2024-08-18T22:16:47.403 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_recent_interval", 2024-08-18T22:16:47.403 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.403 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.403 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.403 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1209600", 2024-08-18T22:16:47.404 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.404 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.404 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.404 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-18T22:16:47.404 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.404 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.404 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.404 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.405 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.405 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.405 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.405 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "dashboard", 2024-08-18T22:16:47.405 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.405 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.405 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.405 INFO:teuthology.orchestra.run.smithi123.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-18T22:16:47.405 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-18T22:16:47.406 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.406 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.406 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.406 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:47.406 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.406 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.406 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.407 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.407 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.407 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.407 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.407 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.407 INFO:teuthology.orchestra.run.smithi123.stdout: "ALERTMANAGER_API_HOST": { 2024-08-18T22:16:47.407 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-18T22:16:47.407 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.408 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.408 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.408 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.408 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.408 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.408 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.408 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.408 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.408 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.409 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.409 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.409 INFO:teuthology.orchestra.run.smithi123.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-18T22:16:47.409 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-18T22:16:47.409 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.409 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.409 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.409 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.410 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.410 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.410 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.410 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.410 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.410 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.410 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.410 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.411 INFO:teuthology.orchestra.run.smithi123.stdout: "AUDIT_API_ENABLED": { 2024-08-18T22:16:47.411 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "AUDIT_API_ENABLED", 2024-08-18T22:16:47.411 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.411 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.411 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.411 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.411 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.411 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.412 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.412 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.412 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.412 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.412 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.412 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.412 INFO:teuthology.orchestra.run.smithi123.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-18T22:16:47.412 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-18T22:16:47.412 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.413 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.413 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.413 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.413 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.413 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.413 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.413 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.413 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.414 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.414 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.414 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.414 INFO:teuthology.orchestra.run.smithi123.stdout: "ENABLE_BROWSABLE_API": { 2024-08-18T22:16:47.414 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-18T22:16:47.414 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.414 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.414 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.415 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.415 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.415 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.415 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.415 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.415 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.415 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.415 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.415 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.416 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-18T22:16:47.416 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-18T22:16:47.416 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.416 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.416 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.416 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.416 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.416 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.417 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.417 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.417 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.417 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.417 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.417 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.417 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-18T22:16:47.417 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-18T22:16:47.418 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.418 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.418 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.418 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.418 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.418 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.418 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.418 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.418 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.419 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.419 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.419 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.419 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-18T22:16:47.419 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-18T22:16:47.419 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.419 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.419 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.420 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.420 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.420 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.420 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.420 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.420 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.420 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.420 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.420 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.421 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-18T22:16:47.421 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-18T22:16:47.421 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.421 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.421 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.421 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.421 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.421 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.422 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.422 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.422 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.422 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.422 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.422 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.422 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-18T22:16:47.422 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-18T22:16:47.422 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.423 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.423 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.423 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.423 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.423 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.423 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.423 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.423 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.424 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.424 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.424 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.424 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-18T22:16:47.424 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-18T22:16:47.424 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.424 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.424 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.424 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.425 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.425 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.425 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.425 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.425 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.425 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.425 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.425 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.425 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-18T22:16:47.426 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-18T22:16:47.426 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.426 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.426 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.426 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.426 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.426 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.426 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.427 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.427 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.427 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.427 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.427 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.427 INFO:teuthology.orchestra.run.smithi123.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-18T22:16:47.427 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-18T22:16:47.427 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.428 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.428 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.428 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.428 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.428 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.428 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.428 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.428 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.429 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.429 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.429 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.429 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_PASSWORD": { 2024-08-18T22:16:47.429 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-18T22:16:47.429 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.429 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.429 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.430 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-08-18T22:16:47.430 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.430 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.430 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.430 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.430 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.430 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.430 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.431 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.431 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-18T22:16:47.431 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-18T22:16:47.431 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.431 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.431 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.431 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.431 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.432 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.432 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.432 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.432 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.432 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.432 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.432 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.432 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_URL": { 2024-08-18T22:16:47.432 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_URL", 2024-08-18T22:16:47.433 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.433 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.433 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.433 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.433 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.433 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.433 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.433 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.434 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.434 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.434 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.434 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.434 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_USERNAME": { 2024-08-18T22:16:47.434 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-18T22:16:47.434 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.434 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.435 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.435 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-08-18T22:16:47.435 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.435 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.435 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.435 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.435 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.435 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.436 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.436 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.436 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-18T22:16:47.436 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-18T22:16:47.436 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.436 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.436 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.436 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.437 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.437 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.437 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.437 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.437 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.437 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.437 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.437 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.438 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-18T22:16:47.438 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-18T22:16:47.438 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.438 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.438 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.438 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.438 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.438 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.439 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.439 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.439 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.439 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.439 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.439 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.439 INFO:teuthology.orchestra.run.smithi123.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-18T22:16:47.439 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-18T22:16:47.439 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.440 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.440 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.440 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.440 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.440 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.440 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.440 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.440 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.441 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.441 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.441 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.441 INFO:teuthology.orchestra.run.smithi123.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-18T22:16:47.441 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-18T22:16:47.441 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.441 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.441 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.442 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.442 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.442 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.442 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.442 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.442 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.442 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.442 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.442 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.443 INFO:teuthology.orchestra.run.smithi123.stdout: "PROMETHEUS_API_HOST": { 2024-08-18T22:16:47.443 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-18T22:16:47.443 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.443 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.443 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.443 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.443 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.443 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.444 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.444 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.444 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.444 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.444 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.444 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.444 INFO:teuthology.orchestra.run.smithi123.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-18T22:16:47.444 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-18T22:16:47.445 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.445 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.445 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.445 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.445 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.445 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.445 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.445 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.446 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.446 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.446 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.446 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.446 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-18T22:16:47.446 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-18T22:16:47.446 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.446 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.447 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.447 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.447 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.447 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.447 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.447 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.447 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.447 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.447 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.448 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.448 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-18T22:16:47.448 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-18T22:16:47.448 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.448 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.448 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.448 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.448 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.448 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.449 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.449 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.449 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.449 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.449 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.449 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.449 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-18T22:16:47.449 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-18T22:16:47.450 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.450 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.450 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.450 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.450 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.450 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.450 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.450 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.451 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.451 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.451 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.451 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.451 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-18T22:16:47.451 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-18T22:16:47.451 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.451 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.451 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.452 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.452 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.452 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.452 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.452 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.452 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.452 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.452 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.452 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.453 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-18T22:16:47.453 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-18T22:16:47.453 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.453 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.453 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.453 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.453 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.453 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.454 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.454 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.454 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.454 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.454 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.454 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.454 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-18T22:16:47.454 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-18T22:16:47.454 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.455 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.455 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.455 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.455 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.455 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.455 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.455 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.455 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.456 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.456 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.456 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.456 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-18T22:16:47.456 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-18T22:16:47.456 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.456 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.456 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.457 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.457 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.457 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.457 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.457 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.457 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.457 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.457 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.457 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.458 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_ENABLED": { 2024-08-18T22:16:47.458 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-18T22:16:47.458 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.458 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.458 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.458 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.458 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.458 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.459 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.459 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.459 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.459 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.459 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.459 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.459 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-18T22:16:47.459 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-18T22:16:47.460 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.460 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.460 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.460 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-18T22:16:47.460 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.460 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.460 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.460 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.461 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.461 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.461 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.461 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.461 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-18T22:16:47.461 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-18T22:16:47.461 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.461 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.462 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.462 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:47.462 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.462 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.462 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.462 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.462 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.462 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.463 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.463 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.463 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-18T22:16:47.463 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-18T22:16:47.463 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.463 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.463 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.463 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8", 2024-08-18T22:16:47.464 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.464 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.464 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.464 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.464 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.464 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.464 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.464 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.464 INFO:teuthology.orchestra.run.smithi123.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-18T22:16:47.465 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-18T22:16:47.465 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.465 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.465 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.465 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "45", 2024-08-18T22:16:47.465 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.465 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.465 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.466 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.466 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.466 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.466 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.466 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.466 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_ACCESS_KEY": { 2024-08-18T22:16:47.466 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-18T22:16:47.466 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.467 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.467 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.467 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.467 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.467 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.467 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.467 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.467 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.467 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.468 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.468 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.468 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-18T22:16:47.468 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-18T22:16:47.468 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.468 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.468 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.468 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-08-18T22:16:47.469 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.469 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.469 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.469 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.469 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.469 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.469 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.469 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.469 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_SECRET_KEY": { 2024-08-18T22:16:47.470 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-18T22:16:47.470 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.470 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.470 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.470 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.470 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.470 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.470 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.471 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.471 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.471 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.471 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.471 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.471 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_SSL_VERIFY": { 2024-08-18T22:16:47.471 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-18T22:16:47.471 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.472 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.472 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.472 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.472 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.472 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.472 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.472 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.472 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.472 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.473 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.473 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.473 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-18T22:16:47.473 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-18T22:16:47.473 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.473 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.473 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.473 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-08-18T22:16:47.474 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.474 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.474 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.474 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.474 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.474 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.474 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.474 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.475 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-18T22:16:47.475 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-18T22:16:47.475 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.475 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.475 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.475 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:47.475 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.475 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.476 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.476 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.476 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.476 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.476 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.476 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.476 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-18T22:16:47.476 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-18T22:16:47.476 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.477 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.477 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.477 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-08-18T22:16:47.477 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.477 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.477 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.477 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.477 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.478 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.478 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.478 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.478 INFO:teuthology.orchestra.run.smithi123.stdout: "cross_origin_url": { 2024-08-18T22:16:47.478 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cross_origin_url", 2024-08-18T22:16:47.478 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.478 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.478 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.478 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.479 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.479 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.479 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.479 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.479 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.479 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.479 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.479 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.480 INFO:teuthology.orchestra.run.smithi123.stdout: "crt_file": { 2024-08-18T22:16:47.480 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crt_file", 2024-08-18T22:16:47.480 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.480 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.480 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.480 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.480 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.480 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.480 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.481 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.481 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.481 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.481 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.481 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.481 INFO:teuthology.orchestra.run.smithi123.stdout: "debug": { 2024-08-18T22:16:47.481 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "debug", 2024-08-18T22:16:47.481 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.482 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.482 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.482 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.482 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.482 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.482 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.482 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable/disable debug options", 2024-08-18T22:16:47.482 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.483 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.483 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.483 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.483 INFO:teuthology.orchestra.run.smithi123.stdout: "jwt_token_ttl": { 2024-08-18T22:16:47.483 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "jwt_token_ttl", 2024-08-18T22:16:47.483 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.483 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.483 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.483 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "28800", 2024-08-18T22:16:47.484 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.484 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.484 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.484 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.484 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.484 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.484 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.484 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.484 INFO:teuthology.orchestra.run.smithi123.stdout: "key_file": { 2024-08-18T22:16:47.485 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "key_file", 2024-08-18T22:16:47.485 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.485 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.485 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.485 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.485 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.485 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.485 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.486 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.486 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.486 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.486 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.486 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.486 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.486 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.486 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.487 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.487 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.487 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.487 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.487 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.487 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.487 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.487 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.488 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.488 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.488 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.488 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.488 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.488 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.488 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.488 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.488 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.489 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.489 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.489 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.489 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.489 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.489 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.489 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.489 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.490 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.490 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.490 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.490 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.490 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.490 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.490 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.490 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.491 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.491 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.491 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.491 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.491 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.491 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.491 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.491 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.492 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.492 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.492 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.492 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.492 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.492 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.492 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.492 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.493 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.493 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.493 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.493 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.493 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.493 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.493 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.493 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.493 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.494 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.494 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.494 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.494 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.494 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.494 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.494 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.495 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.495 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.495 INFO:teuthology.orchestra.run.smithi123.stdout: "motd": { 2024-08-18T22:16:47.495 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "motd", 2024-08-18T22:16:47.495 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.495 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.495 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.495 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.495 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.496 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.496 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.496 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "The message of the day", 2024-08-18T22:16:47.496 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.496 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.496 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.496 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.496 INFO:teuthology.orchestra.run.smithi123.stdout: "redirect_resolve_ip_addr": { 2024-08-18T22:16:47.497 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "redirect_resolve_ip_addr", 2024-08-18T22:16:47.497 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.497 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.497 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.497 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.497 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.497 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.497 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.498 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.498 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.498 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.498 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.498 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.498 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-08-18T22:16:47.498 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-08-18T22:16:47.498 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.499 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.499 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.499 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "::", 2024-08-18T22:16:47.499 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.499 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.499 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.499 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.499 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.500 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.500 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.500 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.500 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-08-18T22:16:47.500 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-08-18T22:16:47.500 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.500 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.500 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.500 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8080", 2024-08-18T22:16:47.501 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.501 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.501 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.501 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.501 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.501 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.501 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.501 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.502 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl": { 2024-08-18T22:16:47.502 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl", 2024-08-18T22:16:47.502 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.502 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.502 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.502 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.502 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.502 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.503 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.503 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.503 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.503 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.503 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.503 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.503 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl_server_port": { 2024-08-18T22:16:47.503 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl_server_port", 2024-08-18T22:16:47.504 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.504 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.504 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.504 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8443", 2024-08-18T22:16:47.504 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.504 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.504 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.504 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.505 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.505 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.505 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.505 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.505 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_behaviour": { 2024-08-18T22:16:47.505 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_behaviour", 2024-08-18T22:16:47.505 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.505 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.505 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.506 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "redirect", 2024-08-18T22:16:47.506 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.506 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.506 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.506 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.506 INFO:teuthology.orchestra.run.smithi123.stdout: "redirect" 2024-08-18T22:16:47.506 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.506 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.507 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.507 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.507 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.507 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.507 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_error_status_code": { 2024-08-18T22:16:47.507 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_error_status_code", 2024-08-18T22:16:47.507 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.507 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.508 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.508 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "500", 2024-08-18T22:16:47.508 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "400", 2024-08-18T22:16:47.508 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "599", 2024-08-18T22:16:47.508 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.508 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.508 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.508 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.509 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.509 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.509 INFO:teuthology.orchestra.run.smithi123.stdout: "url_prefix": { 2024-08-18T22:16:47.509 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "url_prefix", 2024-08-18T22:16:47.509 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.509 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.509 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.509 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.510 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.510 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.510 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.510 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.510 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.510 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.510 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.510 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.511 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.511 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.511 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.511 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "devicehealth", 2024-08-18T22:16:47.511 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.511 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.511 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.511 INFO:teuthology.orchestra.run.smithi123.stdout: "enable_monitoring": { 2024-08-18T22:16:47.511 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enable_monitoring", 2024-08-18T22:16:47.512 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.512 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.512 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.512 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.512 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.512 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.512 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.512 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "monitor device health metrics", 2024-08-18T22:16:47.513 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.513 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.513 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.513 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.513 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.513 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.513 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.513 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.513 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.514 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.514 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.514 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.514 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.514 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.514 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.514 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.514 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.515 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.515 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.515 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.515 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.515 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.515 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.515 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.515 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.516 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.516 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.516 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.516 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.516 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.516 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.516 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.516 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.517 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.517 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.517 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.517 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.517 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.517 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.517 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.517 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.518 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.518 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.518 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.518 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.518 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.518 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.518 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.518 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.518 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.519 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.519 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.519 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.519 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.519 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.519 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.519 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.519 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.520 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.520 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.520 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.520 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.520 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.520 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.520 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.520 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.520 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.521 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.521 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.521 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.521 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.521 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.521 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.521 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.521 INFO:teuthology.orchestra.run.smithi123.stdout: "mark_out_threshold": { 2024-08-18T22:16:47.522 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mark_out_threshold", 2024-08-18T22:16:47.522 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.522 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.522 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.522 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "2419200", 2024-08-18T22:16:47.522 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.522 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.522 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.522 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-18T22:16:47.523 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.523 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.523 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.523 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.523 INFO:teuthology.orchestra.run.smithi123.stdout: "pool_name": { 2024-08-18T22:16:47.523 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pool_name", 2024-08-18T22:16:47.523 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.523 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.524 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.524 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "device_health_metrics", 2024-08-18T22:16:47.524 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.524 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.524 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.524 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-18T22:16:47.524 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.524 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.524 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.525 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.525 INFO:teuthology.orchestra.run.smithi123.stdout: "retention_period": { 2024-08-18T22:16:47.525 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "retention_period", 2024-08-18T22:16:47.525 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.525 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.525 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.525 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15552000", 2024-08-18T22:16:47.525 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.526 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.526 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.526 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long to retain device health metrics", 2024-08-18T22:16:47.526 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.526 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.526 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.526 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.526 INFO:teuthology.orchestra.run.smithi123.stdout: "scrape_frequency": { 2024-08-18T22:16:47.527 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "scrape_frequency", 2024-08-18T22:16:47.527 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.527 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.527 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.527 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "86400", 2024-08-18T22:16:47.527 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.527 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.527 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.528 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-18T22:16:47.528 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.528 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.528 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.528 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.528 INFO:teuthology.orchestra.run.smithi123.stdout: "self_heal": { 2024-08-18T22:16:47.528 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "self_heal", 2024-08-18T22:16:47.528 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.528 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.529 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.529 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.529 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.529 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.529 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.529 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-18T22:16:47.529 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.529 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.530 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.530 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.530 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-08-18T22:16:47.530 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-08-18T22:16:47.530 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.530 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.530 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.530 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-08-18T22:16:47.531 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.531 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.531 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.531 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to wake up and check device health", 2024-08-18T22:16:47.531 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.531 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.531 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.531 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.532 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_threshold": { 2024-08-18T22:16:47.532 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_threshold", 2024-08-18T22:16:47.532 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.532 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.532 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.532 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "7257600", 2024-08-18T22:16:47.532 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.532 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.532 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.533 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-18T22:16:47.533 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.533 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.533 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.533 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.533 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.533 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.533 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.534 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "diskprediction_local", 2024-08-18T22:16:47.534 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.534 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.534 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.534 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.534 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.534 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.534 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.535 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.535 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.535 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.535 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.535 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.535 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.535 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.535 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.536 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.536 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.536 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.536 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.536 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.536 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.536 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.536 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.536 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.537 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.537 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.537 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.537 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.537 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.537 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.537 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.537 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.538 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.538 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.538 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.538 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.538 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.538 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.538 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.538 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.539 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.539 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.539 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.539 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.539 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.539 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.539 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.539 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.540 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.540 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.540 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.540 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.540 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.540 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.540 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.540 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.540 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.541 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.541 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.541 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.541 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.541 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.541 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.541 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.541 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.542 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.542 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.542 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.542 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.542 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.542 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.542 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.542 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.543 INFO:teuthology.orchestra.run.smithi123.stdout: "predict_interval": { 2024-08-18T22:16:47.543 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "predict_interval", 2024-08-18T22:16:47.543 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.543 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.543 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.543 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "86400", 2024-08-18T22:16:47.544 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.544 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.544 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.544 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.544 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.544 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.544 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.544 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.544 INFO:teuthology.orchestra.run.smithi123.stdout: "predictor_model": { 2024-08-18T22:16:47.545 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "predictor_model", 2024-08-18T22:16:47.545 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.545 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.545 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.545 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "prophetstor", 2024-08-18T22:16:47.545 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.545 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.545 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.546 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.546 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.546 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.546 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.546 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.546 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-08-18T22:16:47.546 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-08-18T22:16:47.546 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.547 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.547 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.547 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-08-18T22:16:47.547 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.547 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.547 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.547 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.547 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.548 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.548 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.548 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.548 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.548 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.548 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.548 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "influx", 2024-08-18T22:16:47.548 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": false, 2024-08-18T22:16:47.548 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "influxdb python module not found", 2024-08-18T22:16:47.549 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.549 INFO:teuthology.orchestra.run.smithi123.stdout: "batch_size": { 2024-08-18T22:16:47.549 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "batch_size", 2024-08-18T22:16:47.549 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.549 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.549 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.549 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5000", 2024-08-18T22:16:47.549 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.550 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.550 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.550 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-18T22:16:47.550 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.550 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.550 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.550 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.550 INFO:teuthology.orchestra.run.smithi123.stdout: "database": { 2024-08-18T22:16:47.551 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "database", 2024-08-18T22:16:47.551 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.551 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.551 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.551 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "ceph", 2024-08-18T22:16:47.551 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.551 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.551 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.552 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-18T22:16:47.552 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.552 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.552 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.552 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.552 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": { 2024-08-18T22:16:47.552 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "hostname", 2024-08-18T22:16:47.552 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.552 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.553 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.553 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.553 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.553 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.553 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.553 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB server hostname", 2024-08-18T22:16:47.553 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.553 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.554 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.554 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.554 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-08-18T22:16:47.554 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-08-18T22:16:47.554 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.554 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.554 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.554 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "30", 2024-08-18T22:16:47.555 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "5", 2024-08-18T22:16:47.555 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.555 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.555 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-18T22:16:47.555 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.555 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.555 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.555 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.556 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.556 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.556 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.556 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.556 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.556 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.556 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.556 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.557 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.557 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.557 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.557 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.557 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.557 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.557 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.557 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.557 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.558 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.558 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.558 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.558 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.558 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.558 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.558 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.558 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.559 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.559 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.559 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.559 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.559 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.559 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.559 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.559 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.559 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.560 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.560 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.560 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.560 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.560 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.560 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.560 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.560 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.561 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.561 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.561 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.561 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.561 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.561 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.561 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.562 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.562 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.562 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.562 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.562 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.562 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.562 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.562 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.563 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.563 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.563 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.563 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.563 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.563 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.563 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.563 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.564 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.564 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.564 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.564 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.564 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.564 INFO:teuthology.orchestra.run.smithi123.stdout: "password": { 2024-08-18T22:16:47.564 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "password", 2024-08-18T22:16:47.564 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.564 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.565 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.565 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.565 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.565 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.565 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.565 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "password of InfluxDB server user", 2024-08-18T22:16:47.565 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.565 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.566 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.566 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.566 INFO:teuthology.orchestra.run.smithi123.stdout: "port": { 2024-08-18T22:16:47.566 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "port", 2024-08-18T22:16:47.566 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.566 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.566 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.566 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8086", 2024-08-18T22:16:47.566 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.567 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.567 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.567 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB server port", 2024-08-18T22:16:47.567 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.567 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.567 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.567 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.567 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl": { 2024-08-18T22:16:47.568 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl", 2024-08-18T22:16:47.568 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.568 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.568 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.568 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "false", 2024-08-18T22:16:47.568 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.568 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.568 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-18T22:16:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: "threads": { 2024-08-18T22:16:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "threads", 2024-08-18T22:16:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.570 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.570 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-08-18T22:16:47.570 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-08-18T22:16:47.570 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "32", 2024-08-18T22:16:47.570 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.570 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-18T22:16:47.570 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.570 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.571 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.571 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.571 INFO:teuthology.orchestra.run.smithi123.stdout: "username": { 2024-08-18T22:16:47.571 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "username", 2024-08-18T22:16:47.571 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.571 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.571 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.571 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.572 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.572 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.572 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.572 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "username of InfluxDB server user", 2024-08-18T22:16:47.572 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.572 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.572 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.572 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.573 INFO:teuthology.orchestra.run.smithi123.stdout: "verify_ssl": { 2024-08-18T22:16:47.573 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "verify_ssl", 2024-08-18T22:16:47.573 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.573 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.573 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.573 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "true", 2024-08-18T22:16:47.573 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.573 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.574 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.574 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-18T22:16:47.574 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.574 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.574 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.574 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.574 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.574 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.574 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.575 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "insights", 2024-08-18T22:16:47.575 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.575 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.575 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.575 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.575 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.575 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.576 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.576 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.576 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.576 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.576 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.576 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.576 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.576 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.576 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.577 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.577 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.577 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.577 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.577 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.577 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.577 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.577 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.578 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.578 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.578 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.578 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.578 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.578 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.578 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.578 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.579 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.579 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.579 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.579 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.579 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.579 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.579 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.579 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.580 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.580 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.580 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.580 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.580 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.580 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.580 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.580 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.581 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.581 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.581 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.581 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.581 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.581 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.581 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.581 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.581 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.582 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.582 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.582 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.582 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.582 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.582 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.582 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.582 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.583 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.583 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.583 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.583 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.583 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.583 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.583 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.583 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.584 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.584 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.584 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.584 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.584 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "iostat", 2024-08-18T22:16:47.584 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.584 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.584 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.584 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.585 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.585 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.585 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.585 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.585 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.585 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.585 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.585 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.586 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.586 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.586 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.586 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.586 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.586 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.586 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.586 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.587 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.587 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.587 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.587 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.587 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.587 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.587 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.587 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.588 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.588 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.588 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.588 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.588 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.588 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.588 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.588 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.588 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.589 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.589 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.589 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.589 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.589 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.589 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.589 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.589 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.590 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.590 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.590 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.590 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.590 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.590 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.590 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.590 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.590 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.591 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.591 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.591 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.591 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.591 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.591 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.591 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.591 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.592 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.592 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.592 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.592 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.592 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.592 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.592 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.592 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.592 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.593 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.593 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.593 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.593 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.593 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.593 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "k8sevents", 2024-08-18T22:16:47.593 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.593 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.594 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.594 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_event_retention_days": { 2024-08-18T22:16:47.594 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ceph_event_retention_days", 2024-08-18T22:16:47.594 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.594 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.594 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.594 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "7", 2024-08-18T22:16:47.594 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.594 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.595 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.595 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-18T22:16:47.595 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.595 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.595 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.595 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.595 INFO:teuthology.orchestra.run.smithi123.stdout: "config_check_secs": { 2024-08-18T22:16:47.595 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_check_secs", 2024-08-18T22:16:47.596 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.596 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.596 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.596 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:47.596 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "10", 2024-08-18T22:16:47.596 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.596 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.596 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-18T22:16:47.597 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.597 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.597 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.597 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.597 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.597 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.597 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.597 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.597 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.598 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.598 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.598 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.598 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.598 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.598 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.598 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.598 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.599 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.599 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.599 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.599 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.599 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.599 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.599 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.599 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.600 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.600 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.600 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.600 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.600 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.600 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.600 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.600 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.601 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.601 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.601 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.601 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.601 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.601 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.601 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.601 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.602 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.602 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.602 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.602 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.602 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.602 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.602 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.602 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.603 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.603 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.603 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.603 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.603 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.603 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.603 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.603 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.604 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.604 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.604 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.604 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.604 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.604 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.604 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.604 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.604 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.605 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.605 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.605 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.605 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.605 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.605 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.605 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.605 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.606 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.606 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.606 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.606 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "localpool", 2024-08-18T22:16:47.606 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.606 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.606 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.606 INFO:teuthology.orchestra.run.smithi123.stdout: "failure_domain": { 2024-08-18T22:16:47.607 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "failure_domain", 2024-08-18T22:16:47.607 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.607 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.607 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.607 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "host", 2024-08-18T22:16:47.607 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.607 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.607 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.608 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "failure domain for any created local pool", 2024-08-18T22:16:47.608 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-18T22:16:47.608 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.608 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.608 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.608 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.608 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.608 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.609 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.609 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.609 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.609 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.609 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.609 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.609 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.609 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.609 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.610 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.610 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.610 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.610 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.610 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.610 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.610 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.610 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.611 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.611 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.611 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.611 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.611 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.611 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.611 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.611 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.612 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.612 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.612 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.612 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.612 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.612 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.612 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.612 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.613 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.613 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.613 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.613 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.613 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.613 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.613 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.613 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.614 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.614 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.614 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.614 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.614 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.614 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.614 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.614 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.614 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.615 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.615 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.615 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.615 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.615 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.615 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.615 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.615 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.616 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.616 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.616 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.616 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.616 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.616 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.616 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.616 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.617 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.617 INFO:teuthology.orchestra.run.smithi123.stdout: "min_size": { 2024-08-18T22:16:47.617 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "min_size", 2024-08-18T22:16:47.617 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.617 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.617 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.617 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.617 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.617 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.618 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.618 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default min_size for any created local pool", 2024-08-18T22:16:47.618 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-18T22:16:47.618 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.618 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.618 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.618 INFO:teuthology.orchestra.run.smithi123.stdout: "num_rep": { 2024-08-18T22:16:47.618 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "num_rep", 2024-08-18T22:16:47.619 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.619 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.619 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.619 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3", 2024-08-18T22:16:47.619 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.619 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.619 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.619 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default replica count for any created local pool", 2024-08-18T22:16:47.620 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.620 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.620 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.620 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.620 INFO:teuthology.orchestra.run.smithi123.stdout: "pg_num": { 2024-08-18T22:16:47.620 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pg_num", 2024-08-18T22:16:47.620 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.620 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.621 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.621 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "128", 2024-08-18T22:16:47.621 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.621 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.621 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.621 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default pg_num for any created local pool", 2024-08-18T22:16:47.621 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.621 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.621 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.622 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.622 INFO:teuthology.orchestra.run.smithi123.stdout: "prefix": { 2024-08-18T22:16:47.622 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prefix", 2024-08-18T22:16:47.622 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.622 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.622 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.622 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.622 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.623 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.623 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.623 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "name prefix for any created local pool", 2024-08-18T22:16:47.623 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.623 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.623 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.623 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.623 INFO:teuthology.orchestra.run.smithi123.stdout: "subtree": { 2024-08-18T22:16:47.623 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "subtree", 2024-08-18T22:16:47.624 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.624 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.624 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.624 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "rack", 2024-08-18T22:16:47.624 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.624 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.624 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.624 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-18T22:16:47.625 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-18T22:16:47.625 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.625 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.625 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.625 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.625 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.625 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.625 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mds_autoscaler", 2024-08-18T22:16:47.625 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.626 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.626 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.626 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.626 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.626 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.626 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.626 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.626 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.627 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.627 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.627 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.627 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.627 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.627 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.627 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.627 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.628 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.628 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.628 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.628 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.628 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.628 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.628 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.628 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.629 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.629 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.629 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.629 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.629 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.629 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.629 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.629 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.629 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.630 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.630 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.630 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.630 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.630 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.630 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.630 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.630 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.631 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.631 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.631 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.631 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.631 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.631 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.631 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.631 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.632 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.632 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.632 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.632 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.632 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.632 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.632 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.632 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.632 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.633 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.633 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.633 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.633 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.633 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.633 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.633 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.633 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.634 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.634 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.634 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.634 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.634 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.634 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.634 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.634 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.635 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.635 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mirroring", 2024-08-18T22:16:47.635 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.635 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.635 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.635 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.635 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.635 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.636 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.636 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.636 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.636 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.636 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.636 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.636 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.636 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.637 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.637 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.637 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.637 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.637 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.637 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.637 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.637 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.638 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.638 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.638 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.638 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.638 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.638 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.638 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.639 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.639 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.639 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.639 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.639 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.639 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.639 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.639 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.640 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.640 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.640 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.640 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.640 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.640 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.640 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.640 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.641 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.641 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.641 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.641 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.641 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.641 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.641 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.641 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.642 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.642 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.642 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.642 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.642 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.642 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.642 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.642 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.643 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.643 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.643 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.643 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.643 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.643 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.643 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.643 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.644 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.644 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.644 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.644 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.644 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.644 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.644 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.644 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "nfs", 2024-08-18T22:16:47.645 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.645 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.645 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.645 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.645 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.645 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.645 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.645 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.645 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.646 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.646 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.646 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.646 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.646 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.646 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.646 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.647 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.647 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.647 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.647 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.647 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.647 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.647 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.647 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.647 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.648 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.648 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.648 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.648 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.648 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.648 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.648 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.648 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.649 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.649 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.649 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.649 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.649 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.649 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.649 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.649 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.649 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.650 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.650 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.650 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.650 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.650 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.650 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.650 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.650 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.651 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.651 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.651 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.651 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.651 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.651 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.651 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.651 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.652 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.652 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.652 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.652 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.652 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.652 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.652 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.652 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.652 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.653 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.653 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.653 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.653 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.653 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.653 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.653 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.653 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.654 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.654 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "orchestrator", 2024-08-18T22:16:47.654 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.654 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.654 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.654 INFO:teuthology.orchestra.run.smithi123.stdout: "fail_fs": { 2024-08-18T22:16:47.654 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "fail_fs", 2024-08-18T22:16:47.654 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.654 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.655 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.655 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.655 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.655 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.655 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.655 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-18T22:16:47.655 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.655 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.656 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.656 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.656 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.656 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.656 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.656 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.656 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.656 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.656 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.657 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.657 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.657 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.657 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.657 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.657 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.657 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.657 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.658 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.658 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.658 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.658 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.658 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.658 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.658 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.658 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.659 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.659 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.659 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.659 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.659 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.659 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.659 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.659 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.660 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.660 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.660 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.660 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.660 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.660 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.660 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.660 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.661 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.661 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.661 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.661 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.661 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.661 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.661 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.661 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.661 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.662 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.662 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.662 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.662 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.662 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.662 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.662 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.662 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.663 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.663 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.663 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.663 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.663 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.663 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.663 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.663 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.664 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.664 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.664 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.664 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.664 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.664 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.664 INFO:teuthology.orchestra.run.smithi123.stdout: "orchestrator": { 2024-08-18T22:16:47.664 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "orchestrator", 2024-08-18T22:16:47.665 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.665 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.665 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.665 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.665 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.665 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.665 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.665 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm", 2024-08-18T22:16:47.665 INFO:teuthology.orchestra.run.smithi123.stdout: "rook", 2024-08-18T22:16:47.666 INFO:teuthology.orchestra.run.smithi123.stdout: "test_orchestrator" 2024-08-18T22:16:47.666 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.666 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Orchestrator backend", 2024-08-18T22:16:47.666 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.666 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.666 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.666 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.667 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.667 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.667 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.667 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "osd_perf_query", 2024-08-18T22:16:47.667 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.667 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.667 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.667 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.667 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.668 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.668 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.668 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.668 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.668 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.668 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.668 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.668 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.669 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.669 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.669 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.669 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.669 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.669 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.669 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.669 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.670 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.670 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.670 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.670 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.670 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.670 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.670 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.670 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.671 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.671 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.671 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.671 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.671 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.671 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.671 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.672 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.672 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.672 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.672 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.672 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.672 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.672 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.672 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.673 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.673 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.673 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.673 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.673 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.673 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.673 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.673 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.674 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.674 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.674 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.674 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.674 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.674 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.674 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.674 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.674 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.675 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.675 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.675 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.675 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.675 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.675 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.675 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.675 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.676 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.676 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.676 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.676 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.676 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.676 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.676 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.676 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "osd_support", 2024-08-18T22:16:47.677 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.677 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.677 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.677 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.677 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.677 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.677 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.677 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.677 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.678 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.678 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.678 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.678 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.678 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.678 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.678 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.678 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.679 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.679 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.679 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.679 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.679 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.679 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.679 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.679 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.680 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.680 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.680 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.680 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.680 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.680 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.680 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.680 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.680 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.681 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.681 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.681 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.681 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.681 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.681 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.681 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.681 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.682 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.682 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.682 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.682 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.682 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.682 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.682 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.682 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.683 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.683 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.683 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.683 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.683 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.683 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.683 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.683 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.683 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.684 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.684 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.684 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.684 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.684 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.684 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.684 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.684 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.685 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.685 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.685 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.685 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.685 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.685 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.685 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.685 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.686 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.686 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pg_autoscaler", 2024-08-18T22:16:47.686 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.686 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.686 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.686 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.686 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.686 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.687 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.687 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.687 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.687 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.687 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.687 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.687 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.687 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.688 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.688 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.688 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.688 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.688 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.688 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.688 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.688 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.689 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.689 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.689 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.689 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.689 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.689 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.689 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.689 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.690 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.690 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.690 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.690 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.690 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.690 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.690 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.690 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.693 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.694 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.694 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.694 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.694 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.694 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.694 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.694 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.695 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.695 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.695 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.695 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.695 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.695 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.695 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.695 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.695 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.696 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.696 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.696 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.696 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.696 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.696 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.696 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.696 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.697 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.697 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.697 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.697 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.697 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.697 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.697 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.697 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.698 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.698 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.698 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-08-18T22:16:47.698 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-08-18T22:16:47.698 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.698 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.698 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.698 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-08-18T22:16:47.699 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.699 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.699 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.699 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.699 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.699 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.699 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.699 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.700 INFO:teuthology.orchestra.run.smithi123.stdout: "threshold": { 2024-08-18T22:16:47.700 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "threshold", 2024-08-18T22:16:47.700 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:47.700 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.700 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.700 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3.0", 2024-08-18T22:16:47.700 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1.0", 2024-08-18T22:16:47.700 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.700 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.701 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "scaling threshold", 2024-08-18T22:16:47.701 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-18T22:16:47.701 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.701 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.701 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.701 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.701 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.701 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.702 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "progress", 2024-08-18T22:16:47.702 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.702 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.702 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.702 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_pg_recovery_event": { 2024-08-18T22:16:47.702 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_pg_recovery_event", 2024-08-18T22:16:47.702 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.702 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.703 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.703 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.703 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.703 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.703 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.703 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-18T22:16:47.703 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.703 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.704 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.704 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.704 INFO:teuthology.orchestra.run.smithi123.stdout: "enabled": { 2024-08-18T22:16:47.704 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enabled", 2024-08-18T22:16:47.704 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.704 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.704 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.704 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.705 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.705 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.705 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.705 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.705 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.705 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.705 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.705 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.705 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.706 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.706 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.706 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.706 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.706 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.706 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.706 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.707 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.707 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.707 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.707 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.707 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.707 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.707 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.707 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.707 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.708 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.708 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.708 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.708 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.708 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.708 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.708 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.708 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.709 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.709 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.709 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.709 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.709 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.709 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.709 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.709 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.710 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.710 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.710 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.710 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.710 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.710 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.710 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.710 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.711 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.711 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.711 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.711 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.711 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.711 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.711 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.711 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.712 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.712 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.712 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.712 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.712 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.712 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.712 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.712 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.713 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.713 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.713 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.713 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.713 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.713 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.713 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.713 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.714 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.714 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.714 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.714 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.714 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.714 INFO:teuthology.orchestra.run.smithi123.stdout: "max_completed_events": { 2024-08-18T22:16:47.714 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_completed_events", 2024-08-18T22:16:47.714 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.715 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.715 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.715 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "50", 2024-08-18T22:16:47.715 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.715 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.715 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.715 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "number of past completed events to remember", 2024-08-18T22:16:47.715 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.715 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.716 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.716 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.716 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-08-18T22:16:47.716 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-08-18T22:16:47.716 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.716 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.716 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.716 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-08-18T22:16:47.717 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.717 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.717 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.717 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long the module is going to sleep", 2024-08-18T22:16:47.717 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.717 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.717 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.717 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.718 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.718 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.718 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.718 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prometheus", 2024-08-18T22:16:47.718 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.718 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.718 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.718 INFO:teuthology.orchestra.run.smithi123.stdout: "cache": { 2024-08-18T22:16:47.719 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cache", 2024-08-18T22:16:47.719 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.719 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.719 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.719 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.719 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.719 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.719 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.719 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.720 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.720 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.720 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.720 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.720 INFO:teuthology.orchestra.run.smithi123.stdout: "exclude_perf_counters": { 2024-08-18T22:16:47.720 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "exclude_perf_counters", 2024-08-18T22:16:47.720 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.720 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.721 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.721 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.721 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.721 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.721 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.721 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-18T22:16:47.721 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-18T22:16:47.721 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.721 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.722 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.722 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.722 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.722 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.722 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.722 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.722 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.722 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.723 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.723 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.723 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.723 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.723 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.723 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.723 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.723 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.724 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.724 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.724 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.724 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.724 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.724 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.724 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.724 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.724 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.725 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.725 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.725 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.725 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.725 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.725 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.725 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.725 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.726 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.726 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.726 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.726 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.726 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.726 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.726 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.726 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.727 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.727 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.727 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.727 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.727 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.727 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.727 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.727 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.728 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.728 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.728 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.728 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.728 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.728 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.728 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.728 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.728 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.729 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.729 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.729 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.729 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.729 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.729 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.729 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.729 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.730 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.730 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.730 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.730 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.730 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.730 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_stats_pools": { 2024-08-18T22:16:47.730 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_stats_pools", 2024-08-18T22:16:47.730 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.731 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.731 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.731 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.731 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.731 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.731 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.731 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.731 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.731 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.732 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.732 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.732 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-18T22:16:47.732 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-18T22:16:47.732 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.732 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.732 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.732 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "300", 2024-08-18T22:16:47.733 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.733 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.733 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.733 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.733 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.733 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.733 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.733 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.734 INFO:teuthology.orchestra.run.smithi123.stdout: "scrape_interval": { 2024-08-18T22:16:47.734 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "scrape_interval", 2024-08-18T22:16:47.734 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:47.734 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.734 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.734 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15.0", 2024-08-18T22:16:47.734 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.734 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.735 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.735 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.735 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.735 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.735 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.735 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.735 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-08-18T22:16:47.735 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-08-18T22:16:47.736 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.736 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.736 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.736 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "::", 2024-08-18T22:16:47.736 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.736 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.736 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.737 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-18T22:16:47.737 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.737 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.737 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.737 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.737 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-08-18T22:16:47.737 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-08-18T22:16:47.737 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.737 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.738 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.738 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "9283", 2024-08-18T22:16:47.738 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.738 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.738 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.738 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-18T22:16:47.738 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.739 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.739 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.739 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.739 INFO:teuthology.orchestra.run.smithi123.stdout: "stale_cache_strategy": { 2024-08-18T22:16:47.739 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "stale_cache_strategy", 2024-08-18T22:16:47.739 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.739 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.739 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.740 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "log", 2024-08-18T22:16:47.740 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.740 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.740 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.740 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.740 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.740 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.740 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.740 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.741 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_behaviour": { 2024-08-18T22:16:47.741 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_behaviour", 2024-08-18T22:16:47.741 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.741 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.741 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.741 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "default", 2024-08-18T22:16:47.741 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.742 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.742 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.742 INFO:teuthology.orchestra.run.smithi123.stdout: "default", 2024-08-18T22:16:47.742 INFO:teuthology.orchestra.run.smithi123.stdout: "error" 2024-08-18T22:16:47.742 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.742 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.742 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.742 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.743 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.743 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.743 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_error_status_code": { 2024-08-18T22:16:47.743 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_error_status_code", 2024-08-18T22:16:47.743 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.743 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.743 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.743 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "500", 2024-08-18T22:16:47.744 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "400", 2024-08-18T22:16:47.744 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "599", 2024-08-18T22:16:47.744 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.744 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.744 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.744 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.744 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.744 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.745 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.745 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.745 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.745 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_support", 2024-08-18T22:16:47.745 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.745 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.745 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.745 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.746 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.746 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.746 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.746 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.746 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.746 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.746 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.746 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.747 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.747 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.747 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.747 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.747 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.747 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.747 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.747 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.748 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.748 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.748 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.748 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.748 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.748 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.748 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.748 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.749 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.749 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.749 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.749 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.749 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.749 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.749 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.749 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.749 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.750 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.750 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.750 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.750 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.750 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.750 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.750 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.750 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.751 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.751 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.751 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.751 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.751 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.751 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.751 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.751 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.752 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.752 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.752 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.752 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.752 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.752 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.752 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.752 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.753 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.753 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.753 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.753 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.753 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.753 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.753 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.753 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.754 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.754 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.754 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.754 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.754 INFO:teuthology.orchestra.run.smithi123.stdout: "max_concurrent_snap_create": { 2024-08-18T22:16:47.754 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_concurrent_snap_create", 2024-08-18T22:16:47.754 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.754 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.755 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.755 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-08-18T22:16:47.755 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.755 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.755 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.755 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.755 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.755 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.756 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.756 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.756 INFO:teuthology.orchestra.run.smithi123.stdout: "mirror_snapshot_schedule": { 2024-08-18T22:16:47.756 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mirror_snapshot_schedule", 2024-08-18T22:16:47.756 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.756 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.756 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.756 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.757 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.757 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.757 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.757 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.757 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.757 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.757 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.757 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.758 INFO:teuthology.orchestra.run.smithi123.stdout: "trash_purge_schedule": { 2024-08-18T22:16:47.758 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "trash_purge_schedule", 2024-08-18T22:16:47.758 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.758 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.758 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.758 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.758 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.758 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.759 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.759 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.759 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.759 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.759 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.759 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.759 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.759 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.759 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.760 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "restful", 2024-08-18T22:16:47.760 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.760 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.760 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.760 INFO:teuthology.orchestra.run.smithi123.stdout: "enable_auth": { 2024-08-18T22:16:47.760 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enable_auth", 2024-08-18T22:16:47.760 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.760 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.761 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.761 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.761 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.761 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.761 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.761 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.761 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.761 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.762 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.762 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.762 INFO:teuthology.orchestra.run.smithi123.stdout: "key_file": { 2024-08-18T22:16:47.762 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "key_file", 2024-08-18T22:16:47.762 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.762 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.762 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.762 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.763 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.763 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.763 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.763 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.763 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.763 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.763 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.763 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.764 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.764 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.764 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.764 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.764 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.764 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.764 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.764 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.764 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.765 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.765 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.765 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.765 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.765 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.765 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.765 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.765 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.766 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.766 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.766 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.766 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.766 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.766 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.766 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.766 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.767 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.767 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.767 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.767 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.767 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.767 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.767 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.767 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.767 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.768 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.768 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.768 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.768 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.768 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.768 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.768 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.768 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.769 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.769 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.769 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.769 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.769 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.769 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.769 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.769 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.770 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.770 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.770 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.770 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.770 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.770 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.770 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.770 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.771 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.771 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.771 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.771 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.771 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.771 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.771 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.771 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.771 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.772 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.772 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.772 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.772 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-08-18T22:16:47.772 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-08-18T22:16:47.772 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.772 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.772 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.773 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.773 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.773 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.773 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.773 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.773 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.773 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.773 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.773 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.774 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-08-18T22:16:47.774 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-08-18T22:16:47.774 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.774 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.774 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.774 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.774 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.774 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.775 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.775 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.775 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.775 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.775 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.775 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.775 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.776 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.776 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.776 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rgw", 2024-08-18T22:16:47.776 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.776 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.776 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.776 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.776 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.777 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.777 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.777 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.777 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.777 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.777 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.777 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.777 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.778 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.778 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.778 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.778 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.778 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.778 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.778 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.778 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.779 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.779 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.779 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.779 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.779 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.779 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.779 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.779 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.780 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.780 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.780 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.780 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.780 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.780 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.780 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.780 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.780 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.781 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.781 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.781 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.781 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.781 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.781 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.781 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.781 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.782 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.782 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.782 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.782 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.782 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.782 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.782 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.782 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.783 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.783 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.783 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.783 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.783 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.783 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.783 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.783 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.784 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.784 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.784 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.784 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.784 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.784 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.784 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.784 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.785 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.785 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.785 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.785 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.785 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.785 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.785 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rook", 2024-08-18T22:16:47.785 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.786 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.786 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.786 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.786 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.786 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.786 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.786 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.786 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.787 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.787 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.787 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.787 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.787 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.787 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.787 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.787 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.788 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.788 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.788 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.788 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.788 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.788 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.788 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.788 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.788 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.789 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.789 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.789 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.789 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.789 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.789 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.789 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.789 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.790 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.790 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.790 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.790 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.790 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.790 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.790 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.790 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.791 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.791 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.791 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.791 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.791 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.791 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.791 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.791 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.791 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.792 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.792 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.792 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.792 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.792 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.792 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.792 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.792 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.793 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.793 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.793 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.793 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.793 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.793 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.793 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.793 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.793 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.794 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.794 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.794 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.794 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.794 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.794 INFO:teuthology.orchestra.run.smithi123.stdout: "storage_class": { 2024-08-18T22:16:47.794 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "storage_class", 2024-08-18T22:16:47.794 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.795 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.795 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.795 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "local", 2024-08-18T22:16:47.795 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.795 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.795 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.795 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-18T22:16:47.795 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.796 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.796 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.796 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.796 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.796 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.796 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.796 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "selftest", 2024-08-18T22:16:47.796 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.797 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.797 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.797 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.797 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.797 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.797 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.797 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.797 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.797 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.798 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.798 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.798 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.798 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.798 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.798 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.798 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.798 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.799 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.799 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.799 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.799 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.799 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.799 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.799 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.799 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.799 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.800 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.800 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.800 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.800 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.800 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.800 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.800 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.800 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.801 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.801 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.801 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.801 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.801 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.801 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.801 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.801 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.801 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.802 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.802 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.802 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.802 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.802 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.802 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.802 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.802 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.803 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.803 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.803 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.803 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.803 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.803 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.803 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.803 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: "roption1": { 2024-08-18T22:16:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "roption1", 2024-08-18T22:16:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "roption2": { 2024-08-18T22:16:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "roption2", 2024-08-18T22:16:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "xyz", 2024-08-18T22:16:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption1": { 2024-08-18T22:16:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption1", 2024-08-18T22:16:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption2": { 2024-08-18T22:16:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption2", 2024-08-18T22:16:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption3": { 2024-08-18T22:16:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption3", 2024-08-18T22:16:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-08-18T22:16:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption4": { 2024-08-18T22:16:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption4", 2024-08-18T22:16:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption5": { 2024-08-18T22:16:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption5", 2024-08-18T22:16:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption6": { 2024-08-18T22:16:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption6", 2024-08-18T22:16:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption7": { 2024-08-18T22:16:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption7", 2024-08-18T22:16:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-08-18T22:16:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "42", 2024-08-18T22:16:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.821 INFO:teuthology.orchestra.run.smithi123.stdout: "testkey": { 2024-08-18T22:16:47.821 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testkey", 2024-08-18T22:16:47.821 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.821 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.821 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.821 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.821 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.821 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.821 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: "testlkey": { 2024-08-18T22:16:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testlkey", 2024-08-18T22:16:47.823 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.823 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.823 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.823 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.823 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.823 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.823 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.823 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.823 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.824 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.824 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.824 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.824 INFO:teuthology.orchestra.run.smithi123.stdout: "testnewline": { 2024-08-18T22:16:47.824 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testnewline", 2024-08-18T22:16:47.824 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.824 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.824 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.825 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.825 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.825 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.825 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.825 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.825 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.825 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.825 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snap_schedule", 2024-08-18T22:16:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.827 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_m_granularity": { 2024-08-18T22:16:47.827 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_m_granularity", 2024-08-18T22:16:47.827 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.827 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.827 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.827 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.827 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.827 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow minute scheduled snapshots", 2024-08-18T22:16:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "dump_on_update": { 2024-08-18T22:16:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "dump_on_update", 2024-08-18T22:16:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "dump database to debug log on update", 2024-08-18T22:16:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "stats", 2024-08-18T22:16:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "status", 2024-08-18T22:16:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "telegraf", 2024-08-18T22:16:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: "address": { 2024-08-18T22:16:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "address", 2024-08-18T22:16:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-18T22:16:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-08-18T22:16:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-08-18T22:16:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15", 2024-08-18T22:16:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.862 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.862 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.862 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.862 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.862 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.862 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.862 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.862 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.863 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.863 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.863 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.863 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.863 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.863 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.863 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.863 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.863 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.864 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.864 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.864 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.864 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.864 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.864 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.864 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.864 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.865 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.865 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.865 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.865 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.865 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.865 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.865 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.865 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.865 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.866 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.866 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.866 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.866 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.866 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.866 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.866 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.866 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.867 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.867 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.867 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.867 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.867 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.867 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.867 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.867 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.868 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.868 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.868 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.868 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.868 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.868 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.868 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.868 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.869 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.869 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.869 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.869 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.869 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.869 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.869 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.869 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.870 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.870 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.870 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.870 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.870 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.870 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.870 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.870 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "telemetry", 2024-08-18T22:16:47.871 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.871 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.871 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.871 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_basic": { 2024-08-18T22:16:47.871 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_basic", 2024-08-18T22:16:47.871 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.871 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.871 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.871 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.872 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.872 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.872 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.872 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-18T22:16:47.872 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.872 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.872 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.872 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.873 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_crash": { 2024-08-18T22:16:47.873 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_crash", 2024-08-18T22:16:47.873 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.873 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.873 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.873 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.873 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.873 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.874 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.874 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-18T22:16:47.874 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.874 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.874 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.874 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.874 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_device": { 2024-08-18T22:16:47.874 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_device", 2024-08-18T22:16:47.874 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.875 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.875 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.875 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.875 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.875 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.875 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.875 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-18T22:16:47.876 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.876 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.876 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.876 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.876 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_ident": { 2024-08-18T22:16:47.876 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_ident", 2024-08-18T22:16:47.876 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.876 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.876 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.877 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.877 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.877 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.877 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.877 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-18T22:16:47.877 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.877 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.877 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.878 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.878 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_perf": { 2024-08-18T22:16:47.878 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_perf", 2024-08-18T22:16:47.878 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.878 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.878 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.878 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.879 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.879 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.879 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.879 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-18T22:16:47.879 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.879 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.879 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.879 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.880 INFO:teuthology.orchestra.run.smithi123.stdout: "contact": { 2024-08-18T22:16:47.880 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "contact", 2024-08-18T22:16:47.880 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.880 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.880 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.880 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.880 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.880 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.881 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.881 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.881 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.881 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.881 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.881 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.881 INFO:teuthology.orchestra.run.smithi123.stdout: "description": { 2024-08-18T22:16:47.881 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "description", 2024-08-18T22:16:47.881 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.882 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.882 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.882 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.882 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.882 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.882 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.882 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.882 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.883 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.883 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.883 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.883 INFO:teuthology.orchestra.run.smithi123.stdout: "device_url": { 2024-08-18T22:16:47.883 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_url", 2024-08-18T22:16:47.883 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.883 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.883 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.884 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-18T22:16:47.884 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.884 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.884 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.884 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.884 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.884 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.884 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.885 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.885 INFO:teuthology.orchestra.run.smithi123.stdout: "enabled": { 2024-08-18T22:16:47.885 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enabled", 2024-08-18T22:16:47.885 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.885 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.885 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.885 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.885 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.885 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.886 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.886 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.886 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.886 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.886 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.886 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.886 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-08-18T22:16:47.887 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-08-18T22:16:47.887 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.887 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.887 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.887 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "24", 2024-08-18T22:16:47.887 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "8", 2024-08-18T22:16:47.887 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.887 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.888 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.888 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.888 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.888 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.888 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.888 INFO:teuthology.orchestra.run.smithi123.stdout: "last_opt_revision": { 2024-08-18T22:16:47.888 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "last_opt_revision", 2024-08-18T22:16:47.888 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.888 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.889 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.889 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1", 2024-08-18T22:16:47.889 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.889 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.889 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.889 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.889 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.889 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.890 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.890 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.890 INFO:teuthology.orchestra.run.smithi123.stdout: "leaderboard": { 2024-08-18T22:16:47.890 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "leaderboard", 2024-08-18T22:16:47.890 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.890 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.890 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.891 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.891 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.891 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.891 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.891 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.891 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.891 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.891 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.891 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.892 INFO:teuthology.orchestra.run.smithi123.stdout: "leaderboard_description": { 2024-08-18T22:16:47.892 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "leaderboard_description", 2024-08-18T22:16:47.892 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.892 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.892 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.892 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.892 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.892 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.893 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.893 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.893 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.893 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.893 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.893 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.893 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.893 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.894 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.894 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.894 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.894 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.894 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.894 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.894 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.894 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.895 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.895 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.895 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.897 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.897 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.897 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.897 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.898 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.898 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.898 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.898 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.898 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.898 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.898 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.898 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.899 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.899 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.899 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.899 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.899 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.899 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.899 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.899 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.900 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.900 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.900 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.900 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.900 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.900 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.901 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.901 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.901 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.901 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.901 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.901 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.901 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.902 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.902 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.902 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.902 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.902 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.902 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.902 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.902 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.903 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.903 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.903 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.903 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.903 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.903 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.903 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.903 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.904 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.904 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.904 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.904 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.904 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.904 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.904 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.905 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.905 INFO:teuthology.orchestra.run.smithi123.stdout: "organization": { 2024-08-18T22:16:47.905 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "organization", 2024-08-18T22:16:47.905 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.905 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.905 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.905 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.905 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.906 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.906 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.906 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.906 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.906 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.906 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.906 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.906 INFO:teuthology.orchestra.run.smithi123.stdout: "proxy": { 2024-08-18T22:16:47.906 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "proxy", 2024-08-18T22:16:47.907 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.907 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.907 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.907 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.907 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.907 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.907 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.907 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.908 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.908 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.908 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.908 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.908 INFO:teuthology.orchestra.run.smithi123.stdout: "url": { 2024-08-18T22:16:47.908 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "url", 2024-08-18T22:16:47.908 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.908 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.909 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.909 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-18T22:16:47.909 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.909 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.909 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.909 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.909 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.909 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.910 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.910 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.910 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.910 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.910 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.910 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "test_orchestrator", 2024-08-18T22:16:47.910 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.910 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.911 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.911 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.911 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.911 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.911 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.911 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.911 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.912 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.912 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.912 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.912 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.912 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.912 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.912 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.912 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.913 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.913 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.913 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.913 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.913 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.913 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.913 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.913 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.914 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.914 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.914 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.914 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.914 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.914 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.915 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.915 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.915 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.915 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.915 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.915 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.915 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.916 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.916 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.916 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.916 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.916 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.916 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.916 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.917 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.917 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.917 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.917 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.917 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.917 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.917 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.917 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.918 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.918 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.918 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.918 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.918 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.919 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.919 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.919 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.919 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.919 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.919 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.919 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.919 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.920 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.920 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.920 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.920 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.920 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.920 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.920 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.921 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.921 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.921 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.921 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "volumes", 2024-08-18T22:16:47.921 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.921 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.921 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.921 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.922 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.922 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.922 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.922 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.922 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.922 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.922 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.922 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.923 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.923 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.923 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.923 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.923 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.923 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.923 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.923 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.924 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.924 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.924 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.924 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.924 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.924 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.924 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.924 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.924 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.925 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.925 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.925 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.925 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.925 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.925 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.925 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.925 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.926 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.926 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.926 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.926 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.926 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.926 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.926 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.927 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.927 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.927 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.927 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.927 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.927 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.927 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.927 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.928 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.928 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.928 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.928 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.928 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.928 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.928 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.928 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.928 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.929 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.929 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.929 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.929 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.929 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.929 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.929 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.929 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.930 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.930 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.930 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.930 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.930 INFO:teuthology.orchestra.run.smithi123.stdout: "max_concurrent_clones": { 2024-08-18T22:16:47.930 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_concurrent_clones", 2024-08-18T22:16:47.930 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.930 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.931 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.931 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "4", 2024-08-18T22:16:47.931 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.931 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.931 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.931 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-18T22:16:47.931 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.931 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.932 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.932 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.932 INFO:teuthology.orchestra.run.smithi123.stdout: "periodic_async_work": { 2024-08-18T22:16:47.932 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "periodic_async_work", 2024-08-18T22:16:47.932 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.932 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.932 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.932 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.933 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.933 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.933 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.933 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Periodically check for async work", 2024-08-18T22:16:47.933 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.933 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.933 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.933 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.934 INFO:teuthology.orchestra.run.smithi123.stdout: "snapshot_clone_delay": { 2024-08-18T22:16:47.934 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snapshot_clone_delay", 2024-08-18T22:16:47.934 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.934 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.934 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.934 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-08-18T22:16:47.934 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.935 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.935 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.935 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-18T22:16:47.935 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.935 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.935 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.935 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.935 INFO:teuthology.orchestra.run.smithi123.stdout: "snapshot_clone_no_wait": { 2024-08-18T22:16:47.936 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snapshot_clone_no_wait", 2024-08-18T22:16:47.936 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.936 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.936 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.936 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-08-18T22:16:47.936 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.936 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.936 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.937 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-18T22:16:47.937 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.937 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.937 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.937 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.937 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.937 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.937 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.938 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix", 2024-08-18T22:16:47.938 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-08-18T22:16:47.938 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-08-18T22:16:47.938 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-08-18T22:16:47.938 INFO:teuthology.orchestra.run.smithi123.stdout: "discovery_interval": { 2024-08-18T22:16:47.938 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "discovery_interval", 2024-08-18T22:16:47.938 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-08-18T22:16:47.938 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.939 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.939 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "100", 2024-08-18T22:16:47.939 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.939 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.939 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.939 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.939 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.939 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.940 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.940 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.940 INFO:teuthology.orchestra.run.smithi123.stdout: "identifier": { 2024-08-18T22:16:47.940 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "identifier", 2024-08-18T22:16:47.940 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.940 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.940 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.940 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.940 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.941 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.941 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.941 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.941 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.941 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.941 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.941 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.942 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-08-18T22:16:47.942 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-08-18T22:16:47.942 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-08-18T22:16:47.942 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.942 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.942 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-08-18T22:16:47.942 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.943 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.943 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.943 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.943 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.943 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.943 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.943 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.943 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-08-18T22:16:47.944 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-08-18T22:16:47.944 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.944 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.944 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.944 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.944 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.944 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.944 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.945 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.945 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.945 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.945 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.945 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.945 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.945 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.946 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.946 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.946 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.946 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.946 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.946 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-08-18T22:16:47.946 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-08-18T22:16:47.946 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.947 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.947 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.947 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.947 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.947 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.947 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.947 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.947 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.948 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.948 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.948 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.948 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-08-18T22:16:47.948 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-08-18T22:16:47.948 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.948 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.948 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.949 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-08-18T22:16:47.949 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.949 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.949 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-08-18T22:16:47.949 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-08-18T22:16:47.949 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-08-18T22:16:47.949 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-08-18T22:16:47.949 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-08-18T22:16:47.950 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-08-18T22:16:47.950 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-08-18T22:16:47.950 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.950 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.950 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.950 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.950 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.950 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.951 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-08-18T22:16:47.951 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-08-18T22:16:47.951 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-08-18T22:16:47.951 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.951 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-08-18T22:16:47.951 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-08-18T22:16:47.951 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.951 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.952 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.952 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.952 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.952 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.952 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.952 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.952 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_host": { 2024-08-18T22:16:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_host", 2024-08-18T22:16:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-08-18T22:16:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_port": { 2024-08-18T22:16:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_port", 2024-08-18T22:16:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-08-18T22:16:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10051", 2024-08-18T22:16:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_sender": { 2024-08-18T22:16:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_sender", 2024-08-18T22:16:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-08-18T22:16:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-08-18T22:16:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-08-18T22:16:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-18T22:16:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-08-18T22:16:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-08-18T22:16:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-08-18T22:16:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-08-18T22:16:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-08-18T22:16:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-08-18T22:16:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-08-18T22:16:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: "services": { 2024-08-18T22:16:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: "dashboard": "https://172.21.15.123:8443/" 2024-08-18T22:16:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: "always_on_modules": { 2024-08-18T22:16:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus": [ 2024-08-18T22:16:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: "balancer", 2024-08-18T22:16:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: "crash", 2024-08-18T22:16:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: "devicehealth", 2024-08-18T22:16:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: "orchestrator", 2024-08-18T22:16:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: "pg_autoscaler", 2024-08-18T22:16:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: "progress", 2024-08-18T22:16:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_support", 2024-08-18T22:16:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: "status", 2024-08-18T22:16:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: "telemetry", 2024-08-18T22:16:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: "volumes" 2024-08-18T22:16:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific": [ 2024-08-18T22:16:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: "balancer", 2024-08-18T22:16:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: "crash", 2024-08-18T22:16:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: "devicehealth", 2024-08-18T22:16:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: "orchestrator", 2024-08-18T22:16:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: "pg_autoscaler", 2024-08-18T22:16:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: "progress", 2024-08-18T22:16:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_support", 2024-08-18T22:16:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: "status", 2024-08-18T22:16:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: "telemetry", 2024-08-18T22:16:47.962 INFO:teuthology.orchestra.run.smithi123.stdout: "volumes" 2024-08-18T22:16:47.962 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.962 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy": [ 2024-08-18T22:16:47.962 INFO:teuthology.orchestra.run.smithi123.stdout: "balancer", 2024-08-18T22:16:47.962 INFO:teuthology.orchestra.run.smithi123.stdout: "crash", 2024-08-18T22:16:47.962 INFO:teuthology.orchestra.run.smithi123.stdout: "devicehealth", 2024-08-18T22:16:47.962 INFO:teuthology.orchestra.run.smithi123.stdout: "orchestrator", 2024-08-18T22:16:47.963 INFO:teuthology.orchestra.run.smithi123.stdout: "pg_autoscaler", 2024-08-18T22:16:47.963 INFO:teuthology.orchestra.run.smithi123.stdout: "progress", 2024-08-18T22:16:47.963 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_support", 2024-08-18T22:16:47.963 INFO:teuthology.orchestra.run.smithi123.stdout: "status", 2024-08-18T22:16:47.963 INFO:teuthology.orchestra.run.smithi123.stdout: "telemetry", 2024-08-18T22:16:47.963 INFO:teuthology.orchestra.run.smithi123.stdout: "volumes" 2024-08-18T22:16:47.963 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.963 INFO:teuthology.orchestra.run.smithi123.stdout: "reef": [ 2024-08-18T22:16:47.964 INFO:teuthology.orchestra.run.smithi123.stdout: "balancer", 2024-08-18T22:16:47.964 INFO:teuthology.orchestra.run.smithi123.stdout: "crash", 2024-08-18T22:16:47.964 INFO:teuthology.orchestra.run.smithi123.stdout: "devicehealth", 2024-08-18T22:16:47.964 INFO:teuthology.orchestra.run.smithi123.stdout: "orchestrator", 2024-08-18T22:16:47.964 INFO:teuthology.orchestra.run.smithi123.stdout: "pg_autoscaler", 2024-08-18T22:16:47.964 INFO:teuthology.orchestra.run.smithi123.stdout: "progress", 2024-08-18T22:16:47.964 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_support", 2024-08-18T22:16:47.964 INFO:teuthology.orchestra.run.smithi123.stdout: "status", 2024-08-18T22:16:47.965 INFO:teuthology.orchestra.run.smithi123.stdout: "telemetry", 2024-08-18T22:16:47.965 INFO:teuthology.orchestra.run.smithi123.stdout: "volumes" 2024-08-18T22:16:47.965 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-08-18T22:16:47.965 INFO:teuthology.orchestra.run.smithi123.stdout: "squid": [ 2024-08-18T22:16:47.965 INFO:teuthology.orchestra.run.smithi123.stdout: "balancer", 2024-08-18T22:16:47.965 INFO:teuthology.orchestra.run.smithi123.stdout: "crash", 2024-08-18T22:16:47.965 INFO:teuthology.orchestra.run.smithi123.stdout: "devicehealth", 2024-08-18T22:16:47.965 INFO:teuthology.orchestra.run.smithi123.stdout: "orchestrator", 2024-08-18T22:16:47.965 INFO:teuthology.orchestra.run.smithi123.stdout: "pg_autoscaler", 2024-08-18T22:16:47.966 INFO:teuthology.orchestra.run.smithi123.stdout: "progress", 2024-08-18T22:16:47.966 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_support", 2024-08-18T22:16:47.966 INFO:teuthology.orchestra.run.smithi123.stdout: "status", 2024-08-18T22:16:47.966 INFO:teuthology.orchestra.run.smithi123.stdout: "telemetry", 2024-08-18T22:16:47.966 INFO:teuthology.orchestra.run.smithi123.stdout: "volumes" 2024-08-18T22:16:47.966 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-08-18T22:16:47.966 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.966 INFO:teuthology.orchestra.run.smithi123.stdout: "last_failure_osd_epoch": 3, 2024-08-18T22:16:47.967 INFO:teuthology.orchestra.run.smithi123.stdout: "active_clients": [ 2024-08-18T22:16:47.967 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.967 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "devicehealth", 2024-08-18T22:16:47.967 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-08-18T22:16:47.967 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.967 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-08-18T22:16:47.967 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:0", 2024-08-18T22:16:47.967 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 3856807507 2024-08-18T22:16:47.968 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.968 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-08-18T22:16:47.968 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.968 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.968 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "libcephsqlite", 2024-08-18T22:16:47.968 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-08-18T22:16:47.968 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.968 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-08-18T22:16:47.969 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:0", 2024-08-18T22:16:47.969 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 4058654125 2024-08-18T22:16:47.969 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.969 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-08-18T22:16:47.969 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.969 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.969 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_support", 2024-08-18T22:16:47.969 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-08-18T22:16:47.970 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.970 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-08-18T22:16:47.970 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:0", 2024-08-18T22:16:47.970 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 2778415458 2024-08-18T22:16:47.970 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.970 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-08-18T22:16:47.970 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:47.970 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.971 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "volumes", 2024-08-18T22:16:47.971 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-08-18T22:16:47.971 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-08-18T22:16:47.971 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-08-18T22:16:47.971 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:0", 2024-08-18T22:16:47.971 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 1665323376 2024-08-18T22:16:47.971 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.971 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-08-18T22:16:47.972 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:47.972 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-08-18T22:16:47.972 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:16:47.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:46 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3390590316' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-08-18T22:16:47.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:46 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/942689894' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-08-18T22:16:47.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:47 smithi130 ceph-mon[21698]: pgmap v614: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-08-18T22:16:47.974 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:45 smithi183 ceph-mon[22097]: pgmap v613: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-08-18T22:16:47.974 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:45 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3525997179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-18T22:16:47.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:45 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3769572503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-18T22:16:47.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:45 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3280143095' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-18T22:16:47.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:46 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3390590316' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-08-18T22:16:47.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:46 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/942689894' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-08-18T22:16:47.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:47 smithi183 ceph-mon[22097]: pgmap v614: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-08-18T22:16:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.636+0000 7fad463f8640 1 -- 172.21.15.123:0/942689894 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fad280a2b90 msgr2=0x7fad280a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.636+0000 7fad463f8640 1 --2- 172.21.15.123:0/942689894 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fad280a2b90 0x7fad280a5050 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fad40069990 tx=0x7fad34005d90 comp rx=0 tx=0).stop 2024-08-18T22:16:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.636+0000 7fad463f8640 1 -- 172.21.15.123:0/942689894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad40100740 msgr2=0x7fad40069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:16:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.636+0000 7fad463f8640 1 --2- 172.21.15.123:0/942689894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad40100740 0x7fad40069c20 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fad3000d950 tx=0x7fad3000de10 comp rx=0 tx=0).stop 2024-08-18T22:16:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.636+0000 7fad463f8640 1 -- 172.21.15.123:0/942689894 shutdown_connections 2024-08-18T22:16:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.636+0000 7fad463f8640 1 --2- 172.21.15.123:0/942689894 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fad280a2b90 0x7fad280a5050 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.636+0000 7fad463f8640 1 --2- 172.21.15.123:0/942689894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad401022f0 0x7fad4019ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.636+0000 7fad463f8640 1 --2- 172.21.15.123:0/942689894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad40101930 0x7fad4019c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:47.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.636+0000 7fad463f8640 1 --2- 172.21.15.123:0/942689894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad40100740 0x7fad40069c20 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:16:47.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.636+0000 7fad463f8640 1 -- 172.21.15.123:0/942689894 >> 172.21.15.123:0/942689894 conn(0x7fad400fbea0 msgr2=0x7fad40104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:16:47.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.636+0000 7fad463f8640 1 -- 172.21.15.123:0/942689894 shutdown_connections 2024-08-18T22:16:47.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:16:45.636+0000 7fad463f8640 1 -- 172.21.15.123:0/942689894 wait complete. 2024-08-18T22:16:47.984 DEBUG:tasks.check_counter:Getting stats from a 2024-08-18T22:16:47.985 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph daemon mds.a perf dump 2024-08-18T22:16:47.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:46 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3390590316' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-08-18T22:16:47.986 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:46 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/942689894' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-08-18T22:16:47.986 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:47 smithi123 ceph-mon[18462]: pgmap v614: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-08-18T22:16:48.249 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:16:48.772 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:16:48.773 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:16:48.773 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 191, 2024-08-18T22:16:48.773 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 188, 2024-08-18T22:16:48.773 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 469968, 2024-08-18T22:16:48.773 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 115408, 2024-08-18T22:16:48.773 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 4, 2024-08-18T22:16:48.773 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 0, 2024-08-18T22:16:48.774 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.026813998, 2024-08-18T22:16:48.774 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.013097528, 2024-08-18T22:16:48.774 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.015845077, 2024-08-18T22:16:48.774 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:16:48.774 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:48.774 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 187, 2024-08-18T22:16:48.774 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.009442596, 2024-08-18T22:16:48.775 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000050495 2024-08-18T22:16:48.775 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:48.775 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:48.775 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:48.775 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:48.775 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:48.775 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:48.775 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 469968, 2024-08-18T22:16:48.776 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 115408 2024-08-18T22:16:48.776 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:48.776 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:16:48.776 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 5, 2024-08-18T22:16:48.776 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 145, 2024-08-18T22:16:48.776 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 3184, 2024-08-18T22:16:48.776 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 103840, 2024-08-18T22:16:48.776 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 3, 2024-08-18T22:16:48.777 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 2, 2024-08-18T22:16:48.777 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.012278792, 2024-08-18T22:16:48.777 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.007920897, 2024-08-18T22:16:48.777 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.003171164, 2024-08-18T22:16:48.778 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:16:48.778 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:48.778 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 144, 2024-08-18T22:16:48.778 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.009367344, 2024-08-18T22:16:48.778 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000065051 2024-08-18T22:16:48.778 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:48.778 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:48.779 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:48.779 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:48.779 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:48.779 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:48.779 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-08-18T22:16:48.779 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 103840 2024-08-18T22:16:48.779 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:48.779 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:16:48.780 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 0, 2024-08-18T22:16:48.780 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 2, 2024-08-18T22:16:48.780 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 0, 2024-08-18T22:16:48.780 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 0, 2024-08-18T22:16:48.780 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 2, 2024-08-18T22:16:48.780 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 1, 2024-08-18T22:16:48.780 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.000280936, 2024-08-18T22:16:48.780 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.000000000, 2024-08-18T22:16:48.781 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.000211625, 2024-08-18T22:16:48.781 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:16:48.781 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:48.781 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:48.781 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:48.781 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:48.781 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:48.781 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:48.781 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:48.782 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:48.782 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:48.782 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:48.782 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-18T22:16:48.782 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-08-18T22:16:48.782 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:48.782 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-08-18T22:16:48.783 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 0, 2024-08-18T22:16:48.783 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-08-18T22:16:48.783 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:48.783 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-08-18T22:16:48.783 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-08-18T22:16:48.783 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-08-18T22:16:48.783 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:16:48.784 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:16:48.784 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:16:48.784 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:16:48.784 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:16:48.784 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:16:48.784 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:16:48.784 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:16:48.785 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:16:48.785 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:16:48.785 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:16:48.785 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:16:48.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:16:48.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-08-18T22:16:48.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:16:48.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-08-18T22:16:48.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:16:48.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:16:48.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:16:48.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:16:48.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:16:48.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:16:48.788 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:16:48.788 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-08-18T22:16:48.788 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:16:48.788 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:16:48.788 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:16:48.788 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-08-18T22:16:48.789 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-08-18T22:16:48.789 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-08-18T22:16:48.789 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:16:48.789 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:16:48.789 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:16:48.790 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:16:48.790 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 149047, 2024-08-18T22:16:48.790 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 31, 2024-08-18T22:16:48.790 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-08-18T22:16:48.790 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-08-18T22:16:48.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-08-18T22:16:48.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-08-18T22:16:48.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:16:48.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-08-18T22:16:48.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:16:48.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-08-18T22:16:48.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 0, 2024-08-18T22:16:48.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 0, 2024-08-18T22:16:48.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:16:48.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:16:48.792 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-08-18T22:16:48.793 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-08-18T22:16:48.793 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 928, 2024-08-18T22:16:48.793 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 2, 2024-08-18T22:16:48.793 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-08-18T22:16:48.794 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-08-18T22:16:48.794 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-08-18T22:16:48.794 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-08-18T22:16:48.794 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:48.794 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:16:48.794 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-08-18T22:16:48.795 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-08-18T22:16:48.795 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-08-18T22:16:48.795 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 192, 2024-08-18T22:16:48.795 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 442993, 2024-08-18T22:16:48.795 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:48.795 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 192, 2024-08-18T22:16:48.795 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-08-18T22:16:48.795 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-08-18T22:16:48.796 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 192, 2024-08-18T22:16:48.796 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 442993, 2024-08-18T22:16:48.796 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-08-18T22:16:48.796 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:48.796 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:48.797 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:48.797 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:48.797 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:48.797 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:16:49.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:49 smithi123 ceph-mon[18462]: pgmap v615: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-08-18T22:16:49.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:49 smithi130 ceph-mon[21698]: pgmap v615: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-08-18T22:16:49.606 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-08-18T22:16:49.606 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-08-18T22:16:49.607 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-08-18T22:16:49.607 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-08-18T22:16:49.607 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-08-18T22:16:49.607 DEBUG:tasks.check_counter:Getting stats from d 2024-08-18T22:16:49.607 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph daemon mds.d perf dump 2024-08-18T22:16:49.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:49 smithi183 ceph-mon[22097]: pgmap v615: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-08-18T22:16:49.862 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:16:50.612 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:16:50.612 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:16:50.612 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 202, 2024-08-18T22:16:50.612 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 197, 2024-08-18T22:16:50.612 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 475520, 2024-08-18T22:16:50.612 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 120032, 2024-08-18T22:16:50.613 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 4, 2024-08-18T22:16:50.613 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 0, 2024-08-18T22:16:50.613 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.029198770, 2024-08-18T22:16:50.613 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.013311262, 2024-08-18T22:16:50.613 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.017708403, 2024-08-18T22:16:50.613 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:16:50.613 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:50.613 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 197, 2024-08-18T22:16:50.614 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.013459938, 2024-08-18T22:16:50.614 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000068324 2024-08-18T22:16:50.614 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:50.614 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:50.614 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:50.614 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:50.614 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:50.614 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:50.615 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 475520, 2024-08-18T22:16:50.615 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 120032 2024-08-18T22:16:50.615 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:50.615 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:16:50.615 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 1, 2024-08-18T22:16:50.615 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 148, 2024-08-18T22:16:50.615 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 160, 2024-08-18T22:16:50.615 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 104272, 2024-08-18T22:16:50.615 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 3, 2024-08-18T22:16:50.616 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 2, 2024-08-18T22:16:50.616 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.011079935, 2024-08-18T22:16:50.616 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.008598749, 2024-08-18T22:16:50.616 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.001097246, 2024-08-18T22:16:50.616 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:16:50.616 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:50.617 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 146, 2024-08-18T22:16:50.617 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.006531141, 2024-08-18T22:16:50.617 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000044733 2024-08-18T22:16:50.617 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:50.617 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:50.617 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:50.617 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:50.617 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:50.617 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:50.618 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-18T22:16:50.618 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 104272 2024-08-18T22:16:50.618 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:50.618 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:16:50.618 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 0, 2024-08-18T22:16:50.618 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 2, 2024-08-18T22:16:50.618 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 0, 2024-08-18T22:16:50.619 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 0, 2024-08-18T22:16:50.619 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 2, 2024-08-18T22:16:50.619 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 1, 2024-08-18T22:16:50.619 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.000211950, 2024-08-18T22:16:50.619 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.000000000, 2024-08-18T22:16:50.619 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.000123836, 2024-08-18T22:16:50.619 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:16:50.619 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:50.619 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:50.620 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:50.620 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:50.620 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:50.620 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:50.620 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:50.620 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:50.620 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:50.620 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:50.620 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-18T22:16:50.621 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-08-18T22:16:50.621 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:50.621 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-08-18T22:16:50.621 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 0, 2024-08-18T22:16:50.621 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-08-18T22:16:50.621 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:50.621 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-08-18T22:16:50.621 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-08-18T22:16:50.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-08-18T22:16:50.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:16:50.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:16:50.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:16:50.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:16:50.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:16:50.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:16:50.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:16:50.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:16:50.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:16:50.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:16:50.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:16:50.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:16:50.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:16:50.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-08-18T22:16:50.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:16:50.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-08-18T22:16:50.624 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:16:50.624 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:16:50.624 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:16:50.624 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:16:50.624 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:16:50.624 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:16:50.624 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:16:50.624 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-08-18T22:16:50.625 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:16:50.625 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:16:50.625 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:16:50.625 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-08-18T22:16:50.625 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-08-18T22:16:50.625 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-08-18T22:16:50.625 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:16:50.625 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:16:50.625 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:16:50.626 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:16:50.626 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 148985, 2024-08-18T22:16:50.626 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 30, 2024-08-18T22:16:50.626 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-08-18T22:16:50.626 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-08-18T22:16:50.626 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-08-18T22:16:50.626 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-08-18T22:16:50.626 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:16:50.627 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-08-18T22:16:50.627 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:16:50.627 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-08-18T22:16:50.627 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 0, 2024-08-18T22:16:50.627 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 0, 2024-08-18T22:16:50.627 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:16:50.627 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:16:50.627 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-08-18T22:16:50.628 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-08-18T22:16:50.628 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 928, 2024-08-18T22:16:50.628 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 2, 2024-08-18T22:16:50.628 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-08-18T22:16:50.628 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-08-18T22:16:50.628 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-08-18T22:16:50.628 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-08-18T22:16:50.628 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:50.629 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:16:50.629 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-08-18T22:16:50.629 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-08-18T22:16:50.629 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-08-18T22:16:50.629 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 199, 2024-08-18T22:16:50.629 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 444540, 2024-08-18T22:16:50.629 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:50.629 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 199, 2024-08-18T22:16:50.629 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-08-18T22:16:50.630 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-08-18T22:16:50.630 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 199, 2024-08-18T22:16:50.630 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 444540, 2024-08-18T22:16:50.630 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-08-18T22:16:50.630 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:50.630 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:50.630 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:50.630 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:50.631 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:50.631 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:16:51.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:51 smithi123 ceph-mon[18462]: pgmap v616: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-08-18T22:16:51.369 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-08-18T22:16:51.369 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-08-18T22:16:51.369 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-08-18T22:16:51.370 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-08-18T22:16:51.370 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-08-18T22:16:51.370 DEBUG:tasks.check_counter:Getting stats from g 2024-08-18T22:16:51.370 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph daemon mds.g perf dump 2024-08-18T22:16:51.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:51 smithi130 ceph-mon[21698]: pgmap v616: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-08-18T22:16:51.618 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:16:51.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:51 smithi183 ceph-mon[22097]: pgmap v616: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-08-18T22:16:52.130 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:16:52.131 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:16:52.131 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 0, 2024-08-18T22:16:52.131 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 2, 2024-08-18T22:16:52.131 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 0, 2024-08-18T22:16:52.131 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 0, 2024-08-18T22:16:52.131 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 4, 2024-08-18T22:16:52.131 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 0, 2024-08-18T22:16:52.131 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.001170545, 2024-08-18T22:16:52.132 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.000000000, 2024-08-18T22:16:52.132 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.000265371, 2024-08-18T22:16:52.132 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:16:52.132 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:52.132 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:52.132 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:52.132 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:52.132 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:52.132 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:52.133 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:52.133 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:52.133 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:52.133 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:52.133 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-18T22:16:52.133 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-08-18T22:16:52.133 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:52.133 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:16:52.134 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 193, 2024-08-18T22:16:52.134 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 190, 2024-08-18T22:16:52.134 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 470512, 2024-08-18T22:16:52.134 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 116688, 2024-08-18T22:16:52.134 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 2, 2024-08-18T22:16:52.134 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 1, 2024-08-18T22:16:52.134 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.025672665, 2024-08-18T22:16:52.134 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.012860961, 2024-08-18T22:16:52.135 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.015692511, 2024-08-18T22:16:52.135 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:16:52.135 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:52.135 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 189, 2024-08-18T22:16:52.135 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.010171284, 2024-08-18T22:16:52.135 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000053816 2024-08-18T22:16:52.135 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:52.135 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:52.135 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:52.136 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:52.136 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:52.136 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:52.136 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 470512, 2024-08-18T22:16:52.136 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 116688 2024-08-18T22:16:52.136 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:52.136 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:16:52.136 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 5, 2024-08-18T22:16:52.137 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 147, 2024-08-18T22:16:52.137 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 3184, 2024-08-18T22:16:52.137 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 104192, 2024-08-18T22:16:52.137 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 3, 2024-08-18T22:16:52.137 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 2, 2024-08-18T22:16:52.137 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.012231276, 2024-08-18T22:16:52.137 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.007846847, 2024-08-18T22:16:52.137 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.003136019, 2024-08-18T22:16:52.137 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:16:52.138 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:52.138 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 146, 2024-08-18T22:16:52.138 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.010993893, 2024-08-18T22:16:52.138 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000075300 2024-08-18T22:16:52.138 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:52.138 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:52.138 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:52.138 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:52.139 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:52.139 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:52.139 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-08-18T22:16:52.139 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 104192 2024-08-18T22:16:52.139 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:52.139 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-08-18T22:16:52.139 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 0, 2024-08-18T22:16:52.139 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-08-18T22:16:52.139 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:52.140 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-08-18T22:16:52.140 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-08-18T22:16:52.140 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-08-18T22:16:52.140 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:16:52.140 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:16:52.140 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:16:52.140 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:16:52.140 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:16:52.141 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:16:52.141 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:16:52.141 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:16:52.141 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:16:52.141 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:16:52.141 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:16:52.141 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:16:52.141 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:16:52.141 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-08-18T22:16:52.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:16:52.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-08-18T22:16:52.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:16:52.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:16:52.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:16:52.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:16:52.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:16:52.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:16:52.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:16:52.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-08-18T22:16:52.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:16:52.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:16:52.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:16:52.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-08-18T22:16:52.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-08-18T22:16:52.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-08-18T22:16:52.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:16:52.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:16:52.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:16:52.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:16:52.144 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 148962, 2024-08-18T22:16:52.144 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 30, 2024-08-18T22:16:52.144 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-08-18T22:16:52.144 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-08-18T22:16:52.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-08-18T22:16:52.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-08-18T22:16:52.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:16:52.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-08-18T22:16:52.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:16:52.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-08-18T22:16:52.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 0, 2024-08-18T22:16:52.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 0, 2024-08-18T22:16:52.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:16:52.146 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:16:52.146 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-08-18T22:16:52.146 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-08-18T22:16:52.146 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 928, 2024-08-18T22:16:52.146 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 2, 2024-08-18T22:16:52.146 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-08-18T22:16:52.146 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-08-18T22:16:52.146 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-08-18T22:16:52.147 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-08-18T22:16:52.147 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:52.147 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:16:52.147 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-08-18T22:16:52.147 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-08-18T22:16:52.147 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-08-18T22:16:52.147 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 194, 2024-08-18T22:16:52.147 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 443253, 2024-08-18T22:16:52.147 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:52.148 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 194, 2024-08-18T22:16:52.148 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-08-18T22:16:52.148 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-08-18T22:16:52.148 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 194, 2024-08-18T22:16:52.148 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 443253, 2024-08-18T22:16:52.148 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-08-18T22:16:52.148 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:52.148 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:52.149 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:52.149 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:52.149 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:52.149 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:16:52.906 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-08-18T22:16:52.906 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-08-18T22:16:52.906 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-08-18T22:16:52.907 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-08-18T22:16:52.907 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-08-18T22:16:52.907 DEBUG:tasks.check_counter:Getting stats from j 2024-08-18T22:16:52.907 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph daemon mds.j perf dump 2024-08-18T22:16:53.160 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:16:53.437 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:53 smithi123 ceph-mon[18462]: pgmap v617: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-08-18T22:16:53.461 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:53 smithi183 ceph-mon[22097]: pgmap v617: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-08-18T22:16:53.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:53 smithi130 ceph-mon[21698]: pgmap v617: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-08-18T22:16:53.657 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-08-18T22:16:53.657 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:16:53.657 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 4, 2024-08-18T22:16:53.657 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 4, 2024-08-18T22:16:53.658 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 3024, 2024-08-18T22:16:53.658 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 448, 2024-08-18T22:16:53.658 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 4, 2024-08-18T22:16:53.658 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 0, 2024-08-18T22:16:53.658 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.003030189, 2024-08-18T22:16:53.658 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.000035598, 2024-08-18T22:16:53.658 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.002220028, 2024-08-18T22:16:53.658 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:16:53.658 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:53.659 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3, 2024-08-18T22:16:53.659 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.004058330, 2024-08-18T22:16:53.659 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001352776 2024-08-18T22:16:53.659 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:53.659 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:53.659 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:53.659 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:53.659 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:53.659 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:53.660 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-08-18T22:16:53.660 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 448 2024-08-18T22:16:53.660 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:53.660 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:16:53.660 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 1, 2024-08-18T22:16:53.660 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 149, 2024-08-18T22:16:53.660 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 160, 2024-08-18T22:16:53.660 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 104448, 2024-08-18T22:16:53.660 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 3, 2024-08-18T22:16:53.661 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 2, 2024-08-18T22:16:53.661 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.011880142, 2024-08-18T22:16:53.661 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.009192336, 2024-08-18T22:16:53.661 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.001245137, 2024-08-18T22:16:53.661 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:16:53.661 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:53.661 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 147, 2024-08-18T22:16:53.661 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.007202795, 2024-08-18T22:16:53.662 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000048998 2024-08-18T22:16:53.662 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:53.662 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:53.662 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:53.662 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:53.662 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:53.662 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:53.662 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-18T22:16:53.662 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 104448 2024-08-18T22:16:53.663 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:53.663 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:16:53.663 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 199, 2024-08-18T22:16:53.663 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 196, 2024-08-18T22:16:53.663 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 472768, 2024-08-18T22:16:53.663 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 120224, 2024-08-18T22:16:53.663 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 2, 2024-08-18T22:16:53.663 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 1, 2024-08-18T22:16:53.664 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.027956805, 2024-08-18T22:16:53.664 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.013456147, 2024-08-18T22:16:53.664 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.017664963, 2024-08-18T22:16:53.664 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:16:53.664 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:53.664 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 195, 2024-08-18T22:16:53.664 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.009840356, 2024-08-18T22:16:53.664 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000050463 2024-08-18T22:16:53.665 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:53.665 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:53.665 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:53.665 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:53.665 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:53.665 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:53.665 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 472768, 2024-08-18T22:16:53.665 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 120224 2024-08-18T22:16:53.665 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:53.666 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-08-18T22:16:53.666 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 0, 2024-08-18T22:16:53.666 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-08-18T22:16:53.666 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:53.666 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-08-18T22:16:53.666 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-08-18T22:16:53.666 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-08-18T22:16:53.666 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:16:53.667 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:16:53.667 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:16:53.667 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:16:53.667 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:16:53.667 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:16:53.667 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:16:53.667 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:16:53.667 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:16:53.667 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:16:53.668 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:16:53.668 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:16:53.668 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:16:53.668 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-08-18T22:16:53.668 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:16:53.668 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-08-18T22:16:53.668 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:16:53.668 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:16:53.668 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:16:53.669 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:16:53.669 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:16:53.669 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:16:53.669 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:16:53.669 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-08-18T22:16:53.669 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:16:53.669 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:16:53.669 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:16:53.669 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-08-18T22:16:53.670 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-08-18T22:16:53.670 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-08-18T22:16:53.670 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:16:53.670 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:16:53.670 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:16:53.670 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:16:53.670 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 149998, 2024-08-18T22:16:53.670 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 30, 2024-08-18T22:16:53.670 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-08-18T22:16:53.671 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-08-18T22:16:53.671 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-08-18T22:16:53.671 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-08-18T22:16:53.671 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:16:53.671 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-08-18T22:16:53.671 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:16:53.671 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-08-18T22:16:53.671 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 0, 2024-08-18T22:16:53.672 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 0, 2024-08-18T22:16:53.672 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:16:53.672 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:16:53.672 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-08-18T22:16:53.672 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-08-18T22:16:53.672 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 928, 2024-08-18T22:16:53.672 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 2, 2024-08-18T22:16:53.672 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-08-18T22:16:53.672 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-08-18T22:16:53.673 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-08-18T22:16:53.673 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-08-18T22:16:53.673 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-08-18T22:16:53.673 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:16:53.673 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-08-18T22:16:53.673 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-08-18T22:16:53.673 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-08-18T22:16:53.673 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 200, 2024-08-18T22:16:53.673 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 444670, 2024-08-18T22:16:53.673 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:53.674 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 200, 2024-08-18T22:16:53.674 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-08-18T22:16:53.674 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-08-18T22:16:53.674 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 200, 2024-08-18T22:16:53.674 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 444670, 2024-08-18T22:16:53.674 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-08-18T22:16:53.674 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-08-18T22:16:53.674 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-08-18T22:16:53.675 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-08-18T22:16:53.675 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:53.675 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-08-18T22:16:53.675 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-08-18T22:16:54.354 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:54 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:16:54.381 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-08-18T22:16:54.381 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-08-18T22:16:54.381 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-08-18T22:16:54.382 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-08-18T22:16:54.382 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-08-18T22:16:54.382 DEBUG:tasks.check_counter:Getting stats from b 2024-08-18T22:16:54.382 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph daemon mds.b perf dump 2024-08-18T22:16:54.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:54 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:16:54.635 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.b/config 2024-08-18T22:16:54.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:54 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:16:55.153 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-08-18T22:16:55.153 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:16:55.153 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 26324, 2024-08-18T22:16:55.154 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 28998, 2024-08-18T22:16:55.154 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 47086735, 2024-08-18T22:16:55.154 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 62710060, 2024-08-18T22:16:55.154 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 16, 2024-08-18T22:16:55.154 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 6, 2024-08-18T22:16:55.154 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 1.859756517, 2024-08-18T22:16:55.154 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.606011015, 2024-08-18T22:16:55.154 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.780998341, 2024-08-18T22:16:55.155 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.503373266, 2024-08-18T22:16:55.155 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:55.155 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 28997, 2024-08-18T22:16:55.155 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 2.447725432, 2024-08-18T22:16:55.155 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000084413 2024-08-18T22:16:55.155 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.155 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:55.155 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 24682, 2024-08-18T22:16:55.155 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.004635911, 2024-08-18T22:16:55.156 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000187 2024-08-18T22:16:55.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.156 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 555536, 2024-08-18T22:16:55.156 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 181120 2024-08-18T22:16:55.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.156 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:16:55.156 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 23109, 2024-08-18T22:16:55.156 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 28973, 2024-08-18T22:16:55.156 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 30652552, 2024-08-18T22:16:55.157 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 83741235, 2024-08-18T22:16:55.157 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 13, 2024-08-18T22:16:55.157 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 6, 2024-08-18T22:16:55.157 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 2.122155771, 2024-08-18T22:16:55.157 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.748642243, 2024-08-18T22:16:55.157 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.702075028, 2024-08-18T22:16:55.157 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.655487875, 2024-08-18T22:16:55.157 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:55.158 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 28972, 2024-08-18T22:16:55.158 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 2.570220000, 2024-08-18T22:16:55.158 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000088713 2024-08-18T22:16:55.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.158 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:55.158 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 24008, 2024-08-18T22:16:55.158 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.004590101, 2024-08-18T22:16:55.158 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000191 2024-08-18T22:16:55.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.159 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 4112, 2024-08-18T22:16:55.159 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 327536 2024-08-18T22:16:55.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.160 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:16:55.160 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 82939, 2024-08-18T22:16:55.160 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 137206, 2024-08-18T22:16:55.160 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 29252101, 2024-08-18T22:16:55.160 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 115438416, 2024-08-18T22:16:55.160 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 15, 2024-08-18T22:16:55.160 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 5, 2024-08-18T22:16:55.161 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 5.718168803, 2024-08-18T22:16:55.161 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 2.340496951, 2024-08-18T22:16:55.161 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 33.726707330, 2024-08-18T22:16:55.161 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.790657308, 2024-08-18T22:16:55.161 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:55.162 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 137204, 2024-08-18T22:16:55.162 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 9.044632484, 2024-08-18T22:16:55.162 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000065921 2024-08-18T22:16:55.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.162 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:55.162 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 156279, 2024-08-18T22:16:55.162 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.037762441, 2024-08-18T22:16:55.163 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000241 2024-08-18T22:16:55.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.163 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-18T22:16:55.163 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 0 2024-08-18T22:16:55.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.163 INFO:teuthology.orchestra.run.smithi130.stdout: "cct": { 2024-08-18T22:16:55.164 INFO:teuthology.orchestra.run.smithi130.stdout: "total_workers": 1, 2024-08-18T22:16:55.164 INFO:teuthology.orchestra.run.smithi130.stdout: "unhealthy_workers": 0 2024-08-18T22:16:55.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.164 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-MDSRank": { 2024-08-18T22:16:55.164 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-18T22:16:55.164 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-18T22:16:55.164 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 10004, 2024-08-18T22:16:55.164 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 40.529550192, 2024-08-18T22:16:55.165 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.004051334 2024-08-18T22:16:55.165 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:55.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.165 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-PurgeQueue": { 2024-08-18T22:16:55.165 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-18T22:16:55.165 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-18T22:16:55.165 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 30143, 2024-08-18T22:16:55.165 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 8.616799452, 2024-08-18T22:16:55.166 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000285864 2024-08-18T22:16:55.166 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:55.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.166 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": { 2024-08-18T22:16:55.166 INFO:teuthology.orchestra.run.smithi130.stdout: "request": 48693, 2024-08-18T22:16:55.166 INFO:teuthology.orchestra.run.smithi130.stdout: "reply": 44010, 2024-08-18T22:16:55.166 INFO:teuthology.orchestra.run.smithi130.stdout: "reply_latency": { 2024-08-18T22:16:55.166 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 44010, 2024-08-18T22:16:55.167 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 121.851399275, 2024-08-18T22:16:55.167 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.002768720 2024-08-18T22:16:55.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.167 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_reply": 0, 2024-08-18T22:16:55.167 INFO:teuthology.orchestra.run.smithi130.stdout: "forward": 4683, 2024-08-18T22:16:55.167 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_complete": 188, 2024-08-18T22:16:55.167 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_keys": 0, 2024-08-18T22:16:55.167 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_commit": 720, 2024-08-18T22:16:55.168 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_split": 86, 2024-08-18T22:16:55.168 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_merge": 21, 2024-08-18T22:16:55.168 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes": 40, 2024-08-18T22:16:55.168 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_top": 16, 2024-08-18T22:16:55.168 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_bottom": 13, 2024-08-18T22:16:55.168 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pin_tail": 11, 2024-08-18T22:16:55.168 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pinned": 16, 2024-08-18T22:16:55.169 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_expired": 26207, 2024-08-18T22:16:55.169 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_with_caps": 0, 2024-08-18T22:16:55.169 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": 0, 2024-08-18T22:16:55.169 INFO:teuthology.orchestra.run.smithi130.stdout: "subtrees": 4, 2024-08-18T22:16:55.169 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse": 75946, 2024-08-18T22:16:55.170 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_hit": 63453, 2024-08-18T22:16:55.170 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_forward": 4635, 2024-08-18T22:16:55.170 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_discover": 10, 2024-08-18T22:16:55.170 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_dir_fetch": 184, 2024-08-18T22:16:55.170 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_remote_ino": 0, 2024-08-18T22:16:55.171 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_lock": 4, 2024-08-18T22:16:55.171 INFO:teuthology.orchestra.run.smithi130.stdout: "load_cent": 1000, 2024-08-18T22:16:55.171 INFO:teuthology.orchestra.run.smithi130.stdout: "q": 1, 2024-08-18T22:16:55.171 INFO:teuthology.orchestra.run.smithi130.stdout: "exported": 283, 2024-08-18T22:16:55.171 INFO:teuthology.orchestra.run.smithi130.stdout: "exported_inodes": 13403, 2024-08-18T22:16:55.171 INFO:teuthology.orchestra.run.smithi130.stdout: "imported": 170, 2024-08-18T22:16:55.172 INFO:teuthology.orchestra.run.smithi130.stdout: "imported_inodes": 24607, 2024-08-18T22:16:55.172 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_dir_fetch": 0, 2024-08-18T22:16:55.172 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_backtrace_fetch": 13485, 2024-08-18T22:16:55.172 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_peer_discover": 0, 2024-08-18T22:16:55.173 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rfiles": 4, 2024-08-18T22:16:55.173 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rbytes": 234, 2024-08-18T22:16:55.173 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rsnaps": 0, 2024-08-18T22:16:55.173 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_fetch": 13485, 2024-08-18T22:16:55.173 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_set_tag": 0, 2024-08-18T22:16:55.173 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_repaired": 0, 2024-08-18T22:16:55.173 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_inotable_repaired": 0, 2024-08-18T22:16:55.173 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_inodes": 1, 2024-08-18T22:16:55.174 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_base_inodes": 0, 2024-08-18T22:16:55.174 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dirfrag_rstats": 1, 2024-08-18T22:16:55.174 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_file_inodes": 13484, 2024-08-18T22:16:55.174 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_inode_file_caps": 1, 2024-08-18T22:16:55.174 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_revoke": 52, 2024-08-18T22:16:55.174 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_grant": 26171, 2024-08-18T22:16:55.174 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_trunc": 0, 2024-08-18T22:16:55.174 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-18T22:16:55.175 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-18T22:16:55.175 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps": 10654, 2024-08-18T22:16:55.175 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps_dirty": 10534, 2024-08-18T22:16:55.175 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_cap_release": 220, 2024-08-18T22:16:55.175 INFO:teuthology.orchestra.run.smithi130.stdout: "process_request_cap_release": 25298 2024-08-18T22:16:55.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.176 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_cache": { 2024-08-18T22:16:55.176 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update": 1040, 2024-08-18T22:16:55.176 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update_receipt": 3731, 2024-08-18T22:16:55.177 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_try_discover": 1869, 2024-08-18T22:16:55.177 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_send_discover": 1960, 2024-08-18T22:16:55.177 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_handle_discover": 1062, 2024-08-18T22:16:55.177 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays": 1, 2024-08-18T22:16:55.177 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_delayed": 0, 2024-08-18T22:16:55.177 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_enqueuing": 0, 2024-08-18T22:16:55.178 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_created": 17283, 2024-08-18T22:16:55.178 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_enqueued": 17282, 2024-08-18T22:16:55.178 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_reintegrated": 0, 2024-08-18T22:16:55.178 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_migrated": 0, 2024-08-18T22:16:55.178 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_processing": 0, 2024-08-18T22:16:55.178 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_enqueued": 0, 2024-08-18T22:16:55.178 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_prioritized": 0, 2024-08-18T22:16:55.178 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_started": 0, 2024-08-18T22:16:55.179 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_completed": 0, 2024-08-18T22:16:55.179 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_path": 7, 2024-08-18T22:16:55.179 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_inode": 2170, 2024-08-18T22:16:55.180 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_enqueue_scrub": 0, 2024-08-18T22:16:55.180 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_exportdir": 313, 2024-08-18T22:16:55.180 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_flush": 0, 2024-08-18T22:16:55.180 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragmentdir": 108, 2024-08-18T22:16:55.180 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragstats": 0, 2024-08-18T22:16:55.180 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_inodestats": 0 2024-08-18T22:16:55.180 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.181 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_log": { 2024-08-18T22:16:55.181 INFO:teuthology.orchestra.run.smithi130.stdout: "evlrg": 2, 2024-08-18T22:16:55.181 INFO:teuthology.orchestra.run.smithi130.stdout: "evadd": 57957, 2024-08-18T22:16:55.181 INFO:teuthology.orchestra.run.smithi130.stdout: "evex": 0, 2024-08-18T22:16:55.182 INFO:teuthology.orchestra.run.smithi130.stdout: "evtrm": 0, 2024-08-18T22:16:55.182 INFO:teuthology.orchestra.run.smithi130.stdout: "ev": 57957, 2024-08-18T22:16:55.182 INFO:teuthology.orchestra.run.smithi130.stdout: "evexg": 0, 2024-08-18T22:16:55.183 INFO:teuthology.orchestra.run.smithi130.stdout: "evexd": 0, 2024-08-18T22:16:55.183 INFO:teuthology.orchestra.run.smithi130.stdout: "segadd": 76, 2024-08-18T22:16:55.183 INFO:teuthology.orchestra.run.smithi130.stdout: "segex": 0, 2024-08-18T22:16:55.183 INFO:teuthology.orchestra.run.smithi130.stdout: "segtrm": 0, 2024-08-18T22:16:55.184 INFO:teuthology.orchestra.run.smithi130.stdout: "seg": 76, 2024-08-18T22:16:55.184 INFO:teuthology.orchestra.run.smithi130.stdout: "segmjr": 6, 2024-08-18T22:16:55.184 INFO:teuthology.orchestra.run.smithi130.stdout: "segexg": 0, 2024-08-18T22:16:55.184 INFO:teuthology.orchestra.run.smithi130.stdout: "segexd": 0, 2024-08-18T22:16:55.184 INFO:teuthology.orchestra.run.smithi130.stdout: "expos": 4194304, 2024-08-18T22:16:55.185 INFO:teuthology.orchestra.run.smithi130.stdout: "wrpos": 118314067, 2024-08-18T22:16:55.185 INFO:teuthology.orchestra.run.smithi130.stdout: "rdpos": 0, 2024-08-18T22:16:55.185 INFO:teuthology.orchestra.run.smithi130.stdout: "jlat": { 2024-08-18T22:16:55.185 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 942, 2024-08-18T22:16:55.185 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 81.632098334, 2024-08-18T22:16:55.186 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.086658278 2024-08-18T22:16:55.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.186 INFO:teuthology.orchestra.run.smithi130.stdout: "replayed": 0 2024-08-18T22:16:55.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.186 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_mem": { 2024-08-18T22:16:55.187 INFO:teuthology.orchestra.run.smithi130.stdout: "ino": 26, 2024-08-18T22:16:55.187 INFO:teuthology.orchestra.run.smithi130.stdout: "ino+": 17832, 2024-08-18T22:16:55.187 INFO:teuthology.orchestra.run.smithi130.stdout: "ino-": 17806, 2024-08-18T22:16:55.187 INFO:teuthology.orchestra.run.smithi130.stdout: "dir": 71, 2024-08-18T22:16:55.187 INFO:teuthology.orchestra.run.smithi130.stdout: "dir+": 2793, 2024-08-18T22:16:55.187 INFO:teuthology.orchestra.run.smithi130.stdout: "dir-": 2722, 2024-08-18T22:16:55.187 INFO:teuthology.orchestra.run.smithi130.stdout: "dn": 40, 2024-08-18T22:16:55.188 INFO:teuthology.orchestra.run.smithi130.stdout: "dn+": 50590, 2024-08-18T22:16:55.188 INFO:teuthology.orchestra.run.smithi130.stdout: "dn-": 50550, 2024-08-18T22:16:55.188 INFO:teuthology.orchestra.run.smithi130.stdout: "cap": 0, 2024-08-18T22:16:55.188 INFO:teuthology.orchestra.run.smithi130.stdout: "cap+": 24933, 2024-08-18T22:16:55.189 INFO:teuthology.orchestra.run.smithi130.stdout: "cap-": 24933, 2024-08-18T22:16:55.189 INFO:teuthology.orchestra.run.smithi130.stdout: "rss": 128852, 2024-08-18T22:16:55.189 INFO:teuthology.orchestra.run.smithi130.stdout: "heap": 223520 2024-08-18T22:16:55.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.189 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_server": { 2024-08-18T22:16:55.189 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_client_request": 57256, 2024-08-18T22:16:55.189 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_server_request": 2, 2024-08-18T22:16:55.190 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_request": 48693, 2024-08-18T22:16:55.190 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_session": 11, 2024-08-18T22:16:55.190 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_peer_request": 7747, 2024-08-18T22:16:55.190 INFO:teuthology.orchestra.run.smithi130.stdout: "req_create_latency": { 2024-08-18T22:16:55.190 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 8465, 2024-08-18T22:16:55.191 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 17.783447204, 2024-08-18T22:16:55.191 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.002100820 2024-08-18T22:16:55.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.191 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getattr_latency": { 2024-08-18T22:16:55.191 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 315, 2024-08-18T22:16:55.191 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.265307465, 2024-08-18T22:16:55.191 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000842245 2024-08-18T22:16:55.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.192 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getfilelock_latency": { 2024-08-18T22:16:55.192 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.192 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.192 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.192 INFO:teuthology.orchestra.run.smithi130.stdout: "req_link_latency": { 2024-08-18T22:16:55.192 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.193 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.193 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.194 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookup_latency": { 2024-08-18T22:16:55.194 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 17210, 2024-08-18T22:16:55.194 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 20.133516081, 2024-08-18T22:16:55.194 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.001169873 2024-08-18T22:16:55.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.194 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookuphash_latency": { 2024-08-18T22:16:55.195 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.195 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.195 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.196 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupino_latency": { 2024-08-18T22:16:55.196 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.196 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.196 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.196 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupname_latency": { 2024-08-18T22:16:55.196 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.196 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.197 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.197 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupparent_latency": { 2024-08-18T22:16:55.197 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.197 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.197 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.197 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupsnap_latency": { 2024-08-18T22:16:55.198 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.198 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.199 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.199 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lssnap_latency": { 2024-08-18T22:16:55.199 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.199 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.199 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.200 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mkdir_latency": { 2024-08-18T22:16:55.200 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.200 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.200 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.200 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mknod_latency": { 2024-08-18T22:16:55.201 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.201 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.201 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.201 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mksnap_latency": { 2024-08-18T22:16:55.201 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.202 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.202 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.203 INFO:teuthology.orchestra.run.smithi130.stdout: "req_open_latency": { 2024-08-18T22:16:55.203 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.203 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.203 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.203 INFO:teuthology.orchestra.run.smithi130.stdout: "req_readdir_latency": { 2024-08-18T22:16:55.203 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 737, 2024-08-18T22:16:55.204 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 11.615276493, 2024-08-18T22:16:55.204 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.015760212 2024-08-18T22:16:55.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.204 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rename_latency": { 2024-08-18T22:16:55.204 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.204 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.204 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.205 INFO:teuthology.orchestra.run.smithi130.stdout: "req_renamesnap_latency": { 2024-08-18T22:16:55.205 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.205 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.205 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.205 INFO:teuthology.orchestra.run.smithi130.stdout: "req_snapdiff_latency": { 2024-08-18T22:16:55.206 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.206 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.206 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.206 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmdir_latency": { 2024-08-18T22:16:55.206 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 2, 2024-08-18T22:16:55.206 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.016532313, 2024-08-18T22:16:55.206 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.008266156 2024-08-18T22:16:55.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.207 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmsnap_latency": { 2024-08-18T22:16:55.207 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.207 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.207 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.208 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmxattr_latency": { 2024-08-18T22:16:55.208 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.208 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.208 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.208 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setattr_latency": { 2024-08-18T22:16:55.209 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.209 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.209 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.209 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setdirlayout_latency": { 2024-08-18T22:16:55.209 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.209 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.209 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.210 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setfilelock_latency": { 2024-08-18T22:16:55.210 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.210 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.210 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.210 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setlayout_latency": { 2024-08-18T22:16:55.210 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.211 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.211 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.211 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setxattr_latency": { 2024-08-18T22:16:55.211 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.211 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.211 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.212 INFO:teuthology.orchestra.run.smithi130.stdout: "req_symlink_latency": { 2024-08-18T22:16:55.212 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.212 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.212 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.212 INFO:teuthology.orchestra.run.smithi130.stdout: "req_unlink_latency": { 2024-08-18T22:16:55.212 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 17281, 2024-08-18T22:16:55.213 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 72.037319719, 2024-08-18T22:16:55.213 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.004168585 2024-08-18T22:16:55.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.213 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_revoke_eviction": 0, 2024-08-18T22:16:55.213 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_acquisition_throttle": 0, 2024-08-18T22:16:55.213 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getvxattr_latency": { 2024-08-18T22:16:55.213 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.213 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.214 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.214 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:55.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.214 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_sessions": { 2024-08-18T22:16:55.214 INFO:teuthology.orchestra.run.smithi130.stdout: "session_count": 1, 2024-08-18T22:16:55.214 INFO:teuthology.orchestra.run.smithi130.stdout: "session_add": 2, 2024-08-18T22:16:55.214 INFO:teuthology.orchestra.run.smithi130.stdout: "session_remove": 1, 2024-08-18T22:16:55.215 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_open": 1, 2024-08-18T22:16:55.215 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_stale": 0, 2024-08-18T22:16:55.215 INFO:teuthology.orchestra.run.smithi130.stdout: "total_load": 16027, 2024-08-18T22:16:55.215 INFO:teuthology.orchestra.run.smithi130.stdout: "average_load": 16027, 2024-08-18T22:16:55.215 INFO:teuthology.orchestra.run.smithi130.stdout: "avg_session_uptime": 463, 2024-08-18T22:16:55.215 INFO:teuthology.orchestra.run.smithi130.stdout: "mdthresh_evicted": 0 2024-08-18T22:16:55.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.215 INFO:teuthology.orchestra.run.smithi130.stdout: "mempool": { 2024-08-18T22:16:55.216 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_bytes": 0, 2024-08-18T22:16:55.216 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_items": 0, 2024-08-18T22:16:55.216 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:16:55.216 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:16:55.216 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:16:55.216 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:16:55.216 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:16:55.216 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:16:55.216 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:16:55.217 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:16:55.217 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:16:55.217 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:16:55.217 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:16:55.217 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:16:55.217 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:16:55.217 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_items": 0, 2024-08-18T22:16:55.217 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:16:55.218 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_items": 0, 2024-08-18T22:16:55.218 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:16:55.218 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:16:55.218 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:16:55.218 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:16:55.218 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:16:55.218 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:16:55.219 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:16:55.219 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_items": 0, 2024-08-18T22:16:55.219 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:16:55.219 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:16:55.219 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:16:55.219 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_items": 0, 2024-08-18T22:16:55.219 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_bytes": 0, 2024-08-18T22:16:55.219 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_items": 0, 2024-08-18T22:16:55.220 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:16:55.220 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:16:55.220 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:16:55.220 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:16:55.220 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_bytes": 287542, 2024-08-18T22:16:55.220 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_items": 104, 2024-08-18T22:16:55.220 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_bytes": 0, 2024-08-18T22:16:55.221 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_items": 0, 2024-08-18T22:16:55.221 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_bytes": 0, 2024-08-18T22:16:55.221 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_items": 0, 2024-08-18T22:16:55.221 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:16:55.221 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_items": 0, 2024-08-18T22:16:55.221 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:16:55.221 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_items": 0, 2024-08-18T22:16:55.221 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_bytes": 8856, 2024-08-18T22:16:55.222 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_items": 166, 2024-08-18T22:16:55.222 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:16:55.222 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:16:55.222 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_bytes": 0, 2024-08-18T22:16:55.222 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_items": 0, 2024-08-18T22:16:55.222 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_bytes": 188127, 2024-08-18T22:16:55.222 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_items": 1254, 2024-08-18T22:16:55.222 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_bytes": 0, 2024-08-18T22:16:55.223 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_items": 0, 2024-08-18T22:16:55.223 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_bytes": 0, 2024-08-18T22:16:55.223 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_items": 0 2024-08-18T22:16:55.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.223 INFO:teuthology.orchestra.run.smithi130.stdout: "objecter": { 2024-08-18T22:16:55.223 INFO:teuthology.orchestra.run.smithi130.stdout: "op_active": 0, 2024-08-18T22:16:55.223 INFO:teuthology.orchestra.run.smithi130.stdout: "op_laggy": 0, 2024-08-18T22:16:55.223 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send": 51285, 2024-08-18T22:16:55.223 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send_bytes": 124315169, 2024-08-18T22:16:55.224 INFO:teuthology.orchestra.run.smithi130.stdout: "op_resend": 28, 2024-08-18T22:16:55.224 INFO:teuthology.orchestra.run.smithi130.stdout: "op_reply": 51285, 2024-08-18T22:16:55.224 INFO:teuthology.orchestra.run.smithi130.stdout: "op_latency": { 2024-08-18T22:16:55.224 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 51285, 2024-08-18T22:16:55.224 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 340.366662140, 2024-08-18T22:16:55.224 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.006636768 2024-08-18T22:16:55.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.224 INFO:teuthology.orchestra.run.smithi130.stdout: "op_inflight": 0, 2024-08-18T22:16:55.225 INFO:teuthology.orchestra.run.smithi130.stdout: "oplen_avg": { 2024-08-18T22:16:55.225 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 51285, 2024-08-18T22:16:55.225 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 52342 2024-08-18T22:16:55.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.225 INFO:teuthology.orchestra.run.smithi130.stdout: "op": 51285, 2024-08-18T22:16:55.225 INFO:teuthology.orchestra.run.smithi130.stdout: "op_r": 13877, 2024-08-18T22:16:55.225 INFO:teuthology.orchestra.run.smithi130.stdout: "op_w": 37408, 2024-08-18T22:16:55.225 INFO:teuthology.orchestra.run.smithi130.stdout: "op_rmw": 0, 2024-08-18T22:16:55.226 INFO:teuthology.orchestra.run.smithi130.stdout: "op_pg": 0, 2024-08-18T22:16:55.226 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_stat": 0, 2024-08-18T22:16:55.226 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_create": 10, 2024-08-18T22:16:55.226 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_read": 204, 2024-08-18T22:16:55.226 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_write": 1146, 2024-08-18T22:16:55.226 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writefull": 77, 2024-08-18T22:16:55.226 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writesame": 0, 2024-08-18T22:16:55.226 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_append": 0, 2024-08-18T22:16:55.227 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_zero": 0, 2024-08-18T22:16:55.227 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_truncate": 0, 2024-08-18T22:16:55.227 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_delete": 35330, 2024-08-18T22:16:55.227 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_mapext": 0, 2024-08-18T22:16:55.227 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_sparse_read": 0, 2024-08-18T22:16:55.227 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_clonerange": 0, 2024-08-18T22:16:55.227 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_getxattr": 13485, 2024-08-18T22:16:55.227 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_setxattr": 20, 2024-08-18T22:16:55.228 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_cmpxattr": 0, 2024-08-18T22:16:55.228 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_rmxattr": 0, 2024-08-18T22:16:55.228 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_resetxattrs": 0, 2024-08-18T22:16:55.228 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_call": 0, 2024-08-18T22:16:55.228 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_watch": 0, 2024-08-18T22:16:55.228 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_notify": 0, 2024-08-18T22:16:55.228 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_src_cmpxattr": 0, 2024-08-18T22:16:55.228 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls": 0, 2024-08-18T22:16:55.229 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls_filter": 0, 2024-08-18T22:16:55.229 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_other": 0, 2024-08-18T22:16:55.229 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_active": 0, 2024-08-18T22:16:55.229 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_send": 0, 2024-08-18T22:16:55.229 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_resend": 0, 2024-08-18T22:16:55.229 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_ping": 0, 2024-08-18T22:16:55.229 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_active": 0, 2024-08-18T22:16:55.229 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_send": 0, 2024-08-18T22:16:55.230 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_resend": 0, 2024-08-18T22:16:55.230 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_active": 0, 2024-08-18T22:16:55.230 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_send": 0, 2024-08-18T22:16:55.230 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_resend": 0, 2024-08-18T22:16:55.230 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_active": 0, 2024-08-18T22:16:55.230 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_send": 0, 2024-08-18T22:16:55.230 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_resend": 0, 2024-08-18T22:16:55.230 INFO:teuthology.orchestra.run.smithi130.stdout: "command_active": 0, 2024-08-18T22:16:55.231 INFO:teuthology.orchestra.run.smithi130.stdout: "command_send": 0, 2024-08-18T22:16:55.231 INFO:teuthology.orchestra.run.smithi130.stdout: "command_resend": 0, 2024-08-18T22:16:55.231 INFO:teuthology.orchestra.run.smithi130.stdout: "map_epoch": 96, 2024-08-18T22:16:55.231 INFO:teuthology.orchestra.run.smithi130.stdout: "map_full": 0, 2024-08-18T22:16:55.231 INFO:teuthology.orchestra.run.smithi130.stdout: "map_inc": 8, 2024-08-18T22:16:55.231 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_sessions": 12, 2024-08-18T22:16:55.231 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_open": 12, 2024-08-18T22:16:55.231 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_close": 0, 2024-08-18T22:16:55.232 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_laggy": 0, 2024-08-18T22:16:55.232 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_wr": 1639, 2024-08-18T22:16:55.232 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_rd": 376, 2024-08-18T22:16:55.232 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_del": 55 2024-08-18T22:16:55.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.232 INFO:teuthology.orchestra.run.smithi130.stdout: "oft": { 2024-08-18T22:16:55.232 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_objs": 1, 2024-08-18T22:16:55.232 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_kv_pairs": 0, 2024-08-18T22:16:55.233 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_updates": 0, 2024-08-18T22:16:55.233 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_removes": 0 2024-08-18T22:16:55.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.233 INFO:teuthology.orchestra.run.smithi130.stdout: "osd-slow-ops": { 2024-08-18T22:16:55.233 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_ops_count": 2160 2024-08-18T22:16:55.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.233 INFO:teuthology.orchestra.run.smithi130.stdout: "purge_queue": { 2024-08-18T22:16:55.233 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops": 0, 2024-08-18T22:16:55.234 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops_high_water": 16, 2024-08-18T22:16:55.234 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing": 0, 2024-08-18T22:16:55.234 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_high_water": 8, 2024-08-18T22:16:55.234 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed_ops": 34563, 2024-08-18T22:16:55.234 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed": 17282, 2024-08-18T22:16:55.234 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_item_in_journal": 0 2024-08-18T22:16:55.234 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.234 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:16:55.235 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:16:55.235 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-18T22:16:55.235 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:16:55.235 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 132368, 2024-08-18T22:16:55.235 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 95062432, 2024-08-18T22:16:55.235 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:55.235 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 132368, 2024-08-18T22:16:55.235 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-18T22:16:55.235 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-18T22:16:55.236 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 132368, 2024-08-18T22:16:55.236 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 95062432, 2024-08-18T22:16:55.236 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:16:55.236 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.236 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.236 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.236 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:55.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.237 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_bytes": { 2024-08-18T22:16:55.237 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:16:55.237 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-18T22:16:55.237 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:16:55.237 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-18T22:16:55.237 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-18T22:16:55.237 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:55.238 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-18T22:16:55.238 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 51285, 2024-08-18T22:16:55.238 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 126195891, 2024-08-18T22:16:55.238 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 51285, 2024-08-18T22:16:55.238 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 126195891, 2024-08-18T22:16:55.238 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:16:55.238 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.238 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.239 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.239 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:55.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.239 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_ops": { 2024-08-18T22:16:55.239 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:16:55.239 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 1024, 2024-08-18T22:16:55.239 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:16:55.239 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-18T22:16:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-18T22:16:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-18T22:16:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 51285, 2024-08-18T22:16:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 51285, 2024-08-18T22:16:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 51285, 2024-08-18T22:16:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 51285, 2024-08-18T22:16:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:16:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle": { 2024-08-18T22:16:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:16:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-18T22:16:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:16:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 17282, 2024-08-18T22:16:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 1883730, 2024-08-18T22:16:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 17282, 2024-08-18T22:16:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-18T22:16:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-18T22:16:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 204, 2024-08-18T22:16:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 1883730, 2024-08-18T22:16:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:16:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle-0x55be6d956960": { 2024-08-18T22:16:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:16:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-18T22:16:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:16:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 57957, 2024-08-18T22:16:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 114119763, 2024-08-18T22:16:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 57957, 2024-08-18T22:16:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-18T22:16:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-18T22:16:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 942, 2024-08-18T22:16:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 114119763, 2024-08-18T22:16:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:16:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:55.246 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-08-18T22:16:55.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:55 smithi130 ceph-mon[21698]: pgmap v618: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-08-18T22:16:55.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:55 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:16:55.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:55 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:16:55.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:55 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:16:55.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:55 smithi123 ceph-mon[18462]: pgmap v618: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-08-18T22:16:55.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:55 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:16:55.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:55 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:16:55.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:55 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:16:55.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:55 smithi183 ceph-mon[22097]: pgmap v618: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-08-18T22:16:55.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:55 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:16:55.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:55 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:16:55.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:55 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' 2024-08-18T22:16:56.121 INFO:tasks.check_counter:Daemon mds.b mds.exported=283 2024-08-18T22:16:56.121 INFO:tasks.check_counter:Daemon mds.b mds.imported=170 2024-08-18T22:16:56.121 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=1040 2024-08-18T22:16:56.121 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=3731 2024-08-18T22:16:56.121 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=86 2024-08-18T22:16:56.122 DEBUG:tasks.check_counter:Getting stats from e 2024-08-18T22:16:56.122 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph daemon mds.e perf dump 2024-08-18T22:16:56.388 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.b/config 2024-08-18T22:16:56.921 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-08-18T22:16:56.922 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:16:56.922 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 696, 2024-08-18T22:16:56.922 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 698, 2024-08-18T22:16:56.922 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 42129776, 2024-08-18T22:16:56.922 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 221392, 2024-08-18T22:16:56.922 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 7, 2024-08-18T22:16:56.922 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 3, 2024-08-18T22:16:56.923 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.089151599, 2024-08-18T22:16:56.923 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.021360766, 2024-08-18T22:16:56.923 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.042981063, 2024-08-18T22:16:56.923 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.018300901, 2024-08-18T22:16:56.923 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:56.923 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 696, 2024-08-18T22:16:56.923 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.028112779, 2024-08-18T22:16:56.923 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000040391 2024-08-18T22:16:56.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.924 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:56.924 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.924 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.924 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.924 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-18T22:16:56.924 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 0 2024-08-18T22:16:56.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.925 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:16:56.925 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 552, 2024-08-18T22:16:56.925 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 697, 2024-08-18T22:16:56.925 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 46285801, 2024-08-18T22:16:56.925 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 499647, 2024-08-18T22:16:56.925 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 6, 2024-08-18T22:16:56.925 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 5, 2024-08-18T22:16:56.925 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.083567566, 2024-08-18T22:16:56.925 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.019774110, 2024-08-18T22:16:56.926 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.041637469, 2024-08-18T22:16:56.926 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.016356481, 2024-08-18T22:16:56.926 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:56.926 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 696, 2024-08-18T22:16:56.926 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.030160443, 2024-08-18T22:16:56.926 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000043333 2024-08-18T22:16:56.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.926 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:56.927 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.927 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.927 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.927 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.927 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-08-18T22:16:56.927 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 325696 2024-08-18T22:16:56.927 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.927 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:16:56.927 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 1147, 2024-08-18T22:16:56.928 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 1132, 2024-08-18T22:16:56.928 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 49195219, 2024-08-18T22:16:56.928 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 415978, 2024-08-18T22:16:56.928 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 5, 2024-08-18T22:16:56.928 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 4, 2024-08-18T22:16:56.928 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.152129408, 2024-08-18T22:16:56.928 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.042630775, 2024-08-18T22:16:56.928 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.075952976, 2024-08-18T22:16:56.929 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.030474176, 2024-08-18T22:16:56.929 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:56.929 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1131, 2024-08-18T22:16:56.929 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.058224642, 2024-08-18T22:16:56.929 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000051480 2024-08-18T22:16:56.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.929 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:56.929 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.929 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.930 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.930 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.930 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 543952, 2024-08-18T22:16:56.930 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 122464 2024-08-18T22:16:56.930 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.930 INFO:teuthology.orchestra.run.smithi130.stdout: "cct": { 2024-08-18T22:16:56.930 INFO:teuthology.orchestra.run.smithi130.stdout: "total_workers": 1, 2024-08-18T22:16:56.930 INFO:teuthology.orchestra.run.smithi130.stdout: "unhealthy_workers": 0 2024-08-18T22:16:56.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.931 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-MDSRank": { 2024-08-18T22:16:56.931 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-18T22:16:56.931 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-18T22:16:56.931 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 3515, 2024-08-18T22:16:56.931 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.094021814, 2024-08-18T22:16:56.931 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000026748 2024-08-18T22:16:56.931 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:56.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.932 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-PurgeQueue": { 2024-08-18T22:16:56.932 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-18T22:16:56.932 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-18T22:16:56.932 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.932 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.932 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.932 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:56.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.933 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": { 2024-08-18T22:16:56.933 INFO:teuthology.orchestra.run.smithi130.stdout: "request": 0, 2024-08-18T22:16:56.933 INFO:teuthology.orchestra.run.smithi130.stdout: "reply": 0, 2024-08-18T22:16:56.933 INFO:teuthology.orchestra.run.smithi130.stdout: "reply_latency": { 2024-08-18T22:16:56.933 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.933 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.933 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.934 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_reply": 0, 2024-08-18T22:16:56.934 INFO:teuthology.orchestra.run.smithi130.stdout: "forward": 0, 2024-08-18T22:16:56.934 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_complete": 0, 2024-08-18T22:16:56.934 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_keys": 0, 2024-08-18T22:16:56.934 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_commit": 0, 2024-08-18T22:16:56.934 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_split": 0, 2024-08-18T22:16:56.934 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_merge": 0, 2024-08-18T22:16:56.935 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes": 16524, 2024-08-18T22:16:56.935 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_top": 0, 2024-08-18T22:16:56.935 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_bottom": 16524, 2024-08-18T22:16:56.935 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pin_tail": 0, 2024-08-18T22:16:56.935 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pinned": 16524, 2024-08-18T22:16:56.935 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_expired": 0, 2024-08-18T22:16:56.935 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_with_caps": 0, 2024-08-18T22:16:56.935 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": 0, 2024-08-18T22:16:56.936 INFO:teuthology.orchestra.run.smithi130.stdout: "subtrees": 1, 2024-08-18T22:16:56.936 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse": 0, 2024-08-18T22:16:56.936 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_hit": 0, 2024-08-18T22:16:56.936 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_forward": 0, 2024-08-18T22:16:56.936 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_discover": 0, 2024-08-18T22:16:56.936 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_dir_fetch": 0, 2024-08-18T22:16:56.936 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_remote_ino": 0, 2024-08-18T22:16:56.936 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_lock": 0, 2024-08-18T22:16:56.937 INFO:teuthology.orchestra.run.smithi130.stdout: "load_cent": 0, 2024-08-18T22:16:56.937 INFO:teuthology.orchestra.run.smithi130.stdout: "q": 0, 2024-08-18T22:16:56.937 INFO:teuthology.orchestra.run.smithi130.stdout: "exported": 0, 2024-08-18T22:16:56.937 INFO:teuthology.orchestra.run.smithi130.stdout: "exported_inodes": 0, 2024-08-18T22:16:56.937 INFO:teuthology.orchestra.run.smithi130.stdout: "imported": 0, 2024-08-18T22:16:56.937 INFO:teuthology.orchestra.run.smithi130.stdout: "imported_inodes": 0, 2024-08-18T22:16:56.937 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_dir_fetch": 0, 2024-08-18T22:16:56.937 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_backtrace_fetch": 0, 2024-08-18T22:16:56.937 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_peer_discover": 0, 2024-08-18T22:16:56.938 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rfiles": 0, 2024-08-18T22:16:56.938 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rbytes": 0, 2024-08-18T22:16:56.938 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rsnaps": 0, 2024-08-18T22:16:56.938 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_fetch": 0, 2024-08-18T22:16:56.938 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_set_tag": 0, 2024-08-18T22:16:56.938 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_repaired": 0, 2024-08-18T22:16:56.938 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_inotable_repaired": 0, 2024-08-18T22:16:56.938 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_inodes": 0, 2024-08-18T22:16:56.939 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_base_inodes": 0, 2024-08-18T22:16:56.939 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dirfrag_rstats": 0, 2024-08-18T22:16:56.939 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_file_inodes": 0, 2024-08-18T22:16:56.939 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_inode_file_caps": 0, 2024-08-18T22:16:56.939 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_revoke": 0, 2024-08-18T22:16:56.939 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_grant": 0, 2024-08-18T22:16:56.939 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_trunc": 0, 2024-08-18T22:16:56.939 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-18T22:16:56.940 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-18T22:16:56.940 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps": 0, 2024-08-18T22:16:56.940 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps_dirty": 0, 2024-08-18T22:16:56.940 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_cap_release": 0, 2024-08-18T22:16:56.940 INFO:teuthology.orchestra.run.smithi130.stdout: "process_request_cap_release": 0 2024-08-18T22:16:56.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.940 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_cache": { 2024-08-18T22:16:56.940 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update": 0, 2024-08-18T22:16:56.940 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update_receipt": 0, 2024-08-18T22:16:56.941 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_try_discover": 0, 2024-08-18T22:16:56.941 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_send_discover": 0, 2024-08-18T22:16:56.941 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_handle_discover": 0, 2024-08-18T22:16:56.941 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays": 0, 2024-08-18T22:16:56.941 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_delayed": 0, 2024-08-18T22:16:56.941 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_enqueuing": 0, 2024-08-18T22:16:56.941 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_created": 0, 2024-08-18T22:16:56.941 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_enqueued": 0, 2024-08-18T22:16:56.942 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_reintegrated": 0, 2024-08-18T22:16:56.942 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_migrated": 0, 2024-08-18T22:16:56.942 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_processing": 0, 2024-08-18T22:16:56.942 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_enqueued": 0, 2024-08-18T22:16:56.942 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_prioritized": 0, 2024-08-18T22:16:56.942 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_started": 0, 2024-08-18T22:16:56.942 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_completed": 0, 2024-08-18T22:16:56.942 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_path": 0, 2024-08-18T22:16:56.942 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_inode": 0, 2024-08-18T22:16:56.943 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_enqueue_scrub": 0, 2024-08-18T22:16:56.943 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_exportdir": 0, 2024-08-18T22:16:56.943 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_flush": 0, 2024-08-18T22:16:56.943 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragmentdir": 0, 2024-08-18T22:16:56.943 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragstats": 0, 2024-08-18T22:16:56.943 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_inodestats": 0 2024-08-18T22:16:56.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.943 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_log": { 2024-08-18T22:16:56.944 INFO:teuthology.orchestra.run.smithi130.stdout: "evlrg": 0, 2024-08-18T22:16:56.944 INFO:teuthology.orchestra.run.smithi130.stdout: "evadd": 0, 2024-08-18T22:16:56.944 INFO:teuthology.orchestra.run.smithi130.stdout: "evex": 0, 2024-08-18T22:16:56.944 INFO:teuthology.orchestra.run.smithi130.stdout: "evtrm": 0, 2024-08-18T22:16:56.944 INFO:teuthology.orchestra.run.smithi130.stdout: "ev": 62317, 2024-08-18T22:16:56.944 INFO:teuthology.orchestra.run.smithi130.stdout: "evexg": 0, 2024-08-18T22:16:56.944 INFO:teuthology.orchestra.run.smithi130.stdout: "evexd": 0, 2024-08-18T22:16:56.944 INFO:teuthology.orchestra.run.smithi130.stdout: "segadd": 0, 2024-08-18T22:16:56.944 INFO:teuthology.orchestra.run.smithi130.stdout: "segex": 0, 2024-08-18T22:16:56.945 INFO:teuthology.orchestra.run.smithi130.stdout: "segtrm": 0, 2024-08-18T22:16:56.945 INFO:teuthology.orchestra.run.smithi130.stdout: "seg": 80, 2024-08-18T22:16:56.945 INFO:teuthology.orchestra.run.smithi130.stdout: "segmjr": 7, 2024-08-18T22:16:56.945 INFO:teuthology.orchestra.run.smithi130.stdout: "segexg": 0, 2024-08-18T22:16:56.945 INFO:teuthology.orchestra.run.smithi130.stdout: "segexd": 0, 2024-08-18T22:16:56.945 INFO:teuthology.orchestra.run.smithi130.stdout: "expos": 4194304, 2024-08-18T22:16:56.945 INFO:teuthology.orchestra.run.smithi130.stdout: "wrpos": 140631205, 2024-08-18T22:16:56.945 INFO:teuthology.orchestra.run.smithi130.stdout: "rdpos": 140630067, 2024-08-18T22:16:56.945 INFO:teuthology.orchestra.run.smithi130.stdout: "jlat": { 2024-08-18T22:16:56.946 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.946 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.946 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.946 INFO:teuthology.orchestra.run.smithi130.stdout: "replayed": 62317 2024-08-18T22:16:56.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.946 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_mem": { 2024-08-18T22:16:56.946 INFO:teuthology.orchestra.run.smithi130.stdout: "ino": 13, 2024-08-18T22:16:56.947 INFO:teuthology.orchestra.run.smithi130.stdout: "ino+": 18903, 2024-08-18T22:16:56.947 INFO:teuthology.orchestra.run.smithi130.stdout: "ino-": 18890, 2024-08-18T22:16:56.947 INFO:teuthology.orchestra.run.smithi130.stdout: "dir": 11, 2024-08-18T22:16:56.947 INFO:teuthology.orchestra.run.smithi130.stdout: "dir+": 1340, 2024-08-18T22:16:56.947 INFO:teuthology.orchestra.run.smithi130.stdout: "dir-": 1329, 2024-08-18T22:16:56.947 INFO:teuthology.orchestra.run.smithi130.stdout: "dn": 16524, 2024-08-18T22:16:56.947 INFO:teuthology.orchestra.run.smithi130.stdout: "dn+": 38066, 2024-08-18T22:16:56.947 INFO:teuthology.orchestra.run.smithi130.stdout: "dn-": 21542, 2024-08-18T22:16:56.948 INFO:teuthology.orchestra.run.smithi130.stdout: "cap": 0, 2024-08-18T22:16:56.948 INFO:teuthology.orchestra.run.smithi130.stdout: "cap+": 0, 2024-08-18T22:16:56.948 INFO:teuthology.orchestra.run.smithi130.stdout: "cap-": 0, 2024-08-18T22:16:56.948 INFO:teuthology.orchestra.run.smithi130.stdout: "rss": 104040, 2024-08-18T22:16:56.948 INFO:teuthology.orchestra.run.smithi130.stdout: "heap": 215328 2024-08-18T22:16:56.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.948 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_server": { 2024-08-18T22:16:56.948 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_client_request": 0, 2024-08-18T22:16:56.948 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_server_request": 0, 2024-08-18T22:16:56.949 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_request": 0, 2024-08-18T22:16:56.949 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_session": 0, 2024-08-18T22:16:56.949 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_peer_request": 0, 2024-08-18T22:16:56.949 INFO:teuthology.orchestra.run.smithi130.stdout: "req_create_latency": { 2024-08-18T22:16:56.949 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.949 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.949 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.950 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getattr_latency": { 2024-08-18T22:16:56.950 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.950 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.950 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.950 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getfilelock_latency": { 2024-08-18T22:16:56.950 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.950 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.951 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.951 INFO:teuthology.orchestra.run.smithi130.stdout: "req_link_latency": { 2024-08-18T22:16:56.951 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.951 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.951 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.951 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookup_latency": { 2024-08-18T22:16:56.952 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.952 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.952 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.952 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookuphash_latency": { 2024-08-18T22:16:56.952 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.952 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.952 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.953 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupino_latency": { 2024-08-18T22:16:56.953 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.953 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.953 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.953 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupname_latency": { 2024-08-18T22:16:56.953 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.953 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.953 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.954 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupparent_latency": { 2024-08-18T22:16:56.954 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.954 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.954 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.954 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupsnap_latency": { 2024-08-18T22:16:56.954 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.955 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.955 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.955 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lssnap_latency": { 2024-08-18T22:16:56.955 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.955 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.955 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.956 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mkdir_latency": { 2024-08-18T22:16:56.956 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.956 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.956 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.956 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.957 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mknod_latency": { 2024-08-18T22:16:56.957 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.957 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.957 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.957 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.957 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mksnap_latency": { 2024-08-18T22:16:56.957 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.957 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.958 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.958 INFO:teuthology.orchestra.run.smithi130.stdout: "req_open_latency": { 2024-08-18T22:16:56.958 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.958 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.958 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.958 INFO:teuthology.orchestra.run.smithi130.stdout: "req_readdir_latency": { 2024-08-18T22:16:56.958 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.959 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.959 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.959 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rename_latency": { 2024-08-18T22:16:56.959 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.959 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.959 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.960 INFO:teuthology.orchestra.run.smithi130.stdout: "req_renamesnap_latency": { 2024-08-18T22:16:56.960 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.960 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.960 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.960 INFO:teuthology.orchestra.run.smithi130.stdout: "req_snapdiff_latency": { 2024-08-18T22:16:56.960 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.960 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.960 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.961 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmdir_latency": { 2024-08-18T22:16:56.961 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.961 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.961 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.961 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmsnap_latency": { 2024-08-18T22:16:56.961 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.961 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.962 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.962 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.962 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmxattr_latency": { 2024-08-18T22:16:56.962 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.962 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.962 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.962 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.962 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setattr_latency": { 2024-08-18T22:16:56.963 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.963 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.963 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.963 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setdirlayout_latency": { 2024-08-18T22:16:56.963 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.963 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.963 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.964 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setfilelock_latency": { 2024-08-18T22:16:56.964 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.964 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.964 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.964 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setlayout_latency": { 2024-08-18T22:16:56.964 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.964 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.965 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.965 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.965 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setxattr_latency": { 2024-08-18T22:16:56.965 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.965 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.965 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.965 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.965 INFO:teuthology.orchestra.run.smithi130.stdout: "req_symlink_latency": { 2024-08-18T22:16:56.966 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.966 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.966 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.966 INFO:teuthology.orchestra.run.smithi130.stdout: "req_unlink_latency": { 2024-08-18T22:16:56.966 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.966 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.966 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.967 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_revoke_eviction": 0, 2024-08-18T22:16:56.967 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_acquisition_throttle": 0, 2024-08-18T22:16:56.967 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getvxattr_latency": { 2024-08-18T22:16:56.967 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.967 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.967 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.967 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:56.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.968 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_sessions": { 2024-08-18T22:16:56.968 INFO:teuthology.orchestra.run.smithi130.stdout: "session_count": 1, 2024-08-18T22:16:56.968 INFO:teuthology.orchestra.run.smithi130.stdout: "session_add": 2, 2024-08-18T22:16:56.968 INFO:teuthology.orchestra.run.smithi130.stdout: "session_remove": 1, 2024-08-18T22:16:56.968 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_open": 1, 2024-08-18T22:16:56.968 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_stale": 0, 2024-08-18T22:16:56.968 INFO:teuthology.orchestra.run.smithi130.stdout: "total_load": 0, 2024-08-18T22:16:56.968 INFO:teuthology.orchestra.run.smithi130.stdout: "average_load": 0, 2024-08-18T22:16:56.968 INFO:teuthology.orchestra.run.smithi130.stdout: "avg_session_uptime": 1458, 2024-08-18T22:16:56.969 INFO:teuthology.orchestra.run.smithi130.stdout: "mdthresh_evicted": 0 2024-08-18T22:16:56.969 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.969 INFO:teuthology.orchestra.run.smithi130.stdout: "mempool": { 2024-08-18T22:16:56.969 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_bytes": 0, 2024-08-18T22:16:56.969 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_items": 0, 2024-08-18T22:16:56.969 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:16:56.969 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:16:56.969 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:16:56.970 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:16:56.970 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:16:56.970 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:16:56.970 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:16:56.970 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:16:56.970 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:16:56.970 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:16:56.970 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:16:56.971 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:16:56.971 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:16:56.971 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_items": 0, 2024-08-18T22:16:56.971 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:16:56.971 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_items": 0, 2024-08-18T22:16:56.971 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:16:56.971 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:16:56.971 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:16:56.972 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:16:56.972 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:16:56.972 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:16:56.972 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:16:56.972 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_items": 0, 2024-08-18T22:16:56.972 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:16:56.972 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:16:56.972 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:16:56.972 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_items": 0, 2024-08-18T22:16:56.972 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_bytes": 0, 2024-08-18T22:16:56.973 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_items": 0, 2024-08-18T22:16:56.973 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:16:56.973 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:16:56.973 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:16:56.973 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:16:56.973 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_bytes": 222487, 2024-08-18T22:16:56.973 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_items": 68, 2024-08-18T22:16:56.973 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_bytes": 0, 2024-08-18T22:16:56.974 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_items": 0, 2024-08-18T22:16:56.974 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_bytes": 0, 2024-08-18T22:16:56.974 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_items": 0, 2024-08-18T22:16:56.974 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:16:56.974 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_items": 0, 2024-08-18T22:16:56.974 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:16:56.974 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_items": 0, 2024-08-18T22:16:56.974 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_bytes": 8856, 2024-08-18T22:16:56.975 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_items": 166, 2024-08-18T22:16:56.975 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:16:56.975 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:16:56.975 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_bytes": 0, 2024-08-18T22:16:56.975 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_items": 0, 2024-08-18T22:16:56.975 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_bytes": 11676488, 2024-08-18T22:16:56.975 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_items": 66224, 2024-08-18T22:16:56.975 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_bytes": 0, 2024-08-18T22:16:56.976 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_items": 0, 2024-08-18T22:16:56.976 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_bytes": 0, 2024-08-18T22:16:56.976 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_items": 0 2024-08-18T22:16:56.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.976 INFO:teuthology.orchestra.run.smithi130.stdout: "objecter": { 2024-08-18T22:16:56.976 INFO:teuthology.orchestra.run.smithi130.stdout: "op_active": 0, 2024-08-18T22:16:56.976 INFO:teuthology.orchestra.run.smithi130.stdout: "op_laggy": 0, 2024-08-18T22:16:56.976 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send": 2166, 2024-08-18T22:16:56.977 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send_bytes": 21, 2024-08-18T22:16:56.977 INFO:teuthology.orchestra.run.smithi130.stdout: "op_resend": 3, 2024-08-18T22:16:56.977 INFO:teuthology.orchestra.run.smithi130.stdout: "op_reply": 2166, 2024-08-18T22:16:56.977 INFO:teuthology.orchestra.run.smithi130.stdout: "op_latency": { 2024-08-18T22:16:56.977 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 2166, 2024-08-18T22:16:56.977 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 5.048906005, 2024-08-18T22:16:56.977 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.002330981 2024-08-18T22:16:56.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.978 INFO:teuthology.orchestra.run.smithi130.stdout: "op_inflight": 0, 2024-08-18T22:16:56.978 INFO:teuthology.orchestra.run.smithi130.stdout: "oplen_avg": { 2024-08-18T22:16:56.978 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 2166, 2024-08-18T22:16:56.978 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 2167 2024-08-18T22:16:56.978 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.979 INFO:teuthology.orchestra.run.smithi130.stdout: "op": 2166, 2024-08-18T22:16:56.979 INFO:teuthology.orchestra.run.smithi130.stdout: "op_r": 2166, 2024-08-18T22:16:56.979 INFO:teuthology.orchestra.run.smithi130.stdout: "op_w": 0, 2024-08-18T22:16:56.979 INFO:teuthology.orchestra.run.smithi130.stdout: "op_rmw": 0, 2024-08-18T22:16:56.979 INFO:teuthology.orchestra.run.smithi130.stdout: "op_pg": 0, 2024-08-18T22:16:56.979 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_stat": 1359, 2024-08-18T22:16:56.979 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_create": 0, 2024-08-18T22:16:56.979 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_read": 805, 2024-08-18T22:16:56.979 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_write": 0, 2024-08-18T22:16:56.980 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writefull": 0, 2024-08-18T22:16:56.980 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writesame": 0, 2024-08-18T22:16:56.980 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_append": 0, 2024-08-18T22:16:56.980 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_zero": 0, 2024-08-18T22:16:56.980 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_truncate": 0, 2024-08-18T22:16:56.980 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_delete": 0, 2024-08-18T22:16:56.980 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_mapext": 0, 2024-08-18T22:16:56.980 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_sparse_read": 0, 2024-08-18T22:16:56.981 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_clonerange": 0, 2024-08-18T22:16:56.981 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_getxattr": 1, 2024-08-18T22:16:56.981 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_setxattr": 0, 2024-08-18T22:16:56.981 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_cmpxattr": 0, 2024-08-18T22:16:56.981 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_rmxattr": 0, 2024-08-18T22:16:56.981 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_resetxattrs": 0, 2024-08-18T22:16:56.981 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_call": 0, 2024-08-18T22:16:56.981 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_watch": 0, 2024-08-18T22:16:56.981 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_notify": 0, 2024-08-18T22:16:56.982 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_src_cmpxattr": 0, 2024-08-18T22:16:56.982 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls": 0, 2024-08-18T22:16:56.982 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls_filter": 0, 2024-08-18T22:16:56.982 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_other": 0, 2024-08-18T22:16:56.982 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_active": 0, 2024-08-18T22:16:56.982 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_send": 0, 2024-08-18T22:16:56.982 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_resend": 0, 2024-08-18T22:16:56.982 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_ping": 0, 2024-08-18T22:16:56.983 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_active": 0, 2024-08-18T22:16:56.983 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_send": 0, 2024-08-18T22:16:56.983 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_resend": 0, 2024-08-18T22:16:56.983 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_active": 0, 2024-08-18T22:16:56.983 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_send": 0, 2024-08-18T22:16:56.983 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_resend": 0, 2024-08-18T22:16:56.983 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_active": 0, 2024-08-18T22:16:56.983 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_send": 0, 2024-08-18T22:16:56.983 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_resend": 0, 2024-08-18T22:16:56.984 INFO:teuthology.orchestra.run.smithi130.stdout: "command_active": 0, 2024-08-18T22:16:56.984 INFO:teuthology.orchestra.run.smithi130.stdout: "command_send": 0, 2024-08-18T22:16:56.984 INFO:teuthology.orchestra.run.smithi130.stdout: "command_resend": 0, 2024-08-18T22:16:56.984 INFO:teuthology.orchestra.run.smithi130.stdout: "map_epoch": 96, 2024-08-18T22:16:56.984 INFO:teuthology.orchestra.run.smithi130.stdout: "map_full": 0, 2024-08-18T22:16:56.984 INFO:teuthology.orchestra.run.smithi130.stdout: "map_inc": 8, 2024-08-18T22:16:56.984 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_sessions": 9, 2024-08-18T22:16:56.984 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_open": 9, 2024-08-18T22:16:56.985 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_close": 0, 2024-08-18T22:16:56.985 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_laggy": 0, 2024-08-18T22:16:56.985 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_wr": 0, 2024-08-18T22:16:56.985 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_rd": 2, 2024-08-18T22:16:56.985 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_del": 0 2024-08-18T22:16:56.985 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.985 INFO:teuthology.orchestra.run.smithi130.stdout: "oft": { 2024-08-18T22:16:56.985 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_objs": 0, 2024-08-18T22:16:56.985 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_kv_pairs": 0, 2024-08-18T22:16:56.986 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_updates": 0, 2024-08-18T22:16:56.986 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_removes": 0 2024-08-18T22:16:56.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.986 INFO:teuthology.orchestra.run.smithi130.stdout: "osd-slow-ops": { 2024-08-18T22:16:56.986 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_ops_count": 0 2024-08-18T22:16:56.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.986 INFO:teuthology.orchestra.run.smithi130.stdout: "purge_queue": { 2024-08-18T22:16:56.986 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops": 0, 2024-08-18T22:16:56.987 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops_high_water": 0, 2024-08-18T22:16:56.987 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing": 0, 2024-08-18T22:16:56.987 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_high_water": 0, 2024-08-18T22:16:56.987 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed_ops": 0, 2024-08-18T22:16:56.987 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed": 0, 2024-08-18T22:16:56.987 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_item_in_journal": 0 2024-08-18T22:16:56.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.987 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:16:56.987 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:16:56.988 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-18T22:16:56.988 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:16:56.988 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 2391, 2024-08-18T22:16:56.988 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 137381148, 2024-08-18T22:16:56.988 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:56.988 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 2391, 2024-08-18T22:16:56.988 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-18T22:16:56.988 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-18T22:16:56.989 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 2391, 2024-08-18T22:16:56.989 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 137381148, 2024-08-18T22:16:56.989 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:16:56.989 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.989 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.989 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.989 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:56.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.990 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_bytes": { 2024-08-18T22:16:56.990 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:16:56.990 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-18T22:16:56.990 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:16:56.990 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-18T22:16:56.990 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-18T22:16:56.990 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:56.990 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-18T22:16:56.991 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 2166, 2024-08-18T22:16:56.991 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 136457730, 2024-08-18T22:16:56.991 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 2166, 2024-08-18T22:16:56.991 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 136457730, 2024-08-18T22:16:56.991 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:16:56.991 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.991 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.991 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.992 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:56.992 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.992 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_ops": { 2024-08-18T22:16:56.992 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:16:56.992 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 1024, 2024-08-18T22:16:56.992 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:16:56.992 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-18T22:16:56.992 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-18T22:16:56.992 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:56.993 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-18T22:16:56.993 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 2166, 2024-08-18T22:16:56.993 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 2166, 2024-08-18T22:16:56.993 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 2166, 2024-08-18T22:16:56.993 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 2166, 2024-08-18T22:16:56.993 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:16:56.993 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.993 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.994 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.994 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:56.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.994 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle": { 2024-08-18T22:16:56.994 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:16:56.994 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-18T22:16:56.994 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:16:56.994 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-18T22:16:56.995 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-18T22:16:56.995 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:56.995 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-18T22:16:56.995 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-18T22:16:56.995 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-18T22:16:56.995 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 0, 2024-08-18T22:16:56.995 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 0, 2024-08-18T22:16:56.995 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:16:56.996 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.996 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.996 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.996 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:56.996 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:56.996 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle-0x55a4d73c8b40": { 2024-08-18T22:16:56.996 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:16:56.996 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-18T22:16:56.997 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:16:56.997 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-18T22:16:56.997 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-18T22:16:56.997 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:56.997 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-18T22:16:56.997 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-18T22:16:56.997 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-18T22:16:56.997 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 0, 2024-08-18T22:16:56.997 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 0, 2024-08-18T22:16:56.998 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:16:56.998 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:56.998 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:56.998 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:56.998 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:56.998 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:56.998 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-08-18T22:16:57.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:57 smithi123 ceph-mon[18462]: pgmap v619: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-18T22:16:57.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:57 smithi130 ceph-mon[21698]: pgmap v619: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-18T22:16:57.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:57 smithi183 ceph-mon[22097]: pgmap v619: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-18T22:16:57.697 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-08-18T22:16:57.697 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-08-18T22:16:57.697 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-08-18T22:16:57.697 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-08-18T22:16:57.698 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-08-18T22:16:57.698 DEBUG:tasks.check_counter:Getting stats from h 2024-08-18T22:16:57.698 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph daemon mds.h perf dump 2024-08-18T22:16:57.949 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.b/config 2024-08-18T22:16:58.491 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-08-18T22:16:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:16:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 932, 2024-08-18T22:16:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 917, 2024-08-18T22:16:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 17566807, 2024-08-18T22:16:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 346946, 2024-08-18T22:16:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 7, 2024-08-18T22:16:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 3, 2024-08-18T22:16:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.111126517, 2024-08-18T22:16:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.040463725, 2024-08-18T22:16:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.048034797, 2024-08-18T22:16:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.019475881, 2024-08-18T22:16:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 916, 2024-08-18T22:16:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.051089910, 2024-08-18T22:16:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000055775 2024-08-18T22:16:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 542512, 2024-08-18T22:16:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 120848 2024-08-18T22:16:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:16:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 245, 2024-08-18T22:16:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 389, 2024-08-18T22:16:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 38690989, 2024-08-18T22:16:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 403518, 2024-08-18T22:16:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 7, 2024-08-18T22:16:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 6, 2024-08-18T22:16:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.049294817, 2024-08-18T22:16:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.011340035, 2024-08-18T22:16:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.029754163, 2024-08-18T22:16:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.005308468, 2024-08-18T22:16:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 388, 2024-08-18T22:16:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.020971861, 2024-08-18T22:16:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000054051 2024-08-18T22:16:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-08-18T22:16:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 327136 2024-08-18T22:16:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:16:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 1189, 2024-08-18T22:16:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 1191, 2024-08-18T22:16:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 59026556, 2024-08-18T22:16:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 378109, 2024-08-18T22:16:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 6, 2024-08-18T22:16:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 5, 2024-08-18T22:16:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.107255987, 2024-08-18T22:16:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.019821627, 2024-08-18T22:16:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.053827809, 2024-08-18T22:16:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.028095616, 2024-08-18T22:16:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:16:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1189, 2024-08-18T22:16:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.032926655, 2024-08-18T22:16:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000027692 2024-08-18T22:16:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:16:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-18T22:16:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 0 2024-08-18T22:16:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: "cct": { 2024-08-18T22:16:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: "total_workers": 1, 2024-08-18T22:16:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: "unhealthy_workers": 0 2024-08-18T22:16:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-MDSRank": { 2024-08-18T22:16:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-18T22:16:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-18T22:16:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 3526, 2024-08-18T22:16:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.079735445, 2024-08-18T22:16:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000022613 2024-08-18T22:16:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-PurgeQueue": { 2024-08-18T22:16:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-18T22:16:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-18T22:16:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": { 2024-08-18T22:16:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: "request": 0, 2024-08-18T22:16:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: "reply": 0, 2024-08-18T22:16:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: "reply_latency": { 2024-08-18T22:16:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_reply": 0, 2024-08-18T22:16:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "forward": 0, 2024-08-18T22:16:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_complete": 0, 2024-08-18T22:16:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_keys": 0, 2024-08-18T22:16:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_commit": 0, 2024-08-18T22:16:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_split": 0, 2024-08-18T22:16:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_merge": 0, 2024-08-18T22:16:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes": 27217, 2024-08-18T22:16:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_top": 5109, 2024-08-18T22:16:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_bottom": 22108, 2024-08-18T22:16:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pin_tail": 0, 2024-08-18T22:16:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pinned": 19918, 2024-08-18T22:16:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_expired": 0, 2024-08-18T22:16:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_with_caps": 0, 2024-08-18T22:16:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": 0, 2024-08-18T22:16:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: "subtrees": 1, 2024-08-18T22:16:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse": 0, 2024-08-18T22:16:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_hit": 0, 2024-08-18T22:16:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_forward": 0, 2024-08-18T22:16:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_discover": 0, 2024-08-18T22:16:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_dir_fetch": 0, 2024-08-18T22:16:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_remote_ino": 0, 2024-08-18T22:16:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_lock": 0, 2024-08-18T22:16:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "load_cent": 0, 2024-08-18T22:16:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "q": 0, 2024-08-18T22:16:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "exported": 0, 2024-08-18T22:16:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "exported_inodes": 0, 2024-08-18T22:16:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "imported": 0, 2024-08-18T22:16:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "imported_inodes": 0, 2024-08-18T22:16:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_dir_fetch": 0, 2024-08-18T22:16:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_backtrace_fetch": 0, 2024-08-18T22:16:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_peer_discover": 0, 2024-08-18T22:16:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rfiles": 0, 2024-08-18T22:16:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rbytes": 0, 2024-08-18T22:16:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rsnaps": 0, 2024-08-18T22:16:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_fetch": 0, 2024-08-18T22:16:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_set_tag": 0, 2024-08-18T22:16:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_repaired": 0, 2024-08-18T22:16:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_inotable_repaired": 0, 2024-08-18T22:16:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_inodes": 0, 2024-08-18T22:16:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_base_inodes": 0, 2024-08-18T22:16:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dirfrag_rstats": 0, 2024-08-18T22:16:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_file_inodes": 0, 2024-08-18T22:16:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_inode_file_caps": 0, 2024-08-18T22:16:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_revoke": 0, 2024-08-18T22:16:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_grant": 0, 2024-08-18T22:16:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_trunc": 0, 2024-08-18T22:16:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-18T22:16:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-18T22:16:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps": 0, 2024-08-18T22:16:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps_dirty": 0, 2024-08-18T22:16:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_cap_release": 0, 2024-08-18T22:16:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "process_request_cap_release": 0 2024-08-18T22:16:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_cache": { 2024-08-18T22:16:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update": 0, 2024-08-18T22:16:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update_receipt": 0, 2024-08-18T22:16:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_try_discover": 0, 2024-08-18T22:16:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_send_discover": 0, 2024-08-18T22:16:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_handle_discover": 0, 2024-08-18T22:16:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays": 0, 2024-08-18T22:16:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_delayed": 0, 2024-08-18T22:16:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_enqueuing": 0, 2024-08-18T22:16:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_created": 0, 2024-08-18T22:16:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_enqueued": 0, 2024-08-18T22:16:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_reintegrated": 0, 2024-08-18T22:16:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_migrated": 0, 2024-08-18T22:16:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_processing": 0, 2024-08-18T22:16:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_enqueued": 0, 2024-08-18T22:16:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_prioritized": 0, 2024-08-18T22:16:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_started": 0, 2024-08-18T22:16:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_completed": 0, 2024-08-18T22:16:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_path": 0, 2024-08-18T22:16:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_inode": 0, 2024-08-18T22:16:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_enqueue_scrub": 0, 2024-08-18T22:16:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_exportdir": 0, 2024-08-18T22:16:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_flush": 0, 2024-08-18T22:16:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragmentdir": 0, 2024-08-18T22:16:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragstats": 0, 2024-08-18T22:16:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_inodestats": 0 2024-08-18T22:16:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_log": { 2024-08-18T22:16:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: "evlrg": 0, 2024-08-18T22:16:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "evadd": 0, 2024-08-18T22:16:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "evex": 0, 2024-08-18T22:16:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "evtrm": 0, 2024-08-18T22:16:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "ev": 57957, 2024-08-18T22:16:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "evexg": 0, 2024-08-18T22:16:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "evexd": 0, 2024-08-18T22:16:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "segadd": 0, 2024-08-18T22:16:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "segex": 0, 2024-08-18T22:16:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "segtrm": 0, 2024-08-18T22:16:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "seg": 76, 2024-08-18T22:16:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "segmjr": 6, 2024-08-18T22:16:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "segexg": 0, 2024-08-18T22:16:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "segexd": 0, 2024-08-18T22:16:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "expos": 4194304, 2024-08-18T22:16:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "wrpos": 118314067, 2024-08-18T22:16:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "rdpos": 118312929, 2024-08-18T22:16:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "jlat": { 2024-08-18T22:16:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: "replayed": 57957 2024-08-18T22:16:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_mem": { 2024-08-18T22:16:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: "ino": 14, 2024-08-18T22:16:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: "ino+": 17356, 2024-08-18T22:16:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "ino-": 17342, 2024-08-18T22:16:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "dir": 59, 2024-08-18T22:16:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "dir+": 1110, 2024-08-18T22:16:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "dir-": 1051, 2024-08-18T22:16:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "dn": 27217, 2024-08-18T22:16:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "dn+": 50704, 2024-08-18T22:16:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "dn-": 23487, 2024-08-18T22:16:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "cap": 0, 2024-08-18T22:16:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "cap+": 0, 2024-08-18T22:16:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "cap-": 0, 2024-08-18T22:16:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "rss": 97540, 2024-08-18T22:16:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "heap": 215328 2024-08-18T22:16:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_server": { 2024-08-18T22:16:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_client_request": 0, 2024-08-18T22:16:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_server_request": 0, 2024-08-18T22:16:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_request": 0, 2024-08-18T22:16:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_session": 0, 2024-08-18T22:16:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_peer_request": 0, 2024-08-18T22:16:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: "req_create_latency": { 2024-08-18T22:16:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getattr_latency": { 2024-08-18T22:16:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getfilelock_latency": { 2024-08-18T22:16:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.522 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.522 INFO:teuthology.orchestra.run.smithi130.stdout: "req_link_latency": { 2024-08-18T22:16:58.522 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.522 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.522 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.522 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookup_latency": { 2024-08-18T22:16:58.523 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.523 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.523 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.523 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookuphash_latency": { 2024-08-18T22:16:58.523 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.523 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.523 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.524 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupino_latency": { 2024-08-18T22:16:58.524 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.524 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.524 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.524 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupname_latency": { 2024-08-18T22:16:58.525 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.525 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.525 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.525 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupparent_latency": { 2024-08-18T22:16:58.525 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.525 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.525 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.526 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupsnap_latency": { 2024-08-18T22:16:58.526 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.526 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.526 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.526 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lssnap_latency": { 2024-08-18T22:16:58.526 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.526 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.527 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.527 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mkdir_latency": { 2024-08-18T22:16:58.528 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.528 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.528 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.528 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mknod_latency": { 2024-08-18T22:16:58.528 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.528 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.528 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.529 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mksnap_latency": { 2024-08-18T22:16:58.529 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.529 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.529 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.529 INFO:teuthology.orchestra.run.smithi130.stdout: "req_open_latency": { 2024-08-18T22:16:58.529 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.530 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.530 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.530 INFO:teuthology.orchestra.run.smithi130.stdout: "req_readdir_latency": { 2024-08-18T22:16:58.530 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.530 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.530 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.531 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rename_latency": { 2024-08-18T22:16:58.531 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.531 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.531 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.531 INFO:teuthology.orchestra.run.smithi130.stdout: "req_renamesnap_latency": { 2024-08-18T22:16:58.531 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.531 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.531 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.532 INFO:teuthology.orchestra.run.smithi130.stdout: "req_snapdiff_latency": { 2024-08-18T22:16:58.532 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.532 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.532 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.533 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmdir_latency": { 2024-08-18T22:16:58.533 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.533 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.533 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.533 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmsnap_latency": { 2024-08-18T22:16:58.533 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.533 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.534 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.534 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmxattr_latency": { 2024-08-18T22:16:58.534 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.534 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.534 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.534 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setattr_latency": { 2024-08-18T22:16:58.535 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.535 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.535 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.535 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setdirlayout_latency": { 2024-08-18T22:16:58.535 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.535 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.535 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.536 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setfilelock_latency": { 2024-08-18T22:16:58.536 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.536 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.536 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.536 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setlayout_latency": { 2024-08-18T22:16:58.536 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.536 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.537 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.537 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setxattr_latency": { 2024-08-18T22:16:58.537 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.537 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.537 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.537 INFO:teuthology.orchestra.run.smithi130.stdout: "req_symlink_latency": { 2024-08-18T22:16:58.538 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.538 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.538 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.538 INFO:teuthology.orchestra.run.smithi130.stdout: "req_unlink_latency": { 2024-08-18T22:16:58.538 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.538 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.538 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.539 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_revoke_eviction": 0, 2024-08-18T22:16:58.539 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_acquisition_throttle": 0, 2024-08-18T22:16:58.539 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getvxattr_latency": { 2024-08-18T22:16:58.539 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.539 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.539 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.539 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:58.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.540 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_sessions": { 2024-08-18T22:16:58.540 INFO:teuthology.orchestra.run.smithi130.stdout: "session_count": 1, 2024-08-18T22:16:58.540 INFO:teuthology.orchestra.run.smithi130.stdout: "session_add": 2, 2024-08-18T22:16:58.540 INFO:teuthology.orchestra.run.smithi130.stdout: "session_remove": 1, 2024-08-18T22:16:58.540 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_open": 1, 2024-08-18T22:16:58.540 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_stale": 0, 2024-08-18T22:16:58.540 INFO:teuthology.orchestra.run.smithi130.stdout: "total_load": 0, 2024-08-18T22:16:58.540 INFO:teuthology.orchestra.run.smithi130.stdout: "average_load": 0, 2024-08-18T22:16:58.541 INFO:teuthology.orchestra.run.smithi130.stdout: "avg_session_uptime": 1456, 2024-08-18T22:16:58.541 INFO:teuthology.orchestra.run.smithi130.stdout: "mdthresh_evicted": 0 2024-08-18T22:16:58.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.541 INFO:teuthology.orchestra.run.smithi130.stdout: "mempool": { 2024-08-18T22:16:58.541 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_bytes": 0, 2024-08-18T22:16:58.541 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_items": 0, 2024-08-18T22:16:58.541 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:16:58.541 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:16:58.542 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:16:58.542 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:16:58.542 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:16:58.542 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:16:58.542 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:16:58.542 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:16:58.542 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:16:58.542 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:16:58.543 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:16:58.543 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:16:58.543 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:16:58.543 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_items": 0, 2024-08-18T22:16:58.543 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:16:58.546 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_items": 0, 2024-08-18T22:16:58.546 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:16:58.546 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:16:58.546 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:16:58.546 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:16:58.546 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:16:58.547 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:16:58.547 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:16:58.547 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_items": 0, 2024-08-18T22:16:58.547 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:16:58.547 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:16:58.547 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:16:58.547 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_items": 0, 2024-08-18T22:16:58.547 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_bytes": 0, 2024-08-18T22:16:58.548 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_items": 0, 2024-08-18T22:16:58.548 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:16:58.548 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:16:58.548 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:16:58.548 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:16:58.548 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_bytes": 238662, 2024-08-18T22:16:58.548 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_items": 77, 2024-08-18T22:16:58.548 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_bytes": 0, 2024-08-18T22:16:58.549 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_items": 0, 2024-08-18T22:16:58.549 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_bytes": 0, 2024-08-18T22:16:58.549 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_items": 0, 2024-08-18T22:16:58.549 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:16:58.549 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_items": 0, 2024-08-18T22:16:58.549 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:16:58.549 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_items": 0, 2024-08-18T22:16:58.549 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_bytes": 8856, 2024-08-18T22:16:58.550 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_items": 166, 2024-08-18T22:16:58.550 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:16:58.550 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:16:58.550 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_bytes": 0, 2024-08-18T22:16:58.550 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_items": 0, 2024-08-18T22:16:58.550 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_bytes": 19149096, 2024-08-18T22:16:58.550 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_items": 93653, 2024-08-18T22:16:58.550 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_bytes": 0, 2024-08-18T22:16:58.551 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_items": 0, 2024-08-18T22:16:58.551 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_bytes": 0, 2024-08-18T22:16:58.551 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_items": 0 2024-08-18T22:16:58.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.551 INFO:teuthology.orchestra.run.smithi130.stdout: "objecter": { 2024-08-18T22:16:58.551 INFO:teuthology.orchestra.run.smithi130.stdout: "op_active": 0, 2024-08-18T22:16:58.551 INFO:teuthology.orchestra.run.smithi130.stdout: "op_laggy": 0, 2024-08-18T22:16:58.551 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send": 2140, 2024-08-18T22:16:58.551 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send_bytes": 21, 2024-08-18T22:16:58.552 INFO:teuthology.orchestra.run.smithi130.stdout: "op_resend": 3, 2024-08-18T22:16:58.552 INFO:teuthology.orchestra.run.smithi130.stdout: "op_reply": 2140, 2024-08-18T22:16:58.552 INFO:teuthology.orchestra.run.smithi130.stdout: "op_latency": { 2024-08-18T22:16:58.552 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 2140, 2024-08-18T22:16:58.552 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 6.971870166, 2024-08-18T22:16:58.552 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.003257883 2024-08-18T22:16:58.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.552 INFO:teuthology.orchestra.run.smithi130.stdout: "op_inflight": 0, 2024-08-18T22:16:58.553 INFO:teuthology.orchestra.run.smithi130.stdout: "oplen_avg": { 2024-08-18T22:16:58.553 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 2140, 2024-08-18T22:16:58.553 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 2141 2024-08-18T22:16:58.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.553 INFO:teuthology.orchestra.run.smithi130.stdout: "op": 2140, 2024-08-18T22:16:58.553 INFO:teuthology.orchestra.run.smithi130.stdout: "op_r": 2140, 2024-08-18T22:16:58.553 INFO:teuthology.orchestra.run.smithi130.stdout: "op_w": 0, 2024-08-18T22:16:58.553 INFO:teuthology.orchestra.run.smithi130.stdout: "op_rmw": 0, 2024-08-18T22:16:58.554 INFO:teuthology.orchestra.run.smithi130.stdout: "op_pg": 0, 2024-08-18T22:16:58.554 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_stat": 1346, 2024-08-18T22:16:58.554 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_create": 0, 2024-08-18T22:16:58.554 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_read": 792, 2024-08-18T22:16:58.554 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_write": 0, 2024-08-18T22:16:58.554 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writefull": 0, 2024-08-18T22:16:58.554 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writesame": 0, 2024-08-18T22:16:58.554 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_append": 0, 2024-08-18T22:16:58.555 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_zero": 0, 2024-08-18T22:16:58.555 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_truncate": 0, 2024-08-18T22:16:58.555 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_delete": 0, 2024-08-18T22:16:58.555 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_mapext": 0, 2024-08-18T22:16:58.555 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_sparse_read": 0, 2024-08-18T22:16:58.555 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_clonerange": 0, 2024-08-18T22:16:58.555 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_getxattr": 1, 2024-08-18T22:16:58.555 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_setxattr": 0, 2024-08-18T22:16:58.556 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_cmpxattr": 0, 2024-08-18T22:16:58.556 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_rmxattr": 0, 2024-08-18T22:16:58.556 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_resetxattrs": 0, 2024-08-18T22:16:58.556 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_call": 0, 2024-08-18T22:16:58.556 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_watch": 0, 2024-08-18T22:16:58.556 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_notify": 0, 2024-08-18T22:16:58.556 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_src_cmpxattr": 0, 2024-08-18T22:16:58.556 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls": 0, 2024-08-18T22:16:58.557 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls_filter": 0, 2024-08-18T22:16:58.557 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_other": 0, 2024-08-18T22:16:58.557 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_active": 0, 2024-08-18T22:16:58.557 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_send": 0, 2024-08-18T22:16:58.557 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_resend": 0, 2024-08-18T22:16:58.557 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_ping": 0, 2024-08-18T22:16:58.557 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_active": 0, 2024-08-18T22:16:58.557 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_send": 0, 2024-08-18T22:16:58.557 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_resend": 0, 2024-08-18T22:16:58.558 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_active": 0, 2024-08-18T22:16:58.558 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_send": 0, 2024-08-18T22:16:58.558 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_resend": 0, 2024-08-18T22:16:58.558 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_active": 0, 2024-08-18T22:16:58.558 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_send": 0, 2024-08-18T22:16:58.558 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_resend": 0, 2024-08-18T22:16:58.558 INFO:teuthology.orchestra.run.smithi130.stdout: "command_active": 0, 2024-08-18T22:16:58.558 INFO:teuthology.orchestra.run.smithi130.stdout: "command_send": 0, 2024-08-18T22:16:58.559 INFO:teuthology.orchestra.run.smithi130.stdout: "command_resend": 0, 2024-08-18T22:16:58.559 INFO:teuthology.orchestra.run.smithi130.stdout: "map_epoch": 96, 2024-08-18T22:16:58.559 INFO:teuthology.orchestra.run.smithi130.stdout: "map_full": 0, 2024-08-18T22:16:58.559 INFO:teuthology.orchestra.run.smithi130.stdout: "map_inc": 8, 2024-08-18T22:16:58.559 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_sessions": 11, 2024-08-18T22:16:58.559 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_open": 11, 2024-08-18T22:16:58.559 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_close": 0, 2024-08-18T22:16:58.559 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_laggy": 0, 2024-08-18T22:16:58.560 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_wr": 0, 2024-08-18T22:16:58.560 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_rd": 2, 2024-08-18T22:16:58.560 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_del": 0 2024-08-18T22:16:58.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.560 INFO:teuthology.orchestra.run.smithi130.stdout: "oft": { 2024-08-18T22:16:58.560 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_objs": 0, 2024-08-18T22:16:58.560 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_kv_pairs": 0, 2024-08-18T22:16:58.560 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_updates": 0, 2024-08-18T22:16:58.561 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_removes": 0 2024-08-18T22:16:58.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.561 INFO:teuthology.orchestra.run.smithi130.stdout: "osd-slow-ops": { 2024-08-18T22:16:58.561 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_ops_count": 0 2024-08-18T22:16:58.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.561 INFO:teuthology.orchestra.run.smithi130.stdout: "purge_queue": { 2024-08-18T22:16:58.561 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops": 0, 2024-08-18T22:16:58.561 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops_high_water": 0, 2024-08-18T22:16:58.561 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing": 0, 2024-08-18T22:16:58.562 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_high_water": 0, 2024-08-18T22:16:58.562 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed_ops": 0, 2024-08-18T22:16:58.562 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed": 0, 2024-08-18T22:16:58.562 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_item_in_journal": 0 2024-08-18T22:16:58.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.562 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:16:58.562 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:16:58.562 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-18T22:16:58.563 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:16:58.563 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 2362, 2024-08-18T22:16:58.563 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 115057457, 2024-08-18T22:16:58.563 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:58.563 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 2362, 2024-08-18T22:16:58.563 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-18T22:16:58.563 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-18T22:16:58.563 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 2362, 2024-08-18T22:16:58.564 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 115057457, 2024-08-18T22:16:58.564 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:16:58.564 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.564 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.564 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.564 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:58.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.564 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_bytes": { 2024-08-18T22:16:58.565 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:16:58.565 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-18T22:16:58.565 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:16:58.565 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-18T22:16:58.565 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-18T22:16:58.565 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:58.565 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-18T22:16:58.565 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 2140, 2024-08-18T22:16:58.566 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 114139352, 2024-08-18T22:16:58.566 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 2140, 2024-08-18T22:16:58.566 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 114139352, 2024-08-18T22:16:58.566 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:16:58.566 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.566 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.566 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.567 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:58.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.567 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_ops": { 2024-08-18T22:16:58.567 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:16:58.567 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 1024, 2024-08-18T22:16:58.567 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:16:58.567 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-18T22:16:58.567 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-18T22:16:58.568 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:58.568 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-18T22:16:58.568 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 2140, 2024-08-18T22:16:58.568 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 2140, 2024-08-18T22:16:58.568 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 2140, 2024-08-18T22:16:58.568 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 2140, 2024-08-18T22:16:58.568 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:16:58.568 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.568 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.569 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.569 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:58.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.569 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle": { 2024-08-18T22:16:58.569 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:16:58.569 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-18T22:16:58.569 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:16:58.569 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-18T22:16:58.570 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-18T22:16:58.570 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:58.570 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-18T22:16:58.570 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-18T22:16:58.570 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-18T22:16:58.570 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 0, 2024-08-18T22:16:58.570 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 0, 2024-08-18T22:16:58.570 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:16:58.571 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.571 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.571 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.571 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:58.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:16:58.571 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle-0x55a1a2582b40": { 2024-08-18T22:16:58.571 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:16:58.571 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-18T22:16:58.571 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:16:58.572 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-18T22:16:58.572 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-18T22:16:58.572 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:16:58.572 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-18T22:16:58.572 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-18T22:16:58.572 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-18T22:16:58.572 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 0, 2024-08-18T22:16:58.572 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 0, 2024-08-18T22:16:58.572 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:16:58.573 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:16:58.573 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:16:58.573 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:16:58.573 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:58.573 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:16:58.573 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-08-18T22:16:59.249 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-08-18T22:16:59.250 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-08-18T22:16:59.250 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-08-18T22:16:59.250 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-08-18T22:16:59.250 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-08-18T22:16:59.250 DEBUG:tasks.check_counter:Getting stats from k 2024-08-18T22:16:59.251 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph daemon mds.k perf dump 2024-08-18T22:16:59.498 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.b/config 2024-08-18T22:16:59.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:16:59 smithi123 ceph-mon[18462]: pgmap v620: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:16:59.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:16:59 smithi130 ceph-mon[21698]: pgmap v620: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:16:59.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:16:59 smithi183 ceph-mon[22097]: pgmap v620: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:17:00.042 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-08-18T22:17:00.042 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:17:00.042 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 4, 2024-08-18T22:17:00.043 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 4, 2024-08-18T22:17:00.043 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 3024, 2024-08-18T22:17:00.043 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 448, 2024-08-18T22:17:00.043 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 4, 2024-08-18T22:17:00.043 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 0, 2024-08-18T22:17:00.043 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.003124355, 2024-08-18T22:17:00.043 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.000039192, 2024-08-18T22:17:00.044 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.002285790, 2024-08-18T22:17:00.044 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:17:00.044 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:17:00.044 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 3, 2024-08-18T22:17:00.045 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.004048857, 2024-08-18T22:17:00.045 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.001349619 2024-08-18T22:17:00.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:17:00.045 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:17:00.045 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:17:00.045 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:17:00.045 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:17:00.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:17:00.046 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-08-18T22:17:00.046 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 448 2024-08-18T22:17:00.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:17:00.046 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:17:00.046 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 202, 2024-08-18T22:17:00.046 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 199, 2024-08-18T22:17:00.047 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 473584, 2024-08-18T22:17:00.047 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 122144, 2024-08-18T22:17:00.047 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 2, 2024-08-18T22:17:00.047 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 1, 2024-08-18T22:17:00.047 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.029385362, 2024-08-18T22:17:00.047 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.013555793, 2024-08-18T22:17:00.047 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.019354569, 2024-08-18T22:17:00.047 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:17:00.047 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:17:00.048 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 198, 2024-08-18T22:17:00.048 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.011224109, 2024-08-18T22:17:00.048 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000056687 2024-08-18T22:17:00.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:17:00.048 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:17:00.048 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:17:00.048 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:17:00.048 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:17:00.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:17:00.049 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 473584, 2024-08-18T22:17:00.049 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 122144 2024-08-18T22:17:00.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:17:00.049 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:17:00.049 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 1, 2024-08-18T22:17:00.049 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 151, 2024-08-18T22:17:00.049 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 160, 2024-08-18T22:17:00.050 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 104800, 2024-08-18T22:17:00.050 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 3, 2024-08-18T22:17:00.050 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 2, 2024-08-18T22:17:00.050 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.010242342, 2024-08-18T22:17:00.050 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.007307788, 2024-08-18T22:17:00.050 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.001090045, 2024-08-18T22:17:00.051 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:17:00.051 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:17:00.051 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 149, 2024-08-18T22:17:00.051 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.009212715, 2024-08-18T22:17:00.051 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000061830 2024-08-18T22:17:00.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:17:00.052 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:17:00.052 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:17:00.052 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:17:00.052 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:17:00.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:17:00.052 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-18T22:17:00.052 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 104800 2024-08-18T22:17:00.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:17:00.052 INFO:teuthology.orchestra.run.smithi130.stdout: "cct": { 2024-08-18T22:17:00.053 INFO:teuthology.orchestra.run.smithi130.stdout: "total_workers": 0, 2024-08-18T22:17:00.053 INFO:teuthology.orchestra.run.smithi130.stdout: "unhealthy_workers": 0 2024-08-18T22:17:00.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:17:00.053 INFO:teuthology.orchestra.run.smithi130.stdout: "mempool": { 2024-08-18T22:17:00.053 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_bytes": 0, 2024-08-18T22:17:00.053 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_items": 0, 2024-08-18T22:17:00.053 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:17:00.053 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:17:00.054 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:17:00.054 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:17:00.054 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:17:00.054 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:17:00.054 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:17:00.054 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:17:00.054 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:17:00.055 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:17:00.055 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:17:00.055 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:17:00.055 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:17:00.055 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_items": 0, 2024-08-18T22:17:00.055 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:17:00.056 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_items": 0, 2024-08-18T22:17:00.056 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:17:00.056 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:17:00.056 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:17:00.057 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:17:00.057 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:17:00.057 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:17:00.057 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:17:00.058 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_items": 0, 2024-08-18T22:17:00.058 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:17:00.058 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:17:00.058 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:17:00.059 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_items": 0, 2024-08-18T22:17:00.059 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_bytes": 0, 2024-08-18T22:17:00.059 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_items": 0, 2024-08-18T22:17:00.060 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:17:00.060 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:17:00.060 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:17:00.060 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:17:00.061 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_bytes": 149998, 2024-08-18T22:17:00.061 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_items": 30, 2024-08-18T22:17:00.061 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_bytes": 0, 2024-08-18T22:17:00.062 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_items": 0, 2024-08-18T22:17:00.062 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_bytes": 0, 2024-08-18T22:17:00.062 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_items": 0, 2024-08-18T22:17:00.062 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:17:00.063 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_items": 0, 2024-08-18T22:17:00.063 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:17:00.063 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_items": 0, 2024-08-18T22:17:00.064 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_bytes": 0, 2024-08-18T22:17:00.064 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_items": 0, 2024-08-18T22:17:00.064 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:17:00.064 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:17:00.065 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_bytes": 0, 2024-08-18T22:17:00.065 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_items": 0, 2024-08-18T22:17:00.065 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_bytes": 928, 2024-08-18T22:17:00.065 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_items": 2, 2024-08-18T22:17:00.065 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_bytes": 0, 2024-08-18T22:17:00.066 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_items": 0, 2024-08-18T22:17:00.066 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_bytes": 0, 2024-08-18T22:17:00.066 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_items": 0 2024-08-18T22:17:00.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-18T22:17:00.067 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:17:00.067 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-18T22:17:00.068 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-18T22:17:00.068 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-18T22:17:00.068 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 203, 2024-08-18T22:17:00.068 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 445060, 2024-08-18T22:17:00.069 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:00.069 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 203, 2024-08-18T22:17:00.069 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-18T22:17:00.069 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-18T22:17:00.070 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 203, 2024-08-18T22:17:00.070 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 445060, 2024-08-18T22:17:00.070 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-18T22:17:00.071 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-18T22:17:00.071 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-18T22:17:00.071 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-18T22:17:00.071 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:17:00.072 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-18T22:17:00.072 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-08-18T22:17:00.741 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-08-18T22:17:00.741 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-08-18T22:17:00.742 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-08-18T22:17:00.742 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-08-18T22:17:00.742 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-08-18T22:17:00.742 DEBUG:tasks.check_counter:Getting stats from c 2024-08-18T22:17:00.742 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph daemon mds.c perf dump 2024-08-18T22:17:01.007 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T22:17:01.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:01 smithi183 ceph-mon[22097]: pgmap v621: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-18T22:17:01.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:01 smithi123 ceph-mon[18462]: pgmap v621: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-18T22:17:01.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:01 smithi130 ceph-mon[21698]: pgmap v621: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-18T22:17:01.558 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-08-18T22:17:01.559 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:17:01.559 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 90604, 2024-08-18T22:17:01.559 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 151231, 2024-08-18T22:17:01.559 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 31061621, 2024-08-18T22:17:01.559 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 146374856, 2024-08-18T22:17:01.560 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 18, 2024-08-18T22:17:01.560 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 6, 2024-08-18T22:17:01.560 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 6.509763905, 2024-08-18T22:17:01.560 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 2.446012592, 2024-08-18T22:17:01.560 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 49.300835678, 2024-08-18T22:17:01.560 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 1.197660052, 2024-08-18T22:17:01.560 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:17:01.560 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 151228, 2024-08-18T22:17:01.561 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 18.491621993, 2024-08-18T22:17:01.561 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000122276 2024-08-18T22:17:01.561 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.561 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:17:01.561 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 173161, 2024-08-18T22:17:01.561 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.038658942, 2024-08-18T22:17:01.561 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000223 2024-08-18T22:17:01.561 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.562 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 3952, 2024-08-18T22:17:01.562 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 1184 2024-08-18T22:17:01.562 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.562 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:17:01.562 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 30880, 2024-08-18T22:17:01.562 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 25302, 2024-08-18T22:17:01.562 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 37022698, 2024-08-18T22:17:01.563 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 80283647, 2024-08-18T22:17:01.563 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 8, 2024-08-18T22:17:01.563 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 5, 2024-08-18T22:17:01.563 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 2.415202458, 2024-08-18T22:17:01.563 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.948106674, 2024-08-18T22:17:01.563 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.896957201, 2024-08-18T22:17:01.563 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.686207280, 2024-08-18T22:17:01.563 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:17:01.564 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 25302, 2024-08-18T22:17:01.564 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 3.660045958, 2024-08-18T22:17:01.564 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000144654 2024-08-18T22:17:01.564 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.564 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:17:01.564 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 24951, 2024-08-18T22:17:01.564 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.004114749, 2024-08-18T22:17:01.564 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000164 2024-08-18T22:17:01.564 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.565 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-18T22:17:01.565 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 327056 2024-08-18T22:17:01.565 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.565 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:17:01.565 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 27943, 2024-08-18T22:17:01.565 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 36330, 2024-08-18T22:17:01.565 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 49528737, 2024-08-18T22:17:01.565 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 58787449, 2024-08-18T22:17:01.566 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 19, 2024-08-18T22:17:01.566 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 7, 2024-08-18T22:17:01.566 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 2.516837669, 2024-08-18T22:17:01.566 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 1.026093740, 2024-08-18T22:17:01.566 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.894894944, 2024-08-18T22:17:01.566 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.628891644, 2024-08-18T22:17:01.566 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:17:01.566 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 36329, 2024-08-18T22:17:01.567 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 4.184405302, 2024-08-18T22:17:01.567 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000115180 2024-08-18T22:17:01.567 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.567 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:17:01.567 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 33139, 2024-08-18T22:17:01.567 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.007519133, 2024-08-18T22:17:01.567 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000226 2024-08-18T22:17:01.567 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.568 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 554400, 2024-08-18T22:17:01.568 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 128928 2024-08-18T22:17:01.568 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.568 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-08-18T22:17:01.568 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 1, 2024-08-18T22:17:01.568 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-08-18T22:17:01.568 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.569 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-MDSRank": { 2024-08-18T22:17:01.569 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-08-18T22:17:01.569 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-08-18T22:17:01.569 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 8148, 2024-08-18T22:17:01.569 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 68.697555164, 2024-08-18T22:17:01.569 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.008431216 2024-08-18T22:17:01.569 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:01.570 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.570 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-PurgeQueue": { 2024-08-18T22:17:01.570 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-08-18T22:17:01.570 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-08-18T22:17:01.570 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 26756, 2024-08-18T22:17:01.570 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 11.352616508, 2024-08-18T22:17:01.570 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000424301 2024-08-18T22:17:01.570 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:01.571 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.571 INFO:teuthology.orchestra.run.smithi183.stdout: "mds": { 2024-08-18T22:17:01.571 INFO:teuthology.orchestra.run.smithi183.stdout: "request": 50583, 2024-08-18T22:17:01.571 INFO:teuthology.orchestra.run.smithi183.stdout: "reply": 45286, 2024-08-18T22:17:01.571 INFO:teuthology.orchestra.run.smithi183.stdout: "reply_latency": { 2024-08-18T22:17:01.571 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 45286, 2024-08-18T22:17:01.571 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 247.156973431, 2024-08-18T22:17:01.571 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.005457690 2024-08-18T22:17:01.572 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.572 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_reply": 0, 2024-08-18T22:17:01.572 INFO:teuthology.orchestra.run.smithi183.stdout: "forward": 5297, 2024-08-18T22:17:01.572 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_complete": 205, 2024-08-18T22:17:01.572 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_keys": 0, 2024-08-18T22:17:01.572 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_commit": 1024, 2024-08-18T22:17:01.572 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_split": 121, 2024-08-18T22:17:01.573 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_merge": 45, 2024-08-18T22:17:01.573 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes": 20, 2024-08-18T22:17:01.573 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_top": 2, 2024-08-18T22:17:01.573 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_bottom": 8, 2024-08-18T22:17:01.573 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pin_tail": 10, 2024-08-18T22:17:01.573 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pinned": 15, 2024-08-18T22:17:01.573 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_expired": 19197, 2024-08-18T22:17:01.573 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_with_caps": 1, 2024-08-18T22:17:01.574 INFO:teuthology.orchestra.run.smithi183.stdout: "caps": 1, 2024-08-18T22:17:01.574 INFO:teuthology.orchestra.run.smithi183.stdout: "subtrees": 4, 2024-08-18T22:17:01.574 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse": 73399, 2024-08-18T22:17:01.574 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_hit": 62835, 2024-08-18T22:17:01.574 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_forward": 5296, 2024-08-18T22:17:01.574 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_discover": 54, 2024-08-18T22:17:01.574 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_dir_fetch": 92, 2024-08-18T22:17:01.574 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_remote_ino": 0, 2024-08-18T22:17:01.575 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_lock": 2, 2024-08-18T22:17:01.575 INFO:teuthology.orchestra.run.smithi183.stdout: "load_cent": 0, 2024-08-18T22:17:01.575 INFO:teuthology.orchestra.run.smithi183.stdout: "q": 0, 2024-08-18T22:17:01.575 INFO:teuthology.orchestra.run.smithi183.stdout: "exported": 99, 2024-08-18T22:17:01.575 INFO:teuthology.orchestra.run.smithi183.stdout: "exported_inodes": 11003, 2024-08-18T22:17:01.575 INFO:teuthology.orchestra.run.smithi183.stdout: "imported": 211, 2024-08-18T22:17:01.575 INFO:teuthology.orchestra.run.smithi183.stdout: "imported_inodes": 9876, 2024-08-18T22:17:01.576 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_dir_fetch": 0, 2024-08-18T22:17:01.576 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_backtrace_fetch": 17443, 2024-08-18T22:17:01.576 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_peer_discover": 0, 2024-08-18T22:17:01.576 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rfiles": 4, 2024-08-18T22:17:01.576 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rbytes": 234, 2024-08-18T22:17:01.576 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rsnaps": 0, 2024-08-18T22:17:01.576 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_fetch": 17443, 2024-08-18T22:17:01.576 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_set_tag": 0, 2024-08-18T22:17:01.576 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_repaired": 0, 2024-08-18T22:17:01.577 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_inotable_repaired": 0, 2024-08-18T22:17:01.577 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_inodes": 2, 2024-08-18T22:17:01.577 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_base_inodes": 0, 2024-08-18T22:17:01.577 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dirfrag_rstats": 2, 2024-08-18T22:17:01.577 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_file_inodes": 17441, 2024-08-18T22:17:01.577 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_inode_file_caps": 10, 2024-08-18T22:17:01.577 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_revoke": 69, 2024-08-18T22:17:01.577 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_grant": 28337, 2024-08-18T22:17:01.578 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_trunc": 0, 2024-08-18T22:17:01.578 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-18T22:17:01.578 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-18T22:17:01.578 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps": 15070, 2024-08-18T22:17:01.578 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps_dirty": 14925, 2024-08-18T22:17:01.578 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_cap_release": 237, 2024-08-18T22:17:01.578 INFO:teuthology.orchestra.run.smithi183.stdout: "process_request_cap_release": 34024 2024-08-18T22:17:01.578 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.579 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_cache": { 2024-08-18T22:17:01.579 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update": 952, 2024-08-18T22:17:01.579 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update_receipt": 2900, 2024-08-18T22:17:01.579 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_try_discover": 1454, 2024-08-18T22:17:01.579 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_send_discover": 1563, 2024-08-18T22:17:01.579 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_handle_discover": 952, 2024-08-18T22:17:01.579 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays": 0, 2024-08-18T22:17:01.579 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_delayed": 0, 2024-08-18T22:17:01.579 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_enqueuing": 0, 2024-08-18T22:17:01.579 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_created": 16514, 2024-08-18T22:17:01.580 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_enqueued": 16514, 2024-08-18T22:17:01.580 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_reintegrated": 0, 2024-08-18T22:17:01.580 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_migrated": 0, 2024-08-18T22:17:01.580 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_processing": 0, 2024-08-18T22:17:01.580 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_enqueued": 0, 2024-08-18T22:17:01.580 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_prioritized": 0, 2024-08-18T22:17:01.580 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_started": 0, 2024-08-18T22:17:01.581 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_completed": 0, 2024-08-18T22:17:01.581 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_path": 7, 2024-08-18T22:17:01.581 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_inode": 11374, 2024-08-18T22:17:01.581 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_enqueue_scrub": 0, 2024-08-18T22:17:01.581 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_exportdir": 140, 2024-08-18T22:17:01.581 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_flush": 0, 2024-08-18T22:17:01.581 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragmentdir": 181, 2024-08-18T22:17:01.582 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragstats": 0, 2024-08-18T22:17:01.582 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_inodestats": 0 2024-08-18T22:17:01.582 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.582 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_log": { 2024-08-18T22:17:01.582 INFO:teuthology.orchestra.run.smithi183.stdout: "evlrg": 1, 2024-08-18T22:17:01.582 INFO:teuthology.orchestra.run.smithi183.stdout: "evadd": 62317, 2024-08-18T22:17:01.582 INFO:teuthology.orchestra.run.smithi183.stdout: "evex": 0, 2024-08-18T22:17:01.582 INFO:teuthology.orchestra.run.smithi183.stdout: "evtrm": 0, 2024-08-18T22:17:01.583 INFO:teuthology.orchestra.run.smithi183.stdout: "ev": 62317, 2024-08-18T22:17:01.583 INFO:teuthology.orchestra.run.smithi183.stdout: "evexg": 0, 2024-08-18T22:17:01.583 INFO:teuthology.orchestra.run.smithi183.stdout: "evexd": 0, 2024-08-18T22:17:01.583 INFO:teuthology.orchestra.run.smithi183.stdout: "segadd": 80, 2024-08-18T22:17:01.583 INFO:teuthology.orchestra.run.smithi183.stdout: "segex": 0, 2024-08-18T22:17:01.583 INFO:teuthology.orchestra.run.smithi183.stdout: "segtrm": 0, 2024-08-18T22:17:01.583 INFO:teuthology.orchestra.run.smithi183.stdout: "seg": 80, 2024-08-18T22:17:01.583 INFO:teuthology.orchestra.run.smithi183.stdout: "segmjr": 7, 2024-08-18T22:17:01.583 INFO:teuthology.orchestra.run.smithi183.stdout: "segexg": 0, 2024-08-18T22:17:01.584 INFO:teuthology.orchestra.run.smithi183.stdout: "segexd": 0, 2024-08-18T22:17:01.584 INFO:teuthology.orchestra.run.smithi183.stdout: "expos": 4194304, 2024-08-18T22:17:01.584 INFO:teuthology.orchestra.run.smithi183.stdout: "wrpos": 140631205, 2024-08-18T22:17:01.584 INFO:teuthology.orchestra.run.smithi183.stdout: "rdpos": 0, 2024-08-18T22:17:01.584 INFO:teuthology.orchestra.run.smithi183.stdout: "jlat": { 2024-08-18T22:17:01.584 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 818, 2024-08-18T22:17:01.584 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 78.691451146, 2024-08-18T22:17:01.584 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.096199818 2024-08-18T22:17:01.585 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.585 INFO:teuthology.orchestra.run.smithi183.stdout: "replayed": 0 2024-08-18T22:17:01.585 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.585 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_mem": { 2024-08-18T22:17:01.585 INFO:teuthology.orchestra.run.smithi183.stdout: "ino": 25, 2024-08-18T22:17:01.585 INFO:teuthology.orchestra.run.smithi183.stdout: "ino+": 19679, 2024-08-18T22:17:01.585 INFO:teuthology.orchestra.run.smithi183.stdout: "ino-": 19654, 2024-08-18T22:17:01.585 INFO:teuthology.orchestra.run.smithi183.stdout: "dir": 23, 2024-08-18T22:17:01.585 INFO:teuthology.orchestra.run.smithi183.stdout: "dir+": 2852, 2024-08-18T22:17:01.586 INFO:teuthology.orchestra.run.smithi183.stdout: "dir-": 2829, 2024-08-18T22:17:01.586 INFO:teuthology.orchestra.run.smithi183.stdout: "dn": 20, 2024-08-18T22:17:01.586 INFO:teuthology.orchestra.run.smithi183.stdout: "dn+": 38902, 2024-08-18T22:17:01.586 INFO:teuthology.orchestra.run.smithi183.stdout: "dn-": 38882, 2024-08-18T22:17:01.586 INFO:teuthology.orchestra.run.smithi183.stdout: "cap": 1, 2024-08-18T22:17:01.586 INFO:teuthology.orchestra.run.smithi183.stdout: "cap+": 30808, 2024-08-18T22:17:01.586 INFO:teuthology.orchestra.run.smithi183.stdout: "cap-": 30807, 2024-08-18T22:17:01.586 INFO:teuthology.orchestra.run.smithi183.stdout: "rss": 164772, 2024-08-18T22:17:01.586 INFO:teuthology.orchestra.run.smithi183.stdout: "heap": 223520 2024-08-18T22:17:01.587 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.587 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_server": { 2024-08-18T22:17:01.587 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_client_request": 57189, 2024-08-18T22:17:01.587 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_server_request": 4256, 2024-08-18T22:17:01.587 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_request": 50583, 2024-08-18T22:17:01.587 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_session": 64, 2024-08-18T22:17:01.587 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_peer_request": 13177, 2024-08-18T22:17:01.587 INFO:teuthology.orchestra.run.smithi183.stdout: "req_create_latency": { 2024-08-18T22:17:01.587 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 11653, 2024-08-18T22:17:01.588 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 39.648120047, 2024-08-18T22:17:01.588 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.003402395 2024-08-18T22:17:01.588 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.588 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getattr_latency": { 2024-08-18T22:17:01.588 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 21, 2024-08-18T22:17:01.588 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.430698451, 2024-08-18T22:17:01.588 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.020509450 2024-08-18T22:17:01.588 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.588 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getfilelock_latency": { 2024-08-18T22:17:01.589 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.589 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.589 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.589 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.589 INFO:teuthology.orchestra.run.smithi183.stdout: "req_link_latency": { 2024-08-18T22:17:01.589 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.589 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.589 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookup_latency": { 2024-08-18T22:17:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 16071, 2024-08-18T22:17:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 39.035163318, 2024-08-18T22:17:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.002428919 2024-08-18T22:17:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookuphash_latency": { 2024-08-18T22:17:01.590 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupino_latency": { 2024-08-18T22:17:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1, 2024-08-18T22:17:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000101132, 2024-08-18T22:17:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000101132 2024-08-18T22:17:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.591 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupname_latency": { 2024-08-18T22:17:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupparent_latency": { 2024-08-18T22:17:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.592 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupsnap_latency": { 2024-08-18T22:17:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.593 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lssnap_latency": { 2024-08-18T22:17:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.594 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mkdir_latency": { 2024-08-18T22:17:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.595 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mknod_latency": { 2024-08-18T22:17:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mksnap_latency": { 2024-08-18T22:17:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.596 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: "req_open_latency": { 2024-08-18T22:17:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: "req_readdir_latency": { 2024-08-18T22:17:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1026, 2024-08-18T22:17:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 17.694649500, 2024-08-18T22:17:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.017246247 2024-08-18T22:17:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rename_latency": { 2024-08-18T22:17:01.598 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: "req_renamesnap_latency": { 2024-08-18T22:17:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.599 INFO:teuthology.orchestra.run.smithi183.stdout: "req_snapdiff_latency": { 2024-08-18T22:17:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmdir_latency": { 2024-08-18T22:17:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1, 2024-08-18T22:17:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.024852055, 2024-08-18T22:17:01.600 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.024852055 2024-08-18T22:17:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmsnap_latency": { 2024-08-18T22:17:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.601 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmxattr_latency": { 2024-08-18T22:17:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setattr_latency": { 2024-08-18T22:17:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.602 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setdirlayout_latency": { 2024-08-18T22:17:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setfilelock_latency": { 2024-08-18T22:17:01.603 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setlayout_latency": { 2024-08-18T22:17:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.604 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setxattr_latency": { 2024-08-18T22:17:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: "req_symlink_latency": { 2024-08-18T22:17:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: "req_unlink_latency": { 2024-08-18T22:17:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 16513, 2024-08-18T22:17:01.606 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 150.323388928, 2024-08-18T22:17:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.009103336 2024-08-18T22:17:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_revoke_eviction": 0, 2024-08-18T22:17:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_acquisition_throttle": 0, 2024-08-18T22:17:01.607 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getvxattr_latency": { 2024-08-18T22:17:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_sessions": { 2024-08-18T22:17:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: "session_count": 1, 2024-08-18T22:17:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: "session_add": 2, 2024-08-18T22:17:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: "session_remove": 1, 2024-08-18T22:17:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_open": 1, 2024-08-18T22:17:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_stale": 0, 2024-08-18T22:17:01.611 INFO:teuthology.orchestra.run.smithi183.stdout: "total_load": 12351, 2024-08-18T22:17:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "average_load": 12351, 2024-08-18T22:17:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "avg_session_uptime": 530, 2024-08-18T22:17:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "mdthresh_evicted": 0 2024-08-18T22:17:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-08-18T22:17:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 0, 2024-08-18T22:17:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 0, 2024-08-18T22:17:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:17:01.612 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:17:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:17:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:17:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:17:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:17:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:17:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:17:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:17:01.613 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:17:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:17:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:17:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:17:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-08-18T22:17:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:17:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-08-18T22:17:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:17:01.614 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:17:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:17:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:17:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:17:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:17:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:17:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-08-18T22:17:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:17:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:17:01.615 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:17:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-08-18T22:17:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-08-18T22:17:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-08-18T22:17:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:17:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:17:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:17:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:17:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 287521, 2024-08-18T22:17:01.616 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 103, 2024-08-18T22:17:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 0, 2024-08-18T22:17:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 0, 2024-08-18T22:17:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-08-18T22:17:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-08-18T22:17:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:17:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-08-18T22:17:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:17:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-08-18T22:17:01.617 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 8856, 2024-08-18T22:17:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 166, 2024-08-18T22:17:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:17:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:17:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-08-18T22:17:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-08-18T22:17:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 101903, 2024-08-18T22:17:01.618 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 547, 2024-08-18T22:17:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-08-18T22:17:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-08-18T22:17:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-08-18T22:17:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-08-18T22:17:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "objecter": { 2024-08-18T22:17:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "op_active": 0, 2024-08-18T22:17:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "op_laggy": 0, 2024-08-18T22:17:01.619 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send": 54333, 2024-08-18T22:17:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send_bytes": 149309626, 2024-08-18T22:17:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: "op_resend": 31, 2024-08-18T22:17:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: "op_reply": 54333, 2024-08-18T22:17:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: "op_latency": { 2024-08-18T22:17:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 54333, 2024-08-18T22:17:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 320.848251714, 2024-08-18T22:17:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.005905218 2024-08-18T22:17:01.620 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: "op_inflight": 0, 2024-08-18T22:17:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: "oplen_avg": { 2024-08-18T22:17:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 54333, 2024-08-18T22:17:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 55722 2024-08-18T22:17:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: "op": 54333, 2024-08-18T22:17:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: "op_r": 17896, 2024-08-18T22:17:01.621 INFO:teuthology.orchestra.run.smithi183.stdout: "op_w": 36437, 2024-08-18T22:17:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: "op_rmw": 0, 2024-08-18T22:17:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: "op_pg": 0, 2024-08-18T22:17:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_stat": 0, 2024-08-18T22:17:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_create": 10, 2024-08-18T22:17:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_read": 248, 2024-08-18T22:17:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_write": 1066, 2024-08-18T22:17:01.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writefull": 98, 2024-08-18T22:17:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writesame": 0, 2024-08-18T22:17:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_append": 0, 2024-08-18T22:17:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_zero": 0, 2024-08-18T22:17:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_truncate": 0, 2024-08-18T22:17:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_delete": 34103, 2024-08-18T22:17:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_mapext": 0, 2024-08-18T22:17:01.623 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_sparse_read": 0, 2024-08-18T22:17:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_clonerange": 0, 2024-08-18T22:17:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_getxattr": 17443, 2024-08-18T22:17:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_setxattr": 20, 2024-08-18T22:17:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_cmpxattr": 0, 2024-08-18T22:17:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_rmxattr": 0, 2024-08-18T22:17:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_resetxattrs": 0, 2024-08-18T22:17:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_call": 0, 2024-08-18T22:17:01.624 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_watch": 0, 2024-08-18T22:17:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_notify": 0, 2024-08-18T22:17:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_src_cmpxattr": 0, 2024-08-18T22:17:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls": 0, 2024-08-18T22:17:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls_filter": 0, 2024-08-18T22:17:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_other": 0, 2024-08-18T22:17:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_active": 0, 2024-08-18T22:17:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_send": 0, 2024-08-18T22:17:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_resend": 0, 2024-08-18T22:17:01.625 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_ping": 0, 2024-08-18T22:17:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_active": 0, 2024-08-18T22:17:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_send": 0, 2024-08-18T22:17:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_resend": 0, 2024-08-18T22:17:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_active": 0, 2024-08-18T22:17:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_send": 0, 2024-08-18T22:17:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_resend": 0, 2024-08-18T22:17:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_active": 0, 2024-08-18T22:17:01.626 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_send": 0, 2024-08-18T22:17:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_resend": 0, 2024-08-18T22:17:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "command_active": 0, 2024-08-18T22:17:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "command_send": 0, 2024-08-18T22:17:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "command_resend": 0, 2024-08-18T22:17:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "map_epoch": 96, 2024-08-18T22:17:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "map_full": 0, 2024-08-18T22:17:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "map_inc": 8, 2024-08-18T22:17:01.627 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_sessions": 12, 2024-08-18T22:17:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_open": 12, 2024-08-18T22:17:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_close": 0, 2024-08-18T22:17:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_laggy": 0, 2024-08-18T22:17:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_wr": 2251, 2024-08-18T22:17:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_rd": 410, 2024-08-18T22:17:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_del": 73 2024-08-18T22:17:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.628 INFO:teuthology.orchestra.run.smithi183.stdout: "oft": { 2024-08-18T22:17:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_objs": 1, 2024-08-18T22:17:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_kv_pairs": 0, 2024-08-18T22:17:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_updates": 0, 2024-08-18T22:17:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_removes": 0 2024-08-18T22:17:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: "osd-slow-ops": { 2024-08-18T22:17:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_ops_count": 11367 2024-08-18T22:17:01.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "purge_queue": { 2024-08-18T22:17:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops": 0, 2024-08-18T22:17:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops_high_water": 44, 2024-08-18T22:17:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing": 0, 2024-08-18T22:17:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_high_water": 8, 2024-08-18T22:17:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed_ops": 33070, 2024-08-18T22:17:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed": 16514, 2024-08-18T22:17:01.630 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_item_in_journal": 0 2024-08-18T22:17:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:17:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-08-18T22:17:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 149423, 2024-08-18T22:17:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 104148793, 2024-08-18T22:17:01.631 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 149423, 2024-08-18T22:17:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-08-18T22:17:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-08-18T22:17:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 149423, 2024-08-18T22:17:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 104148793, 2024-08-18T22:17:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.632 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_bytes": { 2024-08-18T22:17:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-08-18T22:17:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:01.633 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-08-18T22:17:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-08-18T22:17:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-08-18T22:17:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 54333, 2024-08-18T22:17:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 151106476, 2024-08-18T22:17:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 54333, 2024-08-18T22:17:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 151106476, 2024-08-18T22:17:01.634 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_ops": { 2024-08-18T22:17:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:01.635 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 1024, 2024-08-18T22:17:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-08-18T22:17:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-08-18T22:17:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-08-18T22:17:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 54333, 2024-08-18T22:17:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 54333, 2024-08-18T22:17:01.636 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 54333, 2024-08-18T22:17:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 54333, 2024-08-18T22:17:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.637 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle": { 2024-08-18T22:17:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-08-18T22:17:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 16514, 2024-08-18T22:17:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 1800130, 2024-08-18T22:17:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:01.638 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 16514, 2024-08-18T22:17:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-08-18T22:17:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-08-18T22:17:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 248, 2024-08-18T22:17:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 1800130, 2024-08-18T22:17:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.639 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle-0x55eb46b6c960": { 2024-08-18T22:17:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-08-18T22:17:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 62317, 2024-08-18T22:17:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 136436901, 2024-08-18T22:17:01.640 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 62317, 2024-08-18T22:17:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-08-18T22:17:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-08-18T22:17:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 818, 2024-08-18T22:17:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 136436901, 2024-08-18T22:17:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:01.641 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:01.642 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:01.642 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:01.642 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:01.642 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-08-18T22:17:02.501 INFO:tasks.check_counter:Daemon mds.c mds.exported=99 2024-08-18T22:17:02.501 INFO:tasks.check_counter:Daemon mds.c mds.imported=211 2024-08-18T22:17:02.501 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=952 2024-08-18T22:17:02.502 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=2900 2024-08-18T22:17:02.502 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=121 2024-08-18T22:17:02.502 DEBUG:tasks.check_counter:Getting stats from f 2024-08-18T22:17:02.502 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph daemon mds.f perf dump 2024-08-18T22:17:02.755 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T22:17:03.234 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-08-18T22:17:03.234 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:17:03.234 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 1333, 2024-08-18T22:17:03.235 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 1332, 2024-08-18T22:17:03.235 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 71718214, 2024-08-18T22:17:03.235 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 422762, 2024-08-18T22:17:03.235 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 8, 2024-08-18T22:17:03.235 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 4, 2024-08-18T22:17:03.235 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.169255703, 2024-08-18T22:17:03.235 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.038599484, 2024-08-18T22:17:03.236 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.078951350, 2024-08-18T22:17:03.236 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.039739367, 2024-08-18T22:17:03.236 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:17:03.236 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1331, 2024-08-18T22:17:03.236 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.060169871, 2024-08-18T22:17:03.236 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000045206 2024-08-18T22:17:03.236 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.236 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:17:03.237 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.237 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.237 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.237 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.237 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-08-18T22:17:03.237 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 448 2024-08-18T22:17:03.237 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.237 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:17:03.238 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 505, 2024-08-18T22:17:03.238 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 653, 2024-08-18T22:17:03.238 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 88218932, 2024-08-18T22:17:03.238 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 488994, 2024-08-18T22:17:03.238 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 7, 2024-08-18T22:17:03.238 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 6, 2024-08-18T22:17:03.238 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.099321261, 2024-08-18T22:17:03.239 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.017377647, 2024-08-18T22:17:03.239 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.064594553, 2024-08-18T22:17:03.239 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.012710422, 2024-08-18T22:17:03.239 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:17:03.239 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 651, 2024-08-18T22:17:03.239 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.030900128, 2024-08-18T22:17:03.239 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000047465 2024-08-18T22:17:03.240 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.240 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:17:03.240 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.240 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.240 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.240 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.240 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-18T22:17:03.240 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 328656 2024-08-18T22:17:03.240 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.241 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:17:03.241 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 839, 2024-08-18T22:17:03.241 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 824, 2024-08-18T22:17:03.241 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 47193096, 2024-08-18T22:17:03.241 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 318199, 2024-08-18T22:17:03.241 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 5, 2024-08-18T22:17:03.241 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 4, 2024-08-18T22:17:03.241 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.107708394, 2024-08-18T22:17:03.241 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.033899439, 2024-08-18T22:17:03.242 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.057070061, 2024-08-18T22:17:03.242 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.017292514, 2024-08-18T22:17:03.242 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:17:03.242 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 823, 2024-08-18T22:17:03.242 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.049216728, 2024-08-18T22:17:03.242 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000059801 2024-08-18T22:17:03.242 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.242 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:17:03.243 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.243 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.243 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.243 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.243 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 544384, 2024-08-18T22:17:03.243 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 123264 2024-08-18T22:17:03.243 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.243 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-08-18T22:17:03.243 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 1, 2024-08-18T22:17:03.244 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-08-18T22:17:03.244 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.244 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-MDSRank": { 2024-08-18T22:17:03.244 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-08-18T22:17:03.244 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-08-18T22:17:03.244 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 3904, 2024-08-18T22:17:03.244 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.603141326, 2024-08-18T22:17:03.244 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000154493 2024-08-18T22:17:03.245 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:03.245 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.245 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-PurgeQueue": { 2024-08-18T22:17:03.245 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-08-18T22:17:03.245 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-08-18T22:17:03.245 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.245 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.245 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.246 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:03.246 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.246 INFO:teuthology.orchestra.run.smithi183.stdout: "mds": { 2024-08-18T22:17:03.246 INFO:teuthology.orchestra.run.smithi183.stdout: "request": 0, 2024-08-18T22:17:03.246 INFO:teuthology.orchestra.run.smithi183.stdout: "reply": 0, 2024-08-18T22:17:03.246 INFO:teuthology.orchestra.run.smithi183.stdout: "reply_latency": { 2024-08-18T22:17:03.246 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.247 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.247 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.247 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.247 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_reply": 0, 2024-08-18T22:17:03.247 INFO:teuthology.orchestra.run.smithi183.stdout: "forward": 0, 2024-08-18T22:17:03.247 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_complete": 0, 2024-08-18T22:17:03.247 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_keys": 0, 2024-08-18T22:17:03.247 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_commit": 0, 2024-08-18T22:17:03.247 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_split": 0, 2024-08-18T22:17:03.248 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_merge": 0, 2024-08-18T22:17:03.248 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes": 26220, 2024-08-18T22:17:03.248 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_top": 18326, 2024-08-18T22:17:03.248 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_bottom": 7894, 2024-08-18T22:17:03.248 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pin_tail": 0, 2024-08-18T22:17:03.248 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pinned": 40, 2024-08-18T22:17:03.248 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_expired": 0, 2024-08-18T22:17:03.248 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_with_caps": 0, 2024-08-18T22:17:03.249 INFO:teuthology.orchestra.run.smithi183.stdout: "caps": 0, 2024-08-18T22:17:03.249 INFO:teuthology.orchestra.run.smithi183.stdout: "subtrees": 2, 2024-08-18T22:17:03.249 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse": 0, 2024-08-18T22:17:03.249 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_hit": 0, 2024-08-18T22:17:03.249 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_forward": 0, 2024-08-18T22:17:03.249 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_discover": 0, 2024-08-18T22:17:03.249 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_dir_fetch": 0, 2024-08-18T22:17:03.250 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_remote_ino": 0, 2024-08-18T22:17:03.250 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_lock": 0, 2024-08-18T22:17:03.250 INFO:teuthology.orchestra.run.smithi183.stdout: "load_cent": 0, 2024-08-18T22:17:03.250 INFO:teuthology.orchestra.run.smithi183.stdout: "q": 0, 2024-08-18T22:17:03.250 INFO:teuthology.orchestra.run.smithi183.stdout: "exported": 0, 2024-08-18T22:17:03.250 INFO:teuthology.orchestra.run.smithi183.stdout: "exported_inodes": 0, 2024-08-18T22:17:03.250 INFO:teuthology.orchestra.run.smithi183.stdout: "imported": 0, 2024-08-18T22:17:03.251 INFO:teuthology.orchestra.run.smithi183.stdout: "imported_inodes": 0, 2024-08-18T22:17:03.251 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_dir_fetch": 0, 2024-08-18T22:17:03.251 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_backtrace_fetch": 0, 2024-08-18T22:17:03.251 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_peer_discover": 0, 2024-08-18T22:17:03.251 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rfiles": 4, 2024-08-18T22:17:03.251 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rbytes": 234, 2024-08-18T22:17:03.251 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rsnaps": 0, 2024-08-18T22:17:03.251 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_fetch": 0, 2024-08-18T22:17:03.251 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_set_tag": 0, 2024-08-18T22:17:03.252 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_repaired": 0, 2024-08-18T22:17:03.252 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_inotable_repaired": 0, 2024-08-18T22:17:03.252 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_inodes": 0, 2024-08-18T22:17:03.252 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_base_inodes": 0, 2024-08-18T22:17:03.252 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dirfrag_rstats": 0, 2024-08-18T22:17:03.252 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_file_inodes": 0, 2024-08-18T22:17:03.252 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_inode_file_caps": 0, 2024-08-18T22:17:03.252 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_revoke": 0, 2024-08-18T22:17:03.253 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_grant": 0, 2024-08-18T22:17:03.253 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_trunc": 0, 2024-08-18T22:17:03.253 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-18T22:17:03.253 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-18T22:17:03.253 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps": 0, 2024-08-18T22:17:03.253 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps_dirty": 0, 2024-08-18T22:17:03.253 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_cap_release": 0, 2024-08-18T22:17:03.253 INFO:teuthology.orchestra.run.smithi183.stdout: "process_request_cap_release": 0 2024-08-18T22:17:03.253 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.254 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_cache": { 2024-08-18T22:17:03.254 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update": 0, 2024-08-18T22:17:03.254 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update_receipt": 0, 2024-08-18T22:17:03.254 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_try_discover": 0, 2024-08-18T22:17:03.254 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_send_discover": 0, 2024-08-18T22:17:03.254 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_handle_discover": 0, 2024-08-18T22:17:03.254 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays": 0, 2024-08-18T22:17:03.254 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_delayed": 0, 2024-08-18T22:17:03.255 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_enqueuing": 0, 2024-08-18T22:17:03.255 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_created": 0, 2024-08-18T22:17:03.255 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_enqueued": 0, 2024-08-18T22:17:03.255 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_reintegrated": 0, 2024-08-18T22:17:03.255 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_migrated": 0, 2024-08-18T22:17:03.255 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_processing": 0, 2024-08-18T22:17:03.255 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_enqueued": 0, 2024-08-18T22:17:03.256 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_prioritized": 0, 2024-08-18T22:17:03.256 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_started": 0, 2024-08-18T22:17:03.256 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_completed": 0, 2024-08-18T22:17:03.256 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_path": 0, 2024-08-18T22:17:03.256 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_inode": 0, 2024-08-18T22:17:03.256 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_enqueue_scrub": 0, 2024-08-18T22:17:03.256 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_exportdir": 0, 2024-08-18T22:17:03.256 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_flush": 0, 2024-08-18T22:17:03.257 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragmentdir": 0, 2024-08-18T22:17:03.257 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragstats": 0, 2024-08-18T22:17:03.257 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_inodestats": 0 2024-08-18T22:17:03.257 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.257 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_log": { 2024-08-18T22:17:03.257 INFO:teuthology.orchestra.run.smithi183.stdout: "evlrg": 0, 2024-08-18T22:17:03.257 INFO:teuthology.orchestra.run.smithi183.stdout: "evadd": 0, 2024-08-18T22:17:03.257 INFO:teuthology.orchestra.run.smithi183.stdout: "evex": 0, 2024-08-18T22:17:03.258 INFO:teuthology.orchestra.run.smithi183.stdout: "evtrm": 0, 2024-08-18T22:17:03.258 INFO:teuthology.orchestra.run.smithi183.stdout: "ev": 92735, 2024-08-18T22:17:03.258 INFO:teuthology.orchestra.run.smithi183.stdout: "evexg": 0, 2024-08-18T22:17:03.258 INFO:teuthology.orchestra.run.smithi183.stdout: "evexd": 0, 2024-08-18T22:17:03.258 INFO:teuthology.orchestra.run.smithi183.stdout: "segadd": 0, 2024-08-18T22:17:03.258 INFO:teuthology.orchestra.run.smithi183.stdout: "segex": 0, 2024-08-18T22:17:03.258 INFO:teuthology.orchestra.run.smithi183.stdout: "segtrm": 0, 2024-08-18T22:17:03.259 INFO:teuthology.orchestra.run.smithi183.stdout: "seg": 2, 2024-08-18T22:17:03.259 INFO:teuthology.orchestra.run.smithi183.stdout: "segmjr": 35, 2024-08-18T22:17:03.259 INFO:teuthology.orchestra.run.smithi183.stdout: "segexg": 0, 2024-08-18T22:17:03.259 INFO:teuthology.orchestra.run.smithi183.stdout: "segexd": 0, 2024-08-18T22:17:03.259 INFO:teuthology.orchestra.run.smithi183.stdout: "expos": 209806672, 2024-08-18T22:17:03.259 INFO:teuthology.orchestra.run.smithi183.stdout: "wrpos": 210063852, 2024-08-18T22:17:03.259 INFO:teuthology.orchestra.run.smithi183.stdout: "rdpos": 210062714, 2024-08-18T22:17:03.259 INFO:teuthology.orchestra.run.smithi183.stdout: "jlat": { 2024-08-18T22:17:03.260 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.260 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.260 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.260 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.260 INFO:teuthology.orchestra.run.smithi183.stdout: "replayed": 92735 2024-08-18T22:17:03.260 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.260 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_mem": { 2024-08-18T22:17:03.260 INFO:teuthology.orchestra.run.smithi183.stdout: "ino": 29, 2024-08-18T22:17:03.260 INFO:teuthology.orchestra.run.smithi183.stdout: "ino+": 30096, 2024-08-18T22:17:03.261 INFO:teuthology.orchestra.run.smithi183.stdout: "ino-": 30067, 2024-08-18T22:17:03.261 INFO:teuthology.orchestra.run.smithi183.stdout: "dir": 89, 2024-08-18T22:17:03.261 INFO:teuthology.orchestra.run.smithi183.stdout: "dir+": 1561, 2024-08-18T22:17:03.261 INFO:teuthology.orchestra.run.smithi183.stdout: "dir-": 1472, 2024-08-18T22:17:03.261 INFO:teuthology.orchestra.run.smithi183.stdout: "dn": 26220, 2024-08-18T22:17:03.261 INFO:teuthology.orchestra.run.smithi183.stdout: "dn+": 58036, 2024-08-18T22:17:03.261 INFO:teuthology.orchestra.run.smithi183.stdout: "dn-": 31816, 2024-08-18T22:17:03.261 INFO:teuthology.orchestra.run.smithi183.stdout: "cap": 0, 2024-08-18T22:17:03.262 INFO:teuthology.orchestra.run.smithi183.stdout: "cap+": 0, 2024-08-18T22:17:03.262 INFO:teuthology.orchestra.run.smithi183.stdout: "cap-": 0, 2024-08-18T22:17:03.262 INFO:teuthology.orchestra.run.smithi183.stdout: "rss": 110856, 2024-08-18T22:17:03.262 INFO:teuthology.orchestra.run.smithi183.stdout: "heap": 215328 2024-08-18T22:17:03.262 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.262 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_server": { 2024-08-18T22:17:03.262 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_client_request": 0, 2024-08-18T22:17:03.262 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_server_request": 0, 2024-08-18T22:17:03.263 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_request": 0, 2024-08-18T22:17:03.263 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_session": 0, 2024-08-18T22:17:03.263 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_peer_request": 0, 2024-08-18T22:17:03.263 INFO:teuthology.orchestra.run.smithi183.stdout: "req_create_latency": { 2024-08-18T22:17:03.263 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.263 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.263 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.263 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.264 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getattr_latency": { 2024-08-18T22:17:03.264 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.264 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.264 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.264 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.264 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getfilelock_latency": { 2024-08-18T22:17:03.264 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.264 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.265 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.265 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.265 INFO:teuthology.orchestra.run.smithi183.stdout: "req_link_latency": { 2024-08-18T22:17:03.265 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.265 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.265 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.265 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.265 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookup_latency": { 2024-08-18T22:17:03.266 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.266 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.266 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.266 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.266 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookuphash_latency": { 2024-08-18T22:17:03.266 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.266 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.266 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.267 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.267 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupino_latency": { 2024-08-18T22:17:03.267 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.267 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.267 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.267 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.267 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupname_latency": { 2024-08-18T22:17:03.267 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.267 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.268 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.268 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.268 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupparent_latency": { 2024-08-18T22:17:03.268 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.268 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.268 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.268 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.268 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupsnap_latency": { 2024-08-18T22:17:03.269 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.269 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.269 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.269 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.269 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lssnap_latency": { 2024-08-18T22:17:03.269 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.269 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.269 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.270 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.270 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mkdir_latency": { 2024-08-18T22:17:03.270 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.271 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.271 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.271 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.271 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mknod_latency": { 2024-08-18T22:17:03.271 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.271 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.271 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.271 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.272 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mksnap_latency": { 2024-08-18T22:17:03.272 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.272 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.272 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.272 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.272 INFO:teuthology.orchestra.run.smithi183.stdout: "req_open_latency": { 2024-08-18T22:17:03.272 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.272 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.273 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.273 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.273 INFO:teuthology.orchestra.run.smithi183.stdout: "req_readdir_latency": { 2024-08-18T22:17:03.273 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.273 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.273 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.273 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.273 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rename_latency": { 2024-08-18T22:17:03.274 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.274 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.274 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.274 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.274 INFO:teuthology.orchestra.run.smithi183.stdout: "req_renamesnap_latency": { 2024-08-18T22:17:03.274 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.274 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.274 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.275 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.275 INFO:teuthology.orchestra.run.smithi183.stdout: "req_snapdiff_latency": { 2024-08-18T22:17:03.275 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.275 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.275 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.275 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.275 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmdir_latency": { 2024-08-18T22:17:03.275 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.276 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.276 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.276 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.276 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmsnap_latency": { 2024-08-18T22:17:03.276 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.276 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.276 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.276 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.277 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmxattr_latency": { 2024-08-18T22:17:03.277 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.277 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.277 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.277 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.277 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setattr_latency": { 2024-08-18T22:17:03.277 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.277 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.277 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.278 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.278 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setdirlayout_latency": { 2024-08-18T22:17:03.278 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.278 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.278 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.278 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.278 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setfilelock_latency": { 2024-08-18T22:17:03.278 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.279 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.279 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.279 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.279 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setlayout_latency": { 2024-08-18T22:17:03.279 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.279 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.279 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.279 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.280 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setxattr_latency": { 2024-08-18T22:17:03.280 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.280 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.280 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.280 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.280 INFO:teuthology.orchestra.run.smithi183.stdout: "req_symlink_latency": { 2024-08-18T22:17:03.280 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.280 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.281 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.281 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.281 INFO:teuthology.orchestra.run.smithi183.stdout: "req_unlink_latency": { 2024-08-18T22:17:03.281 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.281 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.281 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.281 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.281 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_revoke_eviction": 0, 2024-08-18T22:17:03.282 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_acquisition_throttle": 0, 2024-08-18T22:17:03.282 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getvxattr_latency": { 2024-08-18T22:17:03.282 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.282 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.282 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.282 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:03.282 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.282 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_sessions": { 2024-08-18T22:17:03.283 INFO:teuthology.orchestra.run.smithi183.stdout: "session_count": 1, 2024-08-18T22:17:03.283 INFO:teuthology.orchestra.run.smithi183.stdout: "session_add": 3, 2024-08-18T22:17:03.283 INFO:teuthology.orchestra.run.smithi183.stdout: "session_remove": 2, 2024-08-18T22:17:03.283 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_open": 1, 2024-08-18T22:17:03.283 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_stale": 0, 2024-08-18T22:17:03.283 INFO:teuthology.orchestra.run.smithi183.stdout: "total_load": 0, 2024-08-18T22:17:03.283 INFO:teuthology.orchestra.run.smithi183.stdout: "average_load": 0, 2024-08-18T22:17:03.283 INFO:teuthology.orchestra.run.smithi183.stdout: "avg_session_uptime": 1465, 2024-08-18T22:17:03.284 INFO:teuthology.orchestra.run.smithi183.stdout: "mdthresh_evicted": 0 2024-08-18T22:17:03.284 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.284 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-08-18T22:17:03.284 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 0, 2024-08-18T22:17:03.284 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 0, 2024-08-18T22:17:03.284 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:17:03.284 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:17:03.284 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:17:03.284 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:17:03.285 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:17:03.285 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:17:03.285 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:17:03.285 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:17:03.285 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:17:03.285 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:17:03.285 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:17:03.285 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:17:03.286 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:17:03.286 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-08-18T22:17:03.286 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:17:03.286 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-08-18T22:17:03.286 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:17:03.286 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:17:03.286 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:17:03.286 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:17:03.287 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:17:03.287 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:17:03.287 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:17:03.287 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-08-18T22:17:03.287 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:17:03.287 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:17:03.287 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:17:03.287 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-08-18T22:17:03.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-08-18T22:17:03.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-08-18T22:17:03.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:17:03.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:17:03.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:17:03.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:17:03.288 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 239693, 2024-08-18T22:17:03.288 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 85, 2024-08-18T22:17:03.288 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 0, 2024-08-18T22:17:03.289 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 0, 2024-08-18T22:17:03.289 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-08-18T22:17:03.289 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-08-18T22:17:03.289 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:17:03.289 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-08-18T22:17:03.289 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:17:03.289 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-08-18T22:17:03.290 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 8856, 2024-08-18T22:17:03.290 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 166, 2024-08-18T22:17:03.290 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:17:03.290 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:17:03.290 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-08-18T22:17:03.290 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-08-18T22:17:03.290 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 18510249, 2024-08-18T22:17:03.290 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 88735, 2024-08-18T22:17:03.291 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-08-18T22:17:03.291 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-08-18T22:17:03.291 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-08-18T22:17:03.291 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-08-18T22:17:03.291 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.291 INFO:teuthology.orchestra.run.smithi183.stdout: "objecter": { 2024-08-18T22:17:03.291 INFO:teuthology.orchestra.run.smithi183.stdout: "op_active": 0, 2024-08-18T22:17:03.291 INFO:teuthology.orchestra.run.smithi183.stdout: "op_laggy": 0, 2024-08-18T22:17:03.292 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send": 2445, 2024-08-18T22:17:03.292 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send_bytes": 26, 2024-08-18T22:17:03.292 INFO:teuthology.orchestra.run.smithi183.stdout: "op_resend": 4, 2024-08-18T22:17:03.292 INFO:teuthology.orchestra.run.smithi183.stdout: "op_reply": 2445, 2024-08-18T22:17:03.292 INFO:teuthology.orchestra.run.smithi183.stdout: "op_latency": { 2024-08-18T22:17:03.292 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 2445, 2024-08-18T22:17:03.292 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 7.780787703, 2024-08-18T22:17:03.292 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.003182326 2024-08-18T22:17:03.292 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.293 INFO:teuthology.orchestra.run.smithi183.stdout: "op_inflight": 0, 2024-08-18T22:17:03.293 INFO:teuthology.orchestra.run.smithi183.stdout: "oplen_avg": { 2024-08-18T22:17:03.293 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 2445, 2024-08-18T22:17:03.293 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 2446 2024-08-18T22:17:03.293 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.293 INFO:teuthology.orchestra.run.smithi183.stdout: "op": 2445, 2024-08-18T22:17:03.293 INFO:teuthology.orchestra.run.smithi183.stdout: "op_r": 2445, 2024-08-18T22:17:03.293 INFO:teuthology.orchestra.run.smithi183.stdout: "op_w": 0, 2024-08-18T22:17:03.294 INFO:teuthology.orchestra.run.smithi183.stdout: "op_rmw": 0, 2024-08-18T22:17:03.294 INFO:teuthology.orchestra.run.smithi183.stdout: "op_pg": 0, 2024-08-18T22:17:03.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_stat": 1503, 2024-08-18T22:17:03.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_create": 0, 2024-08-18T22:17:03.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_read": 939, 2024-08-18T22:17:03.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_write": 0, 2024-08-18T22:17:03.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writefull": 0, 2024-08-18T22:17:03.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writesame": 0, 2024-08-18T22:17:03.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_append": 0, 2024-08-18T22:17:03.295 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_zero": 0, 2024-08-18T22:17:03.295 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_truncate": 0, 2024-08-18T22:17:03.295 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_delete": 0, 2024-08-18T22:17:03.295 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_mapext": 0, 2024-08-18T22:17:03.295 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_sparse_read": 0, 2024-08-18T22:17:03.295 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_clonerange": 0, 2024-08-18T22:17:03.295 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_getxattr": 2, 2024-08-18T22:17:03.295 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_setxattr": 0, 2024-08-18T22:17:03.296 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_cmpxattr": 0, 2024-08-18T22:17:03.296 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_rmxattr": 0, 2024-08-18T22:17:03.296 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_resetxattrs": 0, 2024-08-18T22:17:03.296 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_call": 0, 2024-08-18T22:17:03.296 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_watch": 0, 2024-08-18T22:17:03.296 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_notify": 0, 2024-08-18T22:17:03.296 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_src_cmpxattr": 0, 2024-08-18T22:17:03.296 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls": 0, 2024-08-18T22:17:03.296 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls_filter": 0, 2024-08-18T22:17:03.297 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_other": 0, 2024-08-18T22:17:03.297 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_active": 0, 2024-08-18T22:17:03.297 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_send": 0, 2024-08-18T22:17:03.297 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_resend": 0, 2024-08-18T22:17:03.297 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_ping": 0, 2024-08-18T22:17:03.297 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_active": 0, 2024-08-18T22:17:03.297 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_send": 0, 2024-08-18T22:17:03.297 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_resend": 0, 2024-08-18T22:17:03.297 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_active": 0, 2024-08-18T22:17:03.298 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_send": 0, 2024-08-18T22:17:03.298 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_resend": 0, 2024-08-18T22:17:03.298 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_active": 0, 2024-08-18T22:17:03.298 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_send": 0, 2024-08-18T22:17:03.298 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_resend": 0, 2024-08-18T22:17:03.298 INFO:teuthology.orchestra.run.smithi183.stdout: "command_active": 0, 2024-08-18T22:17:03.298 INFO:teuthology.orchestra.run.smithi183.stdout: "command_send": 0, 2024-08-18T22:17:03.298 INFO:teuthology.orchestra.run.smithi183.stdout: "command_resend": 0, 2024-08-18T22:17:03.299 INFO:teuthology.orchestra.run.smithi183.stdout: "map_epoch": 96, 2024-08-18T22:17:03.299 INFO:teuthology.orchestra.run.smithi183.stdout: "map_full": 0, 2024-08-18T22:17:03.299 INFO:teuthology.orchestra.run.smithi183.stdout: "map_inc": 8, 2024-08-18T22:17:03.299 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_sessions": 11, 2024-08-18T22:17:03.299 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_open": 11, 2024-08-18T22:17:03.299 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_close": 0, 2024-08-18T22:17:03.299 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_laggy": 0, 2024-08-18T22:17:03.299 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_wr": 0, 2024-08-18T22:17:03.299 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_rd": 2, 2024-08-18T22:17:03.300 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_del": 0 2024-08-18T22:17:03.300 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.300 INFO:teuthology.orchestra.run.smithi183.stdout: "oft": { 2024-08-18T22:17:03.300 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_objs": 0, 2024-08-18T22:17:03.300 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_kv_pairs": 0, 2024-08-18T22:17:03.300 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_updates": 0, 2024-08-18T22:17:03.300 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_removes": 0 2024-08-18T22:17:03.301 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.301 INFO:teuthology.orchestra.run.smithi183.stdout: "osd-slow-ops": { 2024-08-18T22:17:03.301 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_ops_count": 0 2024-08-18T22:17:03.301 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.301 INFO:teuthology.orchestra.run.smithi183.stdout: "purge_queue": { 2024-08-18T22:17:03.301 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops": 0, 2024-08-18T22:17:03.301 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops_high_water": 0, 2024-08-18T22:17:03.301 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing": 0, 2024-08-18T22:17:03.302 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_high_water": 0, 2024-08-18T22:17:03.302 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed_ops": 0, 2024-08-18T22:17:03.302 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed": 0, 2024-08-18T22:17:03.302 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_item_in_journal": 0 2024-08-18T22:17:03.302 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.302 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:17:03.302 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:03.302 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-08-18T22:17:03.303 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:03.303 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 2673, 2024-08-18T22:17:03.303 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 206875116, 2024-08-18T22:17:03.303 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:03.303 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 2673, 2024-08-18T22:17:03.303 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-08-18T22:17:03.303 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-08-18T22:17:03.303 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 2673, 2024-08-18T22:17:03.303 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 206875116, 2024-08-18T22:17:03.304 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:03.304 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.304 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.304 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.304 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:03.304 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.304 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_bytes": { 2024-08-18T22:17:03.304 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:03.305 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-08-18T22:17:03.305 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:03.305 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-08-18T22:17:03.305 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-08-18T22:17:03.305 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:03.305 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-08-18T22:17:03.305 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 2445, 2024-08-18T22:17:03.305 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 205905462, 2024-08-18T22:17:03.306 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 2445, 2024-08-18T22:17:03.306 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 205905462, 2024-08-18T22:17:03.306 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:03.306 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.306 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.306 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.306 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:03.306 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.307 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_ops": { 2024-08-18T22:17:03.307 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:03.307 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 1024, 2024-08-18T22:17:03.307 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:03.307 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-08-18T22:17:03.307 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-08-18T22:17:03.307 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:03.307 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-08-18T22:17:03.308 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 2445, 2024-08-18T22:17:03.308 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 2445, 2024-08-18T22:17:03.308 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 2445, 2024-08-18T22:17:03.308 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 2445, 2024-08-18T22:17:03.308 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:03.308 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.308 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.308 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.309 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:03.309 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.309 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle": { 2024-08-18T22:17:03.309 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:03.309 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-08-18T22:17:03.309 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:03.309 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-08-18T22:17:03.309 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-08-18T22:17:03.310 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:03.310 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-08-18T22:17:03.310 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-08-18T22:17:03.310 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-08-18T22:17:03.310 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 0, 2024-08-18T22:17:03.310 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 0, 2024-08-18T22:17:03.310 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:03.310 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.311 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.311 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.311 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:03.311 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:03.311 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle-0x564f75afab40": { 2024-08-18T22:17:03.311 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:03.311 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-08-18T22:17:03.311 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:03.312 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-08-18T22:17:03.312 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-08-18T22:17:03.312 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:03.312 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-08-18T22:17:03.312 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-08-18T22:17:03.312 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-08-18T22:17:03.312 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 0, 2024-08-18T22:17:03.312 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 0, 2024-08-18T22:17:03.313 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:03.313 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:03.313 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:03.313 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:03.313 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:03.313 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:03.313 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-08-18T22:17:03.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:03 smithi183 ceph-mon[22097]: pgmap v622: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:17:03.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:03 smithi123 ceph-mon[18462]: pgmap v622: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:17:03.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:03 smithi130 ceph-mon[21698]: pgmap v622: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-18T22:17:04.107 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-08-18T22:17:04.107 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-08-18T22:17:04.107 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-08-18T22:17:04.108 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-08-18T22:17:04.108 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-08-18T22:17:04.108 DEBUG:tasks.check_counter:Getting stats from i 2024-08-18T22:17:04.108 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph daemon mds.i perf dump 2024-08-18T22:17:04.360 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T22:17:04.868 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-08-18T22:17:04.868 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:17:04.868 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 131438, 2024-08-18T22:17:04.869 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 239596, 2024-08-18T22:17:04.869 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 48515655, 2024-08-18T22:17:04.869 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 204571736, 2024-08-18T22:17:04.869 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 140, 2024-08-18T22:17:04.869 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 6, 2024-08-18T22:17:04.869 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 8.882882097, 2024-08-18T22:17:04.869 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 3.700065213, 2024-08-18T22:17:04.870 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 42.908149893, 2024-08-18T22:17:04.870 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 1.236466095, 2024-08-18T22:17:04.870 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:17:04.870 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 239592, 2024-08-18T22:17:04.870 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 45.059494339, 2024-08-18T22:17:04.870 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000188067 2024-08-18T22:17:04.870 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.871 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:17:04.871 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 251646, 2024-08-18T22:17:04.871 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.052761501, 2024-08-18T22:17:04.871 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000209 2024-08-18T22:17:04.871 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.871 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 619792, 2024-08-18T22:17:04.871 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 167536 2024-08-18T22:17:04.871 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.871 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:17:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 68857, 2024-08-18T22:17:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 60598, 2024-08-18T22:17:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 48513906, 2024-08-18T22:17:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 138392540, 2024-08-18T22:17:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 24, 2024-08-18T22:17:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 7, 2024-08-18T22:17:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 4.248971726, 2024-08-18T22:17:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 1.498503311, 2024-08-18T22:17:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 1.367488149, 2024-08-18T22:17:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 1.434953009, 2024-08-18T22:17:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:17:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 60599, 2024-08-18T22:17:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 33.535558627, 2024-08-18T22:17:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000553401 2024-08-18T22:17:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:17:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 33919, 2024-08-18T22:17:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.005047213, 2024-08-18T22:17:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000148 2024-08-18T22:17:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-18T22:17:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 344368 2024-08-18T22:17:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:17:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 72275, 2024-08-18T22:17:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 69579, 2024-08-18T22:17:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 58025188, 2024-08-18T22:17:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 160307122, 2024-08-18T22:17:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 11, 2024-08-18T22:17:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 6, 2024-08-18T22:17:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 4.407824942, 2024-08-18T22:17:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 1.470726578, 2024-08-18T22:17:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 1.294170060, 2024-08-18T22:17:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 1.609256705, 2024-08-18T22:17:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:17:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 69578, 2024-08-18T22:17:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 41.175385600, 2024-08-18T22:17:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000591787 2024-08-18T22:17:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:17:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 24835, 2024-08-18T22:17:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.004401748, 2024-08-18T22:17:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000177 2024-08-18T22:17:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-08-18T22:17:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 448 2024-08-18T22:17:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-08-18T22:17:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 1, 2024-08-18T22:17:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-08-18T22:17:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-MDSRank": { 2024-08-18T22:17:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-08-18T22:17:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-08-18T22:17:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 30269, 2024-08-18T22:17:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 99.569340151, 2024-08-18T22:17:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.003289482 2024-08-18T22:17:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-PurgeQueue": { 2024-08-18T22:17:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-08-18T22:17:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-08-18T22:17:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 26705, 2024-08-18T22:17:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 7.982397426, 2024-08-18T22:17:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000298910 2024-08-18T22:17:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: "mds": { 2024-08-18T22:17:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: "request": 61383, 2024-08-18T22:17:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: "reply": 53802, 2024-08-18T22:17:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: "reply_latency": { 2024-08-18T22:17:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 53802, 2024-08-18T22:17:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 562.937397475, 2024-08-18T22:17:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.010463131 2024-08-18T22:17:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_reply": 0, 2024-08-18T22:17:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "forward": 7581, 2024-08-18T22:17:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_complete": 180, 2024-08-18T22:17:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_keys": 1, 2024-08-18T22:17:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_commit": 7654, 2024-08-18T22:17:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_split": 158, 2024-08-18T22:17:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_merge": 36, 2024-08-18T22:17:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes": 162, 2024-08-18T22:17:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_top": 100, 2024-08-18T22:17:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_bottom": 48, 2024-08-18T22:17:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pin_tail": 14, 2024-08-18T22:17:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pinned": 19, 2024-08-18T22:17:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_expired": 28926, 2024-08-18T22:17:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_with_caps": 2, 2024-08-18T22:17:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "caps": 2, 2024-08-18T22:17:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "subtrees": 4, 2024-08-18T22:17:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse": 68499, 2024-08-18T22:17:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_hit": 60459, 2024-08-18T22:17:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_forward": 7545, 2024-08-18T22:17:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_discover": 2, 2024-08-18T22:17:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_dir_fetch": 7, 2024-08-18T22:17:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_remote_ino": 0, 2024-08-18T22:17:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_lock": 0, 2024-08-18T22:17:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: "load_cent": 10, 2024-08-18T22:17:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: "q": 0, 2024-08-18T22:17:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: "exported": 222, 2024-08-18T22:17:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: "exported_inodes": 21784, 2024-08-18T22:17:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: "imported": 223, 2024-08-18T22:17:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: "imported_inodes": 11707, 2024-08-18T22:17:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_dir_fetch": 0, 2024-08-18T22:17:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_backtrace_fetch": 36771, 2024-08-18T22:17:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_peer_discover": 0, 2024-08-18T22:17:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rfiles": 4, 2024-08-18T22:17:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rbytes": 234, 2024-08-18T22:17:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rsnaps": 0, 2024-08-18T22:17:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_fetch": 36771, 2024-08-18T22:17:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_set_tag": 0, 2024-08-18T22:17:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_repaired": 0, 2024-08-18T22:17:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_inotable_repaired": 0, 2024-08-18T22:17:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_inodes": 66, 2024-08-18T22:17:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_base_inodes": 6, 2024-08-18T22:17:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dirfrag_rstats": 60, 2024-08-18T22:17:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_file_inodes": 36705, 2024-08-18T22:17:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_inode_file_caps": 4, 2024-08-18T22:17:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_revoke": 11735, 2024-08-18T22:17:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_grant": 46652, 2024-08-18T22:17:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_trunc": 1, 2024-08-18T22:17:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-18T22:17:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-18T22:17:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps": 25519, 2024-08-18T22:17:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps_dirty": 24581, 2024-08-18T22:17:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_cap_release": 281, 2024-08-18T22:17:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "process_request_cap_release": 23696 2024-08-18T22:17:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_cache": { 2024-08-18T22:17:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update": 1820, 2024-08-18T22:17:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update_receipt": 1008, 2024-08-18T22:17:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_try_discover": 504, 2024-08-18T22:17:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_send_discover": 506, 2024-08-18T22:17:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_handle_discover": 2016, 2024-08-18T22:17:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays": 4, 2024-08-18T22:17:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_delayed": 0, 2024-08-18T22:17:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_enqueuing": 0, 2024-08-18T22:17:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_created": 16344, 2024-08-18T22:17:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_enqueued": 16340, 2024-08-18T22:17:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_reintegrated": 0, 2024-08-18T22:17:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_migrated": 0, 2024-08-18T22:17:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_processing": 0, 2024-08-18T22:17:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_enqueued": 0, 2024-08-18T22:17:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_prioritized": 0, 2024-08-18T22:17:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_started": 0, 2024-08-18T22:17:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_completed": 0, 2024-08-18T22:17:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_path": 7, 2024-08-18T22:17:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_inode": 25880, 2024-08-18T22:17:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_enqueue_scrub": 6, 2024-08-18T22:17:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_exportdir": 269, 2024-08-18T22:17:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_flush": 0, 2024-08-18T22:17:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragmentdir": 224, 2024-08-18T22:17:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragstats": 0, 2024-08-18T22:17:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_inodestats": 0 2024-08-18T22:17:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_log": { 2024-08-18T22:17:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: "evlrg": 0, 2024-08-18T22:17:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: "evadd": 92735, 2024-08-18T22:17:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: "evex": 92620, 2024-08-18T22:17:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: "evtrm": 92620, 2024-08-18T22:17:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: "ev": 115, 2024-08-18T22:17:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "evexg": 104, 2024-08-18T22:17:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "evexd": 23, 2024-08-18T22:17:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "segadd": 136, 2024-08-18T22:17:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "segex": 134, 2024-08-18T22:17:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "segtrm": 134, 2024-08-18T22:17:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "seg": 2, 2024-08-18T22:17:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "segmjr": 2, 2024-08-18T22:17:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "segexg": 1, 2024-08-18T22:17:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "segexd": 1, 2024-08-18T22:17:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "expos": 209806672, 2024-08-18T22:17:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "wrpos": 210063852, 2024-08-18T22:17:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "rdpos": 0, 2024-08-18T22:17:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "jlat": { 2024-08-18T22:17:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 12450, 2024-08-18T22:17:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 1490.188005397, 2024-08-18T22:17:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.119693815 2024-08-18T22:17:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "replayed": 0 2024-08-18T22:17:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_mem": { 2024-08-18T22:17:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "ino": 27, 2024-08-18T22:17:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "ino+": 31082, 2024-08-18T22:17:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "ino-": 31055, 2024-08-18T22:17:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "dir": 91, 2024-08-18T22:17:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "dir+": 3183, 2024-08-18T22:17:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "dir-": 3092, 2024-08-18T22:17:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "dn": 162, 2024-08-18T22:17:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "dn+": 57655, 2024-08-18T22:17:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "dn-": 57493, 2024-08-18T22:17:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "cap": 2, 2024-08-18T22:17:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "cap+": 39086, 2024-08-18T22:17:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "cap-": 39084, 2024-08-18T22:17:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "rss": 185040, 2024-08-18T22:17:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "heap": 231712 2024-08-18T22:17:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_server": { 2024-08-18T22:17:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_client_request": 62378, 2024-08-18T22:17:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_server_request": 8164, 2024-08-18T22:17:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_request": 61383, 2024-08-18T22:17:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_session": 138, 2024-08-18T22:17:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_peer_request": 16309, 2024-08-18T22:17:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: "req_create_latency": { 2024-08-18T22:17:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 29906, 2024-08-18T22:17:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 430.324358198, 2024-08-18T22:17:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.014389231 2024-08-18T22:17:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getattr_latency": { 2024-08-18T22:17:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 154, 2024-08-18T22:17:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.177332055, 2024-08-18T22:17:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.001151506 2024-08-18T22:17:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getfilelock_latency": { 2024-08-18T22:17:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: "req_link_latency": { 2024-08-18T22:17:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookup_latency": { 2024-08-18T22:17:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 6167, 2024-08-18T22:17:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 11.342364280, 2024-08-18T22:17:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.001839202 2024-08-18T22:17:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookuphash_latency": { 2024-08-18T22:17:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupino_latency": { 2024-08-18T22:17:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1, 2024-08-18T22:17:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000248654, 2024-08-18T22:17:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000248654 2024-08-18T22:17:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupname_latency": { 2024-08-18T22:17:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupparent_latency": { 2024-08-18T22:17:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupsnap_latency": { 2024-08-18T22:17:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lssnap_latency": { 2024-08-18T22:17:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mkdir_latency": { 2024-08-18T22:17:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 130, 2024-08-18T22:17:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.114187909, 2024-08-18T22:17:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000878368 2024-08-18T22:17:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mknod_latency": { 2024-08-18T22:17:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mksnap_latency": { 2024-08-18T22:17:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "req_open_latency": { 2024-08-18T22:17:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1, 2024-08-18T22:17:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000357772, 2024-08-18T22:17:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000357772 2024-08-18T22:17:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: "req_readdir_latency": { 2024-08-18T22:17:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1039, 2024-08-18T22:17:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 17.624463071, 2024-08-18T22:17:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.016962909 2024-08-18T22:17:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rename_latency": { 2024-08-18T22:17:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 4, 2024-08-18T22:17:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.006011848, 2024-08-18T22:17:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.001502962 2024-08-18T22:17:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: "req_renamesnap_latency": { 2024-08-18T22:17:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "req_snapdiff_latency": { 2024-08-18T22:17:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmdir_latency": { 2024-08-18T22:17:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 118, 2024-08-18T22:17:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 9.759256759, 2024-08-18T22:17:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.082705565 2024-08-18T22:17:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmsnap_latency": { 2024-08-18T22:17:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmxattr_latency": { 2024-08-18T22:17:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 3, 2024-08-18T22:17:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.008962071, 2024-08-18T22:17:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.002987357 2024-08-18T22:17:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setattr_latency": { 2024-08-18T22:17:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 5, 2024-08-18T22:17:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.011150270, 2024-08-18T22:17:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.002230054 2024-08-18T22:17:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setdirlayout_latency": { 2024-08-18T22:17:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setfilelock_latency": { 2024-08-18T22:17:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 22, 2024-08-18T22:17:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 10.014680695, 2024-08-18T22:17:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.455212758 2024-08-18T22:17:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setlayout_latency": { 2024-08-18T22:17:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setxattr_latency": { 2024-08-18T22:17:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 25, 2024-08-18T22:17:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.076525947, 2024-08-18T22:17:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.003061037 2024-08-18T22:17:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: "req_symlink_latency": { 2024-08-18T22:17:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: "req_unlink_latency": { 2024-08-18T22:17:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 16225, 2024-08-18T22:17:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 83.477036728, 2024-08-18T22:17:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.005144963 2024-08-18T22:17:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_revoke_eviction": 0, 2024-08-18T22:17:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_acquisition_throttle": 0, 2024-08-18T22:17:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getvxattr_latency": { 2024-08-18T22:17:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 2, 2024-08-18T22:17:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000461218, 2024-08-18T22:17:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000230609 2024-08-18T22:17:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_sessions": { 2024-08-18T22:17:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: "session_count": 1, 2024-08-18T22:17:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: "session_add": 3, 2024-08-18T22:17:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "session_remove": 2, 2024-08-18T22:17:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_open": 1, 2024-08-18T22:17:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_stale": 0, 2024-08-18T22:17:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "total_load": 6935, 2024-08-18T22:17:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "average_load": 6935, 2024-08-18T22:17:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "avg_session_uptime": 558, 2024-08-18T22:17:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "mdthresh_evicted": 0 2024-08-18T22:17:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-08-18T22:17:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 360, 2024-08-18T22:17:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 360, 2024-08-18T22:17:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:17:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:17:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:17:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:17:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:17:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:17:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:17:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:17:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:17:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:17:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:17:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:17:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:17:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-08-18T22:17:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:17:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-08-18T22:17:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:17:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:17:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:17:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:17:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:17:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:17:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:17:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-08-18T22:17:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:17:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:17:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:17:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-08-18T22:17:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-08-18T22:17:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-08-18T22:17:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:17:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:17:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:17:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:17:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 287189, 2024-08-18T22:17:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 108, 2024-08-18T22:17:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 88, 2024-08-18T22:17:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 1, 2024-08-18T22:17:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-08-18T22:17:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-08-18T22:17:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:17:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-08-18T22:17:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:17:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-08-18T22:17:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 8856, 2024-08-18T22:17:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 166, 2024-08-18T22:17:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:17:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:17:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-08-18T22:17:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-08-18T22:17:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 312668, 2024-08-18T22:17:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 2731, 2024-08-18T22:17:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-08-18T22:17:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-08-18T22:17:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-08-18T22:17:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-08-18T22:17:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "objecter": { 2024-08-18T22:17:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "op_active": 0, 2024-08-18T22:17:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: "op_laggy": 0, 2024-08-18T22:17:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send": 148434, 2024-08-18T22:17:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send_bytes": 276746665, 2024-08-18T22:17:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: "op_resend": 32, 2024-08-18T22:17:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: "op_reply": 148434, 2024-08-18T22:17:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: "op_latency": { 2024-08-18T22:17:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 148434, 2024-08-18T22:17:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 41279.516513666, 2024-08-18T22:17:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.278100142 2024-08-18T22:17:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: "op_inflight": 0, 2024-08-18T22:17:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: "oplen_avg": { 2024-08-18T22:17:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 148435, 2024-08-18T22:17:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 245548 2024-08-18T22:17:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "op": 148435, 2024-08-18T22:17:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "op_r": 37198, 2024-08-18T22:17:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "op_w": 111237, 2024-08-18T22:17:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "op_rmw": 0, 2024-08-18T22:17:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "op_pg": 0, 2024-08-18T22:17:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_stat": 6317, 2024-08-18T22:17:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_create": 55966, 2024-08-18T22:17:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_read": 240, 2024-08-18T22:17:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_write": 12684, 2024-08-18T22:17:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writefull": 238, 2024-08-18T22:17:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writesame": 0, 2024-08-18T22:17:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_append": 0, 2024-08-18T22:17:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_zero": 0, 2024-08-18T22:17:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_truncate": 5, 2024-08-18T22:17:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_delete": 34392, 2024-08-18T22:17:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_mapext": 0, 2024-08-18T22:17:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_sparse_read": 0, 2024-08-18T22:17:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_clonerange": 0, 2024-08-18T22:17:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_getxattr": 36782, 2024-08-18T22:17:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_setxattr": 84586, 2024-08-18T22:17:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_cmpxattr": 0, 2024-08-18T22:17:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_rmxattr": 0, 2024-08-18T22:17:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_resetxattrs": 0, 2024-08-18T22:17:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_call": 0, 2024-08-18T22:17:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_watch": 0, 2024-08-18T22:17:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_notify": 0, 2024-08-18T22:17:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_src_cmpxattr": 0, 2024-08-18T22:17:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls": 0, 2024-08-18T22:17:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls_filter": 0, 2024-08-18T22:17:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_other": 1, 2024-08-18T22:17:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_active": 0, 2024-08-18T22:17:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_send": 0, 2024-08-18T22:17:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_resend": 0, 2024-08-18T22:17:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_ping": 0, 2024-08-18T22:17:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_active": 0, 2024-08-18T22:17:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_send": 0, 2024-08-18T22:17:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_resend": 0, 2024-08-18T22:17:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_active": 0, 2024-08-18T22:17:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_send": 0, 2024-08-18T22:17:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_resend": 0, 2024-08-18T22:17:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_active": 0, 2024-08-18T22:17:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_send": 0, 2024-08-18T22:17:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_resend": 0, 2024-08-18T22:17:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: "command_active": 0, 2024-08-18T22:17:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: "command_send": 0, 2024-08-18T22:17:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: "command_resend": 0, 2024-08-18T22:17:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: "map_epoch": 96, 2024-08-18T22:17:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: "map_full": 0, 2024-08-18T22:17:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: "map_inc": 14, 2024-08-18T22:17:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_sessions": 12, 2024-08-18T22:17:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_open": 12, 2024-08-18T22:17:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_close": 0, 2024-08-18T22:17:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_laggy": 0, 2024-08-18T22:17:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_wr": 13570, 2024-08-18T22:17:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_rd": 362, 2024-08-18T22:17:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_del": 405 2024-08-18T22:17:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "oft": { 2024-08-18T22:17:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_objs": 1, 2024-08-18T22:17:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_kv_pairs": 0, 2024-08-18T22:17:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_updates": 0, 2024-08-18T22:17:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_removes": 0 2024-08-18T22:17:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: "osd-slow-ops": { 2024-08-18T22:17:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_ops_count": 25874 2024-08-18T22:17:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: "purge_queue": { 2024-08-18T22:17:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops": 0, 2024-08-18T22:17:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops_high_water": 80, 2024-08-18T22:17:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing": 0, 2024-08-18T22:17:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_high_water": 16, 2024-08-18T22:17:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed_ops": 32635, 2024-08-18T22:17:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed": 16340, 2024-08-18T22:17:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_item_in_journal": 0 2024-08-18T22:17:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:17:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-08-18T22:17:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 272566, 2024-08-18T22:17:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 130501229, 2024-08-18T22:17:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 272566, 2024-08-18T22:17:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-08-18T22:17:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-08-18T22:17:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 272566, 2024-08-18T22:17:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 130501229, 2024-08-18T22:17:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_bytes": { 2024-08-18T22:17:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-08-18T22:17:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-08-18T22:17:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-08-18T22:17:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-08-18T22:17:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 148435, 2024-08-18T22:17:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 278524088, 2024-08-18T22:17:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 148435, 2024-08-18T22:17:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 278524088, 2024-08-18T22:17:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_ops": { 2024-08-18T22:17:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 1024, 2024-08-18T22:17:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-08-18T22:17:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-08-18T22:17:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-08-18T22:17:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 148435, 2024-08-18T22:17:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 148435, 2024-08-18T22:17:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 148435, 2024-08-18T22:17:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 148435, 2024-08-18T22:17:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle": { 2024-08-18T22:17:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-08-18T22:17:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 16340, 2024-08-18T22:17:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 1780150, 2024-08-18T22:17:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 16340, 2024-08-18T22:17:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-08-18T22:17:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-08-18T22:17:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 234, 2024-08-18T22:17:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 1780150, 2024-08-18T22:17:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle-0x560b4a6f0960": { 2024-08-18T22:17:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-08-18T22:17:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 92735, 2024-08-18T22:17:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 205869548, 2024-08-18T22:17:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 92735, 2024-08-18T22:17:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-08-18T22:17:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-08-18T22:17:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 12450, 2024-08-18T22:17:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 205869548, 2024-08-18T22:17:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:04.948 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-08-18T22:17:05.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:05 smithi123 ceph-mon[18462]: pgmap v623: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-18T22:17:05.570 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:05 smithi183 ceph-mon[22097]: pgmap v623: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-18T22:17:05.571 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:05 smithi130 ceph-mon[21698]: pgmap v623: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-18T22:17:05.572 INFO:tasks.check_counter:Daemon mds.i mds.exported=222 2024-08-18T22:17:05.573 INFO:tasks.check_counter:Daemon mds.i mds.imported=223 2024-08-18T22:17:05.573 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=1820 2024-08-18T22:17:05.573 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=1008 2024-08-18T22:17:05.573 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=158 2024-08-18T22:17:05.573 DEBUG:tasks.check_counter:Getting stats from l 2024-08-18T22:17:05.574 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph daemon mds.l perf dump 2024-08-18T22:17:05.826 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.c/config 2024-08-18T22:17:06.342 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-08-18T22:17:06.343 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:17:06.343 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 4, 2024-08-18T22:17:06.343 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 4, 2024-08-18T22:17:06.343 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 3024, 2024-08-18T22:17:06.343 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 448, 2024-08-18T22:17:06.343 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 4, 2024-08-18T22:17:06.343 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 0, 2024-08-18T22:17:06.343 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.003176888, 2024-08-18T22:17:06.343 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.000035787, 2024-08-18T22:17:06.344 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.002243581, 2024-08-18T22:17:06.344 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:17:06.344 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:17:06.344 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 3, 2024-08-18T22:17:06.344 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.003980202, 2024-08-18T22:17:06.344 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.001326734 2024-08-18T22:17:06.344 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:06.344 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:17:06.345 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:06.345 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:06.345 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:06.345 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:06.345 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-08-18T22:17:06.345 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 448 2024-08-18T22:17:06.346 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:06.346 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:17:06.346 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 204, 2024-08-18T22:17:06.346 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 201, 2024-08-18T22:17:06.346 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 474128, 2024-08-18T22:17:06.347 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 123408, 2024-08-18T22:17:06.347 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 2, 2024-08-18T22:17:06.347 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 1, 2024-08-18T22:17:06.347 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.030573176, 2024-08-18T22:17:06.347 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.014523501, 2024-08-18T22:17:06.347 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.020524533, 2024-08-18T22:17:06.347 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:17:06.347 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:17:06.348 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 200, 2024-08-18T22:17:06.348 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.011784258, 2024-08-18T22:17:06.348 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000058921 2024-08-18T22:17:06.348 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:06.348 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:17:06.348 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:06.348 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:06.348 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:06.348 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:06.349 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 474128, 2024-08-18T22:17:06.349 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 123408 2024-08-18T22:17:06.349 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:06.349 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:17:06.349 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 1, 2024-08-18T22:17:06.349 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 153, 2024-08-18T22:17:06.349 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 160, 2024-08-18T22:17:06.349 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 105152, 2024-08-18T22:17:06.350 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 3, 2024-08-18T22:17:06.350 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 2, 2024-08-18T22:17:06.350 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.009113991, 2024-08-18T22:17:06.350 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.006842676, 2024-08-18T22:17:06.350 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.000546638, 2024-08-18T22:17:06.351 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-18T22:17:06.351 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:17:06.351 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 151, 2024-08-18T22:17:06.351 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.009089118, 2024-08-18T22:17:06.352 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000060192 2024-08-18T22:17:06.352 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:06.352 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:17:06.352 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:06.352 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:06.352 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:06.352 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:06.352 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-18T22:17:06.353 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 105152 2024-08-18T22:17:06.353 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:06.353 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-08-18T22:17:06.353 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 0, 2024-08-18T22:17:06.353 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-08-18T22:17:06.353 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:06.353 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-08-18T22:17:06.353 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 0, 2024-08-18T22:17:06.354 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 0, 2024-08-18T22:17:06.354 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:17:06.354 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:17:06.354 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:17:06.354 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:17:06.354 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:17:06.354 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:17:06.355 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:17:06.355 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:17:06.355 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:17:06.355 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:17:06.355 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:17:06.355 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:17:06.355 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:17:06.355 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-08-18T22:17:06.356 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:17:06.356 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-08-18T22:17:06.356 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:17:06.356 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:17:06.356 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:17:06.356 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:17:06.356 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:17:06.357 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:17:06.357 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:17:06.357 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-08-18T22:17:06.357 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:17:06.357 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:17:06.357 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:17:06.357 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-08-18T22:17:06.357 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-08-18T22:17:06.358 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-08-18T22:17:06.358 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:17:06.358 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:17:06.358 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:17:06.358 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:17:06.358 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 148984, 2024-08-18T22:17:06.358 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 30, 2024-08-18T22:17:06.359 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 0, 2024-08-18T22:17:06.359 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 0, 2024-08-18T22:17:06.359 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-08-18T22:17:06.359 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-08-18T22:17:06.359 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:17:06.359 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-08-18T22:17:06.359 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:17:06.359 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-08-18T22:17:06.359 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 0, 2024-08-18T22:17:06.360 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 0, 2024-08-18T22:17:06.360 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:17:06.360 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:17:06.360 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-08-18T22:17:06.360 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-08-18T22:17:06.361 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 928, 2024-08-18T22:17:06.361 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 2, 2024-08-18T22:17:06.361 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-08-18T22:17:06.361 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-08-18T22:17:06.361 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-08-18T22:17:06.361 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-08-18T22:17:06.361 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-08-18T22:17:06.362 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:17:06.362 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-08-18T22:17:06.362 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-08-18T22:17:06.362 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-08-18T22:17:06.362 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 205, 2024-08-18T22:17:06.362 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 445320, 2024-08-18T22:17:06.362 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-08-18T22:17:06.362 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 205, 2024-08-18T22:17:06.362 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-08-18T22:17:06.362 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-08-18T22:17:06.363 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 205, 2024-08-18T22:17:06.363 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 445320, 2024-08-18T22:17:06.363 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-08-18T22:17:06.363 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-08-18T22:17:06.363 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-08-18T22:17:06.363 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-08-18T22:17:06.363 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:06.363 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-08-18T22:17:06.363 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-08-18T22:17:07.025 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-08-18T22:17:07.026 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-08-18T22:17:07.026 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-08-18T22:17:07.026 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-08-18T22:17:07.026 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-08-18T22:17:07.027 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-18T22:17:07.038 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-18T22:17:07.038 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T22:17:07.039 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:17:07.069 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T22:17:07.070 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:17:07.129 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-18T22:17:07.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:07 smithi183 ceph-mon[22097]: pgmap v624: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-18T22:17:07.432 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:17:07.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:07 smithi123 ceph-mon[18462]: pgmap v624: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-18T22:17:07.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:07 smithi130 ceph-mon[21698]: pgmap v624: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-18T22:17:07.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.932+0000 7fc099a5c640 1 -- 172.21.15.123:0/14001059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0941078c0 msgr2=0x7fc094107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:07.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.932+0000 7fc099a5c640 1 --2- 172.21.15.123:0/14001059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0941078c0 0x7fc094107ca0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc084009cd0 tx=0x7fc08402a8e0 comp rx=0 tx=0).stop 2024-08-18T22:17:07.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.933+0000 7fc099a5c640 1 -- 172.21.15.123:0/14001059 shutdown_connections 2024-08-18T22:17:07.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.933+0000 7fc099a5c640 1 --2- 172.21.15.123:0/14001059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc094102260 0x7fc09410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:07.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.933+0000 7fc099a5c640 1 --2- 172.21.15.123:0/14001059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0941018c0 0x7fc094101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:07.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.933+0000 7fc099a5c640 1 --2- 172.21.15.123:0/14001059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0941078c0 0x7fc094107ca0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.933+0000 7fc099a5c640 1 -- 172.21.15.123:0/14001059 >> 172.21.15.123:0/14001059 conn(0x7fc0940fd5e0 msgr2=0x7fc0940ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.933+0000 7fc099a5c640 1 -- 172.21.15.123:0/14001059 shutdown_connections 2024-08-18T22:17:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.933+0000 7fc099a5c640 1 -- 172.21.15.123:0/14001059 wait complete. 2024-08-18T22:17:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.933+0000 7fc099a5c640 1 Processor -- start 2024-08-18T22:17:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.933+0000 7fc099a5c640 1 -- start start 2024-08-18T22:17:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.933+0000 7fc099a5c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0941018c0 0x7fc094198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.933+0000 7fc099a5c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc094102260 0x7fc094198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.933+0000 7fc099a5c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0941078c0 0x7fc09419cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:07.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.933+0000 7fc099a5c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc094111ce0 con 0x7fc0941018c0 2024-08-18T22:17:07.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.933+0000 7fc099a5c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc094111b60 con 0x7fc094102260 2024-08-18T22:17:07.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc099a5c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc094111e60 con 0x7fc0941078c0 2024-08-18T22:17:07.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc092ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0941018c0 0x7fc094198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:07.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc092ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0941018c0 0x7fc094198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37590/0 (socket says 172.21.15.123:37590) 2024-08-18T22:17:07.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc092ffd640 1 -- 172.21.15.123:0/4120462911 learned_addr learned my addr 172.21.15.123:0/4120462911 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:17:07.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc0927fc640 1 --2- 172.21.15.123:0/4120462911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc094102260 0x7fc094198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:07.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc0937fe640 1 --2- 172.21.15.123:0/4120462911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0941078c0 0x7fc09419cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:07.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc092ffd640 1 -- 172.21.15.123:0/4120462911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0941078c0 msgr2=0x7fc09419cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc092ffd640 1 --2- 172.21.15.123:0/4120462911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0941078c0 0x7fc09419cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc092ffd640 1 -- 172.21.15.123:0/4120462911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc094102260 msgr2=0x7fc094198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc092ffd640 1 --2- 172.21.15.123:0/4120462911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc094102260 0x7fc094198790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc092ffd640 1 -- 172.21.15.123:0/4120462911 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09419d200 con 0x7fc0941018c0 2024-08-18T22:17:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc0927fc640 1 --2- 172.21.15.123:0/4120462911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc094102260 0x7fc094198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:17:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc092ffd640 1 --2- 172.21.15.123:0/4120462911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0941018c0 0x7fc094198250 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc08402ae00 tx=0x7fc084003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc098a5a640 1 -- 172.21.15.123:0/4120462911 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc084004040 con 0x7fc0941018c0 2024-08-18T22:17:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc098a5a640 1 -- 172.21.15.123:0/4120462911 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0840046c0 con 0x7fc0941018c0 2024-08-18T22:17:07.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc098a5a640 1 -- 172.21.15.123:0/4120462911 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc084046480 con 0x7fc0941018c0 2024-08-18T22:17:07.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc099a5c640 1 -- 172.21.15.123:0/4120462911 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc09419d490 con 0x7fc0941018c0 2024-08-18T22:17:07.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.934+0000 7fc099a5c640 1 -- 172.21.15.123:0/4120462911 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0941a4dd0 con 0x7fc0941018c0 2024-08-18T22:17:07.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.935+0000 7fc099a5c640 1 -- 172.21.15.123:0/4120462911 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc094101d20 con 0x7fc0941018c0 2024-08-18T22:17:07.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.936+0000 7fc098a5a640 1 -- 172.21.15.123:0/4120462911 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fc0840305a0 con 0x7fc0941018c0 2024-08-18T22:17:07.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.937+0000 7fc098a5a640 1 --2- 172.21.15.123:0/4120462911 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0800a2b80 0x7fc0800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:07.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.937+0000 7fc0927fc640 1 --2- 172.21.15.123:0/4120462911 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0800a2b80 0x7fc0800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:07.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.937+0000 7fc098a5a640 1 -- 172.21.15.123:0/4120462911 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7fc08402e030 con 0x7fc0941018c0 2024-08-18T22:17:07.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.938+0000 7fc0927fc640 1 --2- 172.21.15.123:0/4120462911 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0800a2b80 0x7fc0800a5040 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc0940ffc90 tx=0x7fc07c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:07.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:07.941+0000 7fc098a5a640 1 -- 172.21.15.123:0/4120462911 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fc08404b060 con 0x7fc0941018c0 2024-08-18T22:17:08.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:08.117+0000 7fc099a5c640 1 -- 172.21.15.123:0/4120462911 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc094109e30 con 0x7fc0941018c0 2024-08-18T22:17:08.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:08.117+0000 7fc098a5a640 1 -- 172.21.15.123:0/4120462911 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v96) ==== 81+0+602 (secure 0 0 0) 0x7fc084030890 con 0x7fc0941018c0 2024-08-18T22:17:08.119 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/4048905381 2024-08-19T21:59:09.243300+0000 2024-08-18T22:17:08.119 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/4048905381 2024-08-19T21:59:09.243300+0000 2024-08-18T22:17:08.119 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3344429295 2024-08-19T21:58:46.762466+0000 2024-08-18T22:17:08.119 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1091246574 2024-08-19T21:58:46.762466+0000 2024-08-18T22:17:08.119 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1435078155 2024-08-19T21:59:09.243300+0000 2024-08-18T22:17:08.120 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3196395967 2024-08-19T21:58:46.762466+0000 2024-08-18T22:17:08.120 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3505218516 2024-08-19T21:59:09.243300+0000 2024-08-18T22:17:08.120 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2299071339 2024-08-19T21:59:09.243300+0000 2024-08-18T22:17:08.120 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/1909168969 2024-08-19T21:58:46.762466+0000 2024-08-18T22:17:08.120 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/1909168969 2024-08-19T21:58:46.762466+0000 2024-08-18T22:17:08.121 INFO:teuthology.orchestra.run.smithi123.stderr:listed 10 entries 2024-08-18T22:17:08.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:08.119+0000 7fc099a5c640 1 -- 172.21.15.123:0/4120462911 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0800a2b80 msgr2=0x7fc0800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:08.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:08.119+0000 7fc099a5c640 1 --2- 172.21.15.123:0/4120462911 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0800a2b80 0x7fc0800a5040 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc0940ffc90 tx=0x7fc07c008040 comp rx=0 tx=0).stop 2024-08-18T22:17:08.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:08.119+0000 7fc099a5c640 1 -- 172.21.15.123:0/4120462911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0941018c0 msgr2=0x7fc094198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:08.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:08.119+0000 7fc099a5c640 1 --2- 172.21.15.123:0/4120462911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0941018c0 0x7fc094198250 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc08402ae00 tx=0x7fc084003970 comp rx=0 tx=0).stop 2024-08-18T22:17:08.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:08.119+0000 7fc099a5c640 1 -- 172.21.15.123:0/4120462911 shutdown_connections 2024-08-18T22:17:08.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:08.119+0000 7fc099a5c640 1 --2- 172.21.15.123:0/4120462911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0941078c0 0x7fc09419cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:08.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:08.119+0000 7fc099a5c640 1 --2- 172.21.15.123:0/4120462911 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fc0800a2b80 0x7fc0800a5040 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:08.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:08.119+0000 7fc099a5c640 1 --2- 172.21.15.123:0/4120462911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc094102260 0x7fc094198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:08.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:08.119+0000 7fc099a5c640 1 --2- 172.21.15.123:0/4120462911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0941018c0 0x7fc094198250 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:08.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:08.119+0000 7fc099a5c640 1 -- 172.21.15.123:0/4120462911 >> 172.21.15.123:0/4120462911 conn(0x7fc0940fd5e0 msgr2=0x7fc0940fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:08.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:08.119+0000 7fc099a5c640 1 -- 172.21.15.123:0/4120462911 shutdown_connections 2024-08-18T22:17:08.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:08.120+0000 7fc099a5c640 1 -- 172.21.15.123:0/4120462911 wait complete. 2024-08-18T22:17:08.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:08 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/4120462911' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-18T22:17:08.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:08 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/4120462911' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-18T22:17:08.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:08 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/4120462911' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-18T22:17:08.913 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:17:08.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:17:08.913 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-18T22:17:09.040 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-08-18T22:17:09.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:17:09.041 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:17:09.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:17:09.090 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-08-18T22:17:09.168 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:17:09.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:17:09.169 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:17:09.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:17:09.195 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-08-18T22:17:09.296 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-18T22:17:09.297 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-18T22:17:09.297 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:17:09.313 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055807,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497476k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248736k,nr_inodes=812184,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/f85d27fba7dcc0276a9c0d336483c59638564a2cd9bd7237c839047ddc6b9490/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/RBZLGE5CMJ5GDYIJWPWZTGQWYA:/var/lib/containers/storage/overlay/l/OSUCWWO7WM5RQ2YKFBFPWTIJKL,upperdir=/var/lib/containers/storage/overlay/f85d27fba7dcc0276a9c0d336483c59638564a2cd9bd7237c839047ddc6b9490/diff,workdir=/var/lib/containers/storage/overlay/f85d27fba7dcc0276a9c0d336483c59638564a2cd9bd7237c839047ddc6b9490/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/3f5208081e862364f43b0bdeb6e50d55122e6c36be40db475e15683b8ae5afef/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/RBZLGE5CMJ5GDYIJWPWZTGQWYA:/var/lib/containers/storage/overlay/l/OSUCWWO7WM5RQ2YKFBFPWTIJKL,upperdir=/var/lib/containers/storage/overlay/3f5208081e862364f43b0bdeb6e50d55122e6c36be40db475e15683b8ae5afef/diff,workdir=/var/lib/containers/storage/overlay/3f5208081e862364f43b0bdeb6e50d55122e6c36be40db475e15683b8ae5afef/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248736k,nr_inodes=812184,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/022e868d9be277263a8f20a8b2000ae27c0cc4f25a8e5c058349bf10061e9fc7/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/RBZLGE5CMJ5GDYIJWPWZTGQWYA:/var/lib/containers/storage/overlay/l/OSUCWWO7WM5RQ2YKFBFPWTIJKL,upperdir=/var/lib/containers/storage/overlay/022e868d9be277263a8f20a8b2000ae27c0cc4f25a8e5c058349bf10061e9fc7/diff,workdir=/var/lib/containers/storage/overlay/022e868d9be277263a8f20a8b2000ae27c0cc4f25a8e5c058349bf10061e9fc7/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/1f89ca5bde06412ae304cc60384d28ed2b9fd12a80e9bf41623f7ab470005c4c/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/RBZLGE5CMJ5GDYIJWPWZTGQWYA:/var/lib/containers/storage/overlay/l/OSUCWWO7WM5RQ2YKFBFPWTIJKL,upperdir=/var/lib/containers/storage/overlay/1f89ca5bde06412ae304cc60384d28ed2b9fd12a80e9bf41623f7ab470005c4c/diff,workdir=/var/lib/containers/storage/overlay/1f89ca5bde06412ae304cc60384d28ed2b9fd12a80e9bf41623f7ab470005c4c/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f4ae48aff30dd2e1b73f9a50ecd11fe74d42b6e07b96bb1956bf2cf8355a5b66/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/RBZLGE5CMJ5GDYIJWPWZTGQWYA:/var/lib/containers/storage/overlay/l/OSUCWWO7WM5RQ2YKFBFPWTIJKL,upperdir=/var/lib/containers/storage/overlay/f4ae48aff30dd2e1b73f9a50ecd11fe74d42b6e07b96bb1956bf2cf8355a5b66/diff,workdir=/var/lib/containers/storage/overlay/f4ae48aff30dd2e1b73f9a50ecd11fe74d42b6e07b96bb1956bf2cf8355a5b66/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f762c9807ac6a04b82b1c10a91803697e953eb76f06945fe19b1573033c3f056/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/RBZLGE5CMJ5GDYIJWPWZTGQWYA:/var/lib/containers/storage/overlay/l/OSUCWWO7WM5RQ2YKFBFPWTIJKL,upperdir=/var/lib/containers/storage/overlay/f762c9807ac6a04b82b1c10a91803697e953eb76f06945fe19b1573033c3f056/diff,workdir=/var/lib/containers/storage/overlay/f762c9807ac6a04b82b1c10a91803697e953eb76f06945fe19b1573033c3f056/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/6fbdd3ce5c76966dd230bfa817a60394018dc201e644c858711bb12efa7285d3/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/RBZLGE5CMJ5GDYIJWPWZTGQWYA:/var/lib/containers/storage/overlay/l/OSUCWWO7WM5RQ2YKFBFPWTIJKL,upperdir=/var/lib/containers/storage/overlay/6fbdd3ce5c76966dd230bfa817a60394018dc201e644c858711bb12efa7285d3/diff,workdir=/var/lib/containers/storage/overlay/6fbdd3ce5c76966dd230bfa817a60394018dc201e644c858711bb12efa7285d3/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a17abd626c07b13c434029397d6210195bba25b9ab70377a89ddb46178fdb0d2/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/RBZLGE5CMJ5GDYIJWPWZTGQWYA:/var/lib/containers/storage/overlay/l/OSUCWWO7WM5RQ2YKFBFPWTIJKL,upperdir=/var/lib/containers/storage/overlay/a17abd626c07b13c434029397d6210195bba25b9ab70377a89ddb46178fdb0d2/diff,workdir=/var/lib/containers/storage/overlay/a17abd626c07b13c434029397d6210195bba25b9ab70377a89ddb46178fdb0d2/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/bd713078f547564557107d4b9534758ceae6ad7f6936ff75cdf2d5ade9dc3994/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/RBZLGE5CMJ5GDYIJWPWZTGQWYA:/var/lib/containers/storage/overlay/l/OSUCWWO7WM5RQ2YKFBFPWTIJKL,upperdir=/var/lib/containers/storage/overlay/bd713078f547564557107d4b9534758ceae6ad7f6936ff75cdf2d5ade9dc3994/diff,workdir=/var/lib/containers/storage/overlay/bd713078f547564557107d4b9534758ceae6ad7f6936ff75cdf2d5ade9dc3994/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f681884c48f56e5074e1346ba4c08969df14a731fffad6d4adb1ff859766e2da/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/RBZLGE5CMJ5GDYIJWPWZTGQWYA:/var/lib/containers/storage/overlay/l/OSUCWWO7WM5RQ2YKFBFPWTIJKL,upperdir=/var/lib/containers/storage/overlay/f681884c48f56e5074e1346ba4c08969df14a731fffad6d4adb1ff859766e2da/diff,workdir=/var/lib/containers/storage/overlay/f681884c48f56e5074e1346ba4c08969df14a731fffad6d4adb1ff859766e2da/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497476k,nr_inodes=819200,mode=755,inode64 0 0 2024-08-18T22:17:09.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:17:09.314 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-08-18T22:17:09.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:17:09.369 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-08-18T22:17:09.486 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:09 smithi123 ceph-mon[18462]: pgmap v625: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:17:09.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:09 smithi130 ceph-mon[21698]: pgmap v625: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:17:09.515 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-08-18T22:17:09.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:17:09.518 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-18T22:17:09.528 INFO:tasks.cephadm:Teardown begin 2024-08-18T22:17:09.528 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:17:09.528 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:17:09.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:09 smithi183 ceph-mon[22097]: pgmap v625: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-18T22:17:09.779 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:17:10.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.253+0000 7febf52f6640 1 -- 172.21.15.123:0/897543103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febf0100b50 msgr2=0x7febf0100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:10.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.253+0000 7febf52f6640 1 --2- 172.21.15.123:0/897543103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febf0100b50 0x7febf0100f30 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7febe0009900 tx=0x7febe002a480 comp rx=0 tx=0).stop 2024-08-18T22:17:10.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.253+0000 7febf52f6640 1 -- 172.21.15.123:0/897543103 shutdown_connections 2024-08-18T22:17:10.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.253+0000 7febf52f6640 1 --2- 172.21.15.123:0/897543103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf0102c20 0x7febf010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:10.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.253+0000 7febf52f6640 1 --2- 172.21.15.123:0/897543103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf01022a0 0x7febf01026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:10.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.253+0000 7febf52f6640 1 --2- 172.21.15.123:0/897543103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febf0100b50 0x7febf0100f30 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:10.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.253+0000 7febf52f6640 1 -- 172.21.15.123:0/897543103 >> 172.21.15.123:0/897543103 conn(0x7febf00fc500 msgr2=0x7febf00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:10.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.253+0000 7febf52f6640 1 -- 172.21.15.123:0/897543103 shutdown_connections 2024-08-18T22:17:10.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.253+0000 7febf52f6640 1 -- 172.21.15.123:0/897543103 wait complete. 2024-08-18T22:17:10.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.254+0000 7febf52f6640 1 Processor -- start 2024-08-18T22:17:10.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.254+0000 7febf52f6640 1 -- start start 2024-08-18T22:17:10.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.254+0000 7febf52f6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf0100b50 0x7febf01981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:10.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.254+0000 7febf52f6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf01022a0 0x7febf0198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:10.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.254+0000 7febf52f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febf0102c20 0x7febf019cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:10.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.254+0000 7febf52f6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7febf0111dd0 con 0x7febf0102c20 2024-08-18T22:17:10.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.254+0000 7febf52f6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7febf0111c50 con 0x7febf01022a0 2024-08-18T22:17:10.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.254+0000 7febf52f6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7febf0111f50 con 0x7febf0100b50 2024-08-18T22:17:10.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.254+0000 7febef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febf0102c20 0x7febf019cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:10.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.254+0000 7febef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febf0102c20 0x7febf019cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37606/0 (socket says 172.21.15.123:37606) 2024-08-18T22:17:10.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.254+0000 7febef7fe640 1 -- 172.21.15.123:0/4230954408 learned_addr learned my addr 172.21.15.123:0/4230954408 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:17:10.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.254+0000 7febeeffd640 1 --2- 172.21.15.123:0/4230954408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf0100b50 0x7febf01981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:10.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.254+0000 7febee7fc640 1 --2- 172.21.15.123:0/4230954408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf01022a0 0x7febf0198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:10.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.255+0000 7febef7fe640 1 -- 172.21.15.123:0/4230954408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf0100b50 msgr2=0x7febf01981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:10.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.255+0000 7febef7fe640 1 --2- 172.21.15.123:0/4230954408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf0100b50 0x7febf01981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:10.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.255+0000 7febef7fe640 1 -- 172.21.15.123:0/4230954408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf01022a0 msgr2=0x7febf0198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:10.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.255+0000 7febef7fe640 1 --2- 172.21.15.123:0/4230954408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf01022a0 0x7febf0198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:10.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.255+0000 7febef7fe640 1 -- 172.21.15.123:0/4230954408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf019d1a0 con 0x7febf0102c20 2024-08-18T22:17:10.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.255+0000 7febef7fe640 1 --2- 172.21.15.123:0/4230954408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febf0102c20 0x7febf019cac0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7febe800eaa0 tx=0x7febe800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:10.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.255+0000 7febd7fff640 1 -- 172.21.15.123:0/4230954408 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe800cdb0 con 0x7febf0102c20 2024-08-18T22:17:10.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.255+0000 7febf52f6640 1 -- 172.21.15.123:0/4230954408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf019d490 con 0x7febf0102c20 2024-08-18T22:17:10.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.255+0000 7febd7fff640 1 -- 172.21.15.123:0/4230954408 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febe8005020 con 0x7febf0102c20 2024-08-18T22:17:10.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.255+0000 7febd7fff640 1 -- 172.21.15.123:0/4230954408 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe80116b0 con 0x7febf0102c20 2024-08-18T22:17:10.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.255+0000 7febf52f6640 1 -- 172.21.15.123:0/4230954408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf01a4d70 con 0x7febf0102c20 2024-08-18T22:17:10.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.256+0000 7febf52f6640 1 -- 172.21.15.123:0/4230954408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febf0100f30 con 0x7febf0102c20 2024-08-18T22:17:10.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.257+0000 7febd7fff640 1 -- 172.21.15.123:0/4230954408 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7febe8005560 con 0x7febf0102c20 2024-08-18T22:17:10.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.258+0000 7febd7fff640 1 --2- 172.21.15.123:0/4230954408 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7febd80a2b80 0x7febd80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:10.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.258+0000 7febeeffd640 1 --2- 172.21.15.123:0/4230954408 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7febd80a2b80 0x7febd80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:10.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.258+0000 7febd7fff640 1 -- 172.21.15.123:0/4230954408 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7febe80cf5a0 con 0x7febf0102c20 2024-08-18T22:17:10.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.258+0000 7febeeffd640 1 --2- 172.21.15.123:0/4230954408 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7febd80a2b80 0x7febd80a5040 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7febe0009230 tx=0x7febe00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:10.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.262+0000 7febd7fff640 1 -- 172.21.15.123:0/4230954408 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7febe8016030 con 0x7febf0102c20 2024-08-18T22:17:10.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.463+0000 7febf52f6640 1 -- 172.21.15.123:0/4230954408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febf0108dc0 con 0x7febf0102c20 2024-08-18T22:17:10.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.463+0000 7febd7fff640 1 -- 172.21.15.123:0/4230954408 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11930 (secure 0 0 0) 0x7febe809bb20 con 0x7febf0102c20 2024-08-18T22:17:10.465 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:17:10.465 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":36,"btime":"2024-08-18T22:16:19:519031+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:16:18.935695+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":125,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":171,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:17:10.465 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 36 2024-08-18T22:17:10.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.466+0000 7febf52f6640 1 -- 172.21.15.123:0/4230954408 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7febd80a2b80 msgr2=0x7febd80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:10.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.466+0000 7febf52f6640 1 --2- 172.21.15.123:0/4230954408 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7febd80a2b80 0x7febd80a5040 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7febe0009230 tx=0x7febe00058d0 comp rx=0 tx=0).stop 2024-08-18T22:17:10.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.466+0000 7febf52f6640 1 -- 172.21.15.123:0/4230954408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febf0102c20 msgr2=0x7febf019cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:10.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.466+0000 7febf52f6640 1 --2- 172.21.15.123:0/4230954408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febf0102c20 0x7febf019cac0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7febe800eaa0 tx=0x7febe800ef60 comp rx=0 tx=0).stop 2024-08-18T22:17:10.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.466+0000 7febf52f6640 1 -- 172.21.15.123:0/4230954408 shutdown_connections 2024-08-18T22:17:10.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.466+0000 7febf52f6640 1 --2- 172.21.15.123:0/4230954408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febf0102c20 0x7febf019cac0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:10.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.466+0000 7febf52f6640 1 --2- 172.21.15.123:0/4230954408 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7febd80a2b80 0x7febd80a5040 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:10.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.466+0000 7febf52f6640 1 --2- 172.21.15.123:0/4230954408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf01022a0 0x7febf0198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:10.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.466+0000 7febf52f6640 1 --2- 172.21.15.123:0/4230954408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf0100b50 0x7febf01981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:10.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.466+0000 7febf52f6640 1 -- 172.21.15.123:0/4230954408 >> 172.21.15.123:0/4230954408 conn(0x7febf00fc500 msgr2=0x7febf00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:10.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.466+0000 7febf52f6640 1 -- 172.21.15.123:0/4230954408 shutdown_connections 2024-08-18T22:17:10.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:10.466+0000 7febf52f6640 1 -- 172.21.15.123:0/4230954408 wait complete. 2024-08-18T22:17:11.206 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:17:11.458 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:17:11.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:11 smithi123 ceph-mon[18462]: pgmap v626: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-18T22:17:11.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:11 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/4230954408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:17:11.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:11 smithi130 ceph-mon[21698]: pgmap v626: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-18T22:17:11.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:11 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/4230954408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:17:11.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:11 smithi183 ceph-mon[22097]: pgmap v626: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-18T22:17:11.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:11 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/4230954408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:17:11.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.953+0000 7f856dd5a640 1 -- 172.21.15.123:0/1251244228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8568101160 msgr2=0x7f856810d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:11.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.953+0000 7f856dd5a640 1 --2- 172.21.15.123:0/1251244228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8568101160 0x7f856810d690 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f8560009cd0 tx=0x7f856002a8e0 comp rx=0 tx=0).stop 2024-08-18T22:17:11.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.953+0000 7f856dd5a640 1 -- 172.21.15.123:0/1251244228 shutdown_connections 2024-08-18T22:17:11.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.953+0000 7f856dd5a640 1 --2- 172.21.15.123:0/1251244228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8568101160 0x7f856810d690 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:11.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.953+0000 7f856dd5a640 1 --2- 172.21.15.123:0/1251244228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85681007c0 0x7f8568100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:11.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.953+0000 7f856dd5a640 1 --2- 172.21.15.123:0/1251244228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85681067c0 0x7f8568106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:11.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.953+0000 7f856dd5a640 1 -- 172.21.15.123:0/1251244228 >> 172.21.15.123:0/1251244228 conn(0x7f85680fc500 msgr2=0x7f85680fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:11.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.953+0000 7f856dd5a640 1 -- 172.21.15.123:0/1251244228 shutdown_connections 2024-08-18T22:17:11.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.953+0000 7f856dd5a640 1 -- 172.21.15.123:0/1251244228 wait complete. 2024-08-18T22:17:11.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f856dd5a640 1 Processor -- start 2024-08-18T22:17:11.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f856dd5a640 1 -- start start 2024-08-18T22:17:11.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f856dd5a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85681007c0 0x7f8568102390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:11.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f856dd5a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8568101160 0x7f85681028d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:11.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f856dd5a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85681067c0 0x7f8568102e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:11.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f856dd5a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8568110be0 con 0x7f85681007c0 2024-08-18T22:17:11.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f856dd5a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8568110a60 con 0x7f85681067c0 2024-08-18T22:17:11.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f856dd5a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8568110d60 con 0x7f8568101160 2024-08-18T22:17:11.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f85677fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85681007c0 0x7f8568102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:11.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f85677fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85681007c0 0x7f8568102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37626/0 (socket says 172.21.15.123:37626) 2024-08-18T22:17:11.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f85677fe640 1 -- 172.21.15.123:0/616349913 learned_addr learned my addr 172.21.15.123:0/616349913 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:17:11.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f8567fff640 1 --2- 172.21.15.123:0/616349913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85681067c0 0x7f8568102e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:11.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f855ffff640 1 --2- 172.21.15.123:0/616349913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8568101160 0x7f85681028d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f85677fe640 1 -- 172.21.15.123:0/616349913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8568101160 msgr2=0x7f85681028d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f85677fe640 1 --2- 172.21.15.123:0/616349913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8568101160 0x7f85681028d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f85677fe640 1 -- 172.21.15.123:0/616349913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85681067c0 msgr2=0x7f8568102e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f85677fe640 1 --2- 172.21.15.123:0/616349913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85681067c0 0x7f8568102e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f85677fe640 1 -- 172.21.15.123:0/616349913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85681a6690 con 0x7f85681007c0 2024-08-18T22:17:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f855ffff640 1 --2- 172.21.15.123:0/616349913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8568101160 0x7f85681028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:17:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.954+0000 7f85677fe640 1 --2- 172.21.15.123:0/616349913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85681007c0 0x7f8568102390 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f855800b4a0 tx=0x7f855800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:11.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.955+0000 7f85657fa640 1 -- 172.21.15.123:0/616349913 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558014070 con 0x7f85681007c0 2024-08-18T22:17:11.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.955+0000 7f85657fa640 1 -- 172.21.15.123:0/616349913 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8558010af0 con 0x7f85681007c0 2024-08-18T22:17:11.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.955+0000 7f856dd5a640 1 -- 172.21.15.123:0/616349913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85681a6980 con 0x7f85681007c0 2024-08-18T22:17:11.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.955+0000 7f85657fa640 1 -- 172.21.15.123:0/616349913 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558017d10 con 0x7f85681007c0 2024-08-18T22:17:11.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.955+0000 7f856dd5a640 1 -- 172.21.15.123:0/616349913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85681a6e70 con 0x7f85681007c0 2024-08-18T22:17:11.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.956+0000 7f856dd5a640 1 -- 172.21.15.123:0/616349913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8568100c20 con 0x7f85681007c0 2024-08-18T22:17:11.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.957+0000 7f85657fa640 1 -- 172.21.15.123:0/616349913 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f8558017070 con 0x7f85681007c0 2024-08-18T22:17:11.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.957+0000 7f85657fa640 1 --2- 172.21.15.123:0/616349913 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f85540a2b80 0x7f85540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:11.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.957+0000 7f855ffff640 1 --2- 172.21.15.123:0/616349913 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f85540a2b80 0x7f85540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:11.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.958+0000 7f85657fa640 1 -- 172.21.15.123:0/616349913 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f85580ce8c0 con 0x7f85681007c0 2024-08-18T22:17:11.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.958+0000 7f855ffff640 1 --2- 172.21.15.123:0/616349913 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f85540a2b80 0x7f85540a5040 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8568103e20 tx=0x7f8550005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:11.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:11.961+0000 7f85657fa640 1 -- 172.21.15.123:0/616349913 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f855809b490 con 0x7f85681007c0 2024-08-18T22:17:12.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:12.163+0000 7f856dd5a640 1 -- 172.21.15.123:0/616349913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85681a7130 con 0x7f85681007c0 2024-08-18T22:17:12.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:12.164+0000 7f85657fa640 1 -- 172.21.15.123:0/616349913 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11930 (secure 0 0 0) 0x7f855809ad90 con 0x7f85681007c0 2024-08-18T22:17:12.165 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:17:12.165 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":36,"btime":"2024-08-18T22:16:19:519031+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3015555290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3015555290},{"type":"v1","addr":"172.21.15.123:6835","nonce":3015555290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1466506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1466506081},{"type":"v1","addr":"172.21.15.123:6837","nonce":1466506081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1921278824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1921278824},{"type":"v1","addr":"172.21.15.123:6839","nonce":1921278824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/344960390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":344960390},{"type":"v1","addr":"172.21.15.123:6841","nonce":344960390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2515758332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2515758332},{"type":"v1","addr":"172.21.15.130:6833","nonce":2515758332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3134276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3134276},{"type":"v1","addr":"172.21.15.183:6833","nonce":3134276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:05:22.597053+0000","modified":"2024-08-18T22:16:18.935695+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24466,"mds_1":24458,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24422":{"gid":24422,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/579024659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":579024659},{"type":"v1","addr":"172.21.15.130:6835","nonce":579024659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/29028326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":29028326},{"type":"v1","addr":"172.21.15.130:6837","nonce":29028326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/1138667446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1138667446},{"type":"v1","addr":"172.21.15.183:6835","nonce":1138667446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.183:6837/1468802140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1468802140},{"type":"v1","addr":"172.21.15.183:6837","nonce":1468802140}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":125,"addr":"172.21.15.130:6839/991946562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":991946562},{"type":"v1","addr":"172.21.15.130:6839","nonce":991946562}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":171,"addr":"172.21.15.183:6839/1902275683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1902275683},{"type":"v1","addr":"172.21.15.183:6839","nonce":1902275683}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24466,"qdb_cluster":[24466,24458,24448]},"id":1}]} 2024-08-18T22:17:12.166 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 36 2024-08-18T22:17:12.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:12.166+0000 7f856dd5a640 1 -- 172.21.15.123:0/616349913 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f85540a2b80 msgr2=0x7f85540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:12.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:12.166+0000 7f856dd5a640 1 --2- 172.21.15.123:0/616349913 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f85540a2b80 0x7f85540a5040 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8568103e20 tx=0x7f8550005ec0 comp rx=0 tx=0).stop 2024-08-18T22:17:12.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:12.166+0000 7f856dd5a640 1 -- 172.21.15.123:0/616349913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85681007c0 msgr2=0x7f8568102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:12.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:12.166+0000 7f856dd5a640 1 --2- 172.21.15.123:0/616349913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85681007c0 0x7f8568102390 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f855800b4a0 tx=0x7f855800b960 comp rx=0 tx=0).stop 2024-08-18T22:17:12.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:12.166+0000 7f856dd5a640 1 -- 172.21.15.123:0/616349913 shutdown_connections 2024-08-18T22:17:12.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:12.166+0000 7f856dd5a640 1 --2- 172.21.15.123:0/616349913 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f85540a2b80 0x7f85540a5040 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:12.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:12.166+0000 7f856dd5a640 1 --2- 172.21.15.123:0/616349913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85681067c0 0x7f8568102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:12.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:12.166+0000 7f856dd5a640 1 --2- 172.21.15.123:0/616349913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8568101160 0x7f85681028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:12.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:12.166+0000 7f856dd5a640 1 --2- 172.21.15.123:0/616349913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85681007c0 0x7f8568102390 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:12.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:12.166+0000 7f856dd5a640 1 -- 172.21.15.123:0/616349913 >> 172.21.15.123:0/616349913 conn(0x7f85680fc500 msgr2=0x7f856806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:12.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:12.166+0000 7f856dd5a640 1 -- 172.21.15.123:0/616349913 shutdown_connections 2024-08-18T22:17:12.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:12.166+0000 7f856dd5a640 1 -- 172.21.15.123:0/616349913 wait complete. 2024-08-18T22:17:12.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:12 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/616349913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:17:12.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:12 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/616349913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:17:12.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:12 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/616349913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:17:13.058 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:17:13.307 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:17:13.429 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:13 smithi123 ceph-mon[18462]: pgmap v627: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-18T22:17:13.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:13 smithi130 ceph-mon[21698]: pgmap v627: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-18T22:17:13.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:13 smithi183 ceph-mon[22097]: pgmap v627: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-18T22:17:13.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.779+0000 7f2d1005b640 1 -- 172.21.15.123:0/2427787257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d081078c0 msgr2=0x7f2d08107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:13.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.779+0000 7f2d1005b640 1 --2- 172.21.15.123:0/2427787257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d081078c0 0x7f2d08107ca0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009cd0 tx=0x7f2cf802a8e0 comp rx=0 tx=0).stop 2024-08-18T22:17:13.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.779+0000 7f2d1005b640 1 -- 172.21.15.123:0/2427787257 shutdown_connections 2024-08-18T22:17:13.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.779+0000 7f2d1005b640 1 --2- 172.21.15.123:0/2427787257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d08102260 0x7f2d0810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:13.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.779+0000 7f2d1005b640 1 --2- 172.21.15.123:0/2427787257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d081018c0 0x7f2d08101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:13.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.779+0000 7f2d1005b640 1 --2- 172.21.15.123:0/2427787257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d081078c0 0x7f2d08107ca0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:13.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.779+0000 7f2d1005b640 1 -- 172.21.15.123:0/2427787257 >> 172.21.15.123:0/2427787257 conn(0x7f2d080fd5e0 msgr2=0x7f2d080ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:13.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.779+0000 7f2d1005b640 1 -- 172.21.15.123:0/2427787257 shutdown_connections 2024-08-18T22:17:13.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.779+0000 7f2d1005b640 1 -- 172.21.15.123:0/2427787257 wait complete. 2024-08-18T22:17:13.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.779+0000 7f2d1005b640 1 Processor -- start 2024-08-18T22:17:13.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d1005b640 1 -- start start 2024-08-18T22:17:13.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d1005b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d081018c0 0x7f2d08074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:13.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d1005b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d08102260 0x7f2d08074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:13.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d1005b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d081078c0 0x7f2d08074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:13.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d1005b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2d08111cc0 con 0x7f2d08102260 2024-08-18T22:17:13.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d1005b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2d08111b40 con 0x7f2d081078c0 2024-08-18T22:17:13.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d1005b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2d08111e40 con 0x7f2d081018c0 2024-08-18T22:17:13.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d0d5f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d08102260 0x7f2d08074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:13.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d0d5f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d08102260 0x7f2d08074760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37034/0 (socket says 172.21.15.123:37034) 2024-08-18T22:17:13.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d0d5f6640 1 -- 172.21.15.123:0/504277252 learned_addr learned my addr 172.21.15.123:0/504277252 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:17:13.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d0e5f8640 1 --2- 172.21.15.123:0/504277252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d081078c0 0x7f2d08074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:13.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d0ddf7640 1 --2- 172.21.15.123:0/504277252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d081018c0 0x7f2d08074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:13.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d0d5f6640 1 -- 172.21.15.123:0/504277252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d081018c0 msgr2=0x7f2d08074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:13.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d0d5f6640 1 --2- 172.21.15.123:0/504277252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d081018c0 0x7f2d08074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:13.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d0d5f6640 1 -- 172.21.15.123:0/504277252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d081078c0 msgr2=0x7f2d08074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:13.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d0d5f6640 1 --2- 172.21.15.123:0/504277252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d081078c0 0x7f2d08074ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:13.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d0d5f6640 1 -- 172.21.15.123:0/504277252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d081a6620 con 0x7f2d08102260 2024-08-18T22:17:13.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d0ddf7640 1 --2- 172.21.15.123:0/504277252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d081018c0 0x7f2d08074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:17:13.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d0d5f6640 1 --2- 172.21.15.123:0/504277252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d08102260 0x7f2d08074760 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00c920 tx=0x7f2cfc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:13.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d06ffd640 1 -- 172.21.15.123:0/504277252 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc007c70 con 0x7f2d08102260 2024-08-18T22:17:13.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d1005b640 1 -- 172.21.15.123:0/504277252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d081a6910 con 0x7f2d08102260 2024-08-18T22:17:13.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.780+0000 7f2d06ffd640 1 -- 172.21.15.123:0/504277252 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cfc007e10 con 0x7f2d08102260 2024-08-18T22:17:13.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.781+0000 7f2d06ffd640 1 -- 172.21.15.123:0/504277252 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc018890 con 0x7f2d08102260 2024-08-18T22:17:13.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.781+0000 7f2d1005b640 1 -- 172.21.15.123:0/504277252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d081a6e50 con 0x7f2d08102260 2024-08-18T22:17:13.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.782+0000 7f2d1005b640 1 -- 172.21.15.123:0/504277252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d08101d20 con 0x7f2d08102260 2024-08-18T22:17:13.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.783+0000 7f2d06ffd640 1 -- 172.21.15.123:0/504277252 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f2cfc018a50 con 0x7f2d08102260 2024-08-18T22:17:13.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.784+0000 7f2d06ffd640 1 --2- 172.21.15.123:0/504277252 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2cf00a2b80 0x7f2cf00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:13.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.784+0000 7f2d0ddf7640 1 --2- 172.21.15.123:0/504277252 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2cf00a2b80 0x7f2cf00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:13.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.784+0000 7f2d06ffd640 1 -- 172.21.15.123:0/504277252 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f2cfc0cf7b0 con 0x7f2d08102260 2024-08-18T22:17:13.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.785+0000 7f2d0ddf7640 1 --2- 172.21.15.123:0/504277252 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2cf00a2b80 0x7f2cf00a5040 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8000f80 tx=0x7f2cf80093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:13.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.787+0000 7f2d06ffd640 1 -- 172.21.15.123:0/504277252 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2cfc014030 con 0x7f2d08102260 2024-08-18T22:17:13.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.958+0000 7f2d1005b640 1 -- 172.21.15.123:0/504277252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d08109e60 con 0x7f2d08102260 2024-08-18T22:17:13.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.960+0000 7f2d06ffd640 1 -- 172.21.15.123:0/504277252 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+24810 (secure 0 0 0) 0x7f2cfc09c410 con 0x7f2d08102260 2024-08-18T22:17:13.961 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-18T22:17:13.962 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":96,"fsid":"dfa1db70-5dac-11ef-bccf-c7b262605968","created":"2024-08-18T21:58:23.301274+0000","modified":"2024-08-18T22:16:13.498586+0000","last_up_change":"2024-08-18T22:04:30.976680+0000","last_in_change":"2024-08-18T22:04:11.872039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:01:09.550765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:05:18.077632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:05:20.808463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:05:27.136662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c488e31f-717b-4e62-9a65-2716c0c0b138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6803","nonce":2904363725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6805","nonce":2904363725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6809","nonce":2904363725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2904363725},{"type":"v1","addr":"172.21.15.123:6807","nonce":2904363725}]},"public_addr":"172.21.15.123:6803/2904363725","cluster_addr":"172.21.15.123:6805/2904363725","heartbeat_back_addr":"172.21.15.123:6809/2904363725","heartbeat_front_addr":"172.21.15.123:6807/2904363725","state":["exists","up"]},{"osd":1,"uuid":"fc6d894a-bf9f-45f3-9902-8fabe7a564ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6801","nonce":328938210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6803","nonce":328938210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6807","nonce":328938210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":328938210},{"type":"v1","addr":"172.21.15.130:6805","nonce":328938210}]},"public_addr":"172.21.15.130:6801/328938210","cluster_addr":"172.21.15.130:6803/328938210","heartbeat_back_addr":"172.21.15.130:6807/328938210","heartbeat_front_addr":"172.21.15.130:6805/328938210","state":["exists","up"]},{"osd":2,"uuid":"8d53b95f-7d21-4c8b-bdfb-de99b494ca99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6801","nonce":2507871173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6803","nonce":2507871173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6807","nonce":2507871173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2507871173},{"type":"v1","addr":"172.21.15.183:6805","nonce":2507871173}]},"public_addr":"172.21.15.183:6801/2507871173","cluster_addr":"172.21.15.183:6803/2507871173","heartbeat_back_addr":"172.21.15.183:6807/2507871173","heartbeat_front_addr":"172.21.15.183:6805/2507871173","state":["exists","up"]},{"osd":3,"uuid":"80751174-10e5-4717-9f1b-2216aae9402c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6811","nonce":969520577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6813","nonce":969520577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6817","nonce":969520577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":969520577},{"type":"v1","addr":"172.21.15.123:6815","nonce":969520577}]},"public_addr":"172.21.15.123:6811/969520577","cluster_addr":"172.21.15.123:6813/969520577","heartbeat_back_addr":"172.21.15.123:6817/969520577","heartbeat_front_addr":"172.21.15.123:6815/969520577","state":["exists","up"]},{"osd":4,"uuid":"489f811e-7dc9-4c1b-8c2a-3b7a52f40432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6809","nonce":3632746383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6811","nonce":3632746383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6815","nonce":3632746383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3632746383},{"type":"v1","addr":"172.21.15.130:6813","nonce":3632746383}]},"public_addr":"172.21.15.130:6809/3632746383","cluster_addr":"172.21.15.130:6811/3632746383","heartbeat_back_addr":"172.21.15.130:6815/3632746383","heartbeat_front_addr":"172.21.15.130:6813/3632746383","state":["exists","up"]},{"osd":5,"uuid":"79675f4f-62df-4a95-9c74-4cf200b53e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6809","nonce":2372027015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6811","nonce":2372027015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6815","nonce":2372027015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2372027015},{"type":"v1","addr":"172.21.15.183:6813","nonce":2372027015}]},"public_addr":"172.21.15.183:6809/2372027015","cluster_addr":"172.21.15.183:6811/2372027015","heartbeat_back_addr":"172.21.15.183:6815/2372027015","heartbeat_front_addr":"172.21.15.183:6813/2372027015","state":["exists","up"]},{"osd":6,"uuid":"4de09e6b-76c9-4dbf-99ee-b7a876b245b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6819","nonce":1703847973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6821","nonce":1703847973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6825","nonce":1703847973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":1703847973},{"type":"v1","addr":"172.21.15.123:6823","nonce":1703847973}]},"public_addr":"172.21.15.123:6819/1703847973","cluster_addr":"172.21.15.123:6821/1703847973","heartbeat_back_addr":"172.21.15.123:6825/1703847973","heartbeat_front_addr":"172.21.15.123:6823/1703847973","state":["exists","up"]},{"osd":7,"uuid":"dfe0b1bb-066d-4cd2-8089-b7719769d0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6817","nonce":1750872957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6819","nonce":1750872957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6823","nonce":1750872957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":1750872957},{"type":"v1","addr":"172.21.15.130:6821","nonce":1750872957}]},"public_addr":"172.21.15.130:6817/1750872957","cluster_addr":"172.21.15.130:6819/1750872957","heartbeat_back_addr":"172.21.15.130:6823/1750872957","heartbeat_front_addr":"172.21.15.130:6821/1750872957","state":["exists","up"]},{"osd":8,"uuid":"457ed7c9-c4ab-4099-b8ef-e628f2a068db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6817","nonce":1180542594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6819","nonce":1180542594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6823","nonce":1180542594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":1180542594},{"type":"v1","addr":"172.21.15.183:6821","nonce":1180542594}]},"public_addr":"172.21.15.183:6817/1180542594","cluster_addr":"172.21.15.183:6819/1180542594","heartbeat_back_addr":"172.21.15.183:6823/1180542594","heartbeat_front_addr":"172.21.15.183:6821/1180542594","state":["exists","up"]},{"osd":9,"uuid":"b869af87-d9cf-4504-b44e-e95d5a0e2e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6827","nonce":2915312663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6829","nonce":2915312663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6833","nonce":2915312663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2915312663},{"type":"v1","addr":"172.21.15.123:6831","nonce":2915312663}]},"public_addr":"172.21.15.123:6827/2915312663","cluster_addr":"172.21.15.123:6829/2915312663","heartbeat_back_addr":"172.21.15.123:6833/2915312663","heartbeat_front_addr":"172.21.15.123:6831/2915312663","state":["exists","up"]},{"osd":10,"uuid":"ca063387-151b-4025-bed4-af51b9c4fa5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6825","nonce":2924260086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6827","nonce":2924260086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6831","nonce":2924260086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2924260086},{"type":"v1","addr":"172.21.15.130:6829","nonce":2924260086}]},"public_addr":"172.21.15.130:6825/2924260086","cluster_addr":"172.21.15.130:6827/2924260086","heartbeat_back_addr":"172.21.15.130:6831/2924260086","heartbeat_front_addr":"172.21.15.130:6829/2924260086","state":["exists","up"]},{"osd":11,"uuid":"e39da61d-5326-4697-a188-321d5ba93b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6825","nonce":739766724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6827","nonce":739766724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6831","nonce":739766724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":739766724},{"type":"v1","addr":"172.21.15.183:6829","nonce":739766724}]},"public_addr":"172.21.15.183:6825/739766724","cluster_addr":"172.21.15.183:6827/739766724","heartbeat_back_addr":"172.21.15.183:6831/739766724","heartbeat_front_addr":"172.21.15.183:6829/739766724","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:25.295361+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:00:46.071411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:06.589611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:29.351950+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:01:51.136635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:13.583078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:35.840120+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:02:58.298507+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:20.784360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:03:43.738079+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:06.760964+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:04:29.086318+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6801/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6800/4048905381":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3344429295":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1091246574":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/1435078155":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/3196395967":"2024-08-19T21:58:46.762466+0000","172.21.15.123:0/3505218516":"2024-08-19T21:59:09.243300+0000","172.21.15.123:0/2299071339":"2024-08-19T21:59:09.243300+0000","172.21.15.123:6801/1909168969":"2024-08-19T21:58:46.762466+0000","172.21.15.123:6800/1909168969":"2024-08-19T21:58:46.762466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:17:13.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.962+0000 7f2d1005b640 1 -- 172.21.15.123:0/504277252 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2cf00a2b80 msgr2=0x7f2cf00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:13.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.962+0000 7f2d1005b640 1 --2- 172.21.15.123:0/504277252 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2cf00a2b80 0x7f2cf00a5040 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8000f80 tx=0x7f2cf80093f0 comp rx=0 tx=0).stop 2024-08-18T22:17:13.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.962+0000 7f2d1005b640 1 -- 172.21.15.123:0/504277252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d08102260 msgr2=0x7f2d08074760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:13.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.962+0000 7f2d1005b640 1 --2- 172.21.15.123:0/504277252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d08102260 0x7f2d08074760 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00c920 tx=0x7f2cfc00cde0 comp rx=0 tx=0).stop 2024-08-18T22:17:13.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.962+0000 7f2d1005b640 1 -- 172.21.15.123:0/504277252 shutdown_connections 2024-08-18T22:17:13.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.962+0000 7f2d1005b640 1 --2- 172.21.15.123:0/504277252 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f2cf00a2b80 0x7f2cf00a5040 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:13.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.962+0000 7f2d1005b640 1 --2- 172.21.15.123:0/504277252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d081078c0 0x7f2d08074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:13.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.962+0000 7f2d1005b640 1 --2- 172.21.15.123:0/504277252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d08102260 0x7f2d08074760 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:13.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.962+0000 7f2d1005b640 1 --2- 172.21.15.123:0/504277252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d081018c0 0x7f2d08074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:13.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.962+0000 7f2d1005b640 1 -- 172.21.15.123:0/504277252 >> 172.21.15.123:0/504277252 conn(0x7f2d080fd5e0 msgr2=0x7f2d080fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:13.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.962+0000 7f2d1005b640 1 -- 172.21.15.123:0/504277252 shutdown_connections 2024-08-18T22:17:13.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:13.962+0000 7f2d1005b640 1 -- 172.21.15.123:0/504277252 wait complete. 2024-08-18T22:17:14.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:14 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/504277252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:17:14.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:14 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/504277252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:17:14.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:14 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/504277252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:17:14.711 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs fail cephfs 2024-08-18T22:17:14.963 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:17:15.352 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:15 smithi123 ceph-mon[18462]: pgmap v628: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2024-08-18T22:17:15.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.430+0000 7f517c100640 1 -- 172.21.15.123:0/1235958966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51741022a0 msgr2=0x7f51741026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:15.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.430+0000 7f517c100640 1 --2- 172.21.15.123:0/1235958966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51741022a0 0x7f51741026e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f5170009900 tx=0x7f517002a480 comp rx=0 tx=0).stop 2024-08-18T22:17:15.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.430+0000 7f517c100640 1 -- 172.21.15.123:0/1235958966 shutdown_connections 2024-08-18T22:17:15.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.430+0000 7f517c100640 1 --2- 172.21.15.123:0/1235958966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5174102c20 0x7f517410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:15.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.430+0000 7f517c100640 1 --2- 172.21.15.123:0/1235958966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51741022a0 0x7f51741026e0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:15.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.430+0000 7f517c100640 1 --2- 172.21.15.123:0/1235958966 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5174100b50 0x7f5174100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:15.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.430+0000 7f517c100640 1 -- 172.21.15.123:0/1235958966 >> 172.21.15.123:0/1235958966 conn(0x7f51740fc500 msgr2=0x7f51740fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:15.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.430+0000 7f517c100640 1 -- 172.21.15.123:0/1235958966 shutdown_connections 2024-08-18T22:17:15.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.430+0000 7f517c100640 1 -- 172.21.15.123:0/1235958966 wait complete. 2024-08-18T22:17:15.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.430+0000 7f517c100640 1 Processor -- start 2024-08-18T22:17:15.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.430+0000 7f517c100640 1 -- start start 2024-08-18T22:17:15.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517c100640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5174100b50 0x7f51741990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:15.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517c100640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51741022a0 0x7f5174199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:15.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517c100640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5174102c20 0x7f51741a4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:15.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517c100640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5174110cb0 con 0x7f51741022a0 2024-08-18T22:17:15.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517c100640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5174110b30 con 0x7f5174102c20 2024-08-18T22:17:15.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517c100640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5174110e30 con 0x7f5174100b50 2024-08-18T22:17:15.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517969b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51741022a0 0x7f5174199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:15.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517969b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51741022a0 0x7f5174199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37062/0 (socket says 172.21.15.123:37062) 2024-08-18T22:17:15.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517969b640 1 -- 172.21.15.123:0/886076613 learned_addr learned my addr 172.21.15.123:0/886076613 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:17:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517a69d640 1 --2- 172.21.15.123:0/886076613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5174102c20 0x7f51741a4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f5179e9c640 1 --2- 172.21.15.123:0/886076613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5174100b50 0x7f51741990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517969b640 1 -- 172.21.15.123:0/886076613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5174100b50 msgr2=0x7f51741990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517969b640 1 --2- 172.21.15.123:0/886076613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5174100b50 0x7f51741990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517969b640 1 -- 172.21.15.123:0/886076613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5174102c20 msgr2=0x7f51741a4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517969b640 1 --2- 172.21.15.123:0/886076613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5174102c20 0x7f51741a4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517969b640 1 -- 172.21.15.123:0/886076613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51741a4690 con 0x7f51741022a0 2024-08-18T22:17:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517a69d640 1 --2- 172.21.15.123:0/886076613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5174102c20 0x7f51741a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:17:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517969b640 1 --2- 172.21.15.123:0/886076613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51741022a0 0x7f5174199610 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f5170006010 tx=0x7f5170003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f5166ffd640 1 -- 172.21.15.123:0/886076613 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517003f070 con 0x7f51741022a0 2024-08-18T22:17:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f5166ffd640 1 -- 172.21.15.123:0/886076613 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5170031c30 con 0x7f51741022a0 2024-08-18T22:17:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f5166ffd640 1 -- 172.21.15.123:0/886076613 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170035030 con 0x7f51741022a0 2024-08-18T22:17:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517c100640 1 -- 172.21.15.123:0/886076613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51741a4860 con 0x7f51741022a0 2024-08-18T22:17:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.431+0000 7f517c100640 1 -- 172.21.15.123:0/886076613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51741a4d40 con 0x7f51741022a0 2024-08-18T22:17:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.432+0000 7f517c100640 1 -- 172.21.15.123:0/886076613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5174100f30 con 0x7f51741022a0 2024-08-18T22:17:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.434+0000 7f5166ffd640 1 -- 172.21.15.123:0/886076613 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f5170042070 con 0x7f51741022a0 2024-08-18T22:17:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.434+0000 7f5166ffd640 1 --2- 172.21.15.123:0/886076613 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f51600a2c00 0x7f51600a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.435+0000 7f5179e9c640 1 --2- 172.21.15.123:0/886076613 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f51600a2c00 0x7f51600a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.435+0000 7f5166ffd640 1 -- 172.21.15.123:0/886076613 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9150+0+0 (secure 0 0 0) 0x7f51700efff0 con 0x7f51741022a0 2024-08-18T22:17:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.435+0000 7f5179e9c640 1 --2- 172.21.15.123:0/886076613 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f51600a2c00 0x7f51600a50c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5168009b60 tx=0x7f5168005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.438+0000 7f5166ffd640 1 -- 172.21.15.123:0/886076613 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f51700bcba0 con 0x7f51741022a0 2024-08-18T22:17:15.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:15 smithi130 ceph-mon[21698]: pgmap v628: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2024-08-18T22:17:15.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.642+0000 7f517c100640 1 -- 172.21.15.123:0/886076613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5174108dc0 con 0x7f51741022a0 2024-08-18T22:17:15.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.644+0000 7f5166ffd640 1 -- 172.21.15.123:0/886076613 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) ==== 161+0+0 (secure 0 0 0) 0x7f51700bc4a0 con 0x7f51741022a0 2024-08-18T22:17:15.645 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T22:17:15.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.647+0000 7f517c100640 1 -- 172.21.15.123:0/886076613 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f51600a2c00 msgr2=0x7f51600a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:15.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.647+0000 7f517c100640 1 --2- 172.21.15.123:0/886076613 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f51600a2c00 0x7f51600a50c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5168009b60 tx=0x7f5168005f90 comp rx=0 tx=0).stop 2024-08-18T22:17:15.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.647+0000 7f517c100640 1 -- 172.21.15.123:0/886076613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51741022a0 msgr2=0x7f5174199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:15.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.647+0000 7f517c100640 1 --2- 172.21.15.123:0/886076613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51741022a0 0x7f5174199610 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f5170006010 tx=0x7f5170003c10 comp rx=0 tx=0).stop 2024-08-18T22:17:15.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.648+0000 7f517c100640 1 -- 172.21.15.123:0/886076613 shutdown_connections 2024-08-18T22:17:15.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.648+0000 7f517c100640 1 --2- 172.21.15.123:0/886076613 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f51600a2c00 0x7f51600a50c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.648+0000 7f517c100640 1 --2- 172.21.15.123:0/886076613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5174102c20 0x7f51741a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.648+0000 7f517c100640 1 --2- 172.21.15.123:0/886076613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51741022a0 0x7f5174199610 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.648+0000 7f517c100640 1 --2- 172.21.15.123:0/886076613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5174100b50 0x7f51741990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.648+0000 7f517c100640 1 -- 172.21.15.123:0/886076613 >> 172.21.15.123:0/886076613 conn(0x7f51740fc500 msgr2=0x7f51740fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.648+0000 7f517c100640 1 -- 172.21.15.123:0/886076613 shutdown_connections 2024-08-18T22:17:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:15.648+0000 7f517c100640 1 -- 172.21.15.123:0/886076613 wait complete. 2024-08-18T22:17:15.657 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-mon[22097]: pgmap v628: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2024-08-18T22:17:15.909 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-f[51628]: ignoring --setuser ceph since I am not root 2024-08-18T22:17:15.910 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-f[51628]: ignoring --setgroup ceph since I am not root 2024-08-18T22:17:15.910 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-mds[51632]: -- 172.21.15.183:0/302924983 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b64d1e7c20 con 0x55b64d1c5000 2024-08-18T22:17:15.910 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-f[51628]: starting mds.f at 2024-08-18T22:17:15.910 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-c[51930]: ignoring --setuser ceph since I am not root 2024-08-18T22:17:15.910 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-c[51930]: ignoring --setgroup ceph since I am not root 2024-08-18T22:17:15.910 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-mds[51934]: -- 172.21.15.183:0/1432748262 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557ca58f9860 con 0x557ca58d7000 2024-08-18T22:17:15.911 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-c[51930]: starting mds.c at 2024-08-18T22:17:15.911 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: -6326> 2024-08-18T22:16:15.994+0000 7fcbd607e640 -1 log_channel(cluster) log [ERR] : failed to store backtrace on ino 0x10000007735 object, pool 2, errno -2 2024-08-18T22:17:15.911 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: -6325> 2024-08-18T22:16:15.994+0000 7fcbd607e640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-08-18T22:17:15.911 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: -6054> 2024-08-18T22:16:15.996+0000 7fcbd607e640 -1 log_channel(cluster) log [ERR] : failed to store backtrace on ino 0x10000007744 object, pool 2, errno -2 2024-08-18T22:17:15.911 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: -6053> 2024-08-18T22:16:15.996+0000 7fcbd607e640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-08-18T22:17:15.911 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: -5646> 2024-08-18T22:16:15.999+0000 7fcbd607e640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-08-18T22:17:15.912 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: ignoring --setuser ceph since I am not root 2024-08-18T22:17:15.912 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: ignoring --setgroup ceph since I am not root 2024-08-18T22:17:15.912 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-mds[52236]: -- 172.21.15.183:0/3227714815 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561ec0913860 con 0x561ec08f0800 2024-08-18T22:17:15.912 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:17:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: starting mds.i at 2024-08-18T22:17:16.010 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:15 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a[18458]: 2024-08-18T22:17:15.642+0000 7f9a2dcb6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:17:16.014 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:17:15 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: ignoring --setuser ceph since I am not root 2024-08-18T22:17:16.014 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:17:15 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: ignoring --setgroup ceph since I am not root 2024-08-18T22:17:16.014 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:17:15 smithi130 ceph-mds[51563]: -- 172.21.15.130:0/1081842816 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557d43067860 con 0x557d43045000 2024-08-18T22:17:16.014 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:17:15 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: starting mds.b at 2024-08-18T22:17:16.015 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:17:15 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-e[50952]: ignoring --setuser ceph since I am not root 2024-08-18T22:17:16.015 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:17:15 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-e[50952]: ignoring --setgroup ceph since I am not root 2024-08-18T22:17:16.015 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:17:15 smithi130 ceph-mds[50956]: -- 172.21.15.130:0/815786313 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56044a212680 con 0x56044a1e7000 2024-08-18T22:17:16.015 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:17:15 smithi130 ceph-mds[50956]: -- 172.21.15.130:0/815786313 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56044a209860 con 0x56044a1e7000 2024-08-18T22:17:16.015 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:17:15 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-e[50952]: starting mds.e at 2024-08-18T22:17:16.016 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 18 22:17:15 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-h[51253]: ignoring --setuser ceph since I am not root 2024-08-18T22:17:16.016 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 18 22:17:15 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-h[51253]: ignoring --setgroup ceph since I am not root 2024-08-18T22:17:16.016 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 18 22:17:15 smithi130 ceph-mds[51257]: -- 172.21.15.130:0/1288772939 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dac85f3860 con 0x55dac85d0800 2024-08-18T22:17:16.016 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 18 22:17:15 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-h[51253]: starting mds.h at 2024-08-18T22:17:16.338 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T22:17:16.362 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:16 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/886076613' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-18T22:17:16.363 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:16 smithi123 ceph-mon[18462]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-18T22:17:16.363 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:16 smithi123 ceph-mon[18462]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:17:16.363 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:16 smithi123 ceph-mon[18462]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-08-18T22:17:16.363 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:16 smithi123 ceph-mon[18462]: Health check cleared: MDS_READ_ONLY (was: 1 MDSs are read only) 2024-08-18T22:17:16.363 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:16 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/886076613' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-18T22:17:16.363 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:16 smithi123 ceph-mon[18462]: osdmap e97: 12 total, 12 up, 12 in 2024-08-18T22:17:16.363 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:16 smithi123 ceph-mon[18462]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-18T22:17:16.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:16 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/886076613' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-18T22:17:16.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:16 smithi130 ceph-mon[21698]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-18T22:17:16.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:16 smithi130 ceph-mon[21698]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:17:16.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:16 smithi130 ceph-mon[21698]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-08-18T22:17:16.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:16 smithi130 ceph-mon[21698]: Health check cleared: MDS_READ_ONLY (was: 1 MDSs are read only) 2024-08-18T22:17:16.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:16 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/886076613' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-18T22:17:16.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:16 smithi130 ceph-mon[21698]: osdmap e97: 12 total, 12 up, 12 in 2024-08-18T22:17:16.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:16 smithi130 ceph-mon[21698]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-18T22:17:16.591 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:17:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:16 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/886076613' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-18T22:17:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:16 smithi183 ceph-mon[22097]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-18T22:17:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:16 smithi183 ceph-mon[22097]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:17:16.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:16 smithi183 ceph-mon[22097]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-08-18T22:17:16.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:16 smithi183 ceph-mon[22097]: Health check cleared: MDS_READ_ONLY (was: 1 MDSs are read only) 2024-08-18T22:17:16.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:16 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/886076613' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-18T22:17:16.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:16 smithi183 ceph-mon[22097]: osdmap e97: 12 total, 12 up, 12 in 2024-08-18T22:17:16.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:16 smithi183 ceph-mon[22097]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-18T22:17:17.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.056+0000 7fb220f24640 1 -- 172.21.15.123:0/2190454225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb21c1078b0 msgr2=0x7fb21c107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:17.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.056+0000 7fb220f24640 1 --2- 172.21.15.123:0/2190454225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb21c1078b0 0x7fb21c107c90 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009930 tx=0x7fb20c02a420 comp rx=0 tx=0).stop 2024-08-18T22:17:17.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.056+0000 7fb220f24640 1 -- 172.21.15.123:0/2190454225 shutdown_connections 2024-08-18T22:17:17.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.056+0000 7fb220f24640 1 --2- 172.21.15.123:0/2190454225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb21c102250 0x7fb21c10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:17.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.056+0000 7fb220f24640 1 --2- 172.21.15.123:0/2190454225 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb21c1018b0 0x7fb21c101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:17.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.056+0000 7fb220f24640 1 --2- 172.21.15.123:0/2190454225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb21c1078b0 0x7fb21c107c90 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:17.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.056+0000 7fb220f24640 1 -- 172.21.15.123:0/2190454225 >> 172.21.15.123:0/2190454225 conn(0x7fb21c0fd5f0 msgr2=0x7fb21c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:17.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.056+0000 7fb220f24640 1 -- 172.21.15.123:0/2190454225 shutdown_connections 2024-08-18T22:17:17.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.056+0000 7fb220f24640 1 -- 172.21.15.123:0/2190454225 wait complete. 2024-08-18T22:17:17.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.057+0000 7fb220f24640 1 Processor -- start 2024-08-18T22:17:17.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.057+0000 7fb220f24640 1 -- start start 2024-08-18T22:17:17.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.057+0000 7fb220f24640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb21c1018b0 0x7fb21c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:17.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.057+0000 7fb220f24640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb21c102250 0x7fb21c19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:17.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.057+0000 7fb220f24640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb21c1078b0 0x7fb21c19ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:17.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.057+0000 7fb220f24640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c111cd0 con 0x7fb21c1018b0 2024-08-18T22:17:17.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.057+0000 7fb220f24640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c111b50 con 0x7fb21c1078b0 2024-08-18T22:17:17.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.057+0000 7fb220f24640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c111e50 con 0x7fb21c102250 2024-08-18T22:17:17.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.057+0000 7fb219d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb21c102250 0x7fb21c19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:17.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.057+0000 7fb219d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb21c102250 0x7fb21c19a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.123:54146/0 (socket says 172.21.15.123:54146) 2024-08-18T22:17:17.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.057+0000 7fb219d9b640 1 -- 172.21.15.123:0/2288207537 learned_addr learned my addr 172.21.15.123:0/2288207537 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:17:17.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.057+0000 7fb21a59c640 1 --2- 172.21.15.123:0/2288207537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb21c1018b0 0x7fb21c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:17.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.057+0000 7fb21ad9d640 1 --2- 172.21.15.123:0/2288207537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb21c1078b0 0x7fb21c19ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:17.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.058+0000 7fb21a59c640 1 -- 172.21.15.123:0/2288207537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb21c102250 msgr2=0x7fb21c19a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:17.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.058+0000 7fb21a59c640 1 --2- 172.21.15.123:0/2288207537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb21c102250 0x7fb21c19a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:17.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.058+0000 7fb21a59c640 1 -- 172.21.15.123:0/2288207537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb21c1078b0 msgr2=0x7fb21c19ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:17.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.058+0000 7fb21a59c640 1 --2- 172.21.15.123:0/2288207537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb21c1078b0 0x7fb21c19ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:17.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.058+0000 7fb21a59c640 1 -- 172.21.15.123:0/2288207537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c19f320 con 0x7fb21c1018b0 2024-08-18T22:17:17.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.058+0000 7fb21a59c640 1 --2- 172.21.15.123:0/2288207537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb21c1018b0 0x7fb21c19a370 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fb20c005940 tx=0x7fb20c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:17.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.058+0000 7fb20b7fe640 1 -- 172.21.15.123:0/2288207537 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c03f070 con 0x7fb21c1018b0 2024-08-18T22:17:17.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.058+0000 7fb220f24640 1 -- 172.21.15.123:0/2288207537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21c19f5b0 con 0x7fb21c1018b0 2024-08-18T22:17:17.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.058+0000 7fb20b7fe640 1 -- 172.21.15.123:0/2288207537 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb20c03b460 con 0x7fb21c1018b0 2024-08-18T22:17:17.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.058+0000 7fb20b7fe640 1 -- 172.21.15.123:0/2288207537 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c035070 con 0x7fb21c1018b0 2024-08-18T22:17:17.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.058+0000 7fb220f24640 1 -- 172.21.15.123:0/2288207537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb21c1a6ef0 con 0x7fb21c1018b0 2024-08-18T22:17:17.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.059+0000 7fb220f24640 1 -- 172.21.15.123:0/2288207537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb21c102ff0 con 0x7fb21c1018b0 2024-08-18T22:17:17.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.060+0000 7fb20b7fe640 1 -- 172.21.15.123:0/2288207537 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fb20c03b980 con 0x7fb21c1018b0 2024-08-18T22:17:17.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.061+0000 7fb20b7fe640 1 --2- 172.21.15.123:0/2288207537 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb2040a2b80 0x7fb2040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:17.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.061+0000 7fb219d9b640 1 --2- 172.21.15.123:0/2288207537 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb2040a2b80 0x7fb2040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:17.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.061+0000 7fb20b7fe640 1 -- 172.21.15.123:0/2288207537 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9408+0+0 (secure 0 0 0) 0x7fb20c0efa70 con 0x7fb21c1018b0 2024-08-18T22:17:17.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.061+0000 7fb219d9b640 1 --2- 172.21.15.123:0/2288207537 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb2040a2b80 0x7fb2040a5040 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb21c10e920 tx=0x7fb21000a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:17.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.065+0000 7fb20b7fe640 1 -- 172.21.15.123:0/2288207537 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb20c0bbef0 con 0x7fb21c1018b0 2024-08-18T22:17:17.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:17.266+0000 7fb220f24640 1 -- 172.21.15.123:0/2288207537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb21c1a70c0 con 0x7fb21c1018b0 2024-08-18T22:17:17.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:17 smithi123 ceph-mon[18462]: pgmap v630: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 7 op/s 2024-08-18T22:17:17.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:17 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.183:6834/580902597,v1:172.21.15.183:6835/580902597] up:boot 2024-08-18T22:17:17.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:17 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.183:6836/2813235144,v1:172.21.15.183:6837/2813235144] up:boot 2024-08-18T22:17:17.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:17 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.130:6834/2787839039,v1:172.21.15.130:6837/2787839039] up:boot 2024-08-18T22:17:17.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:17 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.130:6836/2130322734,v1:172.21.15.130:6838/2130322734] up:boot 2024-08-18T22:17:17.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:17 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.130:6835/1165050555,v1:172.21.15.130:6839/1165050555] up:boot 2024-08-18T22:17:17.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:17 smithi123 ceph-mon[18462]: mds.? [v2:172.21.15.183:6838/923629546,v1:172.21.15.183:6839/923629546] up:boot 2024-08-18T22:17:17.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:17 smithi123 ceph-mon[18462]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-18T22:17:17.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:17 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-18T22:17:17.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:17 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-18T22:17:17.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:17 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-18T22:17:17.512 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:17 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-18T22:17:17.512 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:17 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-18T22:17:17.512 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:17 smithi123 ceph-mon[18462]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-18T22:17:17.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:17 smithi130 ceph-mon[21698]: pgmap v630: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 7 op/s 2024-08-18T22:17:17.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:17 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.183:6834/580902597,v1:172.21.15.183:6835/580902597] up:boot 2024-08-18T22:17:17.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:17 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.183:6836/2813235144,v1:172.21.15.183:6837/2813235144] up:boot 2024-08-18T22:17:17.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:17 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.130:6834/2787839039,v1:172.21.15.130:6837/2787839039] up:boot 2024-08-18T22:17:17.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:17 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.130:6836/2130322734,v1:172.21.15.130:6838/2130322734] up:boot 2024-08-18T22:17:17.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:17 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.130:6835/1165050555,v1:172.21.15.130:6839/1165050555] up:boot 2024-08-18T22:17:17.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:17 smithi130 ceph-mon[21698]: mds.? [v2:172.21.15.183:6838/923629546,v1:172.21.15.183:6839/923629546] up:boot 2024-08-18T22:17:17.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:17 smithi130 ceph-mon[21698]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-18T22:17:17.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:17 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-18T22:17:17.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:17 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-18T22:17:17.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:17 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-18T22:17:17.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:17 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-18T22:17:17.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:17 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-18T22:17:17.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:17 smithi130 ceph-mon[21698]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-18T22:17:17.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:17 smithi183 ceph-mon[22097]: pgmap v630: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 7 op/s 2024-08-18T22:17:17.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:17 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.183:6834/580902597,v1:172.21.15.183:6835/580902597] up:boot 2024-08-18T22:17:17.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:17 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.183:6836/2813235144,v1:172.21.15.183:6837/2813235144] up:boot 2024-08-18T22:17:17.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:17 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.130:6834/2787839039,v1:172.21.15.130:6837/2787839039] up:boot 2024-08-18T22:17:17.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:17 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.130:6836/2130322734,v1:172.21.15.130:6838/2130322734] up:boot 2024-08-18T22:17:17.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:17 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.130:6835/1165050555,v1:172.21.15.130:6839/1165050555] up:boot 2024-08-18T22:17:17.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:17 smithi183 ceph-mon[22097]: mds.? [v2:172.21.15.183:6838/923629546,v1:172.21.15.183:6839/923629546] up:boot 2024-08-18T22:17:17.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:17 smithi183 ceph-mon[22097]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-18T22:17:17.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:17 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-18T22:17:17.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:17 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-18T22:17:17.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:17 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-18T22:17:17.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:17 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-18T22:17:17.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:17 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-18T22:17:17.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:17 smithi183 ceph-mon[22097]: from='mgr.14150 172.21.15.123:0/3483124108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-18T22:17:18.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:18.234+0000 7fb20b7fe640 1 -- 172.21.15.123:0/2288207537 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7fb20c0c01f0 con 0x7fb21c1018b0 2024-08-18T22:17:18.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:18.236+0000 7fb220f24640 1 -- 172.21.15.123:0/2288207537 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb2040a2b80 msgr2=0x7fb2040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:18.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:18.236+0000 7fb220f24640 1 --2- 172.21.15.123:0/2288207537 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb2040a2b80 0x7fb2040a5040 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb21c10e920 tx=0x7fb21000a380 comp rx=0 tx=0).stop 2024-08-18T22:17:18.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:18.236+0000 7fb220f24640 1 -- 172.21.15.123:0/2288207537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb21c1018b0 msgr2=0x7fb21c19a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:18.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:18.236+0000 7fb220f24640 1 --2- 172.21.15.123:0/2288207537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb21c1018b0 0x7fb21c19a370 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fb20c005940 tx=0x7fb20c0042f0 comp rx=0 tx=0).stop 2024-08-18T22:17:18.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:18.237+0000 7fb220f24640 1 -- 172.21.15.123:0/2288207537 shutdown_connections 2024-08-18T22:17:18.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:18.237+0000 7fb220f24640 1 --2- 172.21.15.123:0/2288207537 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7fb2040a2b80 0x7fb2040a5040 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:18.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:18.237+0000 7fb220f24640 1 --2- 172.21.15.123:0/2288207537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb21c1078b0 0x7fb21c19ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:18.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:18.237+0000 7fb220f24640 1 --2- 172.21.15.123:0/2288207537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb21c102250 0x7fb21c19a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:18.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:18.237+0000 7fb220f24640 1 --2- 172.21.15.123:0/2288207537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb21c1018b0 0x7fb21c19a370 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:18.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:18.237+0000 7fb220f24640 1 -- 172.21.15.123:0/2288207537 >> 172.21.15.123:0/2288207537 conn(0x7fb21c0fd5f0 msgr2=0x7fb21c10ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:18.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:18.237+0000 7fb220f24640 1 -- 172.21.15.123:0/2288207537 shutdown_connections 2024-08-18T22:17:18.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:18.237+0000 7fb220f24640 1 -- 172.21.15.123:0/2288207537 wait complete. 2024-08-18T22:17:18.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:18 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2288207537' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-08-18T22:17:18.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:18 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2288207537' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-08-18T22:17:18.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:18 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2288207537' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-08-18T22:17:19.063 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T22:17:19.356 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:17:19.478 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:19 smithi123 ceph-mon[18462]: pgmap v631: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 7 op/s 2024-08-18T22:17:19.478 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:19 smithi123 ceph-mon[18462]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-18T22:17:19.478 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:19 smithi123 ceph-mon[18462]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-18T22:17:19.478 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:19 smithi123 ceph-mon[18462]: Cluster is now healthy 2024-08-18T22:17:19.478 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:19 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2288207537' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-18T22:17:19.479 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:19 smithi123 ceph-mon[18462]: fsmap 12 up:standby 2024-08-18T22:17:19.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:19 smithi130 ceph-mon[21698]: pgmap v631: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 7 op/s 2024-08-18T22:17:19.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:19 smithi130 ceph-mon[21698]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-18T22:17:19.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:19 smithi130 ceph-mon[21698]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-18T22:17:19.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:19 smithi130 ceph-mon[21698]: Cluster is now healthy 2024-08-18T22:17:19.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:19 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2288207537' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-18T22:17:19.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:19 smithi130 ceph-mon[21698]: fsmap 12 up:standby 2024-08-18T22:17:19.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:19 smithi183 ceph-mon[22097]: pgmap v631: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 7 op/s 2024-08-18T22:17:19.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:19 smithi183 ceph-mon[22097]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-18T22:17:19.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:19 smithi183 ceph-mon[22097]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-18T22:17:19.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:19 smithi183 ceph-mon[22097]: Cluster is now healthy 2024-08-18T22:17:19.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:19 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2288207537' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-18T22:17:19.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:19 smithi183 ceph-mon[22097]: fsmap 12 up:standby 2024-08-18T22:17:19.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.818+0000 7f7644e78640 1 -- 172.21.15.123:0/3265303691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76401007b0 msgr2=0x7f7640100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:19.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.818+0000 7f7644e78640 1 --2- 172.21.15.123:0/3265303691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76401007b0 0x7f7640100c10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7634009cd0 tx=0x7f763402a8e0 comp rx=0 tx=0).stop 2024-08-18T22:17:19.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.818+0000 7f7644e78640 1 -- 172.21.15.123:0/3265303691 shutdown_connections 2024-08-18T22:17:19.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.818+0000 7f7644e78640 1 --2- 172.21.15.123:0/3265303691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7640101150 0x7f764010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:19.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.818+0000 7f7644e78640 1 --2- 172.21.15.123:0/3265303691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76401007b0 0x7f7640100c10 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:19.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.818+0000 7f7644e78640 1 --2- 172.21.15.123:0/3265303691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76401067b0 0x7f7640106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:19.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.818+0000 7f7644e78640 1 -- 172.21.15.123:0/3265303691 >> 172.21.15.123:0/3265303691 conn(0x7f76400fc4d0 msgr2=0x7f76400fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:19.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.818+0000 7f7644e78640 1 -- 172.21.15.123:0/3265303691 shutdown_connections 2024-08-18T22:17:19.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.818+0000 7f7644e78640 1 -- 172.21.15.123:0/3265303691 wait complete. 2024-08-18T22:17:19.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.819+0000 7f7644e78640 1 Processor -- start 2024-08-18T22:17:19.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.819+0000 7f7644e78640 1 -- start start 2024-08-18T22:17:19.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.819+0000 7f7644e78640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76401007b0 0x7f76401982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:19.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.819+0000 7f7644e78640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7640101150 0x7f7640198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:19.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.819+0000 7f7644e78640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76401067b0 0x7f764019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:19.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.819+0000 7f7644e78640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7640110c50 con 0x7f76401007b0 2024-08-18T22:17:19.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.819+0000 7f7644e78640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7640110ad0 con 0x7f7640101150 2024-08-18T22:17:19.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.819+0000 7f7644e78640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7640110dd0 con 0x7f76401067b0 2024-08-18T22:17:19.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.819+0000 7f763e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76401007b0 0x7f76401982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:19.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.819+0000 7f763e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76401007b0 0x7f76401982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37094/0 (socket says 172.21.15.123:37094) 2024-08-18T22:17:19.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.819+0000 7f763e59c640 1 -- 172.21.15.123:0/2509563106 learned_addr learned my addr 172.21.15.123:0/2509563106 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:17:19.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.819+0000 7f763ed9d640 1 --2- 172.21.15.123:0/2509563106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76401067b0 0x7f764019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:19.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.820+0000 7f763dd9b640 1 --2- 172.21.15.123:0/2509563106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7640101150 0x7f7640198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:19.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.820+0000 7f763e59c640 1 -- 172.21.15.123:0/2509563106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76401067b0 msgr2=0x7f764019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:19.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.820+0000 7f763e59c640 1 --2- 172.21.15.123:0/2509563106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76401067b0 0x7f764019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:19.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.820+0000 7f763e59c640 1 -- 172.21.15.123:0/2509563106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7640101150 msgr2=0x7f7640198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:19.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.820+0000 7f763e59c640 1 --2- 172.21.15.123:0/2509563106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7640101150 0x7f7640198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:19.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.820+0000 7f763e59c640 1 -- 172.21.15.123:0/2509563106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764019d2a0 con 0x7f76401007b0 2024-08-18T22:17:19.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.820+0000 7f763dd9b640 1 --2- 172.21.15.123:0/2509563106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7640101150 0x7f7640198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:17:19.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.820+0000 7f763e59c640 1 --2- 172.21.15.123:0/2509563106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76401007b0 0x7f76401982f0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f763800b4a0 tx=0x7f763800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:19.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.820+0000 7f762f7fe640 1 -- 172.21.15.123:0/2509563106 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7638014070 con 0x7f76401007b0 2024-08-18T22:17:19.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.820+0000 7f762f7fe640 1 -- 172.21.15.123:0/2509563106 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7638010af0 con 0x7f76401007b0 2024-08-18T22:17:19.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.820+0000 7f7644e78640 1 -- 172.21.15.123:0/2509563106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f764019d590 con 0x7f76401007b0 2024-08-18T22:17:19.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.820+0000 7f762f7fe640 1 -- 172.21.15.123:0/2509563106 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7638017d10 con 0x7f76401007b0 2024-08-18T22:17:19.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.820+0000 7f7644e78640 1 -- 172.21.15.123:0/2509563106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76401a4e70 con 0x7f76401007b0 2024-08-18T22:17:19.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.821+0000 7f7644e78640 1 -- 172.21.15.123:0/2509563106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7640100c90 con 0x7f76401007b0 2024-08-18T22:17:19.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.822+0000 7f762f7fe640 1 -- 172.21.15.123:0/2509563106 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f7638017070 con 0x7f76401007b0 2024-08-18T22:17:19.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.823+0000 7f762f7fe640 1 --2- 172.21.15.123:0/2509563106 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f76280a2b80 0x7f76280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:19.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.823+0000 7f763dd9b640 1 --2- 172.21.15.123:0/2509563106 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f76280a2b80 0x7f76280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:19.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.823+0000 7f762f7fe640 1 -- 172.21.15.123:0/2509563106 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9408+0+0 (secure 0 0 0) 0x7f76380ce8e0 con 0x7f76401007b0 2024-08-18T22:17:19.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.823+0000 7f763dd9b640 1 --2- 172.21.15.123:0/2509563106 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f76280a2b80 0x7f76280a5040 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7634000f80 tx=0x7f7634009890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:19.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.827+0000 7f762f7fe640 1 -- 172.21.15.123:0/2509563106 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f763809b370 con 0x7f76401007b0 2024-08-18T22:17:19.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:19.995+0000 7f7644e78640 1 -- 172.21.15.123:0/2509563106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f76401a50a0 con 0x7f76401007b0 2024-08-18T22:17:20.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:20.239+0000 7f762f7fe640 1 -- 172.21.15.123:0/2509563106 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v98) ==== 181+0+0 (secure 0 0 0) 0x7f763809ac70 con 0x7f76401007b0 2024-08-18T22:17:20.240 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-08-18T22:17:20.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:20.241+0000 7f7644e78640 1 -- 172.21.15.123:0/2509563106 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f76280a2b80 msgr2=0x7f76280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:20.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:20.241+0000 7f7644e78640 1 --2- 172.21.15.123:0/2509563106 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f76280a2b80 0x7f76280a5040 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7634000f80 tx=0x7f7634009890 comp rx=0 tx=0).stop 2024-08-18T22:17:20.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:20.241+0000 7f7644e78640 1 -- 172.21.15.123:0/2509563106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76401007b0 msgr2=0x7f76401982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:20.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:20.241+0000 7f7644e78640 1 --2- 172.21.15.123:0/2509563106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76401007b0 0x7f76401982f0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f763800b4a0 tx=0x7f763800b960 comp rx=0 tx=0).stop 2024-08-18T22:17:20.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:20.241+0000 7f7644e78640 1 -- 172.21.15.123:0/2509563106 shutdown_connections 2024-08-18T22:17:20.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:20.241+0000 7f7644e78640 1 --2- 172.21.15.123:0/2509563106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76401067b0 0x7f764019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:20.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:20.241+0000 7f7644e78640 1 --2- 172.21.15.123:0/2509563106 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f76280a2b80 0x7f76280a5040 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:20.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:20.241+0000 7f7644e78640 1 --2- 172.21.15.123:0/2509563106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7640101150 0x7f7640198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:20.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:20.241+0000 7f7644e78640 1 --2- 172.21.15.123:0/2509563106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76401007b0 0x7f76401982f0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:20.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:20.241+0000 7f7644e78640 1 -- 172.21.15.123:0/2509563106 >> 172.21.15.123:0/2509563106 conn(0x7f76400fc4d0 msgr2=0x7f7640104660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:20.242+0000 7f7644e78640 1 -- 172.21.15.123:0/2509563106 shutdown_connections 2024-08-18T22:17:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:20.242+0000 7f7644e78640 1 -- 172.21.15.123:0/2509563106 wait complete. 2024-08-18T22:17:20.256 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:20 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2509563106' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-18T22:17:20.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:20 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2509563106' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-18T22:17:20.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:20 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2509563106' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-18T22:17:21.059 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T22:17:21.326 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:17:21.449 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:21 smithi123 ceph-mon[18462]: pgmap v632: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 614 B/s wr, 5 op/s 2024-08-18T22:17:21.450 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:21 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/2509563106' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-18T22:17:21.450 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:21 smithi123 ceph-mon[18462]: osdmap e98: 12 total, 12 up, 12 in 2024-08-18T22:17:21.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:21 smithi130 ceph-mon[21698]: pgmap v632: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 614 B/s wr, 5 op/s 2024-08-18T22:17:21.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:21 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/2509563106' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-18T22:17:21.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:21 smithi130 ceph-mon[21698]: osdmap e98: 12 total, 12 up, 12 in 2024-08-18T22:17:21.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:21 smithi183 ceph-mon[22097]: pgmap v632: 129 pgs: 129 active+clean; 245 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 614 B/s wr, 5 op/s 2024-08-18T22:17:21.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:21 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/2509563106' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-18T22:17:21.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:21 smithi183 ceph-mon[22097]: osdmap e98: 12 total, 12 up, 12 in 2024-08-18T22:17:21.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.820+0000 7f58641f3640 1 -- 172.21.15.123:0/2849211912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f585c105c70 msgr2=0x7f585c106100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:21.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.820+0000 7f58641f3640 1 --2- 172.21.15.123:0/2849211912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f585c105c70 0x7f585c106100 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5854009900 tx=0x7f585402a470 comp rx=0 tx=0).stop 2024-08-18T22:17:21.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.820+0000 7f58641f3640 1 -- 172.21.15.123:0/2849211912 shutdown_connections 2024-08-18T22:17:21.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.820+0000 7f58641f3640 1 --2- 172.21.15.123:0/2849211912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f585c105c70 0x7f585c106100 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:21.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.820+0000 7f58641f3640 1 --2- 172.21.15.123:0/2849211912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f585c101180 0x7f585c105650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:21.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.820+0000 7f58641f3640 1 --2- 172.21.15.123:0/2849211912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f585c100860 0x7f585c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:21.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.820+0000 7f58641f3640 1 -- 172.21.15.123:0/2849211912 >> 172.21.15.123:0/2849211912 conn(0x7f585c0fc4d0 msgr2=0x7f585c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:21.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.820+0000 7f58641f3640 1 -- 172.21.15.123:0/2849211912 shutdown_connections 2024-08-18T22:17:21.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.820+0000 7f58641f3640 1 -- 172.21.15.123:0/2849211912 wait complete. 2024-08-18T22:17:21.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f58641f3640 1 Processor -- start 2024-08-18T22:17:21.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f58641f3640 1 -- start start 2024-08-18T22:17:21.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f58641f3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f585c100860 0x7f585c1a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:21.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f58641f3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f585c101180 0x7f585c1a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:21.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f58641f3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f585c105c70 0x7f585c19e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:21.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f58641f3640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1182f0 con 0x7f585c101180 2024-08-18T22:17:21.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f58641f3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f585c118170 con 0x7f585c105c70 2024-08-18T22:17:21.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f58641f3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f585c118470 con 0x7f585c100860 2024-08-18T22:17:21.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f586178e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f585c101180 0x7f585c1a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:21.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f586178e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f585c101180 0x7f585c1a4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37118/0 (socket says 172.21.15.123:37118) 2024-08-18T22:17:21.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f5862790640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f585c105c70 0x7f585c19e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:21.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f586178e640 1 -- 172.21.15.123:0/3653777625 learned_addr learned my addr 172.21.15.123:0/3653777625 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:17:21.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f5861f8f640 1 --2- 172.21.15.123:0/3653777625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f585c100860 0x7f585c1a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:21.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f586178e640 1 -- 172.21.15.123:0/3653777625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f585c100860 msgr2=0x7f585c1a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:21.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f586178e640 1 --2- 172.21.15.123:0/3653777625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f585c100860 0x7f585c1a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:21.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f586178e640 1 -- 172.21.15.123:0/3653777625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f585c105c70 msgr2=0x7f585c19e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:21.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f586178e640 1 --2- 172.21.15.123:0/3653777625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f585c105c70 0x7f585c19e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:21.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f586178e640 1 -- 172.21.15.123:0/3653777625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585c19ed30 con 0x7f585c101180 2024-08-18T22:17:21.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f5861f8f640 1 --2- 172.21.15.123:0/3653777625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f585c100860 0x7f585c1a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:17:21.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f5862790640 1 --2- 172.21.15.123:0/3653777625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f585c105c70 0x7f585c19e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:17:21.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.821+0000 7f586178e640 1 --2- 172.21.15.123:0/3653777625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f585c101180 0x7f585c1a4980 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f585000b3f0 tx=0x7f585000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:21.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.822+0000 7f585affd640 1 -- 172.21.15.123:0/3653777625 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5850015020 con 0x7f585c101180 2024-08-18T22:17:21.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.822+0000 7f585affd640 1 -- 172.21.15.123:0/3653777625 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5850011d10 con 0x7f585c101180 2024-08-18T22:17:21.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.822+0000 7f58641f3640 1 -- 172.21.15.123:0/3653777625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585c19f020 con 0x7f585c101180 2024-08-18T22:17:21.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.822+0000 7f585affd640 1 -- 172.21.15.123:0/3653777625 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585000f2e0 con 0x7f585c101180 2024-08-18T22:17:21.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.822+0000 7f58641f3640 1 -- 172.21.15.123:0/3653777625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f585c1ab310 con 0x7f585c101180 2024-08-18T22:17:21.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.823+0000 7f58641f3640 1 -- 172.21.15.123:0/3653777625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f585c105650 con 0x7f585c101180 2024-08-18T22:17:21.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.824+0000 7f585affd640 1 -- 172.21.15.123:0/3653777625 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f5850018020 con 0x7f585c101180 2024-08-18T22:17:21.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.824+0000 7f585affd640 1 --2- 172.21.15.123:0/3653777625 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58440a2b80 0x7f58440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:21.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.824+0000 7f5861f8f640 1 --2- 172.21.15.123:0/3653777625 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58440a2b80 0x7f58440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:21.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.824+0000 7f585affd640 1 -- 172.21.15.123:0/3653777625 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8854+0+0 (secure 0 0 0) 0x7f58500ceb00 con 0x7f585c101180 2024-08-18T22:17:21.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.825+0000 7f5861f8f640 1 --2- 172.21.15.123:0/3653777625 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58440a2b80 0x7f58440a5040 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f584c005fd0 tx=0x7f584c009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:21.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:21.829+0000 7f585affd640 1 -- 172.21.15.123:0/3653777625 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f585001f020 con 0x7f585c101180 2024-08-18T22:17:22.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:22.000+0000 7f58641f3640 1 -- 172.21.15.123:0/3653777625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f585c1ab4e0 con 0x7f585c101180 2024-08-18T22:17:22.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:22.246+0000 7f585affd640 1 -- 172.21.15.123:0/3653777625 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v99) ==== 169+0+0 (secure 0 0 0) 0x7f585009b7f0 con 0x7f585c101180 2024-08-18T22:17:22.247 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-08-18T22:17:22.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:22.248+0000 7f58641f3640 1 -- 172.21.15.123:0/3653777625 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58440a2b80 msgr2=0x7f58440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:22.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:22.248+0000 7f58641f3640 1 --2- 172.21.15.123:0/3653777625 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58440a2b80 0x7f58440a5040 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f584c005fd0 tx=0x7f584c009520 comp rx=0 tx=0).stop 2024-08-18T22:17:22.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:22.248+0000 7f58641f3640 1 -- 172.21.15.123:0/3653777625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f585c101180 msgr2=0x7f585c1a4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:22.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:22.248+0000 7f58641f3640 1 --2- 172.21.15.123:0/3653777625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f585c101180 0x7f585c1a4980 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f585000b3f0 tx=0x7f585000b8b0 comp rx=0 tx=0).stop 2024-08-18T22:17:22.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:22.248+0000 7f58641f3640 1 -- 172.21.15.123:0/3653777625 shutdown_connections 2024-08-18T22:17:22.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:22.248+0000 7f58641f3640 1 --2- 172.21.15.123:0/3653777625 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f58440a2b80 0x7f58440a5040 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:22.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:22.248+0000 7f58641f3640 1 --2- 172.21.15.123:0/3653777625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f585c105c70 0x7f585c19e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:22.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:22.248+0000 7f58641f3640 1 --2- 172.21.15.123:0/3653777625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f585c101180 0x7f585c1a4980 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:22.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:22.248+0000 7f58641f3640 1 --2- 172.21.15.123:0/3653777625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f585c100860 0x7f585c1a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:22.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:22.248+0000 7f58641f3640 1 -- 172.21.15.123:0/3653777625 >> 172.21.15.123:0/3653777625 conn(0x7f585c0fc4d0 msgr2=0x7f585c1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:22.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:22.248+0000 7f58641f3640 1 -- 172.21.15.123:0/3653777625 shutdown_connections 2024-08-18T22:17:22.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:22.248+0000 7f58641f3640 1 -- 172.21.15.123:0/3653777625 wait complete. 2024-08-18T22:17:22.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:22 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3653777625' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-18T22:17:22.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:22 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3653777625' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-18T22:17:22.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:22 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3653777625' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-18T22:17:23.022 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-08-18T22:17:23.272 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/mon.a/config 2024-08-18T22:17:23.504 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:23 smithi123 ceph-mon[18462]: pgmap v634: 97 pgs: 97 active+clean; 577 KiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:17:23.504 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:23 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/3653777625' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-18T22:17:23.504 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:23 smithi123 ceph-mon[18462]: osdmap e99: 12 total, 12 up, 12 in 2024-08-18T22:17:23.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:23 smithi130 ceph-mon[21698]: pgmap v634: 97 pgs: 97 active+clean; 577 KiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:17:23.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:23 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/3653777625' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-18T22:17:23.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:23 smithi130 ceph-mon[21698]: osdmap e99: 12 total, 12 up, 12 in 2024-08-18T22:17:23.560 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:23 smithi183 ceph-mon[22097]: pgmap v634: 97 pgs: 97 active+clean; 577 KiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:17:23.561 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:23 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/3653777625' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-18T22:17:23.561 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:23 smithi183 ceph-mon[22097]: osdmap e99: 12 total, 12 up, 12 in 2024-08-18T22:17:23.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.722+0000 7f6bd0ef5640 1 -- 172.21.15.123:0/316407200 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bcc102a70 msgr2=0x7f6bcc102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:23.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.722+0000 7f6bd0ef5640 1 --2- 172.21.15.123:0/316407200 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bcc102a70 0x7f6bcc102e50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009ca0 tx=0x7f6bbc02a950 comp rx=0 tx=0).stop 2024-08-18T22:17:23.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.722+0000 7f6bd0ef5640 1 -- 172.21.15.123:0/316407200 shutdown_connections 2024-08-18T22:17:23.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.722+0000 7f6bd0ef5640 1 --2- 172.21.15.123:0/316407200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bcc10bea0 0x7f6bcc10e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:23.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.722+0000 7f6bd0ef5640 1 --2- 172.21.15.123:0/316407200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bcc103390 0x7f6bcc10b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:23.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.722+0000 7f6bd0ef5640 1 --2- 172.21.15.123:0/316407200 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bcc102a70 0x7f6bcc102e50 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:23.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.722+0000 7f6bd0ef5640 1 -- 172.21.15.123:0/316407200 >> 172.21.15.123:0/316407200 conn(0x7f6bcc0fc4d0 msgr2=0x7f6bcc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:23.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.722+0000 7f6bd0ef5640 1 -- 172.21.15.123:0/316407200 shutdown_connections 2024-08-18T22:17:23.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.722+0000 7f6bd0ef5640 1 -- 172.21.15.123:0/316407200 wait complete. 2024-08-18T22:17:23.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.723+0000 7f6bd0ef5640 1 Processor -- start 2024-08-18T22:17:23.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.723+0000 7f6bd0ef5640 1 -- start start 2024-08-18T22:17:23.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.723+0000 7f6bd0ef5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bcc102a70 0x7f6bcc198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:23.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.723+0000 7f6bd0ef5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bcc103390 0x7f6bcc198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:23.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.723+0000 7f6bd0ef5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bcc10bea0 0x7f6bcc19cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:23.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.723+0000 7f6bd0ef5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6bcc111ce0 con 0x7f6bcc102a70 2024-08-18T22:17:23.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.723+0000 7f6bd0ef5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6bcc111b60 con 0x7f6bcc103390 2024-08-18T22:17:23.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.723+0000 7f6bd0ef5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6bcc111e60 con 0x7f6bcc10bea0 2024-08-18T22:17:23.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.723+0000 7f6bca59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bcc102a70 0x7f6bcc198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:23.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.723+0000 7f6bca59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bcc102a70 0x7f6bcc198200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54016/0 (socket says 172.21.15.123:54016) 2024-08-18T22:17:23.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.723+0000 7f6bca59c640 1 -- 172.21.15.123:0/1074558765 learned_addr learned my addr 172.21.15.123:0/1074558765 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-18T22:17:23.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.724+0000 7f6bcad9d640 1 --2- 172.21.15.123:0/1074558765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bcc10bea0 0x7f6bcc19cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:23.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.724+0000 7f6bca59c640 1 -- 172.21.15.123:0/1074558765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bcc10bea0 msgr2=0x7f6bcc19cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:23.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.724+0000 7f6bca59c640 1 --2- 172.21.15.123:0/1074558765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bcc10bea0 0x7f6bcc19cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:23.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.724+0000 7f6bca59c640 1 -- 172.21.15.123:0/1074558765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bcc103390 msgr2=0x7f6bcc198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:23.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.724+0000 7f6bc9d9b640 1 --2- 172.21.15.123:0/1074558765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bcc103390 0x7f6bcc198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:23.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.724+0000 7f6bca59c640 1 --2- 172.21.15.123:0/1074558765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bcc103390 0x7f6bcc198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:23.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.724+0000 7f6bca59c640 1 -- 172.21.15.123:0/1074558765 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bcc19d1b0 con 0x7f6bcc102a70 2024-08-18T22:17:23.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.724+0000 7f6bc9d9b640 1 --2- 172.21.15.123:0/1074558765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bcc103390 0x7f6bcc198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:17:23.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.724+0000 7f6bca59c640 1 --2- 172.21.15.123:0/1074558765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bcc102a70 0x7f6bcc198200 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc005cc0 tx=0x7f6bbc02f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:23.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.724+0000 7f6bbb7fe640 1 -- 172.21.15.123:0/1074558765 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc034040 con 0x7f6bcc102a70 2024-08-18T22:17:23.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.724+0000 7f6bd0ef5640 1 -- 172.21.15.123:0/1074558765 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bcc19d440 con 0x7f6bcc102a70 2024-08-18T22:17:23.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.724+0000 7f6bbb7fe640 1 -- 172.21.15.123:0/1074558765 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bbc030920 con 0x7f6bcc102a70 2024-08-18T22:17:23.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.724+0000 7f6bd0ef5640 1 -- 172.21.15.123:0/1074558765 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bcc1a4d80 con 0x7f6bcc102a70 2024-08-18T22:17:23.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.724+0000 7f6bbb7fe640 1 -- 172.21.15.123:0/1074558765 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc004830 con 0x7f6bcc102a70 2024-08-18T22:17:23.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.725+0000 7f6bd0ef5640 1 -- 172.21.15.123:0/1074558765 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bcc102e50 con 0x7f6bcc102a70 2024-08-18T22:17:23.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.726+0000 7f6bbb7fe640 1 -- 172.21.15.123:0/1074558765 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f6bbc037020 con 0x7f6bcc102a70 2024-08-18T22:17:23.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.727+0000 7f6bbb7fe640 1 --2- 172.21.15.123:0/1074558765 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6bb40a2b80 0x7f6bb40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:17:23.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.727+0000 7f6bc9d9b640 1 --2- 172.21.15.123:0/1074558765 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6bb40a2b80 0x7f6bb40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:17:23.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.727+0000 7f6bbb7fe640 1 -- 172.21.15.123:0/1074558765 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8324+0+0 (secure 0 0 0) 0x7f6bbc0f0020 con 0x7f6bcc102a70 2024-08-18T22:17:23.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.727+0000 7f6bc9d9b640 1 --2- 172.21.15.123:0/1074558765 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6bb40a2b80 0x7f6bb40a5040 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0006fd0 tx=0x7f6bc0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:17:23.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.731+0000 7f6bbb7fe640 1 -- 172.21.15.123:0/1074558765 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6bbc0bcfc0 con 0x7f6bcc102a70 2024-08-18T22:17:23.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:23.899+0000 7f6bd0ef5640 1 -- 172.21.15.123:0/1074558765 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6bcc106f40 con 0x7f6bcc102a70 2024-08-18T22:17:24.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:24.253+0000 7f6bbb7fe640 1 -- 172.21.15.123:0/1074558765 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v100) ==== 178+0+0 (secure 0 0 0) 0x7f6bbc0bc8c0 con 0x7f6bcc102a70 2024-08-18T22:17:24.254 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data_ec' removed 2024-08-18T22:17:24.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:24.255+0000 7f6bd0ef5640 1 -- 172.21.15.123:0/1074558765 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6bb40a2b80 msgr2=0x7f6bb40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:24.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:24.255+0000 7f6bd0ef5640 1 --2- 172.21.15.123:0/1074558765 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6bb40a2b80 0x7f6bb40a5040 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0006fd0 tx=0x7f6bc0008040 comp rx=0 tx=0).stop 2024-08-18T22:17:24.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:24.255+0000 7f6bd0ef5640 1 -- 172.21.15.123:0/1074558765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bcc102a70 msgr2=0x7f6bcc198200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:17:24.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:24.255+0000 7f6bd0ef5640 1 --2- 172.21.15.123:0/1074558765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bcc102a70 0x7f6bcc198200 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc005cc0 tx=0x7f6bbc02f630 comp rx=0 tx=0).stop 2024-08-18T22:17:24.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:24.255+0000 7f6bd0ef5640 1 -- 172.21.15.123:0/1074558765 shutdown_connections 2024-08-18T22:17:24.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:24.255+0000 7f6bd0ef5640 1 --2- 172.21.15.123:0/1074558765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bcc10bea0 0x7f6bcc19cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:24.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:24.256+0000 7f6bd0ef5640 1 --2- 172.21.15.123:0/1074558765 >> [v2:172.21.15.123:6800/22123895,v1:172.21.15.123:6801/22123895] conn(0x7f6bb40a2b80 0x7f6bb40a5040 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:24.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:24.256+0000 7f6bd0ef5640 1 --2- 172.21.15.123:0/1074558765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bcc103390 0x7f6bcc198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:17:24.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:24.256+0000 7f6bd0ef5640 1 --2- 172.21.15.123:0/1074558765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bcc102a70 0x7f6bcc198200 secure :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc005cc0 tx=0x7f6bbc02f630 comp rx=0 tx=0).stop 2024-08-18T22:17:24.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:24.256+0000 7f6bd0ef5640 1 -- 172.21.15.123:0/1074558765 >> 172.21.15.123:0/1074558765 conn(0x7f6bcc0fc4d0 msgr2=0x7f6bcc0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:17:24.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:24.257+0000 7f6bd0ef5640 1 -- 172.21.15.123:0/1074558765 shutdown_connections 2024-08-18T22:17:24.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-18T22:17:24.257+0000 7f6bd0ef5640 1 -- 172.21.15.123:0/1074558765 wait complete. 2024-08-18T22:17:24.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:24 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1074558765' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-18T22:17:24.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:24 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1074558765' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-18T22:17:24.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:24 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1074558765' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-18T22:17:25.024 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-18T22:17:25.051 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-18T22:17:25.084 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-18T22:17:25.113 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-18T22:17:25.114 DEBUG:teuthology.orchestra.run.smithi123:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-18T22:17:25.142 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-18T22:17:25.159 DEBUG:teuthology.orchestra.run.smithi183:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-18T22:17:25.174 INFO:tasks.cephadm:Stopping all daemons... 2024-08-18T22:17:25.175 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-08-18T22:17:25.175 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mon.a 2024-08-18T22:17:25.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:25 smithi183 ceph-mon[22097]: pgmap v636: 33 pgs: 33 active+clean; 577 KiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:17:25.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:25 smithi183 ceph-mon[22097]: from='client.? 172.21.15.123:0/1074558765' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-18T22:17:25.409 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:25 smithi183 ceph-mon[22097]: osdmap e100: 12 total, 12 up, 12 in 2024-08-18T22:17:25.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:25 smithi123 ceph-mon[18462]: pgmap v636: 33 pgs: 33 active+clean; 577 KiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:17:25.510 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:25 smithi123 ceph-mon[18462]: from='client.? 172.21.15.123:0/1074558765' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-18T22:17:25.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:25 smithi123 ceph-mon[18462]: osdmap e100: 12 total, 12 up, 12 in 2024-08-18T22:17:25.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:25 smithi123 systemd[1]: Stopping Ceph mon.a for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:17:25.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:25 smithi130 ceph-mon[21698]: pgmap v636: 33 pgs: 33 active+clean; 577 KiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-18T22:17:25.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:25 smithi130 ceph-mon[21698]: from='client.? 172.21.15.123:0/1074558765' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-18T22:17:25.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:25 smithi130 ceph-mon[21698]: osdmap e100: 12 total, 12 up, 12 in 2024-08-18T22:17:25.950 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:25 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a[18458]: 2024-08-18T22:17:25.623+0000 7f9a334c1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:17:25.950 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:25 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a[18458]: 2024-08-18T22:17:25.623+0000 7f9a334c1640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-08-18T22:17:25.950 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:25 smithi123 podman[188133]: 2024-08-18 22:17:25.654785669 +0000 UTC m=+0.168782487 container died 391aeb56646b7797c49322c0ecd73b752b78887609c3af722de733686031835e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-18T22:17:26.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:26 smithi123 podman[188133]: 2024-08-18 22:17:26.132692136 +0000 UTC m=+0.646689002 container cleanup 391aeb56646b7797c49322c0ecd73b752b78887609c3af722de733686031835e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:17:26.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Aug 18 22:17:26 smithi123 bash[188133]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-a 2024-08-18T22:17:26.623 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mon.a.service' 2024-08-18T22:17:26.681 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:17:26.681 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-08-18T22:17:26.681 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-08-18T22:17:26.681 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mon.b 2024-08-18T22:17:27.014 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:26 smithi130 systemd[1]: Stopping Ceph mon.b for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:17:27.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:27 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-b[21693]: 2024-08-18T22:17:27.053+0000 7f1a1864a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:17:27.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:27 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-b[21693]: 2024-08-18T22:17:27.053+0000 7f1a1864a640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-08-18T22:17:27.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:27 smithi130 podman[55740]: 2024-08-18 22:17:27.1051977 +0000 UTC m=+0.189212717 container died 480d5f7bdf7b8c0144221891ea7278197eb9749a744d4bd9f6ec913d733ba4fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-18T22:17:27.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:27 smithi130 podman[55740]: 2024-08-18 22:17:27.496409996 +0000 UTC m=+0.580425005 container cleanup 480d5f7bdf7b8c0144221891ea7278197eb9749a744d4bd9f6ec913d733ba4fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-b, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:17:27.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 18 22:17:27 smithi130 bash[55740]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-b 2024-08-18T22:17:27.951 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mon.b.service' 2024-08-18T22:17:27.998 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:17:27.999 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-08-18T22:17:27.999 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-08-18T22:17:27.999 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mon.c 2024-08-18T22:17:28.338 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:28 smithi183 systemd[1]: Stopping Ceph mon.c for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:17:28.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:28 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-c[22093]: 2024-08-18T22:17:28.336+0000 7f9882446640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:17:28.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:28 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-c[22093]: 2024-08-18T22:17:28.336+0000 7f9882446640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-08-18T22:17:28.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:28 smithi183 podman[56514]: 2024-08-18 22:17:28.490573129 +0000 UTC m=+0.260592219 container died 9943b5f35ebf0c296355587a8a9b3ccafb3964ec890317a23dcf5e09e940b11f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-c, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:17:29.140 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:28 smithi183 podman[56514]: 2024-08-18 22:17:28.904475037 +0000 UTC m=+0.674494128 container cleanup 9943b5f35ebf0c296355587a8a9b3ccafb3964ec890317a23dcf5e09e940b11f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-18T22:17:29.140 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:28 smithi183 bash[56514]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-c 2024-08-18T22:17:29.402 INFO:journalctl@ceph.mon.c.smithi183.stdout:Aug 18 22:17:29 smithi183 podman[56528]: 2024-08-18 22:17:29.139637662 +0000 UTC m=+0.653049194 container remove 9943b5f35ebf0c296355587a8a9b3ccafb3964ec890317a23dcf5e09e940b11f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mon-c, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-18T22:17:29.407 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mon.c.service' 2024-08-18T22:17:29.453 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:17:29.453 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-08-18T22:17:29.453 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-08-18T22:17:29.453 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mgr.x 2024-08-18T22:17:29.760 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 22:17:29 smithi123 systemd[1]: Stopping Ceph mgr.x for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:17:30.110 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 22:17:29 smithi123 podman[188603]: 2024-08-18 22:17:29.817141821 +0000 UTC m=+0.158306418 container died 27eeeff18cbb451889911c3836f66a5768718e03872d7024ad8583dac641df2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=) 2024-08-18T22:17:30.510 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 22:17:30 smithi123 podman[188603]: 2024-08-18 22:17:30.31855062 +0000 UTC m=+0.659715208 container cleanup 27eeeff18cbb451889911c3836f66a5768718e03872d7024ad8583dac641df2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-18T22:17:30.510 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Aug 18 22:17:30 smithi123 bash[188603]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-x 2024-08-18T22:17:30.760 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mgr.x.service' 2024-08-18T22:17:30.797 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:17:30.797 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-08-18T22:17:30.798 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-08-18T22:17:30.798 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mgr.y 2024-08-18T22:17:31.147 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:17:30 smithi130 systemd[1]: Stopping Ceph mgr.y for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:17:31.445 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:17:31 smithi130 podman[55958]: 2024-08-18 22:17:31.146923404 +0000 UTC m=+0.142519099 container died 803a4ff97461e86d4e815ce3141e18b93c9a2aed0d3fdb6f59c0d81ef9bb8d6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True) 2024-08-18T22:17:31.764 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:17:31 smithi130 podman[55958]: 2024-08-18 22:17:31.544242046 +0000 UTC m=+0.539837770 container cleanup 803a4ff97461e86d4e815ce3141e18b93c9a2aed0d3fdb6f59c0d81ef9bb8d6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-18T22:17:31.764 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 18 22:17:31 smithi130 bash[55958]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-y 2024-08-18T22:17:31.992 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mgr.y.service' 2024-08-18T22:17:32.027 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:17:32.027 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-08-18T22:17:32.027 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-08-18T22:17:32.027 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mgr.z 2024-08-18T22:17:32.372 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:17:32 smithi183 systemd[1]: Stopping Ceph mgr.z for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:17:32.659 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:17:32 smithi183 podman[56639]: 2024-08-18 22:17:32.372078367 +0000 UTC m=+0.145554154 container died d5afc1953c8e7591accd2bfa1e057d8e3ba9f462e3d44808b38c3a928dd5c84b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-18T22:17:33.028 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:17:32 smithi183 podman[56639]: 2024-08-18 22:17:32.801914637 +0000 UTC m=+0.575390425 container cleanup d5afc1953c8e7591accd2bfa1e057d8e3ba9f462e3d44808b38c3a928dd5c84b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=squid-de09dd0) 2024-08-18T22:17:33.029 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:17:32 smithi183 bash[56639]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z 2024-08-18T22:17:33.290 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:17:33 smithi183 podman[56653]: 2024-08-18 22:17:33.028234527 +0000 UTC m=+0.651712206 container remove d5afc1953c8e7591accd2bfa1e057d8e3ba9f462e3d44808b38c3a928dd5c84b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731) 2024-08-18T22:17:33.290 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Aug 18 22:17:33 smithi183 systemd[1]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-08-18T22:17:33.294 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mgr.z.service' 2024-08-18T22:17:33.328 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:17:33.329 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-08-18T22:17:33.329 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-18T22:17:33.329 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.0 2024-08-18T22:17:33.510 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:17:33 smithi123 systemd[1]: Stopping Ceph osd.0 for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:17:34.010 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:17:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-0[30331]: 2024-08-18T22:17:33.648+0000 7ff62152f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:17:34.011 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:17:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-0[30331]: 2024-08-18T22:17:33.648+0000 7ff62152f640 -1 osd.0 100 *** Got signal Terminated *** 2024-08-18T22:17:34.011 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:17:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-0[30331]: 2024-08-18T22:17:33.648+0000 7ff62152f640 -1 osd.0 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:17:39.376 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:17:39 smithi123 podman[188737]: 2024-08-18 22:17:39.084253584 +0000 UTC m=+5.562032245 container died 43045ed0659051c7ee98b3946d0f636ee30f6497c37250781be2400ed447aee7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-0, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-18T22:17:39.761 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:17:39 smithi123 podman[188737]: 2024-08-18 22:17:39.565919876 +0000 UTC m=+6.043698536 container cleanup 43045ed0659051c7ee98b3946d0f636ee30f6497c37250781be2400ed447aee7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0) 2024-08-18T22:17:39.761 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:17:39 smithi123 bash[188737]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-0 2024-08-18T22:17:40.196 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:17:39 smithi123 podman[188752]: 2024-08-18 22:17:39.867484237 +0000 UTC m=+0.782168858 container remove 43045ed0659051c7ee98b3946d0f636ee30f6497c37250781be2400ed447aee7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, ceph=True) 2024-08-18T22:17:40.506 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:17:40 smithi123 podman[188843]: 2024-08-18 22:17:40.098106585 +0000 UTC m=+0.017115897 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:17:40.506 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:17:40 smithi123 podman[188843]: 2024-08-18 22:17:40.201715966 +0000 UTC m=+0.120725298 container create 92789b84ccc27fc0de7f66ebaaaf7be453080cf652b0b9284098e385e16cefae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:17:40.760 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:17:40 smithi123 podman[188843]: 2024-08-18 22:17:40.505675878 +0000 UTC m=+0.424685178 container init 92789b84ccc27fc0de7f66ebaaaf7be453080cf652b0b9284098e385e16cefae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0) 2024-08-18T22:17:40.760 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:17:40 smithi123 podman[188843]: 2024-08-18 22:17:40.509281566 +0000 UTC m=+0.428290869 container start 92789b84ccc27fc0de7f66ebaaaf7be453080cf652b0b9284098e385e16cefae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, io.buildah.version=1.36.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-18T22:17:40.761 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:17:40 smithi123 podman[188843]: 2024-08-18 22:17:40.66391238 +0000 UTC m=+0.582921674 container attach 92789b84ccc27fc0de7f66ebaaaf7be453080cf652b0b9284098e385e16cefae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-08-18T22:17:41.926 INFO:journalctl@ceph.osd.0.smithi123.stdout:Aug 18 22:17:41 smithi123 podman[188843]: 2024-08-18 22:17:41.616368239 +0000 UTC m=+1.535377536 container died 92789b84ccc27fc0de7f66ebaaaf7be453080cf652b0b9284098e385e16cefae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-18T22:17:42.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.0.service' 2024-08-18T22:17:42.306 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:17:42.306 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-18T22:17:42.306 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-18T22:17:42.306 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.1 2024-08-18T22:17:42.641 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:17:42 smithi130 systemd[1]: Stopping Ceph osd.1 for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:17:43.014 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:17:42 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-1[26022]: 2024-08-18T22:17:42.639+0000 7f33547c6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:17:43.014 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:17:42 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-1[26022]: 2024-08-18T22:17:42.639+0000 7f33547c6640 -1 osd.1 100 *** Got signal Terminated *** 2024-08-18T22:17:43.015 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:17:42 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-1[26022]: 2024-08-18T22:17:42.639+0000 7f33547c6640 -1 osd.1 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:17:48.483 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:17:48 smithi130 podman[56084]: 2024-08-18 22:17:48.164757553 +0000 UTC m=+5.654614980 container died 2772066fbbb8ec8fe14fb5445063074d2548b12236d1507f67192bb8c7bbf12a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-1, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-18T22:17:48.764 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:17:48 smithi130 podman[56084]: 2024-08-18 22:17:48.573615652 +0000 UTC m=+6.063473079 container cleanup 2772066fbbb8ec8fe14fb5445063074d2548b12236d1507f67192bb8c7bbf12a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, RELEASE=squid-de09dd0) 2024-08-18T22:17:48.764 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:17:48 smithi130 bash[56084]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-1 2024-08-18T22:17:49.157 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:17:48 smithi130 podman[56102]: 2024-08-18 22:17:48.817240272 +0000 UTC m=+0.648336308 container remove 2772066fbbb8ec8fe14fb5445063074d2548b12236d1507f67192bb8c7bbf12a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-18T22:17:49.480 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:17:49 smithi130 podman[56194]: 2024-08-18 22:17:49.059150478 +0000 UTC m=+0.017472588 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:17:49.480 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:17:49 smithi130 podman[56194]: 2024-08-18 22:17:49.193158646 +0000 UTC m=+0.151480751 container create cd2d7a603bfdd92cbec40b086da99e75abc364b3686a6ec0572b419ab9dd5112 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:17:49.480 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:17:49 smithi130 podman[56194]: 2024-08-18 22:17:49.479625538 +0000 UTC m=+0.437947658 container init cd2d7a603bfdd92cbec40b086da99e75abc364b3686a6ec0572b419ab9dd5112 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, ceph=True) 2024-08-18T22:17:49.764 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:17:49 smithi130 podman[56194]: 2024-08-18 22:17:49.483421967 +0000 UTC m=+0.441744070 container start cd2d7a603bfdd92cbec40b086da99e75abc364b3686a6ec0572b419ab9dd5112 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-08-18T22:17:49.765 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:17:49 smithi130 podman[56194]: 2024-08-18 22:17:49.579263371 +0000 UTC m=+0.537585486 container attach cd2d7a603bfdd92cbec40b086da99e75abc364b3686a6ec0572b419ab9dd5112 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-18T22:17:49.765 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 18 22:17:49 smithi130 podman[56194]: 2024-08-18 22:17:49.671529782 +0000 UTC m=+0.629851911 container died cd2d7a603bfdd92cbec40b086da99e75abc364b3686a6ec0572b419ab9dd5112 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-18T22:17:50.332 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.1.service' 2024-08-18T22:17:50.374 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:17:50.375 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-18T22:17:50.375 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-18T22:17:50.375 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.2 2024-08-18T22:17:50.659 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:17:50 smithi183 systemd[1]: Stopping Ceph osd.2 for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:17:51.159 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:17:50 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-2[27023]: 2024-08-18T22:17:50.721+0000 7f0e82cf8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:17:51.160 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:17:50 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-2[27023]: 2024-08-18T22:17:50.721+0000 7f0e82cf8640 -1 osd.2 100 *** Got signal Terminated *** 2024-08-18T22:17:51.160 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:17:50 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-2[27023]: 2024-08-18T22:17:50.721+0000 7f0e82cf8640 -1 osd.2 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:17:56.409 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:17:56 smithi183 podman[56765]: 2024-08-18 22:17:56.089838547 +0000 UTC m=+5.514703812 container died 14c1d21e7e65a04f3ff295c94d8ab9ab2d96127e433d00b0e77de65b18029cb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-2, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-18T22:17:56.909 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:17:56 smithi183 podman[56765]: 2024-08-18 22:17:56.429957592 +0000 UTC m=+5.854822845 container cleanup 14c1d21e7e65a04f3ff295c94d8ab9ab2d96127e433d00b0e77de65b18029cb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-2, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-18T22:17:56.909 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:17:56 smithi183 bash[56765]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-2 2024-08-18T22:17:56.909 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:17:56 smithi183 podman[56780]: 2024-08-18 22:17:56.63139406 +0000 UTC m=+0.537635515 container remove 14c1d21e7e65a04f3ff295c94d8ab9ab2d96127e433d00b0e77de65b18029cb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-2, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-18T22:17:57.377 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:17:57 smithi183 podman[56869]: 2024-08-18 22:17:56.96285099 +0000 UTC m=+0.017871922 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:17:57.377 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:17:57 smithi183 podman[56869]: 2024-08-18 22:17:57.082161811 +0000 UTC m=+0.137182742 container create fe69822f1c482894613e7b5c40c4b1fa8680b30f24b8f2462ba3253bde5f13d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-18T22:17:57.377 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:17:57 smithi183 podman[56869]: 2024-08-18 22:17:57.376728944 +0000 UTC m=+0.431749888 container init fe69822f1c482894613e7b5c40c4b1fa8680b30f24b8f2462ba3253bde5f13d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:17:57.659 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:17:57 smithi183 podman[56869]: 2024-08-18 22:17:57.38013031 +0000 UTC m=+0.435151247 container start fe69822f1c482894613e7b5c40c4b1fa8680b30f24b8f2462ba3253bde5f13d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-08-18T22:17:57.659 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:17:57 smithi183 podman[56869]: 2024-08-18 22:17:57.476726206 +0000 UTC m=+0.531747143 container attach fe69822f1c482894613e7b5c40c4b1fa8680b30f24b8f2462ba3253bde5f13d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0) 2024-08-18T22:17:57.660 INFO:journalctl@ceph.osd.2.smithi183.stdout:Aug 18 22:17:57 smithi183 podman[56869]: 2024-08-18 22:17:57.588830765 +0000 UTC m=+0.643851702 container died fe69822f1c482894613e7b5c40c4b1fa8680b30f24b8f2462ba3253bde5f13d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-18T22:17:58.219 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.2.service' 2024-08-18T22:17:58.258 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:17:58.258 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-18T22:17:58.259 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-18T22:17:58.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.3 2024-08-18T22:17:58.571 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:17:58 smithi123 systemd[1]: Stopping Ceph osd.3 for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:17:59.010 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:17:58 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3[36964]: 2024-08-18T22:17:58.569+0000 7ffa98548640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:17:59.010 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:17:58 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3[36964]: 2024-08-18T22:17:58.569+0000 7ffa98548640 -1 osd.3 100 *** Got signal Terminated *** 2024-08-18T22:17:59.010 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:17:58 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3[36964]: 2024-08-18T22:17:58.569+0000 7ffa98548640 -1 osd.3 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:18:00.760 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:18:00 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3[36964]: 2024-08-18T22:18:00.291+0000 7ffa90b56640 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.142594+0000 front 2024-08-18T22:17:37.142658+0000 (oldest deadline 2024-08-18T22:17:59.442681+0000) 2024-08-18T22:18:00.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:00 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:00.397+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:00.846 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:00 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:00.495+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:01.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:00 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:00.844+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:01.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:00 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:00.858+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:01.661 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:01 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:01.384+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:01.662 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:18:01 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3[36964]: 2024-08-18T22:18:01.311+0000 7ffa90b56640 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.142594+0000 front 2024-08-18T22:17:37.142658+0000 (oldest deadline 2024-08-18T22:17:59.442681+0000) 2024-08-18T22:18:01.798 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:01 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:01.468+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:02.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:01 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:01.797+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:02.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:01 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:01.835+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:02.760 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:18:02 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3[36964]: 2024-08-18T22:18:02.304+0000 7ffa90b56640 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.142594+0000 front 2024-08-18T22:17:37.142658+0000 (oldest deadline 2024-08-18T22:17:59.442681+0000) 2024-08-18T22:18:02.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:02 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:02.399+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:02.787 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:02 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:02.493+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:03.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:02 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:02.801+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:03.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:02 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:02.786+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:03.760 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:18:03 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3[36964]: 2024-08-18T22:18:03.306+0000 7ffa90b56640 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.142594+0000 front 2024-08-18T22:17:37.142658+0000 (oldest deadline 2024-08-18T22:17:59.442681+0000) 2024-08-18T22:18:03.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:03 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:03.433+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:03.797 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:03 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:03.511+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:04.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:03 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:03.833+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:04.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:03 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:03.796+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:04.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:03 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:03.900+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:04.321 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:18:04 smithi123 podman[188947]: 2024-08-18 22:18:04.036417017 +0000 UTC m=+5.579003208 container died 6f65fef3a85ad5fbc6fe425570b6a8b8dd8348fd60bdf0305d74a99101708218 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-18T22:18:04.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:04 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:04.404+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:04.761 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:18:04 smithi123 podman[188947]: 2024-08-18 22:18:04.495429208 +0000 UTC m=+6.038015440 container cleanup 6f65fef3a85ad5fbc6fe425570b6a8b8dd8348fd60bdf0305d74a99101708218 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-18T22:18:04.761 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:18:04 smithi123 bash[188947]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3 2024-08-18T22:18:04.795 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:04 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:04.519+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:05.148 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:18:04 smithi123 podman[188973]: 2024-08-18 22:18:04.821940039 +0000 UTC m=+0.781501312 container remove 6f65fef3a85ad5fbc6fe425570b6a8b8dd8348fd60bdf0305d74a99101708218 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:18:05.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:04 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:04.793+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:05.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:04 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:04.827+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:05.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:04 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:04.941+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:05.415 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:18:05 smithi123 podman[189061]: 2024-08-18 22:18:05.050297157 +0000 UTC m=+0.017016347 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:18:05.415 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:18:05 smithi123 podman[189061]: 2024-08-18 22:18:05.189510529 +0000 UTC m=+0.156229751 container create ccbd2db9785b8e732dfee60a1164bc761a360097eaaf0adb091c8b50c3dbdcd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0) 2024-08-18T22:18:05.747 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:05.472+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:05.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:05 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:05.413+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:05.760 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:18:05 smithi123 podman[189061]: 2024-08-18 22:18:05.475821791 +0000 UTC m=+0.442540977 container init ccbd2db9785b8e732dfee60a1164bc761a360097eaaf0adb091c8b50c3dbdcd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3-deactivate, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-18T22:18:05.761 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:18:05 smithi123 podman[189061]: 2024-08-18 22:18:05.479152926 +0000 UTC m=+0.445872102 container start ccbd2db9785b8e732dfee60a1164bc761a360097eaaf0adb091c8b50c3dbdcd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:18:05.761 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:18:05 smithi123 podman[189061]: 2024-08-18 22:18:05.550815614 +0000 UTC m=+0.517534805 container attach ccbd2db9785b8e732dfee60a1164bc761a360097eaaf0adb091c8b50c3dbdcd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:18:05.761 INFO:journalctl@ceph.osd.3.smithi123.stdout:Aug 18 22:18:05 smithi123 podman[189061]: 2024-08-18 22:18:05.663950439 +0000 UTC m=+0.630669618 container died ccbd2db9785b8e732dfee60a1164bc761a360097eaaf0adb091c8b50c3dbdcd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-18T22:18:06.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:05.746+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:06.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:05.857+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:06.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:05 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:05.987+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:06.355 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.3.service' 2024-08-18T22:18:06.395 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:18:06.396 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-18T22:18:06.396 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-18T22:18:06.396 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.4 2024-08-18T22:18:06.728 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:06 smithi130 systemd[1]: Stopping Ceph osd.4 for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:18:06.756 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:06.446+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:06.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:06 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:06.431+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:06.982 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:06 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4[32842]: 2024-08-18T22:18:06.727+0000 7f6a7acea640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:18:06.982 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:06 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4[32842]: 2024-08-18T22:18:06.727+0000 7f6a7acea640 -1 osd.4 100 *** Got signal Terminated *** 2024-08-18T22:18:06.983 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:06 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4[32842]: 2024-08-18T22:18:06.727+0000 7f6a7acea640 -1 osd.4 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:18:07.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:06.754+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:07.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:06.901+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:07.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:06 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:06.981+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:07.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:07 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:07.399+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:07.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:07 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:07.475+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:08.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:07 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:07.802+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:08.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:07 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:07.936+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:08.518 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:08 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:08.030+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:08.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:08 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:08.412+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:08.776 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:08 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:08.502+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:09.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:08 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:08.775+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:09.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:08 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:08.895+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:09.514 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:09 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:09.060+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:09.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:09 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:09.401+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:09.761 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:09 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:09.491+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:10.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:09 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:09.760+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:10.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:09 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:09.850+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:10.264 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:09 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4[32842]: 2024-08-18T22:18:09.960+0000 7f6a732f8640 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.031825+0000 front 2024-08-18T22:17:47.031672+0000 (oldest deadline 2024-08-18T22:18:09.342908+0000) 2024-08-18T22:18:10.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:10 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:10.080+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:10.675 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:10.362+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:10.675 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:10.362+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:10.774 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:10 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:10.506+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:11.010 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:10.673+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:11.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:10 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:10.772+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:11.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:10 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:10.855+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:11.264 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:10 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4[32842]: 2024-08-18T22:18:10.919+0000 7f6a732f8640 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.031825+0000 front 2024-08-18T22:17:47.031672+0000 (oldest deadline 2024-08-18T22:18:09.342908+0000) 2024-08-18T22:18:11.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:11 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:11.093+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:11.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:11 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:11.093+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:11.701 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:11 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:11.349+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:11.701 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:11 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:11.349+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:11.807 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:11 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:11.461+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:12.010 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:11 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:11.700+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:12.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:11 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:11.811+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:12.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:11 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:11.806+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:12.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:11 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:11.806+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:12.514 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:12 smithi130 podman[56310]: 2024-08-18 22:18:12.243944767 +0000 UTC m=+5.638313842 container died d5a0b6068b5502721ea68925d98c399b969eb636f7f9cf447d0f5addf2e3976c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-08-18T22:18:12.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:12 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:12.116+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:12.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:12 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:12.116+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:12.734 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:12 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:12.382+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:12.734 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:12 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:12.382+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:12.790 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:12 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:12.503+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:12.904 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:12 smithi130 podman[56310]: 2024-08-18 22:18:12.611175858 +0000 UTC m=+6.005544938 container cleanup d5a0b6068b5502721ea68925d98c399b969eb636f7f9cf447d0f5addf2e3976c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-18T22:18:12.904 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:12 smithi130 bash[56310]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4 2024-08-18T22:18:13.010 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:12 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:12.733+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:13.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:12 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:12.850+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:13.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:12 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:12.850+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.607036+0000 front 2024-08-18T22:17:46.607056+0000 (oldest deadline 2024-08-18T22:18:11.907127+0000) 2024-08-18T22:18:13.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:12 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:12.789+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:13.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:12 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:12.789+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:13.242 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:12 smithi130 podman[56325]: 2024-08-18 22:18:12.904174125 +0000 UTC m=+0.653935180 container remove d5a0b6068b5502721ea68925d98c399b969eb636f7f9cf447d0f5addf2e3976c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-18T22:18:13.243 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:13 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:13.077+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:13.243 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:13 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:13.077+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:13.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:13 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:13.412+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:13.515 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:13 smithi130 podman[56413]: 2024-08-18 22:18:13.145046597 +0000 UTC m=+0.017753371 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:18:13.515 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:13 smithi130 podman[56413]: 2024-08-18 22:18:13.272022413 +0000 UTC m=+0.144729172 container create 9263c29ee267b8f8dcfe2d52efd89f073110176161703e5783b210691061e9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-08-18T22:18:13.754 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:13 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:13.373+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:13.755 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:13 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:13.373+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:13.814 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:13 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:13.539+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:13.814 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:13 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:13.743+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:13.814 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:13 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:13.743+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:14.010 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:13 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:13.753+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:14.014 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:13 smithi130 podman[56413]: 2024-08-18 22:18:13.533179414 +0000 UTC m=+0.405886179 container init 9263c29ee267b8f8dcfe2d52efd89f073110176161703e5783b210691061e9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-18T22:18:14.014 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:13 smithi130 podman[56413]: 2024-08-18 22:18:13.536875511 +0000 UTC m=+0.409582272 container start 9263c29ee267b8f8dcfe2d52efd89f073110176161703e5783b210691061e9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:18:14.014 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:13 smithi130 podman[56413]: 2024-08-18 22:18:13.591250933 +0000 UTC m=+0.463957702 container attach 9263c29ee267b8f8dcfe2d52efd89f073110176161703e5783b210691061e9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-18T22:18:14.015 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 18 22:18:13 smithi130 podman[56413]: 2024-08-18 22:18:13.728892344 +0000 UTC m=+0.601599116 container died 9263c29ee267b8f8dcfe2d52efd89f073110176161703e5783b210691061e9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:18:14.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:13 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:13.812+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:14.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:13 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:13.812+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.607036+0000 front 2024-08-18T22:17:46.607056+0000 (oldest deadline 2024-08-18T22:18:11.907127+0000) 2024-08-18T22:18:14.395 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:14 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:14.074+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:14.395 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:14 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:14.074+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:14.418 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.4.service' 2024-08-18T22:18:14.457 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:18:14.457 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-18T22:18:14.458 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-18T22:18:14.458 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.5 2024-08-18T22:18:14.745 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:14 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:14.419+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:14.746 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:14 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:14.419+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:14.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:14 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:14.420+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:14.800 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:14 smithi183 systemd[1]: Stopping Ceph osd.5 for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:18:14.800 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:14 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:14.489+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:14.801 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:14 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:14.717+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:14.801 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:14 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:14.717+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:15.010 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:14 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:14.744+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:15.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:14 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:14.798+0000 7f609e672640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:18:15.160 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:14 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:14.798+0000 7f609e672640 -1 osd.5 100 *** Got signal Terminated *** 2024-08-18T22:18:15.160 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:14 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:14.798+0000 7f609e672640 -1 osd.5 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:18:15.160 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:14 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:14.803+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:15.160 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:14 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:14.803+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.607036+0000 front 2024-08-18T22:17:46.607056+0000 (oldest deadline 2024-08-18T22:18:11.907127+0000) 2024-08-18T22:18:15.381 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:15 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:15.053+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:15.381 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:15 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:15.053+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:15.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:15 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:15.424+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:15.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:15 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:15.424+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:15.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:15 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:15.380+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:15.837 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:15.453+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:15.837 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:15.701+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:15.838 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:15.701+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:16.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:15.835+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:16.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:15 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:15.835+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.607036+0000 front 2024-08-18T22:17:46.607056+0000 (oldest deadline 2024-08-18T22:18:11.907127+0000) 2024-08-18T22:18:16.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:15 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:15.784+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:16.355 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:16 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:16.066+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:16.356 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:16 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:16.066+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:16.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:16 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:16.442+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:16.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:16 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:16.442+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:16.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:16 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:16.355+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:16.791 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:16 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:16.460+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:16.791 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:16 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:16.691+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:16.791 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:16 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:16.691+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:17.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:16 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:16.790+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:17.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:16 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:16.790+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.607036+0000 front 2024-08-18T22:17:46.607056+0000 (oldest deadline 2024-08-18T22:18:11.907127+0000) 2024-08-18T22:18:17.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:16 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:16.812+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:17.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:16 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:16.812+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.698749+0000 front 2024-08-18T22:17:55.698732+0000 (oldest deadline 2024-08-18T22:18:16.798668+0000) 2024-08-18T22:18:17.387 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:17.041+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:17.387 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:17.041+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:17.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:17 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:17.435+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:17.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:17 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:17.435+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:17.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:17.387+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:17.839 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:17 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:17.419+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:17.840 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:17 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:17.647+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:17.840 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:17 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:17.647+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:18.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:17 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:17.839+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:18.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:17 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:17.839+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.607036+0000 front 2024-08-18T22:17:46.607056+0000 (oldest deadline 2024-08-18T22:18:11.907127+0000) 2024-08-18T22:18:18.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:17 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:17.806+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:18.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:17 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:17.806+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.698749+0000 front 2024-08-18T22:17:55.698732+0000 (oldest deadline 2024-08-18T22:18:16.798668+0000) 2024-08-18T22:18:18.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:17.996+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:18.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:17 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:17.996+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:18.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:18 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:18.437+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:18.762 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:18 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:18.437+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:18.762 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:18 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:18.437+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:18.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:18 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:18.426+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:18.852 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:18 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:18.444+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:18.853 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:18 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:18.685+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:18.853 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:18 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:18.685+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:19.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:18 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:18.852+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.305313+0000 front 2024-08-18T22:17:34.305396+0000 (oldest deadline 2024-08-18T22:18:00.205214+0000) 2024-08-18T22:18:19.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:18 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:18.852+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.607036+0000 front 2024-08-18T22:17:46.607056+0000 (oldest deadline 2024-08-18T22:18:11.907127+0000) 2024-08-18T22:18:19.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:18 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5[33849]: 2024-08-18T22:18:18.852+0000 7f609ac88640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:54.207884+0000 front 2024-08-18T22:17:54.207795+0000 (oldest deadline 2024-08-18T22:18:18.308015+0000) 2024-08-18T22:18:19.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:18 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:18.761+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:19.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:18 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:18.761+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.698749+0000 front 2024-08-18T22:17:55.698732+0000 (oldest deadline 2024-08-18T22:18:16.798668+0000) 2024-08-18T22:18:19.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:19 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:19.022+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:19.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:19 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:19.022+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:19.757 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:19 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:19.451+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:19.757 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:19 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:19.451+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:19.757 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:19 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:19.451+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:19.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:19 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:19.377+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:19.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:19 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:19.377+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:19.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:19 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:19.471+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:19.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:19 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:19.698+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:19.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:19 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:19.698+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:20.010 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:19 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:19.756+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:20.010 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:19 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:19.756+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.698749+0000 front 2024-08-18T22:17:55.698732+0000 (oldest deadline 2024-08-18T22:18:16.798668+0000) 2024-08-18T22:18:20.337 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:20 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:20.052+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:20.338 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:20 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:20.052+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:20.338 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:20 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:20.052+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:20.491 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:20 smithi183 podman[56987]: 2024-08-18 22:18:20.240414366 +0000 UTC m=+5.575201826 container died c847ebb7b8385f4905903b0a89a2d019684e2f62c62cc4ef171a1698c62a6b4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:18:20.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:20 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:20.481+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:20.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:20 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:20.481+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:20.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:20 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:20.481+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:20.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:20 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:20.337+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:20.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:20 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:20.337+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:20.809 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:20 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:20.513+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:20.810 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:20 smithi183 podman[56987]: 2024-08-18 22:18:20.590552728 +0000 UTC m=+5.925340178 container cleanup c847ebb7b8385f4905903b0a89a2d019684e2f62c62cc4ef171a1698c62a6b4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-18T22:18:20.810 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:20 smithi183 bash[56987]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5 2024-08-18T22:18:20.810 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:20 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:20.691+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:20.811 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:20 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:20.691+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:20.811 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:20 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:20.691+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:21.159 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:20 smithi183 podman[57005]: 2024-08-18 22:18:20.808553965 +0000 UTC m=+0.561298129 container remove c847ebb7b8385f4905903b0a89a2d019684e2f62c62cc4ef171a1698c62a6b4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-18T22:18:21.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:20 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:20.764+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:21.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:20 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:20.764+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.698749+0000 front 2024-08-18T22:17:55.698732+0000 (oldest deadline 2024-08-18T22:18:16.798668+0000) 2024-08-18T22:18:21.512 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:21 smithi183 podman[57096]: 2024-08-18 22:18:21.126366576 +0000 UTC m=+0.017351518 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:18:21.512 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:21 smithi183 podman[57096]: 2024-08-18 22:18:21.250988868 +0000 UTC m=+0.141973798 container create f993aca46b0c66f43ac75fa9a228d40bcf4affae91f94dde5b835e01e5f7bca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-18T22:18:21.512 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:21 smithi183 podman[57096]: 2024-08-18 22:18:21.511792387 +0000 UTC m=+0.402777322 container init f993aca46b0c66f43ac75fa9a228d40bcf4affae91f94dde5b835e01e5f7bca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5-deactivate, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:18:21.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:21 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:21.294+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:21.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:21 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:21.294+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:21.514 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:21 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:21.071+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:21.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:21 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:21.071+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:21.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:21 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:21.071+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:21.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:21 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:21.485+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:21.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:21 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:21.485+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:21.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:21 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:21.485+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:21.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:21 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:21.559+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:21.910 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:21 smithi183 podman[57096]: 2024-08-18 22:18:21.515154828 +0000 UTC m=+0.406139760 container start f993aca46b0c66f43ac75fa9a228d40bcf4affae91f94dde5b835e01e5f7bca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-18T22:18:21.910 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:21 smithi183 podman[57096]: 2024-08-18 22:18:21.611768158 +0000 UTC m=+0.502753097 container attach f993aca46b0c66f43ac75fa9a228d40bcf4affae91f94dde5b835e01e5f7bca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True) 2024-08-18T22:18:21.910 INFO:journalctl@ceph.osd.5.smithi183.stdout:Aug 18 22:18:21 smithi183 podman[57096]: 2024-08-18 22:18:21.705006755 +0000 UTC m=+0.595991687 container died f993aca46b0c66f43ac75fa9a228d40bcf4affae91f94dde5b835e01e5f7bca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True) 2024-08-18T22:18:21.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:21 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:21.684+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:21.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:21 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:21.684+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:21.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:21 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:21.684+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:22.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:21 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:21.764+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:22.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:21 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:21.764+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.698749+0000 front 2024-08-18T22:17:55.698732+0000 (oldest deadline 2024-08-18T22:18:16.798668+0000) 2024-08-18T22:18:22.288 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.5.service' 2024-08-18T22:18:22.327 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:18:22.327 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-18T22:18:22.327 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-08-18T22:18:22.327 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.6 2024-08-18T22:18:22.343 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:22 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:22.043+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:22.343 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:22 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:22.043+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:22.343 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:22 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:22.043+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:22.624 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:22 smithi123 systemd[1]: Stopping Ceph osd.6 for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:18:22.625 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:22 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:22.454+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:22.625 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:22 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:22.454+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:22.625 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:22 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:22.454+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:22.684 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:22 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:22.341+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:22.684 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:22 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:22.341+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:22.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:22 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:22.596+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:22.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:22 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:22.596+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:22.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:22 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:22.718+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:22.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:22 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:22.718+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:22.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:22 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:22.718+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:23.010 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:22 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:22.623+0000 7f11ea9db640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:18:23.010 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:22 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:22.623+0000 7f11ea9db640 -1 osd.6 100 *** Got signal Terminated *** 2024-08-18T22:18:23.010 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:22 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:22.623+0000 7f11ea9db640 -1 osd.6 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:18:23.011 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:22 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:22.761+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:23.011 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:22 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:22.761+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.698749+0000 front 2024-08-18T22:17:55.698732+0000 (oldest deadline 2024-08-18T22:18:16.798668+0000) 2024-08-18T22:18:23.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:23 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:23.305+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:23.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:23 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:23.305+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:23.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:23 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:23.059+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:23.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:23 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:23.059+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:23.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:23 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:23.059+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:23.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:23 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:23.491+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:23.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:23 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:23.491+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:23.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:23 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:23.491+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:23.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:23 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:23.569+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:23.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:23 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:23.569+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:23.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:23 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:23.725+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:23.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:23 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:23.725+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:23.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:23 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:23.725+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:24.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:23 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:23.810+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:24.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:23 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:23.810+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.698749+0000 front 2024-08-18T22:17:55.698732+0000 (oldest deadline 2024-08-18T22:18:16.798668+0000) 2024-08-18T22:18:24.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:24 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:24.311+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:24.515 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:24 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:24.311+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:24.515 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:24 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:24.311+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.825923+0000 front 2024-08-18T22:18:01.826015+0000 (oldest deadline 2024-08-18T22:18:24.126035+0000) 2024-08-18T22:18:24.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:24 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:24.089+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:24.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:24 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:24.089+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:24.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:24 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:24.089+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:24.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:24 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:24.508+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:24.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:24 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:24.508+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:24.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:24 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:24.508+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:24.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:24 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:24.618+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:24.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:24 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:24.618+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:24.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:24 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:24.680+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:24.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:24 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:24.680+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:24.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:24 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:24.680+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:25.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:24 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:24.851+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:25.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:24 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:24.851+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.698749+0000 front 2024-08-18T22:17:55.698732+0000 (oldest deadline 2024-08-18T22:18:16.798668+0000) 2024-08-18T22:18:25.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:25 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:25.268+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:25.515 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:25 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:25.268+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:25.515 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:25 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:25.268+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.825923+0000 front 2024-08-18T22:18:01.826015+0000 (oldest deadline 2024-08-18T22:18:24.126035+0000) 2024-08-18T22:18:25.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:25 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:25.095+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:25.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:25 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:25.095+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:25.516 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:25 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:25.095+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:25.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:25 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:25.496+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:25.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:25 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:25.496+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:25.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:25 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:25.496+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:25.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:25 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:25.607+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:25.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:25 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:25.607+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:25.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:25 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:25.633+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:25.911 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:25 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:25.633+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:25.911 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:25 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:25.633+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:26.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:25 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:25.811+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:26.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:25 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:25.811+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.698749+0000 front 2024-08-18T22:17:55.698732+0000 (oldest deadline 2024-08-18T22:18:16.798668+0000) 2024-08-18T22:18:26.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:26 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:26.256+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:26.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:26 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:26.256+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:26.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:26 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:26.256+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.825923+0000 front 2024-08-18T22:18:01.826015+0000 (oldest deadline 2024-08-18T22:18:24.126035+0000) 2024-08-18T22:18:26.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:26 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:26.070+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:26.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:26 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:26.070+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:26.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:26 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:26.070+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:26.515 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:26 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:26.070+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:26.833 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:26 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:26.563+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:26.833 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:26 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:26.563+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:26.833 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:26 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:26.665+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:26.833 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:26 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:26.665+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:26.834 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:26 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:26.665+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:26.834 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:26 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:26.512+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:26.834 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:26 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:26.512+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:26.835 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:26 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:26.512+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:26.835 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:26 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:26.512+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:27.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:26 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:26.833+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:44.597623+0000 front 2024-08-18T22:17:44.597357+0000 (oldest deadline 2024-08-18T22:18:09.897299+0000) 2024-08-18T22:18:27.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:26 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:26.833+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.698749+0000 front 2024-08-18T22:17:55.698732+0000 (oldest deadline 2024-08-18T22:18:16.798668+0000) 2024-08-18T22:18:27.260 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:26 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6[43467]: 2024-08-18T22:18:26.833+0000 7f11e6ff1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:02.099367+0000 front 2024-08-18T22:18:02.099435+0000 (oldest deadline 2024-08-18T22:18:26.199528+0000) 2024-08-18T22:18:27.297 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:27 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:27.037+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:27.297 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:27 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:27.037+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:27.298 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:27 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:27.037+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:27.298 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:27 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:27.037+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:27.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:27 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:27.500+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:27.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:27 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:27.500+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:27.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:27 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:27.500+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:27.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:27 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:27.500+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:27.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:27 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:27.295+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:27.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:27 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:27.295+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:27.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:27 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:27.295+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.825923+0000 front 2024-08-18T22:18:01.826015+0000 (oldest deadline 2024-08-18T22:18:24.126035+0000) 2024-08-18T22:18:27.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:27 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:27.606+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:27.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:27 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:27.606+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:27.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:27 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:27.606+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:27.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:27 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:27.689+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:27.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:27 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:27.689+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:27.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:27 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:27.689+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:28.258 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:27 smithi123 podman[189166]: 2024-08-18 22:18:27.977184231 +0000 UTC m=+5.450028164 container died be223c51d6eb129d4eb85633404c217729c0bdba3ae182509f5e65a814e1449a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:18:28.333 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:28 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:28.035+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:28.333 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:28 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:28.035+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:28.333 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:28 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:28.035+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:28.333 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:28 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:28.035+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:28.510 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:28 smithi123 podman[189166]: 2024-08-18 22:18:28.482193703 +0000 UTC m=+5.955037626 container cleanup be223c51d6eb129d4eb85633404c217729c0bdba3ae182509f5e65a814e1449a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-18T22:18:28.510 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:28 smithi123 bash[189166]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6 2024-08-18T22:18:28.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:28 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:28.331+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:28.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:28 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:28.331+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:28.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:28 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:28.331+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.825923+0000 front 2024-08-18T22:18:01.826015+0000 (oldest deadline 2024-08-18T22:18:24.126035+0000) 2024-08-18T22:18:28.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:28 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:28.576+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:28.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:28 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:28.576+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:28.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:28 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:28.576+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:28.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:28 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:28.711+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:28.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:28 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:28.711+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:28.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:28 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:28.711+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:29.010 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:28 smithi123 podman[189183]: 2024-08-18 22:18:28.742089205 +0000 UTC m=+0.759736571 container remove be223c51d6eb129d4eb85633404c217729c0bdba3ae182509f5e65a814e1449a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:18:29.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:28 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:28.520+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:29.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:28 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:28.520+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:29.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:28 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:28.520+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:29.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:28 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:28.520+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:29.345 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:29 smithi123 podman[189275]: 2024-08-18 22:18:28.966687832 +0000 UTC m=+0.017154825 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:18:29.346 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:29 smithi123 podman[189275]: 2024-08-18 22:18:29.101193276 +0000 UTC m=+0.151660248 container create 84f55498062aac231fe81226ed2eb446b7a356d4354975ddccff80507290d8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-18T22:18:29.346 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:29 smithi123 podman[189275]: 2024-08-18 22:18:29.345372492 +0000 UTC m=+0.395839477 container init 84f55498062aac231fe81226ed2eb446b7a356d4354975ddccff80507290d8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0) 2024-08-18T22:18:29.366 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:29 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:29.059+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:29.367 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:29 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:29.059+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:29.367 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:29 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:29.059+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:29.367 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:29 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:29.059+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:29.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:29 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:29.505+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:29.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:29 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:29.505+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:29.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:29 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:29.505+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:29.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:29 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:29.505+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:29.761 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:29 smithi123 podman[189275]: 2024-08-18 22:18:29.34900531 +0000 UTC m=+0.399472285 container start 84f55498062aac231fe81226ed2eb446b7a356d4354975ddccff80507290d8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-18T22:18:29.761 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:29 smithi123 podman[189275]: 2024-08-18 22:18:29.445753608 +0000 UTC m=+0.496220595 container attach 84f55498062aac231fe81226ed2eb446b7a356d4354975ddccff80507290d8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-08-18T22:18:29.762 INFO:journalctl@ceph.osd.6.smithi123.stdout:Aug 18 22:18:29 smithi123 podman[189275]: 2024-08-18 22:18:29.545506877 +0000 UTC m=+0.595973858 container died 84f55498062aac231fe81226ed2eb446b7a356d4354975ddccff80507290d8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, ceph=True) 2024-08-18T22:18:29.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:29 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:29.365+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:29.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:29 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:29.365+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:29.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:29 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:29.365+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.825923+0000 front 2024-08-18T22:18:01.826015+0000 (oldest deadline 2024-08-18T22:18:24.126035+0000) 2024-08-18T22:18:29.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:29 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:29.560+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:29.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:29 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:29.560+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:29.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:29 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:29.560+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:29.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:29 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:29.755+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:29.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:29 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:29.755+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:29.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:29 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:29.755+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:30.176 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.6.service' 2024-08-18T22:18:30.215 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:18:30.216 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-08-18T22:18:30.216 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-08-18T22:18:30.216 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.7 2024-08-18T22:18:30.344 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:30 smithi130 systemd[1]: Stopping Ceph osd.7 for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:18:30.344 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:30 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:30.062+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:30.344 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:30 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:30.062+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:30.345 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:30 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:30.062+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:30.345 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:30 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:30.062+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:30.476 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:30 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:30.473+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:30.477 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:30 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:30.473+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:30.477 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:30 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:30.473+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:30.477 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:30 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:30.473+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:30.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:30 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:30.342+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:30.765 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:30 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:30.342+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:30.765 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:30 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:30.342+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.825923+0000 front 2024-08-18T22:18:01.826015+0000 (oldest deadline 2024-08-18T22:18:24.126035+0000) 2024-08-18T22:18:30.765 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:30 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:30.547+0000 7f1b3d823640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:18:30.765 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:30 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:30.547+0000 7f1b3d823640 -1 osd.7 100 *** Got signal Terminated *** 2024-08-18T22:18:30.765 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:30 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:30.547+0000 7f1b3d823640 -1 osd.7 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:18:30.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:30 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:30.729+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:30.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:30 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:30.729+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:30.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:30 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:30.729+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:30.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:30 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:30.585+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:30.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:30 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:30.585+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:30.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:30 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:30.585+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:31.300 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:31 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:31.021+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:31.300 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:31 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:31.021+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:31.300 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:31 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:31.021+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:31.300 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:31 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:31.021+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:31.662 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:31 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:31.500+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:31.662 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:31 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:31.500+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:31.662 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:31 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:31.500+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:31.662 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:31 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:31.500+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:31.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:31 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:31.298+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:31.764 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:31 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:31.298+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:31.765 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:31 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:31.298+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.825923+0000 front 2024-08-18T22:18:01.826015+0000 (oldest deadline 2024-08-18T22:18:24.126035+0000) 2024-08-18T22:18:31.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:31 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:31.732+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:31.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:31 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:31.732+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:31.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:31 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:31.732+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:31.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:31 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:31.578+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:31.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:31 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:31.578+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:31.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:31 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:31.578+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:32.260 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:31 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:31.990+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:32.261 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:31 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:31.990+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:32.261 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:31 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:31.990+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:32.261 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:31 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:31.990+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:32.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:32 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:32.259+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:32.515 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:32 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:32.259+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:32.515 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:32 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:32.259+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.825923+0000 front 2024-08-18T22:18:01.826015+0000 (oldest deadline 2024-08-18T22:18:24.126035+0000) 2024-08-18T22:18:32.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:32 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:32.691+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:32.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:32 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:32.691+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:32.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:32 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:32.691+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:32.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:32 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:32.544+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:32.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:32 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:32.544+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:32.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:32 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:32.544+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:32.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:32 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:32.544+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:07.229409+0000 front 2024-08-18T22:18:07.229533+0000 (oldest deadline 2024-08-18T22:18:32.529369+0000) 2024-08-18T22:18:33.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:32 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:32.520+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:33.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:32 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:32.520+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:33.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:32 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:32.520+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:33.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:32 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:32.520+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:33.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:32 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:32.520+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:33.014 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:32 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:32.998+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:33.014 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:32 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:32.998+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:33.014 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:32 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:32.998+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:33.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:32 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:32.998+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:33.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:33 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:33.226+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:33.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:33 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:33.226+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:33.515 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:33 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:33.226+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.825923+0000 front 2024-08-18T22:18:01.826015+0000 (oldest deadline 2024-08-18T22:18:24.126035+0000) 2024-08-18T22:18:33.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:33.482+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:33.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:33.482+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:33.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:33.482+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:33.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:33.482+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:33.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:33 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:33.482+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:33.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:33 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:33.716+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:33.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:33 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:33.716+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:33.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:33 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:33.716+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:33.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:33 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:33.716+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:33.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:33 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:33.568+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:33.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:33 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:33.568+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:33.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:33 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:33.568+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:33.911 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:33 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:33.568+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:07.229409+0000 front 2024-08-18T22:18:07.229533+0000 (oldest deadline 2024-08-18T22:18:32.529369+0000) 2024-08-18T22:18:34.237 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:33 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:33.982+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:34.237 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:33 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:33.982+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:34.237 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:33 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:33.982+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:34.237 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:33 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:33.982+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:34.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:34 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:34.235+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:34.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:34 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:34.235+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:34.515 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:34 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:34.235+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.825923+0000 front 2024-08-18T22:18:01.826015+0000 (oldest deadline 2024-08-18T22:18:24.126035+0000) 2024-08-18T22:18:34.515 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:34 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:34.235+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.528418+0000 front 2024-08-18T22:18:11.528461+0000 (oldest deadline 2024-08-18T22:18:33.228544+0000) 2024-08-18T22:18:34.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:34 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:34.758+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:34.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:34 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:34.758+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:34.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:34 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:34.758+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:34.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:34 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:34.758+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:34.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:34 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:34.617+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:34.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:34 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:34.617+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:34.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:34 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:34.617+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:34.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:34 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:34.617+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:07.229409+0000 front 2024-08-18T22:18:07.229533+0000 (oldest deadline 2024-08-18T22:18:32.529369+0000) 2024-08-18T22:18:35.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:34 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:34.526+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:35.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:34 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:34.526+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:35.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:34 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:34.526+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:35.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:34 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:34.526+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:35.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:34 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:34.526+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:35.238 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:34 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:34.953+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:35.239 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:34 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:34.953+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:35.239 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:34 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:34.953+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:35.240 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:34 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:34.953+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:35.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:35 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:35.237+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:47.323242+0000 front 2024-08-18T22:17:47.323383+0000 (oldest deadline 2024-08-18T22:18:13.223467+0000) 2024-08-18T22:18:35.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:35 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:35.237+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.224142+0000 front 2024-08-18T22:17:53.224119+0000 (oldest deadline 2024-08-18T22:18:19.123976+0000) 2024-08-18T22:18:35.514 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:35 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:35.237+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.825923+0000 front 2024-08-18T22:18:01.826015+0000 (oldest deadline 2024-08-18T22:18:24.126035+0000) 2024-08-18T22:18:35.515 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:35 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7[39451]: 2024-08-18T22:18:35.237+0000 7f1b35e31640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.528418+0000 front 2024-08-18T22:18:11.528461+0000 (oldest deadline 2024-08-18T22:18:33.228544+0000) 2024-08-18T22:18:35.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:35 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:35.505+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:35.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:35 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:35.505+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:35.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:35 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:35.505+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:35.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:35 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:35.505+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:35.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:35 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:35.505+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:35.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:35 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:35.714+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:35.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:35 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:35.714+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:35.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:35 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:35.714+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:35.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:35 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:35.714+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:35.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:35 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:35.649+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:35.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:35 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:35.649+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:35.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:35 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:35.649+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:35.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:35 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:35.649+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:07.229409+0000 front 2024-08-18T22:18:07.229533+0000 (oldest deadline 2024-08-18T22:18:32.529369+0000) 2024-08-18T22:18:36.264 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:36 smithi130 podman[56532]: 2024-08-18 22:18:36.130390734 +0000 UTC m=+5.704119953 container died 41ce6b637b66d8dff88f52e9ef81c3a59a7d8dcbfe324d5b25749b73818df067 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-18T22:18:36.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:35 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:35.957+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:36.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:35 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:35.957+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:36.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:35 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:35.957+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:36.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:35 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:35.957+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:36.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:35 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:35.957+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:36.766 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:36 smithi130 podman[56532]: 2024-08-18 22:18:36.513935494 +0000 UTC m=+6.087664704 container cleanup 41ce6b637b66d8dff88f52e9ef81c3a59a7d8dcbfe324d5b25749b73818df067 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-18T22:18:36.766 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:36 smithi130 bash[56532]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7 2024-08-18T22:18:36.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:36 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:36.657+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:36.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:36 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:36.657+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:36.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:36 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:36.657+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:36.909 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:36 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:36.657+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:07.229409+0000 front 2024-08-18T22:18:07.229533+0000 (oldest deadline 2024-08-18T22:18:32.529369+0000) 2024-08-18T22:18:36.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:36 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:36.722+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:36.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:36 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:36.722+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:36.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:36 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:36.722+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:36.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:36 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:36.722+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:37.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:36 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:36.542+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:37.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:36 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:36.542+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:37.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:36 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:36.542+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:37.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:36 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:36.542+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:37.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:36 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:36.542+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:37.087 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:36 smithi130 podman[56549]: 2024-08-18 22:18:36.765207055 +0000 UTC m=+0.635331918 container remove 41ce6b637b66d8dff88f52e9ef81c3a59a7d8dcbfe324d5b25749b73818df067 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-18T22:18:37.088 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:36 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:36.928+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:37.088 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:36 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:36.928+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:37.088 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:36 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:36.928+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:37.088 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:36 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:36.928+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:37.088 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:36 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:36.928+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:37.369 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:37 smithi130 podman[56637]: 2024-08-18 22:18:36.989822898 +0000 UTC m=+0.017366436 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:18:37.370 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:37 smithi130 podman[56637]: 2024-08-18 22:18:37.107953488 +0000 UTC m=+0.135497020 container create bf2493f10b2862fe0b5e9ad7dbfcaf4d7f9eedf68f265d735095e4b65e9a5c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-08-18T22:18:37.765 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:37 smithi130 podman[56637]: 2024-08-18 22:18:37.369458258 +0000 UTC m=+0.397001800 container init bf2493f10b2862fe0b5e9ad7dbfcaf4d7f9eedf68f265d735095e4b65e9a5c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0) 2024-08-18T22:18:37.765 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:37 smithi130 podman[56637]: 2024-08-18 22:18:37.373187813 +0000 UTC m=+0.400731346 container start bf2493f10b2862fe0b5e9ad7dbfcaf4d7f9eedf68f265d735095e4b65e9a5c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-08-18T22:18:37.765 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:37 smithi130 podman[56637]: 2024-08-18 22:18:37.460781673 +0000 UTC m=+0.488325211 container attach bf2493f10b2862fe0b5e9ad7dbfcaf4d7f9eedf68f265d735095e4b65e9a5c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0) 2024-08-18T22:18:37.765 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 18 22:18:37 smithi130 podman[56637]: 2024-08-18 22:18:37.561552436 +0000 UTC m=+0.589095981 container died bf2493f10b2862fe0b5e9ad7dbfcaf4d7f9eedf68f265d735095e4b65e9a5c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-7-deactivate, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-08-18T22:18:37.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:37 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:37.683+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:37.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:37 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:37.683+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:37.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:37 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:37.683+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:37.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:37 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:37.683+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:37.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:37 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:37.615+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:37.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:37 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:37.615+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:37.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:37 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:37.615+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:37.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:37 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:37.615+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:07.229409+0000 front 2024-08-18T22:18:07.229533+0000 (oldest deadline 2024-08-18T22:18:32.529369+0000) 2024-08-18T22:18:38.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:37 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:37.565+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:38.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:37 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:37.565+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:38.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:37 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:37.565+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:38.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:37 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:37.565+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:38.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:37 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:37.565+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:38.214 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:37 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:37.901+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:38.215 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:37 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:37.901+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:38.215 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:37 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:37.901+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:38.215 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:37 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:37.901+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:38.215 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:37 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:37.901+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:38.244 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.7.service' 2024-08-18T22:18:38.286 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:18:38.286 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-08-18T22:18:38.286 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-08-18T22:18:38.287 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.8 2024-08-18T22:18:38.609 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:38 smithi183 systemd[1]: Stopping Ceph osd.8 for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:18:38.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:38 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:38.675+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:38.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:38 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:38.675+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:38.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:38 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:38.675+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:38.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:38 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:38.675+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:38.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:38 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:38.607+0000 7fe7672fa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:18:38.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:38 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:38.607+0000 7fe7672fa640 -1 osd.8 100 *** Got signal Terminated *** 2024-08-18T22:18:38.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:38 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:38.607+0000 7fe7672fa640 -1 osd.8 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:18:38.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:38 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:38.613+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:38.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:38 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:38.613+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:38.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:38 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:38.613+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:38.911 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:38 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:38.613+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:07.229409+0000 front 2024-08-18T22:18:07.229533+0000 (oldest deadline 2024-08-18T22:18:32.529369+0000) 2024-08-18T22:18:39.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:38 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:38.564+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:39.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:38 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:38.564+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:39.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:38 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:38.564+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:39.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:38 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:38.564+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:39.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:38 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:38.564+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:39.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:38 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:38.902+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:39.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:38 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:38.902+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:39.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:38 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:38.902+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:39.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:38 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:38.902+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:39.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:38 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:38.902+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:39.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:39 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:39.673+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:39.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:39 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:39.673+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:39.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:39 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:39.673+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:39.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:39 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:39.673+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:39.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:39 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:39.604+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:39.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:39 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:39.604+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:39.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:39 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:39.604+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:39.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:39 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:39.604+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:07.229409+0000 front 2024-08-18T22:18:07.229533+0000 (oldest deadline 2024-08-18T22:18:32.529369+0000) 2024-08-18T22:18:40.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:39 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:39.550+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:40.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:39 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:39.550+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:40.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:39 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:39.550+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:40.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:39 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:39.550+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:40.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:39 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:39.550+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:40.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:39 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:39.877+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:40.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:39 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:39.877+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:40.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:39 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:39.877+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:40.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:39 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:39.877+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:40.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:39 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:39.877+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:40.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:40 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:40.670+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:40.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:40 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:40.670+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:40.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:40 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:40.670+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:40.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:40 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:40.670+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:40.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:40 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:40.623+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:40.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:40 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:40.623+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:40.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:40 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:40.623+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:40.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:40 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:40.623+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:07.229409+0000 front 2024-08-18T22:18:07.229533+0000 (oldest deadline 2024-08-18T22:18:32.529369+0000) 2024-08-18T22:18:41.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:40 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:40.529+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:41.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:40 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:40.529+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:41.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:40 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:40.529+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:41.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:40 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:40.529+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:41.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:40 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:40.529+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:41.266 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:40 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:40.848+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:41.266 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:40 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:40.848+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:41.266 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:40 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:40.848+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:41.266 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:40 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:40.848+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:41.267 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:40 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:40.848+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:41.752 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:41 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:41.486+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:41.752 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:41 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:41.486+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:41.753 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:41 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:41.486+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:41.753 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:41 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:41.486+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:41.753 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:41 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:41.486+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:41.753 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:41 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:41.486+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.403835+0000 front 2024-08-18T22:18:18.403928+0000 (oldest deadline 2024-08-18T22:18:41.303705+0000) 2024-08-18T22:18:42.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:41 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:41.706+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:42.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:41 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:41.706+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:42.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:41 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:41.706+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:42.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:41 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:41.706+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:42.160 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:41 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:41.666+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:42.160 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:41 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:41.666+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:42.160 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:41 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:41.666+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:42.160 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:41 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:41.666+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:07.229409+0000 front 2024-08-18T22:18:07.229533+0000 (oldest deadline 2024-08-18T22:18:32.529369+0000) 2024-08-18T22:18:42.160 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:41 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:41.666+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.330893+0000 front 2024-08-18T22:18:18.330951+0000 (oldest deadline 2024-08-18T22:18:41.231066+0000) 2024-08-18T22:18:42.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:41 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:41.803+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:42.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:41 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:41.803+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:42.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:41 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:41.803+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:42.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:41 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:41.803+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:42.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:41 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:41.803+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:42.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:42 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:42.733+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:42.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:42 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:42.733+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:42.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:42 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:42.733+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:42.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:42 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:42.733+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:42.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:42 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:42.649+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.025173+0000 front 2024-08-18T22:17:38.025207+0000 (oldest deadline 2024-08-18T22:17:59.725215+0000) 2024-08-18T22:18:42.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:42 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:42.649+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.527652+0000 front 2024-08-18T22:17:55.527604+0000 (oldest deadline 2024-08-18T22:18:21.928410+0000) 2024-08-18T22:18:42.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:42 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:42.649+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:18:01.928905+0000 front 2024-08-18T22:18:01.928920+0000 (oldest deadline 2024-08-18T22:18:27.228897+0000) 2024-08-18T22:18:42.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:42 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:42.649+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:07.229409+0000 front 2024-08-18T22:18:07.229533+0000 (oldest deadline 2024-08-18T22:18:32.529369+0000) 2024-08-18T22:18:42.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:42 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8[40272]: 2024-08-18T22:18:42.649+0000 7fe75f908640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.330893+0000 front 2024-08-18T22:18:18.330951+0000 (oldest deadline 2024-08-18T22:18:41.231066+0000) 2024-08-18T22:18:43.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:42 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:42.514+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:43.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:42 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:42.514+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:43.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:42 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:42.514+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:43.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:42 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:42.514+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:43.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:42 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:42.514+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:43.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:42 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:42.514+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.403835+0000 front 2024-08-18T22:18:18.403928+0000 (oldest deadline 2024-08-18T22:18:41.303705+0000) 2024-08-18T22:18:43.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:42 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:42.842+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:43.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:42 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:42.842+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:43.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:42 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:42.842+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:43.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:42 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:42.842+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:43.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:42 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:42.842+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:44.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:43 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:43.541+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:44.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:43 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:43.541+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:44.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:43 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:43.541+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:44.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:43 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:43.541+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:44.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:43 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:43.541+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:44.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:43 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:43.541+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.403835+0000 front 2024-08-18T22:18:18.403928+0000 (oldest deadline 2024-08-18T22:18:41.303705+0000) 2024-08-18T22:18:44.157 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:43 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:43.686+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:44.158 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:43 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:43.686+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:44.158 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:43 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:43.686+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:44.158 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:43 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:43.686+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:44.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:43 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:43.833+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:44.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:43 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:43.833+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:44.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:43 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:43.833+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:44.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:43 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:43.833+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:44.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:43 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:43.833+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:44.409 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:44 smithi183 podman[57209]: 2024-08-18 22:18:44.157256115 +0000 UTC m=+5.668398901 container died 6626e1b4c59cb8eb66b9da8b86a749e85a9ebdc3e1e78601c182718f73306072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-18T22:18:44.852 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:44 smithi183 podman[57209]: 2024-08-18 22:18:44.566686655 +0000 UTC m=+6.077829438 container cleanup 6626e1b4c59cb8eb66b9da8b86a749e85a9ebdc3e1e78601c182718f73306072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:18:44.852 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:44 smithi183 bash[57209]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8 2024-08-18T22:18:44.852 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:44 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:44.685+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:44.852 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:44 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:44.685+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:44.853 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:44 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:44.685+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:44.853 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:44 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:44.685+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:44.853 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:44 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:44.685+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:18:45.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:44 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:44.557+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:45.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:44 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:44.557+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:45.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:44 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:44.557+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:45.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:44 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:44.557+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:45.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:44 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:44.557+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:45.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:44 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:44.557+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.403835+0000 front 2024-08-18T22:18:18.403928+0000 (oldest deadline 2024-08-18T22:18:41.303705+0000) 2024-08-18T22:18:45.159 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:44 smithi183 podman[57226]: 2024-08-18 22:18:44.851370378 +0000 UTC m=+0.689090852 container remove 6626e1b4c59cb8eb66b9da8b86a749e85a9ebdc3e1e78601c182718f73306072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-18T22:18:45.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:44 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:44.864+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:45.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:44 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:44.864+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:45.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:44 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:44.864+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:45.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:44 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:44.864+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:45.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:44 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:44.864+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:45.622 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:45 smithi183 podman[57312]: 2024-08-18 22:18:45.261176817 +0000 UTC m=+0.017359164 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:18:45.622 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:45 smithi183 podman[57312]: 2024-08-18 22:18:45.377373685 +0000 UTC m=+0.133556067 container create 71c19905d9658b61ef09fcd3f027b6056413814b61a3a2193bc2379bb45b893e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8-deactivate, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-08-18T22:18:45.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:45 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:45.637+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:45.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:45 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:45.637+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:45.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:45 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:45.637+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:45.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:45 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:45.637+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:45.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:45 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:45.637+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:18:45.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:45 smithi183 podman[57312]: 2024-08-18 22:18:45.621557177 +0000 UTC m=+0.377739523 container init 71c19905d9658b61ef09fcd3f027b6056413814b61a3a2193bc2379bb45b893e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-08-18T22:18:45.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:45 smithi183 podman[57312]: 2024-08-18 22:18:45.625316191 +0000 UTC m=+0.381498533 container start 71c19905d9658b61ef09fcd3f027b6056413814b61a3a2193bc2379bb45b893e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8-deactivate, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:18:45.910 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:45 smithi183 podman[57312]: 2024-08-18 22:18:45.712852977 +0000 UTC m=+0.469035333 container attach 71c19905d9658b61ef09fcd3f027b6056413814b61a3a2193bc2379bb45b893e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8-deactivate, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-18T22:18:45.911 INFO:journalctl@ceph.osd.8.smithi183.stdout:Aug 18 22:18:45 smithi183 podman[57312]: 2024-08-18 22:18:45.814658416 +0000 UTC m=+0.570840757 container died 71c19905d9658b61ef09fcd3f027b6056413814b61a3a2193bc2379bb45b893e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-de09dd0, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:18:46.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:45 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:45.542+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:46.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:45 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:45.542+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:46.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:45 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:45.542+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:46.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:45 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:45.542+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:46.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:45 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:45.542+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:46.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:45 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:45.542+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.403835+0000 front 2024-08-18T22:18:18.403928+0000 (oldest deadline 2024-08-18T22:18:41.303705+0000) 2024-08-18T22:18:46.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:45 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:45.885+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:46.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:45 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:45.885+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:46.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:45 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:45.885+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:46.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:45 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:45.885+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:46.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:45 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:45.885+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:46.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:45 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:45.885+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:19.234365+0000 front 2024-08-18T22:18:19.234456+0000 (oldest deadline 2024-08-18T22:18:45.134246+0000) 2024-08-18T22:18:46.417 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.8.service' 2024-08-18T22:18:46.458 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:18:46.459 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-08-18T22:18:46.459 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-08-18T22:18:46.459 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.9 2024-08-18T22:18:46.659 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:46 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:46.607+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:46.659 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:46 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:46.607+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:46.659 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:46 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:46.607+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:46.660 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:46 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:46.607+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:46.660 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:46 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:46.607+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:18:46.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:46 smithi123 systemd[1]: Stopping Ceph osd.9 for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:18:46.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:46 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:46.556+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:46.760 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:46 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:46.556+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:46.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:46 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:46.556+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:46.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:46 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:46.556+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:46.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:46 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:46.556+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:46.761 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:46 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:46.556+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.403835+0000 front 2024-08-18T22:18:18.403928+0000 (oldest deadline 2024-08-18T22:18:41.303705+0000) 2024-08-18T22:18:47.260 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:46 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:46.850+0000 7f9bfec00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:18:47.260 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:46 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:46.850+0000 7f9bfec00640 -1 osd.9 100 *** Got signal Terminated *** 2024-08-18T22:18:47.260 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:46 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:46.850+0000 7f9bfec00640 -1 osd.9 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:18:47.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:46 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:46.848+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:47.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:46 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:46.848+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:47.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:46 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:46.848+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:47.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:46 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:46.848+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:47.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:46 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:46.848+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:47.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:46 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:46.849+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:19.234365+0000 front 2024-08-18T22:18:19.234456+0000 (oldest deadline 2024-08-18T22:18:45.134246+0000) 2024-08-18T22:18:47.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:47 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:47.573+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:47.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:47 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:47.573+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:47.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:47 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:47.573+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:47.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:47 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:47.573+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:47.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:47 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:47.573+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:18:48.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:47 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:47.580+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:48.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:47 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:47.580+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:48.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:47 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:47.580+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:48.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:47 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:47.580+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:48.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:47 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:47.580+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:48.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:47 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:47.580+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.403835+0000 front 2024-08-18T22:18:18.403928+0000 (oldest deadline 2024-08-18T22:18:41.303705+0000) 2024-08-18T22:18:48.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:47 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:47.812+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:48.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:47 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:47.812+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:48.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:47 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:47.812+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:48.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:47 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:47.812+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:48.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:47 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:47.812+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:48.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:47 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:47.812+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:19.234365+0000 front 2024-08-18T22:18:19.234456+0000 (oldest deadline 2024-08-18T22:18:45.134246+0000) 2024-08-18T22:18:48.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:48 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:48.540+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:48.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:48 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:48.540+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:48.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:48 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:48.540+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:48.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:48 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:48.540+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:48.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:48 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:48.540+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:18:49.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:48.590+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:49.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:48.590+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:49.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:48.590+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:49.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:48.590+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:49.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:48.590+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:49.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:48 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:48.590+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.403835+0000 front 2024-08-18T22:18:18.403928+0000 (oldest deadline 2024-08-18T22:18:41.303705+0000) 2024-08-18T22:18:49.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:48 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:48.775+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:49.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:48 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:48.775+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:49.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:48 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:48.775+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:49.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:48 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:48.775+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:49.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:48 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:48.775+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:49.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:48 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:48.775+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:19.234365+0000 front 2024-08-18T22:18:19.234456+0000 (oldest deadline 2024-08-18T22:18:45.134246+0000) 2024-08-18T22:18:49.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:49 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:49.517+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:49.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:49 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:49.517+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:49.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:49 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:49.517+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:49.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:49 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:49.517+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:49.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:49 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:49.517+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:18:49.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:49 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:49.517+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:18:50.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:49 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:49.639+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:50.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:49 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:49.639+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:50.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:49 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:49.639+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:50.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:49 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:49.639+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:50.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:49 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:49.639+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:50.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:49 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:49.639+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.403835+0000 front 2024-08-18T22:18:18.403928+0000 (oldest deadline 2024-08-18T22:18:41.303705+0000) 2024-08-18T22:18:50.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:49 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:49.788+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:50.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:49 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:49.788+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:50.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:49 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:49.788+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:50.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:49 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:49.788+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:50.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:49 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:49.788+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:50.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:49 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:49.788+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:19.234365+0000 front 2024-08-18T22:18:19.234456+0000 (oldest deadline 2024-08-18T22:18:45.134246+0000) 2024-08-18T22:18:50.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:50 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:50.550+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:50.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:50 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:50.550+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:50.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:50 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:50.550+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:50.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:50 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:50.550+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:50.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:50 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:50.550+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:18:50.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:50 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:50.550+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:18:51.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:50 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:50.615+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:51.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:50 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:50.615+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:51.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:50 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:50.615+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:51.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:50 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:50.615+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:51.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:50 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:50.615+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:51.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:50 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:50.615+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.403835+0000 front 2024-08-18T22:18:18.403928+0000 (oldest deadline 2024-08-18T22:18:41.303705+0000) 2024-08-18T22:18:51.166 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:50 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:50.834+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:51.166 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:50 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:50.834+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:51.167 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:50 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:50.834+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:51.167 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:50 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:50.834+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:51.167 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:50 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:50.834+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:51.167 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:50 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:50.834+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:19.234365+0000 front 2024-08-18T22:18:19.234456+0000 (oldest deadline 2024-08-18T22:18:45.134246+0000) 2024-08-18T22:18:51.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:51 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:51.551+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:51.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:51 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:51.551+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:51.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:51 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:51.551+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:51.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:51 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:51.551+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:51.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:51 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:51.551+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:18:51.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:51 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:51.551+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:18:52.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:51.594+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:38.197515+0000 front 2024-08-18T22:17:38.197584+0000 (oldest deadline 2024-08-18T22:17:59.897634+0000) 2024-08-18T22:18:52.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:51.594+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:45.198598+0000 front 2024-08-18T22:17:45.198651+0000 (oldest deadline 2024-08-18T22:18:09.898623+0000) 2024-08-18T22:18:52.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:51.594+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.700537+0000 front 2024-08-18T22:17:55.700367+0000 (oldest deadline 2024-08-18T22:18:18.000382+0000) 2024-08-18T22:18:52.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:51.594+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.101176+0000 front 2024-08-18T22:17:59.101124+0000 (oldest deadline 2024-08-18T22:18:25.501825+0000) 2024-08-18T22:18:52.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:51.594+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:09.002890+0000 front 2024-08-18T22:18:09.002850+0000 (oldest deadline 2024-08-18T22:18:32.502747+0000) 2024-08-18T22:18:52.011 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:51 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9[50109]: 2024-08-18T22:18:51.594+0000 7f9bfb216640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.403835+0000 front 2024-08-18T22:18:18.403928+0000 (oldest deadline 2024-08-18T22:18:41.303705+0000) 2024-08-18T22:18:52.186 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:51 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:51.843+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:52.187 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:51 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:51.843+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:52.187 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:51 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:51.843+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:52.187 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:51 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:51.843+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:52.187 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:51 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:51.843+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:52.187 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:51 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:51.843+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:19.234365+0000 front 2024-08-18T22:18:19.234456+0000 (oldest deadline 2024-08-18T22:18:45.134246+0000) 2024-08-18T22:18:52.187 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:51 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:51.843+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:27.335582+0000 front 2024-08-18T22:18:27.335629+0000 (oldest deadline 2024-08-18T22:18:50.835486+0000) 2024-08-18T22:18:52.628 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:52 smithi123 podman[189388]: 2024-08-18 22:18:52.340403985 +0000 UTC m=+5.677578185 container died 63859c9ce86c68ee2a301109af16f877dfa17553943ac1f602605d482cc4f781 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-18T22:18:52.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:52 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:52.588+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:52.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:52 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:52.588+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:52.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:52 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:52.588+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:52.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:52 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:52.588+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:52.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:52 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:52.588+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:18:52.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:52 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:52.588+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:18:52.986 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:52 smithi123 podman[189388]: 2024-08-18 22:18:52.793095245 +0000 UTC m=+6.130269488 container cleanup 63859c9ce86c68ee2a301109af16f877dfa17553943ac1f602605d482cc4f781 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-18T22:18:52.986 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:52 smithi123 bash[189388]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9 2024-08-18T22:18:53.260 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:52 smithi123 podman[189403]: 2024-08-18 22:18:52.986012208 +0000 UTC m=+0.635610315 container remove 63859c9ce86c68ee2a301109af16f877dfa17553943ac1f602605d482cc4f781 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:18:53.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:52 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:52.811+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:53.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:52 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:52.811+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:53.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:52 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:52.811+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:53.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:52 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:52.811+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:53.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:52 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:52.811+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:53.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:52 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:52.811+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:19.234365+0000 front 2024-08-18T22:18:19.234456+0000 (oldest deadline 2024-08-18T22:18:45.134246+0000) 2024-08-18T22:18:53.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:52 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:52.811+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:27.335582+0000 front 2024-08-18T22:18:27.335629+0000 (oldest deadline 2024-08-18T22:18:50.835486+0000) 2024-08-18T22:18:53.698 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:53 smithi123 podman[189493]: 2024-08-18 22:18:53.313454084 +0000 UTC m=+0.017246733 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:18:53.698 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:53 smithi123 podman[189493]: 2024-08-18 22:18:53.41181094 +0000 UTC m=+0.115603582 container create 96ee7a54760e5c7f236127175918c0b9eb8b1421d48bf09b6c43613be274a7c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0) 2024-08-18T22:18:53.698 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:53 smithi123 podman[189493]: 2024-08-18 22:18:53.61429501 +0000 UTC m=+0.318087652 container init 96ee7a54760e5c7f236127175918c0b9eb8b1421d48bf09b6c43613be274a7c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-18T22:18:53.698 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:53 smithi123 podman[189493]: 2024-08-18 22:18:53.617542058 +0000 UTC m=+0.321334703 container start 96ee7a54760e5c7f236127175918c0b9eb8b1421d48bf09b6c43613be274a7c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9-deactivate, RELEASE=squid-de09dd0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-18T22:18:53.699 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:53 smithi123 podman[189493]: 2024-08-18 22:18:53.697421503 +0000 UTC m=+0.401214148 container attach 96ee7a54760e5c7f236127175918c0b9eb8b1421d48bf09b6c43613be274a7c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:18:53.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:53 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:53.586+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:53.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:53 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:53.586+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:53.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:53 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:53.586+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:53.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:53 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:53.586+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:53.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:53 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:53.586+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:18:53.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:53 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:53.586+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:18:54.010 INFO:journalctl@ceph.osd.9.smithi123.stdout:Aug 18 22:18:53 smithi123 podman[189493]: 2024-08-18 22:18:53.803252459 +0000 UTC m=+0.507045102 container died 96ee7a54760e5c7f236127175918c0b9eb8b1421d48bf09b6c43613be274a7c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-18T22:18:54.264 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:53 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:53.763+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:54.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:53 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:53.763+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:54.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:53 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:53.763+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:54.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:53 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:53.763+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:54.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:53 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:53.763+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:54.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:53 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:53.763+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:19.234365+0000 front 2024-08-18T22:18:19.234456+0000 (oldest deadline 2024-08-18T22:18:45.134246+0000) 2024-08-18T22:18:54.265 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:53 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:53.763+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:27.335582+0000 front 2024-08-18T22:18:27.335629+0000 (oldest deadline 2024-08-18T22:18:50.835486+0000) 2024-08-18T22:18:54.488 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.9.service' 2024-08-18T22:18:54.526 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:18:54.527 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-08-18T22:18:54.527 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-08-18T22:18:54.527 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.10 2024-08-18T22:18:54.867 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:54 smithi130 systemd[1]: Stopping Ceph osd.10 for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:18:54.867 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:54 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:54.749+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:54.867 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:54 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:54.749+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:54.867 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:54 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:54.749+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:54.868 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:54 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:54.749+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:54.868 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:54 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:54.749+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:54.868 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:54 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:54.749+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:19.234365+0000 front 2024-08-18T22:18:19.234456+0000 (oldest deadline 2024-08-18T22:18:45.134246+0000) 2024-08-18T22:18:54.868 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:54 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:54.749+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:27.335582+0000 front 2024-08-18T22:18:27.335629+0000 (oldest deadline 2024-08-18T22:18:50.835486+0000) 2024-08-18T22:18:54.868 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:54 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:54.865+0000 7fc213e9a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:18:54.869 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:54 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:54.865+0000 7fc213e9a640 -1 osd.10 100 *** Got signal Terminated *** 2024-08-18T22:18:54.869 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:54 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:54.865+0000 7fc213e9a640 -1 osd.10 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:18:54.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:54 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:54.631+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:54.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:54 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:54.631+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:54.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:54 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:54.631+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:54.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:54 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:54.631+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:54.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:54 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:54.631+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:18:54.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:54 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:54.631+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:18:55.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:55 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:55.647+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:55.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:55 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:55.647+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:55.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:55 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:55.647+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:55.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:55 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:55.647+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:55.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:55 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:55.647+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:18:55.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:55 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:55.647+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:18:56.014 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:55 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:55.756+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:56.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:55 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:55.756+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:56.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:55 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:55.756+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:56.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:55 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:55.756+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:56.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:55 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:55.756+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:56.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:55 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:55.756+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:19.234365+0000 front 2024-08-18T22:18:19.234456+0000 (oldest deadline 2024-08-18T22:18:45.134246+0000) 2024-08-18T22:18:56.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:55 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:55.756+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:27.335582+0000 front 2024-08-18T22:18:27.335629+0000 (oldest deadline 2024-08-18T22:18:50.835486+0000) 2024-08-18T22:18:56.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:56 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:56.642+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:56.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:56 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:56.642+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:56.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:56 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:56.642+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:56.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:56 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:56.642+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:56.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:56 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:56.642+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:18:56.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:56 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:56.642+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:18:57.014 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:56 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:56.718+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:57.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:56 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:56.718+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:57.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:56 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:56.718+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:57.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:56 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:56.718+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:57.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:56 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:56.718+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:57.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:56 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:56.718+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:19.234365+0000 front 2024-08-18T22:18:19.234456+0000 (oldest deadline 2024-08-18T22:18:45.134246+0000) 2024-08-18T22:18:57.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:56 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:56.718+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:27.335582+0000 front 2024-08-18T22:18:27.335629+0000 (oldest deadline 2024-08-18T22:18:50.835486+0000) 2024-08-18T22:18:58.014 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:57 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:57.698+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:58.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:57 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:57.698+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:58.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:57 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:57.698+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:58.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:57 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:57.698+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:58.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:57 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:57.698+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:58.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:57 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:57.698+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:19.234365+0000 front 2024-08-18T22:18:19.234456+0000 (oldest deadline 2024-08-18T22:18:45.134246+0000) 2024-08-18T22:18:58.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:57 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:57.698+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:27.335582+0000 front 2024-08-18T22:18:27.335629+0000 (oldest deadline 2024-08-18T22:18:50.835486+0000) 2024-08-18T22:18:58.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:57 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:57.687+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:58.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:57 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:57.687+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:58.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:57 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:57.687+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:58.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:57 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:57.687+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:58.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:57 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:57.687+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:18:58.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:57 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:57.687+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:18:59.014 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:58 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:58.700+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:18:59.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:58 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:58.700+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:18:59.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:58 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:58.700+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:18:59.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:58 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:58.700+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:18:59.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:58 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:58.700+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:18:59.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:58 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:58.700+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:19.234365+0000 front 2024-08-18T22:18:19.234456+0000 (oldest deadline 2024-08-18T22:18:45.134246+0000) 2024-08-18T22:18:59.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:58 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:58.700+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:27.335582+0000 front 2024-08-18T22:18:27.335629+0000 (oldest deadline 2024-08-18T22:18:50.835486+0000) 2024-08-18T22:18:59.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:58 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:58.727+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:18:59.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:58 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:58.727+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:18:59.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:58 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:58.727+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:18:59.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:58 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:58.727+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:18:59.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:58 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:58.727+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:18:59.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:58 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:58.727+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:19:00.014 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:59 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:59.673+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:37.728902+0000 front 2024-08-18T22:17:37.728933+0000 (oldest deadline 2024-08-18T22:18:03.628617+0000) 2024-08-18T22:19:00.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:59 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:59.673+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.430006+0000 front 2024-08-18T22:17:46.430029+0000 (oldest deadline 2024-08-18T22:18:10.530167+0000) 2024-08-18T22:19:00.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:59 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:59.673+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:55.231299+0000 front 2024-08-18T22:17:55.231260+0000 (oldest deadline 2024-08-18T22:18:19.331225+0000) 2024-08-18T22:19:00.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:59 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:59.673+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-08-18T22:17:59.331755+0000 front 2024-08-18T22:17:59.331853+0000 (oldest deadline 2024-08-18T22:18:25.231716+0000) 2024-08-18T22:19:00.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:59 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:59.673+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.132825+0000 front 2024-08-18T22:18:11.132851+0000 (oldest deadline 2024-08-18T22:18:35.832868+0000) 2024-08-18T22:19:00.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:59 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:59.673+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:19.234365+0000 front 2024-08-18T22:18:19.234456+0000 (oldest deadline 2024-08-18T22:18:45.134246+0000) 2024-08-18T22:19:00.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:18:59 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10[46374]: 2024-08-18T22:18:59.673+0000 7fc20c4a8640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:27.335582+0000 front 2024-08-18T22:18:27.335629+0000 (oldest deadline 2024-08-18T22:18:50.835486+0000) 2024-08-18T22:19:00.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:59 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:59.677+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:19:00.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:59 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:59.678+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:19:00.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:59 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:59.678+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:19:00.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:59 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:59.678+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:19:00.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:59 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:59.678+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:19:00.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:59 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:59.678+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:19:00.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:18:59 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:18:59.678+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-18T22:18:32.871174+0000 front 2024-08-18T22:18:32.871155+0000 (oldest deadline 2024-08-18T22:18:58.771035+0000) 2024-08-18T22:19:00.651 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:19:00 smithi130 podman[56764]: 2024-08-18 22:19:00.344755626 +0000 UTC m=+5.608354338 container died 4a75d6241be9b068ee88fb9ef659b601258d9d0859e42e04df1355b19eb62dd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-18T22:19:01.014 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:19:00 smithi130 podman[56764]: 2024-08-18 22:19:00.732546655 +0000 UTC m=+5.996145363 container cleanup 4a75d6241be9b068ee88fb9ef659b601258d9d0859e42e04df1355b19eb62dd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:19:01.014 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:19:00 smithi130 bash[56764]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10 2024-08-18T22:19:01.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:00 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:00.661+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:19:01.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:00 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:00.661+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:19:01.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:00 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:00.661+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:19:01.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:00 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:00.661+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:19:01.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:00 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:00.661+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:19:01.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:00 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:00.661+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:19:01.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:00 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:00.661+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-18T22:18:32.871174+0000 front 2024-08-18T22:18:32.871155+0000 (oldest deadline 2024-08-18T22:18:58.771035+0000) 2024-08-18T22:19:01.360 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:19:01 smithi130 podman[56781]: 2024-08-18 22:19:01.037985015 +0000 UTC m=+0.694583193 container remove 4a75d6241be9b068ee88fb9ef659b601258d9d0859e42e04df1355b19eb62dd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-18T22:19:01.654 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:19:01 smithi130 podman[56875]: 2024-08-18 22:19:01.262346407 +0000 UTC m=+0.016979207 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:19:01.654 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:19:01 smithi130 podman[56875]: 2024-08-18 22:19:01.368007714 +0000 UTC m=+0.122640548 container create a75ff6fa28774ccf3773bd560d95e3bd28a6dd31d1e1e5f746289da447dca9ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-18T22:19:01.654 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:19:01 smithi130 podman[56875]: 2024-08-18 22:19:01.653761314 +0000 UTC m=+0.408394106 container init a75ff6fa28774ccf3773bd560d95e3bd28a6dd31d1e1e5f746289da447dca9ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-18T22:19:02.014 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:19:01 smithi130 podman[56875]: 2024-08-18 22:19:01.657172957 +0000 UTC m=+0.411805748 container start a75ff6fa28774ccf3773bd560d95e3bd28a6dd31d1e1e5f746289da447dca9ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2) 2024-08-18T22:19:02.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:19:01 smithi130 podman[56875]: 2024-08-18 22:19:01.711897004 +0000 UTC m=+0.466529801 container attach a75ff6fa28774ccf3773bd560d95e3bd28a6dd31d1e1e5f746289da447dca9ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:19:02.015 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 18 22:19:01 smithi130 podman[56875]: 2024-08-18 22:19:01.841918531 +0000 UTC m=+0.596551333 container died a75ff6fa28774ccf3773bd560d95e3bd28a6dd31d1e1e5f746289da447dca9ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0) 2024-08-18T22:19:02.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:01 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:01.661+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:19:02.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:01 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:01.661+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:19:02.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:01 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:01.661+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:19:02.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:01 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:01.661+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:19:02.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:01 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:01.661+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:19:02.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:01 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:01.661+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:19:02.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:01 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:01.661+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-18T22:18:32.871174+0000 front 2024-08-18T22:18:32.871155+0000 (oldest deadline 2024-08-18T22:18:58.771035+0000) 2024-08-18T22:19:02.405 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.10.service' 2024-08-18T22:19:02.443 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:19:02.443 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-08-18T22:19:02.444 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-08-18T22:19:02.444 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.11 2024-08-18T22:19:02.835 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:02 smithi183 systemd[1]: Stopping Ceph osd.11 for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:19:02.835 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:02 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:02.703+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:19:02.836 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:02 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:02.703+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:19:02.836 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:02 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:02.703+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:19:02.836 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:02 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:02.703+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:19:02.836 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:02 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:02.703+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:19:02.836 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:02 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:02.703+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:19:02.836 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:02 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:02.703+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-18T22:18:32.871174+0000 front 2024-08-18T22:18:32.871155+0000 (oldest deadline 2024-08-18T22:18:58.771035+0000) 2024-08-18T22:19:02.836 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:02 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:02.834+0000 7f8d78bbc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:19:02.836 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:02 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:02.834+0000 7f8d78bbc640 -1 osd.11 100 *** Got signal Terminated *** 2024-08-18T22:19:02.837 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:02 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:02.834+0000 7f8d78bbc640 -1 osd.11 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:19:04.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:03 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:03.683+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:19:04.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:03 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:03.683+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:19:04.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:03 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:03.683+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:19:04.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:03 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:03.683+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:19:04.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:03 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:03.683+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:19:04.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:03 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:03.683+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:19:04.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:03 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:03.683+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-18T22:18:32.871174+0000 front 2024-08-18T22:18:32.871155+0000 (oldest deadline 2024-08-18T22:18:58.771035+0000) 2024-08-18T22:19:05.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:04 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:04.686+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:19:05.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:04 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:04.686+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:19:05.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:04 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:04.686+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:19:05.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:04 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:04.686+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:19:05.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:04 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:04.686+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:19:05.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:04 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:04.686+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:19:05.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:04 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:04.686+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-18T22:18:32.871174+0000 front 2024-08-18T22:18:32.871155+0000 (oldest deadline 2024-08-18T22:18:58.771035+0000) 2024-08-18T22:19:05.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:04 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:04.686+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6820 osd.8 since back 2024-08-18T22:18:42.772207+0000 front 2024-08-18T22:18:42.772171+0000 (oldest deadline 2024-08-18T22:19:04.472366+0000) 2024-08-18T22:19:06.159 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:05.669+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:19:06.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:05.669+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:19:06.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:05.669+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:19:06.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:05.669+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:19:06.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:05.669+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:19:06.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:05.669+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:19:06.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:05.669+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-18T22:18:32.871174+0000 front 2024-08-18T22:18:32.871155+0000 (oldest deadline 2024-08-18T22:18:58.771035+0000) 2024-08-18T22:19:06.160 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:05 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:05.669+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6820 osd.8 since back 2024-08-18T22:18:42.772207+0000 front 2024-08-18T22:18:42.772171+0000 (oldest deadline 2024-08-18T22:19:04.472366+0000) 2024-08-18T22:19:06.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:06.643+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:19:06.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:06.643+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:19:06.909 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:06.643+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:19:06.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:06.643+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:19:06.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:06.643+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:19:06.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:06.643+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:19:06.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:06.643+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-18T22:18:32.871174+0000 front 2024-08-18T22:18:32.871155+0000 (oldest deadline 2024-08-18T22:18:58.771035+0000) 2024-08-18T22:19:06.910 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:06 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:06.643+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6820 osd.8 since back 2024-08-18T22:18:42.772207+0000 front 2024-08-18T22:18:42.772171+0000 (oldest deadline 2024-08-18T22:19:04.472366+0000) 2024-08-18T22:19:08.161 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:07 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:07.681+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-08-18T22:17:34.861709+0000 front 2024-08-18T22:17:34.861546+0000 (oldest deadline 2024-08-18T22:18:00.662021+0000) 2024-08-18T22:19:08.161 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:07 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:07.681+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-18T22:17:46.364213+0000 front 2024-08-18T22:17:46.364096+0000 (oldest deadline 2024-08-18T22:18:11.063992+0000) 2024-08-18T22:19:08.161 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:07 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:07.681+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-08-18T22:17:53.964821+0000 front 2024-08-18T22:17:53.964841+0000 (oldest deadline 2024-08-18T22:18:19.864961+0000) 2024-08-18T22:19:08.162 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:07 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:07.681+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-18T22:18:11.367962+0000 front 2024-08-18T22:18:11.367937+0000 (oldest deadline 2024-08-18T22:18:33.667972+0000) 2024-08-18T22:19:08.162 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:07 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:07.681+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-08-18T22:18:18.269177+0000 front 2024-08-18T22:18:18.269414+0000 (oldest deadline 2024-08-18T22:18:44.669753+0000) 2024-08-18T22:19:08.162 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:07 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:07.681+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-08-18T22:18:24.670328+0000 front 2024-08-18T22:18:24.670420+0000 (oldest deadline 2024-08-18T22:18:49.370056+0000) 2024-08-18T22:19:08.162 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:07 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:07.681+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-18T22:18:32.871174+0000 front 2024-08-18T22:18:32.871155+0000 (oldest deadline 2024-08-18T22:18:58.771035+0000) 2024-08-18T22:19:08.162 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:07 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11[46943]: 2024-08-18T22:19:07.681+0000 7f8d751d2640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.183:6820 osd.8 since back 2024-08-18T22:18:42.772207+0000 front 2024-08-18T22:18:42.772171+0000 (oldest deadline 2024-08-18T22:19:04.472366+0000) 2024-08-18T22:19:08.459 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:08 smithi183 podman[57425]: 2024-08-18 22:19:08.189406551 +0000 UTC m=+5.542061508 container died a1f858d346292c701207e3494b0345beca9eb46b77a5a80c48a51202f4899585 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-08-18T22:19:08.793 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:08 smithi183 podman[57425]: 2024-08-18 22:19:08.550484062 +0000 UTC m=+5.903139026 container cleanup a1f858d346292c701207e3494b0345beca9eb46b77a5a80c48a51202f4899585 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-18T22:19:08.793 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:08 smithi183 bash[57425]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11 2024-08-18T22:19:09.143 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:08 smithi183 podman[57442]: 2024-08-18 22:19:08.793124283 +0000 UTC m=+0.597816541 container remove a1f858d346292c701207e3494b0345beca9eb46b77a5a80c48a51202f4899585 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-08-18T22:19:09.396 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:09 smithi183 podman[57534]: 2024-08-18 22:19:09.045810328 +0000 UTC m=+0.017323769 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:19:09.396 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:09 smithi183 podman[57534]: 2024-08-18 22:19:09.177154879 +0000 UTC m=+0.148668310 container create 580a6cb49a9ca4f34ea93546554e4a6936e76187d69acd12e01b1d1762c96aa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:19:09.397 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:09 smithi183 podman[57534]: 2024-08-18 22:19:09.396018897 +0000 UTC m=+0.367532328 container init 580a6cb49a9ca4f34ea93546554e4a6936e76187d69acd12e01b1d1762c96aa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, ceph=True) 2024-08-18T22:19:09.659 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:09 smithi183 podman[57534]: 2024-08-18 22:19:09.399404516 +0000 UTC m=+0.370917948 container start 580a6cb49a9ca4f34ea93546554e4a6936e76187d69acd12e01b1d1762c96aa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-08-18T22:19:09.660 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:09 smithi183 podman[57534]: 2024-08-18 22:19:09.487538595 +0000 UTC m=+0.459052036 container attach 580a6cb49a9ca4f34ea93546554e4a6936e76187d69acd12e01b1d1762c96aa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_CLEAN=True) 2024-08-18T22:19:09.660 INFO:journalctl@ceph.osd.11.smithi183.stdout:Aug 18 22:19:09 smithi183 podman[57534]: 2024-08-18 22:19:09.59081229 +0000 UTC m=+0.562325721 container died 580a6cb49a9ca4f34ea93546554e4a6936e76187d69acd12e01b1d1762c96aa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-osd-11-deactivate, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:19:10.151 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@osd.11.service' 2024-08-18T22:19:10.191 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:19:10.191 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-08-18T22:19:10.191 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-08-18T22:19:10.192 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.a 2024-08-18T22:19:10.503 INFO:journalctl@ceph.mds.a.smithi123.stdout:Aug 18 22:19:10 smithi123 systemd[1]: Stopping Ceph mds.a for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:19:10.760 INFO:journalctl@ceph.mds.a.smithi123.stdout:Aug 18 22:19:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-a[56745]: 2024-08-18T22:19:10.501+0000 7f11d2b35640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:19:10.760 INFO:journalctl@ceph.mds.a.smithi123.stdout:Aug 18 22:19:10 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-a[56745]: 2024-08-18T22:19:10.501+0000 7f11d2b35640 -1 mds.a *** got signal Terminated *** 2024-08-18T22:19:13.419 INFO:journalctl@ceph.mds.a.smithi123.stdout:Aug 18 22:19:13 smithi123 podman[189594]: 2024-08-18 22:19:13.131803733 +0000 UTC m=+2.742007551 container died 9da9ee9cac777d0f26f3b46f24c380eb096b2d0d4536962f589beaca4d496fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-a, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.build-date=20240731) 2024-08-18T22:19:13.760 INFO:journalctl@ceph.mds.a.smithi123.stdout:Aug 18 22:19:13 smithi123 podman[189594]: 2024-08-18 22:19:13.59373486 +0000 UTC m=+3.203938719 container cleanup 9da9ee9cac777d0f26f3b46f24c380eb096b2d0d4536962f589beaca4d496fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-a, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-18T22:19:13.760 INFO:journalctl@ceph.mds.a.smithi123.stdout:Aug 18 22:19:13 smithi123 bash[189594]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-a 2024-08-18T22:19:14.013 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.a.service' 2024-08-18T22:19:14.050 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:19:14.050 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-08-18T22:19:14.050 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-08-18T22:19:14.050 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.d 2024-08-18T22:19:14.260 INFO:journalctl@ceph.mds.d.smithi123.stdout:Aug 18 22:19:14 smithi123 systemd[1]: Stopping Ceph mds.d for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:19:14.760 INFO:journalctl@ceph.mds.d.smithi123.stdout:Aug 18 22:19:14 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-d[55549]: 2024-08-18T22:19:14.372+0000 7fe4c54a7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:19:14.760 INFO:journalctl@ceph.mds.d.smithi123.stdout:Aug 18 22:19:14 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-d[55549]: 2024-08-18T22:19:14.372+0000 7fe4c54a7640 -1 mds.d *** got signal Terminated *** 2024-08-18T22:19:17.606 INFO:journalctl@ceph.mds.d.smithi123.stdout:Aug 18 22:19:17 smithi123 podman[189725]: 2024-08-18 22:19:17.302537923 +0000 UTC m=+3.023820733 container died ec3e4f2e0ff6d0e7a005163c563001019059c96832708c8eb90d9444a1cd5d8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0) 2024-08-18T22:19:17.982 INFO:journalctl@ceph.mds.d.smithi123.stdout:Aug 18 22:19:17 smithi123 podman[189725]: 2024-08-18 22:19:17.699520882 +0000 UTC m=+3.420803682 container cleanup ec3e4f2e0ff6d0e7a005163c563001019059c96832708c8eb90d9444a1cd5d8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-d, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:19:17.982 INFO:journalctl@ceph.mds.d.smithi123.stdout:Aug 18 22:19:17 smithi123 bash[189725]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-d 2024-08-18T22:19:18.147 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.d.service' 2024-08-18T22:19:18.180 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:19:18.181 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-08-18T22:19:18.181 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-08-18T22:19:18.181 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.g 2024-08-18T22:19:18.510 INFO:journalctl@ceph.mds.g.smithi123.stdout:Aug 18 22:19:18 smithi123 systemd[1]: Stopping Ceph mds.g for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:19:18.510 INFO:journalctl@ceph.mds.g.smithi123.stdout:Aug 18 22:19:18 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-g[56422]: 2024-08-18T22:19:18.484+0000 7f4fe29bb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:19:18.510 INFO:journalctl@ceph.mds.g.smithi123.stdout:Aug 18 22:19:18 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-g[56422]: 2024-08-18T22:19:18.484+0000 7f4fe29bb640 -1 mds.g *** got signal Terminated *** 2024-08-18T22:19:22.260 INFO:journalctl@ceph.mds.g.smithi123.stdout:Aug 18 22:19:21 smithi123 podman[189848]: 2024-08-18 22:19:21.998321238 +0000 UTC m=+3.591356669 container died 3d4cd7dae5adcce8b481e0267db3d7f8b9db5810f4f43ded45bb40476877d7e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-18T22:19:22.643 INFO:journalctl@ceph.mds.g.smithi123.stdout:Aug 18 22:19:22 smithi123 podman[189848]: 2024-08-18 22:19:22.384227496 +0000 UTC m=+3.977262941 container cleanup 3d4cd7dae5adcce8b481e0267db3d7f8b9db5810f4f43ded45bb40476877d7e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-18T22:19:22.644 INFO:journalctl@ceph.mds.g.smithi123.stdout:Aug 18 22:19:22 smithi123 bash[189848]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-g 2024-08-18T22:19:22.778 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.g.service' 2024-08-18T22:19:22.810 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:19:22.811 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-08-18T22:19:22.811 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-08-18T22:19:22.811 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.j 2024-08-18T22:19:23.260 INFO:journalctl@ceph.mds.j.smithi123.stdout:Aug 18 22:19:22 smithi123 systemd[1]: Stopping Ceph mds.j for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:19:23.260 INFO:journalctl@ceph.mds.j.smithi123.stdout:Aug 18 22:19:23 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-j[55135]: 2024-08-18T22:19:23.120+0000 7f502506c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:19:23.261 INFO:journalctl@ceph.mds.j.smithi123.stdout:Aug 18 22:19:23 smithi123 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-j[55135]: 2024-08-18T22:19:23.121+0000 7f502506c640 -1 mds.j *** got signal Terminated *** 2024-08-18T22:19:26.072 INFO:journalctl@ceph.mds.j.smithi123.stdout:Aug 18 22:19:25 smithi123 podman[189968]: 2024-08-18 22:19:25.793245567 +0000 UTC m=+2.754425428 container died 6f9c82a6bd43fab61c35321a903c486139c19e34467c35b1b165e8c6257c6310 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-j, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:19:26.439 INFO:journalctl@ceph.mds.j.smithi123.stdout:Aug 18 22:19:26 smithi123 podman[189968]: 2024-08-18 22:19:26.146476685 +0000 UTC m=+3.107656555 container cleanup 6f9c82a6bd43fab61c35321a903c486139c19e34467c35b1b165e8c6257c6310 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-j, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-18T22:19:26.439 INFO:journalctl@ceph.mds.j.smithi123.stdout:Aug 18 22:19:26 smithi123 bash[189968]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-j 2024-08-18T22:19:26.572 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.j.service' 2024-08-18T22:19:26.604 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:19:26.604 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-08-18T22:19:26.604 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-08-18T22:19:26.604 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.b 2024-08-18T22:19:26.907 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:19:26 smithi130 systemd[1]: Stopping Ceph mds.b for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:19:27.165 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:19:26 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:19:26.906+0000 7f888b1f1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:19:27.165 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:19:26 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b[51559]: 2024-08-18T22:19:26.906+0000 7f888b1f1640 -1 mds.b *** got signal Terminated *** 2024-08-18T22:19:31.257 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:19:30 smithi130 podman[56977]: 2024-08-18 22:19:30.922439823 +0000 UTC m=+4.115254771 container died f6df05a461af3e96e7ecff33104ed9ed979516f7f572b49aecd9c6c345ace9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-18T22:19:31.514 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:19:31 smithi130 podman[56977]: 2024-08-18 22:19:31.33959642 +0000 UTC m=+4.532411369 container cleanup f6df05a461af3e96e7ecff33104ed9ed979516f7f572b49aecd9c6c345ace9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:19:31.514 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:19:31 smithi130 bash[56977]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b 2024-08-18T22:19:31.818 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 18 22:19:31 smithi130 podman[57003]: 2024-08-18 22:19:31.566070529 +0000 UTC m=+0.645815131 container remove f6df05a461af3e96e7ecff33104ed9ed979516f7f572b49aecd9c6c345ace9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:19:31.834 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.b.service' 2024-08-18T22:19:31.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:19:31.872 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-08-18T22:19:31.872 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-08-18T22:19:31.872 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.e 2024-08-18T22:19:32.194 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:19:31 smithi130 systemd[1]: Stopping Ceph mds.e for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:19:32.514 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:19:32 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-e[50952]: 2024-08-18T22:19:32.193+0000 7f9727506640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:19:32.514 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:19:32 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-e[50952]: 2024-08-18T22:19:32.193+0000 7f9727506640 -1 mds.e *** got signal Terminated *** 2024-08-18T22:19:35.978 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:19:35 smithi130 podman[57110]: 2024-08-18 22:19:35.708622203 +0000 UTC m=+3.608869432 container died 615d28a876dac3c1396b54e55f4e339dd8c0d0f8f60308f1c858aa481bc6b2f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-08-18T22:19:36.264 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:19:36 smithi130 podman[57110]: 2024-08-18 22:19:36.076996373 +0000 UTC m=+3.977243589 container cleanup 615d28a876dac3c1396b54e55f4e339dd8c0d0f8f60308f1c858aa481bc6b2f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-de09dd0, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:19:36.265 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 18 22:19:36 smithi130 bash[57110]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-e 2024-08-18T22:19:36.515 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.e.service' 2024-08-18T22:19:36.548 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:19:36.549 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-08-18T22:19:36.549 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-08-18T22:19:36.549 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.h 2024-08-18T22:19:36.874 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 18 22:19:36 smithi130 systemd[1]: Stopping Ceph mds.h for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:19:37.264 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 18 22:19:36 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-h[51253]: 2024-08-18T22:19:36.871+0000 7f3776fc3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:19:37.264 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 18 22:19:36 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-h[51253]: 2024-08-18T22:19:36.872+0000 7f3776fc3640 -1 mds.h *** got signal Terminated *** 2024-08-18T22:19:40.014 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 18 22:19:39 smithi130 podman[57231]: 2024-08-18 22:19:39.709193822 +0000 UTC m=+2.936838251 container died cfb66ef090c7fd8af4adf4512148870d2ce5ad547e0a8f11b91ec2e00667f684 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:19:40.315 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 18 22:19:40 smithi130 podman[57231]: 2024-08-18 22:19:40.13050125 +0000 UTC m=+3.358145667 container cleanup cfb66ef090c7fd8af4adf4512148870d2ce5ad547e0a8f11b91ec2e00667f684 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-h, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-18T22:19:40.315 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 18 22:19:40 smithi130 bash[57231]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-h 2024-08-18T22:19:40.572 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 18 22:19:40 smithi130 podman[57243]: 2024-08-18 22:19:40.314869877 +0000 UTC m=+0.599117178 container remove cfb66ef090c7fd8af4adf4512148870d2ce5ad547e0a8f11b91ec2e00667f684 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-h, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-18T22:19:40.576 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.h.service' 2024-08-18T22:19:40.608 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:19:40.608 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-08-18T22:19:40.608 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-08-18T22:19:40.609 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.k 2024-08-18T22:19:40.943 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 18 22:19:40 smithi130 systemd[1]: Stopping Ceph mds.k for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:19:41.264 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 18 22:19:40 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-k[50638]: 2024-08-18T22:19:40.941+0000 7fccdd063640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:19:41.264 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 18 22:19:40 smithi130 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-k[50638]: 2024-08-18T22:19:40.941+0000 7fccdd063640 -1 mds.k *** got signal Terminated *** 2024-08-18T22:19:43.264 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 18 22:19:42 smithi130 podman[57351]: 2024-08-18 22:19:42.889485317 +0000 UTC m=+2.057318395 container died e654da7fc33446ebff63d29c2a06acf374f188a681b251f47f563fb4eec29876 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-18T22:19:43.618 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 18 22:19:43 smithi130 podman[57351]: 2024-08-18 22:19:43.358988741 +0000 UTC m=+2.526821815 container cleanup e654da7fc33446ebff63d29c2a06acf374f188a681b251f47f563fb4eec29876 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-k, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-18T22:19:43.619 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 18 22:19:43 smithi130 bash[57351]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-k 2024-08-18T22:19:43.802 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.k.service' 2024-08-18T22:19:43.833 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:19:43.833 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-08-18T22:19:43.834 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-08-18T22:19:43.834 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.c 2024-08-18T22:19:44.159 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:19:43 smithi183 systemd[1]: Stopping Ceph mds.c for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:19:44.419 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:19:44 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-c[51930]: 2024-08-18T22:19:44.230+0000 7f0ad5ddd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:19:44.419 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:19:44 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-c[51930]: 2024-08-18T22:19:44.230+0000 7f0ad5ddd640 -1 mds.c *** got signal Terminated *** 2024-08-18T22:19:48.106 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:19:47 smithi183 podman[57639]: 2024-08-18 22:19:47.715149512 +0000 UTC m=+3.682716444 container died f3078d6d77023e0f9f25572eb6f78f199f28bc7ac5bcced94cfa02d272a5fd87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-c, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:19:48.409 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:19:48 smithi183 podman[57639]: 2024-08-18 22:19:48.187897051 +0000 UTC m=+4.155463985 container cleanup f3078d6d77023e0f9f25572eb6f78f199f28bc7ac5bcced94cfa02d272a5fd87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-c, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-18T22:19:48.409 INFO:journalctl@ceph.mds.c.smithi183.stdout:Aug 18 22:19:48 smithi183 bash[57639]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-c 2024-08-18T22:19:48.629 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.c.service' 2024-08-18T22:19:48.666 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:19:48.667 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-08-18T22:19:48.667 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-08-18T22:19:48.667 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.f 2024-08-18T22:19:49.159 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:19:48 smithi183 systemd[1]: Stopping Ceph mds.f for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:19:49.159 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:19:48 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-f[51628]: 2024-08-18T22:19:48.992+0000 7ff23e535640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:19:49.159 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:19:48 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-f[51628]: 2024-08-18T22:19:48.992+0000 7ff23e535640 -1 mds.f *** got signal Terminated *** 2024-08-18T22:19:51.985 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:19:51 smithi183 podman[57774]: 2024-08-18 22:19:51.71695679 +0000 UTC m=+2.825717889 container died d92ded7cbce38e995fe69ad3ff07ddb47c1c81cdef101afd90953b05423a0336 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-18T22:19:52.334 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:19:52 smithi183 podman[57774]: 2024-08-18 22:19:52.066585819 +0000 UTC m=+3.175346906 container cleanup d92ded7cbce38e995fe69ad3ff07ddb47c1c81cdef101afd90953b05423a0336 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0) 2024-08-18T22:19:52.334 INFO:journalctl@ceph.mds.f.smithi183.stdout:Aug 18 22:19:52 smithi183 bash[57774]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-f 2024-08-18T22:19:52.507 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.f.service' 2024-08-18T22:19:52.540 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:19:52.540 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-08-18T22:19:52.540 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-08-18T22:19:52.540 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.i 2024-08-18T22:19:52.854 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:19:52 smithi183 systemd[1]: Stopping Ceph mds.i for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:19:53.159 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:19:52 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: 2024-08-18T22:19:52.853+0000 7f026792a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:19:53.159 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:19:52 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i[52232]: 2024-08-18T22:19:52.853+0000 7f026792a640 -1 mds.i *** got signal Terminated *** 2024-08-18T22:19:55.987 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:19:55 smithi183 podman[57894]: 2024-08-18 22:19:55.718275071 +0000 UTC m=+2.957531259 container died 9f6d80154c0d34ec5c7306b1b7d9b35a14e87213db1228fb4ca1ee3a2f08948d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-18T22:19:56.337 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:19:56 smithi183 podman[57894]: 2024-08-18 22:19:56.103144269 +0000 UTC m=+3.342400447 container cleanup 9f6d80154c0d34ec5c7306b1b7d9b35a14e87213db1228fb4ca1ee3a2f08948d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-18T22:19:56.338 INFO:journalctl@ceph.mds.i.smithi183.stdout:Aug 18 22:19:56 smithi183 bash[57894]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-i 2024-08-18T22:19:56.471 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.i.service' 2024-08-18T22:19:56.503 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:19:56.503 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-08-18T22:19:56.504 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-08-18T22:19:56.504 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.l 2024-08-18T22:19:56.659 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:19:56 smithi183 systemd[1]: Stopping Ceph mds.l for dfa1db70-5dac-11ef-bccf-c7b262605968... 2024-08-18T22:19:57.159 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:19:56 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-l[51316]: 2024-08-18T22:19:56.831+0000 7faad0c73640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:19:57.159 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:19:56 smithi183 ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-l[51316]: 2024-08-18T22:19:56.831+0000 7faad0c73640 -1 mds.l *** got signal Terminated *** 2024-08-18T22:20:00.468 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:20:00 smithi183 podman[58013]: 2024-08-18 22:20:00.24185824 +0000 UTC m=+3.511920693 container died 44d1e94f470eecddc02126c12753f39ea1e73f94adefc5610b76ba8da9681ac3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-l, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-18T22:20:00.760 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:20:00 smithi183 podman[58013]: 2024-08-18 22:20:00.550185127 +0000 UTC m=+3.820247579 container cleanup 44d1e94f470eecddc02126c12753f39ea1e73f94adefc5610b76ba8da9681ac3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-18T22:20:00.760 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:20:00 smithi183 bash[58013]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-l 2024-08-18T22:20:00.996 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.l.service' 2024-08-18T22:20:01.017 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:20:00 smithi183 podman[58027]: 2024-08-18 22:20:00.759379686 +0000 UTC m=+0.519775421 container remove 44d1e94f470eecddc02126c12753f39ea1e73f94adefc5610b76ba8da9681ac3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-dfa1db70-5dac-11ef-bccf-c7b262605968-mds-l, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-18T22:20:01.018 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:20:00 smithi183 systemd[1]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.l.service: Deactivated successfully. 2024-08-18T22:20:01.018 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:20:00 smithi183 systemd[1]: Stopped Ceph mds.l for dfa1db70-5dac-11ef-bccf-c7b262605968. 2024-08-18T22:20:01.018 INFO:journalctl@ceph.mds.l.smithi183.stdout:Aug 18 22:20:00 smithi183 systemd[1]: ceph-dfa1db70-5dac-11ef-bccf-c7b262605968@mds.l.service: Consumed 1.064s CPU time. 2024-08-18T22:20:01.029 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:20:01.030 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-08-18T22:20:01.030 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-18T22:20:01.236 INFO:teuthology.orchestra.run.smithi123.stdout:Deleting cluster with fsid: dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T22:20:03.973 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-18T22:20:04.179 INFO:teuthology.orchestra.run.smithi130.stdout:Deleting cluster with fsid: dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T22:20:06.664 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-18T22:20:06.867 INFO:teuthology.orchestra.run.smithi183.stdout:Deleting cluster with fsid: dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T22:20:09.149 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-18T22:20:09.182 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-18T22:20:09.215 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-18T22:20:09.241 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-18T22:20:09.244 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859907/remote/smithi123/crash 2024-08-18T22:20:09.244 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/crash -- . 2024-08-18T22:20:09.283 INFO:teuthology.orchestra.run.smithi123.stderr:tar: /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-18T22:20:09.283 INFO:teuthology.orchestra.run.smithi123.stderr:tar: Error is not recoverable: exiting now 2024-08-18T22:20:09.285 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859907/remote/smithi130/crash 2024-08-18T22:20:09.286 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/crash -- . 2024-08-18T22:20:09.420 INFO:teuthology.orchestra.run.smithi130.stderr:tar: /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-18T22:20:09.421 INFO:teuthology.orchestra.run.smithi130.stderr:tar: Error is not recoverable: exiting now 2024-08-18T22:20:09.423 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859907/remote/smithi183/crash 2024-08-18T22:20:09.424 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/crash -- . 2024-08-18T22:20:09.461 INFO:teuthology.orchestra.run.smithi183.stderr:tar: /var/lib/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-18T22:20:09.461 INFO:teuthology.orchestra.run.smithi183.stderr:tar: Error is not recoverable: exiting now 2024-08-18T22:20:09.462 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-18T22:20:09.462 DEBUG:teuthology.orchestra.run.smithi123:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-18T22:20:09.541 INFO:teuthology.orchestra.run.smithi123.stdout:2024-08-18T22:13:17.408563+0000 mds.b (mds.1) 2 : cluster [WRN] Scrub error on inode 0x100000050c4 (/volumes/qa/sv_1/3c5bf679-9fc9-4b23-a362-547f70607235/client.0/tmp/testdir/dir1/dir2/file5001) see mds.b log and `damage ls` output for details 2024-08-18T22:20:09.541 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-08-18T22:20:09.541 INFO:tasks.cephadm:Compressing logs... 2024-08-18T22:20:09.542 DEBUG:teuthology.orchestra.run.smithi123:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-18T22:20:09.544 DEBUG:teuthology.orchestra.run.smithi130:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-18T22:20:09.547 DEBUG:teuthology.orchestra.run.smithi183:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-18T22:20:09.571 INFO:teuthology.orchestra.run.smithi183.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-18T22:20:09.572 INFO:teuthology.orchestra.run.smithi183.stderr:: No such file or directory 2024-08-18T22:20:09.572 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mgr.z.log 2024-08-18T22:20:09.572 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.2.log 2024-08-18T22:20:09.572 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.11.log 2024-08-18T22:20:09.575 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.f.log 2024-08-18T22:20:09.575 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-18T22:20:09.575 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-18T22:20:09.575 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.8.log 2024-08-18T22:20:09.575 INFO:teuthology.orchestra.run.smithi183.stderr: 82.7%/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.audit.log: -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-18T22:20:09.575 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.i.log 2024-08-18T22:20:09.575 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.8.log: -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.c.log 2024-08-18T22:20:09.577 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.i.log: 90.5% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-18T22:20:09.577 INFO:teuthology.orchestra.run.smithi130.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-18T22:20:09.578 INFO:teuthology.orchestra.run.smithi130.stderr:: No such file or directory 2024-08-18T22:20:09.578 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.e.log 2024-08-18T22:20:09.578 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.h.log 2024-08-18T22:20:09.578 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-18T22:20:09.579 INFO:teuthology.orchestra.run.smithi183.stderr: 92.8% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mgr.z.log.gz 2024-08-18T22:20:09.581 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-18T22:20:09.581 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.b.log 2024-08-18T22:20:09.582 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.cephadm.log: /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.audit.log: 82.7% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-18T22:20:09.582 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.10.log 2024-08-18T22:20:09.582 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.4.log 2024-08-18T22:20:09.582 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.k.log 2024-08-18T22:20:09.582 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mon.b.log 2024-08-18T22:20:09.582 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.k.log: 90.4% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-18T22:20:09.582 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mgr.y.log 2024-08-18T22:20:09.583 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mon.b.log: 94.6% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.k.log.gz 2024-08-18T22:20:09.584 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.7.log 2024-08-18T22:20:09.585 INFO:teuthology.orchestra.run.smithi183.stderr: 90.9% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-18T22:20:09.586 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.5.log 2024-08-18T22:20:09.586 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.log 2024-08-18T22:20:09.586 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mon.c.log 2024-08-18T22:20:09.588 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mgr.y.log: 90.9% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-18T22:20:09.588 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.log: 87.9% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-18T22:20:09.589 INFO:teuthology.orchestra.run.smithi123.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory -5 2024-08-18T22:20:09.589 INFO:teuthology.orchestra.run.smithi123.stderr: --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-18T22:20:09.590 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.l.log 2024-08-18T22:20:09.591 INFO:teuthology.orchestra.run.smithi130.stderr: 92.7% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mgr.y.log.gz 2024-08-18T22:20:09.592 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.1.log 2024-08-18T22:20:09.592 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.log 2024-08-18T22:20:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.3.log 2024-08-18T22:20:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.d.log 2024-08-18T22:20:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-volume.log: /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mgr.x.log 2024-08-18T22:20:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-18T22:20:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-18T22:20:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mon.a.log 2024-08-18T22:20:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.a.log 2024-08-18T22:20:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.9.log 2024-08-18T22:20:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.6.log 2024-08-18T22:20:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.j.log 2024-08-18T22:20:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.0.log 2024-08-18T22:20:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.log 2024-08-18T22:20:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.g.log 2024-08-18T22:20:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-18T22:20:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-08-18T22:20:09.602 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-18T22:20:09.603 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-18T22:20:09.606 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.log: 87.9% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-18T22:20:09.619 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-18T22:20:09.620 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.l.log: 94.6% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.l.log.gz 2024-08-18T22:20:09.622 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-18T22:20:09.660 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.admin.log: 87.9% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-18T22:20:09.743 INFO:teuthology.orchestra.run.smithi123.stderr: 94.8% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.d.log.gz 2024-08-18T22:20:09.744 INFO:teuthology.orchestra.run.smithi123.stderr: 94.8% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.a.log.gz 2024-08-18T22:20:09.745 INFO:teuthology.orchestra.run.smithi123.stderr: 94.9% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.j.log.gz 2024-08-18T22:20:09.770 INFO:teuthology.orchestra.run.smithi123.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-08-18T22:20:09.777 INFO:teuthology.orchestra.run.smithi123.stderr: 82.7% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-18T22:20:09.777 INFO:teuthology.orchestra.run.smithi123.stderr: 90.3% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-18T22:20:09.788 INFO:teuthology.orchestra.run.smithi123.stderr: 94.7% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.g.log.gz 2024-08-18T22:20:09.842 INFO:teuthology.orchestra.run.smithi123.stderr: 94.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-18T22:20:09.873 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-18T22:20:09.986 INFO:teuthology.orchestra.run.smithi130.stderr: 91.8% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mon.b.log.gz 2024-08-18T22:20:10.012 INFO:teuthology.orchestra.run.smithi183.stderr: 91.7% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mon.c.log.gz 2024-08-18T22:20:10.722 INFO:teuthology.orchestra.run.smithi123.stderr: 90.0% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mgr.x.log.gz 2024-08-18T22:20:13.867 INFO:teuthology.orchestra.run.smithi123.stderr: 90.4% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mon.a.log.gz 2024-08-18T22:20:14.830 INFO:teuthology.orchestra.run.smithi130.stderr: 95.3% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.h.log.gz 2024-08-18T22:20:15.285 INFO:teuthology.orchestra.run.smithi130.stderr: 95.4% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.e.log.gz 2024-08-18T22:20:18.152 INFO:teuthology.orchestra.run.smithi183.stderr: 95.2% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.f.log.gz 2024-08-18T22:20:24.495 INFO:teuthology.orchestra.run.smithi130.stderr: 92.3% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.10.log.gz 2024-08-18T22:20:24.895 INFO:teuthology.orchestra.run.smithi183.stderr: 92.0% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.11.log.gz 2024-08-18T22:20:25.407 INFO:teuthology.orchestra.run.smithi130.stderr: 92.0% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.7.log.gz 2024-08-18T22:20:25.665 INFO:teuthology.orchestra.run.smithi130.stderr: 92.0% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.1.log.gz 2024-08-18T22:20:26.867 INFO:teuthology.orchestra.run.smithi123.stderr: 91.9% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.6.log.gz 2024-08-18T22:20:27.924 INFO:teuthology.orchestra.run.smithi123.stderr: 92.1% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.0.log.gz 2024-08-18T22:20:28.208 INFO:teuthology.orchestra.run.smithi123.stderr: 92.0% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.9.log.gz 2024-08-18T22:20:28.850 INFO:teuthology.orchestra.run.smithi183.stderr: 92.0% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.8.log.gz 2024-08-18T22:20:29.421 INFO:teuthology.orchestra.run.smithi130.stderr: 92.1% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.4.log.gz 2024-08-18T22:20:30.783 INFO:teuthology.orchestra.run.smithi123.stderr: 92.0% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.3.log.gz 2024-08-18T22:20:30.785 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-08-18T22:20:30.786 INFO:teuthology.orchestra.run.smithi123.stderr:real 0m21.227s 2024-08-18T22:20:30.786 INFO:teuthology.orchestra.run.smithi123.stderr:user 0m58.056s 2024-08-18T22:20:30.786 INFO:teuthology.orchestra.run.smithi123.stderr:sys 0m2.019s 2024-08-18T22:20:31.737 INFO:teuthology.orchestra.run.smithi183.stderr: 91.9% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.2.log.gz 2024-08-18T22:20:32.714 INFO:teuthology.orchestra.run.smithi183.stderr: 91.9% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-osd.5.log.gz 2024-08-18T22:21:02.970 INFO:teuthology.orchestra.run.smithi130.stderr: 93.5% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.b.log.gz 2024-08-18T22:21:02.972 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-08-18T22:21:02.972 INFO:teuthology.orchestra.run.smithi130.stderr:real 0m53.409s 2024-08-18T22:21:02.972 INFO:teuthology.orchestra.run.smithi130.stderr:user 2m7.301s 2024-08-18T22:21:02.972 INFO:teuthology.orchestra.run.smithi130.stderr:sys 0m3.863s 2024-08-18T22:21:10.545 INFO:teuthology.orchestra.run.smithi183.stderr: 93.5% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.c.log.gz 2024-08-18T22:21:42.547 INFO:teuthology.orchestra.run.smithi183.stderr: 93.6% -- replaced with /var/log/ceph/dfa1db70-5dac-11ef-bccf-c7b262605968/ceph-mds.i.log.gz 2024-08-18T22:21:42.549 INFO:teuthology.orchestra.run.smithi183.stderr: 2024-08-18T22:21:42.549 INFO:teuthology.orchestra.run.smithi183.stderr:real 1m32.987s 2024-08-18T22:21:42.549 INFO:teuthology.orchestra.run.smithi183.stderr:user 3m55.173s 2024-08-18T22:21:42.549 INFO:teuthology.orchestra.run.smithi183.stderr:sys 0m7.209s 2024-08-18T22:21:42.550 INFO:tasks.cephadm:Archiving logs... 2024-08-18T22:21:42.551 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859907/remote/smithi123/log 2024-08-18T22:21:42.552 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-18T22:21:52.381 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859907/remote/smithi130/log 2024-08-18T22:21:52.382 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-18T22:22:09.375 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859907/remote/smithi183/log 2024-08-18T22:22:09.376 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-18T22:22:39.989 INFO:tasks.cephadm:Removing cluster... 2024-08-18T22:22:39.990 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 --force 2024-08-18T22:22:40.195 INFO:teuthology.orchestra.run.smithi123.stdout:Deleting cluster with fsid: dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T22:22:40.534 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 --force 2024-08-18T22:22:40.736 INFO:teuthology.orchestra.run.smithi130.stdout:Deleting cluster with fsid: dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T22:22:41.138 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dfa1db70-5dac-11ef-bccf-c7b262605968 --force 2024-08-18T22:22:41.336 INFO:teuthology.orchestra.run.smithi183.stdout:Deleting cluster with fsid: dfa1db70-5dac-11ef-bccf-c7b262605968 2024-08-18T22:22:41.851 INFO:tasks.cephadm:Removing cephadm ... 2024-08-18T22:22:41.851 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-18T22:22:41.871 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-18T22:22:41.890 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-18T22:22:41.906 INFO:tasks.cephadm:Teardown complete 2024-08-18T22:22:41.906 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-18T22:22:41.917 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-18T22:22:41.917 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-18T22:22:41.920 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-18T22:22:41.932 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-18T22:22:42.048 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-18T22:22:42.059 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-18T22:22:42.059 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T22:22:42.063 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T22:22:42.065 DEBUG:teuthology.orchestra.run.smithi183:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T22:22:42.077 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-08-18T22:22:42.077 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-08-18T22:22:42.079 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2024-08-18T22:22:42.080 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-18T22:22:42.080 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-08-18T22:22:42.081 INFO:teuthology.orchestra.run.smithi130.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 +483us[ +488us] +/- 64ms 2024-08-18T22:22:42.081 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 -644us[ -644us] +/- 57ms 2024-08-18T22:22:42.081 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 +309us[ +309us] +/- 74ms 2024-08-18T22:22:42.081 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T22:22:42.082 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-18T22:22:42.083 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-08-18T22:22:42.083 INFO:teuthology.orchestra.run.smithi123.stdout:^* hv01.front.sepia.ceph.com 3 6 377 41 +478us[ +495us] +/- 64ms 2024-08-18T22:22:42.083 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 -640us[ -623us] +/- 57ms 2024-08-18T22:22:42.083 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +307us[ +324us] +/- 74ms 2024-08-18T22:22:42.083 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T22:22:42.084 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-18T22:22:42.084 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-08-18T22:22:42.084 INFO:teuthology.orchestra.run.smithi183.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 +475us[ +486us] +/- 64ms 2024-08-18T22:22:42.084 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 -643us[ -632us] +/- 57ms 2024-08-18T22:22:42.085 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +300us[ +310us] +/- 74ms 2024-08-18T22:22:42.085 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T22:22:42.085 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-18T22:22:42.102 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-18T22:22:42.103 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-18T22:22:42.120 DEBUG:teuthology.orchestra.run.smithi123:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-18T22:22:42.440 DEBUG:teuthology.orchestra.run.smithi130:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-18T22:22:42.494 DEBUG:teuthology.orchestra.run.smithi183:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-18T22:22:42.548 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T22:22:42.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:22:42.580 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T22:22:42.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:22:42.606 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T22:22:42.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:22:42.633 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-18T22:22:42.655 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-18T22:22:42.667 INFO:teuthology.task.internal:Duration was 1725.859584 seconds 2024-08-18T22:22:42.668 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-18T22:22:42.679 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-18T22:22:42.679 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-18T22:22:42.682 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-18T22:22:42.684 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-18T22:22:42.720 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T22:22:42.722 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T22:22:42.776 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T22:22:43.102 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-18T22:22:43.103 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2024-08-18T22:22:43.103 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-18T22:22:43.126 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2024-08-18T22:22:43.126 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-18T22:22:43.157 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi183.front.sepia.ceph.com 2024-08-18T22:22:43.157 DEBUG:teuthology.orchestra.run.smithi183:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-18T22:22:43.185 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-18T22:22:43.185 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-18T22:22:43.188 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-18T22:22:43.199 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-18T22:22:43.252 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-18T22:22:43.252 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-18T22:22:43.257 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-18T22:22:43.266 DEBUG:teuthology.orchestra.run.smithi183:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-18T22:22:44.115 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-18T22:22:44.129 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-18T22:22:44.129 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-18T22:22:44.154 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-18T22:22:44.182 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-18T22:22:44.210 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-18T22:22:44.221 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-18T22:22:44.224 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-18T22:22:44.226 DEBUG:teuthology.orchestra.run.smithi183:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-18T22:22:44.250 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2024-08-18T22:22:44.257 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2024-08-18T22:22:44.276 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = core 2024-08-18T22:22:44.308 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-18T22:22:44.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:22:44.331 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-18T22:22:44.347 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:22:44.347 DEBUG:teuthology.orchestra.run.smithi183:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-18T22:22:44.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:22:44.363 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-18T22:22:44.376 INFO:teuthology.task.internal:Transferring archived files... 2024-08-18T22:22:44.377 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859907/remote/smithi123 2024-08-18T22:22:44.377 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-18T22:22:44.428 DEBUG:teuthology.misc:Transferring archived files from smithi130:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859907/remote/smithi130 2024-08-18T22:22:44.429 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-18T22:22:44.464 DEBUG:teuthology.misc:Transferring archived files from smithi183:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859907/remote/smithi183 2024-08-18T22:22:44.464 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-18T22:22:44.498 INFO:teuthology.task.internal:Removing archive directory... 2024-08-18T22:22:44.498 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-18T22:22:44.501 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-18T22:22:44.503 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-18T22:22:44.549 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-18T22:22:44.561 INFO:teuthology.task.internal:Not uploading archives. 2024-08-18T22:22:44.561 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-18T22:22:44.573 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-18T22:22:44.573 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-18T22:22:44.575 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-18T22:22:44.578 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-18T22:22:44.588 INFO:teuthology.orchestra.run.smithi123.stdout: 262218 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 18 22:22 /home/ubuntu/cephtest 2024-08-18T22:22:44.591 INFO:teuthology.orchestra.run.smithi130.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 18 22:22 /home/ubuntu/cephtest 2024-08-18T22:22:44.604 INFO:teuthology.orchestra.run.smithi183.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 18 22:22 /home/ubuntu/cephtest 2024-08-18T22:22:44.605 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-18T22:22:44.617 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-18T22:22:44.645 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/misc}} duration: 1725.8595836162567 failure_reason: 'Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi123 with status 11: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh''' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=2d9c45e9e6194bcfb522864712786d30 status: fail success: false 2024-08-18T22:22:44.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-18T22:22:44.756 INFO:teuthology.run:FAIL